2024-04-25T23:41:38.440 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T23:41:38.440 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841 --name teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi --description rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} --verbose --owner scheduled_teuthology@teuthology -- /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/orig.config.yaml 2024-04-25T23:41:38.473 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T23:41:38.556 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841 branch: squid description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} email: ceph-qa@ceph.com first_in_suite: false job_id: '7673841' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: squid ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 1 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos service trim min: 5 osd: bluestore block size: 96636764160 bluestore compression algorithm: lz4 bluestore compression mode: aggressive bluestore fsck on mount: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(TOO_FEW_PGS\) - \(POOL_APP_NOT_ENABLED\) - but it is still running - overall HEALTH_ - \(PG_ - \(MON_DOWN\) - \(AUTH_BAD_CAPS\) mon_bind_msgr2: false sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a owner: scheduled_teuthology@teuthology priority: 101 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 9886 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 30270/100000 suite: rados suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: b22e2ebdeb24376882b7bda2a7329c8cccc2276a targets: smithi106.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDXz2N5HH/vrYk1GKeLOFf20PxNozA8TuZXj9xeF7zNk3FtOupkVbbRqJlhhCO25rA3+XDZh0PRL9Whr3DI5yZU= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHIo9ZsjU8lmoHAV5btKh3fKiQ7rBuA6Er9u3x89BAf9lk0hIuO9t7sPcB003NtknVKg3qvmzn8sqstFEGuNaE= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 store_thrash: true thrash_delay: 1 thrash_many: true - workunit: clients: client.0: - mon/pool_ops.sh - mon/crush_ops.sh - mon/osd.sh - mon/caps.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-25_21:00:03 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T23:41:38.556 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa; will attempt to use it 2024-04-25T23:41:38.557 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa/tasks 2024-04-25T23:41:38.557 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T23:41:38.558 INFO:teuthology.task.internal:Checking packages... 2024-04-25T23:41:38.586 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T23:41:38.587 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T23:41:38.587 INFO:teuthology.packaging:ref: None 2024-04-25T23:41:38.587 INFO:teuthology.packaging:tag: None 2024-04-25T23:41:38.587 INFO:teuthology.packaging:branch: squid 2024-04-25T23:41:38.587 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T23:41:38.587 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=squid 2024-04-25T23:41:38.866 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2447-gb22e2ebd-1jammy 2024-04-25T23:41:38.868 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T23:41:38.876 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T23:41:38.876 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T23:41:38.883 INFO:teuthology.task.internal:Saving configuration 2024-04-25T23:41:38.895 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T23:41:38.901 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T23:41:38.927 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi106.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 23:35:41.228195', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJWwH7wnyFLKu0Wmyd2VNNv4iC+ryCJpdvq9YBy3wcln'} 2024-04-25T23:41:38.951 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 23:35:41.229757', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIJ/AQM+G9BISpUKQAdfBQdRbBRV99NC57Q39VAhRYuLK'} 2024-04-25T23:41:38.952 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T23:41:38.958 INFO:teuthology.task.internal:roles: ubuntu@smithi106.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2024-04-25T23:41:38.958 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-04-25T23:41:38.958 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T23:41:39.029 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdec2c99280>, signals=[15]) 2024-04-25T23:41:39.030 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T23:41:39.036 INFO:teuthology.task.internal:Opening connections... 2024-04-25T23:41:39.036 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi106.front.sepia.ceph.com 2024-04-25T23:41:39.038 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:41:39.119 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-04-25T23:41:39.120 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:41:39.199 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T23:41:39.206 DEBUG:teuthology.orchestra.run.smithi106:> uname -m 2024-04-25T23:41:39.211 INFO:teuthology.orchestra.run.smithi106.stdout:x86_64 2024-04-25T23:41:39.212 DEBUG:teuthology.orchestra.run.smithi106:> cat /etc/os-release 2024-04-25T23:41:39.257 INFO:teuthology.orchestra.run.smithi106.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T23:41:39.257 INFO:teuthology.orchestra.run.smithi106.stdout:NAME="Ubuntu" 2024-04-25T23:41:39.257 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_ID="22.04" 2024-04-25T23:41:39.257 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:VERSION_CODENAME=jammy 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:ID=ubuntu 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:ID_LIKE=debian 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T23:41:39.258 INFO:teuthology.orchestra.run.smithi106.stdout:UBUNTU_CODENAME=jammy 2024-04-25T23:41:39.259 INFO:teuthology.lock.ops:Updating smithi106.front.sepia.ceph.com on lock server 2024-04-25T23:41:39.283 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-04-25T23:41:39.288 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-04-25T23:41:39.288 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-04-25T23:41:39.336 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-25T23:41:39.336 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2024-04-25T23:41:39.336 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="22.04" 2024-04-25T23:41:39.336 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-25T23:41:39.336 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=jammy 2024-04-25T23:41:39.336 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2024-04-25T23:41:39.336 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2024-04-25T23:41:39.337 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-25T23:41:39.337 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-25T23:41:39.337 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-25T23:41:39.337 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-25T23:41:39.337 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=jammy 2024-04-25T23:41:39.337 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-04-25T23:41:39.357 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T23:41:39.366 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T23:41:39.372 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T23:41:39.372 DEBUG:teuthology.orchestra.run.smithi106:> test '!' -e /home/ubuntu/cephtest 2024-04-25T23:41:39.375 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-04-25T23:41:39.384 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T23:41:39.390 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T23:41:39.390 DEBUG:teuthology.orchestra.run.smithi106:> test -z $(ls -A /var/lib/ceph) 2024-04-25T23:41:39.422 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-04-25T23:41:39.443 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T23:41:39.497 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T23:41:39.512 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T23:41:39.512 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.f': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T23:41:39.513 DEBUG:teuthology.orchestra.run.smithi106:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T23:41:39.513 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T23:41:39.517 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:41:39.518 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-25T23:41:39.519 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:41:39.519 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-04-25T23:41:39.564 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-56-generic 2024-04-25T23:41:39.564 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.15.0-56-generic 2024-04-25T23:41:39.565 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get clean 2024-04-25T23:41:39.566 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-56-generic 2024-04-25T23:41:39.566 INFO:teuthology.task.kernel:Running kernel on smithi106: 5.15.0-56-generic 2024-04-25T23:41:39.566 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2024-04-25T23:41:39.697 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-04-25T23:41:39.737 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-04-25T23:41:39.832 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T23:41:39.898 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T23:41:39.901 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T23:41:39.901 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-25T23:41:39.940 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T23:41:39.985 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T23:41:40.022 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-25T23:41:40.065 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T23:41:40.127 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-25T23:41:40.145 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T23:41:40.191 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T23:41:40.195 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T23:41:40.196 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T23:41:40.197 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T23:41:40.208 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,394 kB] 2024-04-25T23:41:40.224 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T23:41:40.224 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T23:41:40.228 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T23:41:40.228 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T23:41:40.237 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T23:41:40.244 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T23:41:40.245 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T23:41:40.245 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T23:41:40.245 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T23:41:40.258 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-25T23:41:40.266 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-25T23:41:40.266 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-25T23:41:40.267 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,773 kB] 2024-04-25T23:41:40.284 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T23:41:40.284 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T23:41:40.291 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [300 kB] 2024-04-25T23:41:40.294 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T23:41:40.294 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-25T23:41:40.301 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-25T23:41:40.310 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-25T23:41:40.311 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-25T23:41:40.341 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-25T23:41:40.341 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T23:41:40.342 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-25T23:41:40.342 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-25T23:41:40.342 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-25T23:41:40.352 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T23:41:40.357 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T23:41:40.358 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T23:41:40.374 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-25T23:41:40.388 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T23:41:40.388 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T23:41:40.393 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T23:41:40.393 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T23:41:40.401 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T23:41:40.412 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T23:41:40.414 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T23:41:40.414 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T23:41:40.415 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T23:41:40.422 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T23:41:40.422 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T23:41:40.422 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T23:41:40.423 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T23:41:40.436 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T23:41:40.437 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T23:41:40.437 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T23:41:40.437 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T23:41:40.437 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T23:41:40.442 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T23:41:40.514 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-25T23:41:40.713 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-25T23:41:40.863 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-25T23:41:40.878 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-25T23:41:40.878 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-25T23:41:40.880 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-25T23:41:40.942 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-25T23:41:40.949 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-25T23:41:41.113 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-25T23:41:41.692 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,071 kB] 2024-04-25T23:41:41.803 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-25T23:41:41.823 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-25T23:41:41.825 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-25T23:41:41.826 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-25T23:41:41.829 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-25T23:41:41.829 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-25T23:41:41.830 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-04-25T23:41:41.833 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-25T23:41:41.838 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-25T23:41:42.002 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-25T23:41:42.086 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-25T23:41:42.167 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-25T23:41:42.249 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-25T23:41:42.281 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-25T23:41:45.922 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 13.2 MB in 2s (7,234 kB/s) 2024-04-25T23:41:46.684 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 13.2 MB in 3s (5,251 kB/s) 2024-04-25T23:41:47.450 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-04-25T23:41:47.468 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T23:41:47.531 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-04-25T23:41:47.715 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-04-25T23:41:47.716 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-04-25T23:41:47.870 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T23:41:47.871 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T23:41:47.871 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T23:41:47.871 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T23:41:47.871 INFO:teuthology.orchestra.run.smithi171.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T23:41:47.871 INFO:teuthology.orchestra.run.smithi171.stdout: python2.7-minimal 2024-04-25T23:41:47.871 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T23:41:47.872 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-04-25T23:41:47.872 INFO:teuthology.orchestra.run.smithi171.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T23:41:47.872 INFO:teuthology.orchestra.run.smithi171.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T23:41:47.873 INFO:teuthology.orchestra.run.smithi171.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T23:41:47.874 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-04-25T23:41:47.874 INFO:teuthology.orchestra.run.smithi171.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T23:41:47.874 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2024-04-25T23:41:47.874 INFO:teuthology.orchestra.run.smithi171.stdout: thermald 2024-04-25T23:41:47.918 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-04-25T23:41:47.918 INFO:teuthology.orchestra.run.smithi171.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T23:41:47.918 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T23:41:47.918 INFO:teuthology.orchestra.run.smithi171.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T23:41:47.919 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages will be upgraded: 2024-04-25T23:41:47.920 INFO:teuthology.orchestra.run.smithi171.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T23:41:47.979 INFO:teuthology.orchestra.run.smithi171.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T23:41:47.979 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 113 MB of archives. 2024-04-25T23:41:47.979 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T23:41:47.979 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T23:41:48.196 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-25T23:41:48.215 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T23:41:48.270 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-25T23:41:48.404 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T23:41:48.469 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-04-25T23:41:48.470 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-04-25T23:41:48.527 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T23:41:48.636 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T23:41:48.636 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T23:41:48.636 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T23:41:48.637 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T23:41:48.637 INFO:teuthology.orchestra.run.smithi106.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-25T23:41:48.637 INFO:teuthology.orchestra.run.smithi106.stdout: python2.7-minimal 2024-04-25T23:41:48.637 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T23:41:48.638 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-04-25T23:41:48.638 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T23:41:48.638 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-25T23:41:48.638 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-25T23:41:48.639 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-04-25T23:41:48.639 INFO:teuthology.orchestra.run.smithi106.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-25T23:41:48.640 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2024-04-25T23:41:48.640 INFO:teuthology.orchestra.run.smithi106.stdout: thermald 2024-04-25T23:41:48.677 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-04-25T23:41:48.677 INFO:teuthology.orchestra.run.smithi106.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-25T23:41:48.677 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-25T23:41:48.678 INFO:teuthology.orchestra.run.smithi106.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-25T23:41:48.679 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages will be upgraded: 2024-04-25T23:41:48.679 INFO:teuthology.orchestra.run.smithi106.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-25T23:41:48.753 INFO:teuthology.orchestra.run.smithi106.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T23:41:48.753 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 113 MB of archives. 2024-04-25T23:41:48.753 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-25T23:41:48.754 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-25T23:41:49.547 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-25T23:41:49.699 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-25T23:41:49.766 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T23:41:49.766 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T23:41:49.767 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T23:41:50.074 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T23:41:50.120 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T23:41:50.511 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 113 MB in 2s (51.7 MB/s) 2024-04-25T23:41:50.678 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T23:41:51.098 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-25T23:41:51.099 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-25T23:41:51.099 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-25T23:41:51.308 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-25T23:41:51.466 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-25T23:41:51.847 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 113 MB in 3s (40.8 MB/s) 2024-04-25T23:41:52.030 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-25T23:41:52.773 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T23:41:52.777 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:41:52.896 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:41:54.021 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-25T23:41:54.025 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:41:54.093 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:41:55.153 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T23:41:55.175 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:41:55.257 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:41:55.766 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T23:41:55.786 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:41:55.844 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:41:56.177 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-25T23:41:56.189 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:41:56.270 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:41:56.722 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-25T23:41:56.742 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:41:56.780 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:02.666 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T23:42:02.792 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T23:42:03.167 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T23:42:03.296 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T23:42:03.557 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T23:42:03.580 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T23:42:03.624 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T23:42:03.669 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T23:42:03.771 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T23:42:04.105 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T23:42:04.233 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T23:42:04.545 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-25T23:42:04.567 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-25T23:42:04.611 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T23:42:09.981 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T23:42:10.019 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:42:10.055 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:10.706 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-25T23:42:10.743 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-25T23:42:10.780 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:12.824 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T23:42:12.949 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T23:42:13.316 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T23:42:13.437 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:13.500 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-25T23:42:13.563 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T23:42:13.615 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-25T23:42:13.692 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:13.924 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-25T23:42:14.045 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:14.171 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-25T23:42:14.291 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:15.045 INFO:teuthology.orchestra.run.smithi171.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T23:42:15.045 INFO:teuthology.orchestra.run.smithi171.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T23:42:15.045 INFO:teuthology.orchestra.run.smithi171.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T23:42:15.046 INFO:teuthology.orchestra.run.smithi171.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:15.210 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:15.637 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-25T23:42:15.637 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-25T23:42:15.637 INFO:teuthology.orchestra.run.smithi106.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-25T23:42:15.637 INFO:teuthology.orchestra.run.smithi106.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:16.193 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:16.880 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:17.606 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:18.270 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T23:42:18.372 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T23:42:18.499 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:18.559 INFO:teuthology.orchestra.run.smithi171.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T23:42:18.559 INFO:teuthology.orchestra.run.smithi171.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:18.979 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-25T23:42:19.105 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-25T23:42:19.214 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-25T23:42:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-25T23:42:19.265 INFO:teuthology.orchestra.run.smithi106.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:32.999 INFO:teuthology.orchestra.run.smithi106.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T23:42:32.999 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub' 2024-04-25T23:42:33.016 INFO:teuthology.orchestra.run.smithi106.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T23:42:33.041 INFO:teuthology.orchestra.run.smithi106.stdout:Generating grub configuration file ... 2024-04-25T23:42:33.304 INFO:teuthology.orchestra.run.smithi171.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-25T23:42:33.304 INFO:teuthology.orchestra.run.smithi171.stdout:Sourcing file `/etc/default/grub' 2024-04-25T23:42:33.327 INFO:teuthology.orchestra.run.smithi171.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T23:42:33.335 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T23:42:33.354 INFO:teuthology.orchestra.run.smithi171.stdout:Generating grub configuration file ... 2024-04-25T23:42:33.355 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:33.646 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T23:42:33.652 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T23:42:33.656 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T23:42:33.672 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:33.726 INFO:teuthology.orchestra.run.smithi106.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T23:42:33.732 INFO:teuthology.orchestra.run.smithi106.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T23:42:33.888 INFO:teuthology.orchestra.run.smithi106.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T23:42:33.888 INFO:teuthology.orchestra.run.smithi106.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T23:42:33.888 INFO:teuthology.orchestra.run.smithi106.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T23:42:33.928 INFO:teuthology.orchestra.run.smithi106.stdout:done 2024-04-25T23:42:34.038 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T23:42:34.043 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T23:42:34.121 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T23:42:34.126 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T23:42:34.287 INFO:teuthology.orchestra.run.smithi171.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T23:42:34.287 INFO:teuthology.orchestra.run.smithi171.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T23:42:34.287 INFO:teuthology.orchestra.run.smithi171.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T23:42:34.330 INFO:teuthology.orchestra.run.smithi171.stdout:done 2024-04-25T23:42:34.400 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2024-04-25T23:42:34.421 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2024-04-25T23:42:34.421 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2024-04-25T23:42:34.421 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2024-04-25T23:42:34.421 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2024-04-25T23:42:34.421 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 21 2024-04-25T23:42:34.421 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.105.102 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2024-04-25T23:42:34.422 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2024-04-25T23:42:34.422 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T23:42:34.423 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T23:42:34.423 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T23:42:34.423 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T23:42:34.423 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi106.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T23:42:34.423 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get clean 2024-04-25T23:42:34.605 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-04-25T23:42:34.754 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T23:42:34.754 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T23:42:34.768 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T23:42:34.788 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T23:42:34.804 DEBUG:teuthology.orchestra.run.smithi171:> dpkg -s linux-image-generic 2024-04-25T23:42:34.833 INFO:teuthology.orchestra.run.smithi171.stdout:Package: linux-image-generic 2024-04-25T23:42:35.084 INFO:teuthology.orchestra.run.smithi171.stdout:Status: install ok installed 2024-04-25T23:42:35.084 INFO:teuthology.orchestra.run.smithi171.stdout:Priority: optional 2024-04-25T23:42:35.084 INFO:teuthology.orchestra.run.smithi171.stdout:Section: kernel 2024-04-25T23:42:35.084 INFO:teuthology.orchestra.run.smithi171.stdout:Installed-Size: 21 2024-04-25T23:42:35.084 INFO:teuthology.orchestra.run.smithi171.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: amd64 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout:Source: linux-meta 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout:Version: 5.15.0.105.102 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout:Recommends: thermald 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout:Description: Generic Linux kernel image 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout: This package will always depend on the latest generic kernel image 2024-04-25T23:42:35.085 INFO:teuthology.orchestra.run.smithi171.stdout: available. 2024-04-25T23:42:35.086 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-25T23:42:35.086 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T23:42:35.086 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T23:42:35.091 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2024-04-25T23:42:35.091 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T23:42:35.091 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get clean 2024-04-25T23:42:35.204 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-04-25T23:42:35.323 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T23:42:35.440 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T23:42:35.520 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T23:42:35.623 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T23:42:36.049 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-25T23:42:36.067 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T23:42:36.126 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-25T23:42:36.327 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-04-25T23:42:36.327 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-04-25T23:42:36.505 INFO:teuthology.orchestra.run.smithi106.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T23:42:36.505 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T23:42:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T23:42:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T23:42:36.505 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T23:42:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T23:42:36.506 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T23:42:36.506 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T23:42:36.547 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T23:42:36.548 DEBUG:teuthology.orchestra.run.smithi106:> dpkg -s linux-image-generic 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Package: linux-image-generic 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Status: install ok installed 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Priority: optional 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Section: kernel 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Installed-Size: 21 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Architecture: amd64 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Source: linux-meta 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Version: 5.15.0.105.102 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T23:42:36.561 INFO:teuthology.orchestra.run.smithi106.stdout:Recommends: thermald 2024-04-25T23:42:36.562 INFO:teuthology.orchestra.run.smithi106.stdout:Description: Generic Linux kernel image 2024-04-25T23:42:36.562 INFO:teuthology.orchestra.run.smithi106.stdout: This package will always depend on the latest generic kernel image 2024-04-25T23:42:36.562 INFO:teuthology.orchestra.run.smithi106.stdout: available. 2024-04-25T23:42:36.562 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-25T23:42:36.608 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.yb071SXx1O 2024-04-25T23:42:36.608 DEBUG:teuthology.orchestra.run.smithi106:> sudo cp /boot/grub/grub.cfg /tmp/tmp.yb071SXx1O 2024-04-25T23:42:36.664 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.yb071SXx1O 2024-04-25T23:42:36.772 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-04-25T23:42:36.776 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.yb071SXx1O is 10KB 2024-04-25T23:42:36.789 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.yb071SXx1O 2024-04-25T23:42:36.790 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-25T23:42:36.795 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T23:42:36.849 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-04-25T23:42:36.851 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:42:36.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T23:42:36.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T23:42:36.915 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T23:42:36.915 DEBUG:teuthology.orchestra.run.smithi106:> sudo update-grub 2024-04-25T23:42:37.049 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-04-25T23:42:37.049 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-04-25T23:42:37.221 INFO:teuthology.orchestra.run.smithi171.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-25T23:42:37.221 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T23:42:37.221 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T23:42:37.221 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T23:42:37.221 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T23:42:37.221 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T23:42:37.221 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T23:42:37.222 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T23:42:37.259 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-25T23:42:37.261 DEBUG:teuthology.orchestra.run.smithi171:> dpkg -s linux-image-generic 2024-04-25T23:42:37.276 INFO:teuthology.orchestra.run.smithi171.stdout:Package: linux-image-generic 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Status: install ok installed 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Priority: optional 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Section: kernel 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Installed-Size: 21 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Maintainer: Ubuntu Kernel Team 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: amd64 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Source: linux-meta 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Version: 5.15.0.105.102 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Recommends: thermald 2024-04-25T23:42:37.277 INFO:teuthology.orchestra.run.smithi171.stdout:Description: Generic Linux kernel image 2024-04-25T23:42:37.278 INFO:teuthology.orchestra.run.smithi171.stdout: This package will always depend on the latest generic kernel image 2024-04-25T23:42:37.278 INFO:teuthology.orchestra.run.smithi171.stdout: available. 2024-04-25T23:42:37.278 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-25T23:42:37.323 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.3DBvp25IDQ 2024-04-25T23:42:37.324 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3DBvp25IDQ 2024-04-25T23:42:37.378 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.3DBvp25IDQ 2024-04-25T23:42:37.499 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.3DBvp25IDQ is 10KB 2024-04-25T23:42:37.512 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.3DBvp25IDQ 2024-04-25T23:42:37.517 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-25T23:42:37.570 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:42:37.570 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-25T23:42:37.570 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-25T23:42:37.648 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-25T23:42:37.648 DEBUG:teuthology.orchestra.run.smithi171:> sudo update-grub 2024-04-25T23:42:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub' 2024-04-25T23:42:38.133 INFO:teuthology.orchestra.run.smithi106.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T23:42:38.137 INFO:teuthology.orchestra.run.smithi106.stderr:Generating grub configuration file ... 2024-04-25T23:42:38.305 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T23:42:38.311 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:38.530 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T23:42:38.535 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T23:42:38.578 INFO:teuthology.orchestra.run.smithi106.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T23:42:38.584 INFO:teuthology.orchestra.run.smithi106.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T23:42:38.713 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T23:42:38.713 INFO:teuthology.orchestra.run.smithi106.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T23:42:38.713 INFO:teuthology.orchestra.run.smithi106.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T23:42:38.725 INFO:teuthology.orchestra.run.smithi106.stderr:done 2024-04-25T23:42:38.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo shutdown -r now 2024-04-25T23:42:39.011 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub' 2024-04-25T23:42:39.012 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-25T23:42:39.015 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-04-25T23:42:39.219 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-25T23:42:39.226 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-25T23:42:39.472 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-25T23:42:39.476 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-25T23:42:39.512 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-25T23:42:39.517 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-25T23:42:39.656 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-25T23:42:39.656 INFO:teuthology.orchestra.run.smithi171.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-25T23:42:39.656 INFO:teuthology.orchestra.run.smithi171.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-25T23:42:39.668 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-04-25T23:42:39.677 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-04-25T23:43:08.765 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T23:43:08.766 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-25T23:43:08.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:43:09.680 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2024-04-25T23:43:09.681 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-25T23:43:09.681 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:43:27.267 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-25T23:43:28.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-25T23:43:36.276 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-25T23:43:36.277 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:43:37.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-25T23:43:37.032 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:43:39.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-25T23:43:40.094 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-04-25T23:43:51.371 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-25T23:43:51.371 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:43:52.096 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-25T23:43:52.096 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:44:09.763 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.106 2024-04-25T23:44:24.778 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-25T23:44:24.780 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:44:25.013 ERROR:teuthology.orchestra.connection:Error authenticating with smithi106.front.sepia.ceph.com: SSHException('No existing session') (No SSH private key found!) Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/teuthology/orchestra/connection.py", line 106, in connect ssh.connect(**connect_args) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 485, in connect self._auth( File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 818, in _auth raise saved_exception File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/client.py", line 794, in _auth self._transport.auth_publickey(username, key) File "/home/teuthworker/src/git.ceph.com_teuthology_9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17/virtualenv/lib/python3.8/site-packages/paramiko/transport.py", line 1664, in auth_publickey raise SSHException("No existing session") paramiko.ssh_exception.SSHException: No existing session 2024-04-25T23:44:29.100 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-25T23:44:29.740 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-25T23:44:29.740 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-25T23:44:29.741 DEBUG:teuthology.orchestra.run.smithi106:> uname -r 2024-04-25T23:44:29.788 INFO:teuthology.orchestra.run.smithi106.stdout:5.15.0-105-generic 2024-04-25T23:44:29.788 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T23:44:29.789 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T23:44:29.789 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T23:44:30.789 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T23:44:30.789 DEBUG:teuthology.orchestra.run.smithi106:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T23:44:30.873 INFO:teuthology.orchestra.run.smithi106.stdout:ttyS1 2024-04-25T23:44:30.902 DEBUG:teuthology.parallel:result is None 2024-04-25T23:44:52.098 DEBUG:teuthology.orchestra.remote:timed out 2024-04-25T23:45:07.099 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-25T23:45:07.100 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:45:07.245 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-25T23:45:07.778 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-25T23:45:07.779 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "5.15.0-105-generic"... 2024-04-25T23:45:07.779 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-04-25T23:45:07.825 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-105-generic 2024-04-25T23:45:07.826 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-25T23:45:07.826 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T23:45:07.826 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-25T23:45:08.827 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2024-04-25T23:45:08.827 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T23:45:09.183 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-04-25T23:45:09.206 DEBUG:teuthology.parallel:result is None 2024-04-25T23:45:09.207 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T23:45:09.215 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T23:45:09.215 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T23:45:09.218 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T23:45:09.223 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T23:45:09.229 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T23:45:09.236 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T23:45:09.237 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T23:45:09.265 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T23:45:09.370 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T23:45:09.379 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T23:45:09.379 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T23:45:09.382 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T23:45:09.404 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T23:45:09.407 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T23:45:09.414 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T23:45:09.414 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T23:45:09.417 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T23:45:09.424 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T23:45:09.424 DEBUG:teuthology.orchestra.run.smithi106:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T23:45:09.461 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T23:45:09.474 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T23:45:09.484 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T23:45:09.484 DEBUG:teuthology.orchestra.run.smithi106:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T23:45:09.518 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T23:45:09.524 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T23:45:09.568 DEBUG:teuthology.orchestra.run.smithi106:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T23:45:09.617 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:45:09.617 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T23:45:09.680 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T23:45:09.686 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T23:45:09.734 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:45:09.734 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T23:45:09.803 DEBUG:teuthology.orchestra.run.smithi106:> sudo service rsyslog restart 2024-04-25T23:45:09.806 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-04-25T23:45:09.876 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T23:45:09.884 INFO:teuthology.task.internal:Starting timer... 2024-04-25T23:45:09.884 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T23:45:09.895 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T23:45:09.904 DEBUG:teuthology.task.selinux:Excluding smithi106: OS 'ubuntu' does not support SELinux 2024-04-25T23:45:09.904 DEBUG:teuthology.task.selinux:Excluding smithi171: OS 'ubuntu' does not support SELinux 2024-04-25T23:45:09.905 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T23:45:09.905 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-25T23:45:09.905 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T23:45:09.905 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T23:45:09.914 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T23:45:09.920 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T23:45:10.045 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T23:45:10.060 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T23:45:10.062 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi106.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T23:52:13.969 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi106.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-04-25T23:52:13.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-25T23:52:13.972 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi106.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:52:14.054 DEBUG:teuthology.orchestra.run.smithi106:> true 2024-04-25T23:52:14.130 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi106.front.sepia.ceph.com' 2024-04-25T23:52:14.130 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-25T23:52:14.131 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T23:52:14.215 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-04-25T23:52:14.294 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-04-25T23:52:14.295 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T23:52:14.305 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T23:52:14.305 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T23:52:14.306 DEBUG:teuthology.orchestra.run.smithi106:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T23:52:14.308 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T23:52:14.308 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T23:52:14.334 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T23:52:14.334 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Command line: ntpd -gq 2024-04-25T23:52:14.334 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: ---------------------------------------------------- 2024-04-25T23:52:14.334 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T23:52:14.335 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T23:52:14.335 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: corporation. Support and training for ntp-4 are 2024-04-25T23:52:14.335 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: available at https://www.nwtime.org/support 2024-04-25T23:52:14.335 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: ---------------------------------------------------- 2024-04-25T23:52:14.335 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: proto: precision = 0.043 usec (-24) 2024-04-25T23:52:14.338 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: basedate set to 2022-02-04 2024-04-25T23:52:14.338 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: gps base set to 2022-02-06 (week 2196) 2024-04-25T23:52:14.338 INFO:teuthology.orchestra.run.smithi106.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T23:52:14.338 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T23:52:14.338 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T23:52:14.339 INFO:teuthology.orchestra.run.smithi106.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T23:52:14.339 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T23:52:14.340 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T23:52:14.340 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T23:52:14.340 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Listen normally on 3 enp3s0f1 172.21.15.106:123 2024-04-25T23:52:14.340 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Listen normally on 4 lo [::1]:123 2024-04-25T23:52:14.340 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce6d%5]:123 2024-04-25T23:52:14.340 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:14 ntpd[17202]: Listening on routing socket on fd #22 for interface updates 2024-04-25T23:52:14.369 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-25T23:52:14.369 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Command line: ntpd -gq 2024-04-25T23:52:14.369 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: ---------------------------------------------------- 2024-04-25T23:52:14.369 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: ntp-4 is maintained by Network Time Foundation, 2024-04-25T23:52:14.369 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-25T23:52:14.370 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: corporation. Support and training for ntp-4 are 2024-04-25T23:52:14.370 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: available at https://www.nwtime.org/support 2024-04-25T23:52:14.370 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: ---------------------------------------------------- 2024-04-25T23:52:14.371 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: proto: precision = 0.044 usec (-24) 2024-04-25T23:52:14.371 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: basedate set to 2022-02-04 2024-04-25T23:52:14.371 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: gps base set to 2022-02-06 (week 2196) 2024-04-25T23:52:14.371 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T23:52:14.371 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: restrict ::: KOD does nothing without LIMITED. 2024-04-25T23:52:14.371 INFO:teuthology.orchestra.run.smithi171.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-25T23:52:14.371 INFO:teuthology.orchestra.run.smithi171.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-25T23:52:14.372 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Listen and drop on 0 v6wildcard [::]:123 2024-04-25T23:52:14.372 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-25T23:52:14.372 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Listen normally on 2 lo 127.0.0.1:123 2024-04-25T23:52:14.372 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Listen normally on 3 enp3s0f1 172.21.15.171:123 2024-04-25T23:52:14.372 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Listen normally on 4 lo [::1]:123 2024-04-25T23:52:14.373 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f6d%5]:123 2024-04-25T23:52:14.373 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:14 ntpd[17230]: Listening on routing socket on fd #22 for interface updates 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:15.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:15 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:16.370 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:16.370 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:16.370 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:16.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:16 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:17.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:17 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:17.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:17 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:17.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:17 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:17.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:17 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:17.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:17 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:17.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:17 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:17.369 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:17 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:17.369 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:17 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:18 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:18 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:18 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:18 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:18 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:18.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:18 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:18.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:18.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:18.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:18.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:18.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:18 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:19.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:19.336 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:19 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:20.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:20 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:20 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:20 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:20 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:20 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:20.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:20 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:20.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.373 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:20.374 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:20.374 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.374 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.374 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:20.374 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:20.375 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:20.375 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:20.375 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:20.375 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:20 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:21.336 INFO:teuthology.orchestra.run.smithi106.stdout:25 Apr 23:52:21 ntpd[17202]: ntpd: time slew -0.000478 s 2024-04-25T23:52:21.336 INFO:teuthology.orchestra.run.smithi106.stdout:ntpd: time slew -0.000478s 2024-04-25T23:52:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T23:52:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:25 Apr 23:52:21 ntpd[17202]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T23:52:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T23:52:21.380 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-04-25T23:52:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:22.370 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: can't open /var/log/ntpstats/rawstats.20240425: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: can't open /var/log/ntpstats/peerstats.20240425: Permission denied 2024-04-25T23:52:22.371 INFO:teuthology.orchestra.run.smithi171.stdout:25 Apr 23:52:22 ntpd[17230]: ntpd: time slew -0.001645 s 2024-04-25T23:52:22.372 INFO:teuthology.orchestra.run.smithi171.stdout:ntpd: time slew -0.001645s 2024-04-25T23:52:22.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-25T23:52:22.372 INFO:teuthology.orchestra.run.smithi171.stderr:25 Apr 23:52:22 ntpd[17230]: can't open /var/log/ntpstats/loopstats.20240425: Permission denied 2024-04-25T23:52:22.420 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2024-04-25T23:52:22.420 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2024-04-25T23:52:22.420 INFO:teuthology.orchestra.run.smithi171.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:22.420 INFO:teuthology.orchestra.run.smithi171.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:22.420 INFO:teuthology.orchestra.run.smithi171.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:22.420 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-25T23:52:22.421 INFO:teuthology.run_tasks:Running task install... 2024-04-25T23:52:22.430 DEBUG:teuthology.task.install:project ceph 2024-04-25T23:52:22.430 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T23:52:22.430 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T23:52:22.430 INFO:teuthology.task.install:Using flavor: default 2024-04-25T23:52:22.436 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T23:52:22.436 INFO:teuthology.task.install:extra packages: [] 2024-04-25T23:52:22.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-key list | grep Ceph 2024-04-25T23:52:22.437 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-key list | grep Ceph 2024-04-25T23:52:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T23:52:22.517 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-25T23:52:22.534 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T23:52:22.534 INFO:teuthology.orchestra.run.smithi106.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T23:52:22.534 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T23:52:22.535 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T23:52:22.546 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-25T23:52:22.547 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph.com (release key) 2024-04-25T23:52:22.547 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-25T23:52:22.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T23:52:22.757 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T23:52:22.758 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:52:22.766 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default/ 2024-04-25T23:52:22.766 INFO:teuthology.task.install.deb:Package version is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:52:22.928 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:52:22.929 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T23:52:22.936 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:52:22.936 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-25T23:52:22.943 DEBUG:teuthology.orchestra.run.smithi106:> sudo apt-get update 2024-04-25T23:52:22.950 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-04-25T23:52:23.117 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T23:52:23.124 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-25T23:52:23.130 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T23:52:23.151 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T23:52:23.163 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T23:52:23.172 INFO:teuthology.orchestra.run.smithi106.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T23:52:23.184 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T23:52:23.206 INFO:teuthology.orchestra.run.smithi106.stdout:Ign:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T23:52:23.227 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T23:52:23.234 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy InRelease 2024-04-25T23:52:23.254 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T23:52:23.257 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-25T23:52:23.270 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-25T23:52:23.316 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:5 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-25T23:52:23.340 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-25T23:52:23.353 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 Packages [17.9 kB] 2024-04-25T23:52:23.414 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,416 B] 2024-04-25T23:52:23.421 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-25T23:52:23.465 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 28.9 kB in 0s (85.4 kB/s) 2024-04-25T23:52:23.558 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 28.9 kB in 0s (67.8 kB/s) 2024-04-25T23:52:24.446 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-25T23:52:24.461 DEBUG:teuthology.orchestra.run.smithi106:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:52:24.520 INFO:teuthology.orchestra.run.smithi106.stdout:Reading package lists... 2024-04-25T23:52:24.556 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-04-25T23:52:24.572 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-2445-gd2c45d97-1jammy cephadm=19.0.0-2445-gd2c45d97-1jammy ceph-mds=19.0.0-2445-gd2c45d97-1jammy ceph-mgr=19.0.0-2445-gd2c45d97-1jammy ceph-common=19.0.0-2445-gd2c45d97-1jammy ceph-fuse=19.0.0-2445-gd2c45d97-1jammy ceph-test=19.0.0-2445-gd2c45d97-1jammy ceph-volume=19.0.0-2445-gd2c45d97-1jammy radosgw=19.0.0-2445-gd2c45d97-1jammy python3-rados=19.0.0-2445-gd2c45d97-1jammy python3-rgw=19.0.0-2445-gd2c45d97-1jammy python3-cephfs=19.0.0-2445-gd2c45d97-1jammy python3-rbd=19.0.0-2445-gd2c45d97-1jammy libcephfs2=19.0.0-2445-gd2c45d97-1jammy libcephfs-dev=19.0.0-2445-gd2c45d97-1jammy librados2=19.0.0-2445-gd2c45d97-1jammy librbd1=19.0.0-2445-gd2c45d97-1jammy rbd-fuse=19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:52:24.624 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-04-25T23:52:24.719 INFO:teuthology.orchestra.run.smithi106.stdout:Building dependency tree... 2024-04-25T23:52:24.720 INFO:teuthology.orchestra.run.smithi106.stdout:Reading state information... 2024-04-25T23:52:24.800 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-04-25T23:52:24.801 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-04-25T23:52:24.902 INFO:teuthology.orchestra.run.smithi106.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T23:52:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T23:52:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T23:52:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T23:52:24.902 INFO:teuthology.orchestra.run.smithi106.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T23:52:24.903 INFO:teuthology.orchestra.run.smithi106.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T23:52:24.903 INFO:teuthology.orchestra.run.smithi106.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T23:52:24.905 INFO:teuthology.orchestra.run.smithi106.stdout:The following additional packages will be installed: 2024-04-25T23:52:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T23:52:24.906 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T23:52:24.907 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T23:52:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T23:52:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T23:52:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T23:52:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T23:52:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T23:52:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T23:52:24.908 INFO:teuthology.orchestra.run.smithi106.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: xmlstarlet zip 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout:Suggested packages: 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout:Recommended packages: 2024-04-25T23:52:24.909 INFO:teuthology.orchestra.run.smithi106.stdout: btrfs-tools 2024-04-25T23:52:24.976 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-04-25T23:52:24.976 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-25T23:52:24.976 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-25T23:52:24.976 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-25T23:52:24.977 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-25T23:52:24.982 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-25T23:52:24.983 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-25T23:52:24.984 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-25T23:52:24.984 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet zip 2024-04-25T23:52:24.984 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-25T23:52:24.985 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2024-04-25T23:52:24.986 INFO:teuthology.orchestra.run.smithi171.stdout: btrfs-tools 2024-04-25T23:52:25.003 INFO:teuthology.orchestra.run.smithi106.stdout:The following NEW packages will be installed: 2024-04-25T23:52:25.004 INFO:teuthology.orchestra.run.smithi106.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T23:52:25.004 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T23:52:25.004 INFO:teuthology.orchestra.run.smithi106.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T23:52:25.004 INFO:teuthology.orchestra.run.smithi106.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T23:52:25.004 INFO:teuthology.orchestra.run.smithi106.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T23:52:25.004 INFO:teuthology.orchestra.run.smithi106.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T23:52:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T23:52:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T23:52:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T23:52:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T23:52:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T23:52:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T23:52:25.006 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T23:52:25.007 INFO:teuthology.orchestra.run.smithi106.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T23:52:25.078 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-04-25T23:52:25.078 INFO:teuthology.orchestra.run.smithi171.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-25T23:52:25.078 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-25T23:52:25.078 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-25T23:52:25.078 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-25T23:52:25.078 INFO:teuthology.orchestra.run.smithi171.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-25T23:52:25.078 INFO:teuthology.orchestra.run.smithi171.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-25T23:52:25.080 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-25T23:52:25.081 INFO:teuthology.orchestra.run.smithi171.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-25T23:52:25.087 INFO:teuthology.orchestra.run.smithi106.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T23:52:25.087 INFO:teuthology.orchestra.run.smithi106.stdout:Need to get 179 MB of archives. 2024-04-25T23:52:25.087 INFO:teuthology.orchestra.run.smithi106.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T23:52:25.087 INFO:teuthology.orchestra.run.smithi106.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T23:52:25.146 INFO:teuthology.orchestra.run.smithi106.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T23:52:25.146 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-25T23:52:25.147 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 179 MB of archives. 2024-04-25T23:52:25.147 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 822 MB of additional disk space will be used. 2024-04-25T23:52:25.147 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-25T23:52:25.198 INFO:teuthology.orchestra.run.smithi106.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T23:52:25.201 INFO:teuthology.orchestra.run.smithi106.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T23:52:25.222 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-2445-gd2c45d97-1jammy [3,541 kB] 2024-04-25T23:52:25.223 INFO:teuthology.orchestra.run.smithi106.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T23:52:25.252 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-25T23:52:25.255 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-25T23:52:25.276 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-25T23:52:25.289 INFO:teuthology.orchestra.run.smithi106.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T23:52:25.295 INFO:teuthology.orchestra.run.smithi106.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T23:52:25.309 INFO:teuthology.orchestra.run.smithi106.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T23:52:25.313 INFO:teuthology.orchestra.run.smithi106.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T23:52:25.313 INFO:teuthology.orchestra.run.smithi106.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T23:52:25.314 INFO:teuthology.orchestra.run.smithi106.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T23:52:25.323 INFO:teuthology.orchestra.run.smithi106.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T23:52:25.326 INFO:teuthology.orchestra.run.smithi106.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T23:52:25.328 INFO:teuthology.orchestra.run.smithi106.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T23:52:25.329 INFO:teuthology.orchestra.run.smithi106.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T23:52:25.346 INFO:teuthology.orchestra.run.smithi106.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T23:52:25.349 INFO:teuthology.orchestra.run.smithi106.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T23:52:25.351 INFO:teuthology.orchestra.run.smithi106.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T23:52:25.353 INFO:teuthology.orchestra.run.smithi106.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T23:52:25.354 INFO:teuthology.orchestra.run.smithi106.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T23:52:25.354 INFO:teuthology.orchestra.run.smithi106.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T23:52:25.361 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-25T23:52:25.367 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-25T23:52:25.368 INFO:teuthology.orchestra.run.smithi106.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T23:52:25.369 INFO:teuthology.orchestra.run.smithi106.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T23:52:25.369 INFO:teuthology.orchestra.run.smithi106.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T23:52:25.370 INFO:teuthology.orchestra.run.smithi106.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T23:52:25.381 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-25T23:52:25.384 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-25T23:52:25.385 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-25T23:52:25.386 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-25T23:52:25.387 INFO:teuthology.orchestra.run.smithi106.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T23:52:25.388 INFO:teuthology.orchestra.run.smithi106.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T23:52:25.388 INFO:teuthology.orchestra.run.smithi106.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T23:52:25.391 INFO:teuthology.orchestra.run.smithi106.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T23:52:25.392 INFO:teuthology.orchestra.run.smithi106.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T23:52:25.392 INFO:teuthology.orchestra.run.smithi106.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T23:52:25.394 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-25T23:52:25.396 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-25T23:52:25.398 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-25T23:52:25.400 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-25T23:52:25.405 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-25T23:52:25.407 INFO:teuthology.orchestra.run.smithi106.stdout:Get:32 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T23:52:25.408 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-25T23:52:25.409 INFO:teuthology.orchestra.run.smithi106.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T23:52:25.410 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-25T23:52:25.411 INFO:teuthology.orchestra.run.smithi106.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T23:52:25.412 INFO:teuthology.orchestra.run.smithi106.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T23:52:25.413 INFO:teuthology.orchestra.run.smithi106.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T23:52:25.425 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-25T23:52:25.426 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-25T23:52:25.426 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-25T23:52:25.428 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-25T23:52:25.428 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-25T23:52:25.428 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-25T23:52:25.428 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-25T23:52:25.429 INFO:teuthology.orchestra.run.smithi106.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T23:52:25.431 INFO:teuthology.orchestra.run.smithi106.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T23:52:25.432 INFO:teuthology.orchestra.run.smithi106.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T23:52:25.443 INFO:teuthology.orchestra.run.smithi106.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T23:52:25.443 INFO:teuthology.orchestra.run.smithi106.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T23:52:25.444 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-25T23:52:25.445 INFO:teuthology.orchestra.run.smithi106.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T23:52:25.445 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-25T23:52:25.445 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-25T23:52:25.449 INFO:teuthology.orchestra.run.smithi106.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T23:52:25.451 INFO:teuthology.orchestra.run.smithi106.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T23:52:25.456 INFO:teuthology.orchestra.run.smithi106.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T23:52:25.457 INFO:teuthology.orchestra.run.smithi106.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T23:52:25.464 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-25T23:52:25.465 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-25T23:52:25.465 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-25T23:52:25.466 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-25T23:52:25.467 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-25T23:52:25.467 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-25T23:52:25.467 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-25T23:52:25.468 INFO:teuthology.orchestra.run.smithi106.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T23:52:25.470 INFO:teuthology.orchestra.run.smithi106.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T23:52:25.475 INFO:teuthology.orchestra.run.smithi106.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T23:52:25.476 INFO:teuthology.orchestra.run.smithi106.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T23:52:25.478 INFO:teuthology.orchestra.run.smithi106.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T23:52:25.483 INFO:teuthology.orchestra.run.smithi106.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T23:52:25.493 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-25T23:52:25.494 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-25T23:52:25.495 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-25T23:52:25.514 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-25T23:52:25.514 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-25T23:52:25.514 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-25T23:52:25.515 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-25T23:52:25.517 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-25T23:52:25.519 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-25T23:52:25.519 INFO:teuthology.orchestra.run.smithi171.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-25T23:52:25.533 INFO:teuthology.orchestra.run.smithi171.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-25T23:52:25.534 INFO:teuthology.orchestra.run.smithi171.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-25T23:52:25.537 INFO:teuthology.orchestra.run.smithi171.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-25T23:52:25.551 INFO:teuthology.orchestra.run.smithi106.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T23:52:25.553 INFO:teuthology.orchestra.run.smithi171.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-25T23:52:25.554 INFO:teuthology.orchestra.run.smithi171.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-25T23:52:25.556 INFO:teuthology.orchestra.run.smithi171.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-25T23:52:25.558 INFO:teuthology.orchestra.run.smithi171.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-2445-gd2c45d97-1jammy [3,218 kB] 2024-04-25T23:52:25.566 INFO:teuthology.orchestra.run.smithi106.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T23:52:25.566 INFO:teuthology.orchestra.run.smithi106.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T23:52:25.567 INFO:teuthology.orchestra.run.smithi106.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T23:52:25.567 INFO:teuthology.orchestra.run.smithi106.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T23:52:25.568 INFO:teuthology.orchestra.run.smithi106.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T23:52:25.587 INFO:teuthology.orchestra.run.smithi106.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T23:52:25.588 INFO:teuthology.orchestra.run.smithi106.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T23:52:25.589 INFO:teuthology.orchestra.run.smithi106.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T23:52:25.594 INFO:teuthology.orchestra.run.smithi106.stdout:Get:62 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T23:52:25.614 INFO:teuthology.orchestra.run.smithi106.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T23:52:25.615 INFO:teuthology.orchestra.run.smithi106.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T23:52:25.617 INFO:teuthology.orchestra.run.smithi106.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T23:52:25.617 INFO:teuthology.orchestra.run.smithi106.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T23:52:25.622 INFO:teuthology.orchestra.run.smithi171.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-25T23:52:25.624 INFO:teuthology.orchestra.run.smithi171.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-25T23:52:25.625 INFO:teuthology.orchestra.run.smithi171.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-25T23:52:25.625 INFO:teuthology.orchestra.run.smithi171.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-25T23:52:25.627 INFO:teuthology.orchestra.run.smithi171.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-25T23:52:25.633 INFO:teuthology.orchestra.run.smithi106.stdout:Get:67 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T23:52:25.635 INFO:teuthology.orchestra.run.smithi106.stdout:Get:68 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T23:52:25.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T23:52:25.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T23:52:25.636 INFO:teuthology.orchestra.run.smithi106.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T23:52:25.637 INFO:teuthology.orchestra.run.smithi106.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T23:52:25.638 INFO:teuthology.orchestra.run.smithi106.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T23:52:25.638 INFO:teuthology.orchestra.run.smithi106.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T23:52:25.643 INFO:teuthology.orchestra.run.smithi106.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T23:52:25.645 INFO:teuthology.orchestra.run.smithi106.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T23:52:25.648 INFO:teuthology.orchestra.run.smithi171.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-25T23:52:25.650 INFO:teuthology.orchestra.run.smithi171.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-25T23:52:25.651 INFO:teuthology.orchestra.run.smithi171.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-25T23:52:25.664 INFO:teuthology.orchestra.run.smithi106.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T23:52:25.666 INFO:teuthology.orchestra.run.smithi106.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T23:52:25.667 INFO:teuthology.orchestra.run.smithi106.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T23:52:25.669 INFO:teuthology.orchestra.run.smithi171.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-25T23:52:25.669 INFO:teuthology.orchestra.run.smithi171.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-25T23:52:25.670 INFO:teuthology.orchestra.run.smithi171.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-25T23:52:25.670 INFO:teuthology.orchestra.run.smithi171.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-25T23:52:25.671 INFO:teuthology.orchestra.run.smithi171.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-25T23:52:25.678 INFO:teuthology.orchestra.run.smithi171.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-25T23:52:25.679 INFO:teuthology.orchestra.run.smithi171.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-25T23:52:25.679 INFO:teuthology.orchestra.run.smithi171.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-25T23:52:25.682 INFO:teuthology.orchestra.run.smithi171.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-25T23:52:25.684 INFO:teuthology.orchestra.run.smithi106.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T23:52:25.687 INFO:teuthology.orchestra.run.smithi106.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T23:52:25.689 INFO:teuthology.orchestra.run.smithi106.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T23:52:25.690 INFO:teuthology.orchestra.run.smithi106.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T23:52:25.696 INFO:teuthology.orchestra.run.smithi106.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T23:52:25.697 INFO:teuthology.orchestra.run.smithi106.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T23:52:25.697 INFO:teuthology.orchestra.run.smithi171.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-25T23:52:25.699 INFO:teuthology.orchestra.run.smithi171.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-25T23:52:25.699 INFO:teuthology.orchestra.run.smithi171.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-25T23:52:25.701 INFO:teuthology.orchestra.run.smithi106.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T23:52:25.703 INFO:teuthology.orchestra.run.smithi171.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-25T23:52:25.706 INFO:teuthology.orchestra.run.smithi171.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-25T23:52:25.706 INFO:teuthology.orchestra.run.smithi106.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T23:52:25.707 INFO:teuthology.orchestra.run.smithi171.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-25T23:52:25.707 INFO:teuthology.orchestra.run.smithi106.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T23:52:25.708 INFO:teuthology.orchestra.run.smithi106.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T23:52:25.717 INFO:teuthology.orchestra.run.smithi171.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-25T23:52:25.723 INFO:teuthology.orchestra.run.smithi171.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-25T23:52:25.724 INFO:teuthology.orchestra.run.smithi171.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-25T23:52:25.727 INFO:teuthology.orchestra.run.smithi171.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-25T23:52:25.727 INFO:teuthology.orchestra.run.smithi106.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T23:52:25.729 INFO:teuthology.orchestra.run.smithi106.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T23:52:25.738 INFO:teuthology.orchestra.run.smithi106.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T23:52:25.738 INFO:teuthology.orchestra.run.smithi106.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T23:52:25.739 INFO:teuthology.orchestra.run.smithi106.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T23:52:25.740 INFO:teuthology.orchestra.run.smithi171.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-25T23:52:25.741 INFO:teuthology.orchestra.run.smithi171.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-25T23:52:25.741 INFO:teuthology.orchestra.run.smithi171.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-25T23:52:25.742 INFO:teuthology.orchestra.run.smithi106.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T23:52:25.742 INFO:teuthology.orchestra.run.smithi106.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T23:52:25.743 INFO:teuthology.orchestra.run.smithi171.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-25T23:52:25.744 INFO:teuthology.orchestra.run.smithi171.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-25T23:52:25.754 INFO:teuthology.orchestra.run.smithi171.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-25T23:52:25.766 INFO:teuthology.orchestra.run.smithi171.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-25T23:52:25.766 INFO:teuthology.orchestra.run.smithi171.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-25T23:52:25.768 INFO:teuthology.orchestra.run.smithi171.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-25T23:52:25.769 INFO:teuthology.orchestra.run.smithi171.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-25T23:52:25.800 INFO:teuthology.orchestra.run.smithi171.stdout:Get:90 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-2445-gd2c45d97-1jammy [711 kB] 2024-04-25T23:52:25.860 INFO:teuthology.orchestra.run.smithi171.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-2445-gd2c45d97-1jammy [356 kB] 2024-04-25T23:52:25.901 INFO:teuthology.orchestra.run.smithi171.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-2445-gd2c45d97-1jammy [32.8 kB] 2024-04-25T23:52:25.902 INFO:teuthology.orchestra.run.smithi171.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-2445-gd2c45d97-1jammy [180 kB] 2024-04-25T23:52:25.918 INFO:teuthology.orchestra.run.smithi171.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-2445-gd2c45d97-1jammy [65.8 kB] 2024-04-25T23:52:25.920 INFO:teuthology.orchestra.run.smithi171.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-2445-gd2c45d97-1jammy [330 kB] 2024-04-25T23:52:25.961 INFO:teuthology.orchestra.run.smithi171.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-2445-gd2c45d97-1jammy [6,775 kB] 2024-04-25T23:52:26.017 INFO:teuthology.orchestra.run.smithi106.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T23:52:26.020 INFO:teuthology.orchestra.run.smithi106.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T23:52:26.046 INFO:teuthology.orchestra.run.smithi106.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T23:52:26.488 INFO:teuthology.orchestra.run.smithi171.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-2445-gd2c45d97-1jammy [112 kB] 2024-04-25T23:52:26.491 INFO:teuthology.orchestra.run.smithi171.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-2445-gd2c45d97-1jammy [467 kB] 2024-04-25T23:52:26.540 INFO:teuthology.orchestra.run.smithi171.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-2445-gd2c45d97-1jammy [25.6 MB] 2024-04-25T23:52:27.572 INFO:teuthology.orchestra.run.smithi106.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T23:52:27.843 INFO:teuthology.orchestra.run.smithi106.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T23:52:27.850 INFO:teuthology.orchestra.run.smithi106.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T23:52:27.853 INFO:teuthology.orchestra.run.smithi106.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T23:52:27.973 INFO:teuthology.orchestra.run.smithi106.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T23:52:28.317 INFO:teuthology.orchestra.run.smithi106.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T23:52:28.741 INFO:teuthology.orchestra.run.smithi171.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-2445-gd2c45d97-1jammy [5,084 kB] 2024-04-25T23:52:29.077 INFO:teuthology.orchestra.run.smithi171.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-2445-gd2c45d97-1jammy [244 kB] 2024-04-25T23:52:29.083 INFO:teuthology.orchestra.run.smithi171.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-2445-gd2c45d97-1jammy [124 kB] 2024-04-25T23:52:29.087 INFO:teuthology.orchestra.run.smithi171.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-2445-gd2c45d97-1jammy [1,526 kB] 2024-04-25T23:52:29.223 INFO:teuthology.orchestra.run.smithi171.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-2445-gd2c45d97-1jammy [6,245 kB] 2024-04-25T23:52:29.697 INFO:teuthology.orchestra.run.smithi171.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-2445-gd2c45d97-1jammy [22.7 MB] 2024-04-25T23:52:30.208 INFO:teuthology.orchestra.run.smithi106.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T23:52:30.209 INFO:teuthology.orchestra.run.smithi106.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T23:52:30.226 INFO:teuthology.orchestra.run.smithi106.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T23:52:30.328 INFO:teuthology.orchestra.run.smithi106.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T23:52:30.389 INFO:teuthology.orchestra.run.smithi106.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T23:52:30.394 INFO:teuthology.orchestra.run.smithi106.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T23:52:30.578 INFO:teuthology.orchestra.run.smithi106.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T23:52:31.313 INFO:teuthology.orchestra.run.smithi106.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T23:52:31.314 INFO:teuthology.orchestra.run.smithi106.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T23:52:31.656 INFO:teuthology.orchestra.run.smithi171.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-2445-gd2c45d97-1jammy [14.0 kB] 2024-04-25T23:52:31.657 INFO:teuthology.orchestra.run.smithi171.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [869 kB] 2024-04-25T23:52:31.674 INFO:teuthology.orchestra.run.smithi171.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-2445-gd2c45d97-1jammy [2,437 kB] 2024-04-25T23:52:31.856 INFO:teuthology.orchestra.run.smithi171.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-2445-gd2c45d97-1jammy [791 kB] 2024-04-25T23:52:31.922 INFO:teuthology.orchestra.run.smithi171.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-2445-gd2c45d97-1jammy [147 kB] 2024-04-25T23:52:31.952 INFO:teuthology.orchestra.run.smithi171.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-2445-gd2c45d97-1jammy [2,293 kB] 2024-04-25T23:52:32.125 INFO:teuthology.orchestra.run.smithi171.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-2445-gd2c45d97-1jammy [8,625 kB] 2024-04-25T23:52:32.871 INFO:teuthology.orchestra.run.smithi171.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-2445-gd2c45d97-1jammy [14.2 kB] 2024-04-25T23:52:32.871 INFO:teuthology.orchestra.run.smithi171.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-2445-gd2c45d97-1jammy [50.7 MB] 2024-04-25T23:52:35.761 INFO:teuthology.orchestra.run.smithi106.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T23:52:35.763 INFO:teuthology.orchestra.run.smithi106.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T23:52:35.764 INFO:teuthology.orchestra.run.smithi106.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T23:52:36.654 INFO:teuthology.orchestra.run.smithi106.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T23:52:37.099 INFO:teuthology.orchestra.run.smithi171.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-2445-gd2c45d97-1jammy [121 kB] 2024-04-25T23:52:37.101 INFO:teuthology.orchestra.run.smithi171.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-2445-gd2c45d97-1jammy [38.9 kB] 2024-04-25T23:52:37.102 INFO:teuthology.orchestra.run.smithi171.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-2445-gd2c45d97-1jammy [13.4 MB] 2024-04-25T23:52:37.212 INFO:teuthology.orchestra.run.smithi106.stdout:Fetched 179 MB in 12s (15.4 MB/s) 2024-04-25T23:52:37.340 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T23:52:37.435 INFO:teuthology.orchestra.run.smithi106.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T23:52:37.441 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T23:52:37.491 INFO:teuthology.orchestra.run.smithi171.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/squid/d2c45d977142e024a59b68a8f1dce8f0b9840551/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-2445-gd2c45d97-1jammy [91.4 kB] 2024-04-25T23:52:37.513 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T23:52:37.842 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T23:52:37.868 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T23:52:37.908 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T23:52:38.051 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 179 MB in 12s (14.5 MB/s) 2024-04-25T23:52:38.195 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T23:52:38.211 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-25T23:52:38.220 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T23:52:38.261 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T23:52:38.306 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-25T23:52:38.312 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-25T23:52:38.401 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T23:52:38.713 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-25T23:52:38.739 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-25T23:52:38.740 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T23:52:38.766 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T23:52:38.797 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T23:52:38.814 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:52:39.066 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-25T23:52:39.092 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-25T23:52:39.133 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T23:52:39.201 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T23:52:39.228 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T23:52:39.268 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:52:39.561 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-25T23:52:39.587 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T23:52:39.596 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T23:52:39.622 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T23:52:39.636 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:52:39.662 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:52:40.016 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T23:52:40.042 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T23:52:40.048 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-25T23:52:40.074 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T23:52:40.082 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T23:52:40.114 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:52:40.394 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librados2. 2024-04-25T23:52:40.420 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:40.434 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-25T23:52:40.460 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-25T23:52:40.492 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:52:40.496 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:40.837 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-25T23:52:40.864 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-25T23:52:40.904 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T23:52:41.222 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librbd1. 2024-04-25T23:52:41.223 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librados2. 2024-04-25T23:52:41.248 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:41.249 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../007-librados2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:41.290 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:41.290 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:41.718 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librbd1. 2024-04-25T23:52:41.724 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T23:52:41.744 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../008-librbd1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:41.750 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:41.784 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:41.791 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:42.085 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rados. 2024-04-25T23:52:42.100 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:42.143 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:42.206 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs2. 2024-04-25T23:52:42.232 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:42.272 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:42.438 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T23:52:42.464 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:52:42.496 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:42.508 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rados. 2024-04-25T23:52:42.523 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../010-python3-rados_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:42.558 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:42.740 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T23:52:42.766 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:42.823 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:43.118 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T23:52:43.144 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:52:43.184 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:43.269 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-25T23:52:43.295 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:52:43.402 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:43.513 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T23:52:43.539 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T23:52:43.579 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T23:52:43.638 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cephfs. 2024-04-25T23:52:43.664 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:43.713 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:43.849 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T23:52:43.875 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T23:52:43.907 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T23:52:44.057 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-25T23:52:44.084 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:52:44.124 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:44.153 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T23:52:44.177 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:44.218 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:44.452 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-25T23:52:44.478 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-25T23:52:44.518 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T23:52:44.571 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T23:52:44.597 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T23:52:44.637 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T23:52:44.830 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-prettytable. 2024-04-25T23:52:44.856 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-25T23:52:44.896 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-25T23:52:44.923 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T23:52:44.949 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T23:52:44.990 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T23:52:45.141 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rbd. 2024-04-25T23:52:45.167 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:45.199 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:45.284 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T23:52:45.299 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T23:52:45.359 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T23:52:45.544 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-25T23:52:45.570 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-25T23:52:45.610 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T23:52:45.679 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua5.1. 2024-04-25T23:52:45.706 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T23:52:45.746 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T23:52:45.879 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-25T23:52:45.906 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-25T23:52:45.946 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T23:52:46.074 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-any. 2024-04-25T23:52:46.100 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T23:52:46.249 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-25T23:52:46.275 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-25T23:52:46.299 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T23:52:46.315 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T23:52:46.551 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package zip. 2024-04-25T23:52:46.578 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T23:52:46.585 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua5.1. 2024-04-25T23:52:46.612 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-25T23:52:46.618 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T23:52:46.652 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-25T23:52:46.913 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package unzip. 2024-04-25T23:52:46.939 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T23:52:46.971 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-any. 2024-04-25T23:52:46.980 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T23:52:46.987 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-25T23:52:47.038 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-25T23:52:47.282 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package zip. 2024-04-25T23:52:47.298 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-25T23:52:47.341 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking zip (3.0-12build2) ... 2024-04-25T23:52:47.450 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package luarocks. 2024-04-25T23:52:47.476 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T23:52:47.525 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T23:52:47.627 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package unzip. 2024-04-25T23:52:47.654 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-25T23:52:47.685 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-25T23:52:47.933 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package librgw2. 2024-04-25T23:52:47.979 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:47.999 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:48.106 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package luarocks. 2024-04-25T23:52:48.132 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-25T23:52:48.172 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-25T23:52:48.535 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T23:52:48.562 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:48.602 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:48.714 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librgw2. 2024-04-25T23:52:48.740 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../025-librgw2_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:48.780 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:48.938 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T23:52:48.965 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T23:52:49.005 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T23:52:49.291 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T23:52:49.316 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rgw. 2024-04-25T23:52:49.318 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:49.331 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:49.358 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:49.366 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:49.627 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-25T23:52:49.642 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-25T23:52:49.685 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T23:52:49.786 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-common. 2024-04-25T23:52:49.812 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:49.853 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:49.997 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libradosstriper1. 2024-04-25T23:52:50.023 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:50.063 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:50.417 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-common. 2024-04-25T23:52:50.443 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../029-ceph-common_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:50.483 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:51.500 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-base. 2024-04-25T23:52:51.526 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:51.575 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:51.813 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-base. 2024-04-25T23:52:51.839 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../030-ceph-base_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:52:51.898 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:52:52.221 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T23:52:52.247 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T23:52:52.287 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T23:52:52.493 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-25T23:52:52.519 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-25T23:52:52.559 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-25T23:52:52.640 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T23:52:52.666 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T23:52:52.715 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T23:52:52.828 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cheroot. 2024-04-25T23:52:52.855 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-25T23:52:52.887 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T23:52:53.035 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T23:52:53.051 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T23:52:53.085 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T23:52:53.157 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-25T23:52:53.183 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-25T23:52:53.215 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-25T23:52:53.363 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T23:52:53.389 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T23:52:53.429 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T23:52:53.509 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-25T23:52:53.536 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-25T23:52:53.578 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-25T23:52:53.732 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T23:52:53.758 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T23:52:53.799 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T23:52:53.879 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-25T23:52:53.906 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-25T23:52:53.945 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-25T23:52:54.102 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T23:52:54.128 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T23:52:54.168 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T23:52:54.257 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempora. 2024-04-25T23:52:54.284 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-25T23:52:54.323 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-25T23:52:54.456 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-portend. 2024-04-25T23:52:54.483 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T23:52:54.523 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T23:52:54.601 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-portend. 2024-04-25T23:52:54.628 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-25T23:52:54.659 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-25T23:52:54.826 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T23:52:54.852 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T23:52:54.892 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T23:52:54.929 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-25T23:52:54.956 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-25T23:52:54.995 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-25T23:52:55.179 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T23:52:55.205 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T23:52:55.245 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T23:52:55.332 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-25T23:52:55.359 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-25T23:52:55.398 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-25T23:52:55.619 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T23:52:55.642 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T23:52:55.682 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T23:52:55.719 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-natsort. 2024-04-25T23:52:55.746 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-25T23:52:55.785 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-25T23:52:55.993 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T23:52:56.020 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T23:52:56.055 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-logutils. 2024-04-25T23:52:56.060 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T23:52:56.082 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-25T23:52:56.113 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-25T23:52:56.347 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T23:52:56.373 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T23:52:56.405 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T23:52:56.408 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-25T23:52:56.437 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-25T23:52:56.474 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-25T23:52:56.699 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-mako. 2024-04-25T23:52:56.726 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T23:52:56.766 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T23:52:56.777 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-mako. 2024-04-25T23:52:56.804 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-25T23:52:56.844 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T23:52:57.086 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T23:52:57.112 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T23:52:57.152 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T23:52:57.163 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-25T23:52:57.190 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-25T23:52:57.230 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-25T23:52:57.500 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T23:52:57.515 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T23:52:57.549 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T23:52:57.827 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webob. 2024-04-25T23:52:57.854 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T23:52:57.894 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T23:52:58.131 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-25T23:52:58.157 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-25T23:52:58.197 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-25T23:52:58.238 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T23:52:58.265 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T23:52:58.308 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T23:52:58.466 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webob. 2024-04-25T23:52:58.493 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-25T23:52:58.525 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-25T23:52:58.844 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-waitress. 2024-04-25T23:52:58.871 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-25T23:52:58.906 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T23:52:59.197 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T23:52:59.224 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T23:52:59.264 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T23:52:59.567 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-paste. 2024-04-25T23:52:59.593 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T23:52:59.633 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T23:52:59.725 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempita. 2024-04-25T23:52:59.751 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-25T23:52:59.791 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T23:52:59.945 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T23:52:59.960 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T23:53:00.003 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T23:53:00.078 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-paste. 2024-04-25T23:53:00.104 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-25T23:53:00.144 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T23:53:00.256 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T23:53:00.283 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T23:53:00.315 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T23:53:00.439 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-25T23:53:00.455 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-25T23:53:00.497 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T23:53:00.600 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T23:53:00.627 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T23:53:00.667 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T23:53:00.800 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-25T23:53:00.826 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-25T23:53:00.866 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-25T23:53:00.978 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T23:53:01.005 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T23:53:01.045 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T23:53:01.169 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webtest. 2024-04-25T23:53:01.196 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-25T23:53:01.236 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-25T23:53:01.417 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T23:53:01.444 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T23:53:01.483 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T23:53:01.556 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pecan. 2024-04-25T23:53:01.583 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-25T23:53:01.622 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T23:53:01.977 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-certifi. 2024-04-25T23:53:02.003 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-25T23:53:02.028 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-idna. 2024-04-25T23:53:02.043 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-25T23:53:02.055 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T23:53:02.094 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T23:53:02.355 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-idna. 2024-04-25T23:53:02.372 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T23:53:02.381 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-25T23:53:02.399 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T23:53:02.421 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-25T23:53:02.439 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T23:53:02.699 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-urllib3. 2024-04-25T23:53:02.717 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests. 2024-04-25T23:53:02.726 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-25T23:53:02.743 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T23:53:02.766 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T23:53:02.783 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T23:53:03.077 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests. 2024-04-25T23:53:03.078 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T23:53:03.104 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-25T23:53:03.105 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T23:53:03.144 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T23:53:03.144 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T23:53:03.415 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T23:53:03.430 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-25T23:53:03.441 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:03.457 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-25T23:53:03.481 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:03.538 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T23:53:03.816 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-25T23:53:03.840 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:03.869 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T23:53:03.883 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:03.896 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:03.936 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:04.197 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T23:53:04.224 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T23:53:04.255 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T23:53:04.271 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-25T23:53:04.298 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:04.337 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:04.542 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T23:53:04.568 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T23:53:04.608 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T23:53:04.666 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-25T23:53:04.692 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-25T23:53:04.732 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-25T23:53:04.961 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T23:53:04.976 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-openssl. 2024-04-25T23:53:04.988 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:04.992 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-25T23:53:05.026 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-25T23:53:05.027 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:05.346 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr. 2024-04-25T23:53:05.372 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:05.412 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:05.439 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T23:53:05.466 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:05.506 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:05.816 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mon. 2024-04-25T23:53:05.842 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:05.882 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:06.084 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T23:53:06.111 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:06.151 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:06.419 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-osd. 2024-04-25T23:53:06.446 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:06.477 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:07.204 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph. 2024-04-25T23:53:07.228 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:07.270 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:07.539 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph. 2024-04-25T23:53:07.557 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T23:53:07.565 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../066-ceph_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:07.584 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:07.606 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:07.623 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:07.925 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-fuse. 2024-04-25T23:53:07.952 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T23:53:07.952 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:07.978 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:07.991 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:08.018 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:08.336 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mds. 2024-04-25T23:53:08.363 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:08.394 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:08.438 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package cephadm. 2024-04-25T23:53:08.465 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:08.504 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:08.764 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephadm. 2024-04-25T23:53:08.791 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../069-cephadm_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:08.822 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:08.840 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T23:53:08.867 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T23:53:08.907 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T23:53:09.125 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-25T23:53:09.152 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-25T23:53:09.191 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-25T23:53:09.268 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T23:53:09.294 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T23:53:09.338 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:09.494 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-25T23:53:09.521 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T23:53:09.561 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:10.331 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-babel. 2024-04-25T23:53:10.358 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T23:53:10.389 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:10.692 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T23:53:10.707 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-babel. 2024-04-25T23:53:10.719 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T23:53:10.734 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-25T23:53:10.750 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T23:53:10.766 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:11.035 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jinja2. 2024-04-25T23:53:11.062 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T23:53:11.062 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-25T23:53:11.089 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:11.093 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T23:53:11.120 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:11.413 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-25T23:53:11.423 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T23:53:11.439 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T23:53:11.440 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:11.471 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:11.473 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T23:53:11.751 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-routes. 2024-04-25T23:53:11.766 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-25T23:53:11.778 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T23:53:11.782 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-25T23:53:11.816 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-25T23:53:11.817 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T23:53:12.111 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-routes. 2024-04-25T23:53:12.137 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-25T23:53:12.154 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T23:53:12.177 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T23:53:12.181 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:12.390 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:12.539 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-25T23:53:12.566 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:12.605 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:13.718 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T23:53:13.746 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T23:53:13.784 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T23:53:13.785 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-25T23:53:13.802 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-25T23:53:13.837 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T23:53:14.263 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T23:53:14.278 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T23:53:14.289 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-joblib. 2024-04-25T23:53:14.313 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T23:53:14.316 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-25T23:53:14.355 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T23:53:14.641 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T23:53:14.668 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T23:53:14.699 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T23:53:14.709 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-25T23:53:14.736 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-25T23:53:14.775 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-25T23:53:14.961 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T23:53:14.987 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T23:53:15.027 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T23:53:15.078 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn. 2024-04-25T23:53:15.106 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-25T23:53:15.136 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T23:53:15.777 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T23:53:15.793 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:15.853 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-25T23:53:15.881 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:15.921 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:15.997 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:16.883 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T23:53:16.910 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T23:53:16.950 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T23:53:17.009 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cachetools. 2024-04-25T23:53:17.036 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-25T23:53:17.075 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-25T23:53:17.253 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T23:53:17.280 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T23:53:17.319 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T23:53:17.378 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-25T23:53:17.405 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-25T23:53:17.444 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-25T23:53:17.657 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T23:53:17.683 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T23:53:17.714 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T23:53:17.765 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-25T23:53:17.792 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-25T23:53:17.839 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T23:53:18.034 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T23:53:18.061 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T23:53:18.101 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T23:53:18.134 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rsa. 2024-04-25T23:53:18.161 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-25T23:53:18.201 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-25T23:53:18.413 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T23:53:18.440 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T23:53:18.479 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T23:53:18.521 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-google-auth. 2024-04-25T23:53:18.549 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-25T23:53:18.587 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-25T23:53:18.941 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T23:53:18.968 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T23:53:18.991 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-25T23:53:19.006 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-25T23:53:19.007 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T23:53:19.041 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T23:53:19.294 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T23:53:19.310 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-websocket. 2024-04-25T23:53:19.321 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T23:53:19.337 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-25T23:53:19.351 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T23:53:19.377 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-25T23:53:19.630 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T23:53:19.657 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T23:53:19.696 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T23:53:19.705 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-25T23:53:19.732 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-25T23:53:19.772 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T23:53:20.319 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T23:53:20.347 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:20.385 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:20.386 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-25T23:53:20.402 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:20.436 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:20.697 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T23:53:20.724 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T23:53:20.755 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T23:53:20.855 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-25T23:53:20.882 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-25T23:53:20.921 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T23:53:21.100 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T23:53:21.127 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T23:53:21.166 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T23:53:21.260 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-25T23:53:21.287 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T23:53:21.326 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T23:53:21.436 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package jq. 2024-04-25T23:53:21.463 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T23:53:21.502 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T23:53:21.587 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package jq. 2024-04-25T23:53:21.614 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-25T23:53:21.645 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-25T23:53:21.738 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package socat. 2024-04-25T23:53:21.754 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T23:53:21.788 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T23:53:21.848 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package socat. 2024-04-25T23:53:21.864 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-25T23:53:21.906 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-25T23:53:22.091 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T23:53:22.107 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T23:53:22.158 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T23:53:22.209 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package xmlstarlet. 2024-04-25T23:53:22.237 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-25T23:53:22.276 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-25T23:53:22.538 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-test. 2024-04-25T23:53:22.565 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:22.612 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:22.630 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-test. 2024-04-25T23:53:22.646 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../097-ceph-test_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:22.713 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:24.942 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T23:53:24.969 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:24.992 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-volume. 2024-04-25T23:53:25.008 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:25.020 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-2445-gd2c45d97-1jammy_all.deb ... 2024-04-25T23:53:25.050 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:25.312 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T23:53:25.313 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-25T23:53:25.328 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:25.339 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:25.362 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:25.378 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:25.623 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T23:53:25.636 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T23:53:25.665 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T23:53:25.706 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-25T23:53:25.734 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-25T23:53:25.781 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T23:53:25.995 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T23:53:26.022 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T23:53:26.061 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T23:53:26.103 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-25T23:53:26.130 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-25T23:53:26.169 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-25T23:53:26.432 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T23:53:26.459 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T23:53:26.498 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T23:53:26.523 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package nvme-cli. 2024-04-25T23:53:26.550 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-25T23:53:26.589 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T23:53:26.920 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package pkg-config. 2024-04-25T23:53:26.947 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T23:53:26.978 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T23:53:27.012 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package pkg-config. 2024-04-25T23:53:27.039 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-25T23:53:27.078 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T23:53:27.231 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T23:53:27.259 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T23:53:27.297 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T23:53:27.314 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-25T23:53:27.330 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-25T23:53:27.364 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-25T23:53:27.718 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T23:53:27.745 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T23:53:27.784 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T23:53:27.800 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-25T23:53:27.828 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-25T23:53:27.867 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-25T23:53:28.086 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T23:53:28.114 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T23:53:28.153 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T23:53:28.153 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pastescript. 2024-04-25T23:53:28.181 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-25T23:53:28.219 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-25T23:53:28.473 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T23:53:28.500 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T23:53:28.539 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T23:53:28.540 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pluggy. 2024-04-25T23:53:28.567 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-25T23:53:28.639 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-25T23:53:28.851 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T23:53:28.878 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T23:53:28.893 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-psutil. 2024-04-25T23:53:28.917 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T23:53:28.920 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-25T23:53:28.959 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-25T23:53:29.254 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-py. 2024-04-25T23:53:29.281 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T23:53:29.287 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-py. 2024-04-25T23:53:29.315 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-25T23:53:29.319 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T23:53:29.353 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-25T23:53:29.632 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T23:53:29.648 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pygments. 2024-04-25T23:53:29.659 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T23:53:29.675 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-25T23:53:29.698 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T23:53:29.714 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T23:53:30.170 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T23:53:30.194 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-25T23:53:30.198 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T23:53:30.221 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-25T23:53:30.235 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T23:53:30.260 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-25T23:53:30.547 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-toml. 2024-04-25T23:53:30.575 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T23:53:30.604 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-toml. 2024-04-25T23:53:30.613 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T23:53:30.632 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-25T23:53:30.671 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-25T23:53:30.916 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T23:53:30.944 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T23:53:30.983 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T23:53:31.224 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pytest. 2024-04-25T23:53:31.251 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-25T23:53:31.290 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T23:53:31.336 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T23:53:31.364 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T23:53:31.402 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T23:53:31.652 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplejson. 2024-04-25T23:53:31.655 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T23:53:31.680 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-25T23:53:31.683 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T23:53:31.718 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-25T23:53:31.721 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T23:53:31.971 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-25T23:53:31.987 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-25T23:53:32.029 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-25T23:53:32.487 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package radosgw. 2024-04-25T23:53:32.514 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:32.544 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:32.766 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package radosgw. 2024-04-25T23:53:32.794 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../116-radosgw_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:32.832 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:33.347 INFO:teuthology.orchestra.run.smithi106.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T23:53:33.364 INFO:teuthology.orchestra.run.smithi106.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:33.405 INFO:teuthology.orchestra.run.smithi106.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:33.661 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package rbd-fuse. 2024-04-25T23:53:33.677 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-2445-gd2c45d97-1jammy_amd64.deb ... 2024-04-25T23:53:33.719 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:33.726 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T23:53:33.969 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T23:53:33.999 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-25T23:53:34.095 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T23:53:34.249 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-25T23:53:34.368 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T23:53:34.375 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-25T23:53:34.641 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-25T23:53:34.708 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T23:53:35.003 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-25T23:53:35.165 INFO:teuthology.orchestra.run.smithi106.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T23:53:35.305 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:35.436 INFO:teuthology.orchestra.run.smithi171.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-25T23:53:35.510 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:35.993 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user cephadm....done 2024-04-25T23:53:36.130 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user cephadm....done 2024-04-25T23:53:36.149 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T23:53:36.262 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-25T23:53:36.443 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T23:53:36.546 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-25T23:53:36.685 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T23:53:36.811 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T23:53:36.814 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-25T23:53:36.940 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-25T23:53:37.071 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T23:53:37.191 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-25T23:53:37.330 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T23:53:37.443 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-25T23:53:37.448 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T23:53:37.544 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-25T23:53:37.741 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T23:53:37.854 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-25T23:53:38.093 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T23:53:38.214 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-25T23:53:38.353 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T23:53:38.482 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-25T23:53:38.637 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T23:53:38.758 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-25T23:53:38.897 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T23:53:39.147 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T23:53:39.310 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-25T23:53:39.399 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T23:53:39.569 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-25T23:53:39.650 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:39.828 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-25T23:53:39.918 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T23:53:40.027 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T23:53:40.088 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-argparse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:40.153 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T23:53:40.279 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T23:53:40.347 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-25T23:53:40.473 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-25T23:53:40.538 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T23:53:40.599 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-25T23:53:40.716 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-25T23:53:40.893 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T23:53:40.928 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T23:53:40.951 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-25T23:53:40.991 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T23:53:41.117 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T23:53:41.335 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-25T23:53:41.365 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-25T23:53:41.429 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-25T23:53:41.555 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-25T23:53:41.635 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:41.761 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T23:53:41.940 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:42.029 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T23:53:42.066 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-25T23:53:42.305 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T23:53:42.342 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-25T23:53:42.593 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-25T23:53:42.615 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T23:53:42.715 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T23:53:42.902 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up zip (3.0-12build2) ... 2024-04-25T23:53:43.028 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-25T23:53:43.342 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T23:53:43.593 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T23:53:43.680 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-25T23:53:43.720 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T23:53:43.845 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T23:53:43.940 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-25T23:53:44.066 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-25T23:53:44.146 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T23:53:44.183 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-25T23:53:44.501 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-25T23:53:44.614 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T23:53:44.865 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T23:53:44.886 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-25T23:53:45.137 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-25T23:53:45.242 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T23:53:45.522 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-25T23:53:45.526 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T23:53:45.831 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-25T23:53:45.870 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T23:53:46.129 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T23:53:46.191 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-25T23:53:46.255 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:46.434 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-25T23:53:46.535 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:46.548 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T23:53:46.819 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-idna (3.3-1) ... 2024-04-25T23:53:46.849 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T23:53:47.137 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-25T23:53:48.038 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T23:53:48.251 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-25T23:53:48.264 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:53:48.373 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T23:53:48.494 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:53:48.633 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T23:53:48.662 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-25T23:53:48.759 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T23:53:48.886 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T23:53:48.930 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-25T23:53:49.056 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-25T23:53:49.182 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-25T23:53:49.186 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T23:53:49.446 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T23:53:49.583 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-25T23:53:49.697 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:53:49.798 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T23:53:49.834 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-25T23:53:50.077 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:53:50.091 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T23:53:50.203 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-25T23:53:50.358 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T23:53:50.505 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-25T23:53:50.626 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T23:53:50.764 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-25T23:53:50.886 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T23:53:51.032 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-25T23:53:51.137 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T23:53:51.282 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-25T23:53:51.404 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T23:53:51.509 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-25T23:53:51.522 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T23:53:51.762 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-25T23:53:51.806 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T23:53:51.903 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-25T23:53:51.907 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T23:53:52.187 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-25T23:53:52.200 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T23:53:52.313 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-25T23:53:52.501 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T23:53:52.605 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-25T23:53:52.761 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T23:53:52.887 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T23:53:52.923 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-25T23:53:53.013 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:53.085 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T23:53:53.166 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-25T23:53:53.267 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-25T23:53:53.314 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T23:53:53.410 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-25T23:53:53.474 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T23:53:53.500 INFO:teuthology.orchestra.run.smithi106.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-25T23:53:53.753 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-25T23:53:53.858 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T23:53:53.879 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-25T23:53:54.101 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T23:53:54.227 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T23:53:54.264 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-25T23:53:54.495 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:53:54.588 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-25T23:53:54.621 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T23:53:54.632 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-25T23:53:54.875 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-25T23:53:54.930 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T23:53:54.985 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-25T23:53:55.239 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T23:53:55.286 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-25T23:53:55.507 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T23:53:55.604 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-25T23:53:55.625 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T23:53:55.880 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-25T23:53:55.884 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T23:53:56.006 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-25T23:53:56.152 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T23:53:56.282 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-25T23:53:56.505 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T23:53:56.533 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-25T23:53:56.886 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-25T23:53:56.899 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T23:53:57.192 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T23:53:57.263 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-25T23:53:57.544 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T23:53:57.547 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-25T23:53:57.670 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:57.780 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:57.889 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T23:53:57.908 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-25T23:53:58.010 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librados2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:58.119 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libsqlite3-mod-ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:58.234 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:58.245 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-25T23:53:58.360 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:58.486 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T23:53:58.606 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:58.732 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libradosstriper1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:58.762 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:58.858 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-25T23:53:58.888 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:59.014 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:59.118 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librbd1 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:59.225 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T23:53:59.225 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T23:53:59.228 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-modules-core (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:59.354 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:59.568 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T23:53:59.568 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-25T23:53:59.707 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:59.833 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:53:59.959 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:00.085 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T23:54:00.105 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up libcephfs-dev (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:00.231 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rados (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:00.357 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up librgw2 (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:00.483 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-25T23:54:01.288 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:01.415 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:01.524 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:01.642 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:01.711 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rbd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:01.759 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:01.838 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up rbd-fuse (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:01.990 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-rgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:02.114 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up python3-cephfs (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:02.224 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-common (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:02.311 INFO:teuthology.orchestra.run.smithi171.stdout:Adding group ceph....done 2024-04-25T23:54:02.638 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user ceph....done 2024-04-25T23:54:02.725 INFO:teuthology.orchestra.run.smithi106.stdout:Adding group ceph....done 2024-04-25T23:54:02.805 INFO:teuthology.orchestra.run.smithi171.stdout:Setting system user ceph properties....done 2024-04-25T23:54:02.821 INFO:teuthology.orchestra.run.smithi171.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T23:54:02.969 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T23:54:03.101 INFO:teuthology.orchestra.run.smithi106.stdout:Adding system user ceph....done 2024-04-25T23:54:03.270 INFO:teuthology.orchestra.run.smithi106.stdout:Setting system user ceph properties....done 2024-04-25T23:54:03.288 INFO:teuthology.orchestra.run.smithi106.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-25T23:54:03.326 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T23:54:03.421 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-25T23:54:03.748 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-25T23:54:03.826 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:03.953 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:04.234 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-test (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:04.359 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up radosgw (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:04.448 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T23:54:04.448 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T23:54:04.832 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T23:54:04.832 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-25T23:54:04.888 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:05.252 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T23:54:05.370 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-base (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:05.739 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:05.824 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-25T23:54:05.970 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T23:54:05.970 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T23:54:06.338 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mds (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:06.483 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:06.585 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T23:54:06.586 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-25T23:54:06.690 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T23:54:06.690 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T23:54:07.082 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:07.288 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T23:54:07.288 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-25T23:54:07.446 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:07.758 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-osd (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:07.776 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T23:54:07.776 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T23:54:08.037 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T23:54:08.037 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-25T23:54:08.305 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:08.466 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:08.518 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-k8sevents (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:08.609 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:08.661 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:08.810 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T23:54:08.810 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T23:54:08.828 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mon (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.047 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T23:54:09.047 INFO:teuthology.orchestra.run.smithi106.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-25T23:54:09.309 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.461 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.529 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-cephadm (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.586 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.672 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.712 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.781 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-mgr-dashboard (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:09.959 INFO:teuthology.orchestra.run.smithi106.stdout:Setting up ceph-volume (19.0.0-2445-gd2c45d97-1jammy) ... 2024-04-25T23:54:10.074 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T23:54:10.183 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T23:54:10.295 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-25T23:54:10.335 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T23:54:10.404 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-25T23:54:10.565 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-25T23:54:11.127 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T23:54:11.649 INFO:teuthology.orchestra.run.smithi106.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-25T23:54:11.770 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T23:54:11.776 DEBUG:teuthology.parallel:result is None 2024-04-25T23:54:12.328 INFO:teuthology.orchestra.run.smithi106.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-25T23:54:12.332 DEBUG:teuthology.parallel:result is None 2024-04-25T23:54:12.333 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T23:54:12.560 DEBUG:teuthology.orchestra.run.smithi106:> dpkg-query -W -f '${Version}' ceph 2024-04-25T23:54:12.579 INFO:teuthology.orchestra.run.smithi106.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:54:12.580 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:54:12.580 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T23:54:12.582 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T23:54:12.803 DEBUG:teuthology.orchestra.run.smithi171:> dpkg-query -W -f '${Version}' ceph 2024-04-25T23:54:12.823 INFO:teuthology.orchestra.run.smithi171.stdout:19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:54:12.823 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2445-gd2c45d97-1jammy 2024-04-25T23:54:12.823 INFO:teuthology.task.install:The correct ceph version 19.0.0-2445-gd2c45d97-1jammy is installed. 2024-04-25T23:54:12.825 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T23:54:12.825 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:12.825 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T23:54:12.839 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:12.839 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T23:54:12.880 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T23:54:12.880 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:12.880 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T23:54:12.894 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T23:54:12.949 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:12.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T23:54:12.963 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T23:54:13.018 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T23:54:13.019 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:13.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T23:54:13.031 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T23:54:13.085 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:13.085 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T23:54:13.098 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T23:54:13.154 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T23:54:13.154 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:13.154 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T23:54:13.168 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T23:54:13.221 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:13.222 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T23:54:13.234 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T23:54:13.290 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T23:54:13.372 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T23:54:13.373 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 777 /var/log/ceph 2024-04-25T23:54:13.375 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-04-25T23:54:13.388 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T23:54:13.388 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T23:54:13.431 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T23:54:13.443 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T23:54:13.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T23:54:13.487 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T23:54:13.512 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T23:54:13.512 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(AUTH_BAD_CAPS\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-04-25T23:54:13.512 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841', 'branch': 'squid', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7673841', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(TOO_FEW_PGS\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'but it is still running', 'overall HEALTH_', '\\(PG_', '\\(MON_DOWN\\)', '\\(AUTH_BAD_CAPS\\)'], 'mon_bind_msgr2': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 101, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 9886, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '30270/100000', 'suite': 'rados', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_b22e2ebdeb24376882b7bda2a7329c8cccc2276a/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a', 'targets': {'smithi106.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDXz2N5HH/vrYk1GKeLOFf20PxNozA8TuZXj9xeF7zNk3FtOupkVbbRqJlhhCO25rA3+XDZh0PRL9Whr3DI5yZU=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHHIo9ZsjU8lmoHAV5btKh3fKiQ7rBuA6Er9u3x89BAf9lk0hIuO9t7sPcB003NtknVKg3qvmzn8sqstFEGuNaE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'store_thrash': True, 'thrash_delay': 1, 'thrash_many': True}}, {'workunit': {'clients': {'client.0': ['mon/pool_ops.sh', 'mon/crush_ops.sh', 'mon/osd.sh', 'mon/caps.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-25_21:00:03', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T23:54:13.512 DEBUG:teuthology.orchestra.run.smithi106:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T23:54:13.543 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T23:54:13.551 DEBUG:teuthology.orchestra.run.smithi106:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T23:54:13.591 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T23:54:13.606 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:13.606 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T23:54:13.650 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T23:54:13.650 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_1 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-25 23:48:53.455438783 +0000 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-25 23:48:53.451438947 +0000 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-25 23:48:53.451438947 +0000 2024-04-25T23:54:13.699 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-04-25T23:54:13.699 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T23:54:13.752 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-25T23:54:13.752 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-25T23:54:13.752 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000337386 s, 1.5 MB/s 2024-04-25T23:54:13.753 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T23:54:13.804 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_2 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-25 23:48:54.223407566 +0000 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-25 23:48:53.963417990 +0000 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-25 23:48:53.963417990 +0000 2024-04-25T23:54:13.850 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-04-25T23:54:13.850 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T23:54:13.904 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-25T23:54:13.904 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-25T23:54:13.904 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000414261 s, 1.2 MB/s 2024-04-25T23:54:13.905 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T23:54:13.955 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_3 2024-04-25T23:54:14.002 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T23:54:14.002 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:14.002 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 921 Links: 1 2024-04-25T23:54:14.002 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:14.002 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-25 23:48:54.491396864 +0000 2024-04-25T23:54:14.002 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-25 23:48:54.487397023 +0000 2024-04-25T23:54:14.003 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-25 23:48:54.487397023 +0000 2024-04-25T23:54:14.003 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-04-25T23:54:14.003 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T23:54:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-25T23:54:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-25T23:54:14.056 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000332645 s, 1.5 MB/s 2024-04-25T23:54:14.058 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T23:54:14.107 DEBUG:teuthology.orchestra.run.smithi106:> stat /dev/vg_nvme/lv_4 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout:Access: 2024-04-25 23:48:55.287365359 +0000 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout:Modify: 2024-04-25 23:48:55.007376260 +0000 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout:Change: 2024-04-25 23:48:55.007376260 +0000 2024-04-25T23:54:14.154 INFO:teuthology.orchestra.run.smithi106.stdout: Birth: - 2024-04-25T23:54:14.155 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T23:54:14.207 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records in 2024-04-25T23:54:14.207 INFO:teuthology.orchestra.run.smithi106.stderr:1+0 records out 2024-04-25T23:54:14.208 INFO:teuthology.orchestra.run.smithi106.stderr:512 bytes copied, 0.000302899 s, 1.7 MB/s 2024-04-25T23:54:14.209 DEBUG:teuthology.orchestra.run.smithi106:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T23:54:14.255 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:14.255 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:14.256 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T23:54:14.261 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T23:54:14.261 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-04-25T23:54:14.307 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T23:54:14.307 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:14.307 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 883 Links: 1 2024-04-25T23:54:14.307 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:14.307 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-25 23:48:53.690849273 +0000 2024-04-25T23:54:14.307 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-25 23:48:53.430851596 +0000 2024-04-25T23:54:14.308 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-25 23:48:53.430851596 +0000 2024-04-25T23:54:14.308 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-25T23:54:14.308 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T23:54:14.362 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-25T23:54:14.362 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-25T23:54:14.362 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000462163 s, 1.1 MB/s 2024-04-25T23:54:14.363 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T23:54:14.412 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-25 23:48:54.194844772 +0000 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-25 23:48:53.946846987 +0000 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-25 23:48:53.946846987 +0000 2024-04-25T23:54:14.459 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-25T23:54:14.460 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T23:54:14.513 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-25T23:54:14.513 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-25T23:54:14.513 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000298042 s, 1.7 MB/s 2024-04-25T23:54:14.514 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T23:54:14.564 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-04-25T23:54:14.611 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T23:54:14.611 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:14.611 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-04-25T23:54:14.611 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:14.612 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-25 23:48:54.710840162 +0000 2024-04-25T23:54:14.612 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-25 23:48:54.434842627 +0000 2024-04-25T23:54:14.612 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-25 23:48:54.434842627 +0000 2024-04-25T23:54:14.612 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-25T23:54:14.612 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T23:54:14.666 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-25T23:54:14.666 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-25T23:54:14.666 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000384284 s, 1.3 MB/s 2024-04-25T23:54:14.667 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T23:54:14.716 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-04-25 23:48:55.214835661 +0000 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-04-25 23:48:54.938838126 +0000 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-04-25 23:48:54.938838126 +0000 2024-04-25T23:54:14.763 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-04-25T23:54:14.764 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T23:54:14.817 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-04-25T23:54:14.817 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-04-25T23:54:14.817 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000373657 s, 1.4 MB/s 2024-04-25T23:54:14.819 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T23:54:14.869 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:14.869 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-25T23:54:14.869 INFO:tasks.ceph:Generating config... 2024-04-25T23:54:14.870 INFO:tasks.ceph:[client] debug monc = 20 2024-04-25T23:54:14.871 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T23:54:14.871 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-04-25T23:54:14.871 INFO:tasks.ceph:[global] mon election default strategy = 1 2024-04-25T23:54:14.871 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-04-25T23:54:14.871 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-04-25T23:54:14.871 INFO:tasks.ceph:[global] ms type = async 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-04-25T23:54:14.871 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-04-25T23:54:14.872 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2024-04-25T23:54:14.872 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2024-04-25T23:54:14.872 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-04-25T23:54:14.872 INFO:tasks.ceph:[mon] paxos service trim min = 5 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] bluestore compression algorithm = lz4 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-25T23:54:14.872 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-04-25T23:54:14.873 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-04-25T23:54:14.873 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T23:54:14.873 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:14.907 INFO:teuthology.orchestra.run.smithi106.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T23:54:14.923 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T23:54:15.001 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T23:54:15.056 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.106:6789]'), ('mon.b', '[v1:172.21.15.106:6790]'), ('mon.c', '[v1:172.21.15.106:6791]'), ('mon.d', '[v1:172.21.15.106:6792]'), ('mon.e', '[v1:172.21.15.106:6793]'), ('mon.f', '[v1:172.21.15.171:6789]'), ('mon.g', '[v1:172.21.15.171:6790]'), ('mon.h', '[v1:172.21.15.171:6791]'), ('mon.i', '[v1:172.21.15.171:6792]')] 2024-04-25T23:54:15.057 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.106:6789],[v1:172.21.15.106:6790],[v1:172.21.15.106:6791],[v1:172.21.15.106:6792],[v1:172.21.15.106:6793],[v1:172.21.15.171:6789],[v1:172.21.15.171:6790],[v1:172.21.15.171:6791],[v1:172.21.15.171:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 1, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'lz4', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos service trim min': 5}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2024-04-25T23:54:15.058 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:15.058 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T23:54:15.102 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.106:6789]' --addv b '[v1:172.21.15.106:6790]' --addv c '[v1:172.21.15.106:6791]' --addv d '[v1:172.21.15.106:6792]' --addv e '[v1:172.21.15.106:6793]' --addv f '[v1:172.21.15.171:6789]' --addv g '[v1:172.21.15.171:6790]' --addv h '[v1:172.21.15.171:6791]' --addv i '[v1:172.21.15.171:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: generated fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:setting min_mon_release = quincy 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:epoch 0 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:15.206 INFO:teuthology.orchestra.run.smithi106.stdout:min_mon_release 17 (quincy) 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:election_strategy: 1 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:1: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:2: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:3: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:4: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:5: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:6: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:7: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:8: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:15.207 INFO:teuthology.orchestra.run.smithi106.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2024-04-25T23:54:15.208 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T23:54:15.214 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 91a11040-4c8b-4137-ad71-c18376365faa... 2024-04-25T23:54:15.215 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T23:54:15.259 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T23:54:15.286 INFO:teuthology.orchestra.run.smithi106.stdout:[global] 2024-04-25T23:54:15.286 INFO:teuthology.orchestra.run.smithi106.stdout: chdir = "" 2024-04-25T23:54:15.286 INFO:teuthology.orchestra.run.smithi106.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T23:54:15.286 INFO:teuthology.orchestra.run.smithi106.stdout: auth supported = cephx 2024-04-25T23:54:15.286 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.286 INFO:teuthology.orchestra.run.smithi106.stdout: filestore xattr use omap = true 2024-04-25T23:54:15.286 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.287 INFO:teuthology.orchestra.run.smithi106.stdout: mon clock drift allowed = 1.000 2024-04-25T23:54:15.287 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.287 INFO:teuthology.orchestra.run.smithi106.stdout: osd crush chooseleaf type = 0 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: auth debug = true 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on old message = true 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: ms die on bug = true 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: mon pg warn max object skew = 0 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T23:54:15.289 INFO:teuthology.orchestra.run.smithi106.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default size = 2 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow primary affinity = true 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd allow pg remap = true 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on legacy crush tunables = false 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on crush straw calc version zero = false 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on no sortbitwise = false 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on osd down out interval zero = false 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon warn on too few osds = false 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: mon_allow_pool_size_one = true 2024-04-25T23:54:15.290 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: osd default data pool replay window = 5 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon allow pool delete = true 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon cluster log file level = debug 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: debug asserts on shutdown = true 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon health detail to clog = false 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon host = "[v1:172.21.15.106:6789],[v1:172.21.15.106:6790],[v1:172.21.15.106:6791],[v1:172.21.15.106:6792],[v1:172.21.15.106:6793],[v1:172.21.15.171:6789],[v1:172.21.15.171:6790],[v1:172.21.15.171:6791],[v1:172.21.15.171:6792]" 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon client directed command retry = 5 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: mon election default strategy = 1 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: ms bind msgr2 = False 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: ms inject socket failures = 5000 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: ms type = async 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: fsid = 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:15.291 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout:[osd] 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd journal size = 100 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub load threshold = 5.0 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd scrub max interval = 600 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock profile = high_recovery_ops 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd recover clone overlap = true 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd recovery max chunk = 1048576 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug shutdown = true 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug op order = true 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify stray on activate = true 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug trim objects = true 2024-04-25T23:54:15.292 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: osd open classes on start = true 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug pg log writeout = true 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: osd deep scrub update digest min age = 30 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: osd map max advance = 10 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: journal zero on create = true 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: filestore ondisk finisher threads = 3 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: filestore apply finisher threads = 3 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: bdev debug aio = true 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug misdirected ops = true 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore block size = 96636764160 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore compression algorithm = lz4 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore compression mode = aggressive 2024-04-25T23:54:15.293 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore fsck on mount = True 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: bluestore zero block detection = True 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluefs = 20 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: debug bluestore = 20 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: debug osd = 20 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: debug rocksdb = 10 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd full ratio = 0.9 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd nearfull ratio = 0.8 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify cached snaps = True 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: osd debug verify missing on start = True 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: osd failsafe full ratio = 0.95 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: osd mclock override recovery settings = True 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: osd objectstore = bluestore 2024-04-25T23:54:15.294 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue = debug_random 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: osd op queue cut off = debug_random 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr] 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug mgr = 20 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: mgr/telemetry/nag = false 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout:[mon] 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug mon = 20 2024-04-25T23:54:15.295 INFO:teuthology.orchestra.run.smithi106.stdout: debug paxos = 20 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: debug auth = 20 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon data avail warn = 5 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon mgr mkfs grace = 240 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min pgs per osd = 4 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd reporter subtree level = osd 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon osd prime pg temp = true 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon reweight min bytes per osd = 10 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T23:54:15.296 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: # 1m isn't quite enough 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon_down_mkfs_grace = 2m 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon_warn_on_filestore_osds = false 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon min osdmap epochs = 25 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune interval = 2 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune min = 15 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon osdmap full prune txsize = 2 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub inject crc mismatch = 0.01 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub inject missing keys = 0.05 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: mon scrub interval = 300 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: paxos service trim min = 5 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout:[client] 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: rgw cache enabled = true 2024-04-25T23:54:15.297 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable ops log = true 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout: rgw enable usage log = true 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout: debug monc = 20 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout: debug ms = 1 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.a] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.b] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.c] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.d] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.e] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.f] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.g] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.h] 2024-04-25T23:54:15.298 INFO:teuthology.orchestra.run.smithi106.stdout:[mon.i] 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-04-25T23:54:15.302 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-04-25T23:54:15.303 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-04-25T23:54:15.304 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-04-25T23:54:15.305 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "[v1:172.21.15.106:6789],[v1:172.21.15.106:6790],[v1:172.21.15.106:6791],[v1:172.21.15.106:6792],[v1:172.21.15.106:6793],[v1:172.21.15.171:6789],[v1:172.21.15.171:6790],[v1:172.21.15.171:6791],[v1:172.21.15.171:6792]" 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: mon client directed command retry = 5 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: mon election default strategy = 1 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: ms bind msgr2 = False 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: ms inject socket failures = 5000 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: ms type = async 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.306 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-04-25T23:54:15.307 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression algorithm = lz4 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore compression mode = aggressive 2024-04-25T23:54:15.308 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore zero block detection = True 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 20 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 20 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 10 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify cached snaps = True 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify missing on start = True 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock override recovery settings = True 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-04-25T23:54:15.309 INFO:teuthology.orchestra.run.smithi171.stdout: osd op queue = debug_random 2024-04-25T23:54:15.310 INFO:teuthology.orchestra.run.smithi171.stdout: osd op queue cut off = debug_random 2024-04-25T23:54:15.310 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.310 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-04-25T23:54:15.310 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-25T23:54:15.310 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-04-25T23:54:15.311 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.312 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: mon min osdmap epochs = 25 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: mon osdmap full prune interval = 2 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: mon osdmap full prune min = 15 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: mon osdmap full prune txsize = 2 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: mon scrub inject crc mismatch = 0.01 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: mon scrub inject missing keys = 0.05 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: mon scrub interval = 300 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: paxos service trim min = 5 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T23:54:15.313 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout: debug monc = 20 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.d] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.e] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.f] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.g] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.h] 2024-04-25T23:54:15.314 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.i] 2024-04-25T23:54:15.314 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T23:54:15.315 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T23:54:15.390 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T23:54:15.391 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:15.391 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T23:54:15.395 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:15.395 DEBUG:teuthology.orchestra.run.smithi106:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T23:54:15.441 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi106.front.sepia.ceph.com 2024-04-25T23:54:15.442 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:15.442 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T23:54:15.442 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T23:54:15.505 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:15.505 DEBUG:teuthology.orchestra.run.smithi106:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:15.550 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-04-25T23:54:15.551 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:15.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T23:54:15.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T23:54:15.574 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:15.574 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:15.624 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T23:54:15.624 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T23:54:15.624 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T23:54:15.707 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T23:54:15.714 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T23:54:15.714 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T23:54:15.714 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T23:54:15.792 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T23:54:15.801 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T23:54:15.801 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi106.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-04-25T23:54:15.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T23:54:15.815 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:15.815 INFO:tasks.ceph:role: osd.0 2024-04-25T23:54:15.815 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-25T23:54:15.815 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T23:54:15.878 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T23:54:15.879 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T23:54:15.879 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T23:54:15.879 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T23:54:15.879 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T23:54:15.880 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-25T23:54:15.880 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T23:54:15.880 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T23:54:15.880 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T23:54:15.880 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T23:54:16.362 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-25T23:54:16.365 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-25T23:54:16.366 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T23:54:16.529 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T23:54:16.540 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:54:16.540 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T23:54:16.541 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T23:54:16.593 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:16.593 INFO:tasks.ceph:role: osd.1 2024-04-25T23:54:16.593 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-25T23:54:16.593 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T23:54:16.657 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T23:54:16.658 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T23:54:16.658 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T23:54:17.099 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-25T23:54:17.101 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-25T23:54:17.101 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T23:54:17.191 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T23:54:17.202 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:54:17.202 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T23:54:17.203 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T23:54:17.256 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:17.256 INFO:tasks.ceph:role: osd.2 2024-04-25T23:54:17.256 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-25T23:54:17.257 DEBUG:teuthology.orchestra.run.smithi106:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout: = sunit=0 swidth=0 blks 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T23:54:17.317 INFO:teuthology.orchestra.run.smithi106.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T23:54:17.793 INFO:teuthology.orchestra.run.smithi106.stdout:Discarding blocks...Done. 2024-04-25T23:54:17.795 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi106.front.sepia.ceph.com -o noatime 2024-04-25T23:54:17.795 DEBUG:teuthology.orchestra.run.smithi106:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T23:54:17.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T23:54:17.932 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:54:17.932 INFO:teuthology.orchestra.run.smithi106.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T23:54:17.932 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:18.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:18.056+0000 7f7119fcc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T23:54:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:18.060+0000 7f7119fcc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T23:54:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:18.060+0000 7f7119fcc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T23:54:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:18.060+0000 7f7119fcc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T23:54:18.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:18.060+0000 7f7119fcc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T23:54:18.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:18.072+0000 7f7119fcc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T23:54:21.023 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T23:54:21.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:21.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:21.136+0000 7fb40f0ba7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T23:54:21.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:21.136+0000 7fb40f0ba7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T23:54:21.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:21.136+0000 7fb40f0ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T23:54:21.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:21.136+0000 7fb40f0ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T23:54:21.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:21.136+0000 7fb40f0ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T23:54:21.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:21.140+0000 7fb40f0ba7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T23:54:24.104 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T23:54:24.159 DEBUG:teuthology.orchestra.run.smithi106:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:24.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:24.256+0000 7eff33faa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T23:54:24.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:24.256+0000 7eff33faa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T23:54:24.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:24.256+0000 7eff33faa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T23:54:24.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:24.256+0000 7eff33faa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T23:54:24.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:24.256+0000 7eff33faa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T23:54:24.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:24.256+0000 7eff33faa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T23:54:27.228 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T23:54:27.282 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T23:54:27.298 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:27.298 INFO:tasks.ceph:role: osd.3 2024-04-25T23:54:27.298 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-25T23:54:27.299 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T23:54:27.363 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T23:54:27.363 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T23:54:27.364 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T23:54:27.364 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T23:54:27.364 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T23:54:27.364 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-25T23:54:27.364 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T23:54:27.364 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T23:54:27.365 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T23:54:27.365 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T23:54:27.820 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-25T23:54:27.822 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-25T23:54:27.822 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-04-25T23:54:27.929 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T23:54:27.940 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:54:27.940 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T23:54:27.940 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-25T23:54:27.995 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:27.995 INFO:tasks.ceph:role: osd.4 2024-04-25T23:54:27.995 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-25T23:54:27.995 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T23:54:28.059 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T23:54:28.542 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-25T23:54:28.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-25T23:54:28.544 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-04-25T23:54:28.681 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-25T23:54:28.693 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T23:54:28.693 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:54:28.694 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-25T23:54:28.750 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-04-25T23:54:28.750 INFO:tasks.ceph:role: osd.5 2024-04-25T23:54:28.750 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-25T23:54:28.751 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T23:54:28.814 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T23:54:28.815 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T23:54:29.268 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-04-25T23:54:29.270 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-04-25T23:54:29.270 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-04-25T23:54:29.418 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-25T23:54:29.429 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:54:29.429 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-04-25T23:54:29.429 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:29.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:29.550+0000 7f04dc7437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T23:54:29.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:29.554+0000 7f04dc7437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T23:54:29.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:29.554+0000 7f04dc7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T23:54:29.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:29.554+0000 7f04dc7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T23:54:29.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:29.554+0000 7f04dc7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T23:54:29.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:29.554+0000 7f04dc7437c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T23:54:32.514 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T23:54:32.527 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:32.608 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:32.626+0000 7efe65c367c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-25T23:54:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:32.626+0000 7efe65c367c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-25T23:54:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:32.626+0000 7efe65c367c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T23:54:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:32.626+0000 7efe65c367c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T23:54:32.609 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:32.626+0000 7efe65c367c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-25T23:54:32.610 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:32.626+0000 7efe65c367c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-25T23:54:35.590 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-25T23:54:35.648 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:35.729 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:35.746+0000 7f45841237c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-25T23:54:35.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:35.746+0000 7f45841237c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-25T23:54:35.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:35.746+0000 7f45841237c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T23:54:35.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:35.746+0000 7f45841237c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T23:54:35.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:35.746+0000 7f45841237c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-25T23:54:35.730 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:35.750+0000 7f45841237c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-25T23:54:38.713 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-25T23:54:38.767 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T23:54:38.767 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:38.767 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T23:54:38.782 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:38.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T23:54:38.837 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:38.838 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T23:54:38.894 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:38.894 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T23:54:38.907 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:38.907 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T23:54:38.962 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:38.963 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-25T23:54:39.017 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:39.017 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-25T23:54:39.073 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:39.073 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T23:54:39.118 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T23:54:39.119 DEBUG:teuthology.orchestra.run.smithi106:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T23:54:39.121 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T23:54:39.164 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.0] 2024-04-25T23:54:39.164 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAq7SpmqlmNAxAAvXHqHz0gMro0hGVPk3Nx9w== 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.1] 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAt7SpmNmBuCBAAQD+EWlXhcpQhK+B4cMhe3A== 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.2] 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAw7SpmbrqBDxAAwKBjK+q0ULWNIF3MUetD8w== 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout:[mgr.x] 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAn7Spm1CdaKxAA3gZlHSl7NmpDBppFtxwSZw== 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.3] 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA17SpmJFz9IBAAzykrPfOxNCU8SbfVxwiLXA== 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.4] 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA47SpmT4R8JRAALD+3qkPbVPgqxP2XKeAUVA== 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout:[osd.5] 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQA77SpmAjerLBAADj4qoahm0fw6znhwWfTPYQ== 2024-04-25T23:54:39.165 INFO:teuthology.orchestra.run.smithi106.stdout:[client.0] 2024-04-25T23:54:39.166 INFO:teuthology.orchestra.run.smithi106.stdout: key = AQAn7Spmk6VeMBAArgLu+kjAEhtxFYxWvlW8DQ== 2024-04-25T23:54:39.172 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAq7SpmqlmNAxAAvXHqHz0gMro0hGVPk3Nx9w== 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAt7SpmNmBuCBAAQD+EWlXhcpQhK+B4cMhe3A== 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAw7SpmbrqBDxAAwKBjK+q0ULWNIF3MUetD8w== 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAn7Spm1CdaKxAA3gZlHSl7NmpDBppFtxwSZw== 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQA17SpmJFz9IBAAzykrPfOxNCU8SbfVxwiLXA== 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQA47SpmT4R8JRAALD+3qkPbVPgqxP2XKeAUVA== 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-04-25T23:54:39.173 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQA77SpmAjerLBAADj4qoahm0fw6znhwWfTPYQ== 2024-04-25T23:54:39.174 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-04-25T23:54:39.174 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQAn7Spmk6VeMBAArgLu+kjAEhtxFYxWvlW8DQ== 2024-04-25T23:54:39.175 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.211 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.262 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.265 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.304 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.351 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.393 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T23:54:39.435 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T23:54:39.481 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.519 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.566 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.603 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.651 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.683 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T23:54:39.733 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T23:54:39.767 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T23:54:39.828 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T23:54:39.828 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T23:54:39.860 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:39.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T23:54:40.001 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T23:54:40.058 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:40.153 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T23:54:40.163 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T23:54:40.215 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:40.304 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T23:54:40.314 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2024-04-25T23:54:40.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:40.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2024-04-25T23:54:40.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2024-04-25T23:54:40.523 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:40.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2024-04-25T23:54:40.665 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2024-04-25T23:54:40.679 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:40.772 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2024-04-25T23:54:40.783 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2024-04-25T23:54:40.835 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:40.928 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2024-04-25T23:54:40.938 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2024-04-25T23:54:40.991 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:41.078 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2024-04-25T23:54:41.134 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2024-04-25T23:54:41.189 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T23:54:41.282 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2024-04-25T23:54:41.293 DEBUG:teuthology.orchestra.run.smithi106:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:41.296 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T23:54:41.339 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T23:54:41.339 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T23:54:41.339 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T23:54:41.342 INFO:tasks.ceph.mon.a:Started 2024-04-25T23:54:41.343 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T23:54:41.343 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T23:54:41.345 INFO:tasks.ceph.mon.b:Started 2024-04-25T23:54:41.345 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T23:54:41.345 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T23:54:41.347 INFO:tasks.ceph.mon.c:Started 2024-04-25T23:54:41.348 INFO:tasks.ceph.mon.d:Restarting daemon 2024-04-25T23:54:41.348 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-04-25T23:54:41.351 INFO:tasks.ceph.mon.d:Started 2024-04-25T23:54:41.351 INFO:tasks.ceph.mon.e:Restarting daemon 2024-04-25T23:54:41.351 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-04-25T23:54:41.353 INFO:tasks.ceph.mon.e:Started 2024-04-25T23:54:41.353 INFO:tasks.ceph.mon.f:Restarting daemon 2024-04-25T23:54:41.354 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-04-25T23:54:41.383 INFO:tasks.ceph.mon.f:Started 2024-04-25T23:54:41.384 INFO:tasks.ceph.mon.g:Restarting daemon 2024-04-25T23:54:41.384 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-04-25T23:54:41.386 INFO:tasks.ceph.mon.g:Started 2024-04-25T23:54:41.386 INFO:tasks.ceph.mon.h:Restarting daemon 2024-04-25T23:54:41.386 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-04-25T23:54:41.389 INFO:tasks.ceph.mon.h:Started 2024-04-25T23:54:41.389 INFO:tasks.ceph.mon.i:Restarting daemon 2024-04-25T23:54:41.389 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-04-25T23:54:41.391 INFO:tasks.ceph.mon.i:Started 2024-04-25T23:54:41.391 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T23:54:41.391 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T23:54:41.392 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T23:54:41.394 INFO:tasks.ceph.mgr.x:Started 2024-04-25T23:54:41.394 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T23:54:41.394 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient: get_monmap_and_config 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient: build_initial_monmap 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient: monmap: 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:41.542901+0000 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:41.542901+0000 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:41.522 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:41.523 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:41.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 1 Processor -- start 2024-04-25T23:54:41.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 1 -- start start 2024-04-25T23:54:41.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient: init 2024-04-25T23:54:41.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:41.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient: _add_conns ranks=[1,0,3,5,6,4,2,7,8] 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient(hunting): picked mon.noname-f con 0x7f5104134970 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient(hunting): picked mon.noname-a con 0x7f51040a4820 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient(hunting): picked mon.noname-g con 0x7f510413e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510406dd40 con 0x7f51040a4820 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51040a2b10 con 0x7f5104134970 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51040a2df0 con 0x7f510413e200 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f510a5f4640 10 monclient(hunting): authenticate will time out at 937.069677s 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f51037fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f51040a4820 0x7f510413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:45636/0 (socket says 172.21.15.106:45636) 2024-04-25T23:54:41.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:41.540+0000 7f51037fe640 1 -- 172.21.15.106:0/3639007486 learned_addr learned my addr 172.21.15.106:0/3639007486 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:44.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient(hunting): tick 2024-04-25T23:54:44.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 1 monclient(hunting): continuing hunt 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 1 -- 172.21.15.106:0/3639007486 >> v1:172.21.15.171:6790/0 conn(0x7f510413e200 legacy=0x7f51041405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 1 -- 172.21.15.106:0/3639007486 >> v1:172.21.15.171:6789/0 conn(0x7f5104134970 legacy=0x7f5104134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 1 -- 172.21.15.106:0/3639007486 >> v1:172.21.15.106:6789/0 conn(0x7f51040a4820 legacy=0x7f510413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient: _add_conns ranks=[2,4,5,7,8,6] 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f50f00037f0 addr v1:172.21.15.106:6790/0 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f50f0007480 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient(hunting): picked mon.noname-h con 0x7f50f000b210 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 1 -- 172.21.15.106:0/3639007486 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51040a30d0 con 0x7f50f00037f0 2024-04-25T23:54:44.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 1 -- 172.21.15.106:0/3639007486 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f0010020 con 0x7f50f0007480 2024-04-25T23:54:44.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 1 -- 172.21.15.106:0/3639007486 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f0011290 con 0x7f50f000b210 2024-04-25T23:54:44.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:44.540+0000 7f5101ffb640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2490860623 0 0) 0x7f51040a30d0 con 0x7f50f00037f0 2024-04-25T23:54:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): my global_id is 4106 2024-04-25T23:54:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50ec003530 con 0x7f50f00037f0 2024-04-25T23:54:46.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195039632 0 0) 0x7f50f0011290 con 0x7f50f000b210 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient(hunting): my global_id is 4109 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51040a30d0 con 0x7f50f000b210 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1684379364 0 0) 0x7f50ec003530 con 0x7f50f00037f0 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 >> v1:172.21.15.171:6791/0 conn(0x7f50f000b210 legacy=0x7f50f000d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 >> v1:172.21.15.106:6791/0 conn(0x7f50f0007480 legacy=0x7f50f0009940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 monclient: found mon.noname-b 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f0012560 con 0x7f50f00037f0 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient: _finish_auth 0 2024-04-25T23:54:46.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50f4001800 con 0x7f50f00037f0 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f510a5f4640 5 monclient: authenticate success, global_id 4106 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5102ffd640 10 monclient: dump: 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:46.763 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f510a5f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:46.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.776+0000 7f5108b91640 1 -- 172.21.15.106:0/3639007486 reap_dead start 2024-04-25T23:54:46.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50f4001aa0 con 0x7f50f00037f0 2024-04-25T23:54:46.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f5102ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:46.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:46.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 4 set_mon_vals no callback set 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f5102ffd640 1 -- 172.21.15.106:0/3639007486 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50f4003960 con 0x7f50f00037f0 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f5102ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f5102ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f5102ffd640 10 monclient: dump: 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:46.766 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 10 monclient: shutdown 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 1 -- 172.21.15.106:0/3639007486 >> v1:172.21.15.106:6790/0 conn(0x7f50f00037f0 legacy=0x7f50f0005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 1 -- 172.21.15.106:0/3639007486 shutdown_connections 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 1 -- 172.21.15.106:0/3639007486 >> 172.21.15.106:0/3639007486 conn(0x7f51040a9e20 msgr2=0x7f51040aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 1 -- 172.21.15.106:0/3639007486 shutdown_connections 2024-04-25T23:54:46.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.780+0000 7f510a5f4640 1 -- 172.21.15.106:0/3639007486 wait complete. 2024-04-25T23:54:46.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient: build_initial_monmap 2024-04-25T23:54:46.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient: monmap: 2024-04-25T23:54:46.771 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:46.771 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:46.771 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:46.771 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:46.771 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 1 Processor -- start 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 1 -- start start 2024-04-25T23:54:46.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient: init 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient: _add_conns ranks=[3,8,0,7,5,6,4,1,2] 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient(hunting): picked mon.noname-g con 0x7f50f00037f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient(hunting): picked mon.noname-e con 0x7f5104072200 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient(hunting): picked mon.noname-a con 0x7f51041d6f00 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51041d17e0 con 0x7f51041d6f00 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f510406fbe0 con 0x7f50f00037f0 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51040a1a40 con 0x7f5104072200 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f510a5f4640 10 monclient(hunting): authenticate will time out at 942.314580s 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f51037fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f5104072200 0x7f51041d10d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35780/0 (socket says 172.21.15.106:35780) 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5108b91640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f51041d6f00 0x7f51041d92f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52182/0 (socket says 172.21.15.106:52182) 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f51037fe640 1 -- 172.21.15.106:0/1422389874 learned_addr learned my addr 172.21.15.106:0/1422389874 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:46.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812989509 0 0) 0x7f51041d17e0 con 0x7f51041d6f00 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): my global_id is 4104 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f0005340 con 0x7f51041d6f00 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1026176549 0 0) 0x7f50f0005340 con 0x7f51041d6f00 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51041d17e0 con 0x7f51041d6f00 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50fc001ca0 con 0x7f51041d6f00 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:46.774 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:46.775 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.784+0000 7f5100ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1045475000 0 0) 0x7f510406fbe0 con 0x7f50f00037f0 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): my global_id is 4116 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f0005340 con 0x7f50f00037f0 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134916209 0 0) 0x7f51040a1a40 con 0x7f5104072200 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): my global_id is 4121 2024-04-25T23:54:46.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f510406fbe0 con 0x7f5104072200 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3193029199 0 0) 0x7f50f0005340 con 0x7f50f00037f0 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51040a1a40 con 0x7f50f00037f0 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50f4001700 con 0x7f50f00037f0 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:46.777 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2087888186 0 0) 0x7f510406fbe0 con 0x7f5104072200 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50f0005340 con 0x7f5104072200 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50f8001850 con 0x7f5104072200 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:46.778 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:46.779 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1959367281 0 0) 0x7f50f0005340 con 0x7f5104072200 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 >> v1:172.21.15.171:6790/0 conn(0x7f50f00037f0 legacy=0x7f51041d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 >> v1:172.21.15.106:6789/0 conn(0x7f51041d6f00 legacy=0x7f51041d92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 monclient: found mon.e 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51040a1e00 con 0x7f5104072200 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: _finish_auth 0 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 5 monclient: authenticate success, global_id 4121 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 10 monclient: _renew_subs 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5104138390 con 0x7f5104072200 2024-04-25T23:54:46.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 10 monclient: _renew_subs 2024-04-25T23:54:46.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:46.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f5104137b70 con 0x7f5104072200 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50f80047f0 con 0x7f5104072200 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50f8004d60 con 0x7f5104072200 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f51027fc640 4 set_mon_vals no callback set 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 10 monclient: dump: 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:46.782 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f50f8005350 con 0x7f5104072200 2024-04-25T23:54:46.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 1278624160 0 0) 0x7f50f8006880 con 0x7f5104072200 2024-04-25T23:54:46.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:46.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:46.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:46.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.788+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e4005090 con 0x7f5104072200 2024-04-25T23:54:46.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.792+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f50f8006ad0 con 0x7f5104072200 2024-04-25T23:54:46.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.792+0000 7f5100ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:46.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.792+0000 7f5100ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:46.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.868+0000 7f510a5f4640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-25T23:54:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.868+0000 7f510a5f4640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-25T23:54:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.868+0000 7f510a5f4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:46.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.868+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f50e4005380 con 0x7f5104072200 2024-04-25T23:54:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.876+0000 7f5100ff9640 1 -- 172.21.15.106:0/1422389874 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7f50f80058e0 con 0x7f5104072200 2024-04-25T23:54:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.876+0000 7f5100ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-04-25T23:54:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.876+0000 7f5100ff9640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-04-25T23:54:46.860 INFO:teuthology.orchestra.run.smithi106.stderr:adjusted tunables profile to default 2024-04-25T23:54:46.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.880+0000 7f510a5f4640 10 monclient: shutdown 2024-04-25T23:54:46.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.880+0000 7f510a5f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:46.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.880+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 >> v1:172.21.15.106:6793/0 conn(0x7f5104072200 legacy=0x7f51041d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:46.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.880+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 shutdown_connections 2024-04-25T23:54:46.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.880+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 >> 172.21.15.106:0/1422389874 conn(0x7f51040a9e20 msgr2=0x7f51040a94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:46.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.880+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 shutdown_connections 2024-04-25T23:54:46.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:46.880+0000 7f510a5f4640 1 -- 172.21.15.106:0/1422389874 wait complete. 2024-04-25T23:54:46.877 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T23:54:46.877 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T23:54:46.878 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:46.878 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T23:54:46.888 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:46.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T23:54:46.939 DEBUG:teuthology.orchestra.run.smithi106:> set -ex 2024-04-25T23:54:46.939 DEBUG:teuthology.orchestra.run.smithi106:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T23:54:46.984 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:47.002+0000 7f42b00b6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T23:54:46.991 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:46.991 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T23:54:47.004 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:47.004 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-25T23:54:47.057 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:54:47.058 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-25T23:54:47.113 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new d8be68ed-f989-43cd-bb66-fdf514ef84a2 0 2024-04-25T23:54:47.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient: get_monmap_and_config 2024-04-25T23:54:47.280 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient: monmap: 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:47.301089+0000 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:47.301089+0000 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.281 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.282 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.282 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.282 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 1 Processor -- start 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 1 -- start start 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient: init 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient: _add_conns ranks=[5,8,6,1,2,3,7,4,0] 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient(hunting): picked mon.noname-h con 0x7f0088071870 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient(hunting): picked mon.noname-e con 0x7f008809f120 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.298+0000 7f008fa22640 10 monclient(hunting): picked mon.noname-d con 0x7f008813ad00 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008809f500 con 0x7f0088071870 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008809fe80 con 0x7f008813ad00 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00880a0160 con 0x7f008809f120 2024-04-25T23:54:47.289 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient(hunting): authenticate will time out at 938.008054s 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008d7be640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f0088071870 0x7f0088071c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:60688/0 (socket says 172.21.15.171:60688) 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008d7be640 1 -- 172.21.15.171:0/1089503696 learned_addr learned my addr 172.21.15.171:0/1089503696 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2964699076 0 0) 0x7f008809f500 con 0x7f0088071870 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient(hunting): my global_id is 4127 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0074003530 con 0x7f0088071870 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1950963445 0 0) 0x7f0074003530 con 0x7f0088071870 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 >> v1:172.21.15.106:6793/0 conn(0x7f008809f120 legacy=0x7f00881395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 >> v1:172.21.15.106:6792/0 conn(0x7f008813ad00 legacy=0x7f008813d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.290 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 monclient: found mon.noname-h 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00880a0440 con 0x7f0088071870 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00800017e0 con 0x7f0088071870 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: dump: 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.291 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 5 monclient: authenticate success, global_id 4127 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0080001ad0 con 0x7f0088071870 2024-04-25T23:54:47.292 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 4 set_mon_vals no callback set 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 1 -- 172.21.15.171:0/1089503696 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0080004bf0 con 0x7f0088071870 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007ffff640 10 monclient: dump: 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.293 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient: shutdown 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- 172.21.15.171:0/1089503696 >> v1:172.21.15.171:6791/0 conn(0x7f0088071870 legacy=0x7f0088071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- 172.21.15.171:0/1089503696 shutdown_connections 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- 172.21.15.171:0/1089503696 >> 172.21.15.171:0/1089503696 conn(0x7f00880a36e0 msgr2=0x7f00880a3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- 172.21.15.171:0/1089503696 shutdown_connections 2024-04-25T23:54:47.294 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- 172.21.15.171:0/1089503696 wait complete. 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient: monmap: 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 0.000000 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:created 0.000000 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.295 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 Processor -- start 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- start start 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient: init 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient: _add_conns ranks=[4,7,5,3,1,6,0,2,8] 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient(hunting): picked mon.noname-c con 0x7f0088071870 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient(hunting): picked mon.noname-i con 0x7f008809f120 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient(hunting): picked mon.noname-h con 0x7f008813ad00 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00881260d0 con 0x7f0088071870 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0088127b20 con 0x7f008813ad00 2024-04-25T23:54:47.296 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f008813a100 con 0x7f008809f120 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 10 monclient(hunting): authenticate will time out at 938.011005s 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008cfbd640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f008809f120 0x7f00881d1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54508/0 (socket says 172.21.15.171:54508) 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008dfbf640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f008813ad00 0x7f00881d4cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:60698/0 (socket says 172.21.15.171:60698) 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008cfbd640 1 -- 172.21.15.171:0/2012409057 learned_addr learned my addr 172.21.15.171:0/2012409057 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733574272 0 0) 0x7f0088127b20 con 0x7f008813ad00 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): my global_id is 4136 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f006c003530 con 0x7f008813ad00 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216689145 0 0) 0x7f008813a100 con 0x7f008809f120 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.297 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): my global_id is 4120 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0088127b20 con 0x7f008809f120 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2697646436 0 0) 0x7f006c003530 con 0x7f008813ad00 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f008813a100 con 0x7f008813ad00 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0084001c70 con 0x7f008813ad00 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): dump: 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.298 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:47.299 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 999542253 0 0) 0x7f0088127b20 con 0x7f008809f120 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f006c003530 con 0x7f008809f120 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0078001b20 con 0x7f008809f120 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): dump: 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.300 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835614304 0 0) 0x7f00881260d0 con 0x7f0088071870 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient(hunting): my global_id is 4108 2024-04-25T23:54:47.301 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0088127b20 con 0x7f0088071870 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1076430004 0 0) 0x7f008813a100 con 0x7f008813ad00 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 >> v1:172.21.15.171:6792/0 conn(0x7f008809f120 legacy=0x7f00881d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 >> v1:172.21.15.106:6791/0 conn(0x7f0088071870 legacy=0x7f00881399f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 monclient: found mon.h 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00881cd110 con 0x7f008813ad00 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f007dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.302+0000 7f008fa22640 5 monclient: authenticate success, global_id 4136 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 10 monclient: _renew_subs 2024-04-25T23:54:47.302 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f008813a360 con 0x7f008813ad00 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 10 monclient: _renew_subs 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f00881cc230 con 0x7f008813ad00 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00840039e0 con 0x7f008813ad00 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0084003ed0 con 0x7f008813ad00 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007f7fe640 4 set_mon_vals no callback set 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 10 monclient: dump: 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.303 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f0084004480 con 0x7f008813ad00 2024-04-25T23:54:47.304 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:47.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00880722e0 con 0x7f008813ad00 2024-04-25T23:54:47.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.306+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 764544566 0 0) 0x7f0084006da0 con 0x7f008813ad00 2024-04-25T23:54:47.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.314+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f0084006290 con 0x7f008813ad00 2024-04-25T23:54:47.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.314+0000 7f007dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.305 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.314+0000 7f007dffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:47.365 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.382+0000 7f008fa22640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "d8be68ed-f989-43cd-bb66-fdf514ef84a2", "id": 0}] 2024-04-25T23:54:47.365 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.382+0000 7f008fa22640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "d8be68ed-f989-43cd-bb66-fdf514ef84a2", "id": 0}] 2024-04-25T23:54:47.365 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.382+0000 7f008fa22640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:47.365 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.382+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd new", "uuid": "d8be68ed-f989-43cd-bb66-fdf514ef84a2", "id": 0} v 0) -- 0x7f0088067160 con 0x7f008813ad00 2024-04-25T23:54:47.374 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f007dffb640 1 -- 172.21.15.171:0/2012409057 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d8be68ed-f989-43cd-bb66-fdf514ef84a2", "id": 0}]=0 v3) ==== 112+0+2 (unknown 2966983647 0 732707515) 0x7f0084005c20 con 0x7f008813ad00 2024-04-25T23:54:47.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f007dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "d8be68ed-f989-43cd-bb66-fdf514ef84a2", "id": 0}] 2024-04-25T23:54:47.375 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f007dffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:47.375 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-04-25T23:54:47.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f008fa22640 10 monclient: shutdown 2024-04-25T23:54:47.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f008fa22640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:47.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 >> v1:172.21.15.171:6791/0 conn(0x7f008813ad00 legacy=0x7f00881d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 shutdown_connections 2024-04-25T23:54:47.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 >> 172.21.15.171:0/2012409057 conn(0x7f00880a36e0 msgr2=0x7f0088067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:47.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 shutdown_connections 2024-04-25T23:54:47.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.394+0000 7f008fa22640 1 -- 172.21.15.171:0/2012409057 wait complete. 2024-04-25T23:54:47.392 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 0b4cb186-016f-4325-86fc-a32d67508e1e 1 2024-04-25T23:54:47.494 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:47.510+0000 7f42b00b6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T23:54:47.508 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.526+0000 7f9fc2816640 10 monclient: get_monmap_and_config 2024-04-25T23:54:47.508 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.526+0000 7f9fc2816640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.508 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.526+0000 7f9fc2816640 10 monclient: monmap: 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:47.529104+0000 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:47.529104+0000 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.509 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.510 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.510 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.510 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.526+0000 7f9fc2816640 1 Processor -- start 2024-04-25T23:54:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- start start 2024-04-25T23:54:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: init 2024-04-25T23:54:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: _add_conns ranks=[2,5,6,7,1,3,0,4,8] 2024-04-25T23:54:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient(hunting): picked mon.noname-b con 0x7f9fbc135a70 addr v1:172.21.15.106:6790/0 2024-04-25T23:54:47.518 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient(hunting): picked mon.noname-h con 0x7f9fbc135470 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient(hunting): picked mon.noname-d con 0x7f9fbc13bef0 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc0a02e0 con 0x7f9fbc135a70 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc06c970 con 0x7f9fbc135470 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc09f9d0 con 0x7f9fbc13bef0 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient(hunting): authenticate will time out at 938.236763s 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbb7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f9fbc135470 0x7f9fbc13a7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:60700/0 (socket says 172.21.15.171:60700) 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbb7fe640 1 -- 172.21.15.171:0/2837127418 learned_addr learned my addr 172.21.15.171:0/2837127418 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2662711351 0 0) 0x7f9fb0001120 con 0x7f9fbc135470 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.519 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient(hunting): my global_id is 4145 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa4003530 con 0x7f9fbc135470 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1939185747 0 0) 0x7f9fa4003530 con 0x7f9fbc135470 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 >> v1:172.21.15.106:6792/0 conn(0x7f9fbc13bef0 legacy=0x7f9fbc13e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 >> v1:172.21.15.106:6790/0 conn(0x7f9fbc135a70 legacy=0x7f9fbc135e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 monclient: found mon.noname-h 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc067c00 con 0x7f9fbc135470 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.520 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9fb0001990 con 0x7f9fbc135470 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: dump: 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.521 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 5 monclient: authenticate success, global_id 4145 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fb0001cf0 con 0x7f9fbc135470 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 1 -- 172.21.15.171:0/2837127418 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9fb0004c70 con 0x7f9fbc135470 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fbaffd640 10 monclient: dump: 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.522 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.523 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 4 set_mon_vals no callback set 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: shutdown 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:47.524 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- 172.21.15.171:0/2837127418 >> v1:172.21.15.171:6791/0 conn(0x7f9fbc135470 legacy=0x7f9fbc13a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- 172.21.15.171:0/2837127418 shutdown_connections 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- 172.21.15.171:0/2837127418 >> 172.21.15.171:0/2837127418 conn(0x7f9fbc0a2d20 msgr2=0x7f9fbc0a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- 172.21.15.171:0/2837127418 shutdown_connections 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- 172.21.15.171:0/2837127418 wait complete. 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: monmap: 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 0.000000 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:created 0.000000 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.525 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 Processor -- start 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 1 -- start start 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: init 2024-04-25T23:54:47.526 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.530+0000 7f9fc2816640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient: _add_conns ranks=[4,6,0,3,5,1,2,8,7] 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient(hunting): picked mon.noname-c con 0x7f9fbc135470 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient(hunting): picked mon.noname-d con 0x7f9fbc135a70 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient(hunting): picked mon.noname-a con 0x7f9fbc13bef0 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc1373a0 con 0x7f9fbc13bef0 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc13b3d0 con 0x7f9fbc135470 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9fbc0730c0 con 0x7f9fbc135a70 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient(hunting): authenticate will time out at 938.240124s 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fbbfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9fbc135470 0x7f9fbc136580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:55414/0 (socket says 172.21.15.171:55414) 2024-04-25T23:54:47.527 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fbbfff640 1 -- 172.21.15.171:0/1019183226 learned_addr learned my addr 172.21.15.171:0/1019183226 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fbb7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9fbc135a70 0x7f9fbc136c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:54990/0 (socket says 172.21.15.171:54990) 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591807270 0 0) 0x7f9fbc13b3d0 con 0x7f9fbc135470 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): my global_id is 4117 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fa8003530 con 0x7f9fbc135470 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98604927 0 0) 0x7f9fbc0730c0 con 0x7f9fbc135a70 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.528 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): my global_id is 4128 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fbc13b3d0 con 0x7f9fbc135a70 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964182638 0 0) 0x7f9fbc1373a0 con 0x7f9fbc13bef0 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): my global_id is 4113 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9fbc0730c0 con 0x7f9fbc13bef0 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 294418513 0 0) 0x7f9fa8003530 con 0x7f9fbc135470 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fbc1373a0 con 0x7f9fbc135470 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9fac001a60 con 0x7f9fbc135470 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:54:47.529 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.530 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 232332718 0 0) 0x7f9fbc13b3d0 con 0x7f9fbc135a70 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fa8003530 con 0x7f9fbc135a70 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2399780948 0 0) 0x7f9fbc0730c0 con 0x7f9fbc13bef0 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9fbc13b3d0 con 0x7f9fbc13bef0 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9fb4001c00 con 0x7f9fbc13bef0 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.531 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.532 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9fb00047f0 con 0x7f9fbc135a70 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.533 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1571166657 0 0) 0x7f9fbc1373a0 con 0x7f9fbc135470 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 >> v1:172.21.15.106:6792/0 conn(0x7f9fbc135a70 legacy=0x7f9fbc136c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 >> v1:172.21.15.106:6789/0 conn(0x7f9fbc13bef0 legacy=0x7f9fbc1d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 monclient: found mon.c 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fbc138b80 con 0x7f9fbc135470 2024-04-25T23:54:47.534 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 5 monclient: authenticate success, global_id 4117 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient: _renew_subs 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9fbc138e60 con 0x7f9fbc135470 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient: _renew_subs 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9fbc137c90 con 0x7f9fbc135470 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9fac0038d0 con 0x7f9fbc135470 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fba7fc640 4 set_mon_vals no callback set 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9fac001d10 con 0x7f9fbc135470 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.535 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 10 monclient: dump: 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.536 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f9fac004250 con 0x7f9fbc135470 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 598901642 0 0) 0x7f9fac006b70 con 0x7f9fbc135470 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:47.537 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.534+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f9c005090 con 0x7f9fbc135470 2024-04-25T23:54:47.538 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.542+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f9fac0058c0 con 0x7f9fbc135470 2024-04-25T23:54:47.538 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.542+0000 7f9fb8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.538 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.542+0000 7f9fb8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:47.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.610+0000 7f9fc2816640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "0b4cb186-016f-4325-86fc-a32d67508e1e", "id": 1}] 2024-04-25T23:54:47.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.610+0000 7f9fc2816640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "0b4cb186-016f-4325-86fc-a32d67508e1e", "id": 1}] 2024-04-25T23:54:47.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.610+0000 7f9fc2816640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:47.591 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.610+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd new", "uuid": "0b4cb186-016f-4325-86fc-a32d67508e1e", "id": 1} v 0) -- 0x7f9f9c005380 con 0x7f9fbc135470 2024-04-25T23:54:47.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fb8ff9640 1 -- 172.21.15.171:0/1019183226 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b4cb186-016f-4325-86fc-a32d67508e1e", "id": 1}]=0 v4) ==== 112+0+2 (unknown 2880296426 0 940483276) 0x7f9fac005bf0 con 0x7f9fbc135470 2024-04-25T23:54:47.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fb8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "0b4cb186-016f-4325-86fc-a32d67508e1e", "id": 1}] 2024-04-25T23:54:47.603 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fb8ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:47.603 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-04-25T23:54:47.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fc2816640 10 monclient: shutdown 2024-04-25T23:54:47.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fc2816640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:47.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 >> v1:172.21.15.106:6791/0 conn(0x7f9fbc135470 legacy=0x7f9fbc136580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 shutdown_connections 2024-04-25T23:54:47.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 >> 172.21.15.171:0/1019183226 conn(0x7f9fbc0a2d20 msgr2=0x7f9fbc0a1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:47.604 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 shutdown_connections 2024-04-25T23:54:47.605 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.622+0000 7f9fc2816640 1 -- 172.21.15.171:0/1019183226 wait complete. 2024-04-25T23:54:47.619 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 5305c964-9533-4f1d-a1a2-6ab03decd54a 2 2024-04-25T23:54:47.700 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:47.718+0000 7f42b00b6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T23:54:47.732 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient: get_monmap_and_config 2024-04-25T23:54:47.732 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.732 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient: monmap: 2024-04-25T23:54:47.732 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.732 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.732 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:47.752755+0000 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:47.752755+0000 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.733 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 1 Processor -- start 2024-04-25T23:54:47.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 1 -- start start 2024-04-25T23:54:47.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient: init 2024-04-25T23:54:47.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.739 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient: _add_conns ranks=[1,6,0,8,2,4,7,5,3] 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient(hunting): picked mon.noname-f con 0x7f2448072170 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient(hunting): picked mon.noname-d con 0x7f244806c610 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient(hunting): picked mon.noname-a con 0x7f244806ca30 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2448068070 con 0x7f244806ca30 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24480a3f60 con 0x7f2448072170 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24480a41c0 con 0x7f244806c610 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244c983640 10 monclient(hunting): authenticate will time out at 938.459603s 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244659c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2448072170 0x7f2448072550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:33488/0 (socket says 172.21.15.171:33488) 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244659c640 1 -- 172.21.15.171:0/2153164657 learned_addr learned my addr 172.21.15.171:0/2153164657 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.750+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515323395 0 0) 0x7f24480a3f60 con 0x7f2448072170 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.740 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient(hunting): my global_id is 4105 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2430003530 con 0x7f2448072170 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2219894275 0 0) 0x7f2430003530 con 0x7f2448072170 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 >> v1:172.21.15.106:6792/0 conn(0x7f244806c610 legacy=0x7f244813cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 >> v1:172.21.15.106:6789/0 conn(0x7f244806ca30 legacy=0x7f2448140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 monclient: found mon.noname-f 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244806e140 con 0x7f2448072170 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f243c0017c0 con 0x7f2448072170 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.741 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: dump: 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.742 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 5 monclient: authenticate success, global_id 4105 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f243c001ab0 con 0x7f2448072170 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 1 -- 172.21.15.171:0/2153164657 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f243c004bf0 con 0x7f2448072170 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 4 set_mon_vals no callback set 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244559a640 10 monclient: dump: 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.743 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: shutdown 2024-04-25T23:54:47.744 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- 172.21.15.171:0/2153164657 >> v1:172.21.15.171:6789/0 conn(0x7f2448072170 legacy=0x7f2448072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- 172.21.15.171:0/2153164657 shutdown_connections 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- 172.21.15.171:0/2153164657 >> 172.21.15.171:0/2153164657 conn(0x7f244806b210 msgr2=0x7f244806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- 172.21.15.171:0/2153164657 shutdown_connections 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- 172.21.15.171:0/2153164657 wait complete. 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: monmap: 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 0.000000 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:created 0.000000 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.745 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 Processor -- start 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- start start 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: init 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: _add_conns ranks=[6,0,7,3,1,5,2,4,8] 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient(hunting): picked mon.noname-d con 0x7f244806c610 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:47.746 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient(hunting): picked mon.noname-a con 0x7f244806ca30 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient(hunting): picked mon.noname-i con 0x7f2448072170 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2448125460 con 0x7f244806ca30 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2448125110 con 0x7f244806c610 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24481cd6b0 con 0x7f2448072170 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient(hunting): authenticate will time out at 938.462518s 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2446d9d640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f2448072170 0x7f24481d4af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54518/0 (socket says 172.21.15.171:54518) 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2446d9d640 1 -- 172.21.15.171:0/1745836988 learned_addr learned my addr 172.21.15.171:0/1745836988 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044353429 0 0) 0x7f24481cd6b0 con 0x7f2448072170 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): my global_id is 4129 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2428003530 con 0x7f2448072170 2024-04-25T23:54:47.747 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3848964507 0 0) 0x7f2428003530 con 0x7f2448072170 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24481cd6b0 con 0x7f2448072170 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2440001d60 con 0x7f2448072170 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): dump: 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.748 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940079639 0 0) 0x7f2448125110 con 0x7f244806c610 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.749 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): my global_id is 4146 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2428003530 con 0x7f244806c610 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1976124339 0 0) 0x7f2448125460 con 0x7f244806ca30 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient(hunting): my global_id is 4131 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2448125110 con 0x7f244806ca30 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2060315923 0 0) 0x7f24481cd6b0 con 0x7f2448072170 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 >> v1:172.21.15.106:6792/0 conn(0x7f244806c610 legacy=0x7f24481cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 >> v1:172.21.15.106:6789/0 conn(0x7f244806ca30 legacy=0x7f24481ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 monclient: found mon.i 2024-04-25T23:54:47.750 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f244806d3e0 con 0x7f2448072170 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 5 monclient: authenticate success, global_id 4129 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: _renew_subs 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2448124690 con 0x7f2448072170 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: _renew_subs 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f2448123ef0 con 0x7f2448072170 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2440003cd0 con 0x7f2448072170 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.751 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2440004240 con 0x7f2448072170 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2444d99640 4 set_mon_vals no callback set 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 10 monclient: dump: 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.752 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f2440005b50 con 0x7f2448072170 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.754+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 1053885211 0 0) 0x7f2440007060 con 0x7f2448072170 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.758+0000 7f244c983640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.758+0000 7f244c983640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.758+0000 7f244c983640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:54:47.753 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.758+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f242c005090 con 0x7f2448072170 2024-04-25T23:54:47.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.758+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f2440006c40 con 0x7f2448072170 2024-04-25T23:54:47.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.758+0000 7f2436ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.754 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.758+0000 7f2436ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:47.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.826+0000 7f244c983640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "5305c964-9533-4f1d-a1a2-6ab03decd54a", "id": 2}] 2024-04-25T23:54:47.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.830+0000 7f244c983640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "5305c964-9533-4f1d-a1a2-6ab03decd54a", "id": 2}] 2024-04-25T23:54:47.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.830+0000 7f244c983640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:54:47.810 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.830+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd new", "uuid": "5305c964-9533-4f1d-a1a2-6ab03decd54a", "id": 2} v 0) -- 0x7f242c005380 con 0x7f2448072170 2024-04-25T23:54:47.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f2436ffd640 1 -- 172.21.15.171:0/1745836988 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5305c964-9533-4f1d-a1a2-6ab03decd54a", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2422375812 0 216599125) 0x7f2440005e40 con 0x7f2448072170 2024-04-25T23:54:47.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f2436ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "5305c964-9533-4f1d-a1a2-6ab03decd54a", "id": 2}] 2024-04-25T23:54:47.819 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f2436ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:47.819 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-04-25T23:54:47.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f244c983640 10 monclient: shutdown 2024-04-25T23:54:47.820 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f244c983640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:47.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 >> v1:172.21.15.171:6792/0 conn(0x7f2448072170 legacy=0x7f24481d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 shutdown_connections 2024-04-25T23:54:47.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 >> 172.21.15.171:0/1745836988 conn(0x7f244806b210 msgr2=0x7f24480a1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:47.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 shutdown_connections 2024-04-25T23:54:47.821 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.838+0000 7f244c983640 1 -- 172.21.15.171:0/1745836988 wait complete. 2024-04-25T23:54:47.835 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new acff288b-4172-4f63-9d56-7556ce456b20 3 2024-04-25T23:54:47.947 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient: get_monmap_and_config 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient: monmap: 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:47.968265+0000 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:47.968265+0000 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.948 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.949 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.949 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.949 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.949 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 1 Processor -- start 2024-04-25T23:54:47.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 1 -- start start 2024-04-25T23:54:47.955 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient: init 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient: _add_conns ranks=[3,8,0,2,5,6,1,4,7] 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient(hunting): picked mon.noname-g con 0x7fccb40a1bc0 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient(hunting): picked mon.noname-e con 0x7fccb40a26b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient(hunting): picked mon.noname-a con 0x7fccb413b0d0 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb409d850 con 0x7fccb413b0d0 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb409db30 con 0x7fccb40a1bc0 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb409de10 con 0x7fccb40a26b0 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.966+0000 7fccbbfbf640 10 monclient(hunting): authenticate will time out at 938.675914s 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb9d5b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fccb40a1bc0 0x7fccb40a1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42766/0 (socket says 172.21.15.171:42766) 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb9d5b640 1 -- 172.21.15.171:0/4119503053 learned_addr learned my addr 172.21.15.171:0/4119503053 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770278019 0 0) 0x7fccb409db30 con 0x7fccb40a1bc0 2024-04-25T23:54:47.956 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient(hunting): my global_id is 4125 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca0005740 con 0x7fccb40a1bc0 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 301094454 0 0) 0x7fcca0005740 con 0x7fccb40a1bc0 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 >> v1:172.21.15.106:6793/0 conn(0x7fccb40a26b0 legacy=0x7fccb41399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 >> v1:172.21.15.106:6789/0 conn(0x7fccb413b0d0 legacy=0x7fccb413d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 monclient: found mon.noname-g 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb409bf70 con 0x7fccb40a1bc0 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.957 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fccb00017c0 con 0x7fccb40a1bc0 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: dump: 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.958 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 5 monclient: authenticate success, global_id 4125 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fccb0001ab0 con 0x7fccb40a1bc0 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 4 set_mon_vals no callback set 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 1 -- 172.21.15.171:0/4119503053 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fccb0004bf0 con 0x7fccb40a1bc0 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:54:47.959 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb8d59640 10 monclient: dump: 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.960 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: shutdown 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- 172.21.15.171:0/4119503053 >> v1:172.21.15.171:6790/0 conn(0x7fccb40a1bc0 legacy=0x7fccb40a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- 172.21.15.171:0/4119503053 shutdown_connections 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- 172.21.15.171:0/4119503053 >> 172.21.15.171:0/4119503053 conn(0x7fccb406b3e0 msgr2=0x7fccb406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- 172.21.15.171:0/4119503053 shutdown_connections 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- 172.21.15.171:0/4119503053 wait complete. 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: build_initial_monmap 2024-04-25T23:54:47.961 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: monmap: 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 0.000000 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:created 0.000000 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:47.962 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 Processor -- start 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- start start 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: init 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: _add_conns ranks=[8,1,0,2,5,3,4,6,7] 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient(hunting): picked mon.noname-e con 0x7fccb40a1bc0 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient(hunting): picked mon.noname-f con 0x7fccb40a26b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient(hunting): picked mon.noname-a con 0x7fccb413b0d0 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb41360d0 con 0x7fccb413b0d0 2024-04-25T23:54:47.963 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb41363b0 con 0x7fccb40a26b0 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb4071ba0 con 0x7fccb40a1bc0 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient(hunting): authenticate will time out at 938.678920s 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb955a640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fccb40a26b0 0x7fccb41cd480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:33492/0 (socket says 172.21.15.171:33492) 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccb955a640 1 -- 172.21.15.171:0/1241726969 learned_addr learned my addr 172.21.15.171:0/1241726969 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 959395238 0 0) 0x7fccb41363b0 con 0x7fccb40a26b0 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): my global_id is 4114 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc98003530 con 0x7fccb40a26b0 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 96125735 0 0) 0x7fcc98003530 con 0x7fccb40a26b0 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccb41363b0 con 0x7fccb40a26b0 2024-04-25T23:54:47.964 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcca4001ac0 con 0x7fccb40a26b0 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): dump: 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.965 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815736067 0 0) 0x7fccb4071ba0 con 0x7fccb40a1bc0 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): my global_id is 4139 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc98003530 con 0x7fccb40a1bc0 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967323477 0 0) 0x7fccb41360d0 con 0x7fccb413b0d0 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:47.966 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient(hunting): my global_id is 4140 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccb4071ba0 con 0x7fccb413b0d0 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2448472694 0 0) 0x7fccb41363b0 con 0x7fccb40a26b0 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 >> v1:172.21.15.106:6793/0 conn(0x7fccb40a1bc0 legacy=0x7fccb41c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 >> v1:172.21.15.106:6789/0 conn(0x7fccb413b0d0 legacy=0x7fccb41d0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 monclient: found mon.f 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb4071dc0 con 0x7fccb40a26b0 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient: _finish_auth 0 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccaa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:47.967 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 5 monclient: authenticate success, global_id 4114 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: _renew_subs 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fccb4135df0 con 0x7fccb40a26b0 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: _renew_subs 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.970+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fccb40718f0 con 0x7fccb40a26b0 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcca4003950 con 0x7fccb40a26b0 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcca4003ec0 con 0x7fccb40a26b0 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccabfff640 4 set_mon_vals no callback set 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 10 monclient: dump: 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:47.968 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fcca40057d0 con 0x7fccb40a26b0 2024-04-25T23:54:47.969 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 1038125206 0 0) 0x7fcca4006d50 con 0x7fccb40a26b0 2024-04-25T23:54:47.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccbbfbf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccbbfbf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccbbfbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:54:47.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.974+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc9c005090 con 0x7fccb40a26b0 2024-04-25T23:54:47.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.978+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7fcca40068c0 con 0x7fccb40a26b0 2024-04-25T23:54:47.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.978+0000 7fccaa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:47.970 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:47.978+0000 7fccaa7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:48.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.046+0000 7fccbbfbf640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "acff288b-4172-4f63-9d56-7556ce456b20", "id": 3}] 2024-04-25T23:54:48.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.046+0000 7fccbbfbf640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "acff288b-4172-4f63-9d56-7556ce456b20", "id": 3}] 2024-04-25T23:54:48.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.046+0000 7fccbbfbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:54:48.027 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.046+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd new", "uuid": "acff288b-4172-4f63-9d56-7556ce456b20", "id": 3} v 0) -- 0x7fcc9c005380 con 0x7fccb40a26b0 2024-04-25T23:54:48.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccaa7fc640 1 -- 172.21.15.171:0/1241726969 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "acff288b-4172-4f63-9d56-7556ce456b20", "id": 3}]=0 v6) ==== 112+0+2 (unknown 3438559063 0 525046306) 0x7fcca4005ac0 con 0x7fccb40a26b0 2024-04-25T23:54:48.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccaa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "acff288b-4172-4f63-9d56-7556ce456b20", "id": 3}] 2024-04-25T23:54:48.034 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccaa7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:48.034 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-04-25T23:54:48.035 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccbbfbf640 10 monclient: shutdown 2024-04-25T23:54:48.035 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccbbfbf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:48.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 >> v1:172.21.15.171:6789/0 conn(0x7fccb40a26b0 legacy=0x7fccb41cd480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 shutdown_connections 2024-04-25T23:54:48.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 >> 172.21.15.171:0/1241726969 conn(0x7fccb406b3e0 msgr2=0x7fccb409b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:48.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 shutdown_connections 2024-04-25T23:54:48.036 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.054+0000 7fccbbfbf640 1 -- 172.21.15.171:0/1241726969 wait complete. 2024-04-25T23:54:48.051 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 7eebb63b-821b-4ad5-9ec1-dc19e2b3602c 4 2024-04-25T23:54:48.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: get_monmap_and_config 2024-04-25T23:54:48.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: build_initial_monmap 2024-04-25T23:54:48.162 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: monmap: 2024-04-25T23:54:48.162 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:48.162 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:48.182696+0000 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:48.182696+0000 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:48.163 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:48.164 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:48.164 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:48.164 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:48.164 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:48.164 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:48.164 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.173 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 Processor -- start 2024-04-25T23:54:48.173 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- start start 2024-04-25T23:54:48.173 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: init 2024-04-25T23:54:48.173 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:48.173 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: _add_conns ranks=[3,5,1,4,2,7,8,6,0] 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient(hunting): picked mon.noname-g con 0x7f7954134470 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient(hunting): picked mon.noname-h con 0x7f7954134850 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient(hunting): picked mon.noname-f con 0x7f7954134cb0 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795409b2c0 con 0x7f7954134cb0 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795409c190 con 0x7f7954134470 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795409c470 con 0x7f7954134850 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient(hunting): authenticate will time out at 938.889719s 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795a20a640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f7954134470 0x7f795409cbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42778/0 (socket says 172.21.15.171:42778) 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795a20a640 1 -- 172.21.15.171:0/2840765028 learned_addr learned my addr 172.21.15.171:0/2840765028 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:48.174 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959a09640 1 --1- 172.21.15.171:0/2840765028 >> v1:172.21.15.171:6791/0 conn(0x7f7954134850 0x7f795413c8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:60702/0 (socket says 172.21.15.171:60702) 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792053240 0 0) 0x7f795409c470 con 0x7f7954134850 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): my global_id is 4154 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7940003530 con 0x7f7954134850 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1526736435 0 0) 0x7f795409c190 con 0x7f7954134470 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): my global_id is 4134 2024-04-25T23:54:48.175 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795409c470 con 0x7f7954134470 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894071276 0 0) 0x7f794c0013d0 con 0x7f7954134cb0 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient(hunting): my global_id is 4123 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795409c190 con 0x7f7954134cb0 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1550066143 0 0) 0x7f7940003530 con 0x7f7954134850 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 >> v1:172.21.15.171:6790/0 conn(0x7f7954134470 legacy=0x7f795409cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 >> v1:172.21.15.171:6789/0 conn(0x7f7954134cb0 legacy=0x7f795413ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: _finish_hunting 0 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 monclient: found mon.noname-h 2024-04-25T23:54:48.176 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795406c360 con 0x7f7954134850 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: _finish_auth 0 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: _check_auth_tickets 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f79440017c0 con 0x7f7954134850 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: dump: 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.177 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.178 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 5 monclient: authenticate success, global_id 4154 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7944001ae0 con 0x7f7954134850 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 1 -- 172.21.15.171:0/2840765028 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7944004b30 con 0x7f7954134850 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 4 set_mon_vals no callback set 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:48.179 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f7959208640 10 monclient: dump: 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.180 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: shutdown 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- 172.21.15.171:0/2840765028 >> v1:172.21.15.171:6791/0 conn(0x7f7954134850 legacy=0x7f795413c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- 172.21.15.171:0/2840765028 shutdown_connections 2024-04-25T23:54:48.181 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- 172.21.15.171:0/2840765028 >> 172.21.15.171:0/2840765028 conn(0x7f795406b210 msgr2=0x7f795406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- 172.21.15.171:0/2840765028 shutdown_connections 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 1 -- 172.21.15.171:0/2840765028 wait complete. 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: build_initial_monmap 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.182+0000 7f795c46e640 10 monclient: monmap: 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 0.000000 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:created 0.000000 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:48.182 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 Processor -- start 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 -- start start 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: init 2024-04-25T23:54:48.183 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _add_conns ranks=[3,5,4,1,7,6,2,8,0] 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient(hunting): picked mon.noname-g con 0x7f7954134470 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient(hunting): picked mon.noname-h con 0x7f7954134850 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient(hunting): picked mon.noname-c con 0x7f7954134cb0 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79541290b0 con 0x7f7954134470 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795412b380 con 0x7f7954134cb0 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f795412aae0 con 0x7f7954134850 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient(hunting): authenticate will time out at 938.892620s 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795a20a640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f7954134470 0x7f7954140510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42794/0 (socket says 172.21.15.171:42794) 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f7959a09640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7954134850 0x7f79541d1cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:60716/0 (socket says 172.21.15.171:60716) 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795a20a640 1 -- 172.21.15.171:0/4140869785 learned_addr learned my addr 172.21.15.171:0/4140869785 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:48.184 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1159815321 0 0) 0x7f79541290b0 con 0x7f7954134470 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): my global_id is 4143 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7938003530 con 0x7f7954134470 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 567485106 0 0) 0x7f795412aae0 con 0x7f7954134850 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): my global_id is 4163 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f79541290b0 con 0x7f7954134850 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 152272617 0 0) 0x7f7938003530 con 0x7f7954134470 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f795412aae0 con 0x7f7954134470 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3364396819 0 0) 0x7f79541290b0 con 0x7f7954134850 2024-04-25T23:54:48.185 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7938003530 con 0x7f7954134850 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7950001aa0 con 0x7f7954134470 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): dump: 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.186 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7944001780 con 0x7f7954134850 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient(hunting): dump: 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.187 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2017015328 0 0) 0x7f795412aae0 con 0x7f7954134470 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 >> v1:172.21.15.171:6791/0 conn(0x7f7954134850 legacy=0x7f79541d1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 >> v1:172.21.15.106:6791/0 conn(0x7f7954134cb0 legacy=0x7f79541d53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.188 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 monclient: found mon.g 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f795412adc0 con 0x7f7954134470 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: _finish_auth 0 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 5 monclient: authenticate success, global_id 4143 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _renew_subs 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7954131bf0 con 0x7f7954134470 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _renew_subs 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:54:48.189 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f795412bf30 con 0x7f7954134470 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7950004aa0 con 0x7f7954134470 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7950004f90 con 0x7f7954134470 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f7958a07640 4 set_mon_vals no callback set 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 10 monclient: dump: 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.190 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f79500054c0 con 0x7f7954134470 2024-04-25T23:54:48.191 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 2269842109 0 0) 0x7f7950006d10 con 0x7f7954134470 2024-04-25T23:54:48.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:54:48.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.186+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f793c005090 con 0x7f7954134470 2024-04-25T23:54:48.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.190+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f7950006080 con 0x7f7954134470 2024-04-25T23:54:48.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.190+0000 7f794affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.192 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.190+0000 7f794affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:48.238 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.254+0000 7f795c46e640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "7eebb63b-821b-4ad5-9ec1-dc19e2b3602c", "id": 4}] 2024-04-25T23:54:48.238 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.254+0000 7f795c46e640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "7eebb63b-821b-4ad5-9ec1-dc19e2b3602c", "id": 4}] 2024-04-25T23:54:48.238 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.254+0000 7f795c46e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:54:48.238 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.254+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd new", "uuid": "7eebb63b-821b-4ad5-9ec1-dc19e2b3602c", "id": 4} v 0) -- 0x7f793c005380 con 0x7f7954134470 2024-04-25T23:54:48.241 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.258+0000 7f794affd640 1 -- 172.21.15.171:0/4140869785 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7eebb63b-821b-4ad5-9ec1-dc19e2b3602c", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2828929649 0 1697012583) 0x7f7950006850 con 0x7f7954134470 2024-04-25T23:54:48.241 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.258+0000 7f794affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "7eebb63b-821b-4ad5-9ec1-dc19e2b3602c", "id": 4}] 2024-04-25T23:54:48.241 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.258+0000 7f794affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:48.241 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-04-25T23:54:48.242 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.262+0000 7f795c46e640 10 monclient: shutdown 2024-04-25T23:54:48.242 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.262+0000 7f795c46e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:48.243 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.262+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 >> v1:172.21.15.171:6790/0 conn(0x7f7954134470 legacy=0x7f7954140510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.243 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.262+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 shutdown_connections 2024-04-25T23:54:48.243 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.262+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 >> 172.21.15.171:0/4140869785 conn(0x7f795406b210 msgr2=0x7f79540a1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:48.243 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.262+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 shutdown_connections 2024-04-25T23:54:48.243 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.262+0000 7f795c46e640 1 -- 172.21.15.171:0/4140869785 wait complete. 2024-04-25T23:54:48.257 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1 5 2024-04-25T23:54:48.274 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.294+0000 7f42b00b6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T23:54:48.331 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.350+0000 7f42b00b6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T23:54:48.367 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient: get_monmap_and_config 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient: build_initial_monmap 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient: monmap: 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:48.388106+0000 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:48.388106+0000 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:48.368 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:48.369 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:48.369 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.376 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 1 Processor -- start 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 1 -- start start 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient: init 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient: _add_conns ranks=[2,3,8,6,0,7,5,1,4] 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient(hunting): picked mon.noname-b con 0x7fa7480a13c0 addr v1:172.21.15.106:6790/0 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient(hunting): picked mon.noname-g con 0x7fa7480a17a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient(hunting): picked mon.noname-e con 0x7fa74813c040 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa748068070 con 0x7fa7480a13c0 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7480a1fb0 con 0x7fa7480a17a0 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa748072660 con 0x7fa74813c040 2024-04-25T23:54:48.377 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa74ee35640 10 monclient(hunting): authenticate will time out at 939.095167s 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa747fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fa7480a17a0 0x7fa74813a920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42810/0 (socket says 172.21.15.171:42810) 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa747fff640 1 -- 172.21.15.171:0/2538708660 learned_addr learned my addr 172.21.15.171:0/2538708660 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275085098 0 0) 0x7fa7480a1fb0 con 0x7fa7480a17a0 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient(hunting): my global_id is 4152 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa730003530 con 0x7fa7480a17a0 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2702287306 0 0) 0x7fa730003530 con 0x7fa7480a17a0 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 >> v1:172.21.15.106:6793/0 conn(0x7fa74813c040 legacy=0x7fa74813e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 >> v1:172.21.15.106:6790/0 conn(0x7fa7480a13c0 legacy=0x7fa748135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.378 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient: _finish_hunting 0 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 monclient: found mon.noname-g 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa748072940 con 0x7fa7480a17a0 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient: _finish_auth 0 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient: _check_auth_tickets 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa73c0017c0 con 0x7fa7480a17a0 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.386+0000 7fa7477fe640 10 monclient: dump: 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.379 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 5 monclient: authenticate success, global_id 4152 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:48.380 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa73c001ab0 con 0x7fa7480a17a0 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7477fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7477fe640 1 -- 172.21.15.171:0/2538708660 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa73c004bf0 con 0x7fa7480a17a0 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7477fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7477fe640 10 monclient: dump: 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.381 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 4 set_mon_vals no callback set 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: shutdown 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- 172.21.15.171:0/2538708660 >> v1:172.21.15.171:6790/0 conn(0x7fa7480a17a0 legacy=0x7fa74813a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- 172.21.15.171:0/2538708660 shutdown_connections 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- 172.21.15.171:0/2538708660 >> 172.21.15.171:0/2538708660 conn(0x7fa74806b210 msgr2=0x7fa74806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:48.382 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- 172.21.15.171:0/2538708660 shutdown_connections 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- 172.21.15.171:0/2538708660 wait complete. 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: build_initial_monmap 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: monmap: 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 0 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 0.000000 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:created 0.000000 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:48.383 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 Processor -- start 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- start start 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: init 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: _add_conns ranks=[0,2,4,3,5,7,1,8,6] 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient(hunting): picked mon.noname-a con 0x7fa7480a13c0 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient(hunting): picked mon.noname-b con 0x7fa7480a17a0 addr v1:172.21.15.106:6790/0 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient(hunting): picked mon.noname-c con 0x7fa74813c040 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74813ea20 con 0x7fa7480a13c0 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74813e340 con 0x7fa7480a17a0 2024-04-25T23:54:48.384 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa74813e120 con 0x7fa74813c040 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient(hunting): authenticate will time out at 939.098251s 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74cbd1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa7480a13c0 0x7fa7481cacc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:59348/0 (socket says 172.21.15.171:59348) 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa747fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fa7480a17a0 0x7fa7481cfce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:60284/0 (socket says 172.21.15.171:60284) 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74cbd1640 1 -- 172.21.15.171:0/1475240785 learned_addr learned my addr 172.21.15.171:0/1475240785 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3849828988 0 0) 0x7fa74813e340 con 0x7fa7480a17a0 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): my global_id is 4142 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa734003530 con 0x7fa7480a17a0 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976151957 0 0) 0x7fa74813ea20 con 0x7fa7480a13c0 2024-04-25T23:54:48.385 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): my global_id is 4149 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa74813e340 con 0x7fa7480a13c0 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1024567092 0 0) 0x7fa74813e120 con 0x7fa74813c040 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): my global_id is 4135 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa74813ea20 con 0x7fa74813c040 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 189278450 0 0) 0x7fa734003530 con 0x7fa7480a17a0 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa74813e120 con 0x7fa7480a17a0 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa73c004b30 con 0x7fa7480a17a0 2024-04-25T23:54:48.386 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): dump: 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.387 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2385719387 0 0) 0x7fa74813e340 con 0x7fa7480a13c0 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa734003530 con 0x7fa7480a13c0 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa738001ae0 con 0x7fa7480a13c0 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): dump: 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.388 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 646035186 0 0) 0x7fa74813ea20 con 0x7fa74813c040 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa74813e340 con 0x7fa74813c040 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa740001b30 con 0x7fa74813c040 2024-04-25T23:54:48.389 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient(hunting): dump: 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.390 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2123296327 0 0) 0x7fa74813e120 con 0x7fa7480a17a0 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 >> v1:172.21.15.106:6791/0 conn(0x7fa74813c040 legacy=0x7fa7481d3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 >> v1:172.21.15.106:6789/0 conn(0x7fa7480a13c0 legacy=0x7fa7481cacc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient: _finish_hunting 0 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 monclient: found mon.b 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa74809b700 con 0x7fa7480a17a0 2024-04-25T23:54:48.391 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient: _finish_auth 0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 10 monclient: _check_auth_tickets 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa7457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 5 monclient: authenticate success, global_id 4142 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: _renew_subs 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa748071870 con 0x7fa7480a17a0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: _renew_subs 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.390+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa74809b420 con 0x7fa7480a17a0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa73c0017e0 con 0x7fa7480a17a0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa73c0051a0 con 0x7fa7480a17a0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:54:48.392 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa746ffd640 4 set_mon_vals no callback set 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 10 monclient: dump: 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:epoch 1 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:election_strategy: 1 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.393 INFO:teuthology.orchestra.run.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fa73c0056d0 con 0x7fa7480a17a0 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 1117562716 0 0) 0x7fa73c006cb0 con 0x7fa7480a17a0 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa74ee35640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa74ee35640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa74ee35640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.394+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa728005090 con 0x7fa7480a17a0 2024-04-25T23:54:48.394 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.398+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7fa73c006820 con 0x7fa7480a17a0 2024-04-25T23:54:48.395 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.398+0000 7fa7457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.395 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.398+0000 7fa7457fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:48.395 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.406+0000 7f42b00b6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T23:54:48.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.466+0000 7fa74ee35640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1", "id": 5}] 2024-04-25T23:54:48.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.466+0000 7fa74ee35640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1", "id": 5}] 2024-04-25T23:54:48.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.466+0000 7fa74ee35640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:54:48.449 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.466+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd new", "uuid": "b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1", "id": 5} v 0) -- 0x7fa728005380 con 0x7fa7480a17a0 2024-04-25T23:54:48.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa7457fa640 1 -- 172.21.15.171:0/1475240785 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1", "id": 5}]=0 v8) ==== 112+0+2 (unknown 2553449713 0 1988412176) 0x7fa73c006ad0 con 0x7fa7480a17a0 2024-04-25T23:54:48.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa7457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1", "id": 5}] 2024-04-25T23:54:48.459 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa7457fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:48.460 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-04-25T23:54:48.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa74ee35640 10 monclient: shutdown 2024-04-25T23:54:48.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa74ee35640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:48.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 >> v1:172.21.15.106:6790/0 conn(0x7fa7480a17a0 legacy=0x7fa7481cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 shutdown_connections 2024-04-25T23:54:48.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 >> 172.21.15.171:0/1475240785 conn(0x7fa74806b210 msgr2=0x7fa748070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:48.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 shutdown_connections 2024-04-25T23:54:48.461 INFO:teuthology.orchestra.run.smithi171.stderr:2024-04-25T23:54:48.478+0000 7fa74ee35640 1 -- 172.21.15.171:0/1475240785 wait complete. 2024-04-25T23:54:48.466 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.486+0000 7f42b00b6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T23:54:48.476 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T23:54:48.476 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T23:54:48.479 INFO:tasks.ceph.osd.0:Started 2024-04-25T23:54:48.479 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T23:54:48.479 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T23:54:48.481 INFO:tasks.ceph.osd.1:Started 2024-04-25T23:54:48.481 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T23:54:48.481 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T23:54:48.484 INFO:tasks.ceph.osd.2:Started 2024-04-25T23:54:48.484 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T23:54:48.484 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T23:54:48.519 INFO:tasks.ceph.osd.3:Started 2024-04-25T23:54:48.519 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-25T23:54:48.519 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-25T23:54:48.520 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.538+0000 7f42b00b6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T23:54:48.521 INFO:tasks.ceph.osd.4:Started 2024-04-25T23:54:48.521 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-25T23:54:48.522 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-25T23:54:48.524 INFO:tasks.ceph.osd.5:Started 2024-04-25T23:54:48.524 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:54:48.605 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.622+0000 7f42b00b6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.656+0000 7efdbf574640 10 monclient: get_monmap_and_config 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.656+0000 7efdbf574640 10 monclient: build_initial_monmap 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.656+0000 7efdbf574640 10 monclient: monmap: 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:48.661614+0000 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:48.661614+0000 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:48.641 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:48.642 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:48.646 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:48.646 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:48.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.656+0000 7efdbf574640 1 Processor -- start 2024-04-25T23:54:48.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- start start 2024-04-25T23:54:48.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: init 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: _add_conns ranks=[3,8,1,5,0,7,4,2,6] 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): picked mon.noname-g con 0x7efdb8134970 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): picked mon.noname-e con 0x7efdb80a4820 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): picked mon.noname-f con 0x7efdb813e200 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb806dd40 con 0x7efdb813e200 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80a2b10 con 0x7efdb8134970 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80a2df0 con 0x7efdb80a4820 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): authenticate will time out at 944.188606s 2024-04-25T23:54:48.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbcb0f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7efdb80a4820 0x7efdb813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35810/0 (socket says 172.21.15.106:35810) 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbcb0f640 1 -- 172.21.15.106:0/2056461563 learned_addr learned my addr 172.21.15.106:0/2056461563 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189404894 0 0) 0x7efdb80a2df0 con 0x7efdb80a4820 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): my global_id is 4175 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda4003530 con 0x7efdb80a4820 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662596813 0 0) 0x7efdb80a2b10 con 0x7efdb8134970 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient(hunting): my global_id is 4161 2024-04-25T23:54:48.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdb80a2df0 con 0x7efdb8134970 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2092104433 0 0) 0x7efda4003530 con 0x7efdb80a4820 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 >> v1:172.21.15.171:6790/0 conn(0x7efdb8134970 legacy=0x7efdb8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 >> v1:172.21.15.171:6789/0 conn(0x7efdb813e200 legacy=0x7efdb81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: _finish_hunting 0 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 monclient: found mon.noname-e 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb80a30d0 con 0x7efdb80a4820 2024-04-25T23:54:48.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: _finish_auth 0 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: _check_auth_tickets 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efda80017c0 con 0x7efdb80a4820 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: dump: 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.657 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 5 monclient: authenticate success, global_id 4175 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efda8001a70 con 0x7efdb80a4820 2024-04-25T23:54:48.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 1 -- 172.21.15.106:0/2056461563 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efda8004bf0 con 0x7efdb80a4820 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 4 set_mon_vals no callback set 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdaffff640 10 monclient: dump: 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:48.659 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: shutdown 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- 172.21.15.106:0/2056461563 >> v1:172.21.15.106:6793/0 conn(0x7efdb80a4820 legacy=0x7efdb813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- 172.21.15.106:0/2056461563 shutdown_connections 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- 172.21.15.106:0/2056461563 >> 172.21.15.106:0/2056461563 conn(0x7efdb80a9e20 msgr2=0x7efdb80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- 172.21.15.106:0/2056461563 shutdown_connections 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- 172.21.15.106:0/2056461563 wait complete. 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: build_initial_monmap 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: monmap: 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:48.661 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 Processor -- start 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- start start 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: init 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient: _add_conns ranks=[8,7,4,6,1,5,3,2,0] 2024-04-25T23:54:48.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): picked mon.noname-e con 0x7efdb80a4820 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): picked mon.noname-i con 0x7efdb8134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): picked mon.noname-c con 0x7efdb813e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb809e0e0 con 0x7efdb813e200 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb809e3c0 con 0x7efdb8134970 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdb80a1e00 con 0x7efdb80a4820 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbf574640 10 monclient(hunting): authenticate will time out at 944.191533s 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbd310640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7efdb80a4820 0x7efdb81cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35812/0 (socket says 172.21.15.106:35812) 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdbd310640 1 -- 172.21.15.106:0/2869603805 learned_addr learned my addr 172.21.15.106:0/2869603805 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3565986159 0 0) 0x7efdb809e0e0 con 0x7efdb813e200 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): my global_id is 4162 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd9c003530 con 0x7efdb813e200 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362890317 0 0) 0x7efdb80a1e00 con 0x7efdb80a4820 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 10 monclient(hunting): my global_id is 4184 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.660+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdb809e0e0 con 0x7efdb80a4820 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3170147071 0 0) 0x7efdb809e3c0 con 0x7efdb8134970 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:48.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): my global_id is 4165 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdb80a1e00 con 0x7efdb8134970 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3208223841 0 0) 0x7efd9c003530 con 0x7efdb813e200 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdb809e3c0 con 0x7efdb813e200 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 591659082 0 0) 0x7efdb809e0e0 con 0x7efdb80a4820 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efd9c003530 con 0x7efdb80a4820 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb0001b70 con 0x7efdb813e200 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): dump: 2024-04-25T23:54:48.665 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.666 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb40019e0 con 0x7efdb80a4820 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient(hunting): dump: 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.667 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2811243417 0 0) 0x7efdb809e3c0 con 0x7efdb813e200 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 >> v1:172.21.15.106:6793/0 conn(0x7efdb80a4820 legacy=0x7efdb81cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 >> v1:172.21.15.171:6792/0 conn(0x7efdb8134970 legacy=0x7efdb809fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: _finish_hunting 0 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 monclient: found mon.c 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:48.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdb809cea0 con 0x7efdb813e200 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: _finish_auth 0 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: _check_auth_tickets 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 5 monclient: authenticate success, global_id 4162 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 10 monclient: _renew_subs 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efdb809c340 con 0x7efdb813e200 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 10 monclient: _renew_subs 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7efdb80a04b0 con 0x7efdb813e200 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdb0003980 con 0x7efdb813e200 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:48.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb0003e70 con 0x7efdb813e200 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdaf7fe640 4 set_mon_vals no callback set 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 10 monclient: dump: 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:48.670 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7efdb0004420 con 0x7efdb813e200 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 3360909625 0 0) 0x7efdb0004710 con 0x7efdb813e200 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:48.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.664+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd98005090 con 0x7efdb813e200 2024-04-25T23:54:48.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.676+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7efdb0005660 con 0x7efdb813e200 2024-04-25T23:54:48.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.676+0000 7efdadffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:48.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.676+0000 7efdadffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:48.672 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.678+0000 7f42b00b6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T23:54:48.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.736+0000 7efdbf574640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:48.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.736+0000 7efdbf574640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.736+0000 7efdbf574640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.736+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efd98005380 con 0x7efdb813e200 2024-04-25T23:54:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.736+0000 7efdadffb640 1 -- 172.21.15.106:0/2869603805 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 795825378) 0x7efdb0005900 con 0x7efdb813e200 2024-04-25T23:54:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.736+0000 7efdadffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:48.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.736+0000 7efdadffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:48.722 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:48.722 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":8,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","created":"2024-04-25T23:54:46.746675+0000","modified":"2024-04-25T23:54:48.471734+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T23:54:48.471734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8be68ed-f989-43cd-bb66-fdf514ef84a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0b4cb186-016f-4325-86fc-a32d67508e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5305c964-9533-4f1d-a1a2-6ab03decd54a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"acff288b-4172-4f63-9d56-7556ce456b20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eebb63b-821b-4ad5-9ec1-dc19e2b3602c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:54:48.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.740+0000 7efdbf574640 10 monclient: shutdown 2024-04-25T23:54:48.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.740+0000 7efdbf574640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:48.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.740+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 >> v1:172.21.15.106:6791/0 conn(0x7efdb813e200 legacy=0x7efdb81d47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:48.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.740+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 shutdown_connections 2024-04-25T23:54:48.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.740+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 >> 172.21.15.106:0/2869603805 conn(0x7efdb80a9e20 msgr2=0x7efdb8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:48.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.740+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 shutdown_connections 2024-04-25T23:54:48.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:48.740+0000 7efdbf574640 1 -- 172.21.15.106:0/2869603805 wait complete. 2024-04-25T23:54:48.738 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T23:54:48.738 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T23:54:48.816 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.834+0000 7f42b00b6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T23:54:48.878 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:48.894+0000 7f42b00b6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T23:54:49.083 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-25T23:54:49.100+0000 7f98d682a7c0 -1 Falling back to public interface 2024-04-25T23:54:49.083 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-25T23:54:49.100+0000 7f69ec8b97c0 -1 Falling back to public interface 2024-04-25T23:54:49.083 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-25T23:54:49.100+0000 7f69eb879640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6800/0: (98) Address already in use 2024-04-25T23:54:49.084 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-25T23:54:49.100+0000 7f98d57ea640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6806/0: (98) Address already in use 2024-04-25T23:54:49.090 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-25T23:54:49.108+0000 7f452a5307c0 -1 Falling back to public interface 2024-04-25T23:54:49.124 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-25T23:54:49.142+0000 7fc6124ce7c0 -1 Falling back to public interface 2024-04-25T23:54:49.127 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-25T23:54:49.146+0000 7f2ae1e097c0 -1 Falling back to public interface 2024-04-25T23:54:49.139 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-25T23:54:49.158+0000 7faa60e597c0 -1 Falling back to public interface 2024-04-25T23:54:49.343 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T23:54:49.461 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.476+0000 7f81eab54640 10 monclient: get_monmap_and_config 2024-04-25T23:54:49.461 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.476+0000 7f81eab54640 10 monclient: build_initial_monmap 2024-04-25T23:54:49.461 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.476+0000 7f81eab54640 10 monclient: monmap: 2024-04-25T23:54:49.461 INFO:teuthology.misc.health.smithi106.stderr:epoch 0 2024-04-25T23:54:49.461 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:49.482151+0000 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:49.482151+0000 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:49.462 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:49.463 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:49.463 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:49.463 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:49.473 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 Processor -- start 2024-04-25T23:54:49.473 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- start start 2024-04-25T23:54:49.473 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: init 2024-04-25T23:54:49.473 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:49.473 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: _add_conns ranks=[0,8,5,3,4,7,6,2,1] 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient(hunting): picked mon.noname-a con 0x7f81e40a38b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient(hunting): picked mon.noname-e con 0x7f81e40a4e10 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient(hunting): picked mon.noname-h con 0x7f81e413e2d0 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40a41b0 con 0x7f81e40a38b0 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40a2890 con 0x7f81e413e2d0 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e40a2b70 con 0x7f81e40a4e10 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient(hunting): authenticate will time out at 945.009224s 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e88f0640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f81e40a38b0 0x7f81e40a54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:52202/0 (socket says 172.21.15.106:52202) 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e88f0640 1 -- 172.21.15.106:0/3490978137 learned_addr learned my addr 172.21.15.106:0/3490978137 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e3fff640 1 --1- 172.21.15.106:0/3490978137 >> v1:172.21.15.106:6793/0 conn(0x7f81e40a4e10 0x7f81e413cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35822/0 (socket says 172.21.15.106:35822) 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692126696 0 0) 0x7f81e40a41b0 con 0x7f81e40a38b0 2024-04-25T23:54:49.474 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): my global_id is 4185 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81cc003530 con 0x7f81e40a38b0 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4269765339 0 0) 0x7f81e40a2b70 con 0x7f81e40a4e10 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): my global_id is 4193 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e40a41b0 con 0x7f81e40a4e10 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553585982 0 0) 0x7f81e40a2890 con 0x7f81e413e2d0 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:49.475 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient(hunting): my global_id is 4208 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e40a2b70 con 0x7f81e413e2d0 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 275819967 0 0) 0x7f81cc003530 con 0x7f81e40a38b0 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 >> v1:172.21.15.106:6793/0 conn(0x7f81e40a4e10 legacy=0x7f81e413cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 >> v1:172.21.15.171:6791/0 conn(0x7f81e413e2d0 legacy=0x7f81e41406c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: _finish_hunting 0 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 monclient: found mon.noname-a 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e40a5bf0 con 0x7f81e40a38b0 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: _finish_auth 0 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: _check_auth_tickets 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:49.476 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f81d40017c0 con 0x7f81e40a38b0 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 5 monclient: authenticate success, global_id 4185 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: dump: 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:49.477 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81d4001a20 con 0x7f81e40a38b0 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 4 set_mon_vals no callback set 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 1 -- 172.21.15.106:0/3490978137 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f81d4004bf0 con 0x7f81e40a38b0 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:54:49.478 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81e37fe640 10 monclient: dump: 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:49.479 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: shutdown 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- 172.21.15.106:0/3490978137 >> v1:172.21.15.106:6789/0 conn(0x7f81e40a38b0 legacy=0x7f81e40a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- 172.21.15.106:0/3490978137 shutdown_connections 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- 172.21.15.106:0/3490978137 >> 172.21.15.106:0/3490978137 conn(0x7f81e40a9f00 msgr2=0x7f81e40aa310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- 172.21.15.106:0/3490978137 shutdown_connections 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- 172.21.15.106:0/3490978137 wait complete. 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: build_initial_monmap 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: monmap: 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:epoch 0 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:49.480 INFO:teuthology.misc.health.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:created 0.000000 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 Processor -- start 2024-04-25T23:54:49.481 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 1 -- start start 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.480+0000 7f81eab54640 10 monclient: init 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _add_conns ranks=[4,7,8,5,1,3,0,6,2] 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient(hunting): picked mon.noname-c con 0x7f81e40a38b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient(hunting): picked mon.noname-i con 0x7f81e40a4e10 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient(hunting): picked mon.noname-e con 0x7f81e413e2d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e409c930 con 0x7f81e40a38b0 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e409ec20 con 0x7f81e40a4e10 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f81e409e380 con 0x7f81e413e2d0 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient(hunting): authenticate will time out at 945.012291s 2024-04-25T23:54:49.482 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e90f1640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f81e413e2d0 0x7f81e41d4d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35824/0 (socket says 172.21.15.106:35824) 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e88f0640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f81e40a38b0 0x7f81e40a0130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:58334/0 (socket says 172.21.15.106:58334) 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e90f1640 1 -- 172.21.15.106:0/3590685655 learned_addr learned my addr 172.21.15.106:0/3590685655 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175863442 0 0) 0x7f81e409e380 con 0x7f81e413e2d0 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): my global_id is 4202 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81d0003530 con 0x7f81e413e2d0 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975491742 0 0) 0x7f81e409c930 con 0x7f81e40a38b0 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): my global_id is 4171 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e409e380 con 0x7f81e40a38b0 2024-04-25T23:54:49.483 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 60426084 0 0) 0x7f81e409ec20 con 0x7f81e40a4e10 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): my global_id is 4174 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f81e409c930 con 0x7f81e40a4e10 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1722603625 0 0) 0x7f81d0003530 con 0x7f81e413e2d0 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81e409ec20 con 0x7f81e413e2d0 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2459625153 0 0) 0x7f81e409e380 con 0x7f81e40a38b0 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f81d0003530 con 0x7f81e40a38b0 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f81dc001da0 con 0x7f81e413e2d0 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): dump: 2024-04-25T23:54:49.484 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:49.485 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f81d4004b30 con 0x7f81e40a38b0 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient(hunting): dump: 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:49.486 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2532614219 0 0) 0x7f81e409ec20 con 0x7f81e413e2d0 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 >> v1:172.21.15.171:6792/0 conn(0x7f81e40a4e10 legacy=0x7f81e41d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 >> v1:172.21.15.106:6791/0 conn(0x7f81e40a38b0 legacy=0x7f81e40a0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: _finish_hunting 0 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 monclient: found mon.e 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:49.487 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81e409d6b0 con 0x7f81e413e2d0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: _finish_auth 0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: _check_auth_tickets 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 5 monclient: authenticate success, global_id 4202 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _renew_subs 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f81e41ccd80 con 0x7f81e413e2d0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _renew_subs 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f81e40a0a10 con 0x7f81e413e2d0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f81dc003c50 con 0x7f81e413e2d0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f81dc001fd0 con 0x7f81e413e2d0 2024-04-25T23:54:49.488 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e2ffd640 4 set_mon_vals no callback set 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 10 monclient: dump: 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:49.489 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f81dc004550 con 0x7f81e413e2d0 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 3360909625 0 0) 0x7f81dc006140 con 0x7f81e413e2d0 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.484+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81c4005090 con 0x7f81e413e2d0 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.488+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (unknown 1092875540 0 2031569661) 0x7f81dc006450 con 0x7f81e413e2d0 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.488+0000 7f81e17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:49.490 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.488+0000 7f81e17fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:49.526 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:49.526 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:49.526 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:49.527 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f81c4005380 con 0x7f81e413e2d0 2024-04-25T23:54:49.527 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81e17fa640 1 -- 172.21.15.106:0/3590685655 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 795825378) 0x7f81dc005c00 con 0x7f81e413e2d0 2024-04-25T23:54:49.527 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81e17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:49.527 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81e17fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:49.527 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-25T23:54:49.527 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":8,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","created":"2024-04-25T23:54:46.746675+0000","modified":"2024-04-25T23:54:48.471734+0000","last_up_change":"0.000000","last_in_change":"2024-04-25T23:54:48.471734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8be68ed-f989-43cd-bb66-fdf514ef84a2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"0b4cb186-016f-4325-86fc-a32d67508e1e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5305c964-9533-4f1d-a1a2-6ab03decd54a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"acff288b-4172-4f63-9d56-7556ce456b20","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eebb63b-821b-4ad5-9ec1-dc19e2b3602c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:54:49.528 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 10 monclient: shutdown 2024-04-25T23:54:49.528 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:49.528 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 >> v1:172.21.15.106:6793/0 conn(0x7f81e413e2d0 legacy=0x7f81e41d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:49.528 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 shutdown_connections 2024-04-25T23:54:49.528 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 >> 172.21.15.106:0/3590685655 conn(0x7f81e40a9f00 msgr2=0x7f81e413f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:49.528 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 shutdown_connections 2024-04-25T23:54:49.528 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:49.544+0000 7f81eab54640 1 -- 172.21.15.106:0/3590685655 wait complete. 2024-04-25T23:54:49.542 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-04-25T23:54:49.566 INFO:tasks.ceph.mgr.x.smithi171.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-25T23:54:49.566 INFO:tasks.ceph.mgr.x.smithi171.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-25T23:54:49.566 INFO:tasks.ceph.mgr.x.smithi171.stderr: from numpy import show_config as show_numpy_config 2024-04-25T23:54:49.629 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:49.646+0000 7f42b00b6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-25T23:54:49.812 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:49.830+0000 7f42b00b6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T23:54:49.997 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:50.014+0000 7f42b00b6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T23:54:50.076 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:50.094+0000 7f42b00b6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T23:54:50.223 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:50.242+0000 7f42b00b6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T23:54:50.851 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:50.870+0000 7f42b00b6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T23:54:50.927 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:50.946+0000 7f42b00b6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T23:54:51.107 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:51.126+0000 7f42b00b6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T23:54:51.180 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:51.198+0000 7f42b00b6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T23:54:51.468 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:51.486+0000 7f42b00b6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T23:54:51.530 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:51.550+0000 7f42b00b6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T23:54:52.577 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.594+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.d 2024-04-25T23:54:52.577 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.594+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.e 2024-04-25T23:54:52.577 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.594+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.f 2024-04-25T23:54:52.577 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.594+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.i 2024-04-25T23:54:52.578 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.594+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T23:54:52.578 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.594+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T23:54:52.578 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.598+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.g 2024-04-25T23:54:52.578 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:54:52.598+0000 7f4257501640 -1 mgr.server handle_report got status from non-daemon mon.h 2024-04-25T23:54:52.728 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-25T23:54:52.744+0000 7f98d682a7c0 -1 osd.1 0 log_to_monitors true 2024-04-25T23:54:52.843 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-25T23:54:52.860+0000 7f69ec8b97c0 -1 osd.2 0 log_to_monitors true 2024-04-25T23:54:52.940 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-25T23:54:52.956+0000 7f452a5307c0 -1 osd.0 0 log_to_monitors true 2024-04-25T23:54:52.947 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-25T23:54:52.966+0000 7faa60e597c0 -1 osd.3 0 log_to_monitors true 2024-04-25T23:54:52.967 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-25T23:54:52.986+0000 7fc6124ce7c0 -1 osd.5 0 log_to_monitors true 2024-04-25T23:54:52.994 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-25T23:54:53.014+0000 7f2ae1e097c0 -1 osd.4 0 log_to_monitors true 2024-04-25T23:54:54.639 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-25T23:54:54.656+0000 7f69e8862640 -1 osd.2 0 waiting for initial osdmap 2024-04-25T23:54:54.647 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-25T23:54:54.665+0000 7f2adddb2640 -1 osd.4 0 waiting for initial osdmap 2024-04-25T23:54:54.647 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-25T23:54:54.665+0000 7fc60e477640 -1 osd.5 0 waiting for initial osdmap 2024-04-25T23:54:54.648 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-25T23:54:54.664+0000 7f45264d9640 -1 osd.0 0 waiting for initial osdmap 2024-04-25T23:54:54.649 INFO:tasks.ceph.osd.2.smithi106.stderr:2024-04-25T23:54:54.668+0000 7f69e469f640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T23:54:54.651 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-04-25T23:54:54.669+0000 7f2ad9bef640 -1 osd.4 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T23:54:54.652 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-04-25T23:54:54.669+0000 7fc60a2b4640 -1 osd.5 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T23:54:54.653 INFO:tasks.ceph.osd.0.smithi106.stderr:2024-04-25T23:54:54.672+0000 7f4522316640 -1 osd.0 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T23:54:55.303 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-25T23:54:55.321+0000 7faa5ce02640 -1 osd.3 0 waiting for initial osdmap 2024-04-25T23:54:55.308 INFO:tasks.ceph.osd.3.smithi171.stderr:2024-04-25T23:54:55.325+0000 7faa54c37640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T23:54:55.326 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-25T23:54:55.344+0000 7f98d2fe5640 -1 osd.1 0 waiting for initial osdmap 2024-04-25T23:54:55.332 INFO:tasks.ceph.osd.1.smithi106.stderr:2024-04-25T23:54:55.348+0000 7f98ca608640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T23:54:56.147 DEBUG:teuthology.orchestra.run.smithi106:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.284+0000 7f9f65776640 10 monclient: get_monmap_and_config 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.284+0000 7f9f65776640 10 monclient: build_initial_monmap 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.284+0000 7f9f65776640 10 monclient: monmap: 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:epoch 0 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:56.289006+0000 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:56.289006+0000 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:56.268 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:56.269 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:56.269 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:56.269 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:56.269 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:56.269 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:56.269 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:56.269 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.275 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.284+0000 7f9f65776640 1 Processor -- start 2024-04-25T23:54:56.275 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.284+0000 7f9f65776640 1 -- start start 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.284+0000 7f9f65776640 10 monclient: init 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.284+0000 7f9f65776640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: _add_conns ranks=[7,0,4,3,2,1,5,8,6] 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): picked mon.noname-i con 0x7f9f60099450 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): picked mon.noname-a con 0x7f9f60099830 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): picked mon.noname-c con 0x7f9f60099c10 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6006bce0 con 0x7f9f60099830 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6006bf20 con 0x7f9f60099c10 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6009dcf0 con 0x7f9f60099450 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): authenticate will time out at 951.816116s 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5f7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9f60099c10 0x7f9f6013dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48508/0 (socket says 172.21.15.106:48508) 2024-04-25T23:54:56.276 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5f7fe640 1 -- 172.21.15.106:0/113208514 learned_addr learned my addr 172.21.15.106:0/113208514 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870271430 0 0) 0x7f9f6006bf20 con 0x7f9f60099c10 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): my global_id is 4216 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f48003530 con 0x7f9f60099c10 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862931185 0 0) 0x7f9f6006bce0 con 0x7f9f60099830 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient(hunting): my global_id is 4248 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f6006bf20 con 0x7f9f60099830 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2451786590 0 0) 0x7f9f48003530 con 0x7f9f60099c10 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 >> v1:172.21.15.171:6792/0 conn(0x7f9f60099450 legacy=0x7f9f6009e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.277 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 >> v1:172.21.15.106:6789/0 conn(0x7f9f60099830 legacy=0x7f9f6013a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 monclient: found mon.noname-c 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f600a3d50 con 0x7f9f60099c10 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: _finish_auth 0 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f58001b40 con 0x7f9f60099c10 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: dump: 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.278 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 5 monclient: authenticate success, global_id 4216 2024-04-25T23:54:56.279 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f58001da0 con 0x7f9f60099c10 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 4 set_mon_vals no callback set 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 1 -- 172.21.15.106:0/113208514 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f58004f70 con 0x7f9f60099c10 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5dffb640 10 monclient: dump: 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.280 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.281 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.281 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.281 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.281 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.281 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.281 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.281 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: shutdown 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- 172.21.15.106:0/113208514 >> v1:172.21.15.106:6791/0 conn(0x7f9f60099c10 legacy=0x7f9f6013dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- 172.21.15.106:0/113208514 shutdown_connections 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- 172.21.15.106:0/113208514 >> 172.21.15.106:0/113208514 conn(0x7f9f600a2f70 msgr2=0x7f9f600a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- 172.21.15.106:0/113208514 shutdown_connections 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- 172.21.15.106:0/113208514 wait complete. 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: build_initial_monmap 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: monmap: 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:epoch 0 2024-04-25T23:54:56.282 INFO:teuthology.misc.health.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:created 0.000000 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:56.283 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 Processor -- start 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- start start 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: init 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:56.284 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient: _add_conns ranks=[6,2,8,5,0,1,4,3,7] 2024-04-25T23:54:56.285 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): picked mon.noname-d con 0x7f9f60099450 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:56.285 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): picked mon.noname-b con 0x7f9f60099830 addr v1:172.21.15.106:6790/0 2024-04-25T23:54:56.285 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): picked mon.noname-e con 0x7f9f60099c10 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6013eb60 con 0x7f9f60099830 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6013ee40 con 0x7f9f60099450 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f6013e2e0 con 0x7f9f60099c10 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f65776640 10 monclient(hunting): authenticate will time out at 951.819259s 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5f7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f9f60099c10 0x7f9f601d3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42230/0 (socket says 172.21.15.106:42230) 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f5f7fe640 1 -- 172.21.15.106:0/1875444172 learned_addr learned my addr 172.21.15.106:0/1875444172 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1200160771 0 0) 0x7f9f6013e2e0 con 0x7f9f60099c10 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.286 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): my global_id is 4256 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f4c003530 con 0x7f9f60099c10 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016844393 0 0) 0x7f9f6013eb60 con 0x7f9f60099830 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): my global_id is 4187 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f6013e2e0 con 0x7f9f60099830 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084307912 0 0) 0x7f9f6013ee40 con 0x7f9f60099450 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.287 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 10 monclient(hunting): my global_id is 4209 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.288+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f6013eb60 con 0x7f9f60099450 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3135280880 0 0) 0x7f9f4c003530 con 0x7f9f60099c10 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f6013ee40 con 0x7f9f60099c10 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f58004eb0 con 0x7f9f60099c10 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): dump: 2024-04-25T23:54:56.288 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.289 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.290 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.290 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.290 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.290 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.290 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.290 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 59142025 0 0) 0x7f9f6013eb60 con 0x7f9f60099450 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f4c003530 con 0x7f9f60099450 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 727932306 0 0) 0x7f9f6013e2e0 con 0x7f9f60099830 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f6013eb60 con 0x7f9f60099830 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f50001960 con 0x7f9f60099450 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): dump: 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:56.291 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.292 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.293 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.293 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.293 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f54001a20 con 0x7f9f60099830 2024-04-25T23:54:56.293 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:56.293 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:54:56.293 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient(hunting): dump: 2024-04-25T23:54:56.293 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.294 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 120229917 0 0) 0x7f9f6013ee40 con 0x7f9f60099c10 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 >> v1:172.21.15.106:6792/0 conn(0x7f9f60099450 legacy=0x7f9f600982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 >> v1:172.21.15.106:6790/0 conn(0x7f9f60099830 legacy=0x7f9f601cfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: _finish_hunting 0 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 monclient: found mon.e 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f6013e5a0 con 0x7f9f60099c10 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: _finish_auth 0 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: _check_auth_tickets 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 5 monclient: authenticate success, global_id 4256 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 10 monclient: _renew_subs 2024-04-25T23:54:56.295 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f6013f260 con 0x7f9f60099c10 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 10 monclient: _renew_subs 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f6013c0a0 con 0x7f9f60099c10 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f58001da0 con 0x7f9f60099c10 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f580014c0 con 0x7f9f60099c10 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f5d7fa640 4 set_mon_vals no callback set 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 10 monclient: dump: 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:epoch 1 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.296 INFO:teuthology.misc.health.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr: 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:56.297 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:56.298 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f9f580100f0 con 0x7f9f60099c10 2024-04-25T23:54:56.298 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f40005090 con 0x7f9f60099c10 2024-04-25T23:54:56.298 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(11..11 src has 1..11) ==== 2767+0+0 (unknown 315681159 0 0) 0x7f9f58044460 con 0x7f9f60099c10 2024-04-25T23:54:56.298 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.292+0000 7f9f5effd640 10 monclient: get_auth_request con 0x7f9f4c0380b0 auth_method 0 2024-04-25T23:54:56.298 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.296+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9f58015bb0 con 0x7f9f60099c10 2024-04-25T23:54:56.298 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.296+0000 7f9f477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:56.298 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.296+0000 7f9f477fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:56.443 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.460+0000 7f9f65776640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:56.444 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.460+0000 7f9f65776640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:56.444 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.460+0000 7f9f65776640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:56.444 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.460+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f40005380 con 0x7f9f60099c10 2024-04-25T23:54:56.444 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.460+0000 7f9f477fe640 1 -- 172.21.15.106:0/1875444172 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) ==== 74+0+7065 (unknown 238102980 0 1730709981) 0x7f9f580154b0 con 0x7f9f60099c10 2024-04-25T23:54:56.445 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.460+0000 7f9f477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:56.445 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.460+0000 7f9f477fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:56.445 INFO:teuthology.misc.health.smithi106.stdout: 2024-04-25T23:54:56.445 INFO:teuthology.misc.health.smithi106.stdout:{"epoch":11,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","created":"2024-04-25T23:54:46.746675+0000","modified":"2024-04-25T23:54:55.661326+0000","last_up_change":"2024-04-25T23:54:55.661326+0000","last_in_change":"2024-04-25T23:54:48.471734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"d8be68ed-f989-43cd-bb66-fdf514ef84a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":1458966339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":1458966339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":1458966339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":1458966339}]},"public_addr":"172.21.15.106:6808/1458966339","cluster_addr":"172.21.15.106:6809/1458966339","heartbeat_back_addr":"172.21.15.106:6811/1458966339","heartbeat_front_addr":"172.21.15.106:6810/1458966339","state":["exists","up"]},{"osd":1,"uuid":"0b4cb186-016f-4325-86fc-a32d67508e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":858572474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":858572474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":858572474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":858572474}]},"public_addr":"172.21.15.106:6800/858572474","cluster_addr":"172.21.15.106:6802/858572474","heartbeat_back_addr":"172.21.15.106:6807/858572474","heartbeat_front_addr":"172.21.15.106:6804/858572474","state":["exists","up"]},{"osd":2,"uuid":"5305c964-9533-4f1d-a1a2-6ab03decd54a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":2648645857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":2648645857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":2648645857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":2648645857}]},"public_addr":"172.21.15.106:6801/2648645857","cluster_addr":"172.21.15.106:6803/2648645857","heartbeat_back_addr":"172.21.15.106:6806/2648645857","heartbeat_front_addr":"172.21.15.106:6805/2648645857","state":["exists","up"]},{"osd":3,"uuid":"acff288b-4172-4f63-9d56-7556ce456b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":2707846597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":2707846597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":2707846597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":2707846597}]},"public_addr":"172.21.15.171:6808/2707846597","cluster_addr":"172.21.15.171:6809/2707846597","heartbeat_back_addr":"172.21.15.171:6811/2707846597","heartbeat_front_addr":"172.21.15.171:6810/2707846597","state":["exists","up"]},{"osd":4,"uuid":"7eebb63b-821b-4ad5-9ec1-dc19e2b3602c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":3736794137}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":3736794137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":3736794137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":3736794137}]},"public_addr":"172.21.15.171:6804/3736794137","cluster_addr":"172.21.15.171:6805/3736794137","heartbeat_back_addr":"172.21.15.171:6807/3736794137","heartbeat_front_addr":"172.21.15.171:6806/3736794137","state":["exists","up"]},{"osd":5,"uuid":"b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":721452434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":721452434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":721452434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":721452434}]},"public_addr":"172.21.15.171:6800/721452434","cluster_addr":"172.21.15.171:6801/721452434","heartbeat_back_addr":"172.21.15.171:6803/721452434","heartbeat_front_addr":"172.21.15.171:6802/721452434","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 >> v1:172.21.15.171:6812/722422047 conn(0x7f9f4c0380b0 legacy=0x7f9f4c03a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 10 monclient: shutdown 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 >> v1:172.21.15.106:6793/0 conn(0x7f9f60099c10 legacy=0x7f9f601d3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 shutdown_connections 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 >> 172.21.15.106:0/1875444172 conn(0x7f9f600a2f70 msgr2=0x7f9f60138910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 shutdown_connections 2024-04-25T23:54:56.447 INFO:teuthology.misc.health.smithi106.stderr:2024-04-25T23:54:56.464+0000 7f9f65776640 1 -- 172.21.15.106:0/1875444172 wait complete. 2024-04-25T23:54:56.461 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-04-25T23:54:56.462 INFO:tasks.ceph:Creating RBD pool 2024-04-25T23:54:56.462 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T23:54:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.600+0000 7f6d63c4a640 10 monclient: get_monmap_and_config 2024-04-25T23:54:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.600+0000 7f6d63c4a640 10 monclient: build_initial_monmap 2024-04-25T23:54:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.600+0000 7f6d63c4a640 10 monclient: monmap: 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:56.605413+0000 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:56.605413+0000 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:56.586 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.600+0000 7f6d63c4a640 1 Processor -- start 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.600+0000 7f6d63c4a640 1 -- start start 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.600+0000 7f6d63c4a640 10 monclient: init 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: _add_conns ranks=[6,4,5,1,0,3,7,8,2] 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): picked mon.noname-d con 0x7f6d5c134920 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): picked mon.noname-c con 0x7f6d5c0a45a0 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): picked mon.noname-h con 0x7f6d5c134d00 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c0a2680 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c138470 con 0x7f6d5c134d00 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c0a28f0 con 0x7f6d5c134920 2024-04-25T23:54:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): authenticate will time out at 952.132600s 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d611e5640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f6d5c0a45a0 0x7f6d5c137d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48514/0 (socket says 172.21.15.106:48514) 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d619e6640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6d5c134920 0x7f6d5c137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43462/0 (socket says 172.21.15.106:43462) 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d611e5640 1 -- 172.21.15.106:0/378439541 learned_addr learned my addr 172.21.15.106:0/378439541 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810121812 0 0) 0x7f6d5c0a2680 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): my global_id is 4225 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d48003530 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2480165387 0 0) 0x7f6d5c0a28f0 con 0x7f6d5c134920 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient(hunting): my global_id is 4218 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d5c0a2680 con 0x7f6d5c134920 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1204295325 0 0) 0x7f6d5c0a2680 con 0x7f6d5c134920 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 >> v1:172.21.15.171:6791/0 conn(0x7f6d5c134d00 legacy=0x7f6d5c1409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 >> v1:172.21.15.106:6791/0 conn(0x7f6d5c0a45a0 legacy=0x7f6d5c137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: _finish_hunting 0 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 monclient: found mon.noname-d 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c0a2bd0 con 0x7f6d5c134920 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: _finish_auth 0 2024-04-25T23:54:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: _check_auth_tickets 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d58001800 con 0x7f6d5c134920 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: dump: 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 5 monclient: authenticate success, global_id 4218 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d58001a10 con 0x7f6d5c134920 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 1 -- 172.21.15.106:0/378439541 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d58004b30 con 0x7f6d5c134920 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 4 set_mon_vals no callback set 2024-04-25T23:54:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d609e4640 10 monclient: dump: 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: shutdown 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- 172.21.15.106:0/378439541 >> v1:172.21.15.106:6792/0 conn(0x7f6d5c134920 legacy=0x7f6d5c137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- 172.21.15.106:0/378439541 shutdown_connections 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- 172.21.15.106:0/378439541 >> 172.21.15.106:0/378439541 conn(0x7f6d5c0a9ba0 msgr2=0x7f6d5c0a9fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- 172.21.15.106:0/378439541 shutdown_connections 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- 172.21.15.106:0/378439541 wait complete. 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: build_initial_monmap 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: monmap: 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 Processor -- start 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- start start 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: init 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient: _add_conns ranks=[6,4,7,2,8,0,3,5,1] 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): picked mon.noname-d con 0x7f6d5c0a45a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): picked mon.noname-c con 0x7f6d5c134920 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 10 monclient(hunting): picked mon.noname-i con 0x7f6d5c134d00 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.604+0000 7f6d63c4a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c0a1890 con 0x7f6d5c134920 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c0a0b20 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5c121a70 con 0x7f6d5c134d00 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d619e6640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6d5c0a45a0 0x7f6d5c130350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43472/0 (socket says 172.21.15.106:43472) 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d619e6640 1 -- 172.21.15.106:0/1616179595 learned_addr learned my addr 172.21.15.106:0/1616179595 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient(hunting): authenticate will time out at 952.136080s 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938951986 0 0) 0x7f6d5c0a0b20 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): my global_id is 4227 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d40003530 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3517570204 0 0) 0x7f6d5c0a1890 con 0x7f6d5c134920 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): my global_id is 4234 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d5c0a0b20 con 0x7f6d5c134920 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 320704522 0 0) 0x7f6d5c0a0b20 con 0x7f6d5c134920 2024-04-25T23:54:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d5c0a1890 con 0x7f6d5c134920 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 736843349 0 0) 0x7f6d40003530 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d5c0a0b20 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d4c0014c0 con 0x7f6d5c134920 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): dump: 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d58004b30 con 0x7f6d5c0a45a0 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): dump: 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1151854815 0 0) 0x7f6d5c121a70 con 0x7f6d5c134d00 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient(hunting): my global_id is 4210 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d40003530 con 0x7f6d5c134d00 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1550430744 0 0) 0x7f6d5c0a1890 con 0x7f6d5c134920 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 >> v1:172.21.15.171:6792/0 conn(0x7f6d5c134d00 legacy=0x7f6d5c1d5060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 >> v1:172.21.15.106:6792/0 conn(0x7f6d5c0a45a0 legacy=0x7f6d5c130350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: _finish_hunting 0 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 monclient: found mon.c 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d5c120340 con 0x7f6d5c134920 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: _finish_auth 0 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: _check_auth_tickets 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 5 monclient: authenticate success, global_id 4234 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient: _renew_subs 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6d5c1205c0 con 0x7f6d5c134920 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient: _renew_subs 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6d5c130c30 con 0x7f6d5c134920 2024-04-25T23:54:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d4c001660 con 0x7f6d5c134920 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d4c004de0 con 0x7f6d5c134920 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d53fff640 4 set_mon_vals no callback set 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 10 monclient: dump: 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f6d4c00fb50 con 0x7f6d5c134920 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d44005090 con 0x7f6d5c134920 2024-04-25T23:54:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(11..11 src has 1..11) ==== 2767+0+0 (unknown 315681159 0 0) 0x7f6d4c043f60 con 0x7f6d5c134920 2024-04-25T23:54:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.608+0000 7f6d619e6640 10 monclient: get_auth_request con 0x7f6d40037e30 auth_method 0 2024-04-25T23:54:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.612+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6d4c0155f0 con 0x7f6d5c134920 2024-04-25T23:54:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.612+0000 7f6d527fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.612+0000 7f6d527fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.788+0000 7f6d63c4a640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-25T23:54:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.788+0000 7f6d63c4a640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-25T23:54:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.788+0000 7f6d63c4a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:56.788+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f6d44005b90 con 0x7f6d5c134920 2024-04-25T23:54:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.716+0000 7f6d527fc640 1 -- 172.21.15.106:0/1616179595 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) ==== 109+0+0 (unknown 2984082091 0 0) 0x7f6d4c014ef0 con 0x7f6d5c134920 2024-04-25T23:54:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.716+0000 7f6d527fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-04-25T23:54:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.716+0000 7f6d527fc640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-04-25T23:54:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:pool 'rbd' created 2024-04-25T23:54:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 >> v1:172.21.15.171:6812/722422047 conn(0x7f6d40037e30 legacy=0x7f6d4003a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 10 monclient: shutdown 2024-04-25T23:54:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 >> v1:172.21.15.106:6791/0 conn(0x7f6d5c134920 legacy=0x7f6d5c1d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 shutdown_connections 2024-04-25T23:54:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 >> 172.21.15.106:0/1616179595 conn(0x7f6d5c0a9ba0 msgr2=0x7f6d5c135430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:57.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 shutdown_connections 2024-04-25T23:54:57.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.720+0000 7f6d63c4a640 1 -- 172.21.15.106:0/1616179595 wait complete. 2024-04-25T23:54:57.723 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient: get_monmap_and_config 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient: build_initial_monmap 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient: monmap: 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:57.872375+0000 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:57.872375+0000 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:57.851 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:57.852 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 1 Processor -- start 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 1 -- start start 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient: init 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient: _add_conns ranks=[0,8,3,5,2,1,6,7,4] 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient(hunting): picked mon.noname-a con 0x7f2e840a5090 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient(hunting): picked mon.noname-e con 0x7f2e84072710 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient(hunting): picked mon.noname-g con 0x7f2e84072b70 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e84137d60 con 0x7f2e840a5090 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8406cf60 con 0x7f2e84072b70 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e8406e240 con 0x7f2e84072710 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e8a489640 10 monclient(hunting): authenticate will time out at 953.399530s 2024-04-25T23:54:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e83fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2e840a5090 0x7f2e84137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55034/0 (socket says 172.21.15.106:55034) 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e83fff640 1 -- 172.21.15.106:0/1511324827 learned_addr learned my addr 172.21.15.106:0/1511324827 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.868+0000 7f2e837fe640 1 --1- 172.21.15.106:0/1511324827 >> v1:172.21.15.106:6793/0 conn(0x7f2e84072710 0x7f2e8413c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42234/0 (socket says 172.21.15.106:42234) 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467989525 0 0) 0x7f2e8406e240 con 0x7f2e84072710 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): my global_id is 4265 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e6c003530 con 0x7f2e84072710 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3807230969 0 0) 0x7f2e84137d60 con 0x7f2e840a5090 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient(hunting): my global_id is 4257 2024-04-25T23:54:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e8406e240 con 0x7f2e840a5090 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2780786159 0 0) 0x7f2e6c003530 con 0x7f2e84072710 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 >> v1:172.21.15.171:6790/0 conn(0x7f2e84072b70 legacy=0x7f2e841400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 >> v1:172.21.15.106:6789/0 conn(0x7f2e840a5090 legacy=0x7f2e84137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 monclient: found mon.noname-e 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e84070560 con 0x7f2e84072710 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: _finish_auth 0 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e780017c0 con 0x7f2e84072710 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 5 monclient: authenticate success, global_id 4265 2024-04-25T23:54:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: dump: 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e780019f0 con 0x7f2e84072710 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 1 -- 172.21.15.106:0/1511324827 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e78004b30 con 0x7f2e84072710 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e82ffd640 10 monclient: dump: 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 4 set_mon_vals no callback set 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient: shutdown 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- 172.21.15.106:0/1511324827 >> v1:172.21.15.106:6793/0 conn(0x7f2e84072710 legacy=0x7f2e8413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- 172.21.15.106:0/1511324827 shutdown_connections 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- 172.21.15.106:0/1511324827 >> 172.21.15.106:0/1511324827 conn(0x7f2e840a83a0 msgr2=0x7f2e840a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- 172.21.15.106:0/1511324827 shutdown_connections 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- 172.21.15.106:0/1511324827 wait complete. 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient: build_initial_monmap 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient: monmap: 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 Processor -- start 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- start start 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient: init 2024-04-25T23:54:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient: _add_conns ranks=[5,1,7,0,6,8,4,3,2] 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient(hunting): picked mon.noname-h con 0x7f2e84072710 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient(hunting): picked mon.noname-f con 0x7f2e84072b70 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient(hunting): picked mon.noname-i con 0x7f2e840a5090 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e84138650 con 0x7f2e84072b70 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e841398a0 con 0x7f2e84072710 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e84141540 con 0x7f2e840a5090 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e8a489640 10 monclient(hunting): authenticate will time out at 953.402834s 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e837fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2e84072b70 0x7f2e84140e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:41916/0 (socket says 172.21.15.106:41916) 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e83fff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f2e84072710 0x7f2e841cc230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:58820/0 (socket says 172.21.15.106:58820) 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e837fe640 1 -- 172.21.15.106:0/3123457529 learned_addr learned my addr 172.21.15.106:0/3123457529 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e88a26640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f2e840a5090 0x7f2e841d4310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:49276/0 (socket says 172.21.15.106:49276) 2024-04-25T23:54:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812940165 0 0) 0x7f2e841398a0 con 0x7f2e84072710 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): my global_id is 4271 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e70003530 con 0x7f2e84072710 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1251701154 0 0) 0x7f2e84141540 con 0x7f2e840a5090 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): my global_id is 4219 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e841398a0 con 0x7f2e840a5090 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1490571625 0 0) 0x7f2e84138650 con 0x7f2e84072b70 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 10 monclient(hunting): my global_id is 4177 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.872+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e84141540 con 0x7f2e84072b70 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 592181769 0 0) 0x7f2e70003530 con 0x7f2e84072710 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e84138650 con 0x7f2e84072710 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e74001940 con 0x7f2e84072710 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.870 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 707767623 0 0) 0x7f2e841398a0 con 0x7f2e840a5090 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e70003530 con 0x7f2e840a5090 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1198183632 0 0) 0x7f2e84141540 con 0x7f2e84072b70 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e841398a0 con 0x7f2e84072b70 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e7c001d60 con 0x7f2e840a5090 2024-04-25T23:54:57.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:57.872 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e78001440 con 0x7f2e84072b70 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 952627040 0 0) 0x7f2e84138650 con 0x7f2e84072710 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 >> v1:172.21.15.171:6792/0 conn(0x7f2e840a5090 legacy=0x7f2e841d4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 >> v1:172.21.15.171:6789/0 conn(0x7f2e84072b70 legacy=0x7f2e84140e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 monclient: found mon.h 2024-04-25T23:54:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e84135a40 con 0x7f2e84072710 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: _finish_auth 0 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 5 monclient: authenticate success, global_id 4271 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 10 monclient: _renew_subs 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e841d5a30 con 0x7f2e84072710 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 10 monclient: _renew_subs 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e841d5dd0 con 0x7f2e84072710 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e74004aa0 con 0x7f2e84072710 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e74001d50 con 0x7f2e84072710 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e827fc640 4 set_mon_vals no callback set 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 10 monclient: dump: 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:57.876 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e64005090 con 0x7f2e84072710 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f2e7400fb60 con 0x7f2e84072710 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(13..13 src has 1..13) ==== 3484+0+0 (unknown 534872454 0 0) 0x7f2e74044220 con 0x7f2e84072710 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.876+0000 7f2e837fe640 10 monclient: get_auth_request con 0x7f2e70038120 auth_method 0 2024-04-25T23:54:57.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.888+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2e74015640 con 0x7f2e84072710 2024-04-25T23:54:57.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.888+0000 7f2e80ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:57.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:57.888+0000 7f2e80ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.052+0000 7f2e8a489640 10 start_mon_command cmd=[{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-25T23:54:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.052+0000 7f2e8a489640 10 monclient: _send_command 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-25T23:54:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.052+0000 7f2e8a489640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.052+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) -- 0x7f2e64005380 con 0x7f2e84072710 2024-04-25T23:54:58.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.716+0000 7f2e80ff9640 1 -- 172.21.15.106:0/3123457529 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) ==== 173+0+0 (unknown 3289125425 0 0) 0x7f2e74014f40 con 0x7f2e84072710 2024-04-25T23:54:58.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.716+0000 7f2e80ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}] 2024-04-25T23:54:58.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.716+0000 7f2e80ff9640 10 monclient: _finish_command 2 = system:0 enabled application 'rbd' on pool 'rbd' 2024-04-25T23:54:58.700 INFO:teuthology.orchestra.run.smithi106.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 >> v1:172.21.15.171:6812/722422047 conn(0x7f2e70038120 legacy=0x7f2e7003a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 10 monclient: shutdown 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 >> v1:172.21.15.171:6791/0 conn(0x7f2e84072710 legacy=0x7f2e841cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 shutdown_connections 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 >> 172.21.15.106:0/3123457529 conn(0x7f2e840a83a0 msgr2=0x7f2e840a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 shutdown_connections 2024-04-25T23:54:58.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.724+0000 7f2e8a489640 1 -- 172.21.15.106:0/3123457529 wait complete. 2024-04-25T23:54:58.729 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T23:54:58.730 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T23:54:58.730 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T23:54:58.730 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T23:54:58.731 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.868+0000 7f956fd06640 10 monclient: get_monmap_and_config 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.868+0000 7f956fd06640 10 monclient: build_initial_monmap 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.868+0000 7f956fd06640 10 monclient: monmap: 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:58.874076+0000 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:58.874076+0000 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:58.853 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:58.854 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:58.854 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:58.854 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:58.854 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:58.854 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:58.854 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 Processor -- start 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- start start 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient: init 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient: _add_conns ranks=[3,1,4,2,7,6,0,5,8] 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient(hunting): picked mon.noname-g con 0x7f9568134970 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient(hunting): picked mon.noname-f con 0x7f95680a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:58.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient(hunting): picked mon.noname-c con 0x7f956813e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f956806dd40 con 0x7f95680a4820 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95680a2b10 con 0x7f9568134970 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95680a2df0 con 0x7f956813e200 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient(hunting): authenticate will time out at 954.401365s 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956e2a3640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f956813e200 0x7f95681405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48536/0 (socket says 172.21.15.106:48536) 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956e2a3640 1 -- 172.21.15.106:0/1556420929 learned_addr learned my addr 172.21.15.106:0/1556420929 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749156103 0 0) 0x7f95680a2df0 con 0x7f956813e200 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient(hunting): _negotiate 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient(hunting): my global_id is 4243 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9554003530 con 0x7f956813e200 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2249893467 0 0) 0x7f9554003530 con 0x7f956813e200 2024-04-25T23:54:58.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 >> v1:172.21.15.171:6790/0 conn(0x7f9568134970 legacy=0x7f9568134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 >> v1:172.21.15.171:6789/0 conn(0x7f95680a4820 legacy=0x7f956813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: _finish_hunting 0 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 monclient: found mon.noname-c 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95680a30d0 con 0x7f956813e200 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: _finish_auth 0 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: _check_auth_tickets 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 5 monclient: authenticate success, global_id 4243 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9560001b40 con 0x7f956813e200 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:58.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: dump: 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:58.863 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9560001e30 con 0x7f956813e200 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 1 -- 172.21.15.106:0/1556420929 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9560004f70 con 0x7f956813e200 2024-04-25T23:54:58.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956caa0640 10 monclient: dump: 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:58.865 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 4 set_mon_vals no callback set 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient: shutdown 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- 172.21.15.106:0/1556420929 >> v1:172.21.15.106:6791/0 conn(0x7f956813e200 legacy=0x7f95681405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- 172.21.15.106:0/1556420929 shutdown_connections 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- 172.21.15.106:0/1556420929 >> 172.21.15.106:0/1556420929 conn(0x7f95680a9e20 msgr2=0x7f95680aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- 172.21.15.106:0/1556420929 shutdown_connections 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 1 -- 172.21.15.106:0/1556420929 wait complete. 2024-04-25T23:54:58.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient: build_initial_monmap 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.872+0000 7f956fd06640 10 monclient: monmap: 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:58.867 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 Processor -- start 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 -- start start 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: init 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _add_conns ranks=[5,7,4,0,6,2,1,8,3] 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient(hunting): picked mon.noname-h con 0x7f95680a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient(hunting): picked mon.noname-i con 0x7f9568134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient(hunting): picked mon.noname-c con 0x7f956813e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9568137350 con 0x7f956813e200 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95680a1a40 con 0x7f95680a4820 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95680a1e00 con 0x7f9568134970 2024-04-25T23:54:58.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient(hunting): authenticate will time out at 954.404829s 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956e2a3640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f956813e200 0x7f95681d4a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48540/0 (socket says 172.21.15.106:48540) 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956e2a3640 1 -- 172.21.15.106:0/3710186100 learned_addr learned my addr 172.21.15.106:0/3710186100 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479604888 0 0) 0x7f9568137350 con 0x7f956813e200 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): my global_id is 4252 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f954c003530 con 0x7f956813e200 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3755001152 0 0) 0x7f954c003530 con 0x7f956813e200 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9568137350 con 0x7f956813e200 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9560001b00 con 0x7f956813e200 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:54:58.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): dump: 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:58.870 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4251488283 0 0) 0x7f95680a1e00 con 0x7f9568134970 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient(hunting): my global_id is 4228 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f954c003530 con 0x7f9568134970 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1107146830 0 0) 0x7f9568137350 con 0x7f956813e200 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 >> v1:172.21.15.171:6792/0 conn(0x7f9568134970 legacy=0x7f9568135ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 >> v1:172.21.15.171:6791/0 conn(0x7f95680a4820 legacy=0x7f95681358e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 monclient: found mon.c 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:58.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9568136700 con 0x7f956813e200 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 5 monclient: authenticate success, global_id 4252 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _renew_subs 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9568139700 con 0x7f956813e200 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _renew_subs 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f956813d5c0 con 0x7f956813e200 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9560001fe0 con 0x7f956813e200 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f95600057d0 con 0x7f956813e200 2024-04-25T23:54:58.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955ffff640 4 set_mon_vals no callback set 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 10 monclient: dump: 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:58.873 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f9560010540 con 0x7f956813e200 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(14..14 src has 1..14) ==== 3506+0+0 (unknown 1253147949 0 0) 0x7f95600447e0 con 0x7f956813e200 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956daa2640 10 monclient: get_auth_request con 0x7f954c0377d0 auth_method 0 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:58.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.876+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9550005090 con 0x7f956813e200 2024-04-25T23:54:58.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.884+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9560015cb0 con 0x7f956813e200 2024-04-25T23:54:58.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.884+0000 7f955e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:58.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:58.884+0000 7f955e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:59.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.088+0000 7f956fd06640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-04-25T23:54:59.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.088+0000 7f956fd06640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-04-25T23:54:59.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.088+0000 7f956fd06640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:54:59.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.088+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f9550005380 con 0x7f956813e200 2024-04-25T23:54:59.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.092+0000 7f955e7fc640 1 -- 172.21.15.106:0/3710186100 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) ==== 74+0+84024 (unknown 3797009233 0 3913963824) 0x7f95600155b0 con 0x7f956813e200 2024-04-25T23:54:59.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.092+0000 7f955e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-04-25T23:54:59.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.092+0000 7f955e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:59.077 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:59.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 >> v1:172.21.15.171:6812/722422047 conn(0x7f954c0377d0 legacy=0x7f954c039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 10 monclient: shutdown 2024-04-25T23:54:59.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 >> v1:172.21.15.106:6791/0 conn(0x7f956813e200 legacy=0x7f95681d4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 shutdown_connections 2024-04-25T23:54:59.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 >> 172.21.15.106:0/3710186100 conn(0x7f95680a9e20 msgr2=0x7f9568067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 shutdown_connections 2024-04-25T23:54:59.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.096+0000 7f956fd06640 1 -- 172.21.15.106:0/3710186100 wait complete. 2024-04-25T23:54:59.094 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":4,"flags":0,"active_gid":4118,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6812","nonce":722422047}]},"active_addr":"172.21.15.171:6812/722422047","active_change":"2024-04-25T23:54:51.574259+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":3288151457}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":2947097909}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.171:0","nonce":2401805510}]}]} 2024-04-25T23:54:59.099 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T23:54:59.099 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T23:54:59.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:54:59.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient: monmap: 2024-04-25T23:54:59.214 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.214 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.235687+0000 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.235687+0000 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.215 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 1 Processor -- start 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 1 -- start start 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient: init 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient: _add_conns ranks=[8,0,3,4,6,2,5,1,7] 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient(hunting): picked mon.noname-e con 0x7f0330072500 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient(hunting): picked mon.noname-a con 0x7f0330137730 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient(hunting): picked mon.noname-g con 0x7f0330137b70 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033009fe40 con 0x7f0330137730 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03300a0120 con 0x7f0330137b70 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03300a0400 con 0x7f0330072500 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient(hunting): authenticate will time out at 954.762634s 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032e59c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0330072500 0x7f03300728e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42246/0 (socket says 172.21.15.106:42246) 2024-04-25T23:54:59.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032e59c640 1 -- 172.21.15.106:0/2785939200 learned_addr learned my addr 172.21.15.106:0/2785939200 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032dd9b640 1 --1- 172.21.15.106:0/2785939200 >> v1:172.21.15.106:6789/0 conn(0x7f0330137730 0x7f033013ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55048/0 (socket says 172.21.15.106:55048) 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674077119 0 0) 0x7f03300a0400 con 0x7f0330072500 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): my global_id is 4283 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0318003530 con 0x7f0330072500 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1656797653 0 0) 0x7f033009fe40 con 0x7f0330137730 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient(hunting): my global_id is 4275 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f03300a0400 con 0x7f0330137730 2024-04-25T23:54:59.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 332796328 0 0) 0x7f0318003530 con 0x7f0330072500 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 >> v1:172.21.15.171:6790/0 conn(0x7f0330137b70 legacy=0x7f0330140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 >> v1:172.21.15.106:6789/0 conn(0x7f0330137730 legacy=0x7f033013ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 monclient: found mon.noname-e 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03300a4220 con 0x7f0330072500 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f03200016f0 con 0x7f0330072500 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: dump: 2024-04-25T23:54:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.222 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 5 monclient: authenticate success, global_id 4283 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03200019d0 con 0x7f0330072500 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 1 -- 172.21.15.106:0/2785939200 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0320004bf0 con 0x7f0330072500 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f032d59a640 10 monclient: dump: 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.223 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.232+0000 7f0334ec9640 4 set_mon_vals no callback set 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: shutdown 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- 172.21.15.106:0/2785939200 >> v1:172.21.15.106:6793/0 conn(0x7f0330072500 legacy=0x7f03300728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- 172.21.15.106:0/2785939200 shutdown_connections 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- 172.21.15.106:0/2785939200 >> 172.21.15.106:0/2785939200 conn(0x7f03300a73f0 msgr2=0x7f03300a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- 172.21.15.106:0/2785939200 shutdown_connections 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- 172.21.15.106:0/2785939200 wait complete. 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: monmap: 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.225 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 Processor -- start 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- start start 2024-04-25T23:54:59.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: init 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: _add_conns ranks=[8,1,3,6,7,2,4,0,5] 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient(hunting): picked mon.noname-e con 0x7f0330072500 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient(hunting): picked mon.noname-f con 0x7f0330137730 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient(hunting): picked mon.noname-g con 0x7f0330137b70 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0330139550 con 0x7f0330137730 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0330141590 con 0x7f0330137b70 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033009f3c0 con 0x7f0330072500 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient(hunting): authenticate will time out at 954.766478s 2024-04-25T23:54:59.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f032e59c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0330072500 0x7f03301328e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42256/0 (socket says 172.21.15.106:42256) 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f032e59c640 1 -- 172.21.15.106:0/2691438261 learned_addr learned my addr 172.21.15.106:0/2691438261 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814842416 0 0) 0x7f033009f3c0 con 0x7f0330072500 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): my global_id is 4292 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0310003530 con 0x7f0330072500 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1144695920 0 0) 0x7f0310003530 con 0x7f0330072500 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f033009f3c0 con 0x7f0330072500 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0320004b30 con 0x7f0330072500 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): dump: 2024-04-25T23:54:59.231 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2113798394 0 0) 0x7f0330141590 con 0x7f0330137b70 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): my global_id is 4233 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0310003530 con 0x7f0330137b70 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116824510 0 0) 0x7f0330139550 con 0x7f0330137730 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient(hunting): my global_id is 4204 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0330141590 con 0x7f0330137730 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3889332472 0 0) 0x7f033009f3c0 con 0x7f0330072500 2024-04-25T23:54:59.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 >> v1:172.21.15.171:6790/0 conn(0x7f0330137b70 legacy=0x7f0330133700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 >> v1:172.21.15.171:6789/0 conn(0x7f0330137730 legacy=0x7f0330132ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 monclient: found mon.e 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033009ee90 con 0x7f0330072500 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 5 monclient: authenticate success, global_id 4292 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: _renew_subs 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0330135310 con 0x7f0330072500 2024-04-25T23:54:59.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: _renew_subs 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f03301d5d50 con 0x7f0330072500 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f03200019d0 con 0x7f0330072500 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0320005280 con 0x7f0330072500 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f032cd99640 4 set_mon_vals no callback set 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.236+0000 7f031effd640 10 monclient: dump: 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.235 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.240+0000 7f0334ec9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.240+0000 7f0334ec9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.240+0000 7f0334ec9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.240+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0314005090 con 0x7f0330072500 2024-04-25T23:54:59.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.240+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f032000fff0 con 0x7f0330072500 2024-04-25T23:54:59.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.240+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(14..14 src has 1..14) ==== 3506+0+0 (unknown 1253147949 0 0) 0x7f03200444e0 con 0x7f0330072500 2024-04-25T23:54:59.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.240+0000 7f032dd9b640 10 monclient: get_auth_request con 0x7f0310037a20 auth_method 0 2024-04-25T23:54:59.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.244+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f03200159a0 con 0x7f0330072500 2024-04-25T23:54:59.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.244+0000 7f031effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:59.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.244+0000 7f031effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:59.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.408+0000 7f0334ec9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:59.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.408+0000 7f0334ec9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:59.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.408+0000 7f0334ec9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.408+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0314005380 con 0x7f0330072500 2024-04-25T23:54:59.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f031effd640 1 -- 172.21.15.106:0/2691438261 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10835 (unknown 92231148 0 3968109742) 0x7f03200152a0 con 0x7f0330072500 2024-04-25T23:54:59.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f031effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:59.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f031effd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:59.398 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":14,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","created":"2024-04-25T23:54:46.746675+0000","modified":"2024-04-25T23:54:58.707761+0000","last_up_change":"2024-04-25T23:54:55.661326+0000","last_in_change":"2024-04-25T23:54:48.471734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25T23:54:56.831664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-25T23:54:57.662371+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8be68ed-f989-43cd-bb66-fdf514ef84a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":1458966339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":1458966339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":1458966339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":1458966339}]},"public_addr":"172.21.15.106:6808/1458966339","cluster_addr":"172.21.15.106:6809/1458966339","heartbeat_back_addr":"172.21.15.106:6811/1458966339","heartbeat_front_addr":"172.21.15.106:6810/1458966339","state":["exists","up"]},{"osd":1,"uuid":"0b4cb186-016f-4325-86fc-a32d67508e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":858572474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":858572474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":858572474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":858572474}]},"public_addr":"172.21.15.106:6800/858572474","cluster_addr":"172.21.15.106:6802/858572474","heartbeat_back_addr":"172.21.15.106:6807/858572474","heartbeat_front_addr":"172.21.15.106:6804/858572474","state":["exists","up"]},{"osd":2,"uuid":"5305c964-9533-4f1d-a1a2-6ab03decd54a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":2648645857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":2648645857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":2648645857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":2648645857}]},"public_addr":"172.21.15.106:6801/2648645857","cluster_addr":"172.21.15.106:6803/2648645857","heartbeat_back_addr":"172.21.15.106:6806/2648645857","heartbeat_front_addr":"172.21.15.106:6805/2648645857","state":["exists","up"]},{"osd":3,"uuid":"acff288b-4172-4f63-9d56-7556ce456b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":2707846597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":2707846597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":2707846597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":2707846597}]},"public_addr":"172.21.15.171:6808/2707846597","cluster_addr":"172.21.15.171:6809/2707846597","heartbeat_back_addr":"172.21.15.171:6811/2707846597","heartbeat_front_addr":"172.21.15.171:6810/2707846597","state":["exists","up"]},{"osd":4,"uuid":"7eebb63b-821b-4ad5-9ec1-dc19e2b3602c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":3736794137}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":3736794137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":3736794137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":3736794137}]},"public_addr":"172.21.15.171:6804/3736794137","cluster_addr":"172.21.15.171:6805/3736794137","heartbeat_back_addr":"172.21.15.171:6807/3736794137","heartbeat_front_addr":"172.21.15.171:6806/3736794137","state":["exists","up"]},{"osd":5,"uuid":"b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":721452434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":721452434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":721452434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":721452434}]},"public_addr":"172.21.15.171:6800/721452434","cluster_addr":"172.21.15.171:6801/721452434","heartbeat_back_addr":"172.21.15.171:6803/721452434","heartbeat_front_addr":"172.21.15.171:6802/721452434","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.949301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.787874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.829667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.994707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:54.048968+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.982217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:54:59.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 >> v1:172.21.15.171:6812/722422047 conn(0x7f0310037a20 legacy=0x7f0310039ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 10 monclient: shutdown 2024-04-25T23:54:59.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 >> v1:172.21.15.106:6793/0 conn(0x7f0330072500 legacy=0x7f03301328e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 shutdown_connections 2024-04-25T23:54:59.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 >> 172.21.15.106:0/2691438261 conn(0x7f03300a73f0 msgr2=0x7f0330136f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 shutdown_connections 2024-04-25T23:54:59.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.416+0000 7f0334ec9640 1 -- 172.21.15.106:0/2691438261 wait complete. 2024-04-25T23:54:59.416 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T23:54:59.416 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:54:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient: monmap: 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.548834+0000 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.548834+0000 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.529 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 1 Processor -- start 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 1 -- start start 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient: init 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient: _add_conns ranks=[0,5,6,2,1,7,3,8,4] 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient(hunting): picked mon.noname-a con 0x7fda200a4f60 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient(hunting): picked mon.noname-h con 0x7fda200a4680 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient(hunting): picked mon.noname-d con 0x7fda2013e060 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda200a5a50 con 0x7fda200a4f60 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda200a2610 con 0x7fda200a4680 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda200a3e30 con 0x7fda2013e060 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.544+0000 7fda2628c640 10 monclient(hunting): authenticate will time out at 955.075977s 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fda200a4f60 0x7fda200a5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55064/0 (socket says 172.21.15.106:55064) 2024-04-25T23:54:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1ffff640 1 -- 172.21.15.106:0/3030505089 learned_addr learned my addr 172.21.15.106:0/3030505089 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425782185 0 0) 0x7fda14001120 con 0x7fda200a4f60 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): my global_id is 4284 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda08003530 con 0x7fda200a4f60 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2143600172 0 0) 0x7fda200a3e30 con 0x7fda2013e060 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): my global_id is 4236 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda14001120 con 0x7fda2013e060 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288032402 0 0) 0x7fda200a2610 con 0x7fda200a4680 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient(hunting): my global_id is 4289 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda200a3e30 con 0x7fda200a4680 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3422527412 0 0) 0x7fda14001120 con 0x7fda2013e060 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 >> v1:172.21.15.171:6791/0 conn(0x7fda200a4680 legacy=0x7fda2013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 >> v1:172.21.15.106:6789/0 conn(0x7fda200a4f60 legacy=0x7fda200a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 monclient: found mon.noname-d 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda200a1310 con 0x7fda2013e060 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda18001a50 con 0x7fda2013e060 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: dump: 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 5 monclient: authenticate success, global_id 4236 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda18001cb0 con 0x7fda2013e060 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 1 -- 172.21.15.106:0/3030505089 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda18003ce0 con 0x7fda2013e060 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 4 set_mon_vals no callback set 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1effd640 10 monclient: dump: 2024-04-25T23:54:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient: shutdown 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- 172.21.15.106:0/3030505089 >> v1:172.21.15.106:6792/0 conn(0x7fda2013e060 legacy=0x7fda20140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- 172.21.15.106:0/3030505089 shutdown_connections 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- 172.21.15.106:0/3030505089 >> 172.21.15.106:0/3030505089 conn(0x7fda200a9c80 msgr2=0x7fda200aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- 172.21.15.106:0/3030505089 shutdown_connections 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- 172.21.15.106:0/3030505089 wait complete. 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient: monmap: 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 Processor -- start 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- start start 2024-04-25T23:54:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient: init 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient: _add_conns ranks=[1,0,3,6,8,7,4,2,5] 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient(hunting): picked mon.noname-f con 0x7fda200a4680 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient(hunting): picked mon.noname-a con 0x7fda200a4f60 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient(hunting): picked mon.noname-g con 0x7fda2013e060 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda200a40e0 con 0x7fda200a4f60 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda201cd0e0 con 0x7fda200a4680 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda2009d270 con 0x7fda2013e060 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda2628c640 10 monclient(hunting): authenticate will time out at 955.079115s 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fda200a4f60 0x7fda201cc9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55072/0 (socket says 172.21.15.106:55072) 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1f7fe640 1 -- 172.21.15.106:0/354574373 learned_addr learned my addr 172.21.15.106:0/354574373 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1514191986 0 0) 0x7fda200a3e30 con 0x7fda200a4f60 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): my global_id is 4293 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda0c003530 con 0x7fda200a4f60 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146252020 0 0) 0x7fda2009d270 con 0x7fda2013e060 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): my global_id is 4242 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda200a3e30 con 0x7fda2013e060 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2411536484 0 0) 0x7fda201cd0e0 con 0x7fda200a4680 2024-04-25T23:54:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): my global_id is 4213 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda2009d270 con 0x7fda200a4680 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 278998316 0 0) 0x7fda0c003530 con 0x7fda200a4f60 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda201cd0e0 con 0x7fda200a4f60 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda10001b40 con 0x7fda200a4f60 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): dump: 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.547 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.548 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2991602323 0 0) 0x7fda200a3e30 con 0x7fda2013e060 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda0c003530 con 0x7fda2013e060 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda18001610 con 0x7fda2013e060 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.548+0000 7fda1cff9640 10 monclient(hunting): dump: 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 196362572 0 0) 0x7fda201cd0e0 con 0x7fda200a4f60 2024-04-25T23:54:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 >> v1:172.21.15.171:6790/0 conn(0x7fda2013e060 legacy=0x7fda201d4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 >> v1:172.21.15.171:6789/0 conn(0x7fda200a4680 legacy=0x7fda201cc2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 monclient: found mon.a 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda2009f560 con 0x7fda200a4f60 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 5 monclient: authenticate success, global_id 4293 2024-04-25T23:54:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 10 monclient: _renew_subs 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda2009ecc0 con 0x7fda200a4f60 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 10 monclient: _renew_subs 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fda200a04f0 con 0x7fda200a4f60 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda100038d0 con 0x7fda200a4f60 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1e7fc640 4 set_mon_vals no callback set 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda10003dc0 con 0x7fda200a4f60 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 10 monclient: dump: 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.552 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.553 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7fda10003fe0 con 0x7fda200a4f60 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda00005090 con 0x7fda200a4f60 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(14..14 src has 1..14) ==== 3506+0+0 (unknown 1253147949 0 0) 0x7fda100444c0 con 0x7fda200a4f60 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.552+0000 7fda1ffff640 10 monclient: get_auth_request con 0x7fda0c037f30 auth_method 0 2024-04-25T23:54:59.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.556+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fda200a40e0 con 0x7fda200a4f60 2024-04-25T23:54:59.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.556+0000 7fda1cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:54:59.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.556+0000 7fda1cff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:54:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.720+0000 7fda2628c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.720+0000 7fda2628c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.720+0000 7fda2628c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:54:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.720+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fda00005380 con 0x7fda200a4f60 2024-04-25T23:54:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.728+0000 7fda1cff9640 1 -- 172.21.15.106:0/354574373 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+10835 (unknown 92231148 0 3968109742) 0x7fda10015860 con 0x7fda200a4f60 2024-04-25T23:54:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.728+0000 7fda1cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:54:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.728+0000 7fda1cff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:54:59.713 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:54:59.713 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":14,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","created":"2024-04-25T23:54:46.746675+0000","modified":"2024-04-25T23:54:58.707761+0000","last_up_change":"2024-04-25T23:54:55.661326+0000","last_in_change":"2024-04-25T23:54:48.471734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25T23:54:56.831664+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-25T23:54:57.662371+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8be68ed-f989-43cd-bb66-fdf514ef84a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":1458966339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":1458966339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":1458966339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":1458966339}]},"public_addr":"172.21.15.106:6808/1458966339","cluster_addr":"172.21.15.106:6809/1458966339","heartbeat_back_addr":"172.21.15.106:6811/1458966339","heartbeat_front_addr":"172.21.15.106:6810/1458966339","state":["exists","up"]},{"osd":1,"uuid":"0b4cb186-016f-4325-86fc-a32d67508e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":858572474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":858572474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":858572474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":858572474}]},"public_addr":"172.21.15.106:6800/858572474","cluster_addr":"172.21.15.106:6802/858572474","heartbeat_back_addr":"172.21.15.106:6807/858572474","heartbeat_front_addr":"172.21.15.106:6804/858572474","state":["exists","up"]},{"osd":2,"uuid":"5305c964-9533-4f1d-a1a2-6ab03decd54a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":2648645857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":2648645857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":2648645857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":2648645857}]},"public_addr":"172.21.15.106:6801/2648645857","cluster_addr":"172.21.15.106:6803/2648645857","heartbeat_back_addr":"172.21.15.106:6806/2648645857","heartbeat_front_addr":"172.21.15.106:6805/2648645857","state":["exists","up"]},{"osd":3,"uuid":"acff288b-4172-4f63-9d56-7556ce456b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":2707846597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":2707846597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":2707846597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":2707846597}]},"public_addr":"172.21.15.171:6808/2707846597","cluster_addr":"172.21.15.171:6809/2707846597","heartbeat_back_addr":"172.21.15.171:6811/2707846597","heartbeat_front_addr":"172.21.15.171:6810/2707846597","state":["exists","up"]},{"osd":4,"uuid":"7eebb63b-821b-4ad5-9ec1-dc19e2b3602c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":3736794137}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":3736794137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":3736794137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":3736794137}]},"public_addr":"172.21.15.171:6804/3736794137","cluster_addr":"172.21.15.171:6805/3736794137","heartbeat_back_addr":"172.21.15.171:6807/3736794137","heartbeat_front_addr":"172.21.15.171:6806/3736794137","state":["exists","up"]},{"osd":5,"uuid":"b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":721452434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":721452434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":721452434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":721452434}]},"public_addr":"172.21.15.171:6800/721452434","cluster_addr":"172.21.15.171:6801/721452434","heartbeat_back_addr":"172.21.15.171:6803/721452434","heartbeat_front_addr":"172.21.15.171:6802/721452434","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.949301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.787874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.829667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.994707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:54.048968+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.982217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 >> v1:172.21.15.171:6812/722422047 conn(0x7fda0c037f30 legacy=0x7fda0c03a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 10 monclient: shutdown 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 >> v1:172.21.15.106:6789/0 conn(0x7fda200a4f60 legacy=0x7fda201cc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 shutdown_connections 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 >> 172.21.15.106:0/354574373 conn(0x7fda200a9c80 msgr2=0x7fda20136630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 shutdown_connections 2024-04-25T23:54:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.732+0000 7fda2628c640 1 -- 172.21.15.106:0/354574373 wait complete. 2024-04-25T23:54:59.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T23:54:59.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T23:54:59.736 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T23:54:59.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T23:54:59.737 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-25T23:54:59.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-25T23:54:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient: monmap: 2024-04-25T23:54:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.879404+0000 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.879404+0000 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.859 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 1 Processor -- start 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 1 -- start start 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient: init 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient: _add_conns ranks=[2,5,3,7,1,4,6,8,0] 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient(hunting): picked mon.noname-b con 0x7fa4b8134970 addr v1:172.21.15.106:6790/0 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient(hunting): picked mon.noname-h con 0x7fa4b80a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient(hunting): picked mon.noname-g con 0x7fa4b813e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b806dd40 con 0x7fa4b8134970 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b80a2b10 con 0x7fa4b813e200 2024-04-25T23:54:59.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b80a2df0 con 0x7fa4b80a4820 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bf564640 10 monclient(hunting): authenticate will time out at 955.406488s 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bd300640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fa4b8134970 0x7fa4b8134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49018/0 (socket says 172.21.15.106:49018) 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4bd300640 1 -- 172.21.15.106:0/761351550 learned_addr learned my addr 172.21.15.106:0/761351550 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120377903 0 0) 0x7fa4b80a2df0 con 0x7fa4b80a4820 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): my global_id is 4298 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4a4003530 con 0x7fa4b80a4820 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1369050691 0 0) 0x7fa4b80a2b10 con 0x7fa4b813e200 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient(hunting): my global_id is 4251 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b80a2df0 con 0x7fa4b813e200 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1315290681 0 0) 0x7fa4a4003530 con 0x7fa4b80a4820 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 >> v1:172.21.15.171:6790/0 conn(0x7fa4b813e200 legacy=0x7fa4b81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 >> v1:172.21.15.106:6790/0 conn(0x7fa4b8134970 legacy=0x7fa4b8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 monclient: found mon.noname-h 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b80a30d0 con 0x7fa4b80a4820 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4a80017c0 con 0x7fa4b80a4820 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.876+0000 7fa4affff640 10 monclient: dump: 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.864 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4a8001a70 con 0x7fa4b80a4820 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4affff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4affff640 1 -- 172.21.15.106:0/761351550 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4a8003960 con 0x7fa4b80a4820 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4affff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4affff640 10 monclient: dump: 2024-04-25T23:54:59.865 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.866 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.867 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.867 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.867 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.867 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 5 monclient: authenticate success, global_id 4298 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 4 set_mon_vals no callback set 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient: shutdown 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- 172.21.15.106:0/761351550 >> v1:172.21.15.171:6791/0 conn(0x7fa4b80a4820 legacy=0x7fa4b813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- 172.21.15.106:0/761351550 shutdown_connections 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- 172.21.15.106:0/761351550 >> 172.21.15.106:0/761351550 conn(0x7fa4b80a9e20 msgr2=0x7fa4b80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- 172.21.15.106:0/761351550 shutdown_connections 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- 172.21.15.106:0/761351550 wait complete. 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient: monmap: 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.868 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 Processor -- start 2024-04-25T23:54:59.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- start start 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient: init 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient: _add_conns ranks=[5,4,2,1,0,8,7,6,3] 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient(hunting): picked mon.noname-h con 0x7fa4b80a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient(hunting): picked mon.noname-c con 0x7fa4b8134970 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient(hunting): picked mon.noname-b con 0x7fa4b813e200 addr v1:172.21.15.106:6790/0 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b806fc10 con 0x7fa4b813e200 2024-04-25T23:54:59.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b8129aa0 con 0x7fa4b8134970 2024-04-25T23:54:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4b80a1e00 con 0x7fa4b80a4820 2024-04-25T23:54:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bf564640 10 monclient(hunting): authenticate will time out at 955.410908s 2024-04-25T23:54:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bcaff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fa4b8134970 0x7fa4b8129390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48542/0 (socket says 172.21.15.106:48542) 2024-04-25T23:54:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4bcaff640 1 -- 172.21.15.106:0/3142651922 learned_addr learned my addr 172.21.15.106:0/3142651922 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fdd02d5b640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fdd02d5b640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1238214713 0 0) 0x7fa4b80a1e00 con 0x7fa4b80a4820 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): my global_id is 4307 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa49c003530 con 0x7fa4b80a4820 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fdd02d5b640 10 monclient: monmap: 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.885913+0000 2024-04-25T23:54:59.872 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.885913+0000 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.873 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 107890548 0 0) 0x7fa4b8129aa0 con 0x7fa4b8134970 2024-04-25T23:54:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 10 monclient(hunting): my global_id is 4261 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.880+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b80a1e00 con 0x7fa4b8134970 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2217180266 0 0) 0x7fa49c003530 con 0x7fa4b80a4820 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4b8129aa0 con 0x7fa4b80a4820 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4b40018d0 con 0x7fa4b80a4820 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient(hunting): dump: 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.876 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3149705360 0 0) 0x7fa4b80a1e00 con 0x7fa4b8134970 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa49c003530 con 0x7fa4b8134970 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4a8001780 con 0x7fa4b8134970 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient(hunting): dump: 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1678076646 0 0) 0x7fa4b8129aa0 con 0x7fa4b80a4820 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 >> v1:172.21.15.106:6791/0 conn(0x7fa4b8134970 legacy=0x7fa4b8129390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 >> v1:172.21.15.106:6790/0 conn(0x7fa4b813e200 legacy=0x7fa4b81d9420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 monclient: found mon.h 2024-04-25T23:54:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4b812a8c0 con 0x7fa4b80a4820 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 5 monclient: authenticate success, global_id 4307 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 10 monclient: _renew_subs 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4b806f930 con 0x7fa4b80a4820 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 10 monclient: _renew_subs 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4b806e530 con 0x7fa4b80a4820 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4b40047f0 con 0x7fa4b80a4820 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4b4004d60 con 0x7fa4b80a4820 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: dump: 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 1 Processor -- start 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 1 -- start start 2024-04-25T23:54:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient: init 2024-04-25T23:54:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:54:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.171:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa4b8067160 con 0x7fa4b80a4820 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient: _add_conns ranks=[8,1,0,7,6,4,2,5,3] 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient(hunting): picked mon.noname-e con 0x7fdcfc1346f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient(hunting): picked mon.noname-f con 0x7fdcfc072690 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient(hunting): picked mon.noname-a con 0x7fdcfc072a70 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd012f8640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdcfc072a70 0x7fdcfc13cca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55080/0 (socket says 172.21.15.106:55080) 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd012f8640 1 -- 172.21.15.106:0/4237758349 learned_addr learned my addr 172.21.15.106:0/4237758349 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0712c0 con 0x7fdcfc072a70 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc070430 con 0x7fdcfc072690 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0715a0 con 0x7fdcfc1346f0 2024-04-25T23:54:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 10 monclient(hunting): authenticate will time out at 955.414259s 2024-04-25T23:54:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7fa4b4004f00 con 0x7fa4b80a4820 2024-04-25T23:54:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fa4b40440d0 con 0x7fa4b80a4820 2024-04-25T23:54:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.106:6800/858572474 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa4b40056f0 con 0x7fa49c03e990 2024-04-25T23:54:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (unknown 2942983318 0 0) 0x7fa4b40114c0 con 0x7fa4b80a4820 2024-04-25T23:54:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4adffb640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-04-25T23:54:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550671112 0 0) 0x7fdcf40014a0 con 0x7fdcfc072a70 2024-04-25T23:54:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): my global_id is 4311 2024-04-25T23:54:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bcaff640 10 monclient: get_auth_request con 0x7fa49c037e50 auth_method 0 2024-04-25T23:54:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcec003530 con 0x7fdcfc072a70 2024-04-25T23:54:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fa4bdb01640 10 monclient: get_auth_request con 0x7fa49c03e990 auth_method 0 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1736219247 0 0) 0x7fdcfc070430 con 0x7fdcfc072690 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient(hunting): my global_id is 4231 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcf40014a0 con 0x7fdcfc072690 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3489464064 0 0) 0x7fdcec003530 con 0x7fdcfc072a70 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 >> v1:172.21.15.106:6793/0 conn(0x7fdcfc1346f0 legacy=0x7fdcfc134ad0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:54:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 >> v1:172.21.15.171:6789/0 conn(0x7fdcfc072690 legacy=0x7fdcfc139570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 monclient: found mon.noname-a 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc0a3fb0 con 0x7fdcfc072a70 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcf4001d10 con 0x7fdcfc072a70 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdcfb7fe640 10 monclient: dump: 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 5 monclient: authenticate success, global_id 4311 2024-04-25T23:54:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.884+0000 7fdd02d5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== osd.1 v1:172.21.15.106:6800/858572474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa4b40056f0 con 0x7fa49c03e990 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcf4001f70 con 0x7fdcfc072a70 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdcfb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdcfb7fe640 1 -- 172.21.15.106:0/4237758349 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcf4004f70 con 0x7fdcfc072a70 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 4 set_mon_vals no callback set 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdcfb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdcfb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:54:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdcfb7fe640 10 monclient: dump: 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 10 monclient: shutdown 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 >> v1:172.21.15.106:6789/0 conn(0x7fdcfc072a70 legacy=0x7fdcfc13cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 shutdown_connections 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 >> 172.21.15.106:0/4237758349 conn(0x7fdcfc0a71b0 msgr2=0x7fdcfc0a3570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 shutdown_connections 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fdd02d5b640 1 -- 172.21.15.106:0/4237758349 wait complete. 2024-04-25T23:54:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.888+0000 7fa4af7fe640 4 set_mon_vals no callback set 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient: monmap: 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.902 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 1 Processor -- start 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 1 -- start start 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient: init 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient: _add_conns ranks=[0,5,8,4,7,3,2,6,1] 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient(hunting): picked mon.noname-a con 0x7fdcfc072690 addr v1:172.21.15.106:6789/0 2024-04-25T23:54:59.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient(hunting): picked mon.noname-h con 0x7fdcfc072a70 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient(hunting): picked mon.noname-e con 0x7fdcfc09e270 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0a08b0 con 0x7fdcfc072690 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc11d160 con 0x7fdcfc072a70 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0a0dc0 con 0x7fdcfc09e270 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd02d5b640 10 monclient(hunting): authenticate will time out at 955.421281s 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd012f8640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fdcfc09e270 0x7fdcfc1d0cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42260/0 (socket says 172.21.15.106:42260) 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.892+0000 7fdd012f8640 1 -- 172.21.15.106:0/3465122060 learned_addr learned my addr 172.21.15.106:0/3465122060 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2900110012 0 0) 0x7fdcfc0a0dc0 con 0x7fdcfc09e270 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): my global_id is 4301 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce0003530 con 0x7fdcfc09e270 2024-04-25T23:54:59.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731056088 0 0) 0x7fdcfc0a08b0 con 0x7fdcfc072690 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): my global_id is 4320 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcfc0a0dc0 con 0x7fdcfc072690 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469916210 0 0) 0x7fdcfc11d160 con 0x7fdcfc072a70 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): my global_id is 4316 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcfc0a08b0 con 0x7fdcfc072a70 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3778258976 0 0) 0x7fdce0003530 con 0x7fdcfc09e270 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcfc11d160 con 0x7fdcfc09e270 2024-04-25T23:54:59.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 404727599 0 0) 0x7fdcfc0a0dc0 con 0x7fdcfc072690 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdce0003530 con 0x7fdcfc072690 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcf4004eb0 con 0x7fdcfc09e270 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): dump: 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.906 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdce8001810 con 0x7fdcfc072690 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient(hunting): dump: 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.907 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3643611604 0 0) 0x7fdcfc0a08b0 con 0x7fdcfc072a70 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcfc0a0dc0 con 0x7fdcfc072a70 2024-04-25T23:54:59.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1985683189 0 0) 0x7fdcfc11d160 con 0x7fdcfc09e270 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 >> v1:172.21.15.171:6791/0 conn(0x7fdcfc072a70 legacy=0x7fdcfc1cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 >> v1:172.21.15.106:6789/0 conn(0x7fdcfc072690 legacy=0x7fdcfc1c8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 monclient: found mon.e 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc11d440 con 0x7fdcfc09e270 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdcf97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdd02d5b640 5 monclient: authenticate success, global_id 4301 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdd02d5b640 10 monclient: _renew_subs 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdd02d5b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdd02d5b640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc11d720 con 0x7fdcfc09e270 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdd02d5b640 10 monclient: _renew_subs 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdd02d5b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.900+0000 7fdd02d5b640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdcfc1c8c80 con 0x7fdcfc09e270 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdd02d5b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdd02d5b640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6793/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fdcfc075c80 con 0x7fdcfc09e270 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcf4005300 con 0x7fdcfc09e270 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcf40057f0 con 0x7fdcfc09e270 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 10 monclient: dump: 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.910 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcfaffd640 4 set_mon_vals no callback set 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7fdcf4010560 con 0x7fdcfc09e270 2024-04-25T23:54:59.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fdcf40438f0 con 0x7fdcfc09e270 2024-04-25T23:54:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdd00af7640 10 monclient: get_auth_request con 0x7fdce00381d0 auth_method 0 2024-04-25T23:54:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6801/2648645857 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcf4001f70 con 0x7fdce003eea0 2024-04-25T23:54:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (unknown 2942983318 0 0) 0x7fdcf4043bb0 con 0x7fdcfc09e270 2024-04-25T23:54:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcf97fa640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-04-25T23:54:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.904+0000 7fdcfbfff640 10 monclient: get_auth_request con 0x7fdce003eea0 auth_method 0 2024-04-25T23:54:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.908+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== osd.2 v1:172.21.15.106:6801/2648645857 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fdcf4001f70 con 0x7fdce003eea0 2024-04-25T23:54:59.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 --> v1:172.21.15.106:6800/858572474 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa4b8062e50 con 0x7fa49c03e990 2024-04-25T23:54:59.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4adffb640 1 -- 172.21.15.106:0/3142651922 <== osd.1 v1:172.21.15.106:6800/858572474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2570787547) 0x7fa4b8062e50 con 0x7fa49c03e990 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 >> v1:172.21.15.106:6800/858572474 conn(0x7fa49c03e990 legacy=0x7fa49c040db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 >> v1:172.21.15.171:6812/722422047 conn(0x7fa49c037e50 legacy=0x7fa49c03a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 10 monclient: shutdown 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 >> v1:172.21.15.171:6791/0 conn(0x7fa4b80a4820 legacy=0x7fa4b8128c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bdb01640 1 -- 172.21.15.106:0/3142651922 reap_dead start 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 shutdown_connections 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 >> 172.21.15.106:0/3142651922 conn(0x7fa4b80a9e20 msgr2=0x7fa4b8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 shutdown_connections 2024-04-25T23:54:59.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.912+0000 7fa4bf564640 1 -- 172.21.15.106:0/3142651922 wait complete. 2024-04-25T23:54:59.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7fdd02d5b640 1 -- 172.21.15.106:0/3465122060 --> v1:172.21.15.106:6801/2648645857 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdcfc070650 con 0x7fdce003eea0 2024-04-25T23:54:59.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient: monmap: 2024-04-25T23:54:59.916 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.916 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.916 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.936286+0000 2024-04-25T23:54:59.916 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.936286+0000 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 1 Processor -- start 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 1 -- start start 2024-04-25T23:54:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient: init 2024-04-25T23:54:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7fdcf97fa640 1 -- 172.21.15.106:0/3465122060 <== osd.2 v1:172.21.15.106:6801/2648645857 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 2570787547) 0x7fdcf00077b0 con 0x7fdce003eea0 2024-04-25T23:54:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient: _add_conns ranks=[7,1,5,2,6,3,0,4,8] 2024-04-25T23:54:59.918 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:54:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f802e59e640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient(hunting): picked mon.noname-i con 0x7f65100a1400 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:59.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient(hunting): picked mon.noname-f con 0x7f65100a1ef0 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:59.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient(hunting): picked mon.noname-h con 0x7f651013c110 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:59.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6510072bd0 con 0x7f65100a1ef0 2024-04-25T23:54:59.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6510071700 con 0x7f651013c110 2024-04-25T23:54:59.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f651006e9d0 con 0x7f65100a1400 2024-04-25T23:54:59.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.932+0000 7f6516ee0640 10 monclient(hunting): authenticate will time out at 955.463986s 2024-04-25T23:54:59.920 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T23:54:59.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient: monmap: 2024-04-25T23:54:59.921 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.921 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.938537+0000 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.938537+0000 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.922 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient: monmap: 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.938648+0000 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.938648+0000 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.923 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.924 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.924 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.924 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.924 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.924 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f65100a1ef0 0x7f651013a9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:41964/0 (socket says 172.21.15.106:41964) 2024-04-25T23:54:59.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650ffff640 1 -- 172.21.15.106:0/2021484560 learned_addr learned my addr 172.21.15.106:0/2021484560 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 1 -- 172.21.15.106:0/3465122060 >> v1:172.21.15.106:6801/2648645857 conn(0x7fdce003eea0 legacy=0x7fdce00412c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 1 -- 172.21.15.106:0/3465122060 >> v1:172.21.15.171:6812/722422047 conn(0x7fdce00381d0 legacy=0x7fdce003a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014155993 0 0) 0x7f6510072bd0 con 0x7f65100a1ef0 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): my global_id is 4240 2024-04-25T23:54:59.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64f8003530 con 0x7f65100a1ef0 2024-04-25T23:54:59.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 10 monclient: shutdown 2024-04-25T23:54:59.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 1 -- 172.21.15.106:0/3465122060 >> v1:172.21.15.106:6793/0 conn(0x7fdcfc09e270 legacy=0x7fdcfc1d0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdd012f8640 1 -- 172.21.15.106:0/3465122060 reap_dead start 2024-04-25T23:54:59.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 1 -- 172.21.15.106:0/3465122060 shutdown_connections 2024-04-25T23:54:59.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 1 -- 172.21.15.106:0/3465122060 >> 172.21.15.106:0/3465122060 conn(0x7fdcfc0a71b0 msgr2=0x7fdcfc1331a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 915704174 0 0) 0x7f651006e9d0 con 0x7f65100a1400 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): my global_id is 4246 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6510072bd0 con 0x7f65100a1400 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642064554 0 0) 0x7f6510071700 con 0x7f651013c110 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient(hunting): my global_id is 4325 2024-04-25T23:54:59.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f651006e9d0 con 0x7f651013c110 2024-04-25T23:54:59.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 1 -- 172.21.15.106:0/3465122060 shutdown_connections 2024-04-25T23:54:59.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7fdce6ffd640 1 -- 172.21.15.106:0/3465122060 wait complete. 2024-04-25T23:54:59.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 1 Processor -- start 2024-04-25T23:54:59.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 1 Processor -- start 2024-04-25T23:54:59.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 1 -- start start 2024-04-25T23:54:59.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient: init 2024-04-25T23:54:59.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 1 -- start start 2024-04-25T23:54:59.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient: init 2024-04-25T23:54:59.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4218651983 0 0) 0x7f64f8003530 con 0x7f65100a1ef0 2024-04-25T23:54:59.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 >> v1:172.21.15.171:6792/0 conn(0x7f65100a1400 legacy=0x7f65100a17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 >> v1:172.21.15.171:6791/0 conn(0x7f651013c110 legacy=0x7f651013e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 monclient: found mon.noname-f 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6510072330 con 0x7f65100a1ef0 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f65040017c0 con 0x7f65100a1ef0 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: dump: 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.931 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 5 monclient: authenticate success, global_id 4240 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6504001a20 con 0x7f65100a1ef0 2024-04-25T23:54:59.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 1 -- 172.21.15.106:0/2021484560 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6504004bf0 con 0x7f65100a1ef0 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 4 set_mon_vals no callback set 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f650f7fe640 10 monclient: dump: 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.933 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient: _add_conns ranks=[3,7,6,1,2,4,0,5,8] 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient: _add_conns ranks=[4,6,7,5,8,0,2,3,1] 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient(hunting): picked mon.noname-g con 0x7f8028071fa0 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient(hunting): picked mon.noname-i con 0x7f802813bf10 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient(hunting): picked mon.noname-d con 0x7f802813c380 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802806ba00 con 0x7f8028071fa0 2024-04-25T23:54:59.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80280701d0 con 0x7f802813c380 2024-04-25T23:54:59.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f802806bd90 con 0x7f802813bf10 2024-04-25T23:54:59.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 10 monclient(hunting): authenticate will time out at 955.466312s 2024-04-25T23:54:59.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient(hunting): picked mon.noname-c con 0x7f3a800a2560 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:59.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7e59c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f3a800a2560 0x7f3a800a2940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48552/0 (socket says 172.21.15.106:48552) 2024-04-25T23:54:59.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7e59c640 1 -- 172.21.15.106:0/1609080847 learned_addr learned my addr 172.21.15.106:0/1609080847 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient(hunting): picked mon.noname-d con 0x7f3a800a3050 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:59.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8027fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f8028071fa0 0x7f8028072380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:59390/0 (socket says 172.21.15.106:59390) 2024-04-25T23:54:59.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8027fff640 1 -- 172.21.15.106:0/672932732 learned_addr learned my addr 172.21.15.106:0/672932732 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient(hunting): picked mon.noname-i con 0x7f3a8013e380 addr v1:172.21.15.171:6792/0 2024-04-25T23:54:59.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8006bb60 con 0x7f3a800a2560 2024-04-25T23:54:59.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 10 monclient: shutdown 2024-04-25T23:54:59.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 1 -- 172.21.15.106:0/2021484560 >> v1:172.21.15.171:6789/0 conn(0x7f65100a1ef0 legacy=0x7f651013a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8006c020 con 0x7f3a800a3050 2024-04-25T23:54:59.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 1 -- 172.21.15.106:0/2021484560 shutdown_connections 2024-04-25T23:54:59.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 1 -- 172.21.15.106:0/2021484560 >> 172.21.15.106:0/2021484560 conn(0x7f65100a6070 msgr2=0x7f65100a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701450680 0 0) 0x7f802806ba00 con 0x7f8028071fa0 2024-04-25T23:54:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): my global_id is 4260 2024-04-25T23:54:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8010003530 con 0x7f8028071fa0 2024-04-25T23:54:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8009f900 con 0x7f3a8013e380 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 10 monclient(hunting): authenticate will time out at 955.467061s 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 440422402 0 0) 0x7f3a8006c020 con 0x7f3a800a3050 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): my global_id is 4245 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a68003530 con 0x7f3a800a3050 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891612091 0 0) 0x7f3a8006bb60 con 0x7f3a800a2560 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): my global_id is 4270 2024-04-25T23:54:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a8006c020 con 0x7f3a800a2560 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 374998941 0 0) 0x7f3a8009f900 con 0x7f3a8013e380 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient(hunting): my global_id is 4264 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a8006bb60 con 0x7f3a8013e380 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1328743413 0 0) 0x7f3a68003530 con 0x7f3a800a3050 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 >> v1:172.21.15.171:6792/0 conn(0x7f3a8013e380 legacy=0x7f3a80140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 >> v1:172.21.15.106:6791/0 conn(0x7f3a800a2560 legacy=0x7f3a800a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 monclient: found mon.noname-d 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8009fbe0 con 0x7f3a800a3050 2024-04-25T23:54:59.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3a740017c0 con 0x7f3a800a3050 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 5 monclient: authenticate success, global_id 4245 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a7d59a640 10 monclient: dump: 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.942 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f3a84b7b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:59.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283508103 0 0) 0x7f802806bd90 con 0x7f802813bf10 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): my global_id is 4255 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f802806ba00 con 0x7f802813bf10 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 728378763 0 0) 0x7f80280701d0 con 0x7f802813c380 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient(hunting): my global_id is 4254 2024-04-25T23:54:59.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f802806bd90 con 0x7f802813c380 2024-04-25T23:54:59.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f6516ee0640 1 -- 172.21.15.106:0/2021484560 shutdown_connections 2024-04-25T23:54:59.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 1 -- 172.21.15.106:0/2021484560 wait complete. 2024-04-25T23:54:59.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3779422443 0 0) 0x7f8010003530 con 0x7f8028071fa0 2024-04-25T23:54:59.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 >> v1:172.21.15.171:6792/0 conn(0x7f802813bf10 legacy=0x7f8028140d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 >> v1:172.21.15.106:6792/0 conn(0x7f802813c380 legacy=0x7f8028144480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 monclient: found mon.noname-g 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80280a40a0 con 0x7f8028071fa0 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8020001b60 con 0x7f8028071fa0 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 10 monclient: dump: 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.946 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 5 monclient: authenticate success, global_id 4260 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f802e59e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.936+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8020001e80 con 0x7f8028071fa0 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f8026ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f8026ffd640 1 -- 172.21.15.106:0/672932732 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8020004f70 con 0x7f8028071fa0 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f8026ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f8026ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f8026ffd640 10 monclient: dump: 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 4 set_mon_vals no callback set 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient: get_monmap_and_config 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient: monmap: 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:59.942799+0000 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:59.942799+0000 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient: monmap: 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.953 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 1 Processor -- start 2024-04-25T23:54:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 1 -- start start 2024-04-25T23:54:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient: init 2024-04-25T23:54:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 1 Processor -- start 2024-04-25T23:54:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 1 -- start start 2024-04-25T23:54:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient: init 2024-04-25T23:54:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient: shutdown 2024-04-25T23:54:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- 172.21.15.106:0/672932732 >> v1:172.21.15.171:6790/0 conn(0x7f8028071fa0 legacy=0x7f8028072380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a74001a20 con 0x7f3a800a3050 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a7d59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a7d59a640 1 -- 172.21.15.106:0/1609080847 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3a74003960 con 0x7f3a800a3050 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a7d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a7d59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a7d59a640 10 monclient: dump: 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a84b7b640 10 monclient: get_monmap_and_config success 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a84b7b640 4 set_mon_vals no callback set 2024-04-25T23:54:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- 172.21.15.106:0/672932732 shutdown_connections 2024-04-25T23:54:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- 172.21.15.106:0/672932732 >> 172.21.15.106:0/672932732 conn(0x7f80280a72b0 msgr2=0x7f80280a3500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a84b7b640 10 monclient: shutdown 2024-04-25T23:54:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a84b7b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:54:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 >> v1:172.21.15.106:6792/0 conn(0x7f3a800a3050 legacy=0x7f3a8013cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 shutdown_connections 2024-04-25T23:54:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 >> 172.21.15.106:0/1609080847 conn(0x7f3a800a3650 msgr2=0x7f3a800a3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:54:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- 172.21.15.106:0/672932732 shutdown_connections 2024-04-25T23:54:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- 172.21.15.106:0/672932732 wait complete. 2024-04-25T23:54:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient: _add_conns ranks=[4,6,8,5,1,2,3,0,7] 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient(hunting): picked mon.noname-c con 0x7f23380a3670 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient(hunting): picked mon.noname-d con 0x7f2338137620 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient(hunting): picked mon.noname-e con 0x7f23381381c0 addr v1:172.21.15.106:6793/0 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f233806da10 con 0x7f23380a3670 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f233806e310 con 0x7f2338137620 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f233806e030 con 0x7f23381381c0 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f23402f8640 10 monclient(hunting): authenticate will time out at 955.469996s 2024-04-25T23:54:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient: _add_conns ranks=[3,6,5,7,2,1,8,0,4] 2024-04-25T23:54:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient(hunting): picked mon.noname-g con 0x7f65100a1400 addr v1:172.21.15.171:6790/0 2024-04-25T23:54:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient(hunting): picked mon.noname-d con 0x7f651013c110 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient(hunting): picked mon.noname-h con 0x7f651013b0b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6510138ae0 con 0x7f65100a1400 2024-04-25T23:54:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f651009f470 con 0x7f651013b0b0 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65101da180 con 0x7f651013c110 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6516ee0640 10 monclient(hunting): authenticate will time out at 955.470229s 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f651013c110 0x7f65101d9a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43516/0 (socket says 172.21.15.106:43516) 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650ffff640 1 -- 172.21.15.106:0/4159686879 learned_addr learned my addr 172.21.15.106:0/4159686879 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f6514c7c640 1 --1- 172.21.15.106:0/4159686879 >> v1:172.21.15.171:6790/0 conn(0x7f65100a1400 0x7f65101d9360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:59402/0 (socket says 172.21.15.106:59402) 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient: monmap: 2024-04-25T23:54:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.962 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2395312483 0 0) 0x7f65101da180 con 0x7f651013c110 2024-04-25T23:54:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): my global_id is 4263 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f64fc003530 con 0x7f651013c110 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113121090 0 0) 0x7f6510138ae0 con 0x7f65100a1400 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): my global_id is 4269 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65101da180 con 0x7f65100a1400 2024-04-25T23:54:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 Processor -- start 2024-04-25T23:54:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2312758956 0 0) 0x7f651006e9d0 con 0x7f651013b0b0 2024-04-25T23:54:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): my global_id is 4334 2024-04-25T23:54:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6510138ae0 con 0x7f651013b0b0 2024-04-25T23:54:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233e094640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f23380a3670 0x7f2338137ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48562/0 (socket says 172.21.15.106:48562) 2024-04-25T23:54:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233e094640 1 -- 172.21.15.106:0/3051816264 learned_addr learned my addr 172.21.15.106:0/3051816264 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- start start 2024-04-25T23:54:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient: init 2024-04-25T23:54:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1329957280 0 0) 0x7f64fc003530 con 0x7f651013c110 2024-04-25T23:54:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f651006e9d0 con 0x7f651013c110 2024-04-25T23:54:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 180471099 0 0) 0x7f65101da180 con 0x7f65100a1400 2024-04-25T23:54:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f64fc003530 con 0x7f65100a1400 2024-04-25T23:54:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f65040016c0 con 0x7f651013c110 2024-04-25T23:54:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2724140741 0 0) 0x7f233806da10 con 0x7f23380a3670 2024-04-25T23:54:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233d092640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233d092640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233d092640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233d092640 10 monclient(hunting): my global_id is 4279 2024-04-25T23:54:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:54:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2324003530 con 0x7f23380a3670 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): dump: 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.969 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3791794850 0 0) 0x7f6510138ae0 con 0x7f651013b0b0 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65101da180 con 0x7f651013b0b0 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6508001d50 con 0x7f65100a1400 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): dump: 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.971 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.972 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient: _add_conns ranks=[6,5,1,8,4,2,7,0,3] 2024-04-25T23:54:59.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f65000017f0 con 0x7f651013b0b0 2024-04-25T23:54:59.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f650d7fa640 10 monclient(hunting): dump: 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.973 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.974 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.974 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3663411661 0 0) 0x7f2324003530 con 0x7f23380a3670 2024-04-25T23:54:59.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 >> v1:172.21.15.106:6793/0 conn(0x7f23381381c0 legacy=0x7f2338140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:54:59.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient(hunting): picked mon.noname-d con 0x7f8028071fa0 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:59.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient(hunting): picked mon.noname-h con 0x7f802813bf10 addr v1:172.21.15.171:6791/0 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient(hunting): picked mon.noname-f con 0x7f802813c380 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028072c40 con 0x7f802813c380 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028138e70 con 0x7f802813bf10 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8028136ce0 con 0x7f8028071fa0 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.940+0000 7f802e59e640 10 monclient(hunting): authenticate will time out at 955.471946s 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8027fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f8028071fa0 0x7f8028135ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43526/0 (socket says 172.21.15.106:43526) 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8027fff640 1 -- 172.21.15.106:0/285878015 learned_addr learned my addr 172.21.15.106:0/285878015 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 822237449 0 0) 0x7f651006e9d0 con 0x7f651013c110 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 >> v1:172.21.15.171:6791/0 conn(0x7f651013b0b0 legacy=0x7f65101e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 >> v1:172.21.15.171:6790/0 conn(0x7f65100a1400 legacy=0x7f65101d9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 monclient: found mon.d 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f651009f9c0 con 0x7f651013c110 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 5 monclient: authenticate success, global_id 4263 2024-04-25T23:54:59.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3520465585 0 0) 0x7f8028136ce0 con 0x7f8028071fa0 2024-04-25T23:54:59.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): my global_id is 4281 2024-04-25T23:54:59.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8014003530 con 0x7f8028071fa0 2024-04-25T23:54:59.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 10 monclient: _renew_subs 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f651013a620 con 0x7f651013c110 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 10 monclient: _renew_subs 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f65101e2d50 con 0x7f651013c110 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6504001a00 con 0x7f651013c110 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6504004c10 con 0x7f651013c110 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650effd640 4 set_mon_vals no callback set 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: dump: 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.978 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.979 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453138737 0 0) 0x7f802806bd90 con 0x7f802813c380 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): my global_id is 4249 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8028136ce0 con 0x7f802813c380 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3022857396 0 0) 0x7f8028138e70 con 0x7f802813bf10 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): my global_id is 4343 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f802806bd90 con 0x7f802813bf10 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3561959239 0 0) 0x7f8014003530 con 0x7f8028071fa0 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8028138e70 con 0x7f8028071fa0 2024-04-25T23:54:59.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8020004eb0 con 0x7f8028071fa0 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.982 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2368547061 0 0) 0x7f802806bd90 con 0x7f802813bf10 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8014003530 con 0x7f802813bf10 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f801c001a60 con 0x7f802813bf10 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.983 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2779700807 0 0) 0x7f8028136ce0 con 0x7f802813c380 2024-04-25T23:54:59.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f802806bd90 con 0x7f802813c380 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8018001940 con 0x7f802813c380 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient(hunting): dump: 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.985 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4281022735 0 0) 0x7f8028138e70 con 0x7f8028071fa0 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 >> v1:172.21.15.171:6791/0 conn(0x7f802813bf10 legacy=0x7f80281365d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6516ee0640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.106:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f64f0000f90 con 0x7f651013c110 2024-04-25T23:54:59.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f650400fe00 con 0x7f651013c110 2024-04-25T23:54:59.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 >> v1:172.21.15.171:6789/0 conn(0x7f802813c380 legacy=0x7f80281d8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:54:59.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 monclient: found mon.d 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8028138b90 con 0x7f8028071fa0 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: _finish_auth 0 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 5 monclient: authenticate success, global_id 4281 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 10 monclient: _renew_subs 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80281371f0 con 0x7f8028071fa0 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 10 monclient: _renew_subs 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f80280a0000 con 0x7f8028071fa0 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8020001c00 con 0x7f8028071fa0 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8020001540 con 0x7f8028071fa0 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f80267fc640 4 set_mon_vals no callback set 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: dump: 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.989 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f6504044320 con 0x7f651013c110 2024-04-25T23:54:59.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.171:6800/721452434 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f64fc042880 con 0x7f64fc03ec10 2024-04-25T23:54:59.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (unknown 2942983318 0 0) 0x7f65040446e0 con 0x7f651013c110 2024-04-25T23:54:59.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f650d7fa640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-04-25T23:54:59.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f6514c7c640 10 monclient: get_auth_request con 0x7f64fc0380d0 auth_method 0 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f8020001e80 con 0x7f8028071fa0 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.106:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f8008000f90 con 0x7f8028071fa0 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f8020044600 con 0x7f8028071fa0 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.171:6804/3736794137 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f80140429c0 con 0x7f801403ed50 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (unknown 2942983318 0 0) 0x7f80200151a0 con 0x7f8028071fa0 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f8024ff9640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f80277fe640 10 monclient: get_auth_request con 0x7f8014038190 auth_method 0 2024-04-25T23:54:59.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f651547d640 10 monclient: get_auth_request con 0x7f64fc03ec10 auth_method 0 2024-04-25T23:54:59.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.944+0000 7f802cb3b640 10 monclient: get_auth_request con 0x7f801403ed50 auth_method 0 2024-04-25T23:54:59.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 shutdown_connections 2024-04-25T23:54:59.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1609080847 wait complete. 2024-04-25T23:54:59.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: build_initial_monmap 2024-04-25T23:54:59.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: monmap: 2024-04-25T23:54:59.994 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:54:59.995 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 Processor -- start 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- start start 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: init 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: _reopen_session rank -1 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: _add_conns ranks=[4,1,6,5,3,8,7,2,0] 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient(hunting): picked mon.noname-c con 0x7f3a800a2560 addr v1:172.21.15.106:6791/0 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient(hunting): picked mon.noname-f con 0x7f3a800a3050 addr v1:172.21.15.171:6789/0 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient(hunting): picked mon.noname-d con 0x7f3a8013e380 addr v1:172.21.15.106:6792/0 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a80123850 con 0x7f3a800a3050 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a8009f420 con 0x7f3a800a2560 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a800728b0 con 0x7f3a8013e380 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient(hunting): _renew_subs 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient(hunting): authenticate will time out at 955.477579s 2024-04-25T23:54:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a7ed9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f3a8013e380 0x7f3a801d0e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43528/0 (socket says 172.21.15.106:43528) 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a7ed9d640 1 -- 172.21.15.106:0/1076344866 learned_addr learned my addr 172.21.15.106:0/1076344866 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a7e59c640 1 --1- 172.21.15.106:0/1076344866 >> v1:172.21.15.106:6791/0 conn(0x7f3a800a2560 0x7f3a801c8780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48572/0 (socket says 172.21.15.106:48572) 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3926978198 0 0) 0x7f3a80123850 con 0x7f3a800a3050 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): my global_id is 4258 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a60003530 con 0x7f3a800a3050 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305345120 0 0) 0x7f3a8009f420 con 0x7f3a800a2560 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): _negotiate 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): my global_id is 4288 2024-04-25T23:54:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a80123850 con 0x7f3a800a2560 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2071066828 0 0) 0x7f3a60003530 con 0x7f3a800a3050 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a8009f420 con 0x7f3a800a3050 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3a740016c0 con 0x7f3a800a3050 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): dump: 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:54:59.998 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2409261067 0 0) 0x7f3a80123850 con 0x7f3a800a2560 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3a60003530 con 0x7f3a800a2560 2024-04-25T23:54:59.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3a700015e0 con 0x7f3a800a2560 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient(hunting): dump: 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.000 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 109576140 0 0) 0x7f3a8009f420 con 0x7f3a800a3050 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 >> v1:172.21.15.106:6792/0 conn(0x7f3a8013e380 legacy=0x7f3a801d0e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 >> v1:172.21.15.106:6791/0 conn(0x7f3a800a2560 legacy=0x7f3a801c8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 monclient: found mon.f 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a80121560 con 0x7f3a800a3050 2024-04-25T23:55:00.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 5 monclient: authenticate success, global_id 4258 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: _renew_subs 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3a80123290 con 0x7f3a800a3050 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: _renew_subs 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3a80121e10 con 0x7f3a800a3050 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3a740011a0 con 0x7f3a800a3050 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3a74003a20 con 0x7f3a800a3050 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a6effd640 10 monclient: dump: 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.003 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.004 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.004 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f3a7cd99640 4 set_mon_vals no callback set 2024-04-25T23:55:00.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== osd.4 v1:172.21.15.171:6804/3736794137 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f80140429c0 con 0x7f801403ed50 2024-04-25T23:55:00.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.948+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== osd.5 v1:172.21.15.171:6800/721452434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f64fc042880 con 0x7f64fc03ec10 2024-04-25T23:55:00.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a84b7b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:55:00.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.171:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f3a80067160 con 0x7f3a800a3050 2024-04-25T23:55:00.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 >> v1:172.21.15.106:6792/0 conn(0x7f2338137620 legacy=0x7f233813c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 1 monclient: found mon.noname-c 2024-04-25T23:55:00.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380708d0 con 0x7f23380a3670 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f23340017c0 con 0x7f23380a3670 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: dump: 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.006 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f3a7400eb70 con 0x7f3a800a3050 2024-04-25T23:55:00.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f3a74042fb0 con 0x7f3a800a3050 2024-04-25T23:55:00.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.106:6808/1458966339 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3a60042710 con 0x7f3a6003eaa0 2024-04-25T23:55:00.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_get_version_reply(handle=1 version=15) ==== 24+0+0 (unknown 2942983318 0 0) 0x7f3a74043340 con 0x7f3a800a3050 2024-04-25T23:55:00.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a6effd640 10 monclient: handle_get_version_reply finishing 1 version 15 2024-04-25T23:55:00.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a7ed9d640 10 monclient: get_auth_request con 0x7f3a6003eaa0 auth_method 0 2024-04-25T23:55:00.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a7e59c640 10 monclient: get_auth_request con 0x7f3a60037e50 auth_method 0 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 5 monclient: authenticate success, global_id 4279 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2334001a20 con 0x7f23380a3670 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 1 -- 172.21.15.106:0/3051816264 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2334001c10 con 0x7f23380a3670 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f233d092640 10 monclient: dump: 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.009 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 4 set_mon_vals no callback set 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 10 monclient: shutdown 2024-04-25T23:55:00.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 1 -- 172.21.15.106:0/3051816264 >> v1:172.21.15.106:6791/0 conn(0x7f23380a3670 legacy=0x7f2338137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 1 -- 172.21.15.106:0/3051816264 shutdown_connections 2024-04-25T23:55:00.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 1 -- 172.21.15.106:0/3051816264 >> 172.21.15.106:0/3051816264 conn(0x7f233806b210 msgr2=0x7f233806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 1 -- 172.21.15.106:0/3051816264 shutdown_connections 2024-04-25T23:55:00.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 1 -- 172.21.15.106:0/3051816264 wait complete. 2024-04-25T23:55:00.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== osd.0 v1:172.21.15.106:6808/1458966339 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f3a60042710 con 0x7f3a6003eaa0 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 10 monclient: monmap: 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.013 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 1 Processor -- start 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 1 -- start start 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.952+0000 7f23402f8640 10 monclient: init 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient: _add_conns ranks=[4,2,0,5,1,3,7,6,8] 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient(hunting): picked mon.noname-c con 0x7f23380a3670 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient(hunting): picked mon.noname-b con 0x7f23381381c0 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:00.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient(hunting): picked mon.noname-a con 0x7f23381d6a90 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2338134b80 con 0x7f23381d6a90 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2338136e70 con 0x7f23381381c0 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2338134730 con 0x7f23380a3670 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient(hunting): authenticate will time out at 955.484677s 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f233d893640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f23381381c0 0x7f2338134020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49032/0 (socket says 172.21.15.106:49032) 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f233d893640 1 -- 172.21.15.106:0/4144081552 learned_addr learned my addr 172.21.15.106:0/4144081552 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482752073 0 0) 0x7f2338134730 con 0x7f23380a3670 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): my global_id is 4297 2024-04-25T23:55:00.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f231c003530 con 0x7f23380a3670 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2855947624 0 0) 0x7f231c003530 con 0x7f23380a3670 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2338134730 con 0x7f23380a3670 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f23340017a0 con 0x7f23380a3670 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): dump: 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.016 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095805777 0 0) 0x7f2338134b80 con 0x7f23381d6a90 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient(hunting): my global_id is 4329 2024-04-25T23:55:00.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f231c003530 con 0x7f23381d6a90 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1934036582 0 0) 0x7f2338134730 con 0x7f23380a3670 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 >> v1:172.21.15.106:6790/0 conn(0x7f23381381c0 legacy=0x7f2338134020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 >> v1:172.21.15.106:6789/0 conn(0x7f23381d6a90 legacy=0x7f23381d8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 monclient: found mon.c 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23380726e0 con 0x7f23380a3670 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 5 monclient: authenticate success, global_id 4297 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2334001cb0 con 0x7f23380a3670 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient: _renew_subs 2024-04-25T23:55:00.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2338072af0 con 0x7f23380a3670 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2334005120 con 0x7f23380a3670 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f232effd640 10 monclient: dump: 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.019 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient: _renew_subs 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2338135430 con 0x7f23380a3670 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.956+0000 7f233c891640 4 set_mon_vals no callback set 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.960+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f233400fe90 con 0x7f23380a3670 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.960+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f2334044260 con 0x7f23380a3670 2024-04-25T23:55:00.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.960+0000 7f233d893640 10 monclient: get_auth_request con 0x7f231c0377c0 auth_method 0 2024-04-25T23:55:00.021 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:55:00.022 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T23:55:00.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.964+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 --> v1:172.21.15.171:6804/3736794137 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8008002c30 con 0x7f801403ed50 2024-04-25T23:55:00.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.964+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.171:6808/2707846597 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2338136760 con 0x7f2338130c50 2024-04-25T23:55:00.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.964+0000 7f6516ee0640 1 -- 172.21.15.106:0/4159686879 --> v1:172.21.15.171:6800/721452434 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f64f0002c60 con 0x7f64fc03ec10 2024-04-25T23:55:00.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.964+0000 7f233e895640 10 monclient: get_auth_request con 0x7f2338130c50 auth_method 0 2024-04-25T23:55:00.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.964+0000 7f8024ff9640 1 -- 172.21.15.106:0/285878015 <== osd.4 v1:172.21.15.171:6804/3736794137 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f8008002c30 con 0x7f801403ed50 2024-04-25T23:55:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 >> v1:172.21.15.171:6804/3736794137 conn(0x7f801403ed50 legacy=0x7f8014041170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f650d7fa640 1 -- 172.21.15.106:0/4159686879 <== osd.5 v1:172.21.15.171:6800/721452434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f64f0002c60 con 0x7f64fc03ec10 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 >> v1:172.21.15.171:6812/722422047 conn(0x7f8014038190 legacy=0x7f801403a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 10 monclient: shutdown 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 >> v1:172.21.15.106:6792/0 conn(0x7f8028071fa0 legacy=0x7f8028135ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802cb3b640 1 -- 172.21.15.106:0/285878015 reap_dead start 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 shutdown_connections 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 >> 172.21.15.106:0/285878015 conn(0x7f80280a72b0 msgr2=0x7f80280a5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f64f6ffd640 1 -- 172.21.15.106:0/4159686879 >> v1:172.21.15.171:6800/721452434 conn(0x7f64fc03ec10 legacy=0x7f64fc041030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 shutdown_connections 2024-04-25T23:55:00.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f802e59e640 1 -- 172.21.15.106:0/285878015 wait complete. 2024-04-25T23:55:00.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f64f6ffd640 1 -- 172.21.15.106:0/4159686879 >> v1:172.21.15.171:6812/722422047 conn(0x7f64fc0380d0 legacy=0x7f64fc03a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f64f6ffd640 10 monclient: shutdown 2024-04-25T23:55:00.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f64f6ffd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f64f6ffd640 1 -- 172.21.15.106:0/4159686879 >> v1:172.21.15.106:6792/0 conn(0x7f651013c110 legacy=0x7f65101d9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f651547d640 1 -- 172.21.15.106:0/4159686879 reap_dead start 2024-04-25T23:55:00.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.968+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== osd.3 v1:172.21.15.171:6808/2707846597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f2328007a60 con 0x7f2338130c50 2024-04-25T23:55:00.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.972+0000 7f64f6ffd640 1 -- 172.21.15.106:0/4159686879 shutdown_connections 2024-04-25T23:55:00.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.972+0000 7f64f6ffd640 1 -- 172.21.15.106:0/4159686879 >> 172.21.15.106:0/4159686879 conn(0x7f65100a6070 msgr2=0x7f651006f4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.972+0000 7f64f6ffd640 1 -- 172.21.15.106:0/4159686879 shutdown_connections 2024-04-25T23:55:00.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.972+0000 7f64f6ffd640 1 -- 172.21.15.106:0/4159686879 wait complete. 2024-04-25T23:55:00.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 --> v1:172.21.15.106:6808/1458966339 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3a8009ff30 con 0x7f3a6003eaa0 2024-04-25T23:55:00.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a6effd640 1 -- 172.21.15.106:0/1076344866 <== osd.0 v1:172.21.15.106:6808/1458966339 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f3a8009ff30 con 0x7f3a6003eaa0 2024-04-25T23:55:00.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 >> v1:172.21.15.106:6808/1458966339 conn(0x7f3a6003eaa0 legacy=0x7f3a60040ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 >> v1:172.21.15.171:6812/722422047 conn(0x7f3a60037e50 legacy=0x7f3a6003a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 10 monclient: shutdown 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 >> v1:172.21.15.171:6789/0 conn(0x7f3a800a3050 legacy=0x7f3a801cd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a7ed9d640 1 -- 172.21.15.106:0/1076344866 reap_dead start 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 shutdown_connections 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 >> 172.21.15.106:0/1076344866 conn(0x7f3a800a3650 msgr2=0x7f3a80067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 shutdown_connections 2024-04-25T23:55:00.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.980+0000 7f3a84b7b640 1 -- 172.21.15.106:0/1076344866 wait complete. 2024-04-25T23:55:00.031 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:00.031 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T23:55:00.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 --> v1:172.21.15.171:6808/2707846597 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2338067160 con 0x7f2338130c50 2024-04-25T23:55:00.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f232effd640 1 -- 172.21.15.106:0/4144081552 <== osd.3 v1:172.21.15.171:6808/2707846597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 1800444376) 0x7f2338067160 con 0x7f2338130c50 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 >> v1:172.21.15.171:6808/2707846597 conn(0x7f2338130c50 legacy=0x7f2338061c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 >> v1:172.21.15.171:6812/722422047 conn(0x7f231c0377c0 legacy=0x7f231c039c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 10 monclient: shutdown 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 >> v1:172.21.15.106:6791/0 conn(0x7f23380a3670 legacy=0x7f2338133910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f233e895640 1 -- 172.21.15.106:0/4144081552 reap_dead start 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 shutdown_connections 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 >> 172.21.15.106:0/4144081552 conn(0x7f233806b210 msgr2=0x7f2338130540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 shutdown_connections 2024-04-25T23:55:00.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:54:59.996+0000 7f23402f8640 1 -- 172.21.15.106:0/4144081552 wait complete. 2024-04-25T23:55:00.034 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:00.034 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T23:55:00.035 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:00.035 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T23:55:00.036 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:00.036 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.100+0000 7fbf56085640 10 monclient: get_monmap_and_config 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.100+0000 7fbf56085640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.100+0000 7fbf56085640 10 monclient: monmap: 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:00.104380+0000 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:00.104380+0000 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.083 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.084 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.100+0000 7fbf56085640 1 Processor -- start 2024-04-25T23:55:00.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.100+0000 7fbf56085640 1 -- start start 2024-04-25T23:55:00.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.100+0000 7fbf56085640 10 monclient: init 2024-04-25T23:55:00.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient: _add_conns ranks=[0,7,3,6,8,5,4,2,1] 2024-04-25T23:55:00.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient(hunting): picked mon.noname-a con 0x7fbf50134970 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient(hunting): picked mon.noname-i con 0x7fbf500a4820 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient(hunting): picked mon.noname-g con 0x7fbf5013e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf5006dd40 con 0x7fbf50134970 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf500a2b10 con 0x7fbf5013e200 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf500a2df0 con 0x7fbf500a4820 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient(hunting): authenticate will time out at 955.632195s 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4ffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbf5013e200 0x7fbf501405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:59410/0 (socket says 172.21.15.106:59410) 2024-04-25T23:55:00.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4ffff640 1 -- 172.21.15.106:0/2432802940 learned_addr learned my addr 172.21.15.106:0/2432802940 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476147780 0 0) 0x7fbf500a2b10 con 0x7fbf5013e200 2024-04-25T23:55:00.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): my global_id is 4287 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf38003530 con 0x7fbf5013e200 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983290907 0 0) 0x7fbf5006dd40 con 0x7fbf50134970 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): my global_id is 4338 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf500a2b10 con 0x7fbf50134970 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584550903 0 0) 0x7fbf500a2df0 con 0x7fbf500a4820 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient(hunting): my global_id is 4273 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf5006dd40 con 0x7fbf500a4820 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3974143900 0 0) 0x7fbf38003530 con 0x7fbf5013e200 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 >> v1:172.21.15.171:6792/0 conn(0x7fbf500a4820 legacy=0x7fbf5013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 >> v1:172.21.15.106:6789/0 conn(0x7fbf50134970 legacy=0x7fbf50134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 monclient: found mon.noname-g 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf500a30d0 con 0x7fbf5013e200 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 5 monclient: authenticate success, global_id 4287 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf48001b40 con 0x7fbf5013e200 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: dump: 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.091 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 1 -- 172.21.15.106:0/2432802940 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf48001da0 con 0x7fbf5013e200 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf4e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:00.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.104+0000 7fbf56085640 4 set_mon_vals no callback set 2024-04-25T23:55:00.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.108+0000 7fbf56085640 10 monclient: shutdown 2024-04-25T23:55:00.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.108+0000 7fbf56085640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.108+0000 7fbf56085640 1 -- 172.21.15.106:0/2432802940 >> v1:172.21.15.171:6790/0 conn(0x7fbf5013e200 legacy=0x7fbf501405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- 172.21.15.106:0/2432802940 shutdown_connections 2024-04-25T23:55:00.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- 172.21.15.106:0/2432802940 >> 172.21.15.106:0/2432802940 conn(0x7fbf500a9e20 msgr2=0x7fbf500aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- 172.21.15.106:0/2432802940 shutdown_connections 2024-04-25T23:55:00.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- 172.21.15.106:0/2432802940 wait complete. 2024-04-25T23:55:00.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient: monmap: 2024-04-25T23:55:00.101 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.101 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:00.101 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 Processor -- start 2024-04-25T23:55:00.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- start start 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient: init 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient: _add_conns ranks=[1,2,5,4,0,7,8,3,6] 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient(hunting): picked mon.noname-f con 0x7fbf500a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient(hunting): picked mon.noname-b con 0x7fbf50134970 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient(hunting): picked mon.noname-h con 0x7fbf5013e200 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf501d9f10 con 0x7fbf500a4820 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf500a1a40 con 0x7fbf50134970 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf500a1e00 con 0x7fbf5013e200 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.116+0000 7fbf56085640 10 monclient(hunting): authenticate will time out at 955.647858s 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf4f7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fbf500a4820 0x7fbf501d90f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:41988/0 (socket says 172.21.15.106:41988) 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf4f7fe640 1 -- 172.21.15.106:0/56880054 learned_addr learned my addr 172.21.15.106:0/56880054 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3442901851 0 0) 0x7fbf500a1e00 con 0x7fbf5013e200 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): my global_id is 4352 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf34003530 con 0x7fbf5013e200 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738866333 0 0) 0x7fbf501d9f10 con 0x7fbf500a4820 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): my global_id is 4267 2024-04-25T23:55:00.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf500a1e00 con 0x7fbf500a4820 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1747690043 0 0) 0x7fbf500a1a40 con 0x7fbf50134970 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): my global_id is 4214 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf501d9f10 con 0x7fbf50134970 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 448607552 0 0) 0x7fbf34003530 con 0x7fbf5013e200 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf500a1a40 con 0x7fbf5013e200 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf48001ba0 con 0x7fbf5013e200 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): dump: 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.108 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1074799695 0 0) 0x7fbf500a1e00 con 0x7fbf500a4820 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf34003530 con 0x7fbf500a4820 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf44001510 con 0x7fbf500a4820 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient(hunting): dump: 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.110 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2286262806 0 0) 0x7fbf500a1a40 con 0x7fbf5013e200 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 >> v1:172.21.15.106:6790/0 conn(0x7fbf50134970 legacy=0x7fbf501d9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 >> v1:172.21.15.171:6789/0 conn(0x7fbf500a4820 legacy=0x7fbf501d90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 monclient: found mon.h 2024-04-25T23:55:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf500712b0 con 0x7fbf5013e200 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf56085640 5 monclient: authenticate success, global_id 4352 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf56085640 10 monclient: _renew_subs 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf56085640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf56085640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5006f910 con 0x7fbf5013e200 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf56085640 10 monclient: _renew_subs 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf56085640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf56085640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf50071f70 con 0x7fbf5013e200 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf480054d0 con 0x7fbf5013e200 2024-04-25T23:55:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf480059c0 con 0x7fbf5013e200 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 10 monclient: dump: 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf4dffb640 4 set_mon_vals no callback set 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7fbf48010730 con 0x7fbf5013e200 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3dffb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3dffb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fbf48044b70 con 0x7fbf5013e200 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3dffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf50067160 con 0x7fbf5013e200 2024-04-25T23:55:00.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.120+0000 7fbf4f7fe640 10 monclient: get_auth_request con 0x7fbf34037ef0 auth_method 0 2024-04-25T23:55:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.128+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbf480160d0 con 0x7fbf5013e200 2024-04-25T23:55:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.128+0000 7fbf3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.128+0000 7fbf3ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.216+0000 7f41a3f8f640 10 monclient: get_monmap_and_config 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: monmap: 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:00.222409+0000 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:00.222409+0000 2024-04-25T23:55:00.201 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.202 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 Processor -- start 2024-04-25T23:55:00.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- start start 2024-04-25T23:55:00.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: init 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: _add_conns ranks=[6,8,0,4,7,1,3,5,2] 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient(hunting): picked mon.noname-d con 0x7f419c131160 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient(hunting): picked mon.noname-e con 0x7f419c09c710 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient(hunting): picked mon.noname-a con 0x7f419c09cb70 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c067c20 con 0x7f419c09cb70 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c131c50 con 0x7f419c131160 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c09ba50 con 0x7f419c09c710 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient(hunting): authenticate will time out at 955.749252s 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a152a640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f419c09c710 0x7f419c13caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42280/0 (socket says 172.21.15.106:42280) 2024-04-25T23:55:00.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a152a640 1 -- 172.21.15.106:0/1841041913 learned_addr learned my addr 172.21.15.106:0/1841041913 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396495483 0 0) 0x7f419c09ba50 con 0x7f419c09c710 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): my global_id is 4310 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4188003530 con 0x7f419c09c710 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659692967 0 0) 0x7f419c067c20 con 0x7f419c09cb70 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient(hunting): my global_id is 4347 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f419c09ba50 con 0x7f419c09cb70 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3716059755 0 0) 0x7f4188003530 con 0x7f419c09c710 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 >> v1:172.21.15.106:6792/0 conn(0x7f419c131160 legacy=0x7f419c131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 >> v1:172.21.15.106:6789/0 conn(0x7f419c09cb70 legacy=0x7f419c1401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 monclient: found mon.noname-e 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c09bd30 con 0x7f419c09c710 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f418c0017c0 con 0x7f419c09c710 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: dump: 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.212 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 5 monclient: authenticate success, global_id 4310 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f418c001a20 con 0x7f419c09c710 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 1 -- 172.21.15.106:0/1841041913 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f418c004bf0 con 0x7f419c09c710 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 4 set_mon_vals no callback set 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a0d29640 10 monclient: dump: 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.215 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: shutdown 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1841041913 >> v1:172.21.15.106:6793/0 conn(0x7f419c09c710 legacy=0x7f419c13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1841041913 shutdown_connections 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1841041913 >> 172.21.15.106:0/1841041913 conn(0x7f419c0a2d20 msgr2=0x7f419c0a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1841041913 shutdown_connections 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1841041913 wait complete. 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.220+0000 7f41a3f8f640 10 monclient: monmap: 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.217 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 1 Processor -- start 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 1 -- start start 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient: init 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient: _add_conns ranks=[4,1,7,2,3,5,0,6,8] 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient(hunting): picked mon.noname-c con 0x7f419c09c710 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient(hunting): picked mon.noname-f con 0x7f419c09cb70 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient(hunting): picked mon.noname-i con 0x7f419c131160 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c067e50 con 0x7f419c09cb70 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c12d7b0 con 0x7f419c09c710 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f419c12da90 con 0x7f419c131160 2024-04-25T23:55:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient(hunting): authenticate will time out at 955.753008s 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a1d2b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f419c09c710 0x7f419c12af30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48592/0 (socket says 172.21.15.106:48592) 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a1d2b640 1 -- 172.21.15.106:0/1245775390 learned_addr learned my addr 172.21.15.106:0/1245775390 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806831960 0 0) 0x7f419c12d7b0 con 0x7f419c09c710 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): my global_id is 4315 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4180003530 con 0x7f419c09c710 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203924743 0 0) 0x7f419c067e50 con 0x7f419c09cb70 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): my global_id is 4276 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f419c12d7b0 con 0x7f419c09cb70 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3702133725 0 0) 0x7f4180003530 con 0x7f419c09c710 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f419c067e50 con 0x7f419c09c710 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2370764244 0 0) 0x7f419c12da90 con 0x7f419c131160 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): my global_id is 4282 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4180003530 con 0x7f419c131160 2024-04-25T23:55:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4198001a80 con 0x7f419c09c710 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): dump: 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1554232100 0 0) 0x7f419c067e50 con 0x7f419c09c710 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 >> v1:172.21.15.171:6792/0 conn(0x7f419c131160 legacy=0x7f419c1d4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 >> v1:172.21.15.171:6789/0 conn(0x7f419c09cb70 legacy=0x7f419c12b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 monclient: found mon.c 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f419c130750 con 0x7f419c09c710 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 5 monclient: authenticate success, global_id 4315 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient: _renew_subs 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f419c131e70 con 0x7f419c09c710 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41980038d0 con 0x7f419c09c710 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4198003dc0 con 0x7f419c09c710 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 10 monclient: dump: 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f4193fff640 4 set_mon_vals no callback set 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient: _renew_subs 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f419c12bf20 con 0x7f419c09c710 2024-04-25T23:55:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.224+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f4198003f60 con 0x7f419c09c710 2024-04-25T23:55:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.228+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f41980111c0 con 0x7f419c09c710 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.228+0000 7f41a152a640 10 monclient: get_auth_request con 0x7f4180037b10 auth_method 0 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.232+0000 7f41a3f8f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.232+0000 7f41a3f8f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.232+0000 7f41a3f8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.232+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f419c067160 con 0x7f419c09c710 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.236+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f41980155c0 con 0x7f419c09c710 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.236+0000 7f41927fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.236+0000 7f41927fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient: get_monmap_and_config 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient: monmap: 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:00.247453+0000 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:00.247453+0000 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.229 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7fdaa224c640 10 monclient: get_monmap_and_config 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7fdaa224c640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7fdaa224c640 10 monclient: monmap: 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:00.247933+0000 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:00.247933+0000 2024-04-25T23:55:00.230 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.231 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 1 Processor -- start 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 1 -- start start 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient: init 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient: _add_conns ranks=[2,0,8,6,7,5,1,4,3] 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient(hunting): picked mon.noname-b con 0x7f6f14134970 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient(hunting): picked mon.noname-a con 0x7f6f140a4820 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient(hunting): picked mon.noname-e con 0x7f6f1413e200 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1406dd40 con 0x7f6f140a4820 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f140a2b10 con 0x7f6f14134970 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f140a2df0 con 0x7f6f1413e200 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient(hunting): authenticate will time out at 955.774531s 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f191d0640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f6f1413e200 0x7f6f141405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42296/0 (socket says 172.21.15.106:42296) 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f191d0640 1 -- 172.21.15.106:0/231411055 learned_addr learned my addr 172.21.15.106:0/231411055 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287601924 0 0) 0x7f6f140a2df0 con 0x7f6f1413e200 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): my global_id is 4319 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f04003530 con 0x7f6f1413e200 2024-04-25T23:55:00.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1583419171 0 0) 0x7f6f140a2b10 con 0x7f6f14134970 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient(hunting): my global_id is 4223 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f140a2df0 con 0x7f6f14134970 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 576371029 0 0) 0x7f6f04003530 con 0x7f6f1413e200 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 >> v1:172.21.15.106:6790/0 conn(0x7f6f14134970 legacy=0x7f6f14134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 >> v1:172.21.15.106:6789/0 conn(0x7f6f140a4820 legacy=0x7f6f1413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 monclient: found mon.noname-e 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f140a30d0 con 0x7f6f1413e200 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 5 monclient: authenticate success, global_id 4319 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f0c001b40 con 0x7f6f1413e200 2024-04-25T23:55:00.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: dump: 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.238 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f0c001da0 con 0x7f6f1413e200 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f137fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.244+0000 7f6f1ac33640 4 set_mon_vals no callback set 2024-04-25T23:55:00.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f137fe640 1 -- 172.21.15.106:0/231411055 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f0c004f70 con 0x7f6f1413e200 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f137fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f137fe640 10 monclient: dump: 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.240 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient: shutdown 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- 172.21.15.106:0/231411055 >> v1:172.21.15.106:6793/0 conn(0x7f6f1413e200 legacy=0x7f6f141405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- 172.21.15.106:0/231411055 shutdown_connections 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- 172.21.15.106:0/231411055 >> 172.21.15.106:0/231411055 conn(0x7f6f140a9e20 msgr2=0x7f6f140aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- 172.21.15.106:0/231411055 shutdown_connections 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- 172.21.15.106:0/231411055 wait complete. 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient: get_monmap_and_config 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient: monmap: 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:00.251305+0000 2024-04-25T23:55:00.242 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:00.251305+0000 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.243 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient: monmap: 2024-04-25T23:55:00.244 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.244 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:00.244 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:00.244 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.245 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 Processor -- start 2024-04-25T23:55:00.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- start start 2024-04-25T23:55:00.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient: init 2024-04-25T23:55:00.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 1 Processor -- start 2024-04-25T23:55:00.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 1 Processor -- start 2024-04-25T23:55:00.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 1 -- start start 2024-04-25T23:55:00.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient: init 2024-04-25T23:55:00.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient: _add_conns ranks=[8,2,4,5,6,3,7,0,1] 2024-04-25T23:55:00.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient(hunting): picked mon.noname-e con 0x7fda9c134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:00.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient(hunting): picked mon.noname-b con 0x7fda9c0a4820 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:00.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient(hunting): picked mon.noname-c con 0x7fda9c13e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c06dd40 con 0x7fda9c0a4820 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c0a2b10 con 0x7fda9c13e200 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c0a2df0 con 0x7fda9c134970 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fdaa224c640 10 monclient(hunting): authenticate will time out at 955.778436s 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient: _add_conns ranks=[0,5,6,7,3,2,1,8,4] 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient(hunting): picked mon.noname-a con 0x7f6f140a4820 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient(hunting): picked mon.noname-h con 0x7f6f14134970 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:00.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient(hunting): picked mon.noname-d con 0x7f6f1413e200 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f141cd1a0 con 0x7f6f140a4820 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1413b1a0 con 0x7f6f14134970 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f1413aec0 con 0x7f6f1413e200 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f1ac33640 10 monclient(hunting): authenticate will time out at 955.778387s 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9b7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fda9c134970 0x7fda9c134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42302/0 (socket says 172.21.15.106:42302) 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9b7fe640 1 -- 172.21.15.106:0/3233251691 learned_addr learned my addr 172.21.15.106:0/3233251691 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9bfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fda9c13e200 0x7fda9c1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48598/0 (socket says 172.21.15.106:48598) 2024-04-25T23:55:00.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f189cf640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6f140a4820 0x7f6f141cc380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55140/0 (socket says 172.21.15.106:55140) 2024-04-25T23:55:00.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f189cf640 1 -- 172.21.15.106:0/2564724785 learned_addr learned my addr 172.21.15.106:0/2564724785 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 1 -- start start 2024-04-25T23:55:00.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient: init 2024-04-25T23:55:00.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient: _add_conns ranks=[7,3,4,0,1,5,6,2,8] 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient(hunting): picked mon.noname-i con 0x7fcd8c021d50 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient(hunting): picked mon.noname-g con 0x7fcd8c022130 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient(hunting): picked mon.noname-c con 0x7fcd8c022530 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c023b80 con 0x7fcd8c022130 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c024a60 con 0x7fcd8c022530 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c025420 con 0x7fcd8c021d50 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9359e640 10 monclient(hunting): authenticate will time out at 955.778691s 2024-04-25T23:55:00.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1888929573 0 0) 0x7fda9c0a2df0 con 0x7fda9c134970 2024-04-25T23:55:00.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd92d9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fcd8c022530 0x7fcd8c0c1ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48608/0 (socket says 172.21.15.106:48608) 2024-04-25T23:55:00.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd92d9d640 1 -- 172.21.15.106:0/1190808389 learned_addr learned my addr 172.21.15.106:0/1190808389 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9a7fc640 10 monclient(hunting): my global_id is 4328 2024-04-25T23:55:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda84003530 con 0x7fda9c134970 2024-04-25T23:55:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3342606346 0 0) 0x7f6f1413aec0 con 0x7f6f1413e200 2024-04-25T23:55:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): my global_id is 4299 2024-04-25T23:55:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ef8003530 con 0x7f6f1413e200 2024-04-25T23:55:00.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200116923 0 0) 0x7fcd8c025420 con 0x7fcd8c021d50 2024-04-25T23:55:00.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): my global_id is 4291 2024-04-25T23:55:00.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd7c003530 con 0x7fcd8c021d50 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 755576434 0 0) 0x7f6ef8003530 con 0x7f6f1413e200 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f1413aec0 con 0x7f6f1413e200 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f0c001b20 con 0x7f6f1413e200 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): dump: 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.255 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.256 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7f6f117fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398583504 0 0) 0x7fcd8c023b80 con 0x7fcd8c022130 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 10 monclient(hunting): my global_id is 4296 2024-04-25T23:55:00.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.248+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd8c025420 con 0x7fcd8c022130 2024-04-25T23:55:00.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148682188 0 0) 0x7fda9c06dd40 con 0x7fda9c0a4820 2024-04-25T23:55:00.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient(hunting): my global_id is 4232 2024-04-25T23:55:00.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda9c0a2df0 con 0x7fda9c0a4820 2024-04-25T23:55:00.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2603913802 0 0) 0x7f6f141cd1a0 con 0x7f6f140a4820 2024-04-25T23:55:00.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient(hunting): my global_id is 4356 2024-04-25T23:55:00.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ef8003530 con 0x7f6f140a4820 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 254474456 0 0) 0x7fda84003530 con 0x7fda9c134970 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 >> v1:172.21.15.106:6791/0 conn(0x7fda9c13e200 legacy=0x7fda9c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 >> v1:172.21.15.106:6790/0 conn(0x7fda9c0a4820 legacy=0x7fda9c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 monclient: found mon.noname-e 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c0a30d0 con 0x7fda9c134970 2024-04-25T23:55:00.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda900017c0 con 0x7fda9c134970 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: dump: 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.261 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 5 monclient: authenticate success, global_id 4328 2024-04-25T23:55:00.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2525968844 0 0) 0x7fcd7c003530 con 0x7fcd8c021d50 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 >> v1:172.21.15.106:6791/0 conn(0x7fcd8c022530 legacy=0x7fcd8c0c1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 >> v1:172.21.15.171:6790/0 conn(0x7fcd8c022130 legacy=0x7fcd8c0be8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 monclient: found mon.noname-i 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c0259e0 con 0x7fcd8c021d50 2024-04-25T23:55:00.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd840016f0 con 0x7fcd8c021d50 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: dump: 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.264 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 5 monclient: authenticate success, global_id 4291 2024-04-25T23:55:00.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:00.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda90001a70 con 0x7fda9c134970 2024-04-25T23:55:00.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 1 -- 172.21.15.106:0/3233251691 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda90004bf0 con 0x7fda9c134970 2024-04-25T23:55:00.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fda9a7fc640 10 monclient: dump: 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.267 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 4 set_mon_vals no callback set 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 10 monclient: shutdown 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 1 -- 172.21.15.106:0/3233251691 >> v1:172.21.15.106:6793/0 conn(0x7fda9c134970 legacy=0x7fda9c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2648885324 0 0) 0x7f6f1413aec0 con 0x7f6f1413e200 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 >> v1:172.21.15.171:6791/0 conn(0x7f6f14134970 legacy=0x7f6f141cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 >> v1:172.21.15.106:6789/0 conn(0x7f6f140a4820 legacy=0x7f6f141cc380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 monclient: found mon.d 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f14137690 con 0x7f6f1413e200 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 5 monclient: authenticate success, global_id 4299 2024-04-25T23:55:00.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 10 monclient: _renew_subs 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f1413bb80 con 0x7f6f1413e200 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 10 monclient: _renew_subs 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f14138240 con 0x7f6f1413e200 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f0c0020b0 con 0x7f6f1413e200 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f0c0054a0 con 0x7f6f1413e200 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:00.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f12ffd640 4 set_mon_vals no callback set 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 10 monclient: dump: 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.271 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.272 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.272 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.272 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.272 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.272 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd84001950 con 0x7fcd8c021d50 2024-04-25T23:55:00.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 1 -- 172.21.15.106:0/1190808389 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd84003600 con 0x7fcd8c021d50 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9159a640 10 monclient: dump: 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.273 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 4 set_mon_vals no callback set 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 10 monclient: shutdown 2024-04-25T23:55:00.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 1 -- 172.21.15.106:0/1190808389 >> v1:172.21.15.171:6792/0 conn(0x7fcd8c021d50 legacy=0x7fcd8c023470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 1 -- 172.21.15.106:0/1190808389 shutdown_connections 2024-04-25T23:55:00.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 1 -- 172.21.15.106:0/1190808389 >> 172.21.15.106:0/1190808389 conn(0x7fcd8c0284f0 msgr2=0x7fcd8c028900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 1 -- 172.21.15.106:0/3233251691 shutdown_connections 2024-04-25T23:55:00.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fdaa224c640 1 -- 172.21.15.106:0/3233251691 >> 172.21.15.106:0/3233251691 conn(0x7fda9c0a9e20 msgr2=0x7fda9c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 1 -- 172.21.15.106:0/1190808389 shutdown_connections 2024-04-25T23:55:00.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 1 -- 172.21.15.106:0/1190808389 wait complete. 2024-04-25T23:55:00.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:00.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f14067160 con 0x7f6f1413e200 2024-04-25T23:55:00.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f6f0c010210 con 0x7f6f1413e200 2024-04-25T23:55:00.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 10 monclient: monmap: 2024-04-25T23:55:00.277 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.277 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:00.277 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:00.277 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.278 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 1 Processor -- start 2024-04-25T23:55:00.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 1 -- start start 2024-04-25T23:55:00.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7fcd9359e640 10 monclient: init 2024-04-25T23:55:00.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.252+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f6f0c0445d0 con 0x7f6f1413e200 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient: get_monmap_and_config 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient: monmap: 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:00.258539+0000 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:00.258539+0000 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.280 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.281 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _add_conns ranks=[2,3,8,7,4,5,6,0,1] 2024-04-25T23:55:00.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient(hunting): picked mon.noname-b con 0x7fcd8c021d50 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:00.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient(hunting): picked mon.noname-g con 0x7fcd8c022130 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient(hunting): picked mon.noname-e con 0x7fcd8c022530 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0bfb70 con 0x7fcd8c021d50 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0c0b60 con 0x7fcd8c022130 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd8c0be9a0 con 0x7fcd8c022530 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient(hunting): authenticate will time out at 955.784439s 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd92d9d640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fcd8c022530 0x7fcd8c15a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42316/0 (socket says 172.21.15.106:42316) 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd92d9d640 1 -- 172.21.15.106:0/1952624264 learned_addr learned my addr 172.21.15.106:0/1952624264 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189116924 0 0) 0x7fcd8c0be9a0 con 0x7fcd8c022530 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): my global_id is 4337 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd74003530 con 0x7fcd8c022530 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555001300 0 0) 0x7fcd8c0c0b60 con 0x7fcd8c022130 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): my global_id is 4305 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd8c0be9a0 con 0x7fcd8c022130 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2105147364 0 0) 0x7fcd74003530 con 0x7fcd8c022530 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd8c0c0b60 con 0x7fcd8c022530 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd94061f70 con 0x7fcd8c022530 2024-04-25T23:55:00.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): dump: 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.286 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2932419739 0 0) 0x7fcd8c0c0b60 con 0x7fcd8c022530 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 >> v1:172.21.15.171:6790/0 conn(0x7fcd8c022130 legacy=0x7fcd8c156be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 >> v1:172.21.15.106:6790/0 conn(0x7fcd8c021d50 legacy=0x7fcd8c0b66d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 monclient: found mon.e 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c024c80 con 0x7fcd8c022530 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 5 monclient: authenticate success, global_id 4337 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _renew_subs 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c024730 con 0x7fcd8c022530 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _renew_subs 2024-04-25T23:55:00.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fcd8c0be6f0 con 0x7fcd8c022530 2024-04-25T23:55:00.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 1 Processor -- start 2024-04-25T23:55:00.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 1 -- start start 2024-04-25T23:55:00.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient: init 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd940504a0 con 0x7fcd8c022530 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd940627c0 con 0x7fcd8c022530 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 10 monclient: dump: 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.292 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd90d99640 4 set_mon_vals no callback set 2024-04-25T23:55:00.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient: _add_conns ranks=[5,8,7,4,6,0,2,1,3] 2024-04-25T23:55:00.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient(hunting): picked mon.noname-h con 0x7f6cf009f830 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:00.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient(hunting): picked mon.noname-e con 0x7f6cf009b260 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:00.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient(hunting): picked mon.noname-i con 0x7f6cf0139b90 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:00.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd78005090 con 0x7fcd8c022530 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf0134420 con 0x7f6cf009f830 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf4994640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f6cf009b260 0x7f6cf009fc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42320/0 (socket says 172.21.15.106:42320) 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf4994640 1 -- 172.21.15.106:0/1208761820 learned_addr learned my addr 172.21.15.106:0/1208761820 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 1 -- 172.21.15.106:0/1208761820 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf009c710 con 0x7f6cf0139b90 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 1 -- 172.21.15.106:0/1208761820 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf00a0320 con 0x7f6cf009b260 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6cf6197640 10 monclient(hunting): authenticate will time out at 955.787382s 2024-04-25T23:55:00.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957143736 0 0) 0x7f6cf00a0320 con 0x7f6cf009b260 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): my global_id is 4346 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cdc003530 con 0x7f6cf009b260 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853470805 0 0) 0x7f6cf009c710 con 0x7f6cf0139b90 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7fcd94062960 con 0x7fcd8c022530 2024-04-25T23:55:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 10 monclient(hunting): my global_id is 4300 2024-04-25T23:55:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cf00a0320 con 0x7f6cf0139b90 2024-04-25T23:55:00.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fcd940bf000 con 0x7fcd8c022530 2024-04-25T23:55:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3584146675 0 0) 0x7f6cf00a0320 con 0x7f6cf0139b90 2024-04-25T23:55:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 >> v1:172.21.15.106:6793/0 conn(0x7f6cf009b260 legacy=0x7f6cf009fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.256+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 >> v1:172.21.15.171:6791/0 conn(0x7f6cf009f830 legacy=0x7f6cf0133d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:55:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fcd9259c640 10 monclient: get_auth_request con 0x7fcd74037840 auth_method 0 2024-04-25T23:55:00.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- 172.21.15.106:0/3233251691 shutdown_connections 2024-04-25T23:55:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7f6f189cf640 10 monclient: get_auth_request con 0x7f6ef8037920 auth_method 0 2024-04-25T23:55:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- 172.21.15.106:0/3233251691 wait complete. 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: monmap: 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 Processor -- start 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- start start 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: init 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _add_conns ranks=[4,5,2,3,7,0,8,6,1] 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient(hunting): picked mon.noname-c con 0x7fda9c0a4820 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient(hunting): picked mon.noname-h con 0x7fda9c134970 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient(hunting): picked mon.noname-b con 0x7fda9c13e200 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c09e1e0 con 0x7fda9c13e200 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c09e4c0 con 0x7fda9c0a4820 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda9c09cee0 con 0x7fda9c134970 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient(hunting): authenticate will time out at 955.790013s 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda9b7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fda9c0a4820 0x7fda9c09f9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48620/0 (socket says 172.21.15.106:48620) 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda9b7fe640 1 -- 172.21.15.106:0/602983422 learned_addr learned my addr 172.21.15.106:0/602983422 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2063650359 0 0) 0x7fda9c09e4c0 con 0x7fda9c0a4820 2024-04-25T23:55:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): my global_id is 4324 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda88003530 con 0x7fda9c0a4820 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3415599978 0 0) 0x7fda88003530 con 0x7fda9c0a4820 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda9c09e4c0 con 0x7fda9c0a4820 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda90004b30 con 0x7fda9c0a4820 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): dump: 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286472461 0 0) 0x7fda9c09e1e0 con 0x7fda9c13e200 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient(hunting): my global_id is 4241 2024-04-25T23:55:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda88003530 con 0x7fda9c13e200 2024-04-25T23:55:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2107131914 0 0) 0x7fda9c09e4c0 con 0x7fda9c0a4820 2024-04-25T23:55:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 >> v1:172.21.15.171:6791/0 conn(0x7fda9c134970 legacy=0x7fda9c1d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 >> v1:172.21.15.106:6790/0 conn(0x7fda9c13e200 legacy=0x7fda9c1d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 monclient: found mon.c 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda9c0a1e00 con 0x7fda9c0a4820 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 5 monclient: authenticate success, global_id 4324 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _renew_subs 2024-04-25T23:55:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda9c09c160 con 0x7fda9c0a4820 2024-04-25T23:55:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _renew_subs 2024-04-25T23:55:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fda9c1cc650 con 0x7fda9c0a4820 2024-04-25T23:55:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 1 monclient: found mon.noname-i 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf00a3470 con 0x7f6cf0139b90 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6ce8001b40 con 0x7f6cf0139b90 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: dump: 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.313 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 5 monclient: authenticate success, global_id 4300 2024-04-25T23:55:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda90001a70 con 0x7fda9c0a4820 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ce8001e60 con 0x7f6cf0139b90 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda9c067160 con 0x7fda9c0a4820 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.260+0000 7fda83fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda90005240 con 0x7fda9c0a4820 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda83fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda99ffb640 4 set_mon_vals no callback set 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda83fff640 10 monclient: dump: 2024-04-25T23:55:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.316 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7fda9000ffb0 con 0x7fda9c0a4820 2024-04-25T23:55:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 1 -- 172.21.15.106:0/1208761820 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6ce80020d0 con 0x7f6cf0139b90 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6ce7fff640 10 monclient: dump: 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 4 set_mon_vals no callback set 2024-04-25T23:55:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fcd9406c420 con 0x7fcd8c022530 2024-04-25T23:55:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fcd82ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fcd82ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 10 monclient: shutdown 2024-04-25T23:55:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 1 -- 172.21.15.106:0/1208761820 >> v1:172.21.15.171:6792/0 conn(0x7f6cf0139b90 legacy=0x7f6cf013bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 1 -- 172.21.15.106:0/1208761820 shutdown_connections 2024-04-25T23:55:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 1 -- 172.21.15.106:0/1208761820 >> 172.21.15.106:0/1208761820 conn(0x7f6cf00a66a0 msgr2=0x7f6cf00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 1 -- 172.21.15.106:0/1208761820 shutdown_connections 2024-04-25T23:55:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 1 -- 172.21.15.106:0/1208761820 wait complete. 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 10 monclient: build_initial_monmap 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7f6cf6197640 10 monclient: monmap: 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:00.322 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fda90044480 con 0x7fda9c0a4820 2024-04-25T23:55:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.264+0000 7fda9affd640 10 monclient: get_auth_request con 0x7fda880377c0 auth_method 0 2024-04-25T23:55:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 1 Processor -- start 2024-04-25T23:55:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 1 -- start start 2024-04-25T23:55:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient: init 2024-04-25T23:55:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:00.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient: _add_conns ranks=[5,8,4,3,6,7,1,0,2] 2024-04-25T23:55:00.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6f0c015a90 con 0x7f6f1413e200 2024-04-25T23:55:00.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient(hunting): picked mon.noname-h con 0x7f6cf009b260 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:00.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6f117fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6f117fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fda90015940 con 0x7fda9c0a4820 2024-04-25T23:55:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7fda83fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7fda83fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient(hunting): picked mon.noname-e con 0x7f6cf009f830 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf4994640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f6cf009f830 0x7f6cf01cd160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42322/0 (socket says 172.21.15.106:42322) 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient(hunting): picked mon.noname-c con 0x7f6cf0139b90 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf0072f90 con 0x7f6cf0139b90 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf5195640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6cf009b260 0x7f6cf01298b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:58938/0 (socket says 172.21.15.106:58938) 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf5195640 1 -- 172.21.15.106:0/2413932528 learned_addr learned my addr 172.21.15.106:0/2413932528 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf0132e60 con 0x7f6cf009b260 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6cf006feb0 con 0x7f6cf009f830 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:00.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient(hunting): authenticate will time out at 955.798119s 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768235880 0 0) 0x7f6cf006feb0 con 0x7f6cf009f830 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): my global_id is 4355 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cd4003530 con 0x7f6cf009f830 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2738227033 0 0) 0x7f6cd4003530 con 0x7f6cf009f830 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6cf006feb0 con 0x7f6cf009f830 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6cec001a80 con 0x7f6cf009f830 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:00.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): dump: 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.331 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 86020017 0 0) 0x7f6cf00a3470 con 0x7f6cf0139b90 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient(hunting): my global_id is 4333 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6cd4003530 con 0x7f6cf0139b90 2024-04-25T23:55:00.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 616232515 0 0) 0x7f6cf006feb0 con 0x7f6cf009f830 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 >> v1:172.21.15.171:6791/0 conn(0x7f6cf009b260 legacy=0x7f6cf01298b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 >> v1:172.21.15.106:6791/0 conn(0x7f6cf0139b90 legacy=0x7f6cf01d0890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 monclient: found mon.e 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cf0070190 con 0x7f6cf009f830 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6ce5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 5 monclient: authenticate success, global_id 4355 2024-04-25T23:55:00.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient: _renew_subs 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6cf006ea00 con 0x7f6cf009f830 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient: _renew_subs 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.268+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f6cf0132430 con 0x7f6cf009f830 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6cec001ce0 con 0x7f6cf009f830 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce77fe640 4 set_mon_vals no callback set 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6cec004e60 con 0x7f6cf009f830 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:00.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 10 monclient: dump: 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:00.335 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 4) ==== 43962+0+0 (unknown 3958683947 0 0) 0x7f6cec005000 con 0x7f6cf009f830 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f6cec0442f0 con 0x7f6cf009f830 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6cf5195640 10 monclient: get_auth_request con 0x7f6cd4037930 auth_method 0 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6cf6197640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6cf6197640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6cf6197640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.272+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cd0005090 con 0x7f6cf009f830 2024-04-25T23:55:00.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.276+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6cec0156b0 con 0x7f6cf009f830 2024-04-25T23:55:00.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.280+0000 7f6ce5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:00.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.280+0000 7f6ce5ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.384+0000 7fbf3dffb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-25T23:55:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.384+0000 7fbf3dffb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-25T23:55:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.384+0000 7fbf3dffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.384+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fbf50062e50 con 0x7fbf5013e200 2024-04-25T23:55:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.384+0000 7fbf3ffff640 1 -- 172.21.15.106:0/56880054 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 3327677263) 0x7fbf48019d20 con 0x7fbf5013e200 2024-04-25T23:55:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.384+0000 7fbf3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-25T23:55:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.384+0000 7fbf3ffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:00.368 INFO:teuthology.orchestra.run.smithi106.stdout:47244640257 2024-04-25T23:55:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 >> v1:172.21.15.171:6812/722422047 conn(0x7fbf34037ef0 legacy=0x7fbf3403a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 10 monclient: shutdown 2024-04-25T23:55:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 >> v1:172.21.15.171:6791/0 conn(0x7fbf5013e200 legacy=0x7fbf501e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 shutdown_connections 2024-04-25T23:55:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 >> 172.21.15.106:0/56880054 conn(0x7fbf500a9e20 msgr2=0x7fbf501cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 shutdown_connections 2024-04-25T23:55:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.388+0000 7fbf3dffb640 1 -- 172.21.15.106:0/56880054 wait complete. 2024-04-25T23:55:00.394 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.1 2024-04-25T23:55:00.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.448+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fda90042390 con 0x7fda9c0a4820 2024-04-25T23:55:00.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.448+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6cec0116b0 con 0x7f6cf009f830 2024-04-25T23:55:00.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.448+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcd940bcf10 con 0x7fcd8c022530 2024-04-25T23:55:00.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.448+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f41980115f0 con 0x7f419c09c710 2024-04-25T23:55:00.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.448+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6f0c042540 con 0x7f6f1413e200 2024-04-25T23:55:00.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.456+0000 7f41a3f8f640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-25T23:55:00.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.456+0000 7f41a3f8f640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-25T23:55:00.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.456+0000 7f41a3f8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.456+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f419c062e50 con 0x7f419c09c710 2024-04-25T23:55:00.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.456+0000 7f41927fc640 1 -- 172.21.15.106:0/1245775390 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 555833778) 0x7f4198015850 con 0x7f419c09c710 2024-04-25T23:55:00.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.456+0000 7f41927fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-25T23:55:00.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.456+0000 7f41927fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:00.441 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 >> v1:172.21.15.171:6812/722422047 conn(0x7f4180037b10 legacy=0x7f4180039fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 10 monclient: shutdown 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 >> v1:172.21.15.106:6791/0 conn(0x7f419c09c710 legacy=0x7f419c12af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 shutdown_connections 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 >> 172.21.15.106:0/1245775390 conn(0x7f419c0a2d20 msgr2=0x7f419c134190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 shutdown_connections 2024-04-25T23:55:00.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.460+0000 7f41a3f8f640 1 -- 172.21.15.106:0/1245775390 wait complete. 2024-04-25T23:55:00.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6cf6197640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-25T23:55:00.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6cf6197640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-25T23:55:00.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6cf6197640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f6cd0005380 con 0x7f6cf009f830 2024-04-25T23:55:00.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6ce5ffb640 1 -- 172.21.15.106:0/2413932528 <== mon.8 v1:172.21.15.106:6793/0 11 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 555833778) 0x7f6cec01bb50 con 0x7f6cf009f830 2024-04-25T23:55:00.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6ce5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-25T23:55:00.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6ce5ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:00.451 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.468+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 >> v1:172.21.15.171:6812/722422047 conn(0x7f6cd4037930 legacy=0x7f6cd4039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.472+0000 7f6cf6197640 10 monclient: shutdown 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.472+0000 7f6cf6197640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.472+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 >> v1:172.21.15.106:6793/0 conn(0x7f6cf009f830 legacy=0x7f6cf01cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.472+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 shutdown_connections 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.472+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 >> 172.21.15.106:0/2413932528 conn(0x7f6cf00a66a0 msgr2=0x7f6cf00a1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.472+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 shutdown_connections 2024-04-25T23:55:00.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.472+0000 7f6cf6197640 1 -- 172.21.15.106:0/2413932528 wait complete. 2024-04-25T23:55:00.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.4 2024-04-25T23:55:00.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.5 2024-04-25T23:55:00.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.508+0000 7f6f1ac33640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-25T23:55:00.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.508+0000 7f6f1ac33640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-25T23:55:00.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.508+0000 7f6f1ac33640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:00.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.508+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6f14062e50 con 0x7f6f1413e200 2024-04-25T23:55:00.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f117fa640 1 -- 172.21.15.106:0/2564724785 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 555833778) 0x7f6f0c015390 con 0x7f6f1413e200 2024-04-25T23:55:00.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f117fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-25T23:55:00.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f117fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:00.493 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 >> v1:172.21.15.171:6812/722422047 conn(0x7f6ef8037920 legacy=0x7f6ef8039de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 10 monclient: shutdown 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 >> v1:172.21.15.106:6792/0 conn(0x7f6f1413e200 legacy=0x7f6f141d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 shutdown_connections 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 >> 172.21.15.106:0/2564724785 conn(0x7f6f140a9e20 msgr2=0x7f6f14130bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 shutdown_connections 2024-04-25T23:55:00.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.512+0000 7f6f1ac33640 1 -- 172.21.15.106:0/2564724785 wait complete. 2024-04-25T23:55:00.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.0 2024-04-25T23:55:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.572+0000 7fcd9359e640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-25T23:55:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.572+0000 7fcd9359e640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-25T23:55:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.572+0000 7fcd9359e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.572+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fcd78005380 con 0x7fcd8c022530 2024-04-25T23:55:00.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.576+0000 7fdaa224c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-25T23:55:00.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.576+0000 7fdaa224c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-25T23:55:00.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.576+0000 7fdaa224c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:00.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.576+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fda9c062e50 con 0x7fda9c0a4820 2024-04-25T23:55:00.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.576+0000 7fda83fff640 1 -- 172.21.15.106:0/602983422 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 3327677263) 0x7fda90032360 con 0x7fda9c0a4820 2024-04-25T23:55:00.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.576+0000 7fda83fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-25T23:55:00.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.576+0000 7fda83fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:00.559 INFO:teuthology.orchestra.run.smithi106.stdout:47244640257 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 >> v1:172.21.15.171:6812/722422047 conn(0x7fda880377c0 legacy=0x7fda88039c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 10 monclient: shutdown 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 >> v1:172.21.15.106:6791/0 conn(0x7fda9c0a4820 legacy=0x7fda9c09f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 shutdown_connections 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 >> 172.21.15.106:0/602983422 conn(0x7fda9c0a9e20 msgr2=0x7fda9c130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 shutdown_connections 2024-04-25T23:55:00.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.580+0000 7fdaa224c640 1 -- 172.21.15.106:0/602983422 wait complete. 2024-04-25T23:55:00.575 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640257 for osd.2 2024-04-25T23:55:00.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd82ffd640 1 -- 172.21.15.106:0/1952624264 <== mon.8 v1:172.21.15.106:6793/0 11 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 555833778) 0x7fcd94068ea0 con 0x7fcd8c022530 2024-04-25T23:55:00.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd82ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-25T23:55:00.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd82ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:00.635 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 >> v1:172.21.15.171:6812/722422047 conn(0x7fcd74037840 legacy=0x7fcd74039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 10 monclient: shutdown 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 >> v1:172.21.15.106:6793/0 conn(0x7fcd8c022530 legacy=0x7fcd8c15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 shutdown_connections 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 >> 172.21.15.106:0/1952624264 conn(0x7fcd8c0284f0 msgr2=0x7fcd8c0080b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 shutdown_connections 2024-04-25T23:55:00.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:00.652+0000 7fcd9359e640 1 -- 172.21.15.106:0/1952624264 wait complete. 2024-04-25T23:55:00.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640258 for osd.3 2024-04-25T23:55:01.395 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T23:55:01.459 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-25T23:55:01.469 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-25T23:55:01.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.536+0000 7f89cc39f640 10 monclient: get_monmap_and_config 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.536+0000 7f89cc39f640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.536+0000 7f89cc39f640 10 monclient: monmap: 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:01.541421+0000 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:01.541421+0000 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.521 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.536+0000 7f89cc39f640 1 Processor -- start 2024-04-25T23:55:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.536+0000 7f89cc39f640 1 -- start start 2024-04-25T23:55:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.536+0000 7f89cc39f640 10 monclient: init 2024-04-25T23:55:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: _add_conns ranks=[7,8,5,1,2,4,6,0,3] 2024-04-25T23:55:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): picked mon.noname-i con 0x7f89c40a2560 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): picked mon.noname-e con 0x7f89c40a3050 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): picked mon.noname-h con 0x7f89c413e380 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c406bb60 con 0x7f89c413e380 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c406c020 con 0x7f89c40a2560 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c409f900 con 0x7f89c40a3050 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): authenticate will time out at 957.068346s 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c993a640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f89c40a3050 0x7f89c413cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42328/0 (socket says 172.21.15.106:42328) 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c993a640 1 -- 172.21.15.106:0/1447869085 learned_addr learned my addr 172.21.15.106:0/1447869085 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 280134598 0 0) 0x7f89c409f900 con 0x7f89c40a3050 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient(hunting): my global_id is 4373 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b0003530 con 0x7f89c40a3050 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 105716818 0 0) 0x7f89b0003530 con 0x7f89c40a3050 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 >> v1:172.21.15.171:6792/0 conn(0x7f89c40a2560 legacy=0x7f89c40a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 >> v1:172.21.15.171:6791/0 conn(0x7f89c413e380 legacy=0x7f89c4140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 monclient: found mon.noname-e 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c409fbe0 con 0x7f89c40a3050 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89b40017c0 con 0x7f89c40a3050 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: dump: 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.528 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 5 monclient: authenticate success, global_id 4373 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89b4001a20 con 0x7f89c40a3050 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 1 -- 172.21.15.106:0/1447869085 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89b4004bf0 con 0x7f89c40a3050 2024-04-25T23:55:01.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89c9139640 10 monclient: dump: 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.530 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.531 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.531 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.531 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.531 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:01.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 4 set_mon_vals no callback set 2024-04-25T23:55:01.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: shutdown 2024-04-25T23:55:01.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- 172.21.15.106:0/1447869085 >> v1:172.21.15.106:6793/0 conn(0x7f89c40a3050 legacy=0x7f89c413cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- 172.21.15.106:0/1447869085 shutdown_connections 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- 172.21.15.106:0/1447869085 >> 172.21.15.106:0/1447869085 conn(0x7f89c40a3650 msgr2=0x7f89c40a3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- 172.21.15.106:0/1447869085 shutdown_connections 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- 172.21.15.106:0/1447869085 wait complete. 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: monmap: 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.535 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 Processor -- start 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- start start 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: init 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient: _add_conns ranks=[2,1,3,7,6,5,8,0,4] 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): picked mon.noname-b con 0x7f89c40a2560 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): picked mon.noname-f con 0x7f89c40a3050 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): picked mon.noname-g con 0x7f89c413e380 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c4127fd0 con 0x7f89c40a3050 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c409f420 con 0x7f89c40a2560 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89c40728b0 con 0x7f89c413e380 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89cc39f640 10 monclient(hunting): authenticate will time out at 957.071552s 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89ca13b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f89c40a2560 0x7f89c413c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49086/0 (socket says 172.21.15.106:49086) 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89ca13b640 1 -- 172.21.15.106:0/626013699 learned_addr learned my addr 172.21.15.106:0/626013699 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482467873 0 0) 0x7f89c409f420 con 0x7f89c40a2560 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89baffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89baffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89baffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89baffd640 10 monclient(hunting): my global_id is 4250 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.540+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a8003530 con 0x7f89c40a2560 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4291600265 0 0) 0x7f89a8003530 con 0x7f89c40a2560 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89c409f420 con 0x7f89c40a2560 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268431746 0 0) 0x7f89c40728b0 con 0x7f89c413e380 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): my global_id is 4314 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a8003530 con 0x7f89c413e380 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89c0001b20 con 0x7f89c40a2560 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:01.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): dump: 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.539 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582633517 0 0) 0x7f89c4127fd0 con 0x7f89c40a3050 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient(hunting): my global_id is 4285 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c40728b0 con 0x7f89c40a3050 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2510053301 0 0) 0x7f89c409f420 con 0x7f89c40a2560 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 >> v1:172.21.15.171:6790/0 conn(0x7f89c413e380 legacy=0x7f89c41d5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 >> v1:172.21.15.171:6789/0 conn(0x7f89c40a3050 legacy=0x7f89c41d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 monclient: found mon.b 2024-04-25T23:55:01.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c4127cf0 con 0x7f89c40a2560 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89cc39f640 5 monclient: authenticate success, global_id 4250 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89cc39f640 10 monclient: _renew_subs 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89cc39f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89c4126550 con 0x7f89c40a2560 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89cc39f640 10 monclient: _renew_subs 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89cc39f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f89c4126a60 con 0x7f89c40a2560 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89c00038d0 con 0x7f89c40a2560 2024-04-25T23:55:01.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89c0003e40 con 0x7f89c40a2560 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89c8938640 4 set_mon_vals no callback set 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 10 monclient: dump: 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.542 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f89c0003fe0 con 0x7f89c40a2560 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89b8ff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89b8ff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89b8ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89b8ff9640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89a0005090 con 0x7f89c40a2560 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f89c00445e0 con 0x7f89c40a2560 2024-04-25T23:55:01.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.544+0000 7f89c993a640 10 monclient: get_auth_request con 0x7f89a8037a90 auth_method 0 2024-04-25T23:55:01.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.552+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f89c00158a0 con 0x7f89c40a2560 2024-04-25T23:55:01.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.552+0000 7f89baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.552+0000 7f89baffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:01.576 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient: get_monmap_and_config 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient: monmap: 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:01.599951+0000 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:01.599951+0000 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 1 Processor -- start 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 1 -- start start 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient: init 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient: _add_conns ranks=[8,4,7,2,6,3,5,0,1] 2024-04-25T23:55:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient(hunting): picked mon.noname-e con 0x7fb2500a3670 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient(hunting): picked mon.noname-c con 0x7fb250137f40 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient(hunting): picked mon.noname-i con 0x7fb250138320 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2500680d0 con 0x7fb250137f40 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24f7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fb2500a3670 0x7fb250137830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42342/0 (socket says 172.21.15.106:42342) 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24f7fe640 1 -- 172.21.15.106:0/1031634728 learned_addr learned my addr 172.21.15.106:0/1031634728 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 1 -- 172.21.15.106:0/1031634728 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25006e0d0 con 0x7fb250138320 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 1 -- 172.21.15.106:0/1031634728 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2500a3e50 con 0x7fb2500a3670 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 10 monclient(hunting): authenticate will time out at 957.127038s 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229460452 0 0) 0x7fb2500a3e50 con 0x7fb2500a3670 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): my global_id is 4382 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb238003530 con 0x7fb2500a3670 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 918042572 0 0) 0x7fb2500680d0 con 0x7fb250137f40 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient(hunting): my global_id is 4342 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2500a3e50 con 0x7fb250137f40 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3366710997 0 0) 0x7fb238003530 con 0x7fb2500a3670 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 >> v1:172.21.15.171:6792/0 conn(0x7fb250138320 legacy=0x7fb250140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 >> v1:172.21.15.106:6791/0 conn(0x7fb250137f40 legacy=0x7fb25013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 monclient: found mon.noname-e 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2500a4090 con 0x7fb2500a3670 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb240001800 con 0x7fb2500a3670 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: dump: 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 5 monclient: authenticate success, global_id 4382 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb255c77640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb240001a60 con 0x7fb2500a3670 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 1 -- 172.21.15.106:0/1031634728 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb240004bf0 con 0x7fb2500a3670 2024-04-25T23:55:01.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.596+0000 7fb24e7fc640 10 monclient: dump: 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.587 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.588 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 4 set_mon_vals no callback set 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: shutdown 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/1031634728 >> v1:172.21.15.106:6793/0 conn(0x7fb2500a3670 legacy=0x7fb250137830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/1031634728 shutdown_connections 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/1031634728 >> 172.21.15.106:0/1031634728 conn(0x7fb25006b210 msgr2=0x7fb25006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/1031634728 shutdown_connections 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/1031634728 wait complete. 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: monmap: 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:01.593 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 Processor -- start 2024-04-25T23:55:01.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- start start 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: init 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: _add_conns ranks=[5,6,4,7,8,3,1,0,2] 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient(hunting): picked mon.noname-h con 0x7fb250137f40 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient(hunting): picked mon.noname-d con 0x7fb250138320 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb24effd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb250138320 0x7fb2501303c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43560/0 (socket says 172.21.15.106:43560) 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb24effd640 1 -- 172.21.15.106:0/2609528238 learned_addr learned my addr 172.21.15.106:0/2609528238 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient(hunting): picked mon.noname-c con 0x7fb2501d2a50 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb25006d8c0 con 0x7fb2501d2a50 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2501338d0 con 0x7fb250137f40 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb250135560 con 0x7fb250138320 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191656566 0 0) 0x7fb250135560 con 0x7fb250138320 2024-04-25T23:55:01.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient(hunting): authenticate will time out at 957.131045s 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): my global_id is 4317 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb23c003530 con 0x7fb250138320 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560203617 0 0) 0x7fb2480014a0 con 0x7fb2501d2a50 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): my global_id is 4351 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb250135560 con 0x7fb2501d2a50 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3497125858 0 0) 0x7fb23c003530 con 0x7fb250138320 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2480014a0 con 0x7fb250138320 2024-04-25T23:55:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb244001b00 con 0x7fb250138320 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): dump: 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.597 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1675614863 0 0) 0x7fb250135560 con 0x7fb2501d2a50 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb23c003530 con 0x7fb2501d2a50 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3705070492 0 0) 0x7fb2480014a0 con 0x7fb250138320 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 >> v1:172.21.15.171:6791/0 conn(0x7fb250137f40 legacy=0x7fb25012fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 >> v1:172.21.15.106:6791/0 conn(0x7fb2501d2a50 legacy=0x7fb2501d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 monclient: found mon.d 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25006d370 con 0x7fb250138320 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb237fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 5 monclient: authenticate success, global_id 4317 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: _renew_subs 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.600+0000 7fb255c77640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb250130ad0 con 0x7fb250138320 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb255c77640 10 monclient: _renew_subs 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb244003950 con 0x7fb250138320 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb255c77640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb255c77640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb250131fa0 con 0x7fb250138320 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb244003e40 con 0x7fb250138320 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 10 monclient: dump: 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.600 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb24dffb640 4 set_mon_vals no callback set 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb235ffb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb235ffb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb235ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb228005090 con 0x7fb250138320 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb244003fe0 con 0x7fb250138320 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fb244044400 con 0x7fb250138320 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.604+0000 7fb24f7fe640 10 monclient: get_auth_request con 0x7fb23c037b20 auth_method 0 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.608+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb244015720 con 0x7fb250138320 2024-04-25T23:55:01.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.608+0000 7fb237fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.608+0000 7fb237fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:01.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient: get_monmap_and_config 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient: monmap: 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:01.640178+0000 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:01.640178+0000 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.619 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.620 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 1 Processor -- start 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 1 -- start start 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient: init 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient: _add_conns ranks=[7,4,3,6,1,8,2,0,5] 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient(hunting): picked mon.noname-i con 0x7fc95c0a1bc0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient(hunting): picked mon.noname-c con 0x7fc95c0a0400 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:01.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient(hunting): picked mon.noname-g con 0x7fc95c0a26b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c09be20 con 0x7fc95c0a26b0 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c09d180 con 0x7fc95c0a0400 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c09fdb0 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 10 monclient(hunting): authenticate will time out at 957.166974s 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95bfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fc95c0a0400 0x7fc95c13abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48636/0 (socket says 172.21.15.106:48636) 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95bfff640 1 -- 172.21.15.106:0/2789678281 learned_addr learned my addr 172.21.15.106:0/2789678281 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96904060 0 0) 0x7fc95c09d180 con 0x7fc95c0a0400 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient(hunting): my global_id is 4360 2024-04-25T23:55:01.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc94c003530 con 0x7fc95c0a0400 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4268640244 0 0) 0x7fc94c003530 con 0x7fc95c0a0400 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 >> v1:172.21.15.171:6792/0 conn(0x7fc95c0a1bc0 legacy=0x7fc95c0a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 >> v1:172.21.15.171:6790/0 conn(0x7fc95c0a26b0 legacy=0x7fc95c13e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 monclient: found mon.noname-c 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c09b160 con 0x7fc95c0a0400 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9480017c0 con 0x7fc95c0a0400 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc95b7fe640 10 monclient: dump: 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.626 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 5 monclient: authenticate success, global_id 4360 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.636+0000 7fc962de7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc948001ab0 con 0x7fc95c0a0400 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc95b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc95b7fe640 1 -- 172.21.15.106:0/2789678281 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc948004bf0 con 0x7fc95c0a0400 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 4 set_mon_vals no callback set 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc95b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc95b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc95b7fe640 10 monclient: dump: 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.627 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: shutdown 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- 172.21.15.106:0/2789678281 >> v1:172.21.15.106:6791/0 conn(0x7fc95c0a0400 legacy=0x7fc95c13abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- 172.21.15.106:0/2789678281 shutdown_connections 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- 172.21.15.106:0/2789678281 >> 172.21.15.106:0/2789678281 conn(0x7fc95c06b3e0 msgr2=0x7fc95c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- 172.21.15.106:0/2789678281 shutdown_connections 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- 172.21.15.106:0/2789678281 wait complete. 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: monmap: 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.629 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 Processor -- start 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- start start 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: init 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: _add_conns ranks=[8,4,1,7,3,2,5,6,0] 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient(hunting): picked mon.noname-e con 0x7fc95c0a1bc0 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient(hunting): picked mon.noname-c con 0x7fc95c0a26b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient(hunting): picked mon.noname-f con 0x7fc95c1cc330 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c09f330 con 0x7fc95c1cc330 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c1a9d60 con 0x7fc95c0a26b0 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95c1aa040 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient(hunting): authenticate will time out at 957.170325s 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc960b83640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc95c0a1bc0 0x7fc95c1bac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42354/0 (socket says 172.21.15.106:42354) 2024-04-25T23:55:01.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc960b83640 1 -- 172.21.15.106:0/2150515065 learned_addr learned my addr 172.21.15.106:0/2150515065 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462964375 0 0) 0x7fc95c1aa040 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): my global_id is 4391 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc940003530 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852772933 0 0) 0x7fc95c1a9d60 con 0x7fc95c0a26b0 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): my global_id is 4369 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc95c1aa040 con 0x7fc95c0a26b0 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151170497 0 0) 0x7fc95c09f330 con 0x7fc95c1cc330 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): my global_id is 4294 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc95c1a9d60 con 0x7fc95c1cc330 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1704556057 0 0) 0x7fc95c1aa040 con 0x7fc95c0a26b0 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc95c09f330 con 0x7fc95c0a26b0 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc948004b30 con 0x7fc95c0a26b0 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): dump: 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.636 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3265815113 0 0) 0x7fc940003530 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc95c1aa040 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc950001a40 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient(hunting): dump: 2024-04-25T23:55:01.637 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.638 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 727027548 0 0) 0x7fc95c1aa040 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 >> v1:172.21.15.106:6791/0 conn(0x7fc95c0a26b0 legacy=0x7fc95c1d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 >> v1:172.21.15.171:6789/0 conn(0x7fc95c1cc330 legacy=0x7fc95c1d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 monclient: found mon.e 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95c1ccd90 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc9597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 5 monclient: authenticate success, global_id 4391 2024-04-25T23:55:01.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: _renew_subs 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc95c1a88a0 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: _renew_subs 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.640+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fc95c1a9090 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc950001d00 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc950003c10 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 10 monclient: dump: 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.640 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc95affd640 4 set_mon_vals no callback set 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc950003db0 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fc950044290 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.644+0000 7fc95bfff640 10 monclient: get_auth_request con 0x7fc940037db0 auth_method 0 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.648+0000 7fc962de7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.648+0000 7fc962de7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.648+0000 7fc962de7640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.648+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93c005090 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.652+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc9500156f0 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.652+0000 7fc9597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.652+0000 7fc9597fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:01.652 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.676+0000 7fccbed9a640 10 monclient: get_monmap_and_config 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.676+0000 7fccbed9a640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.676+0000 7fccbed9a640 10 monclient: monmap: 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:01.681470+0000 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:01.681470+0000 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.660 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.661 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.676+0000 7fccbed9a640 1 Processor -- start 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- start start 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient: init 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient: _add_conns ranks=[6,5,8,7,2,1,0,3,4] 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient(hunting): picked mon.noname-d con 0x7fccb80a1b00 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient(hunting): picked mon.noname-h con 0x7fccb806be20 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient(hunting): picked mon.noname-e con 0x7fccb80a25f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb809eaa0 con 0x7fccb806be20 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb80a3410 con 0x7fccb80a1b00 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb809ed80 con 0x7fccb80a25f0 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient(hunting): authenticate will time out at 957.208898s 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbcb36640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fccb80a1b00 0x7fccb80a1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43566/0 (socket says 172.21.15.106:43566) 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbcb36640 1 -- 172.21.15.106:0/294917574 learned_addr learned my addr 172.21.15.106:0/294917574 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbd337640 1 --1- 172.21.15.106:0/294917574 >> v1:172.21.15.106:6793/0 conn(0x7fccb80a25f0 0x7fccb8140320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42366/0 (socket says 172.21.15.106:42366) 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980303971 0 0) 0x7fccb809ed80 con 0x7fccb80a25f0 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient(hunting): my global_id is 4400 2024-04-25T23:55:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcca8003530 con 0x7fccb80a25f0 2024-04-25T23:55:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 86610259 0 0) 0x7fcca8003530 con 0x7fccb80a25f0 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 >> v1:172.21.15.106:6792/0 conn(0x7fccb80a1b00 legacy=0x7fccb80a1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 >> v1:172.21.15.171:6791/0 conn(0x7fccb806be20 legacy=0x7fccb813cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 monclient: found mon.noname-e 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb806b470 con 0x7fccb80a25f0 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fccb0001b80 con 0x7fccb80a25f0 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: dump: 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fccb0001e60 con 0x7fccb80a25f0 2024-04-25T23:55:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 5 monclient: authenticate success, global_id 4400 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 1 -- 172.21.15.106:0/294917574 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fccb0004eb0 con 0x7fccb80a25f0 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccb77fe640 10 monclient: dump: 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 4 set_mon_vals no callback set 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 10 monclient: shutdown 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- 172.21.15.106:0/294917574 >> v1:172.21.15.106:6793/0 conn(0x7fccb80a25f0 legacy=0x7fccb8140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- 172.21.15.106:0/294917574 shutdown_connections 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- 172.21.15.106:0/294917574 >> 172.21.15.106:0/294917574 conn(0x7fccb80a6fe0 msgr2=0x7fccb80a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- 172.21.15.106:0/294917574 shutdown_connections 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.680+0000 7fccbed9a640 1 -- 172.21.15.106:0/294917574 wait complete. 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: monmap: 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 1 Processor -- start 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 1 -- start start 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: init 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: _add_conns ranks=[5,3,4,8,2,0,7,6,1] 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient(hunting): picked mon.noname-h con 0x7fccb806be20 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient(hunting): picked mon.noname-g con 0x7fccb80a1b00 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient(hunting): picked mon.noname-c con 0x7fccb80a25f0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb8139390 con 0x7fccb80a1b00 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb813f750 con 0x7fccb80a25f0 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccb811d230 con 0x7fccb806be20 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient(hunting): authenticate will time out at 957.213594s 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbd337640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fccb80a25f0 0x7fccb81d9450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48656/0 (socket says 172.21.15.106:48656) 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbd337640 1 -- 172.21.15.106:0/2698166290 learned_addr learned my addr 172.21.15.106:0/2698166290 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155895616 0 0) 0x7fccb813f750 con 0x7fccb80a25f0 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): my global_id is 4378 2024-04-25T23:55:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc9c003530 con 0x7fccb80a25f0 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 431508061 0 0) 0x7fcc9c003530 con 0x7fccb80a25f0 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccb813f750 con 0x7fccb80a25f0 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fccb00020d0 con 0x7fccb80a25f0 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): dump: 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2204695236 0 0) 0x7fccb8139390 con 0x7fccb80a1b00 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): my global_id is 4332 2024-04-25T23:55:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc9c003530 con 0x7fccb80a1b00 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204232150 0 0) 0x7fccb811d230 con 0x7fccb806be20 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient(hunting): my global_id is 4388 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccb8139390 con 0x7fccb806be20 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3137262557 0 0) 0x7fccb813f750 con 0x7fccb80a25f0 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 >> v1:172.21.15.171:6791/0 conn(0x7fccb806be20 legacy=0x7fccb8138570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 >> v1:172.21.15.171:6790/0 conn(0x7fccb80a1b00 legacy=0x7fccb8138c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 monclient: found mon.c 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccb81411a0 con 0x7fccb80a25f0 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 5 monclient: authenticate success, global_id 4378 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: _renew_subs 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fccb81405f0 con 0x7fccb80a25f0 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fccb0005160 con 0x7fccb80a25f0 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fccb0005650 con 0x7fccb80a25f0 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb6ffd640 4 set_mon_vals no callback set 2024-04-25T23:55:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccb57fa640 10 monclient: dump: 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.680 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: _renew_subs 2024-04-25T23:55:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.684+0000 7fccbed9a640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fccb813a0b0 con 0x7fccb80a25f0 2024-04-25T23:55:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.688+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fccb00103f0 con 0x7fccb80a25f0 2024-04-25T23:55:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.688+0000 7fcca2ffd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.688+0000 7fcca2ffd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.688+0000 7fcca2ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.688+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc90005090 con 0x7fccb80a25f0 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.688+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fccb0044d50 con 0x7fccb80a25f0 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.688+0000 7fccbcb36640 10 monclient: get_auth_request con 0x7fcc9c037b20 auth_method 0 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.696+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fccb0001e30 con 0x7fccb80a25f0 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.696+0000 7fccb57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.696+0000 7fccb57fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:01.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.752+0000 7f89b8ff9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-25T23:55:01.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.752+0000 7f89b8ff9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-25T23:55:01.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.752+0000 7f89b8ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:01.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.752+0000 7f89b8ff9640 1 -- 172.21.15.106:0/626013699 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f89a0005380 con 0x7f89c40a2560 2024-04-25T23:55:01.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89baffd640 1 -- 172.21.15.106:0/626013699 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 555833778) 0x7f89c00151a0 con 0x7f89c40a2560 2024-04-25T23:55:01.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89baffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-04-25T23:55:01.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89baffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:01.737 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient: get_monmap_and_config 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient: monmap: 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:01.759317+0000 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:01.759317+0000 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.738 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.739 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 1 Processor -- start 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 1 -- start start 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient: init 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient: _add_conns ranks=[7,4,8,6,2,0,3,1,5] 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient(hunting): picked mon.noname-i con 0x7f2dc0134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient(hunting): picked mon.noname-c con 0x7f2dc00a4820 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient(hunting): picked mon.noname-e con 0x7f2dc013e200 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:01.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc006dd40 con 0x7f2dc00a4820 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc00a2b10 con 0x7f2dc0134970 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc00a2df0 con 0x7f2dc013e200 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dc5e2a640 10 monclient(hunting): authenticate will time out at 957.286735s 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2db7fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f2dc00a4820 0x7f2dc013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48664/0 (socket says 172.21.15.106:48664) 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2db7fff640 1 -- 172.21.15.106:0/2104609454 learned_addr learned my addr 172.21.15.106:0/2104609454 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 >> v1:172.21.15.171:6812/722422047 conn(0x7f89a8037a90 legacy=0x7f89a8039f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936623148 0 0) 0x7f2dc00a2df0 con 0x7f2dc013e200 2024-04-25T23:55:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dbeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dbeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dbeffd640 10 monclient(hunting): my global_id is 4409 2024-04-25T23:55:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2da0003530 con 0x7f2dc013e200 2024-04-25T23:55:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 10 monclient: shutdown 2024-04-25T23:55:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 >> v1:172.21.15.106:6790/0 conn(0x7f89c40a2560 legacy=0x7f89c413c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 shutdown_connections 2024-04-25T23:55:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 >> 172.21.15.106:0/626013699 conn(0x7f89c40a3650 msgr2=0x7f89c4070270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 shutdown_connections 2024-04-25T23:55:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.756+0000 7f89cc39f640 1 -- 172.21.15.106:0/626013699 wait complete. 2024-04-25T23:55:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560136760 0 0) 0x7f2dc00a2b10 con 0x7f2dc0134970 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient(hunting): my global_id is 4345 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc00a2df0 con 0x7f2dc0134970 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2605669747 0 0) 0x7f2da0003530 con 0x7f2dc013e200 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 >> v1:172.21.15.171:6792/0 conn(0x7f2dc0134970 legacy=0x7f2dc0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 >> v1:172.21.15.106:6791/0 conn(0x7f2dc00a4820 legacy=0x7f2dc013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 monclient: found mon.noname-e 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc00a30d0 con 0x7f2dc013e200 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2db8001a70 con 0x7f2dc013e200 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: dump: 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.745 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dc5e2a640 5 monclient: authenticate success, global_id 4409 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dc5e2a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2db8001d20 con 0x7f2dc013e200 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 1 -- 172.21.15.106:0/2104609454 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2db8003cc0 con 0x7f2dc013e200 2024-04-25T23:55:01.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.760+0000 7f2dbeffd640 10 monclient: dump: 2024-04-25T23:55:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.747 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.764+0000 7f2dc5e2a640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.764+0000 7f2dc5e2a640 4 set_mon_vals no callback set 2024-04-25T23:55:01.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.764+0000 7f2dc5e2a640 10 monclient: shutdown 2024-04-25T23:55:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.764+0000 7f2dc5e2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.764+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/2104609454 >> v1:172.21.15.106:6793/0 conn(0x7f2dc013e200 legacy=0x7f2dc01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.764+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/2104609454 shutdown_connections 2024-04-25T23:55:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.764+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/2104609454 >> 172.21.15.106:0/2104609454 conn(0x7f2dc00a9e20 msgr2=0x7f2dc00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/2104609454 shutdown_connections 2024-04-25T23:55:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/2104609454 wait complete. 2024-04-25T23:55:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient: monmap: 2024-04-25T23:55:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 1 Processor -- start 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 1 -- start start 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient: init 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient: _add_conns ranks=[6,8,0,1,5,4,7,2,3] 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient(hunting): picked mon.noname-d con 0x7f2dc00a4820 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient(hunting): picked mon.noname-e con 0x7f2dc0134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient(hunting): picked mon.noname-a con 0x7f2dc013e200 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc01da270 con 0x7f2dc013e200 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc00a1a40 con 0x7f2dc00a4820 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2dc00a1e00 con 0x7f2dc0134970 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dc5e2a640 10 monclient(hunting): authenticate will time out at 957.298437s 2024-04-25T23:55:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2db7fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f2dc0134970 0x7f2dc01d9b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42390/0 (socket says 172.21.15.106:42390) 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2db7fff640 1 -- 172.21.15.106:0/1231752300 learned_addr learned my addr 172.21.15.106:0/1231752300 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123281535 0 0) 0x7f2dc00a1e00 con 0x7f2dc0134970 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): my global_id is 4418 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2da4003530 con 0x7f2dc0134970 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918252188 0 0) 0x7f2dc01da270 con 0x7f2dc013e200 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): my global_id is 4365 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dc00a1e00 con 0x7f2dc013e200 2024-04-25T23:55:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3530360073 0 0) 0x7f2da4003530 con 0x7f2dc0134970 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2dc01da270 con 0x7f2dc0134970 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2db0001950 con 0x7f2dc0134970 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): dump: 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3157321663 0 0) 0x7f2dc00a1e00 con 0x7f2dc013e200 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2da4003530 con 0x7f2dc013e200 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2db8001a70 con 0x7f2dc013e200 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 10 monclient(hunting): dump: 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.757 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.768+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 706575520 0 0) 0x7f2dc01da270 con 0x7f2dc0134970 2024-04-25T23:55:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 >> v1:172.21.15.106:6792/0 conn(0x7f2dc00a4820 legacy=0x7f2dc01d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 >> v1:172.21.15.106:6789/0 conn(0x7f2dc013e200 legacy=0x7f2dc01e16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 monclient: found mon.e 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2dc013ae90 con 0x7f2dc0134970 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 5 monclient: authenticate success, global_id 4418 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 10 monclient: _renew_subs 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2dc013a5f0 con 0x7f2dc0134970 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2db0001c70 con 0x7f2dc0134970 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2db0004de0 con 0x7f2dc0134970 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 10 monclient: dump: 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 10 monclient: _renew_subs 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f2dc0139950 con 0x7f2dc0134970 2024-04-25T23:55:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbe7fc640 4 set_mon_vals no callback set 2024-04-25T23:55:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2db0004f80 con 0x7f2dc0134970 2024-04-25T23:55:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f2db00442f0 con 0x7f2dc0134970 2024-04-25T23:55:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dc0067160 con 0x7f2dc0134970 2024-04-25T23:55:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.772+0000 7f2dbf7fe640 10 monclient: get_auth_request con 0x7f2da4037e00 auth_method 0 2024-04-25T23:55:01.765 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640258 for osd.1 2024-04-25T23:55:01.765 DEBUG:teuthology.parallel:result is None 2024-04-25T23:55:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.784+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2db0015550 con 0x7f2dc0134970 2024-04-25T23:55:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.784+0000 7f2dbcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.784+0000 7f2dbcff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:01.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.800+0000 7fb235ffb640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-25T23:55:01.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.800+0000 7fb235ffb640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-25T23:55:01.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.800+0000 7fb235ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:01.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.800+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fb228005380 con 0x7fb250138320 2024-04-25T23:55:01.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.800+0000 7fb237fff640 1 -- 172.21.15.106:0/2609528238 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 847495621) 0x7fb244015020 con 0x7fb250138320 2024-04-25T23:55:01.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.800+0000 7fb237fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-04-25T23:55:01.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.800+0000 7fb237fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:01.785 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 >> v1:172.21.15.171:6812/722422047 conn(0x7fb23c037b20 legacy=0x7fb23c039fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 10 monclient: shutdown 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 >> v1:172.21.15.106:6792/0 conn(0x7fb250138320 legacy=0x7fb2501303c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 shutdown_connections 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 >> 172.21.15.106:0/2609528238 conn(0x7fb25006b210 msgr2=0x7fb250067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 shutdown_connections 2024-04-25T23:55:01.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.804+0000 7fb235ffb640 1 -- 172.21.15.106:0/2609528238 wait complete. 2024-04-25T23:55:01.802 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.4 2024-04-25T23:55:01.802 DEBUG:teuthology.parallel:result is None 2024-04-25T23:55:01.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient: get_monmap_and_config 2024-04-25T23:55:01.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient: monmap: 2024-04-25T23:55:01.803 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.803 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.803 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:01.824303+0000 2024-04-25T23:55:01.803 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:01.824303+0000 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.804 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 1 Processor -- start 2024-04-25T23:55:01.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 1 -- start start 2024-04-25T23:55:01.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient: init 2024-04-25T23:55:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient: _add_conns ranks=[2,7,6,3,5,1,4,8,0] 2024-04-25T23:55:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient(hunting): picked mon.noname-b con 0x7f21cc1345e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient(hunting): picked mon.noname-i con 0x7f21cc09cca0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient(hunting): picked mon.noname-d con 0x7f21cc13dfc0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc134020 con 0x7f21cc1345e0 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc09b590 con 0x7f21cc13dfc0 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc09bca0 con 0x7f21cc09cca0 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 10 monclient(hunting): authenticate will time out at 957.351149s 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d1b9a640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f21cc1345e0 0x7f21cc1349c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49092/0 (socket says 172.21.15.106:49092) 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d239b640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f21cc13dfc0 0x7f21cc1403b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43576/0 (socket says 172.21.15.106:43576) 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d1b9a640 1 -- 172.21.15.106:0/1204184486 learned_addr learned my addr 172.21.15.106:0/1204184486 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2922282157 0 0) 0x7f21cc09b590 con 0x7f21cc13dfc0 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): my global_id is 4335 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21b8003530 con 0x7f21cc13dfc0 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885134040 0 0) 0x7f21c8001050 con 0x7f21cc1345e0 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient(hunting): my global_id is 4259 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21cc09b590 con 0x7f21cc1345e0 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4195679112 0 0) 0x7f21cc09b590 con 0x7f21cc1345e0 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 >> v1:172.21.15.171:6792/0 conn(0x7f21cc09cca0 legacy=0x7f21cc13c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 >> v1:172.21.15.106:6792/0 conn(0x7f21cc13dfc0 legacy=0x7f21cc1403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 monclient: found mon.noname-b 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc09bf80 con 0x7f21cc1345e0 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21c80018e0 con 0x7f21cc1345e0 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d0b98640 10 monclient: dump: 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.813 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.814 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.820+0000 7f21d3dfe640 5 monclient: authenticate success, global_id 4259 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21c8001ad0 con 0x7f21cc1345e0 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d0b98640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d0b98640 1 -- 172.21.15.106:0/1204184486 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21c8001d00 con 0x7f21cc1345e0 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d0b98640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d0b98640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d0b98640 10 monclient: dump: 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.815 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 4 set_mon_vals no callback set 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: shutdown 2024-04-25T23:55:01.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- 172.21.15.106:0/1204184486 >> v1:172.21.15.106:6790/0 conn(0x7f21cc1345e0 legacy=0x7f21cc1349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- 172.21.15.106:0/1204184486 shutdown_connections 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- 172.21.15.106:0/1204184486 >> 172.21.15.106:0/1204184486 conn(0x7f21cc06b3e0 msgr2=0x7f21cc06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- 172.21.15.106:0/1204184486 shutdown_connections 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- 172.21.15.106:0/1204184486 wait complete. 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: build_initial_monmap 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: monmap: 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.817 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 Processor -- start 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- start start 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: init 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:01.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: _add_conns ranks=[4,0,7,2,8,1,5,3,6] 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient(hunting): picked mon.noname-c con 0x7f21cc09cca0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient(hunting): picked mon.noname-a con 0x7f21cc1345e0 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient(hunting): picked mon.noname-i con 0x7f21cc13dfc0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc139010 con 0x7f21cc1345e0 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc1392f0 con 0x7f21cc09cca0 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21cc1395d0 con 0x7f21cc13dfc0 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient(hunting): authenticate will time out at 957.354306s 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d1399640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f21cc1345e0 0x7f21cc1362c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55162/0 (socket says 172.21.15.106:55162) 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d1399640 1 -- 172.21.15.106:0/4182902946 learned_addr learned my addr 172.21.15.106:0/4182902946 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d1b9a640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f21cc09cca0 0x7f21cc135bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48670/0 (socket says 172.21.15.106:48670) 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1194460160 0 0) 0x7f21cc1392f0 con 0x7f21cc09cca0 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): my global_id is 4387 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21b0003530 con 0x7f21cc09cca0 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671245446 0 0) 0x7f21cc139010 con 0x7f21cc1345e0 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): my global_id is 4374 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21cc1392f0 con 0x7f21cc1345e0 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2873154364 0 0) 0x7f21b0003530 con 0x7f21cc09cca0 2024-04-25T23:55:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21cc139010 con 0x7f21cc09cca0 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21c8001560 con 0x7f21cc09cca0 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): dump: 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3832870008 0 0) 0x7f21cc1392f0 con 0x7f21cc1345e0 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21b0003530 con 0x7f21cc1345e0 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21bc001a40 con 0x7f21cc1345e0 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): dump: 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289489364 0 0) 0x7f21cc1395d0 con 0x7f21cc13dfc0 2024-04-25T23:55:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient(hunting): my global_id is 4363 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21cc1392f0 con 0x7f21cc13dfc0 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3827477416 0 0) 0x7f21cc139010 con 0x7f21cc09cca0 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 >> v1:172.21.15.171:6792/0 conn(0x7f21cc13dfc0 legacy=0x7f21cc1d4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 >> v1:172.21.15.106:6789/0 conn(0x7f21cc1345e0 legacy=0x7f21cc1362c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 monclient: found mon.c 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21cc138120 con 0x7f21cc09cca0 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 5 monclient: authenticate success, global_id 4387 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: _renew_subs 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f21cc131c10 con 0x7f21cc09cca0 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: _renew_subs 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f21cc136ba0 con 0x7f21cc09cca0 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21c8004cd0 con 0x7f21cc09cca0 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21c80051c0 con 0x7f21cc09cca0 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c27fc640 10 monclient: dump: 2024-04-25T23:55:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:01.826 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.824+0000 7f21c3fff640 4 set_mon_vals no callback set 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.828+0000 7f21d3dfe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.828+0000 7f21d3dfe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.828+0000 7f21d3dfe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.828+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21cc067160 con 0x7f21cc09cca0 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.828+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f21c800ff60 con 0x7f21cc09cca0 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.828+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f21c8044390 con 0x7f21cc09cca0 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.828+0000 7f21d1399640 10 monclient: get_auth_request con 0x7f21b0037f30 auth_method 0 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.832+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f21cc134020 con 0x7f21cc09cca0 2024-04-25T23:55:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.832+0000 7f21c27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.832+0000 7f21c27fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-25T23:55:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-25T23:55:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fc93c005380 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc9597fa640 1 -- 172.21.15.106:0/2150515065 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 847495621) 0x7fc950014ff0 con 0x7fc95c0a1bc0 2024-04-25T23:55:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc9597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-04-25T23:55:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc9597fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:01.866 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 >> v1:172.21.15.171:6812/722422047 conn(0x7fc940037db0 legacy=0x7fc94003a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 10 monclient: shutdown 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 >> v1:172.21.15.106:6793/0 conn(0x7fc95c0a1bc0 legacy=0x7fc95c1bac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 shutdown_connections 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 >> 172.21.15.106:0/2150515065 conn(0x7fc95c06b3e0 msgr2=0x7fc95c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 shutdown_connections 2024-04-25T23:55:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.884+0000 7fc962de7640 1 -- 172.21.15.106:0/2150515065 wait complete. 2024-04-25T23:55:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-25T23:55:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-25T23:55:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fcc90005380 con 0x7fccb80a25f0 2024-04-25T23:55:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fccb57fa640 1 -- 172.21.15.106:0/2698166290 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 847495621) 0x7fccb0015e70 con 0x7fccb80a25f0 2024-04-25T23:55:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fccb57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-04-25T23:55:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fccb57fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:01.871 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:01.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 >> v1:172.21.15.171:6812/722422047 conn(0x7fcc9c037b20 legacy=0x7fcc9c039fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 10 monclient: shutdown 2024-04-25T23:55:01.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 >> v1:172.21.15.106:6791/0 conn(0x7fccb80a25f0 legacy=0x7fccb81d9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 shutdown_connections 2024-04-25T23:55:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 >> 172.21.15.106:0/2698166290 conn(0x7fccb80a6fe0 msgr2=0x7fccb8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 shutdown_connections 2024-04-25T23:55:01.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.888+0000 7fcca2ffd640 1 -- 172.21.15.106:0/2698166290 wait complete. 2024-04-25T23:55:01.886 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.5 2024-04-25T23:55:01.886 DEBUG:teuthology.parallel:result is None 2024-04-25T23:55:01.890 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.0 2024-04-25T23:55:01.890 DEBUG:teuthology.parallel:result is None 2024-04-25T23:55:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.984+0000 7f21d3dfe640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-25T23:55:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.984+0000 7f21d3dfe640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-25T23:55:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.984+0000 7f21d3dfe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.984+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f21cc062e50 con 0x7f21cc09cca0 2024-04-25T23:55:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.984+0000 7f21c27fc640 1 -- 172.21.15.106:0/4182902946 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 847495621) 0x7f21c80156b0 con 0x7f21cc09cca0 2024-04-25T23:55:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.984+0000 7f21c27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-04-25T23:55:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.984+0000 7f21c27fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:01.969 INFO:teuthology.orchestra.run.smithi106.stdout:47244640259 2024-04-25T23:55:01.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 >> v1:172.21.15.171:6812/722422047 conn(0x7f21b0037f30 legacy=0x7f21b003a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 10 monclient: shutdown 2024-04-25T23:55:01.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 >> v1:172.21.15.106:6791/0 conn(0x7f21cc09cca0 legacy=0x7f21cc135bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 shutdown_connections 2024-04-25T23:55:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 >> 172.21.15.106:0/4182902946 conn(0x7f21cc06b3e0 msgr2=0x7f21cc13d760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 shutdown_connections 2024-04-25T23:55:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f21d3dfe640 1 -- 172.21.15.106:0/4182902946 wait complete. 2024-04-25T23:55:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f2dc5e2a640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-25T23:55:01.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f2dc5e2a640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-25T23:55:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f2dc5e2a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2dc0062e50 con 0x7f2dc0134970 2024-04-25T23:55:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f2dbcff9640 1 -- 172.21.15.106:0/1231752300 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 555833778) 0x7f2db0019200 con 0x7f2dc0134970 2024-04-25T23:55:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f2dbcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-04-25T23:55:01.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.988+0000 7f2dbcff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:01.973 INFO:teuthology.orchestra.run.smithi106.stdout:47244640258 2024-04-25T23:55:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 >> v1:172.21.15.171:6812/722422047 conn(0x7f2da4037e00 legacy=0x7f2da403a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 10 monclient: shutdown 2024-04-25T23:55:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:01.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 >> v1:172.21.15.106:6793/0 conn(0x7f2dc0134970 legacy=0x7f2dc01d9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 shutdown_connections 2024-04-25T23:55:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 >> 172.21.15.106:0/1231752300 conn(0x7f2dc00a9e20 msgr2=0x7f2dc0067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 shutdown_connections 2024-04-25T23:55:01.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:01.992+0000 7f2dc5e2a640 1 -- 172.21.15.106:0/1231752300 wait complete. 2024-04-25T23:55:01.987 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640259 got 47244640259 for osd.3 2024-04-25T23:55:01.988 DEBUG:teuthology.parallel:result is None 2024-04-25T23:55:01.989 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640258 got 47244640258 for osd.2 2024-04-25T23:55:01.989 DEBUG:teuthology.parallel:result is None 2024-04-25T23:55:01.989 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T23:55:01.990 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.152+0000 7f042a841640 10 monclient: get_monmap_and_config 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.152+0000 7f042a841640 10 monclient: build_initial_monmap 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.152+0000 7f042a841640 10 monclient: monmap: 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:02.157370+0000 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:02.157370+0000 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:02.136 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:02.137 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 Processor -- start 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- start start 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: init 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: _add_conns ranks=[1,8,3,2,6,7,0,4,5] 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): picked mon.noname-f con 0x7f04240716e0 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): picked mon.noname-e con 0x7f0424135e50 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): picked mon.noname-g con 0x7f042413bdd0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04241362a0 con 0x7f04240716e0 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04240723f0 con 0x7f042413bdd0 2024-04-25T23:55:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042406bcc0 con 0x7f0424135e50 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): authenticate will time out at 957.684948s 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f04237fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0424135e50 0x7f042413a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42392/0 (socket says 172.21.15.106:42392) 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f04237fe640 1 -- 172.21.15.106:0/3467746140 learned_addr learned my addr 172.21.15.106:0/3467746140 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3748165811 0 0) 0x7f042406bcc0 con 0x7f0424135e50 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient(hunting): my global_id is 4427 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0410003530 con 0x7f0424135e50 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4207501089 0 0) 0x7f0410003530 con 0x7f0424135e50 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 >> v1:172.21.15.171:6790/0 conn(0x7f042413bdd0 legacy=0x7f042413e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 >> v1:172.21.15.171:6789/0 conn(0x7f04240716e0 legacy=0x7f0424135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 monclient: found mon.noname-e 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0424135390 con 0x7f0424135e50 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: _finish_auth 0 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 5 monclient: authenticate success, global_id 4427 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f040c0017c0 con 0x7f0424135e50 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: dump: 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.146 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f040c001b20 con 0x7f0424135e50 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 4 set_mon_vals no callback set 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 1 -- 172.21.15.106:0/3467746140 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f040c001d50 con 0x7f0424135e50 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0422ffd640 10 monclient: dump: 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: shutdown 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- 172.21.15.106:0/3467746140 >> v1:172.21.15.106:6793/0 conn(0x7f0424135e50 legacy=0x7f042413a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- 172.21.15.106:0/3467746140 shutdown_connections 2024-04-25T23:55:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- 172.21.15.106:0/3467746140 >> 172.21.15.106:0/3467746140 conn(0x7f04240a7240 msgr2=0x7f04240a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- 172.21.15.106:0/3467746140 shutdown_connections 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- 172.21.15.106:0/3467746140 wait complete. 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: build_initial_monmap 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: monmap: 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 Processor -- start 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- start start 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: init 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient: _add_conns ranks=[5,1,6,0,2,8,7,4,3] 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): picked mon.noname-h con 0x7f04240716e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): picked mon.noname-f con 0x7f0424135e50 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): picked mon.noname-d con 0x7f042413bdd0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04241cd680 con 0x7f0424135e50 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04241350f0 con 0x7f04240716e0 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04240a0920 con 0x7f042413bdd0 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f042a841640 10 monclient(hunting): authenticate will time out at 957.687686s 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0428dde640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f042413bdd0 0x7f04241d4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43590/0 (socket says 172.21.15.106:43590) 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0428dde640 1 -- 172.21.15.106:0/386561894 learned_addr learned my addr 172.21.15.106:0/386561894 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 792924141 0 0) 0x7f04240a0920 con 0x7f042413bdd0 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0420ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0420ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0420ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.156+0000 7f0420ff9640 10 monclient(hunting): my global_id is 4344 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0404003530 con 0x7f042413bdd0 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3347535691 0 0) 0x7f0404003530 con 0x7f042413bdd0 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04240a0920 con 0x7f042413bdd0 2024-04-25T23:55:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f041c001a80 con 0x7f042413bdd0 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): dump: 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675321014 0 0) 0x7f04241350f0 con 0x7f04240716e0 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient(hunting): my global_id is 4397 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0404003530 con 0x7f04240716e0 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3071031916 0 0) 0x7f04240a0920 con 0x7f042413bdd0 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 >> v1:172.21.15.171:6791/0 conn(0x7f04240716e0 legacy=0x7f04241cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 >> v1:172.21.15.171:6789/0 conn(0x7f0424135e50 legacy=0x7f04241ccf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:55:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 monclient: found mon.d 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04240a03f0 con 0x7f042413bdd0 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: _finish_auth 0 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 5 monclient: authenticate success, global_id 4344 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 10 monclient: _renew_subs 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04240704e0 con 0x7f042413bdd0 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 10 monclient: _renew_subs 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f042412f700 con 0x7f042413bdd0 2024-04-25T23:55:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f041c003950 con 0x7f042413bdd0 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f041c003ec0 con 0x7f042413bdd0 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f04227fc640 4 set_mon_vals no callback set 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 10 monclient: dump: 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f041c004060 con 0x7f042413bdd0 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0408005090 con 0x7f042413bdd0 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f041c0444b0 con 0x7f042413bdd0 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.160+0000 7f0423fff640 10 monclient: get_auth_request con 0x7f0404037840 auth_method 0 2024-04-25T23:55:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.164+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f041c015770 con 0x7f042413bdd0 2024-04-25T23:55:02.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.164+0000 7f0420ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.164+0000 7f0420ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:02.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.308+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0408000ba0 con 0x7f0404037840 2024-04-25T23:55:02.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f0420ff9640 1 -- 172.21.15.106:0/386561894 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33872 (unknown 2965378022 0 2218541205) 0x7f0408000ba0 con 0x7f0404037840 2024-04-25T23:55:02.294 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:55:02.295 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 >> v1:172.21.15.171:6812/722422047 conn(0x7f0404037840 legacy=0x7f0404039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 10 monclient: shutdown 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 >> v1:172.21.15.106:6792/0 conn(0x7f042413bdd0 legacy=0x7f04241d4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 shutdown_connections 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 >> 172.21.15.106:0/386561894 conn(0x7f04240a7240 msgr2=0x7f042413e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 shutdown_connections 2024-04-25T23:55:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.312+0000 7f042a841640 1 -- 172.21.15.106:0/386561894 wait complete. 2024-04-25T23:55:02.311 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-04-25T23:55:01.583260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163012,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068028,"statfs":{"total":579820584960,"available":579653660672,"internally_reserved":0,"allocated":851968,"data_stored":1145326,"data_compressed":17720,"data_compressed_allocated":57344,"data_compressed_original":901120,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740478+0000","last_change":"2024-04-25T23:54:58.727817+0000","last_active":"2024-04-25T23:54:59.740478+0000","last_peered":"2024-04-25T23:54:59.740478+0000","last_clean":"2024-04-25T23:54:59.740478+0000","last_became_active":"2024-04-25T23:54:58.727069+0000","last_became_peered":"2024-04-25T23:54:58.727069+0000","last_unstale":"2024-04-25T23:54:59.740478+0000","last_undegraded":"2024-04-25T23:54:59.740478+0000","last_fullsized":"2024-04-25T23:54:59.740478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:31.367276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745172+0000","last_change":"2024-04-25T23:54:58.913077+0000","last_active":"2024-04-25T23:54:59.745172+0000","last_peered":"2024-04-25T23:54:59.745172+0000","last_clean":"2024-04-25T23:54:59.745172+0000","last_became_active":"2024-04-25T23:54:58.912576+0000","last_became_peered":"2024-04-25T23:54:58.912576+0000","last_unstale":"2024-04-25T23:54:59.745172+0000","last_undegraded":"2024-04-25T23:54:59.745172+0000","last_fullsized":"2024-04-25T23:54:59.745172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:43.683740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893896+0000","last_change":"2024-04-25T23:54:58.722957+0000","last_active":"2024-04-25T23:54:59.893896+0000","last_peered":"2024-04-25T23:54:59.893896+0000","last_clean":"2024-04-25T23:54:59.893896+0000","last_became_active":"2024-04-25T23:54:58.722155+0000","last_became_peered":"2024-04-25T23:54:58.722155+0000","last_unstale":"2024-04-25T23:54:59.893896+0000","last_undegraded":"2024-04-25T23:54:59.893896+0000","last_fullsized":"2024-04-25T23:54:59.893896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:40:41.779047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.894219+0000","last_change":"2024-04-25T23:54:58.731904+0000","last_active":"2024-04-25T23:54:59.894219+0000","last_peered":"2024-04-25T23:54:59.894219+0000","last_clean":"2024-04-25T23:54:59.894219+0000","last_became_active":"2024-04-25T23:54:58.731527+0000","last_became_peered":"2024-04-25T23:54:58.731527+0000","last_unstale":"2024-04-25T23:54:59.894219+0000","last_undegraded":"2024-04-25T23:54:59.894219+0000","last_fullsized":"2024-04-25T23:54:59.894219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:22.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'105","reported_seq":147,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745116+0000","last_change":"2024-04-25T23:54:58.730774+0000","last_active":"2024-04-25T23:54:59.745116+0000","last_peered":"2024-04-25T23:54:59.745116+0000","last_clean":"2024-04-25T23:54:59.745116+0000","last_became_active":"2024-04-25T23:54:58.730120+0000","last_became_peered":"2024-04-25T23:54:58.730120+0000","last_unstale":"2024-04-25T23:54:59.745116+0000","last_undegraded":"2024-04-25T23:54:59.745116+0000","last_fullsized":"2024-04-25T23:54:59.745116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:21.729441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893931+0000","last_change":"2024-04-25T23:54:58.727780+0000","last_active":"2024-04-25T23:54:59.893931+0000","last_peered":"2024-04-25T23:54:59.893931+0000","last_clean":"2024-04-25T23:54:59.893931+0000","last_became_active":"2024-04-25T23:54:58.727196+0000","last_became_peered":"2024-04-25T23:54:58.727196+0000","last_unstale":"2024-04-25T23:54:59.893931+0000","last_undegraded":"2024-04-25T23:54:59.893931+0000","last_fullsized":"2024-04-25T23:54:59.893931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:46.544411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893844+0000","last_change":"2024-04-25T23:54:58.913127+0000","last_active":"2024-04-25T23:54:59.893844+0000","last_peered":"2024-04-25T23:54:59.893844+0000","last_clean":"2024-04-25T23:54:59.893844+0000","last_became_active":"2024-04-25T23:54:58.912611+0000","last_became_peered":"2024-04-25T23:54:58.912611+0000","last_unstale":"2024-04-25T23:54:59.893844+0000","last_undegraded":"2024-04-25T23:54:59.893844+0000","last_fullsized":"2024-04-25T23:54:59.893844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:05:38.061366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740381+0000","last_change":"2024-04-25T23:54:58.912958+0000","last_active":"2024-04-25T23:54:59.740381+0000","last_peered":"2024-04-25T23:54:59.740381+0000","last_clean":"2024-04-25T23:54:59.740381+0000","last_became_active":"2024-04-25T23:54:58.912600+0000","last_became_peered":"2024-04-25T23:54:58.912600+0000","last_unstale":"2024-04-25T23:54:59.740381+0000","last_undegraded":"2024-04-25T23:54:59.740381+0000","last_fullsized":"2024-04-25T23:54:59.740381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:55.855198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745524+0000","last_change":"2024-04-25T23:54:58.913088+0000","last_active":"2024-04-25T23:54:59.745524+0000","last_peered":"2024-04-25T23:54:59.745524+0000","last_clean":"2024-04-25T23:54:59.745524+0000","last_became_active":"2024-04-25T23:54:58.912664+0000","last_became_peered":"2024-04-25T23:54:58.912664+0000","last_unstale":"2024-04-25T23:54:59.745524+0000","last_undegraded":"2024-04-25T23:54:59.745524+0000","last_fullsized":"2024-04-25T23:54:59.745524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:56.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":934976,"data_compressed":17720,"data_compressed_allocated":57344,"data_compressed_original":901120,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":33587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":33587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":180224,"data_stored":505489,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":33587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":501075,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":467488,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":467488,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:55:02.312 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.436+0000 7f087248b640 10 monclient: get_monmap_and_config 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.436+0000 7f087248b640 10 monclient: build_initial_monmap 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.436+0000 7f087248b640 10 monclient: monmap: 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:02.441528+0000 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:02.441528+0000 2024-04-25T23:55:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:02.421 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.436+0000 7f087248b640 1 Processor -- start 2024-04-25T23:55:02.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.436+0000 7f087248b640 1 -- start start 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.436+0000 7f087248b640 10 monclient: init 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: _add_conns ranks=[6,4,0,2,7,5,1,3,8] 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): picked mon.noname-d con 0x7f086c137730 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): picked mon.noname-c con 0x7f086c0a0b20 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): picked mon.noname-a con 0x7f086c138220 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0a2750 con 0x7f086c138220 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0a2a30 con 0x7f086c0a0b20 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c0a2d10 con 0x7f086c137730 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): authenticate will time out at 957.968548s 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086b7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f086c0a0b20 0x7f086c13ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48674/0 (socket says 172.21.15.106:48674) 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086b7fe640 1 -- 172.21.15.106:0/2424069436 learned_addr learned my addr 172.21.15.106:0/2424069436 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:02.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086bfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f086c137730 0x7f086c137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43604/0 (socket says 172.21.15.106:43604) 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150982162 0 0) 0x7f086c0a2a30 con 0x7f086c0a0b20 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): my global_id is 4396 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0854003530 con 0x7f086c0a0b20 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 55151810 0 0) 0x7f086c0a2750 con 0x7f086c138220 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): my global_id is 4383 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c0a2a30 con 0x7f086c138220 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2736773634 0 0) 0x7f086c0a2d10 con 0x7f086c137730 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient(hunting): my global_id is 4353 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c0a2750 con 0x7f086c137730 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3995810831 0 0) 0x7f086c0a2750 con 0x7f086c137730 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 >> v1:172.21.15.106:6791/0 conn(0x7f086c0a0b20 legacy=0x7f086c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 >> v1:172.21.15.106:6789/0 conn(0x7f086c138220 legacy=0x7f086c140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 monclient: found mon.noname-d 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c0a4680 con 0x7f086c137730 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: _finish_auth 0 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:02.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f085c0016e0 con 0x7f086c137730 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 5 monclient: authenticate success, global_id 4353 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: dump: 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.431 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f085c001990 con 0x7f086c137730 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 4 set_mon_vals no callback set 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 1 -- 172.21.15.106:0/2424069436 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f085c004b30 con 0x7f086c137730 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086affd640 10 monclient: dump: 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.433 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: shutdown 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- 172.21.15.106:0/2424069436 >> v1:172.21.15.106:6792/0 conn(0x7f086c137730 legacy=0x7f086c137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- 172.21.15.106:0/2424069436 shutdown_connections 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- 172.21.15.106:0/2424069436 >> 172.21.15.106:0/2424069436 conn(0x7f086c0a6b80 msgr2=0x7f086c0a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- 172.21.15.106:0/2424069436 shutdown_connections 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- 172.21.15.106:0/2424069436 wait complete. 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: build_initial_monmap 2024-04-25T23:55:02.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: monmap: 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:02.435 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 Processor -- start 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- start start 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: init 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient: _add_conns ranks=[0,4,7,2,6,8,1,3,5] 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): picked mon.noname-a con 0x7f086c0a0b20 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): picked mon.noname-c con 0x7f086c137730 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): picked mon.noname-i con 0x7f086c138220 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c134560 con 0x7f086c0a0b20 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c133150 con 0x7f086c137730 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086bfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f086c0a0b20 0x7f086c1c8e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55166/0 (socket says 172.21.15.106:55166) 2024-04-25T23:55:02.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f086c134fa0 con 0x7f086c138220 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f086bfff640 1 -- 172.21.15.106:0/3507781329 learned_addr learned my addr 172.21.15.106:0/3507781329 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f087248b640 10 monclient(hunting): authenticate will time out at 957.971586s 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92282285 0 0) 0x7f086c134560 con 0x7f086c0a0b20 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): my global_id is 4392 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0858003530 con 0x7f086c0a0b20 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104482464 0 0) 0x7f086c133150 con 0x7f086c137730 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 10 monclient(hunting): my global_id is 4405 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.440+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f086c134560 con 0x7f086c137730 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2738347927 0 0) 0x7f0858003530 con 0x7f086c0a0b20 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f086c133150 con 0x7f086c0a0b20 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f085c0016a0 con 0x7f086c0a0b20 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient(hunting): dump: 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.438 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3858598810 0 0) 0x7f086c134560 con 0x7f086c137730 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0858003530 con 0x7f086c137730 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f08600013b0 con 0x7f086c137730 2024-04-25T23:55:02.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient(hunting): dump: 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.440 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3790198684 0 0) 0x7f086c133150 con 0x7f086c0a0b20 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 >> v1:172.21.15.171:6792/0 conn(0x7f086c138220 legacy=0x7f086c1d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 >> v1:172.21.15.106:6791/0 conn(0x7f086c137730 legacy=0x7f086c1d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 monclient: found mon.a 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f086c132ab0 con 0x7f086c0a0b20 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: _finish_auth 0 2024-04-25T23:55:02.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 5 monclient: authenticate success, global_id 4392 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 10 monclient: _renew_subs 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f086c132d60 con 0x7f086c0a0b20 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 10 monclient: _renew_subs 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f086c1c96e0 con 0x7f086c0a0b20 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f086c075890 con 0x7f086c0a0b20 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f085c001990 con 0x7f086c0a0b20 2024-04-25T23:55:02.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f085c005180 con 0x7f086c0a0b20 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 10 monclient: dump: 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f086a7fc640 4 set_mon_vals no callback set 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f085c00ff20 con 0x7f086c0a0b20 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f085c044490 con 0x7f086c0a0b20 2024-04-25T23:55:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.444+0000 7f086b7fe640 10 monclient: get_auth_request con 0x7f0858037ea0 auth_method 0 2024-04-25T23:55:02.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.448+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f085c0158b0 con 0x7f086c0a0b20 2024-04-25T23:55:02.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.448+0000 7f0868ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.448+0000 7f0868ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.592+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f086c141ad0 con 0x7f0858037ea0 2024-04-25T23:55:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.596+0000 7f0868ff9640 1 -- 172.21.15.106:0/3507781329 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33872 (unknown 2965378022 0 2218541205) 0x7f086c141ad0 con 0x7f0858037ea0 2024-04-25T23:55:02.580 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:55:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-25T23:55:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 >> v1:172.21.15.171:6812/722422047 conn(0x7f0858037ea0 legacy=0x7f085803a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 10 monclient: shutdown 2024-04-25T23:55:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 >> v1:172.21.15.106:6789/0 conn(0x7f086c0a0b20 legacy=0x7f086c1c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 shutdown_connections 2024-04-25T23:55:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 >> 172.21.15.106:0/3507781329 conn(0x7f086c0a6b80 msgr2=0x7f086c0a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 shutdown_connections 2024-04-25T23:55:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.600+0000 7f087248b640 1 -- 172.21.15.106:0/3507781329 wait complete. 2024-04-25T23:55:02.596 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":13,"stamp":"2024-04-25T23:55:01.583260+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163012,"kb_used_data":832,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566068028,"statfs":{"total":579820584960,"available":579653660672,"internally_reserved":0,"allocated":851968,"data_stored":1145326,"data_compressed":17720,"data_compressed_allocated":57344,"data_compressed_original":901120,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740478+0000","last_change":"2024-04-25T23:54:58.727817+0000","last_active":"2024-04-25T23:54:59.740478+0000","last_peered":"2024-04-25T23:54:59.740478+0000","last_clean":"2024-04-25T23:54:59.740478+0000","last_became_active":"2024-04-25T23:54:58.727069+0000","last_became_peered":"2024-04-25T23:54:58.727069+0000","last_unstale":"2024-04-25T23:54:59.740478+0000","last_undegraded":"2024-04-25T23:54:59.740478+0000","last_fullsized":"2024-04-25T23:54:59.740478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:31.367276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745172+0000","last_change":"2024-04-25T23:54:58.913077+0000","last_active":"2024-04-25T23:54:59.745172+0000","last_peered":"2024-04-25T23:54:59.745172+0000","last_clean":"2024-04-25T23:54:59.745172+0000","last_became_active":"2024-04-25T23:54:58.912576+0000","last_became_peered":"2024-04-25T23:54:58.912576+0000","last_unstale":"2024-04-25T23:54:59.745172+0000","last_undegraded":"2024-04-25T23:54:59.745172+0000","last_fullsized":"2024-04-25T23:54:59.745172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:43.683740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893896+0000","last_change":"2024-04-25T23:54:58.722957+0000","last_active":"2024-04-25T23:54:59.893896+0000","last_peered":"2024-04-25T23:54:59.893896+0000","last_clean":"2024-04-25T23:54:59.893896+0000","last_became_active":"2024-04-25T23:54:58.722155+0000","last_became_peered":"2024-04-25T23:54:58.722155+0000","last_unstale":"2024-04-25T23:54:59.893896+0000","last_undegraded":"2024-04-25T23:54:59.893896+0000","last_fullsized":"2024-04-25T23:54:59.893896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:40:41.779047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.894219+0000","last_change":"2024-04-25T23:54:58.731904+0000","last_active":"2024-04-25T23:54:59.894219+0000","last_peered":"2024-04-25T23:54:59.894219+0000","last_clean":"2024-04-25T23:54:59.894219+0000","last_became_active":"2024-04-25T23:54:58.731527+0000","last_became_peered":"2024-04-25T23:54:58.731527+0000","last_unstale":"2024-04-25T23:54:59.894219+0000","last_undegraded":"2024-04-25T23:54:59.894219+0000","last_fullsized":"2024-04-25T23:54:59.894219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:22.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"14'105","reported_seq":147,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745116+0000","last_change":"2024-04-25T23:54:58.730774+0000","last_active":"2024-04-25T23:54:59.745116+0000","last_peered":"2024-04-25T23:54:59.745116+0000","last_clean":"2024-04-25T23:54:59.745116+0000","last_became_active":"2024-04-25T23:54:58.730120+0000","last_became_peered":"2024-04-25T23:54:58.730120+0000","last_unstale":"2024-04-25T23:54:59.745116+0000","last_undegraded":"2024-04-25T23:54:59.745116+0000","last_fullsized":"2024-04-25T23:54:59.745116+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:21.729441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893931+0000","last_change":"2024-04-25T23:54:58.727780+0000","last_active":"2024-04-25T23:54:59.893931+0000","last_peered":"2024-04-25T23:54:59.893931+0000","last_clean":"2024-04-25T23:54:59.893931+0000","last_became_active":"2024-04-25T23:54:58.727196+0000","last_became_peered":"2024-04-25T23:54:58.727196+0000","last_unstale":"2024-04-25T23:54:59.893931+0000","last_undegraded":"2024-04-25T23:54:59.893931+0000","last_fullsized":"2024-04-25T23:54:59.893931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:46.544411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893844+0000","last_change":"2024-04-25T23:54:58.913127+0000","last_active":"2024-04-25T23:54:59.893844+0000","last_peered":"2024-04-25T23:54:59.893844+0000","last_clean":"2024-04-25T23:54:59.893844+0000","last_became_active":"2024-04-25T23:54:58.912611+0000","last_became_peered":"2024-04-25T23:54:58.912611+0000","last_unstale":"2024-04-25T23:54:59.893844+0000","last_undegraded":"2024-04-25T23:54:59.893844+0000","last_fullsized":"2024-04-25T23:54:59.893844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:05:38.061366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740381+0000","last_change":"2024-04-25T23:54:58.912958+0000","last_active":"2024-04-25T23:54:59.740381+0000","last_peered":"2024-04-25T23:54:59.740381+0000","last_clean":"2024-04-25T23:54:59.740381+0000","last_became_active":"2024-04-25T23:54:58.912600+0000","last_became_peered":"2024-04-25T23:54:58.912600+0000","last_unstale":"2024-04-25T23:54:59.740381+0000","last_undegraded":"2024-04-25T23:54:59.740381+0000","last_fullsized":"2024-04-25T23:54:59.740381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:55.855198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745524+0000","last_change":"2024-04-25T23:54:58.913088+0000","last_active":"2024-04-25T23:54:59.745524+0000","last_peered":"2024-04-25T23:54:59.745524+0000","last_clean":"2024-04-25T23:54:59.745524+0000","last_became_active":"2024-04-25T23:54:58.912664+0000","last_became_peered":"2024-04-25T23:54:58.912664+0000","last_unstale":"2024-04-25T23:54:59.745524+0000","last_undegraded":"2024-04-25T23:54:59.745524+0000","last_fullsized":"2024-04-25T23:54:59.745524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:56.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":91,"num_write":145,"num_write_kb":2154,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":934976,"data_compressed":17720,"data_compressed_allocated":57344,"data_compressed_original":901120,"omap_allocated":0,"internal_metadata":0},"log_size":105,"ondisk_log_size":105,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640259,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":33587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640259,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":33587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":180224,"data_stored":505489,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":120,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":122880,"data_stored":33587,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640258,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27204,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344636,"statfs":{"total":96636764160,"available":96608907264,"internally_reserved":0,"allocated":172032,"data_stored":501075,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640259,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":467488,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":467488,"data_compressed":8860,"data_compressed_allocated":28672,"data_compressed_original":450560,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:55:02.597 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T23:55:02.597 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T23:55:02.597 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T23:55:02.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T23:55:02.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.716+0000 7f422a27d640 10 monclient: get_monmap_and_config 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.716+0000 7f422a27d640 10 monclient: build_initial_monmap 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.716+0000 7f422a27d640 10 monclient: monmap: 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:02.721143+0000 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:02.721143+0000 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:02.700 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:02.701 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:02.701 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:02.701 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:02.701 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.716+0000 7f422a27d640 1 Processor -- start 2024-04-25T23:55:02.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.716+0000 7f422a27d640 1 -- start start 2024-04-25T23:55:02.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.716+0000 7f422a27d640 10 monclient: init 2024-04-25T23:55:02.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:02.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: _add_conns ranks=[7,5,0,3,8,6,4,2,1] 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): picked mon.noname-i con 0x7f4224072500 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): picked mon.noname-h con 0x7f4224137730 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): picked mon.noname-a con 0x7f4224137b70 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f422409fe40 con 0x7f4224137b70 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42240a0120 con 0x7f4224137730 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42240a0400 con 0x7f4224072500 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): authenticate will time out at 958.248132s 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f42237fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4224137730 0x7f422413ca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:58980/0 (socket says 172.21.15.106:58980) 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f42237fe640 1 -- 172.21.15.106:0/523647508 learned_addr learned my addr 172.21.15.106:0/523647508 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422881a640 1 --1- 172.21.15.106:0/523647508 >> v1:172.21.15.106:6789/0 conn(0x7f4224137b70 0x7f4224140180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55178/0 (socket says 172.21.15.106:55178) 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460063074 0 0) 0x7f42240a0400 con 0x7f4224072500 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): my global_id is 4381 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f420c003530 con 0x7f4224072500 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399991654 0 0) 0x7f422409fe40 con 0x7f4224137b70 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): my global_id is 4401 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42240a0400 con 0x7f4224137b70 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1213635766 0 0) 0x7f42240a0120 con 0x7f4224137730 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient(hunting): my global_id is 4406 2024-04-25T23:55:02.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f422409fe40 con 0x7f4224137730 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1869966746 0 0) 0x7f42240a0400 con 0x7f4224137b70 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 >> v1:172.21.15.171:6792/0 conn(0x7f4224072500 legacy=0x7f42240728e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 >> v1:172.21.15.171:6791/0 conn(0x7f4224137730 legacy=0x7f422413ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 monclient: found mon.noname-a 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42240a4220 con 0x7f4224137b70 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: _finish_auth 0 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f421c001b20 con 0x7f4224137b70 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 5 monclient: authenticate success, global_id 4401 2024-04-25T23:55:02.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: dump: 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.711 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f421c001e80 con 0x7f4224137b70 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 1 -- 172.21.15.106:0/523647508 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f421c004eb0 con 0x7f4224137b70 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 4 set_mon_vals no callback set 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4222ffd640 10 monclient: dump: 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.712 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: shutdown 2024-04-25T23:55:02.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- 172.21.15.106:0/523647508 >> v1:172.21.15.106:6789/0 conn(0x7f4224137b70 legacy=0x7f4224140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- 172.21.15.106:0/523647508 shutdown_connections 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- 172.21.15.106:0/523647508 >> 172.21.15.106:0/523647508 conn(0x7f42240a73f0 msgr2=0x7f42240a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- 172.21.15.106:0/523647508 shutdown_connections 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- 172.21.15.106:0/523647508 wait complete. 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: build_initial_monmap 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: monmap: 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.714 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 Processor -- start 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- start start 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: init 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient: _add_conns ranks=[0,5,7,1,3,8,6,4,2] 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): picked mon.noname-a con 0x7f4224072500 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:02.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): picked mon.noname-h con 0x7f4224137730 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): picked mon.noname-i con 0x7f4224137b70 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4224135ca0 con 0x7f4224072500 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f422409ee90 con 0x7f4224137730 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42241364a0 con 0x7f4224137b70 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f422a27d640 10 monclient(hunting): authenticate will time out at 958.251662s 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4223fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4224072500 0x7f4224140b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55184/0 (socket says 172.21.15.106:55184) 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4223fff640 1 -- 172.21.15.106:0/2573798549 learned_addr learned my addr 172.21.15.106:0/2573798549 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125551470 0 0) 0x7f4224135ca0 con 0x7f4224072500 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4220ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4220ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4220ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4220ff9640 10 monclient(hunting): my global_id is 4410 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.720+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4210003530 con 0x7f4224072500 2024-04-25T23:55:02.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 201123171 0 0) 0x7f4210003530 con 0x7f4224072500 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4224135ca0 con 0x7f4224072500 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4214001a80 con 0x7f4224072500 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): dump: 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.717 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190868055 0 0) 0x7f42241364a0 con 0x7f4224137b70 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): my global_id is 4390 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4210003530 con 0x7f4224137b70 2024-04-25T23:55:02.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633052198 0 0) 0x7f422409ee90 con 0x7f4224137730 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient(hunting): my global_id is 4415 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42241364a0 con 0x7f4224137730 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 942520188 0 0) 0x7f4224135ca0 con 0x7f4224072500 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 >> v1:172.21.15.171:6792/0 conn(0x7f4224137b70 legacy=0x7f42241d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 >> v1:172.21.15.171:6791/0 conn(0x7f4224137730 legacy=0x7f42241d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 monclient: found mon.a 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f422413a2d0 con 0x7f4224072500 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: _finish_auth 0 2024-04-25T23:55:02.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 5 monclient: authenticate success, global_id 4410 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 10 monclient: _renew_subs 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42241389a0 con 0x7f4224072500 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 10 monclient: _renew_subs 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f42241c9270 con 0x7f4224072500 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4214003950 con 0x7f4224072500 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4214003ec0 con 0x7f4224072500 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f42227fc640 4 set_mon_vals no callback set 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 10 monclient: dump: 2024-04-25T23:55:02.720 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:02.721 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4204005090 con 0x7f4224072500 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4214004060 con 0x7f4224072500 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f4214044430 con 0x7f4224072500 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.724+0000 7f42237fe640 10 monclient: get_auth_request con 0x7f4210037a40 auth_method 0 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.728+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f42140156f0 con 0x7f4224072500 2024-04-25T23:55:02.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.728+0000 7f4220ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:02.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.728+0000 7f4220ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:02.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-04-25T23:55:02.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-04-25T23:55:02.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:02.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f4204005380 con 0x7f4224072500 2024-04-25T23:55:02.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f4220ff9640 1 -- 172.21.15.106:0/2573798549 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7f42140193a0 con 0x7f4224072500 2024-04-25T23:55:02.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f4220ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-04-25T23:55:02.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f4220ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:02.890 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:55:02.890 INFO:teuthology.orchestra.run.smithi106.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T23:55:02.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 >> v1:172.21.15.171:6812/722422047 conn(0x7f4210037a40 legacy=0x7f4210039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 10 monclient: shutdown 2024-04-25T23:55:02.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:02.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 >> v1:172.21.15.106:6789/0 conn(0x7f4224072500 legacy=0x7f4224140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:02.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 shutdown_connections 2024-04-25T23:55:02.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 >> 172.21.15.106:0/2573798549 conn(0x7f42240a73f0 msgr2=0x7f42240a4b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:02.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 shutdown_connections 2024-04-25T23:55:02.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:02.908+0000 7f422a27d640 1 -- 172.21.15.106:0/2573798549 wait complete. 2024-04-25T23:55:02.906 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T23:55:02.907 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-04-25T23:55:02.919 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-04-25T23:55:02.919 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T23:55:03.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient: get_monmap_and_config 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient: monmap: 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:03.052072+0000 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:03.052072+0000 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.031 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.032 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.032 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.032 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.032 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 1 Processor -- start 2024-04-25T23:55:03.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 1 -- start start 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient: init 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient: _add_conns ranks=[4,8,2,3,1,6,0,7,5] 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient(hunting): picked mon.noname-c con 0x7f91e4134970 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient(hunting): picked mon.noname-e con 0x7f91e40a4820 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient(hunting): picked mon.noname-b con 0x7f91e413e200 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e406dd40 con 0x7f91e413e200 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e40a2b10 con 0x7f91e4134970 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e40a2df0 con 0x7f91e40a4820 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 10 monclient(hunting): authenticate will time out at 958.579119s 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e2ffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f91e4134970 0x7f91e4134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48688/0 (socket says 172.21.15.106:48688) 2024-04-25T23:55:03.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e2ffd640 1 -- 172.21.15.106:0/4159172945 learned_addr learned my addr 172.21.15.106:0/4159172945 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 566965323 0 0) 0x7f91e40a2b10 con 0x7f91e4134970 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): my global_id is 4414 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91cc003530 con 0x7f91e4134970 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996254459 0 0) 0x7f91e406dd40 con 0x7f91e413e200 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): my global_id is 4268 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91e40a2b10 con 0x7f91e413e200 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183215439 0 0) 0x7f91e40a2df0 con 0x7f91e40a4820 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient(hunting): my global_id is 4436 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91e406dd40 con 0x7f91e40a4820 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2232843865 0 0) 0x7f91cc003530 con 0x7f91e4134970 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 >> v1:172.21.15.106:6793/0 conn(0x7f91e40a4820 legacy=0x7f91e413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 >> v1:172.21.15.106:6790/0 conn(0x7f91e413e200 legacy=0x7f91e41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 monclient: found mon.noname-c 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e40a30d0 con 0x7f91e4134970 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f91d40017c0 con 0x7f91e4134970 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e1ffb640 10 monclient: dump: 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.041 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 5 monclient: authenticate success, global_id 4414 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.048+0000 7f91e97d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91d40019f0 con 0x7f91e4134970 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e1ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 4 set_mon_vals no callback set 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e1ffb640 1 -- 172.21.15.106:0/4159172945 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f91d4001c60 con 0x7f91e4134970 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e1ffb640 10 monclient: dump: 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.042 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: shutdown 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/4159172945 >> v1:172.21.15.106:6791/0 conn(0x7f91e4134970 legacy=0x7f91e4134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/4159172945 shutdown_connections 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/4159172945 >> 172.21.15.106:0/4159172945 conn(0x7f91e40a9e20 msgr2=0x7f91e40aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/4159172945 shutdown_connections 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/4159172945 wait complete. 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: monmap: 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.044 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 Processor -- start 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- start start 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: init 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _add_conns ranks=[5,7,4,0,8,3,6,1,2] 2024-04-25T23:55:03.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient(hunting): picked mon.noname-h con 0x7f91e40a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient(hunting): picked mon.noname-i con 0x7f91e4134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient(hunting): picked mon.noname-c con 0x7f91e413e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e413bf00 con 0x7f91e413e200 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e41396d0 con 0x7f91e40a4820 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91e413c1e0 con 0x7f91e4134970 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient(hunting): authenticate will time out at 958.582023s 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e37fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f91e413e200 0x7f91e41d45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48702/0 (socket says 172.21.15.106:48702) 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e37fe640 1 -- 172.21.15.106:0/1494685320 learned_addr learned my addr 172.21.15.106:0/1494685320 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341571590 0 0) 0x7f91e413bf00 con 0x7f91e413e200 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): my global_id is 4423 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f91d0003530 con 0x7f91e413e200 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 894774218 0 0) 0x7f91d0003530 con 0x7f91e413e200 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f91e413bf00 con 0x7f91e413e200 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f91dc001d60 con 0x7f91e413e200 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.047 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3013233125 0 0) 0x7f91e413bf00 con 0x7f91e413e200 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 >> v1:172.21.15.171:6792/0 conn(0x7f91e4134970 legacy=0x7f91e4138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 >> v1:172.21.15.171:6791/0 conn(0x7f91e40a4820 legacy=0x7f91e41388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 monclient: found mon.c 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e413bc20 con 0x7f91e413e200 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 5 monclient: authenticate success, global_id 4423 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _renew_subs 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f91e413a5d0 con 0x7f91e413e200 2024-04-25T23:55:03.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _renew_subs 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f91e413c960 con 0x7f91e413e200 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f91dc003c30 con 0x7f91e413e200 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f91dc004120 con 0x7f91e413e200 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e17fa640 4 set_mon_vals no callback set 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 10 monclient: dump: 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.050 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f91dc0042c0 con 0x7f91e413e200 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:03.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91c4005090 con 0x7f91e413e200 2024-04-25T23:55:03.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.052+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f91dc044770 con 0x7f91e413e200 2024-04-25T23:55:03.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.056+0000 7f91e2ffd640 10 monclient: get_auth_request con 0x7f91d0037900 auth_method 0 2024-04-25T23:55:03.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.056+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f91dc0159d0 con 0x7f91e413e200 2024-04-25T23:55:03.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.056+0000 7f91cb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.056+0000 7f91cb7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.208+0000 7f91e97d9640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:55:03.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.208+0000 7f91e97d9640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:55:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.208+0000 7f91e97d9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:55:03.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.208+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91c4005380 con 0x7f91e413e200 2024-04-25T23:55:03.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.208+0000 7f91cb7fe640 1 -- 172.21.15.106:0/1494685320 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+10809 (unknown 4221056075 0 1086299454) 0x7f91dc019680 con 0x7f91e413e200 2024-04-25T23:55:03.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.208+0000 7f91cb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-25T23:55:03.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.208+0000 7f91cb7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:03.191 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:55:03.191 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":15,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","created":"2024-04-25T23:54:46.746675+0000","modified":"2024-04-25T23:54:59.729281+0000","last_up_change":"2024-04-25T23:54:55.661326+0000","last_in_change":"2024-04-25T23:54:48.471734+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25T23:54:56.831664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-25T23:54:57.662371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8be68ed-f989-43cd-bb66-fdf514ef84a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":1458966339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":1458966339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":1458966339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":1458966339}]},"public_addr":"172.21.15.106:6808/1458966339","cluster_addr":"172.21.15.106:6809/1458966339","heartbeat_back_addr":"172.21.15.106:6811/1458966339","heartbeat_front_addr":"172.21.15.106:6810/1458966339","state":["exists","up"]},{"osd":1,"uuid":"0b4cb186-016f-4325-86fc-a32d67508e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":858572474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":858572474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":858572474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":858572474}]},"public_addr":"172.21.15.106:6800/858572474","cluster_addr":"172.21.15.106:6802/858572474","heartbeat_back_addr":"172.21.15.106:6807/858572474","heartbeat_front_addr":"172.21.15.106:6804/858572474","state":["exists","up"]},{"osd":2,"uuid":"5305c964-9533-4f1d-a1a2-6ab03decd54a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":2648645857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":2648645857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":2648645857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":2648645857}]},"public_addr":"172.21.15.106:6801/2648645857","cluster_addr":"172.21.15.106:6803/2648645857","heartbeat_back_addr":"172.21.15.106:6806/2648645857","heartbeat_front_addr":"172.21.15.106:6805/2648645857","state":["exists","up"]},{"osd":3,"uuid":"acff288b-4172-4f63-9d56-7556ce456b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":2707846597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":2707846597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":2707846597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":2707846597}]},"public_addr":"172.21.15.171:6808/2707846597","cluster_addr":"172.21.15.171:6809/2707846597","heartbeat_back_addr":"172.21.15.171:6811/2707846597","heartbeat_front_addr":"172.21.15.171:6810/2707846597","state":["exists","up"]},{"osd":4,"uuid":"7eebb63b-821b-4ad5-9ec1-dc19e2b3602c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":3736794137}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":3736794137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":3736794137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":3736794137}]},"public_addr":"172.21.15.171:6804/3736794137","cluster_addr":"172.21.15.171:6805/3736794137","heartbeat_back_addr":"172.21.15.171:6807/3736794137","heartbeat_front_addr":"172.21.15.171:6806/3736794137","state":["exists","up"]},{"osd":5,"uuid":"b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":721452434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":721452434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":721452434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":721452434}]},"public_addr":"172.21.15.171:6800/721452434","cluster_addr":"172.21.15.171:6801/721452434","heartbeat_back_addr":"172.21.15.171:6803/721452434","heartbeat_front_addr":"172.21.15.171:6802/721452434","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.949301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.787874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.829667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.994707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:54.048968+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.982217+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T23:55:03.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 >> v1:172.21.15.171:6812/722422047 conn(0x7f91d0037900 legacy=0x7f91d0039dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 10 monclient: shutdown 2024-04-25T23:55:03.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:03.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 >> v1:172.21.15.106:6791/0 conn(0x7f91e413e200 legacy=0x7f91e41d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 shutdown_connections 2024-04-25T23:55:03.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 >> 172.21.15.106:0/1494685320 conn(0x7f91e40a9e20 msgr2=0x7f91e4134e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:03.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 shutdown_connections 2024-04-25T23:55:03.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.212+0000 7f91e97d9640 1 -- 172.21.15.106:0/1494685320 wait complete. 2024-04-25T23:55:03.207 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': 'rbd', 'create_time': '2024-04-25T23:54:56.831664+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': '.mgr', 'create_time': '2024-04-25T23:54:57.662371+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-25T23:55:03.208 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.332+0000 7fad0ce8b640 10 monclient: get_monmap_and_config 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.332+0000 7fad0ce8b640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.332+0000 7fad0ce8b640 10 monclient: monmap: 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:03.337488+0000 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:03.337488+0000 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.317 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.332+0000 7fad0ce8b640 1 Processor -- start 2024-04-25T23:55:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- start start 2024-04-25T23:55:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: init 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: _add_conns ranks=[2,3,6,1,5,8,4,7,0] 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient(hunting): picked mon.noname-b con 0x7fad080a4f60 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient(hunting): picked mon.noname-g con 0x7fad080a4680 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient(hunting): picked mon.noname-d con 0x7fad0813e060 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad080a5a50 con 0x7fad080a4f60 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad080a2610 con 0x7fad080a4680 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad080a3e30 con 0x7fad0813e060 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient(hunting): authenticate will time out at 958.864794s 2024-04-25T23:55:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0659c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fad080a4f60 0x7fad080a5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49108/0 (socket says 172.21.15.106:49108) 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0659c640 1 -- 172.21.15.106:0/2910479805 learned_addr learned my addr 172.21.15.106:0/2910479805 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad06d9d640 1 --1- 172.21.15.106:0/2910479805 >> v1:172.21.15.106:6792/0 conn(0x7fad0813e060 0x7fad08140450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43610/0 (socket says 172.21.15.106:43610) 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865467002 0 0) 0x7facf8001050 con 0x7fad080a4f60 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): my global_id is 4277 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf4003530 con 0x7fad080a4f60 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984192380 0 0) 0x7fad080a3e30 con 0x7fad0813e060 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient(hunting): my global_id is 4362 2024-04-25T23:55:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facf8001050 con 0x7fad0813e060 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3161948033 0 0) 0x7facf8001050 con 0x7fad0813e060 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 >> v1:172.21.15.171:6790/0 conn(0x7fad080a4680 legacy=0x7fad0813c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 >> v1:172.21.15.106:6790/0 conn(0x7fad080a4f60 legacy=0x7fad080a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 monclient: found mon.noname-d 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad080a1310 con 0x7fad0813e060 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fad00001b20 con 0x7fad0813e060 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: dump: 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.328 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 5 monclient: authenticate success, global_id 4362 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad00001d90 con 0x7fad0813e060 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 4 set_mon_vals no callback set 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 1 -- 172.21.15.106:0/2910479805 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fad00004eb0 con 0x7fad0813e060 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad05d9b640 10 monclient: dump: 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: shutdown 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2910479805 >> v1:172.21.15.106:6792/0 conn(0x7fad0813e060 legacy=0x7fad08140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2910479805 shutdown_connections 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2910479805 >> 172.21.15.106:0/2910479805 conn(0x7fad080a9c80 msgr2=0x7fad080aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2910479805 shutdown_connections 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2910479805 wait complete. 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: monmap: 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 Processor -- start 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 1 -- start start 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.336+0000 7fad0ce8b640 10 monclient: init 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _add_conns ranks=[7,4,6,0,1,2,3,8,5] 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient(hunting): picked mon.noname-i con 0x7fad080a4680 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient(hunting): picked mon.noname-c con 0x7fad080a4f60 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient(hunting): picked mon.noname-d con 0x7fad0813e060 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad080a1b90 con 0x7fad080a4f60 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad081cd170 con 0x7fad0813e060 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad0809efd0 con 0x7fad080a4680 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient(hunting): authenticate will time out at 958.868291s 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facfdd9b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fad080a4f60 0x7fad081cca60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48706/0 (socket says 172.21.15.106:48706) 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facfdd9b640 1 -- 172.21.15.106:0/2621407457 learned_addr learned my addr 172.21.15.106:0/2621407457 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2826575219 0 0) 0x7fad080a2610 con 0x7fad080a4f60 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): my global_id is 4432 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7face8003530 con 0x7fad080a4f60 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926330621 0 0) 0x7fad081cd170 con 0x7fad0813e060 2024-04-25T23:55:03.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): my global_id is 4371 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad080a2610 con 0x7fad0813e060 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 225032807 0 0) 0x7fad080a2610 con 0x7fad0813e060 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad081cd170 con 0x7fad0813e060 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2686648498 0 0) 0x7face8003530 con 0x7fad080a4f60 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad080a2610 con 0x7fad080a4f60 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fad00001a20 con 0x7fad0813e060 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.334 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7facf0001aa0 con 0x7fad080a4f60 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.336 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071153658 0 0) 0x7fad0809efd0 con 0x7fad080a4680 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient(hunting): my global_id is 4408 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7face8003530 con 0x7fad080a4680 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3621360550 0 0) 0x7fad081cd170 con 0x7fad0813e060 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 >> v1:172.21.15.171:6792/0 conn(0x7fad080a4680 legacy=0x7fad081cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 >> v1:172.21.15.106:6791/0 conn(0x7fad080a4f60 legacy=0x7fad081cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 monclient: found mon.d 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad0809f2b0 con 0x7fad0813e060 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 5 monclient: authenticate success, global_id 4371 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _renew_subs 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad0809db50 con 0x7fad0813e060 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _renew_subs 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fad0809fd40 con 0x7fad0813e060 2024-04-25T23:55:03.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad00001d90 con 0x7fad0813e060 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fad00005460 con 0x7fad0813e060 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0559a640 4 set_mon_vals no callback set 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 10 monclient: dump: 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.339 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fad00010200 con 0x7fad0813e060 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facec005090 con 0x7fad0813e060 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fad00044790 con 0x7fad0813e060 2024-04-25T23:55:03.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.340+0000 7fad0659c640 10 monclient: get_auth_request con 0x7face8037e80 auth_method 0 2024-04-25T23:55:03.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.344+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fad00015b10 con 0x7fad0813e060 2024-04-25T23:55:03.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.344+0000 7facff7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.344+0000 7facff7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.492+0000 7fad0ce8b640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-04-25T23:55:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.492+0000 7fad0ce8b640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-04-25T23:55:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.492+0000 7fad0ce8b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.492+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7facec005b90 con 0x7fad0813e060 2024-04-25T23:55:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.492+0000 7facff7fe640 1 -- 172.21.15.106:0/2621407457 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) ==== 92+0+10 (unknown 946793192 0 265718887) 0x7fad00015410 con 0x7fad0813e060 2024-04-25T23:55:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.492+0000 7facff7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-04-25T23:55:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.492+0000 7facff7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:03.476 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 8 2024-04-25T23:55:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 >> v1:172.21.15.171:6812/722422047 conn(0x7face8037e80 legacy=0x7face803a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 10 monclient: shutdown 2024-04-25T23:55:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 >> v1:172.21.15.106:6792/0 conn(0x7fad0813e060 legacy=0x7fad081d48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 shutdown_connections 2024-04-25T23:55:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 >> 172.21.15.106:0/2621407457 conn(0x7fad080a9c80 msgr2=0x7fad08136630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 shutdown_connections 2024-04-25T23:55:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.496+0000 7fad0ce8b640 1 -- 172.21.15.106:0/2621407457 wait complete. 2024-04-25T23:55:03.493 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T23:55:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 10 monclient: get_monmap_and_config 2024-04-25T23:55:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 10 monclient: monmap: 2024-04-25T23:55:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:03.624612+0000 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:03.624612+0000 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.604 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 1 Processor -- start 2024-04-25T23:55:03.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 1 -- start start 2024-04-25T23:55:03.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 10 monclient: init 2024-04-25T23:55:03.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 10 monclient: _add_conns ranks=[0,6,5,7,8,2,3,4,1] 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.620+0000 7f5466780640 10 monclient(hunting): picked mon.noname-a con 0x7f5460134970 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): picked mon.noname-d con 0x7f54600a4820 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): picked mon.noname-h con 0x7f546013e200 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546006dd40 con 0x7f5460134970 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54600a2b10 con 0x7f546013e200 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54600a2df0 con 0x7f54600a4820 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): authenticate will time out at 959.152176s 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5460134970 0x7f5460134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55198/0 (socket says 172.21.15.106:55198) 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545ffff640 1 -- 172.21.15.106:0/2197589572 learned_addr learned my addr 172.21.15.106:0/2197589572 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248531766 0 0) 0x7f546006dd40 con 0x7f5460134970 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): my global_id is 4419 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5448003530 con 0x7f5460134970 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3242486988 0 0) 0x7f54600a2df0 con 0x7f54600a4820 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient(hunting): my global_id is 4380 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f546006dd40 con 0x7f54600a4820 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3368594777 0 0) 0x7f546006dd40 con 0x7f54600a4820 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 >> v1:172.21.15.171:6791/0 conn(0x7f546013e200 legacy=0x7f54601405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 >> v1:172.21.15.106:6789/0 conn(0x7f5460134970 legacy=0x7f5460134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 monclient: found mon.noname-d 2024-04-25T23:55:03.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54600a30d0 con 0x7f54600a4820 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f54540017c0 con 0x7f54600a4820 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 5 monclient: authenticate success, global_id 4380 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: dump: 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.614 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54540019b0 con 0x7f54600a4820 2024-04-25T23:55:03.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 1 -- 172.21.15.106:0/2197589572 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5454003620 con 0x7f54600a4820 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 4 set_mon_vals no callback set 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545effd640 10 monclient: dump: 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.616 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: shutdown 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- 172.21.15.106:0/2197589572 >> v1:172.21.15.106:6792/0 conn(0x7f54600a4820 legacy=0x7f546013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- 172.21.15.106:0/2197589572 shutdown_connections 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- 172.21.15.106:0/2197589572 >> 172.21.15.106:0/2197589572 conn(0x7f54600a9e20 msgr2=0x7f54600aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- 172.21.15.106:0/2197589572 shutdown_connections 2024-04-25T23:55:03.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- 172.21.15.106:0/2197589572 wait complete. 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: monmap: 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.618 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 Processor -- start 2024-04-25T23:55:03.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- start start 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: init 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: _add_conns ranks=[8,2,6,0,4,3,5,1,7] 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): picked mon.noname-e con 0x7f54600a4820 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): picked mon.noname-b con 0x7f5460134970 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): picked mon.noname-d con 0x7f546013e200 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546009df60 con 0x7f5460134970 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546009e240 con 0x7f546013e200 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f546009c6d0 con 0x7f54600a4820 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient(hunting): authenticate will time out at 959.154892s 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545ffff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f54600a4820 0x7f546012a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42402/0 (socket says 172.21.15.106:42402) 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545f7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f5460134970 0x7f54601d17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49110/0 (socket says 172.21.15.106:49110) 2024-04-25T23:55:03.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545ffff640 1 -- 172.21.15.106:0/4107189121 learned_addr learned my addr 172.21.15.106:0/4107189121 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5464d1d640 1 --1- 172.21.15.106:0/4107189121 >> v1:172.21.15.106:6792/0 conn(0x7f546013e200 0x7f54601d4f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43648/0 (socket says 172.21.15.106:43648) 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 113065185 0 0) 0x7f546009c6d0 con 0x7f54600a4820 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): my global_id is 4445 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f544c003530 con 0x7f54600a4820 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853904981 0 0) 0x7f546009df60 con 0x7f5460134970 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): my global_id is 4286 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f546009c6d0 con 0x7f5460134970 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328337077 0 0) 0x7f546009e240 con 0x7f546013e200 2024-04-25T23:55:03.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): my global_id is 4389 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f546009df60 con 0x7f546013e200 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2374030293 0 0) 0x7f544c003530 con 0x7f54600a4820 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f546009e240 con 0x7f54600a4820 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1135491625 0 0) 0x7f546009df60 con 0x7f546013e200 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f544c003530 con 0x7f546013e200 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5450001620 con 0x7f54600a4820 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): dump: 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.622 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2357197365 0 0) 0x7f546009c6d0 con 0x7f5460134970 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f546009df60 con 0x7f5460134970 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5458001cc0 con 0x7f546013e200 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): dump: 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.624 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5454001780 con 0x7f5460134970 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient(hunting): dump: 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.625 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 935150957 0 0) 0x7f546009e240 con 0x7f54600a4820 2024-04-25T23:55:03.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 >> v1:172.21.15.106:6792/0 conn(0x7f546013e200 legacy=0x7f54601d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 >> v1:172.21.15.106:6790/0 conn(0x7f5460134970 legacy=0x7f54601d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 monclient: found mon.e 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54600a1e00 con 0x7f54600a4820 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f545cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 5 monclient: authenticate success, global_id 4445 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: _renew_subs 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f546009ef00 con 0x7f54600a4820 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: _renew_subs 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:03.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.624+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f546009bb80 con 0x7f54600a4820 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5450004aa0 con 0x7f54600a4820 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5450004f90 con 0x7f54600a4820 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545e7fc640 4 set_mon_vals no callback set 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 10 monclient: dump: 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.628 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f545000fd30 con 0x7f54600a4820 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f5466780640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f5466780640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f5466780640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5440005090 con 0x7f54600a4820 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f5450044470 con 0x7f54600a4820 2024-04-25T23:55:03.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.628+0000 7f545f7fe640 10 monclient: get_auth_request con 0x7f544c038070 auth_method 0 2024-04-25T23:55:03.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.632+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f54500157f0 con 0x7f54600a4820 2024-04-25T23:55:03.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.632+0000 7f545cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.632+0000 7f545cff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.788+0000 7f5466780640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-04-25T23:55:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.788+0000 7f5466780640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-04-25T23:55:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.788+0000 7f5466780640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.788+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5440005b90 con 0x7f54600a4820 2024-04-25T23:55:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f545cff9640 1 -- 172.21.15.106:0/4107189121 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) ==== 93+0+10 (unknown 554344602 0 2170607528) 0x7f54500150f0 con 0x7f54600a4820 2024-04-25T23:55:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f545cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-04-25T23:55:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f545cff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:03.774 INFO:teuthology.orchestra.run.smithi106.stdout:pg_num: 1 2024-04-25T23:55:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 >> v1:172.21.15.171:6812/722422047 conn(0x7f544c038070 legacy=0x7f544c03a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 10 monclient: shutdown 2024-04-25T23:55:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 >> v1:172.21.15.106:6793/0 conn(0x7f54600a4820 legacy=0x7f546012a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 shutdown_connections 2024-04-25T23:55:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 >> 172.21.15.106:0/4107189121 conn(0x7f54600a9e20 msgr2=0x7f5460130c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 shutdown_connections 2024-04-25T23:55:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.792+0000 7f5466780640 1 -- 172.21.15.106:0/4107189121 wait complete. 2024-04-25T23:55:03.790 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-04-25T23:55:03.790 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:55:03.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient: get_monmap_and_config 2024-04-25T23:55:03.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient: monmap: 2024-04-25T23:55:03.903 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:03.924769+0000 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:03.924769+0000 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.904 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 1 Processor -- start 2024-04-25T23:55:03.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 1 -- start start 2024-04-25T23:55:03.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient: init 2024-04-25T23:55:03.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient: _add_conns ranks=[8,2,7,4,5,1,6,0,3] 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient(hunting): picked mon.noname-e con 0x7fd364134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient(hunting): picked mon.noname-b con 0x7fd3640a4820 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient(hunting): picked mon.noname-i con 0x7fd36413e200 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36406dd40 con 0x7fd3640a4820 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3640a2b10 con 0x7fd36413e200 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3640a2df0 con 0x7fd364134970 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd36bc10640 10 monclient(hunting): authenticate will time out at 959.451876s 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.920+0000 7fd3699ac640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fd364134970 0x7fd364134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42410/0 (socket says 172.21.15.106:42410) 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3691ab640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd3640a4820 0x7fd36413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49124/0 (socket says 172.21.15.106:49124) 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3699ac640 1 -- 172.21.15.106:0/3178857102 learned_addr learned my addr 172.21.15.106:0/3178857102 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237968016 0 0) 0x7fd3640a2df0 con 0x7fd364134970 2024-04-25T23:55:03.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): my global_id is 4454 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd350003530 con 0x7fd364134970 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975455082 0 0) 0x7fd36406dd40 con 0x7fd3640a4820 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient(hunting): my global_id is 4295 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3640a2df0 con 0x7fd3640a4820 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 912316727 0 0) 0x7fd350003530 con 0x7fd364134970 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 >> v1:172.21.15.171:6792/0 conn(0x7fd36413e200 legacy=0x7fd3641405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 >> v1:172.21.15.106:6790/0 conn(0x7fd3640a4820 legacy=0x7fd36413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 monclient: found mon.noname-e 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3640a30d0 con 0x7fd364134970 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3540017c0 con 0x7fd364134970 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 5 monclient: authenticate success, global_id 4454 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:03.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: dump: 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.915 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd3540019b0 con 0x7fd364134970 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 4 set_mon_vals no callback set 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 1 -- 172.21.15.106:0/3178857102 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd354004bf0 con 0x7fd364134970 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3689aa640 10 monclient: dump: 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.916 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient: shutdown 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:03.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- 172.21.15.106:0/3178857102 >> v1:172.21.15.106:6793/0 conn(0x7fd364134970 legacy=0x7fd364134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- 172.21.15.106:0/3178857102 shutdown_connections 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- 172.21.15.106:0/3178857102 >> 172.21.15.106:0/3178857102 conn(0x7fd3640a9e20 msgr2=0x7fd3640aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- 172.21.15.106:0/3178857102 shutdown_connections 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- 172.21.15.106:0/3178857102 wait complete. 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient: build_initial_monmap 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient: monmap: 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:03.918 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 Processor -- start 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- start start 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient: init 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient: _add_conns ranks=[5,3,7,6,2,0,4,1,8] 2024-04-25T23:55:03.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient(hunting): picked mon.noname-h con 0x7fd3640a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient(hunting): picked mon.noname-g con 0x7fd364134970 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient(hunting): picked mon.noname-i con 0x7fd36413e200 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd36409f780 con 0x7fd364134970 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3640a1e00 con 0x7fd3640a4820 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd364135620 con 0x7fd36413e200 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd36bc10640 10 monclient(hunting): authenticate will time out at 959.454915s 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3691ab640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd364134970 0x7fd3641d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:59486/0 (socket says 172.21.15.106:59486) 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd3691ab640 1 -- 172.21.15.106:0/1029594611 learned_addr learned my addr 172.21.15.106:0/1029594611 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1149924823 0 0) 0x7fd36409f780 con 0x7fd364134970 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): my global_id is 4359 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd348003530 con 0x7fd364134970 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760122886 0 0) 0x7fd364135620 con 0x7fd36413e200 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): my global_id is 4417 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd36409f780 con 0x7fd36413e200 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3706914638 0 0) 0x7fd3640a30d0 con 0x7fd3640a4820 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 10 monclient(hunting): my global_id is 4442 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.924+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd364135620 con 0x7fd3640a4820 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1822780722 0 0) 0x7fd348003530 con 0x7fd364134970 2024-04-25T23:55:03.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd3640a30d0 con 0x7fd364134970 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd360001580 con 0x7fd364134970 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): dump: 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3529460542 0 0) 0x7fd36409f780 con 0x7fd36413e200 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd348003530 con 0x7fd36413e200 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd35c001c40 con 0x7fd36413e200 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): dump: 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.923 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 852173912 0 0) 0x7fd364135620 con 0x7fd3640a4820 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd36409f780 con 0x7fd3640a4820 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd354001780 con 0x7fd3640a4820 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient(hunting): dump: 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1844621227 0 0) 0x7fd3640a30d0 con 0x7fd364134970 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 >> v1:172.21.15.171:6792/0 conn(0x7fd36413e200 legacy=0x7fd3641d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 >> v1:172.21.15.171:6791/0 conn(0x7fd3640a4820 legacy=0x7fd36412dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 monclient: found mon.g 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3640a1a40 con 0x7fd364134970 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 5 monclient: authenticate success, global_id 4359 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 10 monclient: _renew_subs 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd364135e80 con 0x7fd364134970 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 10 monclient: _renew_subs 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd36412e330 con 0x7fd364134970 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd360001860 con 0x7fd364134970 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:03.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35bfff640 4 set_mon_vals no callback set 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd360004de0 con 0x7fd364134970 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 10 monclient: dump: 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd34c005090 con 0x7fd364134970 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd36000fc00 con 0x7fd364134970 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fd3600443f0 con 0x7fd364134970 2024-04-25T23:55:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.928+0000 7fd3699ac640 10 monclient: get_auth_request con 0x7fd348038180 auth_method 0 2024-04-25T23:55:03.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.940+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd360015710 con 0x7fd364134970 2024-04-25T23:55:03.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.940+0000 7fd35a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:03.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:03.940+0000 7fd35a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:04.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.088+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd34c000ba0 con 0x7fd348038180 2024-04-25T23:55:04.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.088+0000 7fd35a7fc640 1 -- 172.21.15.106:0/1029594611 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33833 (unknown 2965378022 0 1057021456) 0x7fd34c000ba0 con 0x7fd348038180 2024-04-25T23:55:04.073 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:55:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-25T23:55:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 >> v1:172.21.15.171:6812/722422047 conn(0x7fd348038180 legacy=0x7fd34803a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 10 monclient: shutdown 2024-04-25T23:55:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 >> v1:172.21.15.171:6790/0 conn(0x7fd364134970 legacy=0x7fd3641d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 shutdown_connections 2024-04-25T23:55:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 >> 172.21.15.106:0/1029594611 conn(0x7fd3640a9e20 msgr2=0x7fd364130ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 shutdown_connections 2024-04-25T23:55:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.092+0000 7fd36bc10640 1 -- 172.21.15.106:0/1029594611 wait complete. 2024-04-25T23:55:04.091 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-25T23:55:03.583881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163048,"kb_used_data":872,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067992,"statfs":{"total":579820584960,"available":579653623808,"internally_reserved":0,"allocated":892928,"data_stored":1285862,"data_compressed":18382,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000621"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740478+0000","last_change":"2024-04-25T23:54:58.727817+0000","last_active":"2024-04-25T23:54:59.740478+0000","last_peered":"2024-04-25T23:54:59.740478+0000","last_clean":"2024-04-25T23:54:59.740478+0000","last_became_active":"2024-04-25T23:54:58.727069+0000","last_became_peered":"2024-04-25T23:54:58.727069+0000","last_unstale":"2024-04-25T23:54:59.740478+0000","last_undegraded":"2024-04-25T23:54:59.740478+0000","last_fullsized":"2024-04-25T23:54:59.740478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:31.367276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745172+0000","last_change":"2024-04-25T23:54:58.913077+0000","last_active":"2024-04-25T23:54:59.745172+0000","last_peered":"2024-04-25T23:54:59.745172+0000","last_clean":"2024-04-25T23:54:59.745172+0000","last_became_active":"2024-04-25T23:54:58.912576+0000","last_became_peered":"2024-04-25T23:54:58.912576+0000","last_unstale":"2024-04-25T23:54:59.745172+0000","last_undegraded":"2024-04-25T23:54:59.745172+0000","last_fullsized":"2024-04-25T23:54:59.745172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:43.683740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893896+0000","last_change":"2024-04-25T23:54:58.722957+0000","last_active":"2024-04-25T23:54:59.893896+0000","last_peered":"2024-04-25T23:54:59.893896+0000","last_clean":"2024-04-25T23:54:59.893896+0000","last_became_active":"2024-04-25T23:54:58.722155+0000","last_became_peered":"2024-04-25T23:54:58.722155+0000","last_unstale":"2024-04-25T23:54:59.893896+0000","last_undegraded":"2024-04-25T23:54:59.893896+0000","last_fullsized":"2024-04-25T23:54:59.893896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:40:41.779047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.894219+0000","last_change":"2024-04-25T23:54:58.731904+0000","last_active":"2024-04-25T23:54:59.894219+0000","last_peered":"2024-04-25T23:54:59.894219+0000","last_clean":"2024-04-25T23:54:59.894219+0000","last_became_active":"2024-04-25T23:54:58.731527+0000","last_became_peered":"2024-04-25T23:54:58.731527+0000","last_unstale":"2024-04-25T23:54:59.894219+0000","last_undegraded":"2024-04-25T23:54:59.894219+0000","last_fullsized":"2024-04-25T23:54:59.894219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:22.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:55:00.688160+0000","last_change":"2024-04-25T23:54:58.730774+0000","last_active":"2024-04-25T23:55:00.688160+0000","last_peered":"2024-04-25T23:55:00.688160+0000","last_clean":"2024-04-25T23:55:00.688160+0000","last_became_active":"2024-04-25T23:54:58.730120+0000","last_became_peered":"2024-04-25T23:54:58.730120+0000","last_unstale":"2024-04-25T23:55:00.688160+0000","last_undegraded":"2024-04-25T23:55:00.688160+0000","last_fullsized":"2024-04-25T23:55:00.688160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:21.729441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893931+0000","last_change":"2024-04-25T23:54:58.727780+0000","last_active":"2024-04-25T23:54:59.893931+0000","last_peered":"2024-04-25T23:54:59.893931+0000","last_clean":"2024-04-25T23:54:59.893931+0000","last_became_active":"2024-04-25T23:54:58.727196+0000","last_became_peered":"2024-04-25T23:54:58.727196+0000","last_unstale":"2024-04-25T23:54:59.893931+0000","last_undegraded":"2024-04-25T23:54:59.893931+0000","last_fullsized":"2024-04-25T23:54:59.893931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:46.544411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893844+0000","last_change":"2024-04-25T23:54:58.913127+0000","last_active":"2024-04-25T23:54:59.893844+0000","last_peered":"2024-04-25T23:54:59.893844+0000","last_clean":"2024-04-25T23:54:59.893844+0000","last_became_active":"2024-04-25T23:54:58.912611+0000","last_became_peered":"2024-04-25T23:54:58.912611+0000","last_unstale":"2024-04-25T23:54:59.893844+0000","last_undegraded":"2024-04-25T23:54:59.893844+0000","last_fullsized":"2024-04-25T23:54:59.893844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:05:38.061366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740381+0000","last_change":"2024-04-25T23:54:58.912958+0000","last_active":"2024-04-25T23:54:59.740381+0000","last_peered":"2024-04-25T23:54:59.740381+0000","last_clean":"2024-04-25T23:54:59.740381+0000","last_became_active":"2024-04-25T23:54:58.912600+0000","last_became_peered":"2024-04-25T23:54:58.912600+0000","last_unstale":"2024-04-25T23:54:59.740381+0000","last_undegraded":"2024-04-25T23:54:59.740381+0000","last_fullsized":"2024-04-25T23:54:59.740381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:55.855198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745524+0000","last_change":"2024-04-25T23:54:58.913088+0000","last_active":"2024-04-25T23:54:59.745524+0000","last_peered":"2024-04-25T23:54:59.745524+0000","last_clean":"2024-04-25T23:54:59.745524+0000","last_became_active":"2024-04-25T23:54:58.912664+0000","last_became_peered":"2024-04-25T23:54:58.912664+0000","last_unstale":"2024-04-25T23:54:59.745524+0000","last_undegraded":"2024-04-25T23:54:59.745524+0000","last_fullsized":"2024-04-25T23:54:59.745524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:56.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":18382,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":184320,"data_stored":566929,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":184320,"data_stored":566929,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:55:04.092 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T23:55:04.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient: get_monmap_and_config 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient: build_initial_monmap 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient: monmap: 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:04.228939+0000 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:04.228939+0000 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:04.208 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:04.209 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 1 Processor -- start 2024-04-25T23:55:04.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 1 -- start start 2024-04-25T23:55:04.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient: init 2024-04-25T23:55:04.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:04.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient: _add_conns ranks=[8,3,0,5,1,7,2,4,6] 2024-04-25T23:55:04.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient(hunting): picked mon.noname-e con 0x7f8adc071080 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient(hunting): picked mon.noname-g con 0x7f8adc072750 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f8adc072b70 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8adc06e240 con 0x7f8adc072b70 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8adc0705a0 con 0x7f8adc072750 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8adc070880 con 0x7f8adc071080 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.224+0000 7f8ae0b0c640 10 monclient(hunting): authenticate will time out at 959.755998s 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ada59c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f8adc071080 0x7f8adc137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42426/0 (socket says 172.21.15.106:42426) 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ada59c640 1 -- 172.21.15.106:0/514549242 learned_addr learned my addr 172.21.15.106:0/514549242 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8adad9d640 1 --1- 172.21.15.106:0/514549242 >> v1:172.21.15.106:6789/0 conn(0x7f8adc072b70 0x7f8adc140010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55202/0 (socket says 172.21.15.106:55202) 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753024442 0 0) 0x7f8adc070880 con 0x7f8adc071080 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): my global_id is 4463 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac8003530 con 0x7f8adc071080 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001501454 0 0) 0x7f8adc06e240 con 0x7f8adc072b70 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient(hunting): my global_id is 4428 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc070880 con 0x7f8adc072b70 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3958630018 0 0) 0x7f8ac8003530 con 0x7f8adc071080 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 >> v1:172.21.15.171:6790/0 conn(0x7f8adc072750 legacy=0x7f8adc13c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 >> v1:172.21.15.106:6789/0 conn(0x7f8adc072b70 legacy=0x7f8adc140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: _finish_hunting 0 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 monclient: found mon.noname-e 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc06cee0 con 0x7f8adc071080 2024-04-25T23:55:04.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: _finish_auth 0 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: _check_auth_tickets 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ac40017c0 con 0x7f8adc071080 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: dump: 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.218 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 5 monclient: authenticate success, global_id 4463 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ac40019b0 con 0x7f8adc071080 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 1 -- 172.21.15.106:0/514549242 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ac4004bf0 con 0x7f8adc071080 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 4 set_mon_vals no callback set 2024-04-25T23:55:04.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad959a640 10 monclient: dump: 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.220 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: shutdown 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/514549242 >> v1:172.21.15.106:6793/0 conn(0x7f8adc071080 legacy=0x7f8adc137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/514549242 shutdown_connections 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/514549242 >> 172.21.15.106:0/514549242 conn(0x7f8adc0a8370 msgr2=0x7f8adc0a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/514549242 shutdown_connections 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/514549242 wait complete. 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: build_initial_monmap 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: monmap: 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:04.221 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 Processor -- start 2024-04-25T23:55:04.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- start start 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: init 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: _add_conns ranks=[1,6,0,2,3,7,4,5,8] 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient(hunting): picked mon.noname-f con 0x7f8adc071080 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient(hunting): picked mon.noname-d con 0x7f8adc072750 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient(hunting): picked mon.noname-a con 0x7f8adc072b70 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8adc136ad0 con 0x7f8adc072b70 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8adc13d810 con 0x7f8adc071080 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8adc06d450 con 0x7f8adc072750 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient(hunting): authenticate will time out at 959.759032s 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8adad9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8adc072b70 0x7f8adc1d46d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55210/0 (socket says 172.21.15.106:55210) 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8adad9d640 1 -- 172.21.15.106:0/446989313 learned_addr learned my addr 172.21.15.106:0/446989313 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727019689 0 0) 0x7f8adc136ad0 con 0x7f8adc072b70 2024-04-25T23:55:04.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): my global_id is 4437 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8abc003530 con 0x7f8adc072b70 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684738179 0 0) 0x7f8adc06d450 con 0x7f8adc072750 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): my global_id is 4398 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8adc136ad0 con 0x7f8adc072750 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3133630370 0 0) 0x7f8abc003530 con 0x7f8adc072b70 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8adc06d450 con 0x7f8adc072b70 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ad4001d40 con 0x7f8adc072b70 2024-04-25T23:55:04.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): dump: 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.225 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3038693043 0 0) 0x7f8adc136ad0 con 0x7f8adc072750 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8abc003530 con 0x7f8adc072750 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8acc0019a0 con 0x7f8adc072750 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient(hunting): dump: 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.226 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2019741625 0 0) 0x7f8adc06d450 con 0x7f8adc072b70 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 >> v1:172.21.15.106:6792/0 conn(0x7f8adc072750 legacy=0x7f8adc1c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 >> v1:172.21.15.171:6789/0 conn(0x7f8adc071080 legacy=0x7f8adc1363c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 monclient: found mon.a 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8adc06d930 con 0x7f8adc072b70 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ad2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 5 monclient: authenticate success, global_id 4437 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: _renew_subs 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8adc13e010 con 0x7f8adc072b70 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: _renew_subs 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.228+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8adc1c9520 con 0x7f8adc072b70 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ad4004e20 con 0x7f8adc072b70 2024-04-25T23:55:04.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ad4005310 con 0x7f8adc072b70 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 10 monclient: dump: 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.229 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad8d99640 4 set_mon_vals no callback set 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ae0b0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8ad40100b0 con 0x7f8adc072b70 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f8ad40447b0 con 0x7f8adc072b70 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ae0b0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ae0b0c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8adc075890 con 0x7f8adc072b70 2024-04-25T23:55:04.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.232+0000 7f8ada59c640 10 monclient: get_auth_request con 0x7f8abc037dc0 auth_method 0 2024-04-25T23:55:04.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.236+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8ad4015c10 con 0x7f8adc072b70 2024-04-25T23:55:04.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.236+0000 7f8ad2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.236+0000 7f8ad2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:04.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.392+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8adc13feb0 con 0x7f8abc037dc0 2024-04-25T23:55:04.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ad2ffd640 1 -- 172.21.15.106:0/446989313 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+33833 (unknown 2965378022 0 1057021456) 0x7f8adc13feb0 con 0x7f8abc037dc0 2024-04-25T23:55:04.377 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-25T23:55:04.378 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-25T23:55:04.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 >> v1:172.21.15.171:6812/722422047 conn(0x7f8abc037dc0 legacy=0x7f8abc03a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 10 monclient: shutdown 2024-04-25T23:55:04.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:04.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 >> v1:172.21.15.106:6789/0 conn(0x7f8adc072b70 legacy=0x7f8adc1d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 shutdown_connections 2024-04-25T23:55:04.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 >> 172.21.15.106:0/446989313 conn(0x7f8adc0a8370 msgr2=0x7f8adc0a2d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:04.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 shutdown_connections 2024-04-25T23:55:04.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.396+0000 7f8ae0b0c640 1 -- 172.21.15.106:0/446989313 wait complete. 2024-04-25T23:55:04.395 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":14,"stamp":"2024-04-25T23:55:03.583881+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163048,"kb_used_data":872,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067992,"statfs":{"total":579820584960,"available":579653623808,"internally_reserved":0,"allocated":892928,"data_stored":1285862,"data_compressed":18382,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":14,"num_write_kb":262,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.000621"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740478+0000","last_change":"2024-04-25T23:54:58.727817+0000","last_active":"2024-04-25T23:54:59.740478+0000","last_peered":"2024-04-25T23:54:59.740478+0000","last_clean":"2024-04-25T23:54:59.740478+0000","last_became_active":"2024-04-25T23:54:58.727069+0000","last_became_peered":"2024-04-25T23:54:58.727069+0000","last_unstale":"2024-04-25T23:54:59.740478+0000","last_undegraded":"2024-04-25T23:54:59.740478+0000","last_fullsized":"2024-04-25T23:54:59.740478+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:17:31.367276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745172+0000","last_change":"2024-04-25T23:54:58.913077+0000","last_active":"2024-04-25T23:54:59.745172+0000","last_peered":"2024-04-25T23:54:59.745172+0000","last_clean":"2024-04-25T23:54:59.745172+0000","last_became_active":"2024-04-25T23:54:58.912576+0000","last_became_peered":"2024-04-25T23:54:58.912576+0000","last_unstale":"2024-04-25T23:54:59.745172+0000","last_undegraded":"2024-04-25T23:54:59.745172+0000","last_fullsized":"2024-04-25T23:54:59.745172+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:07:43.683740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893896+0000","last_change":"2024-04-25T23:54:58.722957+0000","last_active":"2024-04-25T23:54:59.893896+0000","last_peered":"2024-04-25T23:54:59.893896+0000","last_clean":"2024-04-25T23:54:59.893896+0000","last_became_active":"2024-04-25T23:54:58.722155+0000","last_became_peered":"2024-04-25T23:54:58.722155+0000","last_unstale":"2024-04-25T23:54:59.893896+0000","last_undegraded":"2024-04-25T23:54:59.893896+0000","last_fullsized":"2024-04-25T23:54:59.893896+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:40:41.779047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.894219+0000","last_change":"2024-04-25T23:54:58.731904+0000","last_active":"2024-04-25T23:54:59.894219+0000","last_peered":"2024-04-25T23:54:59.894219+0000","last_clean":"2024-04-25T23:54:59.894219+0000","last_became_active":"2024-04-25T23:54:58.731527+0000","last_became_peered":"2024-04-25T23:54:58.731527+0000","last_unstale":"2024-04-25T23:54:59.894219+0000","last_undegraded":"2024-04-25T23:54:59.894219+0000","last_fullsized":"2024-04-25T23:54:59.894219+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:17:22.487596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"15'117","reported_seq":162,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:55:00.688160+0000","last_change":"2024-04-25T23:54:58.730774+0000","last_active":"2024-04-25T23:55:00.688160+0000","last_peered":"2024-04-25T23:55:00.688160+0000","last_clean":"2024-04-25T23:55:00.688160+0000","last_became_active":"2024-04-25T23:54:58.730120+0000","last_became_peered":"2024-04-25T23:54:58.730120+0000","last_unstale":"2024-04-25T23:55:00.688160+0000","last_undegraded":"2024-04-25T23:55:00.688160+0000","last_fullsized":"2024-04-25T23:55:00.688160+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:47:21.729441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893931+0000","last_change":"2024-04-25T23:54:58.727780+0000","last_active":"2024-04-25T23:54:59.893931+0000","last_peered":"2024-04-25T23:54:59.893931+0000","last_clean":"2024-04-25T23:54:59.893931+0000","last_became_active":"2024-04-25T23:54:58.727196+0000","last_became_peered":"2024-04-25T23:54:58.727196+0000","last_unstale":"2024-04-25T23:54:59.893931+0000","last_undegraded":"2024-04-25T23:54:59.893931+0000","last_fullsized":"2024-04-25T23:54:59.893931+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:52:46.544411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.893844+0000","last_change":"2024-04-25T23:54:58.913127+0000","last_active":"2024-04-25T23:54:59.893844+0000","last_peered":"2024-04-25T23:54:59.893844+0000","last_clean":"2024-04-25T23:54:59.893844+0000","last_became_active":"2024-04-25T23:54:58.912611+0000","last_became_peered":"2024-04-25T23:54:58.912611+0000","last_unstale":"2024-04-25T23:54:59.893844+0000","last_undegraded":"2024-04-25T23:54:59.893844+0000","last_fullsized":"2024-04-25T23:54:59.893844+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:05:38.061366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.740381+0000","last_change":"2024-04-25T23:54:58.912958+0000","last_active":"2024-04-25T23:54:59.740381+0000","last_peered":"2024-04-25T23:54:59.740381+0000","last_clean":"2024-04-25T23:54:59.740381+0000","last_became_active":"2024-04-25T23:54:58.912600+0000","last_became_peered":"2024-04-25T23:54:58.912600+0000","last_unstale":"2024-04-25T23:54:59.740381+0000","last_undegraded":"2024-04-25T23:54:59.740381+0000","last_fullsized":"2024-04-25T23:54:59.740381+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:10:55.855198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":12,"reported_epoch":15,"state":"active+clean","last_fresh":"2024-04-25T23:54:59.745524+0000","last_change":"2024-04-25T23:54:58.913088+0000","last_active":"2024-04-25T23:54:59.745524+0000","last_peered":"2024-04-25T23:54:59.745524+0000","last_clean":"2024-04-25T23:54:59.745524+0000","last_became_active":"2024-04-25T23:54:58.912664+0000","last_became_peered":"2024-04-25T23:54:58.912664+0000","last_unstale":"2024-04-25T23:54:59.745524+0000","last_undegraded":"2024-04-25T23:54:59.745524+0000","last_fullsized":"2024-04-25T23:54:59.745524+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:50:56.990618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":18382,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640260,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640260,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":184320,"data_stored":566929,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640259,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":180,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":184320,"data_stored":566929,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640260,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27148,"kb_used_data":128,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344692,"statfs":{"total":96636764160,"available":96608964608,"internally_reserved":0,"allocated":131072,"data_stored":38001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":9191,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T23:55:04.396 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-04-25T23:55:04.397 DEBUG:tasks.mon_thrash:Yielding 2024-04-25T23:55:04.397 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T23:55:04.410 INFO:tasks.workunit:Pulling workunits from ref b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T23:55:04.410 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T23:55:04.410 DEBUG:teuthology.orchestra.run.smithi171:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T23:55:04.411 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-04-25T23:55:04.411 INFO:tasks.mon_thrash.mon_thrasher:seed: 1714089304, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: True, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-04-25T23:55:04.411 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-25T23:55:04.411 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:55:04.417 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T23:55:04.417 INFO:teuthology.orchestra.run.smithi171.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-25T23:55:04.417 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-25T23:55:04.467 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-25T23:55:04.467 DEBUG:teuthology.orchestra.run.smithi171:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-25T23:55:04.515 INFO:tasks.workunit:timeout=3h 2024-04-25T23:55:04.515 INFO:tasks.workunit:cleanup=True 2024-04-25T23:55:04.515 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b22e2ebdeb24376882b7bda2a7329c8cccc2276a 2024-04-25T23:55:04.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient: get_monmap_and_config 2024-04-25T23:55:04.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient: build_initial_monmap 2024-04-25T23:55:04.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient: monmap: 2024-04-25T23:55:04.522 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:04.522 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:04.543891+0000 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:04.543891+0000 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:04.523 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 1 Processor -- start 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 1 -- start start 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient: init 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient: _add_conns ranks=[2,7,5,1,8,3,4,0,6] 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient(hunting): picked mon.noname-b con 0x7f59200a1c30 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient(hunting): picked mon.noname-i con 0x7f59200a2010 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:04.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient(hunting): picked mon.noname-h con 0x7f592013dc40 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592009c5b0 con 0x7f59200a1c30 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592009c2d0 con 0x7f592013dc40 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59200a3a70 con 0x7f59200a2010 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 10 monclient(hunting): authenticate will time out at 960.071047s 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591effd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f59200a1c30 0x7f592009aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49126/0 (socket says 172.21.15.106:49126) 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591effd640 1 -- 172.21.15.106:0/1916804458 learned_addr learned my addr 172.21.15.106:0/1916804458 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 331482483 0 0) 0x7f59180014a0 con 0x7f59200a1c30 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient(hunting): my global_id is 4304 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f590c003530 con 0x7f59200a1c30 2024-04-25T23:55:04.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3218239784 0 0) 0x7f590c003530 con 0x7f59200a1c30 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 >> v1:172.21.15.171:6792/0 conn(0x7f59200a2010 legacy=0x7f59200a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 >> v1:172.21.15.171:6791/0 conn(0x7f592013dc40 legacy=0x7f5920140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 monclient: found mon.noname-b 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5920144780 con 0x7f59200a1c30 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5918001d10 con 0x7f59200a1c30 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f591dffb640 10 monclient: dump: 2024-04-25T23:55:04.532 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 5 monclient: authenticate success, global_id 4304 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.540+0000 7f5925765640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5918002070 con 0x7f59200a1c30 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591dffb640 1 -- 172.21.15.106:0/1916804458 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5918005030 con 0x7f59200a1c30 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591dffb640 10 monclient: dump: 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.534 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 4 set_mon_vals no callback set 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: shutdown 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1916804458 >> v1:172.21.15.106:6790/0 conn(0x7f59200a1c30 legacy=0x7f592009aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1916804458 shutdown_connections 2024-04-25T23:55:04.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1916804458 >> 172.21.15.106:0/1916804458 conn(0x7f59200a2d20 msgr2=0x7f59200a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1916804458 shutdown_connections 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1916804458 wait complete. 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: build_initial_monmap 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: monmap: 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:04.536 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 Processor -- start 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- start start 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: init 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _add_conns ranks=[3,6,8,7,2,4,5,1,0] 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient(hunting): picked mon.noname-g con 0x7f59200a1c30 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:04.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient(hunting): picked mon.noname-d con 0x7f59200a2010 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient(hunting): picked mon.noname-e con 0x7f592013dc40 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592013f4e0 con 0x7f59200a1c30 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592013f750 con 0x7f59200a2010 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f592013e020 con 0x7f592013dc40 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient(hunting): authenticate will time out at 960.074234s 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591f7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f592013dc40 0x7f59201d46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42440/0 (socket says 172.21.15.106:42440) 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591f7fe640 1 -- 172.21.15.106:0/1680897266 learned_addr learned my addr 172.21.15.106:0/1680897266 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935584310 0 0) 0x7f592013e020 con 0x7f592013dc40 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): my global_id is 4472 2024-04-25T23:55:04.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5900003530 con 0x7f592013dc40 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687801672 0 0) 0x7f592013f750 con 0x7f59200a2010 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): my global_id is 4407 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f592013e020 con 0x7f59200a2010 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 92239621 0 0) 0x7f5900003530 con 0x7f592013dc40 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f592013f750 con 0x7f592013dc40 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59100019a0 con 0x7f592013dc40 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): dump: 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.539 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:04.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2192094044 0 0) 0x7f592013e020 con 0x7f59200a2010 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5900003530 con 0x7f59200a2010 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59080019e0 con 0x7f59200a2010 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): dump: 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.541 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.542 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.543 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.543 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.543 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4137218711 0 0) 0x7f592013f4e0 con 0x7f59200a1c30 2024-04-25T23:55:04.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient(hunting): my global_id is 4377 2024-04-25T23:55:04.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f592013e020 con 0x7f59200a1c30 2024-04-25T23:55:04.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4215821212 0 0) 0x7f592013f750 con 0x7f592013dc40 2024-04-25T23:55:04.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 >> v1:172.21.15.106:6792/0 conn(0x7f59200a2010 legacy=0x7f5920140890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 >> v1:172.21.15.171:6790/0 conn(0x7f59200a1c30 legacy=0x7f592013ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 monclient: found mon.e 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5920131d20 con 0x7f592013dc40 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:04.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 5 monclient: authenticate success, global_id 4472 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _renew_subs 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59201345d0 con 0x7f592013dc40 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _renew_subs 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f59201d5fd0 con 0x7f592013dc40 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5910003950 con 0x7f592013dc40 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5910003ec0 con 0x7f592013dc40 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f591d7fa640 4 set_mon_vals no callback set 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f59177fe640 10 monclient: dump: 2024-04-25T23:55:04.546 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.547 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.544+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5904005090 con 0x7f592013dc40 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.548+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f59100040e0 con 0x7f592013dc40 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.548+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f5910044560 con 0x7f592013dc40 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.548+0000 7f591effd640 10 monclient: get_auth_request con 0x7f5900037ee0 auth_method 0 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.552+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5910015880 con 0x7f592013dc40 2024-04-25T23:55:04.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.552+0000 7f59177fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.552+0000 7f59177fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:04.564 INFO:tasks.workunit.client.0.smithi171.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T23:55:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.760+0000 7f5925765640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:55:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.760+0000 7f5925765640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:55:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.760+0000 7f5925765640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:55:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.760+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f5904005380 con 0x7f592013dc40 2024-04-25T23:55:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f59177fe640 1 -- 172.21.15.106:0/1680897266 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1208274539) 0x7f5910015180 con 0x7f592013dc40 2024-04-25T23:55:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f59177fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:55:04.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f59177fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:04.746 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":8,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":18,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 >> v1:172.21.15.171:6812/722422047 conn(0x7f5900037ee0 legacy=0x7f590003a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 10 monclient: shutdown 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 >> v1:172.21.15.106:6793/0 conn(0x7f592013dc40 legacy=0x7f59201d46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 shutdown_connections 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 >> 172.21.15.106:0/1680897266 conn(0x7f59200a2d20 msgr2=0x7f59200a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 shutdown_connections 2024-04-25T23:55:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.764+0000 7f5925765640 1 -- 172.21.15.106:0/1680897266 wait complete. 2024-04-25T23:55:04.764 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-25T23:55:04.764 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-25T23:55:04.764 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-25T23:55:04.764 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:55:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.896+0000 7f7fbd630640 10 monclient: get_monmap_and_config 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.896+0000 7f7fbd630640 10 monclient: build_initial_monmap 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.896+0000 7f7fbd630640 10 monclient: monmap: 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:04.901189+0000 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:04.901189+0000 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:04.881 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.896+0000 7f7fbd630640 1 Processor -- start 2024-04-25T23:55:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.896+0000 7f7fbd630640 1 -- start start 2024-04-25T23:55:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.896+0000 7f7fbd630640 10 monclient: init 2024-04-25T23:55:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: _add_conns ranks=[6,3,4,0,7,8,5,2,1] 2024-04-25T23:55:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): picked mon.noname-d con 0x7f7fb8135870 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): picked mon.noname-g con 0x7f7fb81353b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): picked mon.noname-c con 0x7f7fb813bdf0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb806f2d0 con 0x7f7fb81353b0 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb8072330 con 0x7f7fb813bdf0 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb8072610 con 0x7f7fb8135870 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): authenticate will time out at 960.428283s 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb77fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f7fb813bdf0 0x7f7fb813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48712/0 (socket says 172.21.15.106:48712) 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb6ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f7fb8135870 0x7f7fb8135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43686/0 (socket says 172.21.15.106:43686) 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb77fe640 1 -- 172.21.15.106:0/1538713329 learned_addr learned my addr 172.21.15.106:0/1538713329 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939955105 0 0) 0x7f7fb8072330 con 0x7f7fb813bdf0 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): my global_id is 4441 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fa4003530 con 0x7f7fb813bdf0 2024-04-25T23:55:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845691277 0 0) 0x7f7fb8072610 con 0x7f7fb8135870 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient(hunting): my global_id is 4416 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb8072330 con 0x7f7fb8135870 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3675896285 0 0) 0x7f7fa4003530 con 0x7f7fb813bdf0 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 >> v1:172.21.15.106:6792/0 conn(0x7f7fb8135870 legacy=0x7f7fb8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 >> v1:172.21.15.171:6790/0 conn(0x7f7fb81353b0 legacy=0x7f7fb813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 monclient: found mon.noname-c 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb80a3260 con 0x7f7fb813bdf0 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fb0001b40 con 0x7f7fb813bdf0 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: dump: 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 5 monclient: authenticate success, global_id 4441 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fb0001e20 con 0x7f7fb813bdf0 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 1 -- 172.21.15.106:0/1538713329 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fb0004f70 con 0x7f7fb813bdf0 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 4 set_mon_vals no callback set 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb5ffb640 10 monclient: dump: 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: shutdown 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- 172.21.15.106:0/1538713329 >> v1:172.21.15.106:6791/0 conn(0x7f7fb813bdf0 legacy=0x7f7fb813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- 172.21.15.106:0/1538713329 shutdown_connections 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- 172.21.15.106:0/1538713329 >> 172.21.15.106:0/1538713329 conn(0x7f7fb80a64e0 msgr2=0x7f7fb80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- 172.21.15.106:0/1538713329 shutdown_connections 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- 172.21.15.106:0/1538713329 wait complete. 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: build_initial_monmap 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: monmap: 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 Processor -- start 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- start start 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: init 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient: _add_conns ranks=[7,1,5,2,0,3,8,6,4] 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): picked mon.noname-i con 0x7f7fb81353b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): picked mon.noname-f con 0x7f7fb8135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): picked mon.noname-h con 0x7f7fb813bdf0 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb81c7220 con 0x7f7fb8135870 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb809e680 con 0x7f7fb813bdf0 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fb8131c80 con 0x7f7fb81353b0 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fbd630640 10 monclient(hunting): authenticate will time out at 960.431172s 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb6ffd640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f7fb81353b0 0x7f7fb81c6b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:49512/0 (socket says 172.21.15.106:49512) 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb6ffd640 1 -- 172.21.15.106:0/362460769 learned_addr learned my addr 172.21.15.106:0/362460769 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb67fc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7fb8135870 0x7f7fb8134a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:42040/0 (socket says 172.21.15.106:42040) 2024-04-25T23:55:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.900+0000 7f7fb77fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7fb813bdf0 0x7f7fb81d23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:59038/0 (socket says 172.21.15.106:59038) 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2675386072 0 0) 0x7f7fb81c7220 con 0x7f7fb8135870 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): my global_id is 4330 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f98003530 con 0x7f7fb8135870 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2604063402 0 0) 0x7f7fb8131c80 con 0x7f7fb81353b0 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): my global_id is 4435 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb81c7220 con 0x7f7fb81353b0 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922306566 0 0) 0x7f7fb809e680 con 0x7f7fb813bdf0 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): my global_id is 4460 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb8131c80 con 0x7f7fb813bdf0 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3497840754 0 0) 0x7f7f98003530 con 0x7f7fb8135870 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fb809e680 con 0x7f7fb8135870 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1892308788 0 0) 0x7f7fb81c7220 con 0x7f7fb81353b0 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f98003530 con 0x7f7fb81353b0 2024-04-25T23:55:04.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1289147414 0 0) 0x7f7fb8131c80 con 0x7f7fb813bdf0 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fb81c7220 con 0x7f7fb813bdf0 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fa8001ac0 con 0x7f7fb81353b0 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.899 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fa0001a60 con 0x7f7fb8135870 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.900 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fb0001ba0 con 0x7f7fb813bdf0 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.901 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3389033364 0 0) 0x7f7f98003530 con 0x7f7fb81353b0 2024-04-25T23:55:04.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.171:6791/0 conn(0x7f7fb813bdf0 legacy=0x7f7fb81d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.171:6789/0 conn(0x7f7fb8135870 legacy=0x7f7fb8134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 monclient: found mon.i 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fb8131f60 con 0x7f7fb81353b0 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 5 monclient: authenticate success, global_id 4435 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 10 monclient: _renew_subs 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7fb8135170 con 0x7f7fb81353b0 2024-04-25T23:55:04.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 10 monclient: _renew_subs 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7fb8130f60 con 0x7f7fb81353b0 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fa8004aa0 con 0x7f7fb81353b0 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fb57fa640 4 set_mon_vals no callback set 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fa8004f90 con 0x7f7fb81353b0 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: dump: 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.904 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f9c0065d0 con 0x7f7f9c002870 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940662143 0 0) 0x7f7f9c0065d0 con 0x7f7f9c002870 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient(hunting): my global_id is 4446 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f98003530 con 0x7f7f9c002870 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1081381596 0 0) 0x7f7f98003530 con 0x7f7f9c002870 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f9c0065d0 con 0x7f7f9c002870 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fa0003c90 con 0x7f7f9c002870 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: dump: 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.906 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7fa800fd30 con 0x7f7fb81353b0 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f7fa80443e0 con 0x7f7fb81353b0 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 445025256 0 0) 0x7f7f9c0065d0 con 0x7f7f9c002870 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f9c00a160 con 0x7f7f9c002870 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7fb77fe640 10 monclient: get_auth_request con 0x7f7f98038170 auth_method 0 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7fa0004290 con 0x7f7f9c002870 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:04.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.106:6789/0 conn(0x7f7f9c002870 legacy=0x7f7f9c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.904+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.106:6789/0 conn(0x7f7f9c002870 legacy=0x7f7f9c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f9c009e60 con 0x7f7f9c009120 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414370450 0 0) 0x7f7f9c009e60 con 0x7f7f9c009120 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient(hunting): my global_id is 4455 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f9c0065d0 con 0x7f7f9c009120 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3583715985 0 0) 0x7f7f9c0065d0 con 0x7f7f9c009120 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f9c009e60 con 0x7f7f9c009120 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fa0005d00 con 0x7f7f9c009120 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:04.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient: dump: 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:04.909 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4025013246 0 0) 0x7f7f9c009e60 con 0x7f7f9c009120 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f9c00c3e0 con 0x7f7f9c009120 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 1987618430) 0x7f7fa00071b0 con 0x7f7f9c009120 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.106:6789/0 conn(0x7f7f9c009120 legacy=0x7f7f9c0095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7faf7fe640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.106:6789/0 conn(0x7f7f9c009120 legacy=0x7f7f9c0095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:04.910 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 23471, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:04.911 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 18, 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:04.912 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:04.913 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:04.914 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:04.915 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.917 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:04.919 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.921 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:04.922 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.923 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:04.924 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:04.926 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:04.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:04.928 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.171:6812/722422047 conn(0x7f7f98038170 legacy=0x7f7f9803a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 10 monclient: shutdown 2024-04-25T23:55:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 >> v1:172.21.15.171:6792/0 conn(0x7f7fb81353b0 legacy=0x7f7fb81c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fb77fe640 1 -- 172.21.15.106:0/362460769 reap_dead start 2024-04-25T23:55:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fb77fe640 1 -- 172.21.15.106:0/362460769 reap_dead start 2024-04-25T23:55:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 shutdown_connections 2024-04-25T23:55:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 >> 172.21.15.106:0/362460769 conn(0x7f7fb80a64e0 msgr2=0x7f7fb80a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 shutdown_connections 2024-04-25T23:55:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:04.912+0000 7f7fbd630640 1 -- 172.21.15.106:0/362460769 wait complete. 2024-04-25T23:55:04.930 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:04.930 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-25T23:55:04.930 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:55:05.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.052+0000 7f992372c640 10 monclient: get_monmap_and_config 2024-04-25T23:55:05.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.052+0000 7f992372c640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.052+0000 7f992372c640 10 monclient: monmap: 2024-04-25T23:55:05.037 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.037 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.037 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:05.057922+0000 2024-04-25T23:55:05.038 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:05.057922+0000 2024-04-25T23:55:05.038 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.038 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.038 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.038 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.038 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.039 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.039 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.039 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.039 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.039 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.039 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.040 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 Processor -- start 2024-04-25T23:55:05.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- start start 2024-04-25T23:55:05.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: init 2024-04-25T23:55:05.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: _add_conns ranks=[7,3,4,1,6,5,0,8,2] 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): picked mon.noname-i con 0x7f991c071080 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): picked mon.noname-g con 0x7f991c072750 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): picked mon.noname-c con 0x7f991c072b70 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c06e240 con 0x7f991c072750 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c0705a0 con 0x7f991c072b70 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c070880 con 0x7f991c071080 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): authenticate will time out at 960.585080s 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9921cc9640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f991c072b70 0x7f991c140010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48726/0 (socket says 172.21.15.106:48726) 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9921cc9640 1 -- 172.21.15.106:0/2639036400 learned_addr learned my addr 172.21.15.106:0/2639036400 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258449484 0 0) 0x7f991c0705a0 con 0x7f991c072b70 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient(hunting): my global_id is 4450 2024-04-25T23:55:05.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9908003530 con 0x7f991c072b70 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3723244050 0 0) 0x7f9908003530 con 0x7f991c072b70 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 >> v1:172.21.15.171:6792/0 conn(0x7f991c071080 legacy=0x7f991c137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 >> v1:172.21.15.171:6790/0 conn(0x7f991c072750 legacy=0x7f991c13c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 monclient: found mon.noname-c 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:55:05.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c06cee0 con 0x7f991c072b70 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9914001b40 con 0x7f991c072b70 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 5 monclient: authenticate success, global_id 4450 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: dump: 2024-04-25T23:55:05.059 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.060 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9914001e30 con 0x7f991c072b70 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 1 -- 172.21.15.106:0/2639036400 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9914004f70 con 0x7f991c072b70 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f9913fff640 10 monclient: dump: 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.061 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.062 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 4 set_mon_vals no callback set 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: shutdown 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- 172.21.15.106:0/2639036400 >> v1:172.21.15.106:6791/0 conn(0x7f991c072b70 legacy=0x7f991c140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- 172.21.15.106:0/2639036400 shutdown_connections 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- 172.21.15.106:0/2639036400 >> 172.21.15.106:0/2639036400 conn(0x7f991c0a8370 msgr2=0x7f991c0a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- 172.21.15.106:0/2639036400 shutdown_connections 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- 172.21.15.106:0/2639036400 wait complete. 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: monmap: 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:05.063 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 Processor -- start 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- start start 2024-04-25T23:55:05.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: init 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient: _add_conns ranks=[3,1,0,2,8,6,7,4,5] 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): picked mon.noname-g con 0x7f991c071080 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): picked mon.noname-f con 0x7f991c072750 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): picked mon.noname-a con 0x7f991c072b70 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c1cd9d0 con 0x7f991c072b70 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c06d930 con 0x7f991c072750 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f991c06d450 con 0x7f991c071080 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.056+0000 7f992372c640 10 monclient(hunting): authenticate will time out at 960.587942s 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9921cc9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f991c072b70 0x7f991c1d4e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55240/0 (socket says 172.21.15.106:55240) 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9921cc9640 1 -- 172.21.15.106:0/3864214410 learned_addr learned my addr 172.21.15.106:0/3864214410 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706000972 0 0) 0x7f991c1cd9d0 con 0x7f991c072b70 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): my global_id is 4464 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9900003560 con 0x7f991c072b70 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2383532753 0 0) 0x7f9900003560 con 0x7f991c072b70 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f991c1cd9d0 con 0x7f991c072b70 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9914001b00 con 0x7f991c072b70 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): dump: 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713813042 0 0) 0x7f991c06d450 con 0x7f991c071080 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): my global_id is 4404 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9900003560 con 0x7f991c071080 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1542760705 0 0) 0x7f991c1cd9d0 con 0x7f991c072b70 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.171:6790/0 conn(0x7f991c071080 legacy=0x7f991c1ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.171:6789/0 conn(0x7f991c072750 legacy=0x7f991c1cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 monclient: found mon.a 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f991c13ec80 con 0x7f991c072b70 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 5 monclient: authenticate success, global_id 4464 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 10 monclient: _renew_subs 2024-04-25T23:55:05.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f991c13ef60 con 0x7f991c072b70 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 10 monclient: _renew_subs 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f991c13f710 con 0x7f991c072b70 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9914001e30 con 0x7f991c072b70 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9914002060 con 0x7f991c072b70 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f99137fe640 4 set_mon_vals no callback set 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: dump: 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98fc0065d0 con 0x7f98fc002870 2024-04-25T23:55:05.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f99140103d0 con 0x7f991c072b70 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f9914044810 con 0x7f991c072b70 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2199721182 0 0) 0x7f98fc0065d0 con 0x7f98fc002870 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient(hunting): my global_id is 4313 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f991c1cd9d0 con 0x7f98fc002870 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 675708924 0 0) 0x7f991c1cd9d0 con 0x7f98fc002870 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98fc0065d0 con 0x7f98fc002870 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f990c001900 con 0x7f98fc002870 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: dump: 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.071 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9920cc7640 10 monclient: get_auth_request con 0x7f9900037820 auth_method 0 2024-04-25T23:55:05.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1765352114 0 0) 0x7f98fc0065d0 con 0x7f98fc002870 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f98fc00a160 con 0x7f98fc002870 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f990c001d30 con 0x7f98fc002870 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.106:6790/0 conn(0x7f98fc002870 legacy=0x7f98fc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.060+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.106:6790/0 conn(0x7f98fc002870 legacy=0x7f98fc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98fc009e50 con 0x7f98fc009110 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093549014 0 0) 0x7f98fc009e50 con 0x7f98fc009110 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient(hunting): my global_id is 4322 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98fc0065d0 con 0x7f98fc009110 2024-04-25T23:55:05.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1351918861 0 0) 0x7f98fc0065d0 con 0x7f98fc009110 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98fc009e50 con 0x7f98fc009110 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f990c003bf0 con 0x7f98fc009110 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient: dump: 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.074 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1345734792 0 0) 0x7f98fc009e50 con 0x7f98fc009110 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f98fc00c3e0 con 0x7f98fc009110 2024-04-25T23:55:05.075 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 23631, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:05.076 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 18, 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.077 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.078 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.079 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.080 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:05.081 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.082 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:05.082 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.082 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.082 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.085 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:05.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.089 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:05.090 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:05.091 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.093 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.094 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:05.095 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:05.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7734 (unknown 0 0 2093209526) 0x7f990c003fb0 con 0x7f98fc009110 2024-04-25T23:55:05.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:05.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:05.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.106:6790/0 conn(0x7f98fc009110 legacy=0x7f98fc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9911ffb640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.106:6790/0 conn(0x7f98fc009110 legacy=0x7f98fc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.171:6812/722422047 conn(0x7f9900037820 legacy=0x7f9900039ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 10 monclient: shutdown 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 >> v1:172.21.15.106:6789/0 conn(0x7f991c072b70 legacy=0x7f991c1d4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9921cc9640 1 -- 172.21.15.106:0/3864214410 reap_dead start 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f9921cc9640 1 -- 172.21.15.106:0/3864214410 reap_dead start 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 shutdown_connections 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 >> 172.21.15.106:0/3864214410 conn(0x7f991c0a8370 msgr2=0x7f991c0a3080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 shutdown_connections 2024-04-25T23:55:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.068+0000 7f992372c640 1 -- 172.21.15.106:0/3864214410 wait complete. 2024-04-25T23:55:05.098 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:05.099 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-25T23:55:05.099 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-25T23:55:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: get_monmap_and_config 2024-04-25T23:55:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: monmap: 2024-04-25T23:55:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:05.238448+0000 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:05.238448+0000 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.219 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 Processor -- start 2024-04-25T23:55:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- start start 2024-04-25T23:55:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: init 2024-04-25T23:55:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: _add_conns ranks=[2,5,3,4,7,6,0,1,8] 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient(hunting): picked mon.noname-b con 0x7fb3040a25f0 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient(hunting): picked mon.noname-h con 0x7fb30409b8e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient(hunting): picked mon.noname-g con 0x7fb30406b5d0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30409ac40 con 0x7fb3040a25f0 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3040a0d50 con 0x7fb30406b5d0 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3040a4430 con 0x7fb30409b8e0 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient(hunting): authenticate will time out at 960.765596s 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb302d9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb3040a25f0 0x7fb3040a29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49150/0 (socket says 172.21.15.106:49150) 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb302d9d640 1 -- 172.21.15.106:0/3073986768 learned_addr learned my addr 172.21.15.106:0/3073986768 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10176554 0 0) 0x7fb30409ac40 con 0x7fb3040a25f0 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient(hunting): my global_id is 4331 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2f0003530 con 0x7fb3040a25f0 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3780683649 0 0) 0x7fb2f0003530 con 0x7fb3040a25f0 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 >> v1:172.21.15.171:6791/0 conn(0x7fb30409b8e0 legacy=0x7fb30413a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 >> v1:172.21.15.171:6790/0 conn(0x7fb30406b5d0 legacy=0x7fb30413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 monclient: found mon.noname-b 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3040a30e0 con 0x7fb3040a25f0 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2fc001b40 con 0x7fb3040a25f0 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: dump: 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 5 monclient: authenticate success, global_id 4331 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2fc001e30 con 0x7fb3040a25f0 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 1 -- 172.21.15.106:0/3073986768 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2fc004f70 con 0x7fb3040a25f0 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 4 set_mon_vals no callback set 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb301d9b640 10 monclient: dump: 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: shutdown 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- 172.21.15.106:0/3073986768 >> v1:172.21.15.106:6790/0 conn(0x7fb3040a25f0 legacy=0x7fb3040a29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- 172.21.15.106:0/3073986768 shutdown_connections 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- 172.21.15.106:0/3073986768 >> 172.21.15.106:0/3073986768 conn(0x7fb3040a36e0 msgr2=0x7fb3040a3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- 172.21.15.106:0/3073986768 shutdown_connections 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 1 -- 172.21.15.106:0/3073986768 wait complete. 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.236+0000 7fb30912d640 10 monclient: monmap: 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.234 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 Processor -- start 2024-04-25T23:55:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 -- start start 2024-04-25T23:55:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient: init 2024-04-25T23:55:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient: _add_conns ranks=[3,4,0,7,6,8,1,2,5] 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient(hunting): picked mon.noname-g con 0x7fb30406b5d0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient(hunting): picked mon.noname-c con 0x7fb3040a25f0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient(hunting): picked mon.noname-a con 0x7fb3041c7260 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30413f360 con 0x7fb3041c7260 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3041366b0 con 0x7fb30406b5d0 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb304133bc0 con 0x7fb3040a25f0 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient(hunting): authenticate will time out at 960.768580s 2024-04-25T23:55:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30359e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb3041c7260 0x7fb3041d2410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:55250/0 (socket says 172.21.15.106:55250) 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30359e640 1 -- 172.21.15.106:0/3654707150 learned_addr learned my addr 172.21.15.106:0/3654707150 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1477363310 0 0) 0x7fb30413f360 con 0x7fb3041c7260 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): my global_id is 4473 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2e4003530 con 0x7fb3041c7260 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749316639 0 0) 0x7fb304133bc0 con 0x7fb3040a25f0 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): my global_id is 4459 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb30413f360 con 0x7fb3040a25f0 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2044618631 0 0) 0x7fb2e4003530 con 0x7fb3041c7260 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb304133bc0 con 0x7fb3041c7260 2024-04-25T23:55:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2f4001a40 con 0x7fb3041c7260 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4242429354 0 0) 0x7fb30413f360 con 0x7fb3040a25f0 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2e4003530 con 0x7fb3040a25f0 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2ec0019e0 con 0x7fb3040a25f0 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.239 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 904386581 0 0) 0x7fb3041366b0 con 0x7fb30406b5d0 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): my global_id is 4422 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb30413f360 con 0x7fb30406b5d0 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3362194255 0 0) 0x7fb304133bc0 con 0x7fb3041c7260 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.106:6791/0 conn(0x7fb3040a25f0 legacy=0x7fb3041c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.171:6790/0 conn(0x7fb30406b5d0 legacy=0x7fb30413ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 monclient: found mon.a 2024-04-25T23:55:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3040727e0 con 0x7fb3041c7260 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 5 monclient: authenticate success, global_id 4473 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient: _renew_subs 2024-04-25T23:55:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3041d3b30 con 0x7fb3041c7260 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient: _renew_subs 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb3041d3ed0 con 0x7fb3041c7260 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2f4003950 con 0x7fb3041c7260 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2f4003ec0 con 0x7fb3041c7260 2024-04-25T23:55:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30159a640 4 set_mon_vals no callback set 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: dump: 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.244 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.245 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb2f4004060 con 0x7fb3041c7260 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2e80065d0 con 0x7fb2e8002870 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fb2f4044440 con 0x7fb3041c7260 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1002378678 0 0) 0x7fb2e80065d0 con 0x7fb2e8002870 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient(hunting): my global_id is 4468 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb304133bc0 con 0x7fb2e8002870 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb30259c640 10 monclient: get_auth_request con 0x7fb2e4037e40 auth_method 0 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2797706173 0 0) 0x7fb304133bc0 con 0x7fb2e8002870 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2e80065d0 con 0x7fb2e8002870 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2fc004eb0 con 0x7fb2e8002870 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: dump: 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.248 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3722097847 0 0) 0x7fb2e80065d0 con 0x7fb2e8002870 2024-04-25T23:55:05.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2e800a160 con 0x7fb2e8002870 2024-04-25T23:55:05.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb2fc004eb0 con 0x7fb2e8002870 2024-04-25T23:55:05.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:05.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.106:6791/0 conn(0x7fb2e8002870 legacy=0x7fb2e8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.240+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.106:6791/0 conn(0x7fb2e8002870 legacy=0x7fb2e8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:05.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2e8009e50 con 0x7fb2e8009110 2024-04-25T23:55:05.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537132256 0 0) 0x7fb2e8009e50 con 0x7fb2e8009110 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient(hunting): my global_id is 4477 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2e80065d0 con 0x7fb2e8009110 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 883692406 0 0) 0x7fb2e80065d0 con 0x7fb2e8009110 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2e8009e50 con 0x7fb2e8009110 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2fc0051e0 con 0x7fb2e8009110 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient: dump: 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.253 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2157344643 0 0) 0x7fb2e8009e50 con 0x7fb2e8009110 2024-04-25T23:55:05.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb2e800c3e0 con 0x7fb2e8009110 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7734 (unknown 0 0 3800227874) 0x7fb2fc008690 con 0x7fb2e8009110 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.106:6791/0 conn(0x7fb2e8009110 legacy=0x7fb2e80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb2fb7fe640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.106:6791/0 conn(0x7fb2e8009110 legacy=0x7fb2e80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 23799, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 18, 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.267 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:05.269 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:05.270 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.271 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:05.272 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:05.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.273 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.273 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.276 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:05.277 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.171:6812/722422047 conn(0x7fb2e4037e40 legacy=0x7fb2e403a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 10 monclient: shutdown 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 >> v1:172.21.15.106:6789/0 conn(0x7fb3041c7260 legacy=0x7fb3041d2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30359e640 1 -- 172.21.15.106:0/3654707150 reap_dead start 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30359e640 1 -- 172.21.15.106:0/3654707150 reap_dead start 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 shutdown_connections 2024-04-25T23:55:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 >> 172.21.15.106:0/3654707150 conn(0x7fb3040a36e0 msgr2=0x7fb3040a5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 shutdown_connections 2024-04-25T23:55:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.248+0000 7fb30912d640 1 -- 172.21.15.106:0/3654707150 wait complete. 2024-04-25T23:55:05.280 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:05.280 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-25T23:55:05.280 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:55:05.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.404+0000 7f180254c640 10 monclient: get_monmap_and_config 2024-04-25T23:55:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.404+0000 7f180254c640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.404+0000 7f180254c640 10 monclient: monmap: 2024-04-25T23:55:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:05.410063+0000 2024-04-25T23:55:05.389 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:05.410063+0000 2024-04-25T23:55:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.390 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.391 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.392 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 Processor -- start 2024-04-25T23:55:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- start start 2024-04-25T23:55:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: init 2024-04-25T23:55:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: _add_conns ranks=[7,8,2,0,5,4,6,1,3] 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): picked mon.noname-i con 0x7f17fc1346f0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): picked mon.noname-e con 0x7f17fc13aa60 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): picked mon.noname-b con 0x7f17fc13e570 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc1351e0 con 0x7f17fc13e570 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc0a13f0 con 0x7f17fc1346f0 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc0a26a0 con 0x7f17fc13aa60 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): authenticate will time out at 960.937141s 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17fb7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f17fc13aa60 0x7f17fc13ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:42450/0 (socket says 172.21.15.106:42450) 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17fb7fe640 1 -- 172.21.15.106:0/4093802151 learned_addr learned my addr 172.21.15.106:0/4093802151 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f1800ae9640 1 --1- 172.21.15.106:0/4093802151 >> v1:172.21.15.106:6790/0 conn(0x7f17fc13e570 0x7f17fc140960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49160/0 (socket says 172.21.15.106:49160) 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 719739228 0 0) 0x7f17fc0a26a0 con 0x7f17fc13aa60 2024-04-25T23:55:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): my global_id is 4481 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e4003530 con 0x7f17fc13aa60 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233732077 0 0) 0x7f17fc1351e0 con 0x7f17fc13e570 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient(hunting): my global_id is 4340 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc0a26a0 con 0x7f17fc13e570 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 230775132 0 0) 0x7f17e4003530 con 0x7f17fc13aa60 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 >> v1:172.21.15.171:6792/0 conn(0x7f17fc1346f0 legacy=0x7f17fc134ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 >> v1:172.21.15.106:6790/0 conn(0x7f17fc13e570 legacy=0x7f17fc140960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 monclient: found mon.noname-e 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc0a2980 con 0x7f17fc13aa60 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17f00017c0 con 0x7f17fc13aa60 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 5 monclient: authenticate success, global_id 4481 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: dump: 2024-04-25T23:55:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f17f0001a20 con 0x7f17fc13aa60 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 1 -- 172.21.15.106:0/4093802151 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17f0004bf0 con 0x7f17fc13aa60 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17faffd640 10 monclient: dump: 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 4 set_mon_vals no callback set 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: shutdown 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- 172.21.15.106:0/4093802151 >> v1:172.21.15.106:6793/0 conn(0x7f17fc13aa60 legacy=0x7f17fc13ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- 172.21.15.106:0/4093802151 shutdown_connections 2024-04-25T23:55:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- 172.21.15.106:0/4093802151 >> 172.21.15.106:0/4093802151 conn(0x7f17fc0a9c10 msgr2=0x7f17fc0aa020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- 172.21.15.106:0/4093802151 shutdown_connections 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- 172.21.15.106:0/4093802151 wait complete. 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: monmap: 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.410 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 Processor -- start 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- start start 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: init 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient: _add_conns ranks=[6,4,5,0,7,2,1,8,3] 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): picked mon.noname-d con 0x7f17fc1346f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): picked mon.noname-c con 0x7f17fc13aa60 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): picked mon.noname-h con 0x7f17fc13e570 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc138d20 con 0x7f17fc13aa60 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc1361d0 con 0x7f17fc13e570 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17fc0a1e00 con 0x7f17fc1346f0 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f180254c640 10 monclient(hunting): authenticate will time out at 960.939847s 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17fb7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f17fc13aa60 0x7f17fc135ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48756/0 (socket says 172.21.15.106:48756) 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17fbfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f17fc1346f0 0x7f17fc1353b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:43696/0 (socket says 172.21.15.106:43696) 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.408+0000 7f17fb7fe640 1 -- 172.21.15.106:0/90750737 learned_addr learned my addr 172.21.15.106:0/90750737 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946042421 0 0) 0x7f17fc138d20 con 0x7f17fc13aa60 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): my global_id is 4486 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e8003530 con 0x7f17fc13aa60 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913205857 0 0) 0x7f17fc0a1e00 con 0x7f17fc1346f0 2024-04-25T23:55:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): my global_id is 4425 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc138d20 con 0x7f17fc1346f0 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2526955280 0 0) 0x7f17fc138d20 con 0x7f17fc1346f0 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17fc0a1e00 con 0x7f17fc1346f0 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17ec001a60 con 0x7f17fc1346f0 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): dump: 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3002169220 0 0) 0x7f17e8003530 con 0x7f17fc13aa60 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17fc138d20 con 0x7f17fc13aa60 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17f0004b30 con 0x7f17fc13aa60 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): dump: 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.415 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3831937352 0 0) 0x7f17fc1361d0 con 0x7f17fc13e570 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): my global_id is 4478 2024-04-25T23:55:05.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17e8003530 con 0x7f17fc13e570 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1696127831 0 0) 0x7f17fc0a1e00 con 0x7f17fc1346f0 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.171:6791/0 conn(0x7f17fc13e570 legacy=0x7f17fc1d4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.106:6791/0 conn(0x7f17fc13aa60 legacy=0x7f17fc135ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 monclient: found mon.d 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17fc138480 con 0x7f17fc1346f0 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 5 monclient: authenticate success, global_id 4425 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 10 monclient: _renew_subs 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f17fc136ad0 con 0x7f17fc1346f0 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 10 monclient: _renew_subs 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f17fc139670 con 0x7f17fc1346f0 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f17ec003950 con 0x7f17fc1346f0 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17ec003ec0 con 0x7f17fc1346f0 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17fa7fc640 4 set_mon_vals no callback set 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: dump: 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.418 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f17dc0065d0 con 0x7f17dc002870 2024-04-25T23:55:05.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f17ec004060 con 0x7f17fc1346f0 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f17ec0444e0 con 0x7f17fc1346f0 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917454171 0 0) 0x7f17dc0065d0 con 0x7f17dc002870 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient(hunting): my global_id is 4434 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc0a1e00 con 0x7f17dc002870 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2925055105 0 0) 0x7f17fc0a1e00 con 0x7f17dc002870 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17dc0065d0 con 0x7f17dc002870 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17f0004f40 con 0x7f17dc002870 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: dump: 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.420 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f1800ae9640 10 monclient: get_auth_request con 0x7f17e8037f40 auth_method 0 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2893318037 0 0) 0x7f17dc0065d0 con 0x7f17dc002870 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f17dc00a160 con 0x7f17dc002870 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f17f0007480 con 0x7f17dc002870 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.106:6792/0 conn(0x7f17dc002870 legacy=0x7f17dc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.412+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.106:6792/0 conn(0x7f17dc002870 legacy=0x7f17dc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f17dc009e50 con 0x7f17dc009110 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4264341412 0 0) 0x7f17dc009e50 con 0x7f17dc009110 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient(hunting): my global_id is 4443 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17dc0065d0 con 0x7f17dc009110 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 279055085 0 0) 0x7f17dc0065d0 con 0x7f17dc009110 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17dc009e50 con 0x7f17dc009110 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17f0005600 con 0x7f17dc009110 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient: dump: 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.423 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1645022958 0 0) 0x7f17dc009e50 con 0x7f17dc009110 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f17dc00c3e0 con 0x7f17dc009110 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 1747627325) 0x7f17f0007630 con 0x7f17dc009110 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.106:6792/0 conn(0x7f17dc009110 legacy=0x7f17dc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f17f8ff9640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.106:6792/0 conn(0x7f17dc009110 legacy=0x7f17dc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 23959, 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 18, 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:05.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.437 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.440 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:05.441 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.443 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:05.443 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.171:6812/722422047 conn(0x7f17e8037f40 legacy=0x7f17e803a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 10 monclient: shutdown 2024-04-25T23:55:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 >> v1:172.21.15.106:6792/0 conn(0x7f17fc1346f0 legacy=0x7f17fc1353b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f1800ae9640 1 -- 172.21.15.106:0/90750737 reap_dead start 2024-04-25T23:55:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f1800ae9640 1 -- 172.21.15.106:0/90750737 reap_dead start 2024-04-25T23:55:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 shutdown_connections 2024-04-25T23:55:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 >> 172.21.15.106:0/90750737 conn(0x7f17fc0a9c10 msgr2=0x7f17fc0a4630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 shutdown_connections 2024-04-25T23:55:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.420+0000 7f180254c640 1 -- 172.21.15.106:0/90750737 wait complete. 2024-04-25T23:55:05.445 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:05.445 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-25T23:55:05.445 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-25T23:55:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: get_monmap_and_config 2024-04-25T23:55:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: monmap: 2024-04-25T23:55:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:05.582648+0000 2024-04-25T23:55:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:05.582648+0000 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.562 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 Processor -- start 2024-04-25T23:55:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- start start 2024-04-25T23:55:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: init 2024-04-25T23:55:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: _add_conns ranks=[0,3,2,6,1,5,8,7,4] 2024-04-25T23:55:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient(hunting): picked mon.noname-a con 0x7f1d6c12dd40 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient(hunting): picked mon.noname-g con 0x7f1d6c09aef0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient(hunting): picked mon.noname-b con 0x7f1d6c09b2f0 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6c09c5b0 con 0x7f1d6c12dd40 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6c09c2d0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6c0a3a70 con 0x7f1d6c09aef0 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient(hunting): authenticate will time out at 961.109948s 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d71b39640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f1d6c09b2f0 0x7f1d6c1400e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:45282/0 (socket says 172.21.15.106:45282) 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d71b39640 1 -- 172.21.15.106:0/2844215944 learned_addr learned my addr 172.21.15.106:0/2844215944 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d71338640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1d6c12dd40 0x7f1d6c12e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58278/0 (socket says 172.21.15.106:58278) 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 922871606 0 0) 0x7f1d6c09c2d0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): my global_id is 4349 2024-04-25T23:55:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d58003530 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 986430017 0 0) 0x7f1d6c09c5b0 con 0x7f1d6c12dd40 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient(hunting): my global_id is 4482 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d6c09c2d0 con 0x7f1d6c12dd40 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3246945178 0 0) 0x7f1d58003530 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 >> v1:172.21.15.171:6790/0 conn(0x7f1d6c09aef0 legacy=0x7f1d6c13c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 >> v1:172.21.15.106:6789/0 conn(0x7f1d6c12dd40 legacy=0x7f1d6c12e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 monclient: found mon.noname-b 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:55:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c144830 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d680017c0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 5 monclient: authenticate success, global_id 4349 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: dump: 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d68001a60 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 1 -- 172.21.15.106:0/2844215944 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d68004bf0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d63fff640 10 monclient: dump: 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 4 set_mon_vals no callback set 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 10 monclient: shutdown 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- 172.21.15.106:0/2844215944 >> v1:172.21.15.106:6790/0 conn(0x7f1d6c09b2f0 legacy=0x7f1d6c1400e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- 172.21.15.106:0/2844215944 shutdown_connections 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- 172.21.15.106:0/2844215944 >> 172.21.15.106:0/2844215944 conn(0x7f1d6c0a2d20 msgr2=0x7f1d6c0a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- 172.21.15.106:0/2844215944 shutdown_connections 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.580+0000 7f1d7359c640 1 -- 172.21.15.106:0/2844215944 wait complete. 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: monmap: 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 Processor -- start 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 -- start start 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: init 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: _add_conns ranks=[5,6,0,3,1,8,2,7,4] 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient(hunting): picked mon.noname-h con 0x7f1d6c09aef0 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient(hunting): picked mon.noname-d con 0x7f1d6c09b2f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient(hunting): picked mon.noname-a con 0x7f1d6c12dd40 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6c09f4e0 con 0x7f1d6c12dd40 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6c12e990 con 0x7f1d6c09aef0 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d6c131d20 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient(hunting): authenticate will time out at 961.113105s 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d70b37640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f1d6c09b2f0 0x7f1d6c09e3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:57324/0 (socket says 172.21.15.106:57324) 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d70b37640 1 -- 172.21.15.106:0/2678255587 learned_addr learned my addr 172.21.15.106:0/2678255587 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1235961200 0 0) 0x7f1d6c131d20 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): my global_id is 4452 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d50003530 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268095506 0 0) 0x7f1d6c09f4e0 con 0x7f1d6c12dd40 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): my global_id is 4491 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d6c131d20 con 0x7f1d6c12dd40 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1170554607 0 0) 0x7f1d50003530 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d6c09f4e0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d5c001ac0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): dump: 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466455300 0 0) 0x7f1d6c12e990 con 0x7f1d6c09aef0 2024-04-25T23:55:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): my global_id is 4487 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d50003530 con 0x7f1d6c09aef0 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 86680055 0 0) 0x7f1d6c131d20 con 0x7f1d6c12dd40 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d6c12e990 con 0x7f1d6c12dd40 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d68004b30 con 0x7f1d6c12dd40 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): dump: 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 782767850 0 0) 0x7f1d6c09f4e0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.171:6791/0 conn(0x7f1d6c09aef0 legacy=0x7f1d6c09dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.106:6789/0 conn(0x7f1d6c12dd40 legacy=0x7f1d6c1d4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 monclient: found mon.d 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d6c1330e0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 5 monclient: authenticate success, global_id 4452 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: _renew_subs 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d6c12d630 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: _renew_subs 2024-04-25T23:55:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d6c09ec90 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d5c0038d0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d5c003dc0 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d637fe640 4 set_mon_vals no callback set 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: dump: 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.585 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1d4c0065d0 con 0x7f1d4c002870 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1d5c003f60 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f1d5c044410 con 0x7f1d6c09b2f0 2024-04-25T23:55:05.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132567963 0 0) 0x7f1d4c0065d0 con 0x7f1d4c002870 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient(hunting): my global_id is 4490 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d6c09f4e0 con 0x7f1d4c002870 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4066509606 0 0) 0x7f1d6c09f4e0 con 0x7f1d4c002870 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d4c0065d0 con 0x7f1d4c002870 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d64001c30 con 0x7f1d4c002870 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d71b39640 10 monclient: get_auth_request con 0x7f1d50038010 auth_method 0 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 10 monclient: dump: 2024-04-25T23:55:05.587 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3002050955 0 0) 0x7f1d4c0065d0 con 0x7f1d4c002870 2024-04-25T23:55:05.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.584+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d4c00a160 con 0x7f1d4c002870 2024-04-25T23:55:05.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.588+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1d64002090 con 0x7f1d4c002870 2024-04-25T23:55:05.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.588+0000 7f1d61ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.588+0000 7f1d61ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:05.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.588+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.106:6793/0 conn(0x7f1d4c002870 legacy=0x7f1d4c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.588+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.106:6793/0 conn(0x7f1d4c002870 legacy=0x7f1d4c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1d4c009e50 con 0x7f1d4c009110 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4210081327 0 0) 0x7f1d4c009e50 con 0x7f1d4c009110 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient(hunting): my global_id is 4499 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d4c0065d0 con 0x7f1d4c009110 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3080402654 0 0) 0x7f1d4c0065d0 con 0x7f1d4c009110 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d4c009e50 con 0x7f1d4c009110 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d64005120 con 0x7f1d4c009110 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient: dump: 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.592 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 992168583 0 0) 0x7f1d4c009e50 con 0x7f1d4c009110 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1d4c00c3e0 con 0x7f1d4c009110 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7734 (unknown 0 0 265346689) 0x7f1d640074b0 con 0x7f1d4c009110 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.106:6793/0 conn(0x7f1d4c009110 legacy=0x7f1d4c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d61ffb640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.106:6793/0 conn(0x7f1d4c009110 legacy=0x7f1d4c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 24131, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 18, 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:05.599 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:05.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.611 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.612 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.612 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:05.612 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:05.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.171:6812/722422047 conn(0x7f1d50038010 legacy=0x7f1d5003a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 10 monclient: shutdown 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 >> v1:172.21.15.106:6792/0 conn(0x7f1d6c09b2f0 legacy=0x7f1d6c09e3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d71b39640 1 -- 172.21.15.106:0/2678255587 reap_dead start 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d71b39640 1 -- 172.21.15.106:0/2678255587 reap_dead start 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 shutdown_connections 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 >> 172.21.15.106:0/2678255587 conn(0x7f1d6c0a2d20 msgr2=0x7f1d6c0a1ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 shutdown_connections 2024-04-25T23:55:05.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.592+0000 7f1d7359c640 1 -- 172.21.15.106:0/2678255587 wait complete. 2024-04-25T23:55:05.614 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:05.615 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-25T23:55:05.615 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: get_monmap_and_config 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: monmap: 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:05.750720+0000 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:05.750720+0000 2024-04-25T23:55:05.729 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.730 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 Processor -- start 2024-04-25T23:55:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- start start 2024-04-25T23:55:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: init 2024-04-25T23:55:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: _add_conns ranks=[6,0,2,3,8,1,5,7,4] 2024-04-25T23:55:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient(hunting): picked mon.noname-d con 0x7f96680a1c30 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient(hunting): picked mon.noname-a con 0x7f96680a2010 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient(hunting): picked mon.noname-b con 0x7f966813dc40 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f966809c5b0 con 0x7f96680a2010 2024-04-25T23:55:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f966809c2d0 con 0x7f966813dc40 2024-04-25T23:55:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96680a3a70 con 0x7f96680a1c30 2024-04-25T23:55:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient(hunting): authenticate will time out at 961.277821s 2024-04-25T23:55:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966df11640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f96680a1c30 0x7f966809aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:57336/0 (socket says 172.21.15.106:57336) 2024-04-25T23:55:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966df11640 1 -- 172.21.15.106:0/2867897311 learned_addr learned my addr 172.21.15.106:0/2867897311 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4006413501 0 0) 0x7f96680a3a70 con 0x7f96680a1c30 2024-04-25T23:55:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): my global_id is 4461 2024-04-25T23:55:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9650003530 con 0x7f96680a1c30 2024-04-25T23:55:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417788847 0 0) 0x7f965c001050 con 0x7f96680a2010 2024-04-25T23:55:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): my global_id is 4500 2024-04-25T23:55:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96680a3a70 con 0x7f96680a2010 2024-04-25T23:55:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1830682274 0 0) 0x7f966809c2d0 con 0x7f966813dc40 2024-04-25T23:55:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient(hunting): my global_id is 4358 2024-04-25T23:55:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f965c001050 con 0x7f966813dc40 2024-04-25T23:55:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2553903483 0 0) 0x7f9650003530 con 0x7f96680a1c30 2024-04-25T23:55:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 >> v1:172.21.15.106:6790/0 conn(0x7f966813dc40 legacy=0x7f9668140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 >> v1:172.21.15.106:6789/0 conn(0x7f96680a2010 legacy=0x7f96680a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 monclient: found mon.noname-d 2024-04-25T23:55:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9668144780 con 0x7f96680a1c30 2024-04-25T23:55:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9660001b40 con 0x7f96680a1c30 2024-04-25T23:55:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 5 monclient: authenticate success, global_id 4461 2024-04-25T23:55:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: dump: 2024-04-25T23:55:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.751 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9660001de0 con 0x7f96680a1c30 2024-04-25T23:55:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 4 set_mon_vals no callback set 2024-04-25T23:55:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 1 -- 172.21.15.106:0/2867897311 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9660004f70 con 0x7f96680a1c30 2024-04-25T23:55:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f966cf0f640 10 monclient: dump: 2024-04-25T23:55:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.755 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: shutdown 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- 172.21.15.106:0/2867897311 >> v1:172.21.15.106:6792/0 conn(0x7f96680a1c30 legacy=0x7f966809aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- 172.21.15.106:0/2867897311 shutdown_connections 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- 172.21.15.106:0/2867897311 >> 172.21.15.106:0/2867897311 conn(0x7f96680a2d20 msgr2=0x7f96680a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- 172.21.15.106:0/2867897311 shutdown_connections 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 1 -- 172.21.15.106:0/2867897311 wait complete. 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.748+0000 7f9670175640 10 monclient: monmap: 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 Processor -- start 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 -- start start 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient: init 2024-04-25T23:55:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient: _add_conns ranks=[1,3,6,5,0,7,8,2,4] 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient(hunting): picked mon.noname-f con 0x7f96680a1c30 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient(hunting): picked mon.noname-g con 0x7f96680a2010 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient(hunting): picked mon.noname-d con 0x7f966813dc40 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9668130130 con 0x7f96680a1c30 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f966812fe50 con 0x7f96680a2010 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9668130410 con 0x7f966813dc40 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient(hunting): authenticate will time out at 961.280810s 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f966e712640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f966813dc40 0x7f96681d46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:57352/0 (socket says 172.21.15.106:57352) 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f966e712640 1 -- 172.21.15.106:0/2934202642 learned_addr learned my addr 172.21.15.106:0/2934202642 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791133909 0 0) 0x7f9668130410 con 0x7f966813dc40 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): my global_id is 4470 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9654003530 con 0x7f966813dc40 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 191464845 0 0) 0x7f9654003530 con 0x7f966813dc40 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9668130410 con 0x7f966813dc40 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9658001880 con 0x7f966813dc40 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): dump: 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.759 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2834708979 0 0) 0x7f9668130410 con 0x7f966813dc40 2024-04-25T23:55:05.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.171:6790/0 conn(0x7f96680a2010 legacy=0x7f966812edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.171:6789/0 conn(0x7f96680a1c30 legacy=0x7f9668130ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 monclient: found mon.d 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f966812e9c0 con 0x7f966813dc40 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 5 monclient: authenticate success, global_id 4470 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient: _renew_subs 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f966812f4d0 con 0x7f966813dc40 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient: _renew_subs 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:05.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f96681d5e00 con 0x7f966813dc40 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9658001c90 con 0x7f966813dc40 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9667fff640 4 set_mon_vals no callback set 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9658004e00 con 0x7f966813dc40 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: dump: 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.762 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f96480065d0 con 0x7f9648002870 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f965800fba0 con 0x7f966813dc40 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f9658044460 con 0x7f966813dc40 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f966d710640 10 monclient: get_auth_request con 0x7f96540378b0 auth_method 0 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706817307 0 0) 0x7f96480065d0 con 0x7f9648002870 2024-04-25T23:55:05.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient(hunting): my global_id is 4357 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9668130410 con 0x7f9648002870 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1010898825 0 0) 0x7f9668130410 con 0x7f9648002870 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96480065d0 con 0x7f9648002870 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9660004eb0 con 0x7f9648002870 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.752+0000 7f96667fc640 10 monclient: dump: 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.764 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.756+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1299216514 0 0) 0x7f96480065d0 con 0x7f9648002870 2024-04-25T23:55:05.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.756+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f964800a160 con 0x7f9648002870 2024-04-25T23:55:05.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.756+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9660002020 con 0x7f9648002870 2024-04-25T23:55:05.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.756+0000 7f96667fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.756+0000 7f96667fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:05.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.756+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.171:6789/0 conn(0x7f9648002870 legacy=0x7f9648004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.756+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.171:6789/0 conn(0x7f9648002870 legacy=0x7f9648004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f9670175640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:05.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9648009e20 con 0x7f9648009110 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3391599874 0 0) 0x7f9648009e20 con 0x7f9648009110 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 10 monclient(hunting): my global_id is 4366 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96480065d0 con 0x7f9648009110 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1420271340 0 0) 0x7f96480065d0 con 0x7f9648009110 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.760+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9648009e20 con 0x7f9648009110 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9660005280 con 0x7f9648009110 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 10 monclient: dump: 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.768 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2297426005 0 0) 0x7f9648009e20 con 0x7f9648009110 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f964800c390 con 0x7f9648009110 2024-04-25T23:55:05.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 1529838217) 0x7f9660008730 con 0x7f9648009110 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.171:6789/0 conn(0x7f9648009110 legacy=0x7f96480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f96667fc640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.171:6789/0 conn(0x7f9648009110 legacy=0x7f96480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 24287, 2024-04-25T23:55:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 19, 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.781 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.782 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:05.783 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.784 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.785 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.786 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.788 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.789 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.790 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:05.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.790 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.790 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.790 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:55:05.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.791 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.791 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:05.791 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:05.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.171:6812/722422047 conn(0x7f96540378b0 legacy=0x7f9654039d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 10 monclient: shutdown 2024-04-25T23:55:05.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 >> v1:172.21.15.106:6792/0 conn(0x7f966813dc40 legacy=0x7f96681d46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f966e712640 1 -- 172.21.15.106:0/2934202642 reap_dead start 2024-04-25T23:55:05.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f966e712640 1 -- 172.21.15.106:0/2934202642 reap_dead start 2024-04-25T23:55:05.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 shutdown_connections 2024-04-25T23:55:05.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 >> 172.21.15.106:0/2934202642 conn(0x7f96680a2d20 msgr2=0x7f96680a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 shutdown_connections 2024-04-25T23:55:05.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.764+0000 7f9670175640 1 -- 172.21.15.106:0/2934202642 wait complete. 2024-04-25T23:55:05.795 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:05.796 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-25T23:55:05.796 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:55:05.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.920+0000 7fd0a75ae640 10 monclient: get_monmap_and_config 2024-04-25T23:55:05.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.920+0000 7fd0a75ae640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.920+0000 7fd0a75ae640 10 monclient: monmap: 2024-04-25T23:55:05.903 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.903 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:05.924822+0000 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:05.924822+0000 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.904 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.920+0000 7fd0a75ae640 1 Processor -- start 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.920+0000 7fd0a75ae640 1 -- start start 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.920+0000 7fd0a75ae640 10 monclient: init 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: _add_conns ranks=[6,5,2,7,1,8,4,3,0] 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): picked mon.noname-d con 0x7fd0a00a1290 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): picked mon.noname-h con 0x7fd0a009f770 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): picked mon.noname-b con 0x7fd0a009fb70 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a00727a0 con 0x7fd0a009fb70 2024-04-25T23:55:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a00724c0 con 0x7fd0a009f770 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a0072a80 con 0x7fd0a00a1290 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): authenticate will time out at 961.452611s 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a534a640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fd0a00a1290 0x7fd0a00a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:57368/0 (socket says 172.21.15.106:57368) 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a534a640 1 -- 172.21.15.106:0/3756672728 learned_addr learned my addr 172.21.15.106:0/3756672728 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a5b4b640 1 --1- 172.21.15.106:0/3756672728 >> v1:172.21.15.106:6790/0 conn(0x7fd0a009fb70 0x7fd0a013de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:45304/0 (socket says 172.21.15.106:45304) 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1702178194 0 0) 0x7fd0a0072a80 con 0x7fd0a00a1290 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): my global_id is 4479 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd08c003530 con 0x7fd0a00a1290 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2050088474 0 0) 0x7fd0980013d0 con 0x7fd0a009fb70 2024-04-25T23:55:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient(hunting): my global_id is 4367 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a0072a80 con 0x7fd0a009fb70 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2711857819 0 0) 0x7fd0a0072a80 con 0x7fd0a009fb70 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 >> v1:172.21.15.106:6792/0 conn(0x7fd0a00a1290 legacy=0x7fd0a00a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 >> v1:172.21.15.171:6791/0 conn(0x7fd0a009f770 legacy=0x7fd0a013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 monclient: found mon.noname-b 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a006bfc0 con 0x7fd0a009fb70 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd098001c40 con 0x7fd0a009fb70 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: dump: 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 5 monclient: authenticate success, global_id 4367 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd098001ea0 con 0x7fd0a009fb70 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 1 -- 172.21.15.106:0/3756672728 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd098004eb0 con 0x7fd0a009fb70 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd097fff640 10 monclient: dump: 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 4 set_mon_vals no callback set 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: shutdown 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- 172.21.15.106:0/3756672728 >> v1:172.21.15.106:6790/0 conn(0x7fd0a009fb70 legacy=0x7fd0a013de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- 172.21.15.106:0/3756672728 shutdown_connections 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- 172.21.15.106:0/3756672728 >> 172.21.15.106:0/3756672728 conn(0x7fd0a006b210 msgr2=0x7fd0a006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- 172.21.15.106:0/3756672728 shutdown_connections 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- 172.21.15.106:0/3756672728 wait complete. 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: build_initial_monmap 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: monmap: 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 Processor -- start 2024-04-25T23:55:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- start start 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: init 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient: _add_conns ranks=[1,0,2,6,5,8,3,4,7] 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): picked mon.noname-f con 0x7fd0a009f770 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): picked mon.noname-a con 0x7fd0a009fb70 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): picked mon.noname-b con 0x7fd0a00a1290 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a006dd30 con 0x7fd0a009fb70 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a0071860 con 0x7fd0a009f770 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0a011f620 con 0x7fd0a00a1290 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a75ae640 10 monclient(hunting): authenticate will time out at 961.455396s 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a5b4b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd0a00a1290 0x7fd0a01d4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:45308/0 (socket says 172.21.15.106:45308) 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a5b4b640 1 -- 172.21.15.106:0/4197193568 learned_addr learned my addr 172.21.15.106:0/4197193568 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd0a4b49640 1 --1- 172.21.15.106:0/4197193568 >> v1:172.21.15.106:6789/0 conn(0x7fd0a009fb70 0x7fd0a01d1790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58306/0 (socket says 172.21.15.106:58306) 2024-04-25T23:55:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1756478757 0 0) 0x7fd0a011f620 con 0x7fd0a00a1290 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): my global_id is 4376 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd084003530 con 0x7fd0a00a1290 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039413078 0 0) 0x7fd0a006dd30 con 0x7fd0a009fb70 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): my global_id is 4509 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a011f620 con 0x7fd0a009fb70 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4196889280 0 0) 0x7fd0a011f620 con 0x7fd0a009fb70 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0a006dd30 con 0x7fd0a009fb70 2024-04-25T23:55:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd090001a60 con 0x7fd0a009fb70 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.924+0000 7fd095ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): dump: 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3971095822 0 0) 0x7fd084003530 con 0x7fd0a00a1290 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0a011f620 con 0x7fd0a00a1290 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd098001c00 con 0x7fd0a00a1290 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): dump: 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 75534342 0 0) 0x7fd0a006dd30 con 0x7fd0a009fb70 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.106:6790/0 conn(0x7fd0a00a1290 legacy=0x7fd0a01d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.171:6789/0 conn(0x7fd0a009f770 legacy=0x7fd0a01ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 monclient: found mon.a 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a011f900 con 0x7fd0a009fb70 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 5 monclient: authenticate success, global_id 4509 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 10 monclient: _renew_subs 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a01355f0 con 0x7fd0a009fb70 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 10 monclient: _renew_subs 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0a01cd2d0 con 0x7fd0a009fb70 2024-04-25T23:55:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0900038d0 con 0x7fd0a009fb70 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd090003e40 con 0x7fd0a009fb70 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0977fe640 4 set_mon_vals no callback set 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: dump: 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd0800065d0 con 0x7fd080002870 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd090004060 con 0x7fd0a009fb70 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fd090044530 con 0x7fd0a009fb70 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847743455 0 0) 0x7fd0800065d0 con 0x7fd080002870 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient(hunting): my global_id is 4449 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0a006dd30 con 0x7fd080002870 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd0a5b4b640 10 monclient: get_auth_request con 0x7fd084037de0 auth_method 0 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 709359794 0 0) 0x7fd0a006dd30 con 0x7fd080002870 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0800065d0 con 0x7fd080002870 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd09c001840 con 0x7fd080002870 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: dump: 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 279318662 0 0) 0x7fd0800065d0 con 0x7fd080002870 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd08000a160 con 0x7fd080002870 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd09c001840 con 0x7fd080002870 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.171:6790/0 conn(0x7fd080002870 legacy=0x7fd080004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.928+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.171:6790/0 conn(0x7fd080002870 legacy=0x7fd080004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd080009e50 con 0x7fd080009110 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834408534 0 0) 0x7fd080009e50 con 0x7fd080009110 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient(hunting): my global_id is 4458 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0800065d0 con 0x7fd080009110 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 505362828 0 0) 0x7fd0800065d0 con 0x7fd080009110 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd080009e50 con 0x7fd080009110 2024-04-25T23:55:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd09c004d20 con 0x7fd080009110 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient: dump: 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 117543377 0 0) 0x7fd080009e50 con 0x7fd080009110 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd08000c3e0 con 0x7fd080009110 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7734 (unknown 0 0 1194064628) 0x7fd09c006230 con 0x7fd080009110 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.171:6790/0 conn(0x7fd080009110 legacy=0x7fd0800095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd095ffb640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.171:6790/0 conn(0x7fd080009110 legacy=0x7fd0800095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:05.933 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 24459, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:05.934 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 19, 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.935 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:05.937 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:05.951 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.171:6812/722422047 conn(0x7fd084037de0 legacy=0x7fd08403a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 10 monclient: shutdown 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 >> v1:172.21.15.106:6789/0 conn(0x7fd0a009fb70 legacy=0x7fd0a01d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a5b4b640 1 -- 172.21.15.106:0/4197193568 reap_dead start 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a5b4b640 1 -- 172.21.15.106:0/4197193568 reap_dead start 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 shutdown_connections 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 >> 172.21.15.106:0/4197193568 conn(0x7fd0a006b210 msgr2=0x7fd0a00a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 shutdown_connections 2024-04-25T23:55:05.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:05.936+0000 7fd0a75ae640 1 -- 172.21.15.106:0/4197193568 wait complete. 2024-04-25T23:55:05.954 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:05.954 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-25T23:55:05.954 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:55:06.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: get_monmap_and_config 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: monmap: 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:06.078829+0000 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:06.078829+0000 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.058 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.059 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 Processor -- start 2024-04-25T23:55:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- start start 2024-04-25T23:55:06.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: init 2024-04-25T23:55:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: _add_conns ranks=[7,2,3,5,1,6,4,8,0] 2024-04-25T23:55:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient(hunting): picked mon.noname-i con 0x7f6324134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient(hunting): picked mon.noname-b con 0x7f63240a4820 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:06.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient(hunting): picked mon.noname-g con 0x7f632413e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632406dd40 con 0x7f63240a4820 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63240a2b10 con 0x7f632413e200 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63240a2df0 con 0x7f6324134970 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient(hunting): authenticate will time out at 961.605882s 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63227fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f63240a4820 0x7f632413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:45320/0 (socket says 172.21.15.106:45320) 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63227fc640 1 -- 172.21.15.106:0/3882722314 learned_addr learned my addr 172.21.15.106:0/3882722314 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2400301545 0 0) 0x7f632406dd40 con 0x7f63240a4820 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient(hunting): my global_id is 4385 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f630c003530 con 0x7f63240a4820 2024-04-25T23:55:06.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1393198054 0 0) 0x7f630c003530 con 0x7f63240a4820 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 >> v1:172.21.15.171:6792/0 conn(0x7f6324134970 legacy=0x7f6324134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 >> v1:172.21.15.171:6790/0 conn(0x7f632413e200 legacy=0x7f63241405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 monclient: found mon.noname-b 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63240a30d0 con 0x7f63240a4820 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 5 monclient: authenticate success, global_id 4385 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63180017c0 con 0x7f63240a4820 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: dump: 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.068 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6318001ab0 con 0x7f63240a4820 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 4 set_mon_vals no callback set 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 1 -- 172.21.15.106:0/3882722314 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6318004bf0 con 0x7f63240a4820 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f6321ffb640 10 monclient: dump: 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.069 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: shutdown 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- 172.21.15.106:0/3882722314 >> v1:172.21.15.106:6790/0 conn(0x7f63240a4820 legacy=0x7f632413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- 172.21.15.106:0/3882722314 shutdown_connections 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- 172.21.15.106:0/3882722314 >> 172.21.15.106:0/3882722314 conn(0x7f63240a9e20 msgr2=0x7f63240aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- 172.21.15.106:0/3882722314 shutdown_connections 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 1 -- 172.21.15.106:0/3882722314 wait complete. 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.076+0000 7f63294de640 10 monclient: monmap: 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.071 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 Processor -- start 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 -- start start 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient: init 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient: _add_conns ranks=[5,2,1,8,6,3,0,4,7] 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient(hunting): picked mon.noname-h con 0x7f63240a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient(hunting): picked mon.noname-b con 0x7f6324134970 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:06.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient(hunting): picked mon.noname-f con 0x7f632413e200 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63240aa740 con 0x7f632413e200 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f632409e6e0 con 0x7f6324134970 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63240a1e00 con 0x7f63240a4820 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient(hunting): authenticate will time out at 961.608880s 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63227fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f6324134970 0x7f63241d1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:45322/0 (socket says 172.21.15.106:45322) 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63227fc640 1 -- 172.21.15.106:0/3714577938 learned_addr learned my addr 172.21.15.106:0/3714577938 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823300785 0 0) 0x7f632409e6e0 con 0x7f6324134970 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): my global_id is 4394 2024-04-25T23:55:06.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6310003530 con 0x7f6324134970 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1981901227 0 0) 0x7f6310003530 con 0x7f6324134970 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f632409e6e0 con 0x7f6324134970 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6318001780 con 0x7f6324134970 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.074 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201701434 0 0) 0x7f63240a1e00 con 0x7f63240a4820 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): my global_id is 4505 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6310003530 con 0x7f63240a4820 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2739099789 0 0) 0x7f632409e6e0 con 0x7f6324134970 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.171:6791/0 conn(0x7f63240a4820 legacy=0x7f632409fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.171:6789/0 conn(0x7f632413e200 legacy=0x7f63241d4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 monclient: found mon.b 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63240a1a40 con 0x7f6324134970 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 5 monclient: authenticate success, global_id 4394 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient: _renew_subs 2024-04-25T23:55:06.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f632409c3f0 con 0x7f6324134970 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient: _renew_subs 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f632409d170 con 0x7f6324134970 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6318001ab0 con 0x7f6324134970 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6318001ce0 con 0x7f6324134970 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63217fa640 4 set_mon_vals no callback set 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: dump: 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.077 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.078 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f63040065d0 con 0x7f6304002870 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f63180100f0 con 0x7f6324134970 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f6318044590 con 0x7f6324134970 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f63237fe640 10 monclient: get_auth_request con 0x7f6310037890 auth_method 0 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279142881 0 0) 0x7f63040065d0 con 0x7f6304002870 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient(hunting): my global_id is 4514 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f632409e6e0 con 0x7f6304002870 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2531518189 0 0) 0x7f632409e6e0 con 0x7f6304002870 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63040065d0 con 0x7f6304002870 2024-04-25T23:55:06.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63140018f0 con 0x7f6304002870 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 10 monclient: dump: 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.080 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2764292604 0 0) 0x7f63040065d0 con 0x7f6304002870 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.080+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f630400a160 con 0x7f6304002870 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.084+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6314001c80 con 0x7f6304002870 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.084+0000 7f630b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.084+0000 7f630b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.084+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.171:6791/0 conn(0x7f6304002870 legacy=0x7f6304004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.084+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.171:6791/0 conn(0x7f6304002870 legacy=0x7f6304004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f63294de640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6304009e10 con 0x7f63040090d0 2024-04-25T23:55:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 480235800 0 0) 0x7f6304009e10 con 0x7f63040090d0 2024-04-25T23:55:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 10 monclient(hunting): my global_id is 4523 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63040065d0 con 0x7f63040090d0 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2954518413 0 0) 0x7f63040065d0 con 0x7f63040090d0 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6304009e10 con 0x7f63040090d0 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6314003bb0 con 0x7f63040090d0 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.088+0000 7f630b7fe640 10 monclient: dump: 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.084 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3803161342 0 0) 0x7f6304009e10 con 0x7f63040090d0 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f630400c390 con 0x7f63040090d0 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7734 (unknown 0 0 1050669686) 0x7f6314003ee0 con 0x7f63040090d0 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f630b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:06.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f630b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.171:6791/0 conn(0x7f63040090d0 legacy=0x7f6304009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f630b7fe640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.171:6791/0 conn(0x7f63040090d0 legacy=0x7f6304009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 24591, 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:06.086 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 19, 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:06.087 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:06.088 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.089 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:06.090 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:06.091 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:06.092 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:06.093 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:06.095 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.098 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.099 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:06.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:06.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:06.105 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.171:6812/722422047 conn(0x7f6310037890 legacy=0x7f6310039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 10 monclient: shutdown 2024-04-25T23:55:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 >> v1:172.21.15.106:6790/0 conn(0x7f6324134970 legacy=0x7f63241d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63237fe640 1 -- 172.21.15.106:0/3714577938 reap_dead start 2024-04-25T23:55:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63237fe640 1 -- 172.21.15.106:0/3714577938 reap_dead start 2024-04-25T23:55:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 shutdown_connections 2024-04-25T23:55:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 >> 172.21.15.106:0/3714577938 conn(0x7f63240a9e20 msgr2=0x7f6324067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 shutdown_connections 2024-04-25T23:55:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.092+0000 7f63294de640 1 -- 172.21.15.106:0/3714577938 wait complete. 2024-04-25T23:55:06.107 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:06.107 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-25T23:55:06.108 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-25T23:55:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: get_monmap_and_config 2024-04-25T23:55:06.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: monmap: 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:06.238967+0000 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:06.238967+0000 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.219 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 1 Processor -- start 2024-04-25T23:55:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 1 -- start start 2024-04-25T23:55:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: init 2024-04-25T23:55:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: _add_conns ranks=[1,4,0,2,3,7,6,5,8] 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient(hunting): picked mon.noname-f con 0x7f6eb4134970 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient(hunting): picked mon.noname-c con 0x7f6eb40a4820 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient(hunting): picked mon.noname-a con 0x7f6eb413e200 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb406dd40 con 0x7f6eb413e200 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb40a2b10 con 0x7f6eb4134970 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb40a2df0 con 0x7f6eb40a4820 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient(hunting): authenticate will time out at 961.766349s 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb359e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6eb413e200 0x7f6eb41405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58310/0 (socket says 172.21.15.106:58310) 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb359e640 1 -- 172.21.15.106:0/3992730403 learned_addr learned my addr 172.21.15.106:0/3992730403 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb259c640 1 --1- 172.21.15.106:0/3992730403 >> v1:172.21.15.106:6791/0 conn(0x7f6eb40a4820 0x7f6eb413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45750/0 (socket says 172.21.15.106:45750) 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229534946 0 0) 0x7f6eb406dd40 con 0x7f6eb413e200 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): my global_id is 4518 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ea0003530 con 0x7f6eb413e200 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360598670 0 0) 0x7f6eb40a2df0 con 0x7f6eb40a4820 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient(hunting): my global_id is 4495 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb406dd40 con 0x7f6eb40a4820 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3499008267 0 0) 0x7f6ea0003530 con 0x7f6eb413e200 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 >> v1:172.21.15.106:6791/0 conn(0x7f6eb40a4820 legacy=0x7f6eb413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 >> v1:172.21.15.171:6789/0 conn(0x7f6eb4134970 legacy=0x7f6eb4134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 monclient: found mon.noname-a 2024-04-25T23:55:06.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb40a30d0 con 0x7f6eb413e200 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6eac001b40 con 0x7f6eb413e200 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: dump: 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.228 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 5 monclient: authenticate success, global_id 4518 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6eac001df0 con 0x7f6eb413e200 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 4 set_mon_vals no callback set 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 1 -- 172.21.15.106:0/3992730403 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6eac004f70 con 0x7f6eb413e200 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb1d9b640 10 monclient: dump: 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.230 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 10 monclient: shutdown 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.236+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3992730403 >> v1:172.21.15.106:6789/0 conn(0x7f6eb413e200 legacy=0x7f6eb41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3992730403 shutdown_connections 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3992730403 >> 172.21.15.106:0/3992730403 conn(0x7f6eb40a9e20 msgr2=0x7f6eb40aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3992730403 shutdown_connections 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3992730403 wait complete. 2024-04-25T23:55:06.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: monmap: 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.232 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 Processor -- start 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- start start 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: init 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: _add_conns ranks=[1,7,5,6,2,8,4,0,3] 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient(hunting): picked mon.noname-f con 0x7f6eb40a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient(hunting): picked mon.noname-i con 0x7f6eb4134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient(hunting): picked mon.noname-h con 0x7f6eb413e200 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb4138cc0 con 0x7f6eb40a4820 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb4138fa0 con 0x7f6eb413e200 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb4137bd0 con 0x7f6eb4134970 2024-04-25T23:55:06.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient(hunting): authenticate will time out at 961.769785s 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb259c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f6eb4134970 0x7f6eb41d1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:54906/0 (socket says 172.21.15.106:54906) 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb259c640 1 -- 172.21.15.106:0/3380780452 learned_addr learned my addr 172.21.15.106:0/3380780452 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1273444735 0 0) 0x7f6eb4137bd0 con 0x7f6eb4134970 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): my global_id is 4471 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e94003530 con 0x7f6eb4134970 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112696612 0 0) 0x7f6eb4138cc0 con 0x7f6eb40a4820 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): my global_id is 4402 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb4137bd0 con 0x7f6eb40a4820 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3095738546 0 0) 0x7f6eb4138fa0 con 0x7f6eb413e200 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): my global_id is 4532 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb4138cc0 con 0x7f6eb413e200 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2898047097 0 0) 0x7f6e94003530 con 0x7f6eb4134970 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6eb4138fa0 con 0x7f6eb4134970 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 970951006 0 0) 0x7f6eb4138cc0 con 0x7f6eb413e200 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e94003530 con 0x7f6eb413e200 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6e9c0019e0 con 0x7f6eb4134970 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:06.235 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.236 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6eac004eb0 con 0x7f6eb413e200 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2351343839 0 0) 0x7f6eb4137bd0 con 0x7f6eb40a4820 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6eb4138cc0 con 0x7f6eb40a4820 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6ea4001910 con 0x7f6eb40a4820 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:06.238 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.239 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2917517680 0 0) 0x7f6eb4138fa0 con 0x7f6eb4134970 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6791/0 conn(0x7f6eb413e200 legacy=0x7f6eb41d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6789/0 conn(0x7f6eb40a4820 legacy=0x7f6eb412a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 monclient: found mon.i 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:55:06.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb40a1e00 con 0x7f6eb4134970 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 5 monclient: authenticate success, global_id 4471 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: _renew_subs 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb4139280 con 0x7f6eb4134970 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: _renew_subs 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.240+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6eb4136500 con 0x7f6eb4134970 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e9c004aa0 con 0x7f6eb4134970 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6e9c001c80 con 0x7f6eb4134970 2024-04-25T23:55:06.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eb159a640 4 set_mon_vals no callback set 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: dump: 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.243 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.244 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eb91fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e980065d0 con 0x7f6e98002870 2024-04-25T23:55:06.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6e9c00fc10 con 0x7f6eb4134970 2024-04-25T23:55:06.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f6e9c044400 con 0x7f6eb4134970 2024-04-25T23:55:06.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146589907 0 0) 0x7f6e980065d0 con 0x7f6e98002870 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient(hunting): my global_id is 4480 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6eb4138fa0 con 0x7f6e98002870 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eb359e640 10 monclient: get_auth_request con 0x7f6e940380c0 auth_method 0 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2428252737 0 0) 0x7f6eb4138fa0 con 0x7f6e98002870 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e980065d0 con 0x7f6e98002870 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6ea4003940 con 0x7f6e98002870 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: dump: 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.247 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 234221616 0 0) 0x7f6e980065d0 con 0x7f6e98002870 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e9800a160 con 0x7f6e98002870 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6ea4004650 con 0x7f6e98002870 2024-04-25T23:55:06.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6792/0 conn(0x7f6e98002870 legacy=0x7f6e98004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.244+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6792/0 conn(0x7f6e98002870 legacy=0x7f6e98004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6e98009e30 con 0x7f6e980090f0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1007347021 0 0) 0x7f6e98009e30 con 0x7f6e980090f0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient(hunting): my global_id is 4489 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e980065d0 con 0x7f6e980090f0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 97434102 0 0) 0x7f6e980065d0 con 0x7f6e980090f0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e98009e30 con 0x7f6e980090f0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6ea4004250 con 0x7f6e980090f0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient: dump: 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.250 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3906740153 0 0) 0x7f6e98009e30 con 0x7f6e980090f0 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6e9800c3a0 con 0x7f6e980090f0 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 1650297287) 0x7f6ea4004800 con 0x7f6e980090f0 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6792/0 conn(0x7f6e980090f0 legacy=0x7f6e98009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eab7fe640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6792/0 conn(0x7f6e980090f0 legacy=0x7f6e98009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:06.251 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 8, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 24767, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:55:06.252 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 19, 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:06.253 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:06.254 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:06.255 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:06.256 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:06.258 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.259 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:06.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.261 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:06.263 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.264 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:06.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.266 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:06.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:06.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:06.270 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:06.270 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6812/722422047 conn(0x7f6e940380c0 legacy=0x7f6e9403a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 10 monclient: shutdown 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 >> v1:172.21.15.171:6792/0 conn(0x7f6eb4134970 legacy=0x7f6eb41d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb359e640 1 -- 172.21.15.106:0/3380780452 reap_dead start 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb359e640 1 -- 172.21.15.106:0/3380780452 reap_dead start 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 shutdown_connections 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 >> 172.21.15.106:0/3380780452 conn(0x7f6eb40a9e20 msgr2=0x7f6eb4130ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 shutdown_connections 2024-04-25T23:55:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.252+0000 7f6eb91fb640 1 -- 172.21.15.106:0/3380780452 wait complete. 2024-04-25T23:55:06.272 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:55:06.272 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['i', 'c', 'f', 'e'] 2024-04-25T23:55:06.272 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-25T23:55:06.272 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-04-25T23:55:06.272 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-04-25T23:55:06.273 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-04-25T23:55:06.273 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:55:06.295 INFO:tasks.ceph.mon.i:Stopped 2024-04-25T23:55:06.295 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-25T23:55:06.295 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c store 2024-04-25T23:55:06.295 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c sync_force --yes-i-really-mean-it 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient: get_monmap_and_config 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient: monmap: 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:06.436686+0000 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:06.436686+0000 2024-04-25T23:55:06.415 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.416 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 1 Processor -- start 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 1 -- start start 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient: init 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient: _add_conns ranks=[3,6,8,4,2,5,7,1,0] 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient(hunting): picked mon.noname-g con 0x7ff6080a1c30 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient(hunting): picked mon.noname-d con 0x7ff6080a2010 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient(hunting): picked mon.noname-e con 0x7ff60813dc40 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:06.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60809c5b0 con 0x7ff6080a1c30 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60809c2d0 con 0x7ff6080a2010 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6080a3a70 con 0x7ff60813dc40 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60fe20640 10 monclient(hunting): authenticate will time out at 961.963820s 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60e3bd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7ff60813dc40 0x7ff608140030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40918/0 (socket says 172.21.15.106:40918) 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.432+0000 7ff60e3bd640 1 -- 172.21.15.106:0/3850836111 learned_addr learned my addr 172.21.15.106:0/3850836111 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4168001730 0 0) 0x7ff60809c2d0 con 0x7ff6080a2010 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): my global_id is 4488 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5f0003530 con 0x7ff6080a2010 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1520742590 0 0) 0x7ff6080a3a70 con 0x7ff60813dc40 2024-04-25T23:55:06.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient(hunting): my global_id is 4508 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff60809c2d0 con 0x7ff60813dc40 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 165901843 0 0) 0x7ff5f0003530 con 0x7ff6080a2010 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 >> v1:172.21.15.106:6793/0 conn(0x7ff60813dc40 legacy=0x7ff608140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 >> v1:172.21.15.171:6790/0 conn(0x7ff6080a1c30 legacy=0x7ff60809aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 monclient: found mon.noname-d 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff608144780 con 0x7ff6080a2010 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff5fc0017c0 con 0x7ff6080a2010 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 5 monclient: authenticate success, global_id 4488 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: dump: 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.426 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5fc001ae0 con 0x7ff6080a2010 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 1 -- 172.21.15.106:0/3850836111 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff5fc001d50 con 0x7ff6080a2010 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:06.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60cbba640 10 monclient: dump: 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.428 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 4 set_mon_vals no callback set 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient: shutdown 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- 172.21.15.106:0/3850836111 >> v1:172.21.15.106:6792/0 conn(0x7ff6080a2010 legacy=0x7ff6080a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- 172.21.15.106:0/3850836111 shutdown_connections 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- 172.21.15.106:0/3850836111 >> 172.21.15.106:0/3850836111 conn(0x7ff6080a2d20 msgr2=0x7ff6080a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- 172.21.15.106:0/3850836111 shutdown_connections 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- 172.21.15.106:0/3850836111 wait complete. 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient: monmap: 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:06.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 Processor -- start 2024-04-25T23:55:06.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- start start 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient: init 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient: _add_conns ranks=[3,1,0,4,6,7,2,8,5] 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient(hunting): picked mon.noname-g con 0x7ff6080a1c30 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient(hunting): picked mon.noname-f con 0x7ff6080a2010 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient(hunting): picked mon.noname-a con 0x7ff60813dc40 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6081349a0 con 0x7ff60813dc40 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60813f350 con 0x7ff6080a2010 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff60813f910 con 0x7ff6080a1c30 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60fe20640 10 monclient(hunting): authenticate will time out at 961.967193s 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60e3bd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff60813dc40 0x7ff6081d48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58324/0 (socket says 172.21.15.106:58324) 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff60e3bd640 1 -- 172.21.15.106:0/2277975910 learned_addr learned my addr 172.21.15.106:0/2277975910 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1604890181 0 0) 0x7ff6081349a0 con 0x7ff60813dc40 2024-04-25T23:55:06.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): my global_id is 4527 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5f4003530 con 0x7ff60813dc40 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 732910660 0 0) 0x7ff5f4003530 con 0x7ff60813dc40 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6081349a0 con 0x7ff60813dc40 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff5f8001980 con 0x7ff60813dc40 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): dump: 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.432 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586324594 0 0) 0x7ff60813f910 con 0x7ff6080a1c30 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 10 monclient(hunting): my global_id is 4485 2024-04-25T23:55:06.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5f4003530 con 0x7ff6080a1c30 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.436+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494985636 0 0) 0x7ff60813f350 con 0x7ff6080a2010 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): my global_id is 4411 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff60813f910 con 0x7ff6080a2010 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3616877299 0 0) 0x7ff6081349a0 con 0x7ff60813dc40 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.171:6790/0 conn(0x7ff6080a1c30 legacy=0x7ff60812d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.171:6789/0 conn(0x7ff6080a2010 legacy=0x7ff60812e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 monclient: found mon.a 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:06.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff60813f630 con 0x7ff60813dc40 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 5 monclient: authenticate success, global_id 4527 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 10 monclient: _renew_subs 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff60813e3f0 con 0x7ff60813dc40 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 10 monclient: _renew_subs 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff608131d20 con 0x7ff60813dc40 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff5f8004aa0 con 0x7ff60813dc40 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff5f8004f90 con 0x7ff60813dc40 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff607fff640 4 set_mon_vals no callback set 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: dump: 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.436 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5e80065d0 con 0x7ff5e8002870 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff5f800fd30 con 0x7ff60813dc40 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7ff5f80443e0 con 0x7ff60813dc40 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113950484 0 0) 0x7ff5e80065d0 con 0x7ff5e8002870 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient(hunting): my global_id is 4504 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6081349a0 con 0x7ff5e8002870 2024-04-25T23:55:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2187260897 0 0) 0x7ff6081349a0 con 0x7ff5e8002870 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5e80065d0 con 0x7ff5e8002870 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff600001dc0 con 0x7ff5e8002870 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: dump: 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff60d3bb640 10 monclient: get_auth_request con 0x7ff5f4037a40 auth_method 0 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2529623442 0 0) 0x7ff5e80065d0 con 0x7ff5e8002870 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff5e800a160 con 0x7ff5e8002870 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff6000039a0 con 0x7ff5e8002870 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.106:6791/0 conn(0x7ff5e8002870 legacy=0x7ff5e8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.440+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.106:6791/0 conn(0x7ff5e8002870 legacy=0x7ff5e8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:06.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5e8009e40 con 0x7ff5e8009100 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558324105 0 0) 0x7ff5e8009e40 con 0x7ff5e8009100 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient(hunting): my global_id is 4513 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5e80065d0 con 0x7ff5e8009100 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 23674575 0 0) 0x7ff5e80065d0 con 0x7ff5e8009100 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5e8009e40 con 0x7ff5e8009100 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff600004080 con 0x7ff5e8009100 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient: dump: 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.441 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2288599255 0 0) 0x7ff5e8009e40 con 0x7ff5e8009100 2024-04-25T23:55:06.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7ff5e800c3e0 con 0x7ff5e8009100 2024-04-25T23:55:06.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7ff600005110 con 0x7ff5e8009100 2024-04-25T23:55:06.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-25T23:55:06.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:06.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.106:6791/0 conn(0x7ff5e8009100 legacy=0x7ff5e8009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff6067fc640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.106:6791/0 conn(0x7ff5e8009100 legacy=0x7ff5e8009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:06.445 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:06.445 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-25T23:55:06.445 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-25T23:55:06.445 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.171:6812/722422047 conn(0x7ff5f4037a40 legacy=0x7ff5f4039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 10 monclient: shutdown 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 >> v1:172.21.15.106:6789/0 conn(0x7ff60813dc40 legacy=0x7ff6081d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60e3bd640 1 -- 172.21.15.106:0/2277975910 reap_dead start 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60e3bd640 1 -- 172.21.15.106:0/2277975910 reap_dead start 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 shutdown_connections 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 >> 172.21.15.106:0/2277975910 conn(0x7ff6080a2d20 msgr2=0x7ff608142500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 shutdown_connections 2024-04-25T23:55:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.448+0000 7ff60fe20640 1 -- 172.21.15.106:0/2277975910 wait complete. 2024-04-25T23:55:06.447 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-25T23:55:06.448 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T23:55:06.448 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:55:06.458 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T23:55:06.459 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-04-25T23:55:06.459 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-25T23:55:06.459 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-04-25T23:55:06.459 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:55:06.473 INFO:tasks.ceph.mon.f:Stopped 2024-04-25T23:55:06.473 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-04-25T23:55:06.473 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-25T23:55:06.474 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-04-25T23:55:06.474 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:55:06.515 INFO:tasks.ceph.mon.e:Stopped 2024-04-25T23:55:06.516 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-04-25T23:55:06.516 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:55:06.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient: get_monmap_and_config 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient: monmap: 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:06.696116+0000 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:06.696116+0000 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.675 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.676 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.676 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.676 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.676 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 1 Processor -- start 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 1 -- start start 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient: init 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient: _add_conns ranks=[1,6,7,4,2,3,5,8,0] 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient(hunting): picked mon.noname-f con 0x7ff128135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient(hunting): picked mon.noname-d con 0x7ff1281353b0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient(hunting): picked mon.noname-i con 0x7ff12813bdf0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12806f2d0 con 0x7ff128135870 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff128072330 con 0x7ff1281353b0 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff128072610 con 0x7ff12813bdf0 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 10 monclient(hunting): authenticate will time out at 962.223267s 2024-04-25T23:55:06.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff126ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff1281353b0 0x7ff12813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:57390/0 (socket says 172.21.15.106:57390) 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1277fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7ff128135870 legacy=0x7ff128135c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff126ffd640 1 -- 172.21.15.106:0/22341102 learned_addr learned my addr 172.21.15.106:0/22341102 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff127fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7ff12813bdf0 legacy=0x7ff12813e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341706315 0 0) 0x7ff128072330 con 0x7ff1281353b0 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient(hunting): my global_id is 4497 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff110003530 con 0x7ff1281353b0 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3236622231 0 0) 0x7ff110003530 con 0x7ff1281353b0 2024-04-25T23:55:06.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 >> v1:172.21.15.171:6792/0 conn(0x7ff12813bdf0 legacy=0x7ff12813e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 >> v1:172.21.15.171:6789/0 conn(0x7ff128135870 legacy=0x7ff128135c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 monclient: found mon.noname-d 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1280a3260 con 0x7ff1281353b0 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff1180017c0 con 0x7ff1281353b0 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 5 monclient: authenticate success, global_id 4497 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff1267fc640 10 monclient: dump: 2024-04-25T23:55:06.684 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.685 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.692+0000 7ff12e066640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff118001b20 con 0x7ff1281353b0 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff1267fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 4 set_mon_vals no callback set 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff1267fc640 1 -- 172.21.15.106:0/22341102 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff118001d50 con 0x7ff1281353b0 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff1267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff1267fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff1267fc640 10 monclient: dump: 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: shutdown 2024-04-25T23:55:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- 172.21.15.106:0/22341102 >> v1:172.21.15.106:6792/0 conn(0x7ff1281353b0 legacy=0x7ff12813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- 172.21.15.106:0/22341102 shutdown_connections 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- 172.21.15.106:0/22341102 >> 172.21.15.106:0/22341102 conn(0x7ff1280a64e0 msgr2=0x7ff1280a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- 172.21.15.106:0/22341102 shutdown_connections 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- 172.21.15.106:0/22341102 wait complete. 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: build_initial_monmap 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: monmap: 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 Processor -- start 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- start start 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: init 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: _add_conns ranks=[4,8,3,1,7,0,2,5,6] 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient(hunting): picked mon.noname-c con 0x7ff1281353b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient(hunting): picked mon.noname-e con 0x7ff128135870 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient(hunting): picked mon.noname-g con 0x7ff12813bdf0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12811c040 con 0x7ff12813bdf0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff128139a30 con 0x7ff1281353b0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff12813bab0 con 0x7ff128135870 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff1277fe640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff1281353b0 legacy=0x7ff1281ca520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient(hunting): authenticate will time out at 962.226153s 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff126ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff128135870 legacy=0x7ff1281cf0d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff127fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff12813bdf0 0x7ff1281d2800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:57446/0 (socket says 172.21.15.106:57446) 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff127fff640 1 -- 172.21.15.106:0/1759426441 learned_addr learned my addr 172.21.15.106:0/1759426441 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 28972484 0 0) 0x7ff12811c040 con 0x7ff12813bdf0 2024-04-25T23:55:06.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): my global_id is 4494 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff114003530 con 0x7ff12813bdf0 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4277609174 0 0) 0x7ff114003530 con 0x7ff12813bdf0 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff12811c040 con 0x7ff12813bdf0 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff120004540 con 0x7ff12813bdf0 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): dump: 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.691 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1657091805 0 0) 0x7ff12811c040 con 0x7ff12813bdf0 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 >> v1:172.21.15.106:6793/0 conn(0x7ff128135870 legacy=0x7ff1281cf0d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:06.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 >> v1:172.21.15.106:6791/0 conn(0x7ff1281353b0 legacy=0x7ff1281ca520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 monclient: found mon.g 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1281cac30 con 0x7ff12813bdf0 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient: _finish_auth 0 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff10ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 5 monclient: authenticate success, global_id 4494 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: _renew_subs 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff128134d30 con 0x7ff12813bdf0 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: _renew_subs 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:06.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.696+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1281c9f20 con 0x7ff12813bdf0 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff120004870 con 0x7ff12813bdf0 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff120004d60 con 0x7ff12813bdf0 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff125ffb640 4 set_mon_vals no callback set 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 10 monclient: dump: 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:06.694 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff12e066640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff12e066640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff12e066640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff108005090 con 0x7ff12813bdf0 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff120004f00 con 0x7ff12813bdf0 2024-04-25T23:55:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7ff1200446d0 con 0x7ff12813bdf0 2024-04-25T23:55:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.700+0000 7ff1277fe640 10 monclient: get_auth_request con 0x7ff114037780 auth_method 0 2024-04-25T23:55:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.712+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff120015990 con 0x7ff12813bdf0 2024-04-25T23:55:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.712+0000 7ff10ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.712+0000 7ff10ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.944+0000 7ff12e066640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:55:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.944+0000 7ff12e066640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:55:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.944+0000 7ff12e066640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:06.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.944+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff108005380 con 0x7ff12813bdf0 2024-04-25T23:55:06.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.944+0000 7ff10ffff640 1 -- 172.21.15.106:0/1759426441 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1029419690) 0x7ff120015290 con 0x7ff12813bdf0 2024-04-25T23:55:06.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.944+0000 7ff10ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:55:06.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.944+0000 7ff10ffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:06.928 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":8,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":20,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:55:06.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 >> v1:172.21.15.171:6812/722422047 conn(0x7ff114037780 legacy=0x7ff114039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 10 monclient: shutdown 2024-04-25T23:55:06.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:06.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 >> v1:172.21.15.171:6790/0 conn(0x7ff12813bdf0 legacy=0x7ff1281d2800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:06.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 shutdown_connections 2024-04-25T23:55:06.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 >> 172.21.15.106:0/1759426441 conn(0x7ff1280a64e0 msgr2=0x7ff1280a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:06.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 shutdown_connections 2024-04-25T23:55:06.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:06.948+0000 7ff12e066640 1 -- 172.21.15.106:0/1759426441 wait complete. 2024-04-25T23:55:09.948 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:55:10.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient: get_monmap_and_config 2024-04-25T23:55:10.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient: build_initial_monmap 2024-04-25T23:55:10.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient: monmap: 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:10.095979+0000 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:10.095979+0000 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:10.075 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:10.076 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 1 Processor -- start 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 1 -- start start 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient: init 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient: _add_conns ranks=[2,1,4,5,8,6,3,0,7] 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient(hunting): picked mon.noname-b con 0x7f8250135870 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient(hunting): picked mon.noname-f con 0x7f82501353b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient(hunting): picked mon.noname-c con 0x7f825013bdf0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825006f2d0 con 0x7f82501353b0 2024-04-25T23:55:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8250072330 con 0x7f8250135870 2024-04-25T23:55:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8250072610 con 0x7f825013bdf0 2024-04-25T23:55:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f8255964640 10 monclient(hunting): authenticate will time out at 965.623176s 2024-04-25T23:55:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f824f7fe640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f825013bdf0 legacy=0x7f825013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f824effd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f8250135870 0x7f8250135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:45342/0 (socket says 172.21.15.106:45342) 2024-04-25T23:55:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f824effd640 1 -- 172.21.15.106:0/759842843 learned_addr learned my addr 172.21.15.106:0/759842843 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.092+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6789/0 conn(0x7f82501353b0 legacy=0x7f825013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:10.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.296+0000 7f824f7fe640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6791/0 conn(0x7f825013bdf0 legacy=0x7f825013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:10.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.296+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6789/0 conn(0x7f82501353b0 legacy=0x7f825013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:10.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.700+0000 7f824f7fe640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6791/0 conn(0x7f825013bdf0 legacy=0x7f825013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:10.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:10.700+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6789/0 conn(0x7f82501353b0 legacy=0x7f825013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:11.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:11.504+0000 7f824f7fe640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6791/0 conn(0x7f825013bdf0 legacy=0x7f825013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:11.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:11.504+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6789/0 conn(0x7f82501353b0 legacy=0x7f825013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:13.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient(hunting): tick 2024-04-25T23:55:13.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 1 monclient(hunting): continuing hunt 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6791/0 conn(0x7f825013bdf0 legacy=0x7f825013e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6790/0 conn(0x7f8250135870 legacy=0x7f8250135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6789/0 conn(0x7f82501353b0 legacy=0x7f825013a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient: _add_conns ranks=[6,0,5,3,7,8] 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-d con 0x7f82300037b0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-a con 0x7f82300073a0 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-h con 0x7f823000b130 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82500a3260 con 0x7f82300073a0 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825006f2d0 con 0x7f823000b130 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8250072610 con 0x7f82300037b0 2024-04-25T23:55:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:13.092+0000 7f824cff9640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient(hunting): tick 2024-04-25T23:55:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:55:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 1 monclient(hunting): continuing hunt 2024-04-25T23:55:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:55:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6792/0 conn(0x7f82300037b0 legacy=0x7f8230005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6791/0 conn(0x7f823000b130 legacy=0x7f823000d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6789/0 conn(0x7f82300073a0 legacy=0x7f8230009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient: _add_conns ranks=[8,7,3] 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824f7fe640 1 -- 172.21.15.106:0/759842843 reap_dead start 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-e con 0x7f823000efd0 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-i con 0x7f8230010fb0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824f7fe640 1 -- 172.21.15.106:0/759842843 reap_dead start 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824effd640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6793/0 conn(0x7f823000efd0 legacy=0x7f823000f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-g con 0x7f8230011b70 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8230012020 con 0x7f8230011b70 2024-04-25T23:55:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823000a030 con 0x7f8230010fb0 2024-04-25T23:55:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823000a200 con 0x7f823000efd0 2024-04-25T23:55:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.096+0000 7f824cff9640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.300+0000 7f824effd640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6793/0 conn(0x7f823000efd0 legacy=0x7f823000f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.300+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:16.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.704+0000 7f824effd640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6793/0 conn(0x7f823000efd0 legacy=0x7f823000f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:16.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:16.704+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:17.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:17.508+0000 7f824effd640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6793/0 conn(0x7f823000efd0 legacy=0x7f823000f410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:17.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:17.508+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient(hunting): tick 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 1 monclient(hunting): continuing hunt 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6793/0 conn(0x7f823000efd0 legacy=0x7f823000f410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6790/0 conn(0x7f8230011b70 legacy=0x7f823000d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient: _add_conns ranks=[5,7,6,1,0,8,3,4,2] 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-h con 0x7f823000a3d0 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-i con 0x7f8230010fb0 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient(hunting): picked mon.noname-d con 0x7f8230005ba0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8230009870 con 0x7f823000a3d0 2024-04-25T23:55:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823000a030 con 0x7f8230005ba0 2024-04-25T23:55:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f823000a200 con 0x7f8230010fb0 2024-04-25T23:55:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824cff9640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.096+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.300+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:19.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:19.704+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:20.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.508+0000 7f824e7fc640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:20.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665765046 0 0) 0x7f823000a030 con 0x7f8230005ba0 2024-04-25T23:55:20.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:20.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:20.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:20.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): my global_id is 4506 2024-04-25T23:55:20.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f823c003530 con 0x7f8230005ba0 2024-04-25T23:55:20.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4151493172 0 0) 0x7f8230009870 con 0x7f823000a3d0 2024-04-25T23:55:20.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:20.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:20.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:20.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 10 monclient(hunting): my global_id is 4541 2024-04-25T23:55:20.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.824+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f823000a030 con 0x7f823000a3d0 2024-04-25T23:55:20.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 208413556 0 0) 0x7f823000a030 con 0x7f823000a3d0 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6792/0 conn(0x7f8230010fb0 legacy=0x7f8230011460 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.106:6792/0 conn(0x7f8230005ba0 legacy=0x7f8230017380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 monclient: found mon.noname-h 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82300060a0 con 0x7f823000a3d0 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f82480017b0 con 0x7f823000a3d0 2024-04-25T23:55:20.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 5 monclient: authenticate success, global_id 4541 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: dump: 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:20.815 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8248001a10 con 0x7f823000a3d0 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 1 -- 172.21.15.106:0/759842843 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8248004bf0 con 0x7f823000a3d0 2024-04-25T23:55:20.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 4 set_mon_vals no callback set 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824dffb640 10 monclient: dump: 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:20.817 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:20.818 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:20.818 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:20.818 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:20.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 10 monclient: shutdown 2024-04-25T23:55:20.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 1 -- 172.21.15.106:0/759842843 >> v1:172.21.15.171:6791/0 conn(0x7f823000a3d0 legacy=0x7f823000a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f824f7fe640 1 -- 172.21.15.106:0/759842843 reap_dead start 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 1 -- 172.21.15.106:0/759842843 shutdown_connections 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 1 -- 172.21.15.106:0/759842843 >> 172.21.15.106:0/759842843 conn(0x7f82500a64e0 msgr2=0x7f82500a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 1 -- 172.21.15.106:0/759842843 shutdown_connections 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 1 -- 172.21.15.106:0/759842843 wait complete. 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 10 monclient: build_initial_monmap 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 10 monclient: monmap: 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:20.822 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 1 Processor -- start 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 1 -- start start 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.832+0000 7f8255964640 10 monclient: init 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:20.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _add_conns ranks=[8,4,0,2,7,1,6,3,5] 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient(hunting): picked mon.noname-e con 0x7f823000a3d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient(hunting): picked mon.noname-c con 0x7f82501ca0e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient(hunting): picked mon.noname-a con 0x7f82501d0b20 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825011fcf0 con 0x7f82501d0b20 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825011e560 con 0x7f82501ca0e0 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f824e7fc640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f82501ca0e0 legacy=0x7f82501cf400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f824effd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f823000a3d0 legacy=0x7f8250134350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f825009f930 con 0x7f823000a3d0 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient(hunting): authenticate will time out at 976.364552s 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f824f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f82501d0b20 0x7f82501d2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56210/0 (socket says 172.21.15.106:56210) 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f824f7fe640 1 -- 172.21.15.106:0/1484758188 learned_addr learned my addr 172.21.15.106:0/1484758188 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574695000 0 0) 0x7f825011fcf0 con 0x7f82501d0b20 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:20.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): my global_id is 4536 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82300111a0 con 0x7f82501d0b20 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1305945407 0 0) 0x7f82300111a0 con 0x7f82501d0b20 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f825011fcf0 con 0x7f82501d0b20 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f82400042d0 con 0x7f82501d0b20 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): dump: 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:20.825 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2376851094 0 0) 0x7f825011fcf0 con 0x7f82501d0b20 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 >> v1:172.21.15.106:6793/0 conn(0x7f823000a3d0 legacy=0x7f8250134350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:20.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 >> v1:172.21.15.106:6791/0 conn(0x7f82501ca0e0 legacy=0x7f82501cf400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 monclient: found mon.a 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f825011e890 con 0x7f82501d0b20 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: _finish_auth 0 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 5 monclient: authenticate success, global_id 4536 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _renew_subs 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f825011fa10 con 0x7f82501d0b20 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _renew_subs 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:20.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8250134a60 con 0x7f82501d0b20 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8240004720 con 0x7f82501d0b20 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8240004c90 con 0x7f82501d0b20 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 10 monclient: dump: 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:20.828 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f824d7fa640 4 set_mon_vals no callback set 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8240004ef0 con 0x7f82501d0b20 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8250075890 con 0x7f82501d0b20 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f8240044290 con 0x7f82501d0b20 2024-04-25T23:55:20.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.836+0000 7f824effd640 10 monclient: get_auth_request con 0x7f82300397d0 auth_method 0 2024-04-25T23:55:20.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.844+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f82400191a0 con 0x7f82501d0b20 2024-04-25T23:55:20.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.844+0000 7f8247fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:20.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:20.844+0000 7f8247fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:21.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.056+0000 7f8255964640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:55:21.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.056+0000 7f8255964640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:55:21.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.056+0000 7f8255964640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:21.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.056+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f8250062e50 con 0x7f82501d0b20 2024-04-25T23:55:21.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.056+0000 7f8247fff640 1 -- 172.21.15.106:0/1484758188 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2720 (unknown 254746657 0 1929231495) 0x7f824001da60 con 0x7f82501d0b20 2024-04-25T23:55:21.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.056+0000 7f8247fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:55:21.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.056+0000 7f8247fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:21.040 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":12,"quorum":[0,2,3,5,6],"quorum_names":["a","b","g","h","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:55:21.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 >> v1:172.21.15.171:6812/722422047 conn(0x7f82300397d0 legacy=0x7f823003bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 10 monclient: shutdown 2024-04-25T23:55:21.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 >> v1:172.21.15.106:6789/0 conn(0x7f82501d0b20 legacy=0x7f82501d2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 shutdown_connections 2024-04-25T23:55:21.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 >> 172.21.15.106:0/1484758188 conn(0x7f82500a64e0 msgr2=0x7f825009cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 shutdown_connections 2024-04-25T23:55:21.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.060+0000 7f8255964640 1 -- 172.21.15.106:0/1484758188 wait complete. 2024-04-25T23:55:21.056 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-04-25T23:55:21.056 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-04-25T23:55:21.057 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:55:21.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.176+0000 7fa39ae98640 10 monclient: get_monmap_and_config 2024-04-25T23:55:21.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.176+0000 7fa39ae98640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.176+0000 7fa39ae98640 10 monclient: monmap: 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:21.182242+0000 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:21.182242+0000 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.161 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.162 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 Processor -- start 2024-04-25T23:55:21.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- start start 2024-04-25T23:55:21.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: init 2024-04-25T23:55:21.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: _add_conns ranks=[6,3,1,4,2,5,0,7,8] 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): picked mon.noname-d con 0x7fa394134970 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): picked mon.noname-g con 0x7fa3940a4820 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): picked mon.noname-f con 0x7fa39413e200 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa39406dd40 con 0x7fa39413e200 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3940a2b10 con 0x7fa3940a4820 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3940a2df0 con 0x7fa394134970 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): authenticate will time out at 976.709240s 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa398c34640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fa394134970 0x7fa394134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:56564/0 (socket says 172.21.15.106:56564) 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa398c34640 1 -- 172.21.15.106:0/3885121576 learned_addr learned my addr 172.21.15.106:0/3885121576 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa399435640 1 -- 172.21.15.106:0/3885121576 >> v1:172.21.15.171:6789/0 conn(0x7fa39413e200 legacy=0x7fa3941405f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422192518 0 0) 0x7fa3940a2df0 con 0x7fa394134970 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient(hunting): my global_id is 4515 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa37c003530 con 0x7fa394134970 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1327489663 0 0) 0x7fa37c003530 con 0x7fa394134970 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 >> v1:172.21.15.171:6790/0 conn(0x7fa3940a4820 legacy=0x7fa39413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 >> v1:172.21.15.171:6789/0 conn(0x7fa39413e200 legacy=0x7fa3941405f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 monclient: found mon.noname-d 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3940a30d0 con 0x7fa394134970 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa3840017c0 con 0x7fa394134970 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 5 monclient: authenticate success, global_id 4515 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: dump: 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.171 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa384001ab0 con 0x7fa394134970 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 4 set_mon_vals no callback set 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 1 -- 172.21.15.106:0/3885121576 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa384004bf0 con 0x7fa394134970 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa3937fe640 10 monclient: dump: 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.173 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: shutdown 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- 172.21.15.106:0/3885121576 >> v1:172.21.15.106:6792/0 conn(0x7fa394134970 legacy=0x7fa394134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- 172.21.15.106:0/3885121576 shutdown_connections 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- 172.21.15.106:0/3885121576 >> 172.21.15.106:0/3885121576 conn(0x7fa3940a9e20 msgr2=0x7fa3940aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- 172.21.15.106:0/3885121576 shutdown_connections 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- 172.21.15.106:0/3885121576 wait complete. 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: monmap: 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 Processor -- start 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- start start 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: init 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient: _add_conns ranks=[4,6,8,2,1,3,0,5,7] 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): picked mon.noname-c con 0x7fa3940a4820 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): picked mon.noname-d con 0x7fa394134970 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): picked mon.noname-e con 0x7fa39413e200 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa39413abb0 con 0x7fa3940a4820 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa39413ae90 con 0x7fa394134970 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa39413b170 con 0x7fa39413e200 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa39ae98640 10 monclient(hunting): authenticate will time out at 976.711838s 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa398c34640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fa3940a4820 legacy=0x7fa394138dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa399435640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fa39413e200 legacy=0x7fa3941d47a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa393fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fa394134970 0x7fa39413cbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:56572/0 (socket says 172.21.15.106:56572) 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.180+0000 7fa393fff640 1 -- 172.21.15.106:0/2481444629 learned_addr learned my addr 172.21.15.106:0/2481444629 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426427170 0 0) 0x7fa39413ae90 con 0x7fa394134970 2024-04-25T23:55:21.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): my global_id is 4524 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa380003530 con 0x7fa394134970 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2170333945 0 0) 0x7fa380003530 con 0x7fa394134970 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa39413ae90 con 0x7fa394134970 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa388001ae0 con 0x7fa394134970 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): dump: 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.177 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1817955146 0 0) 0x7fa39413ae90 con 0x7fa394134970 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.106:6793/0 conn(0x7fa39413e200 legacy=0x7fa3941d47a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.106:6791/0 conn(0x7fa3940a4820 legacy=0x7fa394138dc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 monclient: found mon.d 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39413b450 con 0x7fa394134970 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 5 monclient: authenticate success, global_id 4524 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 10 monclient: _renew_subs 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa39413d2c0 con 0x7fa394134970 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 10 monclient: _renew_subs 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3941d5ec0 con 0x7fa394134970 2024-04-25T23:55:21.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3880038d0 con 0x7fa394134970 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa388003e40 con 0x7fa394134970 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa392ffd640 4 set_mon_vals no callback set 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: dump: 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.180 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa3740065d0 con 0x7fa374002870 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa388003fe0 con 0x7fa394134970 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fa388044530 con 0x7fa394134970 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232994843 0 0) 0x7fa3740065d0 con 0x7fa374002870 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient(hunting): my global_id is 4545 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa39413ae90 con 0x7fa374002870 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1326449250 0 0) 0x7fa39413ae90 con 0x7fa374002870 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3740065d0 con 0x7fa374002870 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa384001220 con 0x7fa374002870 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: dump: 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.182 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa399435640 10 monclient: get_auth_request con 0x7fa3800377e0 auth_method 0 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1523420654 0 0) 0x7fa3740065d0 con 0x7fa374002870 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa37400a160 con 0x7fa374002870 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa384001d20 con 0x7fa374002870 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:21.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.106:6789/0 conn(0x7fa374002870 legacy=0x7fa374004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.184+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.106:6789/0 conn(0x7fa374002870 legacy=0x7fa374004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:21.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa374009e30 con 0x7fa3740090f0 2024-04-25T23:55:21.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062553681 0 0) 0x7fa374009e30 con 0x7fa3740090f0 2024-04-25T23:55:21.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient(hunting): my global_id is 4554 2024-04-25T23:55:21.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3740065d0 con 0x7fa3740090f0 2024-04-25T23:55:21.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1815096467 0 0) 0x7fa3740065d0 con 0x7fa3740090f0 2024-04-25T23:55:21.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa374009e30 con 0x7fa3740090f0 2024-04-25T23:55:21.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa384001740 con 0x7fa3740090f0 2024-04-25T23:55:21.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:21.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient: dump: 2024-04-25T23:55:21.189 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.189 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.190 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.190 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.190 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.190 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.193 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.193 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.193 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.194 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.194 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.194 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.194 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.194 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 171751726 0 0) 0x7fa374009e30 con 0x7fa3740090f0 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa37400c3a0 con 0x7fa3740090f0 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7522 (unknown 0 0 1800164563) 0x7fa3840073e0 con 0x7fa3740090f0 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.106:6789/0 conn(0x7fa3740090f0 legacy=0x7fa374009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa3917fa640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.106:6789/0 conn(0x7fa3740090f0 legacy=0x7fa374009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 12, 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 39751, 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:21.196 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.197 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.198 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.199 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.200 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.201 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:21.201 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:21.201 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:21.201 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:21.201 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:21.201 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:21.201 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:21.202 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.202 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:21.202 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.202 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.202 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.202 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.202 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.204 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.204 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.204 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.204 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:21.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.205 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:21.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.205 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:21.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:21.206 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.209 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.211 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:21.213 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:21.216 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.219 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.220 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.221 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.222 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:21.223 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.171:6812/722422047 conn(0x7fa3800377e0 legacy=0x7fa380039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 10 monclient: shutdown 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 >> v1:172.21.15.106:6792/0 conn(0x7fa394134970 legacy=0x7fa39413cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa399435640 1 -- 172.21.15.106:0/2481444629 reap_dead start 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa399435640 1 -- 172.21.15.106:0/2481444629 reap_dead start 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 shutdown_connections 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 >> 172.21.15.106:0/2481444629 conn(0x7fa3940a9e20 msgr2=0x7fa394130bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 shutdown_connections 2024-04-25T23:55:21.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.192+0000 7fa39ae98640 1 -- 172.21.15.106:0/2481444629 wait complete. 2024-04-25T23:55:21.226 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:55:21.226 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon b 2024-04-25T23:55:21.226 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:55:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: get_monmap_and_config 2024-04-25T23:55:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: monmap: 2024-04-25T23:55:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:21.367035+0000 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:21.367035+0000 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.346 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 Processor -- start 2024-04-25T23:55:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- start start 2024-04-25T23:55:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: init 2024-04-25T23:55:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: _add_conns ranks=[7,4,6,2,5,8,0,3,1] 2024-04-25T23:55:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient(hunting): picked mon.noname-i con 0x7f3b68135870 addr v1:172.21.15.171:6792/0 2024-04-25T23:55:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient(hunting): picked mon.noname-c con 0x7f3b681353b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient(hunting): picked mon.noname-d con 0x7f3b6813bdf0 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6806f2d0 con 0x7f3b681353b0 2024-04-25T23:55:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b68072330 con 0x7f3b6813bdf0 2024-04-25T23:55:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b68072610 con 0x7f3b68135870 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient(hunting): authenticate will time out at 976.894176s 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6c978640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f3b681353b0 legacy=0x7f3b6813a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6d179640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f3b68135870 legacy=0x7f3b68135c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6d97a640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f3b6813bdf0 0x7f3b6813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:56588/0 (socket says 172.21.15.106:56588) 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6d97a640 1 -- 172.21.15.106:0/1089879104 learned_addr learned my addr 172.21.15.106:0/1089879104 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260079997 0 0) 0x7f3b68072330 con 0x7f3b6813bdf0 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient(hunting): my global_id is 4533 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b54003530 con 0x7f3b6813bdf0 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3422553356 0 0) 0x7f3b54003530 con 0x7f3b6813bdf0 2024-04-25T23:55:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 >> v1:172.21.15.171:6792/0 conn(0x7f3b68135870 legacy=0x7f3b68135c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 >> v1:172.21.15.106:6791/0 conn(0x7f3b681353b0 legacy=0x7f3b6813a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 monclient: found mon.noname-d 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b680a3260 con 0x7f3b6813bdf0 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b60001b40 con 0x7f3b6813bdf0 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: dump: 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.357 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 5 monclient: authenticate success, global_id 4533 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b60001ea0 con 0x7f3b6813bdf0 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 1 -- 172.21.15.106:0/1089879104 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b600020d0 con 0x7f3b6813bdf0 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 4 set_mon_vals no callback set 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b5ffff640 10 monclient: dump: 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 10 monclient: shutdown 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1089879104 >> v1:172.21.15.106:6792/0 conn(0x7f3b6813bdf0 legacy=0x7f3b6813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1089879104 shutdown_connections 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1089879104 >> 172.21.15.106:0/1089879104 conn(0x7f3b680a64e0 msgr2=0x7f3b680a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1089879104 shutdown_connections 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.364+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1089879104 wait complete. 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: monmap: 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.360 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 Processor -- start 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 -- start start 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: init 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: _add_conns ranks=[3,6,1,7,2,5,8,4,0] 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient(hunting): picked mon.noname-g con 0x7f3b681353b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:21.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient(hunting): picked mon.noname-d con 0x7f3b68135870 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient(hunting): picked mon.noname-f con 0x7f3b6813bdf0 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6806fd70 con 0x7f3b6813bdf0 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b681cc670 con 0x7f3b681353b0 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6809f930 con 0x7f3b68135870 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient(hunting): authenticate will time out at 976.897068s 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6c978640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f3b68135870 0x7f3b68134860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:56598/0 (socket says 172.21.15.106:56598) 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6c978640 1 -- 172.21.15.106:0/1916820178 learned_addr learned my addr 172.21.15.106:0/1916820178 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6d97a640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.171:6789/0 conn(0x7f3b6813bdf0 legacy=0x7f3b681d40a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908296910 0 0) 0x7f3b6809f930 con 0x7f3b68135870 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): my global_id is 4542 2024-04-25T23:55:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b4c003530 con 0x7f3b68135870 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1190322349 0 0) 0x7f3b4c003530 con 0x7f3b68135870 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b6809f930 con 0x7f3b68135870 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b58004340 con 0x7f3b68135870 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): dump: 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.363 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1832218958 0 0) 0x7f3b6809f930 con 0x7f3b68135870 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.171:6790/0 conn(0x7f3b681353b0 legacy=0x7f3b681cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.171:6789/0 conn(0x7f3b6813bdf0 legacy=0x7f3b681d40a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 monclient: found mon.d 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b680714a0 con 0x7f3b68135870 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 5 monclient: authenticate success, global_id 4542 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: _renew_subs 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b68134f70 con 0x7f3b68135870 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: _renew_subs 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b681d5990 con 0x7f3b68135870 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b58004650 con 0x7f3b68135870 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b58004bc0 con 0x7f3b68135870 2024-04-25T23:55:21.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5f7fe640 4 set_mon_vals no callback set 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: dump: 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.366 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3b58004d60 con 0x7f3b68135870 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3b480065d0 con 0x7f3b48002870 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f3b58044510 con 0x7f3b68135870 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1360054551 0 0) 0x7f3b480065d0 con 0x7f3b48002870 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient(hunting): my global_id is 4403 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b6809f930 con 0x7f3b48002870 2024-04-25T23:55:21.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b6d97a640 10 monclient: get_auth_request con 0x7f3b4c037850 auth_method 0 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2968110335 0 0) 0x7f3b6809f930 con 0x7f3b48002870 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b480065d0 con 0x7f3b48002870 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b640040f0 con 0x7f3b48002870 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: dump: 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.368 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 934680340 0 0) 0x7f3b480065d0 con 0x7f3b48002870 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b4800a160 con 0x7f3b48002870 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3b64006540 con 0x7f3b48002870 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.106:6790/0 conn(0x7f3b48002870 legacy=0x7f3b48004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.368+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.106:6790/0 conn(0x7f3b48002870 legacy=0x7f3b48004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3b48009e50 con 0x7f3b48009110 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4109517640 0 0) 0x7f3b48009e50 con 0x7f3b48009110 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient(hunting): my global_id is 4412 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b480065d0 con 0x7f3b48009110 2024-04-25T23:55:21.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3786314624 0 0) 0x7f3b480065d0 con 0x7f3b48009110 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b48009e50 con 0x7f3b48009110 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b64004b80 con 0x7f3b48009110 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient: dump: 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.372 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1722965848 0 0) 0x7f3b48009e50 con 0x7f3b48009110 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b4800c3e0 con 0x7f3b48009110 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7690 (unknown 0 0 3729103960) 0x7f3b64005f10 con 0x7f3b48009110 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.106:6790/0 conn(0x7f3b48009110 legacy=0x7f3b480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b5dffb640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.106:6790/0 conn(0x7f3b48009110 legacy=0x7f3b480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 12, 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 39939, 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:21.374 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.375 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:21.376 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.377 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.379 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:21.380 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.381 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:21.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.385 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:21.385 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:21.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.386 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.387 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.390 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.390 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.390 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.390 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.390 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.391 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:21.392 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:21.392 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.392 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.394 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:21.394 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:21.394 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.394 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.394 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.399 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:21.399 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:21.400 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.401 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:21.402 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:21.403 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.404 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.405 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.406 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.407 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:55:21.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.407 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.407 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:21.407 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.171:6812/722422047 conn(0x7f3b4c037850 legacy=0x7f3b4c039d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 10 monclient: shutdown 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 >> v1:172.21.15.106:6792/0 conn(0x7f3b68135870 legacy=0x7f3b68134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6d97a640 1 -- 172.21.15.106:0/1916820178 reap_dead start 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6d97a640 1 -- 172.21.15.106:0/1916820178 reap_dead start 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 shutdown_connections 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 >> 172.21.15.106:0/1916820178 conn(0x7f3b680a64e0 msgr2=0x7f3b680a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 shutdown_connections 2024-04-25T23:55:21.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.376+0000 7f3b6f3dd640 1 -- 172.21.15.106:0/1916820178 wait complete. 2024-04-25T23:55:21.410 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:55:21.410 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon d 2024-04-25T23:55:21.410 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:55:21.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: get_monmap_and_config 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: monmap: 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:21.539335+0000 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:21.539335+0000 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.519 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.519 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.519 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.519 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.519 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 Processor -- start 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- start start 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: init 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: _add_conns ranks=[0,5,2,4,6,3,1,7,8] 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient(hunting): picked mon.noname-a con 0x7fc038135870 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient(hunting): picked mon.noname-h con 0x7fc0381353b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient(hunting): picked mon.noname-b con 0x7fc03813bdf0 addr v1:172.21.15.106:6790/0 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03806f2d0 con 0x7fc038135870 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc038072330 con 0x7fc03813bdf0 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc038072610 con 0x7fc0381353b0 2024-04-25T23:55:21.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient(hunting): authenticate will time out at 977.066403s 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc0377fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc03813bdf0 0x7fc03813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42992/0 (socket says 172.21.15.106:42992) 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc036ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc038135870 0x7fc038135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56222/0 (socket says 172.21.15.106:56222) 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc0377fe640 1 -- 172.21.15.106:0/1823700836 learned_addr learned my addr 172.21.15.106:0/1823700836 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1952976220 0 0) 0x7fc03806f2d0 con 0x7fc038135870 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): my global_id is 4563 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc020003530 con 0x7fc038135870 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910803295 0 0) 0x7fc038072330 con 0x7fc03813bdf0 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient(hunting): my global_id is 4421 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc03806f2d0 con 0x7fc03813bdf0 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1080174950 0 0) 0x7fc020003530 con 0x7fc038135870 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 >> v1:172.21.15.171:6791/0 conn(0x7fc0381353b0 legacy=0x7fc03813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 >> v1:172.21.15.106:6790/0 conn(0x7fc03813bdf0 legacy=0x7fc03813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 monclient: found mon.noname-a 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0380a3260 con 0x7fc038135870 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 5 monclient: authenticate success, global_id 4563 2024-04-25T23:55:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0280017c0 con 0x7fc038135870 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: dump: 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc028001ae0 con 0x7fc038135870 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 4 set_mon_vals no callback set 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 1 -- 172.21.15.106:0/1823700836 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc028004b30 con 0x7fc038135870 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc035ffb640 10 monclient: dump: 2024-04-25T23:55:21.531 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.532 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 10 monclient: shutdown 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- 172.21.15.106:0/1823700836 >> v1:172.21.15.106:6789/0 conn(0x7fc038135870 legacy=0x7fc038135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- 172.21.15.106:0/1823700836 shutdown_connections 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- 172.21.15.106:0/1823700836 >> 172.21.15.106:0/1823700836 conn(0x7fc0380a64e0 msgr2=0x7fc0380a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- 172.21.15.106:0/1823700836 shutdown_connections 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.536+0000 7fc03d547640 1 -- 172.21.15.106:0/1823700836 wait complete. 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: monmap: 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.534 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 Processor -- start 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 -- start start 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: init 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: _add_conns ranks=[5,8,4,1,3,6,7,0,2] 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient(hunting): picked mon.noname-h con 0x7fc0381353b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient(hunting): picked mon.noname-e con 0x7fc038135870 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient(hunting): picked mon.noname-c con 0x7fc03813bdf0 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc038134840 con 0x7fc03813bdf0 2024-04-25T23:55:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03809f470 con 0x7fc0381353b0 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc03809f930 con 0x7fc038135870 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient(hunting): authenticate will time out at 977.069215s 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc0367fc640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fc038135870 legacy=0x7fc038134130 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc0377fe640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fc03813bdf0 legacy=0x7fc0381d49e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc036ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc0381353b0 0x7fc038133a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:34216/0 (socket says 172.21.15.106:34216) 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc036ffd640 1 -- 172.21.15.106:0/3186638528 learned_addr learned my addr 172.21.15.106:0/3186638528 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1969044158 0 0) 0x7fc03809f470 con 0x7fc0381353b0 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): my global_id is 4559 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc024003530 con 0x7fc0381353b0 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2271664800 0 0) 0x7fc024003530 con 0x7fc0381353b0 2024-04-25T23:55:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc03809f470 con 0x7fc0381353b0 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc028001780 con 0x7fc0381353b0 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): dump: 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1730923571 0 0) 0x7fc03809f470 con 0x7fc0381353b0 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.106:6793/0 conn(0x7fc038135870 legacy=0x7fc038134130 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.106:6791/0 conn(0x7fc03813bdf0 legacy=0x7fc0381d49e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 monclient: found mon.h 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:21.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc03806fd90 con 0x7fc0381353b0 2024-04-25T23:55:21.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 5 monclient: authenticate success, global_id 4559 2024-04-25T23:55:21.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: _renew_subs 2024-04-25T23:55:21.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc038135030 con 0x7fc0381353b0 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: _renew_subs 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc03809dc30 con 0x7fc0381353b0 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc028001ae0 con 0x7fc0381353b0 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc0357fa640 4 set_mon_vals no callback set 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc028001d10 con 0x7fc0381353b0 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc01f7fe640 10 monclient: dump: 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.540+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc0180065d0 con 0x7fc018002870 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1406042264 0 0) 0x7fc0180065d0 con 0x7fc018002870 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient(hunting): my global_id is 4551 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc03809f470 con 0x7fc018002870 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1010234782 0 0) 0x7fc03809f470 con 0x7fc018002870 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0180065d0 con 0x7fc018002870 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc02c001850 con 0x7fc018002870 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient: dump: 2024-04-25T23:55:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc028010030 con 0x7fc0381353b0 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fc028044650 con 0x7fc0381353b0 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2736396159 0 0) 0x7fc0180065d0 con 0x7fc018002870 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc01800a160 con 0x7fc018002870 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc0377fe640 10 monclient: get_auth_request con 0x7fc024037d60 auth_method 0 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc02c0057d0 con 0x7fc018002870 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:21.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.106:6792/0 conn(0x7fc018002870 legacy=0x7fc018004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.544+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.106:6792/0 conn(0x7fc018002870 legacy=0x7fc018004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc03d547640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:21.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc018009e60 con 0x7fc018009120 2024-04-25T23:55:21.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1977812858 0 0) 0x7fc018009e60 con 0x7fc018009120 2024-04-25T23:55:21.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient(hunting): my global_id is 4560 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0180065d0 con 0x7fc018009120 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1685094668 0 0) 0x7fc0180065d0 con 0x7fc018009120 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc018009e60 con 0x7fc018009120 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc02c003bf0 con 0x7fc018009120 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient: dump: 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 361903790 0 0) 0x7fc018009e60 con 0x7fc018009120 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc01800c3e0 con 0x7fc018009120 2024-04-25T23:55:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7690 (unknown 0 0 128617521) 0x7fc02c005980 con 0x7fc018009120 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.106:6792/0 conn(0x7fc018009120 legacy=0x7fc0180095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.548+0000 7fc01f7fe640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.106:6792/0 conn(0x7fc018009120 legacy=0x7fc0180095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 12, 2024-04-25T23:55:21.550 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 40087, 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.551 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.552 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:21.553 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:21.554 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.555 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:21.556 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:21.557 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:21.560 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.561 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.563 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.564 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:21.566 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.567 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.568 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.568 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.568 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.568 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:21.568 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:21.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:21.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:21.570 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.171:6812/722422047 conn(0x7fc024037d60 legacy=0x7fc02403a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 10 monclient: shutdown 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 >> v1:172.21.15.171:6791/0 conn(0x7fc0381353b0 legacy=0x7fc038133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc0377fe640 1 -- 172.21.15.106:0/3186638528 reap_dead start 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc0377fe640 1 -- 172.21.15.106:0/3186638528 reap_dead start 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 shutdown_connections 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 >> 172.21.15.106:0/3186638528 conn(0x7fc0380a64e0 msgr2=0x7fc0380a2180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 shutdown_connections 2024-04-25T23:55:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.552+0000 7fc03d547640 1 -- 172.21.15.106:0/3186638528 wait complete. 2024-04-25T23:55:21.573 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:55:21.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2024-04-25T23:55:21.573 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: get_monmap_and_config 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: monmap: 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:21.714763+0000 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:21.714763+0000 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.693 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.694 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 Processor -- start 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- start start 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: init 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: _add_conns ranks=[8,6,5,0,3,1,4,2,7] 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient(hunting): picked mon.noname-e con 0x7f8280134760 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient(hunting): picked mon.noname-d con 0x7f82800a0d70 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:21.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient(hunting): picked mon.noname-h con 0x7f828013df70 addr v1:172.21.15.171:6791/0 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828006b910 con 0x7f828013df70 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827e59c640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8280134760 legacy=0x7f8280134b40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f828009fac0 con 0x7f82800a0d70 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82800a0080 con 0x7f8280134760 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient(hunting): authenticate will time out at 977.242020s 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8275d9b640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f82800a0d70 0x7f828013c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:56624/0 (socket says 172.21.15.106:56624) 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8275d9b640 1 -- 172.21.15.106:0/2603724308 learned_addr learned my addr 172.21.15.106:0/2603724308 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3534579979 0 0) 0x7f828009fac0 con 0x7f82800a0d70 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient(hunting): my global_id is 4569 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f826c003530 con 0x7f82800a0d70 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3006626528 0 0) 0x7f826c003530 con 0x7f82800a0d70 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 >> v1:172.21.15.106:6793/0 conn(0x7f8280134760 legacy=0x7f8280134b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 >> v1:172.21.15.171:6791/0 conn(0x7f828013df70 legacy=0x7f8280140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 monclient: found mon.noname-d 2024-04-25T23:55:21.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f828009f280 con 0x7f82800a0d70 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f82700017c0 con 0x7f82800a0d70 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: dump: 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.701 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 5 monclient: authenticate success, global_id 4569 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8270001b20 con 0x7f82800a0d70 2024-04-25T23:55:21.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 1 -- 172.21.15.106:0/2603724308 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8270001d50 con 0x7f82800a0d70 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f827dd9b640 10 monclient: dump: 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.703 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 4 set_mon_vals no callback set 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: shutdown 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- 172.21.15.106:0/2603724308 >> v1:172.21.15.106:6792/0 conn(0x7f82800a0d70 legacy=0x7f828013c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- 172.21.15.106:0/2603724308 shutdown_connections 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- 172.21.15.106:0/2603724308 >> 172.21.15.106:0/2603724308 conn(0x7f82800a7240 msgr2=0x7f82800a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- 172.21.15.106:0/2603724308 shutdown_connections 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 1 -- 172.21.15.106:0/2603724308 wait complete. 2024-04-25T23:55:21.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.712+0000 7f8284903640 10 monclient: monmap: 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 Processor -- start 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 -- start start 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient: init 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient: _add_conns ranks=[4,3,8,7,6,5,2,0,1] 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient(hunting): picked mon.noname-c con 0x7f82800a0d70 addr v1:172.21.15.106:6791/0 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient(hunting): picked mon.noname-g con 0x7f8280134760 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient(hunting): picked mon.noname-e con 0x7f828013df70 addr v1:172.21.15.106:6793/0 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8280072930 con 0x7f8280134760 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f827e59c640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f82800a0d70 legacy=0x7f8280135780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8280139410 con 0x7f82800a0d70 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82801396f0 con 0x7f828013df70 2024-04-25T23:55:21.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient(hunting): authenticate will time out at 977.244812s 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f827ed9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f828013df70 legacy=0x7f82801365a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8275d9b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f8280134760 0x7f8280135e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:54214/0 (socket says 172.21.15.106:54214) 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8275d9b640 1 -- 172.21.15.106:0/209007516 learned_addr learned my addr 172.21.15.106:0/209007516 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177324368 0 0) 0x7f828009f280 con 0x7f8280134760 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): my global_id is 4512 2024-04-25T23:55:21.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8260003530 con 0x7f8280134760 2024-04-25T23:55:21.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2587200143 0 0) 0x7f8260003530 con 0x7f8280134760 2024-04-25T23:55:21.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f828009f280 con 0x7f8280134760 2024-04-25T23:55:21.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8270001780 con 0x7f8280134760 2024-04-25T23:55:21.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:21.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:55:21.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): dump: 2024-04-25T23:55:21.712 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.713 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4277956138 0 0) 0x7f828009f280 con 0x7f8280134760 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.106:6793/0 conn(0x7f828013df70 legacy=0x7f82801365a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.106:6791/0 conn(0x7f82800a0d70 legacy=0x7f8280135780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 monclient: found mon.g 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8280072500 con 0x7f8280134760 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 5 monclient: authenticate success, global_id 4512 2024-04-25T23:55:21.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient: _renew_subs 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8280137400 con 0x7f8280134760 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient: _renew_subs 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f828013d190 con 0x7f8280134760 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8270001b20 con 0x7f8280134760 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f827d59a640 4 set_mon_vals no callback set 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8270001130 con 0x7f8280134760 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f82777fe640 10 monclient: dump: 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.715 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.716+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f82640065d0 con 0x7f8264002870 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f827000ff50 con 0x7f8280134760 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f8270044510 con 0x7f8280134760 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654490415 0 0) 0x7f82640065d0 con 0x7f8264002870 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient(hunting): my global_id is 4521 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f828009f280 con 0x7f8264002870 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f827ed9d640 10 monclient: get_auth_request con 0x7f82600377a0 auth_method 0 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4189680639 0 0) 0x7f828009f280 con 0x7f8264002870 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82640065d0 con 0x7f8264002870 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8268004110 con 0x7f8264002870 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient: dump: 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.718 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1326634502 0 0) 0x7f82640065d0 con 0x7f8264002870 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f826400a160 con 0x7f8264002870 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8268006560 con 0x7f8264002870 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.171:6790/0 conn(0x7f8264002870 legacy=0x7f8264004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.720+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.171:6790/0 conn(0x7f8264002870 legacy=0x7f8264004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8264009e50 con 0x7f8264009110 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015126918 0 0) 0x7f8264009e50 con 0x7f8264009110 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient(hunting): my global_id is 4530 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82640065d0 con 0x7f8264009110 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1190824313 0 0) 0x7f82640065d0 con 0x7f8264009110 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8264009e50 con 0x7f8264009110 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8268004ba0 con 0x7f8264009110 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient: dump: 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.720 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 939694363 0 0) 0x7f8264009e50 con 0x7f8264009110 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f826400c3e0 con 0x7f8264009110 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7690 (unknown 0 0 2030084384) 0x7f8268005ff0 con 0x7f8264009110 2024-04-25T23:55:21.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.171:6790/0 conn(0x7f8264009110 legacy=0x7f82640095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f82777fe640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.171:6790/0 conn(0x7f8264009110 legacy=0x7f82640095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 12, 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 40251, 2024-04-25T23:55:21.722 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.723 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.724 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:21.725 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.726 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:21.727 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.729 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.730 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.731 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:21.732 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:21.737 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.739 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:21.740 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.171:6812/722422047 conn(0x7f82600377a0 legacy=0x7f8260039c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 10 monclient: shutdown 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 >> v1:172.21.15.171:6790/0 conn(0x7f8280134760 legacy=0x7f8280135e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f827ed9d640 1 -- 172.21.15.106:0/209007516 reap_dead start 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f827ed9d640 1 -- 172.21.15.106:0/209007516 reap_dead start 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 shutdown_connections 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 >> 172.21.15.106:0/209007516 conn(0x7f82800a7240 msgr2=0x7f82800a31b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 shutdown_connections 2024-04-25T23:55:21.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.728+0000 7f8284903640 1 -- 172.21.15.106:0/209007516 wait complete. 2024-04-25T23:55:21.743 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:55:21.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-04-25T23:55:21.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:55:21.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: get_monmap_and_config 2024-04-25T23:55:21.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: monmap: 2024-04-25T23:55:21.857 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.857 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.857 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:55:21.878987+0000 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:55:21.878987+0000 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.858 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 Processor -- start 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- start start 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: init 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: _add_conns ranks=[0,6,3,4,8,1,5,7,2] 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient(hunting): picked mon.noname-a con 0x7f6b600a5070 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient(hunting): picked mon.noname-d con 0x7f6b60072710 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient(hunting): picked mon.noname-g con 0x7f6b60072b70 addr v1:172.21.15.171:6790/0 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b60137d60 con 0x7f6b600a5070 2024-04-25T23:55:21.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6006cf90 con 0x7f6b60072b70 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6006e240 con 0x7f6b60072710 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient(hunting): authenticate will time out at 977.406069s 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5e59c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6b60072710 0x7f6b6013c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:56632/0 (socket says 172.21.15.106:56632) 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5e59c640 1 -- 172.21.15.106:0/2284834115 learned_addr learned my addr 172.21.15.106:0/2284834115 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2094383497 0 0) 0x7f6b6006e240 con 0x7f6b60072710 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): my global_id is 4578 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b48003530 con 0x7f6b60072710 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220742478 0 0) 0x7f6b60137d60 con 0x7f6b600a5070 2024-04-25T23:55:21.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient(hunting): my global_id is 4572 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b6006e240 con 0x7f6b600a5070 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1265821510 0 0) 0x7f6b48003530 con 0x7f6b60072710 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 >> v1:172.21.15.171:6790/0 conn(0x7f6b60072b70 legacy=0x7f6b601400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 >> v1:172.21.15.106:6789/0 conn(0x7f6b600a5070 legacy=0x7f6b60137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 monclient: found mon.noname-d 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b60070560 con 0x7f6b60072710 2024-04-25T23:55:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b500017c0 con 0x7f6b60072710 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: dump: 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 5 monclient: authenticate success, global_id 4578 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b50001a20 con 0x7f6b60072710 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: get_monmap_and_config success 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 4 set_mon_vals no callback set 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 1 -- 172.21.15.106:0/2284834115 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b50004bf0 con 0x7f6b60072710 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b5dd9b640 10 monclient: dump: 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.871 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 10 monclient: shutdown 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- 172.21.15.106:0/2284834115 >> v1:172.21.15.106:6792/0 conn(0x7f6b60072710 legacy=0x7f6b6013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- 172.21.15.106:0/2284834115 shutdown_connections 2024-04-25T23:55:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- 172.21.15.106:0/2284834115 >> 172.21.15.106:0/2284834115 conn(0x7f6b600a83a0 msgr2=0x7f6b600a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- 172.21.15.106:0/2284834115 shutdown_connections 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.876+0000 7f6b6510c640 1 -- 172.21.15.106:0/2284834115 wait complete. 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: build_initial_monmap 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: monmap: 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:55:21.873 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 Processor -- start 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 -- start start 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: init 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: _reopen_session rank -1 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: _add_conns ranks=[6,0,1,2,5,8,3,4,7] 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient(hunting): picked mon.noname-d con 0x7f6b60072710 addr v1:172.21.15.106:6792/0 2024-04-25T23:55:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient(hunting): picked mon.noname-a con 0x7f6b60072b70 addr v1:172.21.15.106:6789/0 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient(hunting): picked mon.noname-f con 0x7f6b600a5070 addr v1:172.21.15.171:6789/0 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6006d9f0 con 0x7f6b60072b70 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b60130960 con 0x7f6b600a5070 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b6006d4c0 con 0x7f6b60072710 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient(hunting): _renew_subs 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient(hunting): authenticate will time out at 977.409005s 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b5ed9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6b60072710 0x7f6b6012fb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:56634/0 (socket says 172.21.15.106:56634) 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b5ed9d640 1 -- 172.21.15.106:0/676715178 learned_addr learned my addr 172.21.15.106:0/676715178 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b5f59e640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.171:6789/0 conn(0x7f6b600a5070 legacy=0x7f6b601d4d10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3709397583 0 0) 0x7f6b6006d9f0 con 0x7f6b60072b70 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): my global_id is 4581 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b4c003530 con 0x7f6b60072b70 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3147130472 0 0) 0x7f6b6006d4c0 con 0x7f6b60072710 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): my global_id is 4587 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b6006d9f0 con 0x7f6b60072710 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 140018125 0 0) 0x7f6b6006d9f0 con 0x7f6b60072710 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b6006d4c0 con 0x7f6b60072710 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1166970727 0 0) 0x7f6b4c003530 con 0x7f6b60072b70 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b6006d9f0 con 0x7f6b60072b70 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b54001980 con 0x7f6b60072710 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): dump: 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b500016c0 con 0x7f6b60072b70 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): dump: 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 96593602 0 0) 0x7f6b6006d9f0 con 0x7f6b60072b70 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.106:6792/0 conn(0x7f6b60072710 legacy=0x7f6b6012fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.171:6789/0 conn(0x7f6b600a5070 legacy=0x7f6b601d4d10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: _finish_hunting 0 2024-04-25T23:55:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 monclient: found mon.a 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b60132a20 con 0x7f6b60072b70 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: _finish_auth 0 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: _check_auth_tickets 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 5 monclient: authenticate success, global_id 4581 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: _renew_subs 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b601310f0 con 0x7f6b60072b70 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: _renew_subs 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:55:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b60131570 con 0x7f6b60072b70 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6b60075890 con 0x7f6b60135dc0 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b500011d0 con 0x7f6b60072b70 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b50004b50 con 0x7f6b60072b70 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient: dump: 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b5d59a640 4 set_mon_vals no callback set 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6b500018a0 con 0x7f6b60072b70 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7f6b500442b0 con 0x7f6b60072b70 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2589495071 0 0) 0x7f6b60075890 con 0x7f6b60135dc0 2024-04-25T23:55:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 10 monclient(hunting): my global_id is 4577 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b6006d9f0 con 0x7f6b60135dc0 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b5f59e640 10 monclient: get_auth_request con 0x7f6b4c037d30 auth_method 0 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.880+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4093718806 0 0) 0x7f6b6006d9f0 con 0x7f6b60135dc0 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b60075890 con 0x7f6b60135dc0 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b54003c90 con 0x7f6b60135dc0 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 10 monclient: dump: 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2529086756 0 0) 0x7f6b60075890 con 0x7f6b60135dc0 2024-04-25T23:55:21.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b60062e50 con 0x7f6b60135dc0 2024-04-25T23:55:21.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6b54004090 con 0x7f6b60135dc0 2024-04-25T23:55:21.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:55:21.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:55:21.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.171:6791/0 conn(0x7f6b60135dc0 legacy=0x7f6b601361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.884+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.171:6791/0 conn(0x7f6b60135dc0 legacy=0x7f6b601361a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b6510c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:55:21.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6b601375e0 con 0x7f6b6002d010 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995811131 0 0) 0x7f6b601375e0 con 0x7f6b6002d010 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b477fe640 10 monclient(hunting): my global_id is 4586 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.888+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b60075890 con 0x7f6b6002d010 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3860761117 0 0) 0x7f6b60075890 con 0x7f6b6002d010 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b601375e0 con 0x7f6b6002d010 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b54005b10 con 0x7f6b6002d010 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 10 monclient: dump: 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:55:21.887 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:55:21.888 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2277420505 0 0) 0x7f6b601375e0 con 0x7f6b6002d010 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6b600008e0 con 0x7f6b6002d010 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7690 (unknown 0 0 2162832426) 0x7f6b54007e20 con 0x7f6b6002d010 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.171:6791/0 conn(0x7f6b6002d010 legacy=0x7f6b601368b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b477fe640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.171:6791/0 conn(0x7f6b6002d010 legacy=0x7f6b601368b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:55:21.889 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 12, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 40391, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:55:21.890 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.891 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:55:21.893 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:55:21.894 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:55:21.896 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.899 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.900 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.901 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:55:21.903 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.905 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:55:21.906 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:55:21.907 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:55:21.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:55:21.908 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:55:21.908 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:55:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.171:6812/722422047 conn(0x7f6b4c037d30 legacy=0x7f6b4c03a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 10 monclient: shutdown 2024-04-25T23:55:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:55:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 >> v1:172.21.15.106:6789/0 conn(0x7f6b60072b70 legacy=0x7f6b60130250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:55:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b5f59e640 1 -- 172.21.15.106:0/676715178 reap_dead start 2024-04-25T23:55:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b5f59e640 1 -- 172.21.15.106:0/676715178 reap_dead start 2024-04-25T23:55:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 shutdown_connections 2024-04-25T23:55:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 >> 172.21.15.106:0/676715178 conn(0x7f6b600a83a0 msgr2=0x7f6b600a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:55:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 shutdown_connections 2024-04-25T23:55:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:55:21.892+0000 7f6b6510c640 1 -- 172.21.15.106:0/676715178 wait complete. 2024-04-25T23:55:21.910 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:55:21.910 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-25T23:56:13.240 INFO:tasks.workunit.client.0.smithi171.stderr:Note: switching to 'b22e2ebdeb24376882b7bda2a7329c8cccc2276a'. 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: git switch -c 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr:Or undo this operation with: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: git switch - 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:13.241 INFO:tasks.workunit.client.0.smithi171.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T23:56:13.242 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:13.242 INFO:tasks.workunit.client.0.smithi171.stderr:HEAD is now at b22e2ebdeb2 Merge pull request #57078 from adk3798/squid-cephadm-no-downgrade 2024-04-25T23:56:13.244 DEBUG:teuthology.orchestra.run.smithi171:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T23:56:13.250 INFO:tasks.workunit.client.0.smithi171.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T23:56:13.254 INFO:tasks.workunit.client.0.smithi171.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T23:56:13.254 INFO:tasks.workunit.client.0.smithi171.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T23:56:14.034 INFO:tasks.workunit.client.0.smithi171.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T23:56:14.117 INFO:tasks.workunit.client.0.smithi171.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T23:56:14.166 INFO:tasks.workunit.client.0.smithi171.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T23:56:14.167 INFO:tasks.workunit.client.0.smithi171.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T23:56:14.167 INFO:tasks.workunit.client.0.smithi171.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T23:56:14.213 INFO:tasks.workunit.client.0.smithi171.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T23:56:14.217 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-04-25T23:56:14.217 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T23:56:14.263 INFO:tasks.workunit:Running workunits matching mon/pool_ops.sh on client.0... 2024-04-25T23:56:14.264 INFO:tasks.workunit:Running workunit mon/pool_ops.sh... 2024-04-25T23:56:14.264 DEBUG:teuthology.orchestra.run.smithi171:workunit test mon/pool_ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/pool_ops.sh 2024-04-25T23:56:14.314 INFO:tasks.workunit.client.0.smithi171.stderr:+ TEST_POOL=testpool1234 2024-04-25T23:56:14.314 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create testpool1234 8 --autoscale-mode off 2024-04-25T23:56:14.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.443+0000 7fde17a85640 10 monclient: get_monmap_and_config 2024-04-25T23:56:14.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.443+0000 7fde17a85640 10 monclient: build_initial_monmap 2024-04-25T23:56:14.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.443+0000 7fde17a85640 10 monclient: monmap: 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:14.449296+0000 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:14.449296+0000 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:14.430 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:14.431 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:14.431 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.443+0000 7fde17a85640 1 Processor -- start 2024-04-25T23:56:14.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.443+0000 7fde17a85640 1 -- start start 2024-04-25T23:56:14.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.443+0000 7fde17a85640 10 monclient: init 2024-04-25T23:56:14.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:14.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient: _add_conns ranks=[2,4,1,5,6,0,3,8,7] 2024-04-25T23:56:14.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient(hunting): picked mon.noname-b con 0x7fde10137960 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient(hunting): picked mon.noname-c con 0x7fde100a4220 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient(hunting): picked mon.noname-f con 0x7fde10138450 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde100a48c0 con 0x7fde10138450 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde100a2f70 con 0x7fde10137960 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde100a0d00 con 0x7fde100a4220 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient(hunting): authenticate will time out at 1025.156616s 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde16022640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fde10138450 legacy=0x7fde101405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde15020640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fde100a4220 legacy=0x7fde1013ce90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde15821640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fde10137960 0x7fde10137d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:44730/0 (socket says 172.21.15.171:44730) 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde15821640 1 -- 172.21.15.171:0/4014169234 learned_addr learned my addr 172.21.15.171:0/4014169234 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1018058256 0 0) 0x7fde100a2f70 con 0x7fde10137960 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient(hunting): _negotiate 2024-04-25T23:56:14.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient(hunting): my global_id is 4430 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddfc003530 con 0x7fde10137960 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3338036125 0 0) 0x7fddfc003530 con 0x7fde10137960 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 >> v1:172.21.15.106:6791/0 conn(0x7fde100a4220 legacy=0x7fde1013ce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 >> v1:172.21.15.171:6789/0 conn(0x7fde10138450 legacy=0x7fde101405c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: _finish_hunting 0 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 monclient: found mon.noname-b 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde100a29b0 con 0x7fde10137960 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: _finish_auth 0 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: _check_auth_tickets 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:14.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde0c0017c0 con 0x7fde10137960 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 5 monclient: authenticate success, global_id 4430 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: dump: 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.441 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde0c001ab0 con 0x7fde10137960 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 1 -- 172.21.15.171:0/4014169234 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde0c004bf0 con 0x7fde10137960 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 4 set_mon_vals no callback set 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde1481f640 10 monclient: dump: 2024-04-25T23:56:14.442 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.443 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient: shutdown 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- 172.21.15.171:0/4014169234 >> v1:172.21.15.106:6790/0 conn(0x7fde10137960 legacy=0x7fde10137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- 172.21.15.171:0/4014169234 shutdown_connections 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- 172.21.15.171:0/4014169234 >> 172.21.15.171:0/4014169234 conn(0x7fde100a9fc0 msgr2=0x7fde100aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- 172.21.15.171:0/4014169234 shutdown_connections 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 -- 172.21.15.171:0/4014169234 wait complete. 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient: build_initial_monmap 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 10 monclient: monmap: 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.444 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.447+0000 7fde17a85640 1 Processor -- start 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 1 -- start start 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: init 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _add_conns ranks=[3,7,2,5,6,8,4,0,1] 2024-04-25T23:56:14.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient(hunting): picked mon.noname-g con 0x7fde100a4220 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient(hunting): picked mon.noname-i con 0x7fde10138450 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient(hunting): picked mon.noname-b con 0x7fde10137270 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde100a1f50 con 0x7fde10137270 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde10124520 con 0x7fde100a4220 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde100a0fa0 con 0x7fde10138450 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient(hunting): authenticate will time out at 1025.160592s 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde15020640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fde10138450 legacy=0x7fde101d11c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde15821640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fde100a4220 0x7fde10136b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42048/0 (socket says 172.21.15.171:42048) 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde15821640 1 -- 172.21.15.171:0/766903255 learned_addr learned my addr 172.21.15.171:0/766903255 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3558477860 0 0) 0x7fde10124520 con 0x7fde100a4220 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:14.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): my global_id is 4548 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf4003530 con 0x7fde100a4220 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 370243607 0 0) 0x7fddf4003530 con 0x7fde100a4220 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde10124520 con 0x7fde100a4220 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde0c001780 con 0x7fde100a4220 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): dump: 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.447 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814312433 0 0) 0x7fde08003dd0 con 0x7fde10137270 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient(hunting): my global_id is 4439 2024-04-25T23:56:14.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddf4003530 con 0x7fde10137270 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2939369901 0 0) 0x7fde10124520 con 0x7fde100a4220 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 >> v1:172.21.15.171:6792/0 conn(0x7fde10138450 legacy=0x7fde101d11c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 >> v1:172.21.15.106:6790/0 conn(0x7fde10137270 legacy=0x7fde101d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 monclient: found mon.g 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde10122230 con 0x7fde100a4220 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 5 monclient: authenticate success, global_id 4548 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _renew_subs 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:14.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde10124240 con 0x7fde100a4220 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _renew_subs 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fde101cc0a0 con 0x7fde100a4220 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde0c001ab0 con 0x7fde100a4220 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde0c001ce0 con 0x7fde100a4220 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde07fff640 4 set_mon_vals no callback set 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 10 monclient: dump: 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.450 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:14.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddf8005090 con 0x7fde100a4220 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fde0c0100f0 con 0x7fde100a4220 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(15..15 src has 1..15) ==== 3506+0+0 (unknown 3467304809 0 0) 0x7fde0c044710 con 0x7fde100a4220 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.451+0000 7fde15020640 10 monclient: get_auth_request con 0x7fddf4037800 auth_method 0 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.455+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fde0c015a30 con 0x7fde100a4220 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.455+0000 7fde067fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:14.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.455+0000 7fde067fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:14.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.607+0000 7fde17a85640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}] 2024-04-25T23:56:14.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.607+0000 7fde17a85640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}] 2024-04-25T23:56:14.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.607+0000 7fde17a85640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:14.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.607+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"} v 0) -- 0x7fddf8005380 con 0x7fde100a4220 2024-04-25T23:56:14.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.663+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}]=0 pool 'testpool1234' created v16) ==== 152+0+0 (unknown 3280004674 0 0) 0x7fde0c01dee0 con 0x7fde100a4220 2024-04-25T23:56:14.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.663+0000 7fde067fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}] 2024-04-25T23:56:14.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.663+0000 7fde067fc640 10 monclient: _finish_command 2 = system:0 pool 'testpool1234' created 2024-04-25T23:56:14.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.759+0000 7fde17a85640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}] 2024-04-25T23:56:14.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.759+0000 7fde17a85640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}] 2024-04-25T23:56:14.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.759+0000 7fde17a85640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:14.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.759+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"} v 0) -- 0x7fddf8001150 con 0x7fde100a4220 2024-04-25T23:56:14.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.759+0000 7fde067fc640 1 -- 172.21.15.171:0/766903255 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}]=0 pool 'testpool1234' already exists v16) ==== 159+0+0 (unknown 39399137 0 0) 0x7fde0c013700 con 0x7fde100a4220 2024-04-25T23:56:14.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.759+0000 7fde067fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "testpool1234", "pg_num": 8, "autoscale_mode": "off"}] 2024-04-25T23:56:14.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.759+0000 7fde067fc640 10 monclient: _finish_command 3 = system:0 pool 'testpool1234' already exists 2024-04-25T23:56:14.745 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'testpool1234' already exists 2024-04-25T23:56:14.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 >> v1:172.21.15.171:6812/722422047 conn(0x7fddf4037800 legacy=0x7fddf4039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 10 monclient: shutdown 2024-04-25T23:56:14.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:14.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 >> v1:172.21.15.171:6790/0 conn(0x7fde100a4220 legacy=0x7fde10136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 shutdown_connections 2024-04-25T23:56:14.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 >> 172.21.15.171:0/766903255 conn(0x7fde100a9fc0 msgr2=0x7fde101bf690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:14.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 shutdown_connections 2024-04-25T23:56:14.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.763+0000 7fde17a85640 1 -- 172.21.15.171:0/766903255 wait complete. 2024-04-25T23:56:14.762 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num_min 2 2024-04-25T23:56:14.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient: get_monmap_and_config 2024-04-25T23:56:14.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient: build_initial_monmap 2024-04-25T23:56:14.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient: monmap: 2024-04-25T23:56:14.880 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:14.880 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.880 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:14.900014+0000 2024-04-25T23:56:14.880 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:14.900014+0000 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:14.881 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 1 Processor -- start 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 1 -- start start 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient: init 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient: _add_conns ranks=[5,2,0,7,6,4,3,1,8] 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient(hunting): picked mon.noname-h con 0x7f9d580a38c0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient(hunting): picked mon.noname-b con 0x7f9d580a4ef0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient(hunting): picked mon.noname-a con 0x7f9d580a52d0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d580a28a0 con 0x7f9d580a52d0 2024-04-25T23:56:14.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d580a3ca0 con 0x7f9d580a4ef0 2024-04-25T23:56:14.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d580a40f0 con 0x7f9d580a38c0 2024-04-25T23:56:14.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:14.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5f21f640 10 monclient(hunting): authenticate will time out at 1025.607710s 2024-04-25T23:56:14.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5cfbb640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f9d580a38c0 0x7f9d580a47e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59824/0 (socket says 172.21.15.171:59824) 2024-04-25T23:56:14.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.895+0000 7f9d5cfbb640 1 -- 172.21.15.171:0/2457779039 learned_addr learned my addr 172.21.15.171:0/2457779039 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790378465 0 0) 0x7f9d580a40f0 con 0x7f9d580a38c0 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient(hunting): my global_id is 4595 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d40003530 con 0x7f9d580a38c0 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3789736257 0 0) 0x7f9d40003530 con 0x7f9d580a38c0 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 >> v1:172.21.15.106:6790/0 conn(0x7f9d580a4ef0 legacy=0x7f9d5813ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 >> v1:172.21.15.106:6789/0 conn(0x7f9d580a52d0 legacy=0x7f9d58140580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 monclient: found mon.noname-h 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d580a42c0 con 0x7f9d580a38c0 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 5 monclient: authenticate success, global_id 4595 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d48001800 con 0x7f9d580a38c0 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: dump: 2024-04-25T23:56:14.888 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.889 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d48001aa0 con 0x7f9d580a38c0 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 4 set_mon_vals no callback set 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 1 -- 172.21.15.171:0/2457779039 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d48004bf0 con 0x7f9d580a38c0 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d577fe640 10 monclient: dump: 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.890 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient: shutdown 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2457779039 >> v1:172.21.15.171:6791/0 conn(0x7f9d580a38c0 legacy=0x7f9d580a47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.891 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2457779039 shutdown_connections 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2457779039 >> 172.21.15.171:0/2457779039 conn(0x7f9d580a9ee0 msgr2=0x7f9d580aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2457779039 shutdown_connections 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2457779039 wait complete. 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient: build_initial_monmap 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient: monmap: 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:14.892 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 Processor -- start 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- start start 2024-04-25T23:56:14.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient: init 2024-04-25T23:56:14.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:14.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient: _add_conns ranks=[2,1,5,7,8,3,0,6,4] 2024-04-25T23:56:14.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient(hunting): picked mon.noname-b con 0x7f9d580a38c0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:14.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient(hunting): picked mon.noname-f con 0x7f9d580a4ef0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:14.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient(hunting): picked mon.noname-h con 0x7f9d580a52d0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:14.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d58132a80 con 0x7f9d580a4ef0 2024-04-25T23:56:14.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d58134b00 con 0x7f9d580a38c0 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d58134de0 con 0x7f9d580a52d0 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d57fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f9d580a4ef0 legacy=0x7f9d581d1dd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5f21f640 10 monclient(hunting): authenticate will time out at 1025.611430s 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5d7bc640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f9d580a52d0 0x7f9d581d5500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59840/0 (socket says 172.21.15.171:59840) 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d5d7bc640 1 -- 172.21.15.171:0/2821179996 learned_addr learned my addr 172.21.15.171:0/2821179996 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1502108190 0 0) 0x7f9d58134de0 con 0x7f9d580a52d0 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d557fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d557fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d557fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d557fa640 10 monclient(hunting): my global_id is 4604 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d44003530 con 0x7f9d580a52d0 2024-04-25T23:56:14.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.899+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3321994259 0 0) 0x7f9d44003530 con 0x7f9d580a52d0 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d58134de0 con 0x7f9d580a52d0 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d50001cc0 con 0x7f9d580a52d0 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): dump: 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.899 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 387921521 0 0) 0x7f9d58134b00 con 0x7f9d580a38c0 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient(hunting): my global_id is 4457 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d44003530 con 0x7f9d580a38c0 2024-04-25T23:56:14.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2135360529 0 0) 0x7f9d58134de0 con 0x7f9d580a52d0 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 >> v1:172.21.15.106:6790/0 conn(0x7f9d580a38c0 legacy=0x7f9d581cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 >> v1:172.21.15.171:6789/0 conn(0x7f9d580a4ef0 legacy=0x7f9d581d1dd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: _finish_hunting 0 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 monclient: found mon.h 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d58133160 con 0x7f9d580a52d0 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: _finish_auth 0 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: _check_auth_tickets 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 5 monclient: authenticate success, global_id 4604 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 10 monclient: _renew_subs 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d58134540 con 0x7f9d580a52d0 2024-04-25T23:56:14.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 10 monclient: _renew_subs 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d58135200 con 0x7f9d580a52d0 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d50003cd0 con 0x7f9d580a52d0 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d50004240 con 0x7f9d580a52d0 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d56ffd640 4 set_mon_vals no callback set 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 10 monclient: dump: 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:14.902 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:14.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d38005090 con 0x7f9d580a52d0 2024-04-25T23:56:14.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9d50004460 con 0x7f9d580a52d0 2024-04-25T23:56:14.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(16..16 src has 1..16) ==== 3857+0+0 (unknown 593768186 0 0) 0x7f9d500448c0 con 0x7f9d580a52d0 2024-04-25T23:56:14.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.903+0000 7f9d5cfbb640 10 monclient: get_auth_request con 0x7f9d44037800 auth_method 0 2024-04-25T23:56:14.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.907+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9d50015b00 con 0x7f9d580a52d0 2024-04-25T23:56:14.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.907+0000 7f9d557fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:14.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:14.907+0000 7f9d557fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:15.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.071+0000 7f9d5f21f640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}] 2024-04-25T23:56:15.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.071+0000 7f9d5f21f640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}] 2024-04-25T23:56:15.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.071+0000 7f9d5f21f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:15.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.071+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"} v 0) -- 0x7f9d38005380 con 0x7f9d580a52d0 2024-04-25T23:56:15.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.667+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}]=0 set pool 3 pg_num_min to 2 v17) ==== 143+0+0 (unknown 1752662139 0 0) 0x7f9d50015200 con 0x7f9d580a52d0 2024-04-25T23:56:15.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.667+0000 7f9d557fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}] 2024-04-25T23:56:15.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.667+0000 7f9d557fa640 10 monclient: _finish_command 2 = system:0 set pool 3 pg_num_min to 2 2024-04-25T23:56:15.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.771+0000 7f9d5f21f640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}] 2024-04-25T23:56:15.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.771+0000 7f9d5f21f640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}] 2024-04-25T23:56:15.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.771+0000 7f9d5f21f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:15.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:15.771+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"} v 0) -- 0x7f9d38000c00 con 0x7f9d580a52d0 2024-04-25T23:56:16.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.687+0000 7f9d557fa640 1 -- 172.21.15.171:0/2821179996 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}]=0 set pool 3 pg_num_min to 2 v18) ==== 143+0+0 (unknown 706762250 0 0) 0x7f9d500197b0 con 0x7f9d580a52d0 2024-04-25T23:56:16.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d557fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "2"}] 2024-04-25T23:56:16.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d557fa640 10 monclient: _finish_command 3 = system:0 set pool 3 pg_num_min to 2 2024-04-25T23:56:16.675 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 3 pg_num_min to 2 2024-04-25T23:56:16.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 >> v1:172.21.15.171:6812/722422047 conn(0x7f9d44037800 legacy=0x7f9d44039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:16.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 10 monclient: shutdown 2024-04-25T23:56:16.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:16.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 >> v1:172.21.15.171:6791/0 conn(0x7f9d580a52d0 legacy=0x7f9d581d5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:16.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 shutdown_connections 2024-04-25T23:56:16.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 >> 172.21.15.171:0/2821179996 conn(0x7f9d580a9ee0 msgr2=0x7f9d5812e940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:16.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 shutdown_connections 2024-04-25T23:56:16.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.691+0000 7f9d5f21f640 1 -- 172.21.15.171:0/2821179996 wait complete. 2024-04-25T23:56:16.696 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool get testpool1234 pg_num_min 2024-04-25T23:56:16.696 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 2 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient: get_monmap_and_config 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient: build_initial_monmap 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient: monmap: 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:16.836771+0000 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:16.836771+0000 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:16.817 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:16.818 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:16.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 1 Processor -- start 2024-04-25T23:56:16.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 1 -- start start 2024-04-25T23:56:16.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient: init 2024-04-25T23:56:16.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:16.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient: _add_conns ranks=[0,6,2,7,3,5,4,8,1] 2024-04-25T23:56:16.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient(hunting): picked mon.noname-a con 0x7f7e380a1530 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:16.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient(hunting): picked mon.noname-d con 0x7f7e38071c00 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient(hunting): picked mon.noname-b con 0x7f7e38071730 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3806ea70 con 0x7f7e380a1530 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e380723d0 con 0x7f7e38071730 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e38072990 con 0x7f7e38071c00 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.831+0000 7f7e3de33640 10 monclient(hunting): authenticate will time out at 1027.543881s 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e37fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7e38071730 0x7f7e3813e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:44772/0 (socket says 172.21.15.171:44772) 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e37fff640 1 -- 172.21.15.171:0/2119637083 learned_addr learned my addr 172.21.15.171:0/2119637083 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591333166 0 0) 0x7f7e380723d0 con 0x7f7e38071730 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:16.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): my global_id is 4466 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e20003530 con 0x7f7e38071730 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586888298 0 0) 0x7f7e3806ea70 con 0x7f7e380a1530 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): my global_id is 4599 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e380723d0 con 0x7f7e380a1530 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590043047 0 0) 0x7f7e38072990 con 0x7f7e38071c00 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient(hunting): my global_id is 4596 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e3806ea70 con 0x7f7e38071c00 2024-04-25T23:56:16.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 174860171 0 0) 0x7f7e20003530 con 0x7f7e38071730 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 >> v1:172.21.15.106:6792/0 conn(0x7f7e38071c00 legacy=0x7f7e3813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 >> v1:172.21.15.106:6789/0 conn(0x7f7e380a1530 legacy=0x7f7e380a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 monclient: found mon.noname-b 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e380a3100 con 0x7f7e38071730 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e30001b40 con 0x7f7e38071730 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: dump: 2024-04-25T23:56:16.825 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:16.826 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 5 monclient: authenticate success, global_id 4466 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e30001e60 con 0x7f7e38071730 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 1 -- 172.21.15.171:0/2119637083 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e30004f70 con 0x7f7e38071730 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 4 set_mon_vals no callback set 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e367fc640 10 monclient: dump: 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:16.827 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 10 monclient: shutdown 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:16.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 1 -- 172.21.15.171:0/2119637083 >> v1:172.21.15.106:6790/0 conn(0x7f7e38071730 legacy=0x7f7e3813e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 1 -- 172.21.15.171:0/2119637083 shutdown_connections 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 1 -- 172.21.15.171:0/2119637083 >> 172.21.15.171:0/2119637083 conn(0x7f7e380a62d0 msgr2=0x7f7e380a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 1 -- 172.21.15.171:0/2119637083 shutdown_connections 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 1 -- 172.21.15.171:0/2119637083 wait complete. 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 10 monclient: build_initial_monmap 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 10 monclient: monmap: 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:16.829 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 1 Processor -- start 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 1 -- start start 2024-04-25T23:56:16.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.835+0000 7f7e3de33640 10 monclient: init 2024-04-25T23:56:16.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:16.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _add_conns ranks=[2,3,4,5,6,1,7,8,0] 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient(hunting): picked mon.noname-b con 0x7f7e38071730 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient(hunting): picked mon.noname-g con 0x7f7e38071c00 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient(hunting): picked mon.noname-c con 0x7f7e380a1530 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3809f660 con 0x7f7e38071730 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3809fb20 con 0x7f7e38071c00 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e3811edc0 con 0x7f7e380a1530 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient(hunting): authenticate will time out at 1027.548333s 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e36ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f7e38071c00 0x7f7e381cf3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42050/0 (socket says 172.21.15.171:42050) 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e36ffd640 1 -- 172.21.15.171:0/1557133627 learned_addr learned my addr 172.21.15.171:0/1557133627 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e37fff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f7e380a1530 legacy=0x7f7e381d2b00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1542324023 0 0) 0x7f7e3809fb20 con 0x7f7e38071c00 2024-04-25T23:56:16.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): my global_id is 4557 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e24003530 con 0x7f7e38071c00 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2176810763 0 0) 0x7f7e24003530 con 0x7f7e38071c00 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e3809fb20 con 0x7f7e38071c00 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223599407 0 0) 0x7f7e3809f660 con 0x7f7e38071730 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): my global_id is 4475 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e24003530 con 0x7f7e38071730 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e2c001a60 con 0x7f7e38071c00 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:16.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): dump: 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:16.836 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3633585629 0 0) 0x7f7e3809fb20 con 0x7f7e38071c00 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 >> v1:172.21.15.106:6791/0 conn(0x7f7e380a1530 legacy=0x7f7e381d2b00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 >> v1:172.21.15.106:6790/0 conn(0x7f7e38071730 legacy=0x7f7e381329e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 monclient: found mon.g 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e3811e920 con 0x7f7e38071c00 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: _finish_auth 0 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:16.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 5 monclient: authenticate success, global_id 4557 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _renew_subs 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7e3811fb00 con 0x7f7e38071c00 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _renew_subs 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7e381c6d90 con 0x7f7e38071c00 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e2c0038d0 con 0x7f7e38071c00 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e2c003dc0 con 0x7f7e38071c00 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e35ffb640 4 set_mon_vals no callback set 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:16.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 10 monclient: dump: 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:16.839 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e18005090 con 0x7f7e38071c00 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7e2c003f60 con 0x7f7e38071c00 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(18..18 src has 1..18) ==== 3873+0+0 (unknown 490725129 0 0) 0x7f7e2c0445f0 con 0x7f7e38071c00 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.839+0000 7f7e377fe640 10 monclient: get_auth_request con 0x7f7e24037920 auth_method 0 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.843+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7e2c015740 con 0x7f7e38071c00 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.843+0000 7f7e1ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:16.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:16.843+0000 7f7e1ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:16.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.007+0000 7f7e3de33640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:16.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.007+0000 7f7e3de33640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:16.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.007+0000 7f7e3de33640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:16.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.007+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"} v 0) -- 0x7f7e18005b90 con 0x7f7e38071c00 2024-04-25T23:56:16.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.007+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}]=0 v18) ==== 105+0+14 (unknown 1992256803 0 3052767636) 0x7f7e2c015040 con 0x7f7e38071c00 2024-04-25T23:56:16.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.007+0000 7f7e1ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:16.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.007+0000 7f7e1ffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:56:17.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.099+0000 7f7e3de33640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:17.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.099+0000 7f7e3de33640 10 monclient: _send_command 3 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:17.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.099+0000 7f7e3de33640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:17.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.099+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"} v 0) -- 0x7f7e180010a0 con 0x7f7e38071c00 2024-04-25T23:56:17.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.099+0000 7f7e1ffff640 1 -- 172.21.15.171:0/1557133627 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}]=0 v18) ==== 105+0+14 (unknown 1992256803 0 3052767636) 0x7f7e2c019390 con 0x7f7e38071c00 2024-04-25T23:56:17.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.099+0000 7f7e1ffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:17.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.099+0000 7f7e1ffff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 >> v1:172.21.15.171:6812/722422047 conn(0x7f7e24037920 legacy=0x7f7e24039de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 10 monclient: shutdown 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 >> v1:172.21.15.171:6790/0 conn(0x7f7e38071c00 legacy=0x7f7e381cf3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 shutdown_connections 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 >> 172.21.15.171:0/1557133627 conn(0x7f7e380a62d0 msgr2=0x7f7e380a4560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 shutdown_connections 2024-04-25T23:56:17.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.103+0000 7f7e3de33640 1 -- 172.21.15.171:0/1557133627 wait complete. 2024-04-25T23:56:17.101 INFO:tasks.workunit.client.0.smithi171.stdout:pg_num_min: 2 2024-04-25T23:56:17.101 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num_max 33 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient: get_monmap_and_config 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient: build_initial_monmap 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient: monmap: 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:17.239773+0000 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:17.239773+0000 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:17.220 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:17.221 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 1 Processor -- start 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 1 -- start start 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient: init 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient: _add_conns ranks=[8,5,4,6,0,7,1,3,2] 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient(hunting): picked mon.noname-e con 0x7f1d80135a00 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient(hunting): picked mon.noname-h con 0x7f1d800a1790 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient(hunting): picked mon.noname-c con 0x7f1d8013c130 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:17.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d800a1d80 con 0x7f1d8013c130 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d80072f70 con 0x7f1d800a1790 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d80072640 con 0x7f1d80135a00 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient(hunting): authenticate will time out at 1027.946836s 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d85c2d640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f1d8013c130 legacy=0x7f1d8013e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d84c2b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f1d800a1790 0x7f1d8013aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59848/0 (socket says 172.21.15.171:59848) 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d8542c640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f1d80135a00 legacy=0x7f1d80135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d84c2b640 1 -- 172.21.15.171:0/4175189328 learned_addr learned my addr 172.21.15.171:0/4175189328 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657997611 0 0) 0x7f1d80072f70 con 0x7f1d800a1790 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient(hunting): my global_id is 4613 2024-04-25T23:56:17.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d68003530 con 0x7f1d800a1790 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2749331402 0 0) 0x7f1d68003530 con 0x7f1d800a1790 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 >> v1:172.21.15.106:6793/0 conn(0x7f1d80135a00 legacy=0x7f1d80135de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 >> v1:172.21.15.106:6791/0 conn(0x7f1d8013c130 legacy=0x7f1d8013e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 monclient: found mon.noname-h 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d80072920 con 0x7f1d800a1790 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: _finish_auth 0 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 5 monclient: authenticate success, global_id 4613 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:17.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d7c0017c0 con 0x7f1d800a1790 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: dump: 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:17.231 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d7c001ab0 con 0x7f1d800a1790 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d77fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.235+0000 7f1d87690640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 4 set_mon_vals no callback set 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d77fff640 1 -- 172.21.15.171:0/4175189328 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d7c004bf0 con 0x7f1d800a1790 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d77fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d77fff640 10 monclient: dump: 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:17.232 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: shutdown 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:17.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- 172.21.15.171:0/4175189328 >> v1:172.21.15.171:6791/0 conn(0x7f1d800a1790 legacy=0x7f1d8013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- 172.21.15.171:0/4175189328 shutdown_connections 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- 172.21.15.171:0/4175189328 >> 172.21.15.171:0/4175189328 conn(0x7f1d800a2690 msgr2=0x7f1d800a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- 172.21.15.171:0/4175189328 shutdown_connections 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- 172.21.15.171:0/4175189328 wait complete. 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: build_initial_monmap 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: monmap: 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:17.234 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 Processor -- start 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- start start 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: init 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: _add_conns ranks=[0,5,6,3,8,7,4,2,1] 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient(hunting): picked mon.noname-a con 0x7f1d80135a00 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient(hunting): picked mon.noname-h con 0x7f1d8013c130 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:17.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient(hunting): picked mon.noname-d con 0x7f1d801d02f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d80139010 con 0x7f1d80135a00 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d8009f6f0 con 0x7f1d8013c130 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d80138bf0 con 0x7f1d801d02f0 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient(hunting): authenticate will time out at 1027.950294s 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d84c2b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f1d8013c130 0x7f1d80133b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59860/0 (socket says 172.21.15.171:59860) 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d84c2b640 1 -- 172.21.15.171:0/256553463 learned_addr learned my addr 172.21.15.171:0/256553463 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515681724 0 0) 0x7f1d80072920 con 0x7f1d8013c130 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): my global_id is 4622 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d6c003530 con 0x7f1d8013c130 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2739559136 0 0) 0x7f1d6c003530 con 0x7f1d8013c130 2024-04-25T23:56:17.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1d80072920 con 0x7f1d8013c130 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d7c001780 con 0x7f1d8013c130 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:17.237 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1078643457 0 0) 0x7f1d78003dd0 con 0x7f1d80135a00 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): my global_id is 4608 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d6c003530 con 0x7f1d80135a00 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910512189 0 0) 0x7f1d80138bf0 con 0x7f1d801d02f0 2024-04-25T23:56:17.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient(hunting): my global_id is 4605 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d78003dd0 con 0x7f1d801d02f0 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3597809473 0 0) 0x7f1d80072920 con 0x7f1d8013c130 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 >> v1:172.21.15.106:6792/0 conn(0x7f1d801d02f0 legacy=0x7f1d801d26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 >> v1:172.21.15.106:6789/0 conn(0x7f1d80135a00 legacy=0x7f1d80133410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 monclient: found mon.h 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d8009fc40 con 0x7f1d8013c130 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:17.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 5 monclient: authenticate success, global_id 4622 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: _renew_subs 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1d80134230 con 0x7f1d8013c130 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: _renew_subs 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1d8013b5b0 con 0x7f1d8013c130 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1d7c001c60 con 0x7f1d8013c130 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1d7c0054f0 con 0x7f1d8013c130 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d75ffb640 10 monclient: dump: 2024-04-25T23:56:17.240 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d777fe640 4 set_mon_vals no callback set 2024-04-25T23:56:17.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.239+0000 7f1d87690640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.243+0000 7f1d87690640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.243+0000 7f1d87690640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.243+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8004f5b0 con 0x7f1d8013c130 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.243+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1d7c010290 con 0x7f1d8013c130 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.243+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(18..18 src has 1..18) ==== 3873+0+0 (unknown 490725129 0 0) 0x7f1d7c044750 con 0x7f1d8013c130 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.243+0000 7f1d8542c640 10 monclient: get_auth_request con 0x7f1d6c037a80 auth_method 0 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.247+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1d8009f6f0 con 0x7f1d8013c130 2024-04-25T23:56:17.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.247+0000 7f1d75ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:17.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.247+0000 7f1d75ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:17.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.399+0000 7f1d87690640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}] 2024-04-25T23:56:17.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.399+0000 7f1d87690640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}] 2024-04-25T23:56:17.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.399+0000 7f1d87690640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:17.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.399+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"} v 0) -- 0x7f1d8006bcd0 con 0x7f1d8013c130 2024-04-25T23:56:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.699+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}]=0 set pool 3 pg_num_max to 33 v19) ==== 145+0+0 (unknown 3029085635 0 0) 0x7f1d7c015a20 con 0x7f1d8013c130 2024-04-25T23:56:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.699+0000 7f1d75ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}] 2024-04-25T23:56:17.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.699+0000 7f1d75ffb640 10 monclient: _finish_command 2 = system:0 set pool 3 pg_num_max to 33 2024-04-25T23:56:17.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.795+0000 7f1d87690640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}] 2024-04-25T23:56:17.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.795+0000 7f1d87690640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}] 2024-04-25T23:56:17.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.795+0000 7f1d87690640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:17.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:17.795+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"} v 0) -- 0x7f1d801356f0 con 0x7f1d8013c130 2024-04-25T23:56:18.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.711+0000 7f1d75ffb640 1 -- 172.21.15.171:0/256553463 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}]=0 set pool 3 pg_num_max to 33 v20) ==== 145+0+0 (unknown 3426937336 0 0) 0x7f1d7c042470 con 0x7f1d8013c130 2024-04-25T23:56:18.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.711+0000 7f1d75ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "33"}] 2024-04-25T23:56:18.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.711+0000 7f1d75ffb640 10 monclient: _finish_command 3 = system:0 set pool 3 pg_num_max to 33 2024-04-25T23:56:18.696 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 3 pg_num_max to 33 2024-04-25T23:56:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 >> v1:172.21.15.171:6812/722422047 conn(0x7f1d6c037a80 legacy=0x7f1d6c039f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 10 monclient: shutdown 2024-04-25T23:56:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 >> v1:172.21.15.171:6791/0 conn(0x7f1d8013c130 legacy=0x7f1d80133b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 shutdown_connections 2024-04-25T23:56:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 >> 172.21.15.171:0/256553463 conn(0x7f1d800a2690 msgr2=0x7f1d8012f410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 shutdown_connections 2024-04-25T23:56:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.715+0000 7f1d87690640 1 -- 172.21.15.171:0/256553463 wait complete. 2024-04-25T23:56:18.723 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool get testpool1234 pg_num_max 2024-04-25T23:56:18.723 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 33 2024-04-25T23:56:18.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.859+0000 7f09c2e88640 10 monclient: get_monmap_and_config 2024-04-25T23:56:18.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.859+0000 7f09c2e88640 10 monclient: build_initial_monmap 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.859+0000 7f09c2e88640 10 monclient: monmap: 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:18.865353+0000 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:18.865353+0000 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:18.846 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:18.847 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:18.847 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:18.847 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:18.847 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:18.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 Processor -- start 2024-04-25T23:56:18.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- start start 2024-04-25T23:56:18.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: init 2024-04-25T23:56:18.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:18.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: _add_conns ranks=[5,1,6,7,4,8,2,3,0] 2024-04-25T23:56:18.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient(hunting): picked mon.noname-h con 0x7f09bc131680 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient(hunting): picked mon.noname-f con 0x7f09bc0724f0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient(hunting): picked mon.noname-d con 0x7f09bc13b020 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc132170 con 0x7f09bc0724f0 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc09fe30 con 0x7f09bc131680 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc06ffb0 con 0x7f09bc13b020 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient(hunting): authenticate will time out at 1029.572820s 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bbfff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f09bc0724f0 legacy=0x7f09bc139900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c0c24640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f09bc131680 0x7f09bc131a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59870/0 (socket says 172.21.15.171:59870) 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c0c24640 1 -- 172.21.15.171:0/3935874231 learned_addr learned my addr 172.21.15.171:0/3935874231 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3190020196 0 0) 0x7f09bc09fe30 con 0x7f09bc131680 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:18.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient(hunting): my global_id is 4631 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09ac003530 con 0x7f09bc131680 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 456986304 0 0) 0x7f09ac003530 con 0x7f09bc131680 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 >> v1:172.21.15.106:6792/0 conn(0x7f09bc13b020 legacy=0x7f09bc13d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 >> v1:172.21.15.171:6789/0 conn(0x7f09bc0724f0 legacy=0x7f09bc139900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 monclient: found mon.noname-h 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc071270 con 0x7f09bc131680 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09b00017c0 con 0x7f09bc131680 2024-04-25T23:56:18.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: dump: 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:18.856 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 5 monclient: authenticate success, global_id 4631 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09b0001ab0 con 0x7f09bc131680 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 4 set_mon_vals no callback set 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 1 -- 172.21.15.171:0/3935874231 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09b0004bf0 con 0x7f09bc131680 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09bb7fe640 10 monclient: dump: 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:18.857 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:18.858 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: shutdown 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- 172.21.15.171:0/3935874231 >> v1:172.21.15.171:6791/0 conn(0x7f09bc131680 legacy=0x7f09bc131a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- 172.21.15.171:0/3935874231 shutdown_connections 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- 172.21.15.171:0/3935874231 >> 172.21.15.171:0/3935874231 conn(0x7f09bc0a62d0 msgr2=0x7f09bc0a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- 172.21.15.171:0/3935874231 shutdown_connections 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- 172.21.15.171:0/3935874231 wait complete. 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: build_initial_monmap 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: monmap: 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:18.859 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 Processor -- start 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 1 -- start start 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: init 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:18.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient: _add_conns ranks=[7,8,5,4,0,2,3,6,1] 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.863+0000 7f09c2e88640 10 monclient(hunting): picked mon.noname-i con 0x7f09bc0724f0 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient(hunting): picked mon.noname-e con 0x7f09bc131680 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient(hunting): picked mon.noname-h con 0x7f09bc13b020 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c0c24640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f09bc0724f0 legacy=0x7f09bc1395a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc135d70 con 0x7f09bc13b020 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc1350c0 con 0x7f09bc0724f0 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09bc134200 con 0x7f09bc131680 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient(hunting): authenticate will time out at 1029.576112s 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c1425640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f09bc13b020 0x7f09bc1d4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59878/0 (socket says 172.21.15.171:59878) 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09bbfff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f09bc131680 legacy=0x7f09bc1d1610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c1425640 1 -- 172.21.15.171:0/310625741 learned_addr learned my addr 172.21.15.171:0/310625741 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572317975 0 0) 0x7f09bc135d70 con 0x7f09bc13b020 2024-04-25T23:56:18.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): my global_id is 4640 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a0003530 con 0x7f09bc13b020 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2684208471 0 0) 0x7f09a0003530 con 0x7f09bc13b020 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09bc135d70 con 0x7f09bc13b020 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09b4001df0 con 0x7f09bc13b020 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): dump: 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2618639701 0 0) 0x7f09bc135d70 con 0x7f09bc13b020 2024-04-25T23:56:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 >> v1:172.21.15.106:6793/0 conn(0x7f09bc131680 legacy=0x7f09bc1d1610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 >> v1:172.21.15.171:6792/0 conn(0x7f09bc0724f0 legacy=0x7f09bc1395a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: _finish_hunting 0 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 monclient: found mon.h 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09bc0708b0 con 0x7f09bc13b020 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: _finish_auth 0 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: _check_auth_tickets 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 5 monclient: authenticate success, global_id 4640 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient: _renew_subs 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09bc135a90 con 0x7f09bc13b020 2024-04-25T23:56:18.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient: _renew_subs 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f09bc139e80 con 0x7f09bc13b020 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09b4003c50 con 0x7f09bc13b020 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09b40041c0 con 0x7f09bc13b020 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09baffd640 4 set_mon_vals no callback set 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 10 monclient: dump: 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:18.865 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f09b4004360 con 0x7f09bc13b020 2024-04-25T23:56:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f099c005090 con 0x7f09bc13b020 2024-04-25T23:56:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3889+0+0 (unknown 1297018163 0 0) 0x7f09b4044a20 con 0x7f09bc13b020 2024-04-25T23:56:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.867+0000 7f09c0c24640 10 monclient: get_auth_request con 0x7f09a00377e0 auth_method 0 2024-04-25T23:56:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.871+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f09b4015b00 con 0x7f09bc13b020 2024-04-25T23:56:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.871+0000 7f09b97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:18.871+0000 7f09b97fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:19.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.031+0000 7f09c2e88640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:19.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.031+0000 7f09c2e88640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:19.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.031+0000 7f09c2e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.031+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"} v 0) -- 0x7f099c005b90 con 0x7f09bc13b020 2024-04-25T23:56:19.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.035+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}]=0 v20) ==== 105+0+15 (unknown 2967173288 0 2995009362) 0x7f09b40197b0 con 0x7f09bc13b020 2024-04-25T23:56:19.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.035+0000 7f09b97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:19.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.035+0000 7f09b97fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:56:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.131+0000 7f09c2e88640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.131+0000 7f09c2e88640 10 monclient: _send_command 3 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.131+0000 7f09c2e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.131+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"} v 0) -- 0x7f099c0010a0 con 0x7f09bc13b020 2024-04-25T23:56:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.131+0000 7f09b97fa640 1 -- 172.21.15.171:0/310625741 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}]=0 v20) ==== 105+0+15 (unknown 2967173288 0 2995009362) 0x7f09b401e070 con 0x7f09bc13b020 2024-04-25T23:56:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.131+0000 7f09b97fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.131+0000 7f09b97fa640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 >> v1:172.21.15.171:6812/722422047 conn(0x7f09a00377e0 legacy=0x7f09a0039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 10 monclient: shutdown 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 >> v1:172.21.15.171:6791/0 conn(0x7f09bc13b020 legacy=0x7f09bc1d4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 shutdown_connections 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 >> 172.21.15.171:0/310625741 conn(0x7f09bc0a62d0 msgr2=0x7f09bc12c710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 shutdown_connections 2024-04-25T23:56:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.135+0000 7f09c2e88640 1 -- 172.21.15.171:0/310625741 wait complete. 2024-04-25T23:56:19.134 INFO:tasks.workunit.client.0.smithi171.stdout:pg_num_max: 33 2024-04-25T23:56:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool set testpool1234 pg_num_min 9 2024-04-25T23:56:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num_min 9 2024-04-25T23:56:19.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.267+0000 7fa55398e640 10 monclient: get_monmap_and_config 2024-04-25T23:56:19.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.267+0000 7fa55398e640 10 monclient: build_initial_monmap 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.267+0000 7fa55398e640 10 monclient: monmap: 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:19.274366+0000 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:19.274366+0000 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:19.255 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:19.256 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 Processor -- start 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- start start 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: init 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: _add_conns ranks=[7,6,5,2,0,3,4,8,1] 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient(hunting): picked mon.noname-i con 0x7fa54c0a5340 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient(hunting): picked mon.noname-d con 0x7fa54c0726f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:19.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient(hunting): picked mon.noname-h con 0x7fa54c13e320 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c06d630 con 0x7fa54c13e320 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c0a3f50 con 0x7fa54c0726f0 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c06ed20 con 0x7fa54c0a5340 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55172a640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fa54c0a5340 legacy=0x7fa54c071fe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient(hunting): authenticate will time out at 1029.981430s 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa551f2b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fa54c13e320 0x7fa54c140710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59880/0 (socket says 172.21.15.171:59880) 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa551f2b640 1 -- 172.21.15.171:0/4207932934 learned_addr learned my addr 172.21.15.171:0/4207932934 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 825316842 0 0) 0x7fa54c06d630 con 0x7fa54c13e320 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient(hunting): my global_id is 4649 2024-04-25T23:56:19.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa534003530 con 0x7fa54c13e320 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2222838168 0 0) 0x7fa534003530 con 0x7fa54c13e320 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 >> v1:172.21.15.171:6792/0 conn(0x7fa54c0a5340 legacy=0x7fa54c071fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 >> v1:172.21.15.106:6792/0 conn(0x7fa54c0726f0 legacy=0x7fa54c13cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 monclient: found mon.noname-h 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c06f000 con 0x7fa54c13e320 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: _finish_auth 0 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:19.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa53c001b40 con 0x7fa54c13e320 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: dump: 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 5 monclient: authenticate success, global_id 4649 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa53c001e30 con 0x7fa54c13e320 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 4 set_mon_vals no callback set 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 1 -- 172.21.15.171:0/4207932934 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa53c004f70 con 0x7fa54c13e320 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa54bfff640 10 monclient: dump: 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.267 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: shutdown 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- 172.21.15.171:0/4207932934 >> v1:172.21.15.171:6791/0 conn(0x7fa54c13e320 legacy=0x7fa54c140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- 172.21.15.171:0/4207932934 shutdown_connections 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- 172.21.15.171:0/4207932934 >> 172.21.15.171:0/4207932934 conn(0x7fa54c0a4820 msgr2=0x7fa54c0a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- 172.21.15.171:0/4207932934 shutdown_connections 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- 172.21.15.171:0/4207932934 wait complete. 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: build_initial_monmap 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: monmap: 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:19.268 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 Processor -- start 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 1 -- start start 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.271+0000 7fa55398e640 10 monclient: init 2024-04-25T23:56:19.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _add_conns ranks=[4,5,8,0,6,7,1,3,2] 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient(hunting): picked mon.noname-c con 0x7fa54c0726f0 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient(hunting): picked mon.noname-h con 0x7fa54c0a5340 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient(hunting): picked mon.noname-e con 0x7fa54c13e320 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c133d50 con 0x7fa54c0726f0 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c0a2110 con 0x7fa54c0a5340 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54c135a60 con 0x7fa54c13e320 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient(hunting): authenticate will time out at 1029.984323s 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55172a640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fa54c0726f0 legacy=0x7fa54c132f30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa550f29640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fa54c0a5340 0x7fa54c133640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59882/0 (socket says 172.21.15.171:59882) 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa550f29640 1 -- 172.21.15.171:0/2321267123 learned_addr learned my addr 172.21.15.171:0/2321267123 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa551f2b640 1 -- 172.21.15.171:0/2321267123 >> v1:172.21.15.106:6793/0 conn(0x7fa54c13e320 legacy=0x7fa54c1d4980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:19.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554702049 0 0) 0x7fa54c0a2110 con 0x7fa54c0a5340 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): my global_id is 4658 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa538003530 con 0x7fa54c0a5340 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3343286723 0 0) 0x7fa538003530 con 0x7fa54c0a5340 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa54c0a2110 con 0x7fa54c0a5340 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa540001a80 con 0x7fa54c0a5340 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.271 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4179974481 0 0) 0x7fa54c0a2110 con 0x7fa54c0a5340 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 >> v1:172.21.15.106:6793/0 conn(0x7fa54c13e320 legacy=0x7fa54c1d4980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 >> v1:172.21.15.106:6791/0 conn(0x7fa54c0726f0 legacy=0x7fa54c132f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 monclient: found mon.h 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54c135d40 con 0x7fa54c0a5340 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 5 monclient: authenticate success, global_id 4658 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _renew_subs 2024-04-25T23:56:19.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 1 -- 172.21.15.171:0/2321267123 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa54c136020 con 0x7fa54c0a5340 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _renew_subs 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 1 -- 172.21.15.171:0/2321267123 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa54c1369e0 con 0x7fa54c0a5340 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5400038d0 con 0x7fa54c0a5340 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa540003e40 con 0x7fa54c0a5340 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 10 monclient: dump: 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.274 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa54b7fe640 4 set_mon_vals no callback set 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55398e640 1 -- 172.21.15.171:0/2321267123 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa54c04f5b0 con 0x7fa54c0a5340 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa540004060 con 0x7fa54c0a5340 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3889+0+0 (unknown 1297018163 0 0) 0x7fa540044700 con 0x7fa54c0a5340 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.275+0000 7fa55172a640 10 monclient: get_auth_request con 0x7fa5380376c0 auth_method 0 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.279+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa5400158a0 con 0x7fa54c0a5340 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.279+0000 7fa549ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.276 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.279+0000 7fa549ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:19.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.439+0000 7fa55398e640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "9"}] 2024-04-25T23:56:19.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.439+0000 7fa55398e640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "9"}] 2024-04-25T23:56:19.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.439+0000 7fa55398e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.439+0000 7fa55398e640 1 -- 172.21.15.171:0/2321267123 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "9"} v 0) -- 0x7fa54c06dfa0 con 0x7fa54c0a5340 2024-04-25T23:56:19.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.443+0000 7fa549ffb640 1 -- 172.21.15.171:0/2321267123 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "9"}]=-22 specified pg_num_min 9 > pg_num 8 v20) ==== 150+0+0 (unknown 3399065943 0 0) 0x7fa5400151a0 con 0x7fa54c0a5340 2024-04-25T23:56:19.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.443+0000 7fa549ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "9"}] 2024-04-25T23:56:19.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.443+0000 7fa549ffb640 10 monclient: _finish_command 2 = mon:22 specified pg_num_min 9 > pg_num 8 2024-04-25T23:56:19.428 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: specified pg_num_min 9 > pg_num 8 2024-04-25T23:56:19.433 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:19.433 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool set testpool1234 pg_num_max 7 2024-04-25T23:56:19.433 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:19.433 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num_max 7 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient: get_monmap_and_config 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient: build_initial_monmap 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient: monmap: 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:19.572681+0000 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:19.572681+0000 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:19.553 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:19.554 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 1 Processor -- start 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 1 -- start start 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient: init 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient: _add_conns ranks=[2,6,0,1,5,7,3,8,4] 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient(hunting): picked mon.noname-b con 0x7f31c41379d0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient(hunting): picked mon.noname-d con 0x7f31c41384c0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient(hunting): picked mon.noname-a con 0x7f31c413e620 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c40a2b00 con 0x7f31c413e620 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c40a2de0 con 0x7f31c41379d0 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c40a17a0 con 0x7f31c41384c0 2024-04-25T23:56:19.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.567+0000 7f31cb90f640 10 monclient(hunting): authenticate will time out at 1030.279680s 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31c96ab640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f31c41379d0 0x7f31c4137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:44790/0 (socket says 172.21.15.171:44790) 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31c96ab640 1 -- 172.21.15.171:0/307238206 learned_addr learned my addr 172.21.15.171:0/307238206 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972841309 0 0) 0x7f31c40a2de0 con 0x7f31c41379d0 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): my global_id is 4484 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31b0003530 con 0x7f31c41379d0 2024-04-25T23:56:19.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2882495189 0 0) 0x7f31c40a17a0 con 0x7f31c41384c0 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): my global_id is 4632 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c40a2de0 con 0x7f31c41384c0 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412398315 0 0) 0x7f31c40a2b00 con 0x7f31c413e620 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient(hunting): my global_id is 4617 2024-04-25T23:56:19.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31c40a17a0 con 0x7f31c413e620 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2540782482 0 0) 0x7f31b0003530 con 0x7f31c41379d0 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 >> v1:172.21.15.106:6792/0 conn(0x7f31c41384c0 legacy=0x7f31c413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 >> v1:172.21.15.106:6789/0 conn(0x7f31c413e620 legacy=0x7f31c4140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 monclient: found mon.noname-b 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c40a3b20 con 0x7f31c41379d0 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: _finish_auth 0 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 5 monclient: authenticate success, global_id 4484 2024-04-25T23:56:19.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f31bc001b40 con 0x7f31c41379d0 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: dump: 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.565 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31bc001da0 con 0x7f31c41379d0 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 4 set_mon_vals no callback set 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 1 -- 172.21.15.171:0/307238206 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f31bc004f70 con 0x7f31c41379d0 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31bbfff640 10 monclient: dump: 2024-04-25T23:56:19.566 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient: shutdown 2024-04-25T23:56:19.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- 172.21.15.171:0/307238206 >> v1:172.21.15.106:6790/0 conn(0x7f31c41379d0 legacy=0x7f31c4137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- 172.21.15.171:0/307238206 shutdown_connections 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- 172.21.15.171:0/307238206 >> 172.21.15.171:0/307238206 conn(0x7f31c40a6b30 msgr2=0x7f31c40a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- 172.21.15.171:0/307238206 shutdown_connections 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- 172.21.15.171:0/307238206 wait complete. 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient: build_initial_monmap 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient: monmap: 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:19.568 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 Processor -- start 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- start start 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient: init 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient: _add_conns ranks=[8,1,2,7,5,0,6,4,3] 2024-04-25T23:56:19.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient(hunting): picked mon.noname-e con 0x7f31c41379d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient(hunting): picked mon.noname-f con 0x7f31c41384c0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient(hunting): picked mon.noname-b con 0x7f31c413e620 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c40a0fa0 con 0x7f31c41384c0 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c4136c80 con 0x7f31c413e620 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31c4136f60 con 0x7f31c41379d0 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31cb90f640 10 monclient(hunting): authenticate will time out at 1030.283754s 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31c8eaa640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f31c41384c0 legacy=0x7f31c4134da0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.571+0000 7f31c96ab640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f31c41379d0 legacy=0x7f31c4134690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31c9eac640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f31c413e620 0x7f31c41d4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:44804/0 (socket says 172.21.15.171:44804) 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31c9eac640 1 -- 172.21.15.171:0/1744583081 learned_addr learned my addr 172.21.15.171:0/1744583081 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4220335248 0 0) 0x7f31c4136c80 con 0x7f31c413e620 2024-04-25T23:56:19.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): my global_id is 4493 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31a8003530 con 0x7f31c413e620 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1778892753 0 0) 0x7f31a8003530 con 0x7f31c413e620 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31c4136c80 con 0x7f31c413e620 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f31c0001a00 con 0x7f31c413e620 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.571 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.572 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1056377351 0 0) 0x7f31c4136c80 con 0x7f31c413e620 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 >> v1:172.21.15.106:6793/0 conn(0x7f31c41379d0 legacy=0x7f31c4134690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 >> v1:172.21.15.171:6789/0 conn(0x7f31c41384c0 legacy=0x7f31c4134da0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 monclient: found mon.b 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31c41354b0 con 0x7f31c413e620 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 5 monclient: authenticate success, global_id 4493 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 10 monclient: _renew_subs 2024-04-25T23:56:19.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 1 -- 172.21.15.171:0/1744583081 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31c41334b0 con 0x7f31c413e620 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 10 monclient: _renew_subs 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 1 -- 172.21.15.171:0/1744583081 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f31c4139190 con 0x7f31c413e620 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31c0001d40 con 0x7f31c413e620 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f31c0003c10 con 0x7f31c413e620 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31bb7fe640 4 set_mon_vals no callback set 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 10 monclient: dump: 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.574 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:19.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31cb90f640 1 -- 172.21.15.171:0/1744583081 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31a4005090 con 0x7f31c413e620 2024-04-25T23:56:19.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f31c0003e30 con 0x7f31c413e620 2024-04-25T23:56:19.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3889+0+0 (unknown 1297018163 0 0) 0x7f31c0044550 con 0x7f31c413e620 2024-04-25T23:56:19.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.575+0000 7f31c96ab640 10 monclient: get_auth_request con 0x7f31a80376c0 auth_method 0 2024-04-25T23:56:19.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.591+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f31c0015630 con 0x7f31c413e620 2024-04-25T23:56:19.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.591+0000 7f31b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.591+0000 7f31b9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:19.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.755+0000 7f31cb90f640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "7"}] 2024-04-25T23:56:19.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.755+0000 7f31cb90f640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "7"}] 2024-04-25T23:56:19.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.755+0000 7f31cb90f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:19.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.755+0000 7f31cb90f640 1 -- 172.21.15.171:0/1744583081 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "7"} v 0) -- 0x7f31a4005380 con 0x7f31c413e620 2024-04-25T23:56:19.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.755+0000 7f31b9ffb640 1 -- 172.21.15.171:0/1744583081 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "7"}]=-22 specified pg_num_max 7 < pg_num 8 v20) ==== 150+0+0 (unknown 3385876791 0 0) 0x7f31c00192e0 con 0x7f31c413e620 2024-04-25T23:56:19.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.755+0000 7f31b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "7"}] 2024-04-25T23:56:19.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.755+0000 7f31b9ffb640 10 monclient: _finish_command 2 = mon:22 specified pg_num_max 7 < pg_num 8 2024-04-25T23:56:19.743 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: specified pg_num_max 7 < pg_num 8 2024-04-25T23:56:19.747 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:19.747 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool set testpool1234 pg_num 1 2024-04-25T23:56:19.747 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:19.747 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num 1 2024-04-25T23:56:19.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient: get_monmap_and_config 2024-04-25T23:56:19.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient: build_initial_monmap 2024-04-25T23:56:19.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient: monmap: 2024-04-25T23:56:19.868 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:19.868 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.868 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:19.887977+0000 2024-04-25T23:56:19.868 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:19.887977+0000 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:19.869 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 1 Processor -- start 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 1 -- start start 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient: init 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient: _add_conns ranks=[8,3,6,5,1,4,0,2,7] 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient(hunting): picked mon.noname-e con 0x7fc410071f90 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient(hunting): picked mon.noname-g con 0x7fc410137c40 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient(hunting): picked mon.noname-d con 0x7fc41013e1e0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006ec60 con 0x7fc410137c40 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006ef40 con 0x7fc41013e1e0 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006d510 con 0x7fc410071f90 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:19.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient(hunting): authenticate will time out at 1030.594899s 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40ffff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fc410071f90 legacy=0x7fc410072370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40f7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc410137c40 0x7fc41013cac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42056/0 (socket says 172.21.15.171:42056) 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40f7fe640 1 -- 172.21.15.171:0/2201954522 learned_addr learned my addr 172.21.15.171:0/2201954522 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3000549241 0 0) 0x7fc400001120 con 0x7fc410137c40 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient(hunting): my global_id is 4566 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3f8003530 con 0x7fc410137c40 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3380687649 0 0) 0x7fc3f8003530 con 0x7fc410137c40 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 >> v1:172.21.15.106:6793/0 conn(0x7fc410071f90 legacy=0x7fc410072370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 >> v1:172.21.15.106:6792/0 conn(0x7fc41013e1e0 legacy=0x7fc4101405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:19.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 monclient: found mon.noname-g 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4100a5200 con 0x7fc410137c40 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: _finish_auth 0 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc400001990 con 0x7fc410137c40 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: dump: 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.878 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 5 monclient: authenticate success, global_id 4566 2024-04-25T23:56:19.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc400001cf0 con 0x7fc410137c40 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 1 -- 172.21.15.171:0/2201954522 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc400004cb0 con 0x7fc410137c40 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc40effd640 10 monclient: dump: 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.880 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.883+0000 7fc41681d640 4 set_mon_vals no callback set 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: shutdown 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- 172.21.15.171:0/2201954522 >> v1:172.21.15.171:6790/0 conn(0x7fc410137c40 legacy=0x7fc41013cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- 172.21.15.171:0/2201954522 shutdown_connections 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- 172.21.15.171:0/2201954522 >> 172.21.15.171:0/2201954522 conn(0x7fc4100a8400 msgr2=0x7fc4100a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:19.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- 172.21.15.171:0/2201954522 shutdown_connections 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- 172.21.15.171:0/2201954522 wait complete. 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: build_initial_monmap 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: monmap: 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:19.882 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 Processor -- start 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- start start 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: init 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: _add_conns ranks=[2,5,4,6,1,7,8,0,3] 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient(hunting): picked mon.noname-b con 0x7fc410071f90 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient(hunting): picked mon.noname-h con 0x7fc410137c40 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient(hunting): picked mon.noname-c con 0x7fc41013e1e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41013d1d0 con 0x7fc410071f90 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006e2a0 con 0x7fc41013e1e0 2024-04-25T23:56:19.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc41006dee0 con 0x7fc410137c40 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient(hunting): authenticate will time out at 1030.598015s 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40f7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc410137c40 0x7fc4101d1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59884/0 (socket says 172.21.15.171:59884) 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40f7fe640 1 -- 172.21.15.171:0/1022515475 learned_addr learned my addr 172.21.15.171:0/1022515475 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc414dba640 1 -- 172.21.15.171:0/1022515475 >> v1:172.21.15.106:6791/0 conn(0x7fc41013e1e0 legacy=0x7fc4101d5150 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565521977 0 0) 0x7fc41006dee0 con 0x7fc410137c40 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): my global_id is 4667 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc003530 con 0x7fc410137c40 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1318157553 0 0) 0x7fc3fc003530 con 0x7fc410137c40 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc41006dee0 con 0x7fc410137c40 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426645389 0 0) 0x7fc41013d1d0 con 0x7fc410071f90 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:19.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): my global_id is 4502 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3fc003530 con 0x7fc410071f90 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc400004b30 con 0x7fc410137c40 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): dump: 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.885 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4241318597 0 0) 0x7fc41006dee0 con 0x7fc410137c40 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 >> v1:172.21.15.106:6791/0 conn(0x7fc41013e1e0 legacy=0x7fc4101d5150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 >> v1:172.21.15.106:6790/0 conn(0x7fc410071f90 legacy=0x7fc410134860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: _finish_hunting 0 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 monclient: found mon.h 2024-04-25T23:56:19.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc410120200 con 0x7fc410137c40 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: _finish_auth 0 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: _check_auth_tickets 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 5 monclient: authenticate success, global_id 4667 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: _renew_subs 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc41011f960 con 0x7fc410137c40 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: _renew_subs 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc41681d640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc410134f70 con 0x7fc410137c40 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc400001cf0 con 0x7fc410137c40 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc4000010f0 con 0x7fc410137c40 2024-04-25T23:56:19.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40e7fc640 4 set_mon_vals no callback set 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 10 monclient: dump: 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:19.888 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.887+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc400010160 con 0x7fc410137c40 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.891+0000 7fc41681d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.891+0000 7fc41681d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.891+0000 7fc41681d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.891+0000 7fc41681d640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3f0005090 con 0x7fc410137c40 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.891+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3889+0+0 (unknown 1297018163 0 0) 0x7fc400044830 con 0x7fc410137c40 2024-04-25T23:56:19.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.891+0000 7fc40ffff640 10 monclient: get_auth_request con 0x7fc3fc0377f0 auth_method 0 2024-04-25T23:56:19.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.895+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc41006ec60 con 0x7fc410137c40 2024-04-25T23:56:19.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.895+0000 7fc40cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:19.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:19.895+0000 7fc40cff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:20.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.055+0000 7fc41681d640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "1"}] 2024-04-25T23:56:20.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.055+0000 7fc41681d640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "1"}] 2024-04-25T23:56:20.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.055+0000 7fc41681d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.055+0000 7fc41681d640 1 -- 172.21.15.171:0/1022515475 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "1"} v 0) -- 0x7fc3f0005380 con 0x7fc410137c40 2024-04-25T23:56:20.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.055+0000 7fc40cff9640 1 -- 172.21.15.171:0/1022515475 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "1"}]=-22 specified pg_num 1 < pg_num_min 2 v20) ==== 146+0+0 (unknown 4093504435 0 0) 0x7fc400015a30 con 0x7fc410137c40 2024-04-25T23:56:20.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.055+0000 7fc40cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "1"}] 2024-04-25T23:56:20.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.055+0000 7fc40cff9640 10 monclient: _finish_command 2 = mon:22 specified pg_num 1 < pg_num_min 2 2024-04-25T23:56:20.042 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: specified pg_num 1 < pg_num_min 2 2024-04-25T23:56:20.049 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:20.049 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool set testpool1234 pg_num 44 2024-04-25T23:56:20.049 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:20.049 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num 44 2024-04-25T23:56:20.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: get_monmap_and_config 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: build_initial_monmap 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: monmap: 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:20.182708+0000 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:20.182708+0000 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:20.163 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:20.164 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:20.164 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:20.164 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:20.164 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:20.164 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:20.164 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:20.164 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 Processor -- start 2024-04-25T23:56:20.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- start start 2024-04-25T23:56:20.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: init 2024-04-25T23:56:20.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:20.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: _add_conns ranks=[8,2,1,0,4,3,7,5,6] 2024-04-25T23:56:20.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient(hunting): picked mon.noname-e con 0x7f48f80a3eb0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:20.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient(hunting): picked mon.noname-b con 0x7f48f80a2dc0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient(hunting): picked mon.noname-f con 0x7f48f80a3240 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f809df20 con 0x7f48f80a3240 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f80a0030 con 0x7f48f80a2dc0 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f80a0310 con 0x7f48f80a3eb0 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient(hunting): authenticate will time out at 1030.889580s 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48fdae8640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f48f80a3240 legacy=0x7f48f813cf90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48fd2e7640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f48f80a3eb0 legacy=0x7f48f80a26b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48fcae6640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f48f80a2dc0 0x7f48f8139860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:44824/0 (socket says 172.21.15.171:44824) 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48fcae6640 1 -- 172.21.15.171:0/3243172095 learned_addr learned my addr 172.21.15.171:0/3243172095 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3821729367 0 0) 0x7f48f80a0030 con 0x7f48f80a2dc0 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:20.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient(hunting): my global_id is 4511 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48e4003530 con 0x7f48f80a2dc0 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3159390356 0 0) 0x7f48e4003530 con 0x7f48f80a2dc0 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 >> v1:172.21.15.106:6793/0 conn(0x7f48f80a3eb0 legacy=0x7f48f80a26b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 >> v1:172.21.15.171:6789/0 conn(0x7f48f80a3240 legacy=0x7f48f813cf90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 monclient: found mon.noname-b 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f80a05f0 con 0x7f48f80a2dc0 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: _finish_auth 0 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f48f40017c0 con 0x7f48f80a2dc0 2024-04-25T23:56:20.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: dump: 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.170 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 5 monclient: authenticate success, global_id 4511 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48f4001a20 con 0x7f48f80a2dc0 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 4 set_mon_vals no callback set 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 1 -- 172.21.15.171:0/3243172095 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f48f4004bf0 con 0x7f48f80a2dc0 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:20.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ebfff640 10 monclient: dump: 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.172 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 10 monclient: shutdown 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- 172.21.15.171:0/3243172095 >> v1:172.21.15.106:6790/0 conn(0x7f48f80a2dc0 legacy=0x7f48f8139860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- 172.21.15.171:0/3243172095 shutdown_connections 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- 172.21.15.171:0/3243172095 >> 172.21.15.171:0/3243172095 conn(0x7f48f80a72a0 msgr2=0x7f48f80a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- 172.21.15.171:0/3243172095 shutdown_connections 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.179+0000 7f48ff54b640 1 -- 172.21.15.171:0/3243172095 wait complete. 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: build_initial_monmap 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: monmap: 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:20.173 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 Processor -- start 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 -- start start 2024-04-25T23:56:20.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: init 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _add_conns ranks=[1,2,3,4,0,6,5,7,8] 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient(hunting): picked mon.noname-f con 0x7f48f80a2dc0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient(hunting): picked mon.noname-b con 0x7f48f80a3240 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient(hunting): picked mon.noname-g con 0x7f48f80a3eb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f8072b60 con 0x7f48f80a2dc0 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f813e3b0 con 0x7f48f80a3240 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f8135c80 con 0x7f48f80a3eb0 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48fd2e7640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f48f80a2dc0 legacy=0x7f48f81c6e80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient(hunting): authenticate will time out at 1030.893501s 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48fdae8640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f48f80a3eb0 0x7f48f81d2210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:42068/0 (socket says 172.21.15.171:42068) 2024-04-25T23:56:20.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48fdae8640 1 -- 172.21.15.171:0/2717007632 learned_addr learned my addr 172.21.15.171:0/2717007632 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 205028561 0 0) 0x7f48f8135c80 con 0x7f48f80a3eb0 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): my global_id is 4575 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc003560 con 0x7f48f80a3eb0 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1876208659 0 0) 0x7f48dc003560 con 0x7f48f80a3eb0 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f48f8135c80 con 0x7f48f80a3eb0 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f48ec0041e0 con 0x7f48f80a3eb0 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.179 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:20.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115770111 0 0) 0x7f48f813e3b0 con 0x7f48f80a3240 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient(hunting): my global_id is 4520 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc003560 con 0x7f48f80a3240 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2238195187 0 0) 0x7f48f8135c80 con 0x7f48f80a3eb0 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 >> v1:172.21.15.106:6790/0 conn(0x7f48f80a3240 legacy=0x7f48f813dca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 >> v1:172.21.15.171:6789/0 conn(0x7f48f80a2dc0 legacy=0x7f48f81c6e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 monclient: found mon.g 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f8135f90 con 0x7f48f80a3eb0 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:20.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 5 monclient: authenticate success, global_id 4575 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _renew_subs 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f48f81361c0 con 0x7f48f80a3eb0 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _renew_subs 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f48f81d3b00 con 0x7f48f80a3eb0 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f48ec004540 con 0x7f48f80a3eb0 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f48ec004ab0 con 0x7f48f80a3eb0 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48eb7fe640 4 set_mon_vals no callback set 2024-04-25T23:56:20.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 10 monclient: dump: 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.183 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f48ec004c50 con 0x7f48f80a3eb0 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48ff54b640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48d8005090 con 0x7f48f80a3eb0 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3889+0+0 (unknown 1297018163 0 0) 0x7f48ec044580 con 0x7f48f80a3eb0 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.183+0000 7f48fd2e7640 10 monclient: get_auth_request con 0x7f48dc037910 auth_method 0 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.191+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f48ec015790 con 0x7f48f80a3eb0 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.191+0000 7f48e9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:20.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.191+0000 7f48e9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:20.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.351+0000 7f48ff54b640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "44"}] 2024-04-25T23:56:20.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.351+0000 7f48ff54b640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "44"}] 2024-04-25T23:56:20.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.351+0000 7f48ff54b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:20.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.351+0000 7f48ff54b640 1 -- 172.21.15.171:0/2717007632 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "44"} v 0) -- 0x7f48d8005380 con 0x7f48f80a3eb0 2024-04-25T23:56:20.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.351+0000 7f48e9ffb640 1 -- 172.21.15.171:0/2717007632 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "44"}]=-22 specified pg_num 44 < pg_num_max 33 v20) ==== 149+0+0 (unknown 199559999 0 0) 0x7f48ec015090 con 0x7f48f80a3eb0 2024-04-25T23:56:20.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.351+0000 7f48e9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num", "val": "44"}] 2024-04-25T23:56:20.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.351+0000 7f48e9ffb640 10 monclient: _finish_command 2 = mon:22 specified pg_num 44 < pg_num_max 33 2024-04-25T23:56:20.337 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: specified pg_num 44 < pg_num_max 33 2024-04-25T23:56:20.342 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:20.342 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num_min 0 2024-04-25T23:56:20.460 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient: get_monmap_and_config 2024-04-25T23:56:20.460 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient: build_initial_monmap 2024-04-25T23:56:20.460 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient: monmap: 2024-04-25T23:56:20.460 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:20.460 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:20.480060+0000 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:20.480060+0000 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:20.461 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.468 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 1 Processor -- start 2024-04-25T23:56:20.468 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 1 -- start start 2024-04-25T23:56:20.468 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient: init 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient: _add_conns ranks=[5,7,2,1,3,6,8,4,0] 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient(hunting): picked mon.noname-h con 0x7f2e1c137cb0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient(hunting): picked mon.noname-i con 0x7f2e1c0a0e50 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient(hunting): picked mon.noname-b con 0x7f2e1c13e2c0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c06b860 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c09fb80 con 0x7f2e1c137cb0 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c09fe60 con 0x7f2e1c0a0e50 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 10 monclient(hunting): authenticate will time out at 1031.186957s 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e1a7fc640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f2e1c0a0e50 legacy=0x7f2e1c13cba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e1affd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f2e1c137cb0 0x7f2e1c138090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59412/0 (socket says 172.21.15.171:59412) 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e1affd640 1 -- 172.21.15.171:0/1932432210 learned_addr learned my addr 172.21.15.171:0/1932432210 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304109413 0 0) 0x7f2e1c09fb80 con 0x7f2e1c137cb0 2024-04-25T23:56:20.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient(hunting): my global_id is 4676 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e04003530 con 0x7f2e1c137cb0 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 138225598 0 0) 0x7f2e04003530 con 0x7f2e1c137cb0 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 >> v1:172.21.15.171:6792/0 conn(0x7f2e1c0a0e50 legacy=0x7f2e1c13cba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 >> v1:172.21.15.106:6790/0 conn(0x7f2e1c13e2c0 legacy=0x7f2e1c1406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 monclient: found mon.noname-h 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c0a0140 con 0x7f2e1c137cb0 2024-04-25T23:56:20.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 5 monclient: authenticate success, global_id 4676 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e100017c0 con 0x7f2e1c137cb0 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: dump: 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.471 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e2167b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e10001ab0 con 0x7f2e1c137cb0 2024-04-25T23:56:20.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 1 -- 172.21.15.171:0/1932432210 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e10004bf0 con 0x7f2e1c137cb0 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.475+0000 7f2e19ffb640 10 monclient: dump: 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.473 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 4 set_mon_vals no callback set 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: shutdown 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- 172.21.15.171:0/1932432210 >> v1:172.21.15.171:6791/0 conn(0x7f2e1c137cb0 legacy=0x7f2e1c138090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- 172.21.15.171:0/1932432210 shutdown_connections 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- 172.21.15.171:0/1932432210 >> 172.21.15.171:0/1932432210 conn(0x7f2e1c0a7350 msgr2=0x7f2e1c0a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- 172.21.15.171:0/1932432210 shutdown_connections 2024-04-25T23:56:20.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- 172.21.15.171:0/1932432210 wait complete. 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: build_initial_monmap 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: monmap: 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:20.475 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 Processor -- start 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- start start 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: init 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: _add_conns ranks=[8,0,5,1,3,7,6,2,4] 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient(hunting): picked mon.noname-e con 0x7f2e1c0a0e50 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient(hunting): picked mon.noname-a con 0x7f2e1c137cb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:20.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient(hunting): picked mon.noname-h con 0x7f2e1c13e2c0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c139f90 con 0x7f2e1c137cb0 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c071dd0 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e1c1399d0 con 0x7f2e1c0a0e50 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient(hunting): authenticate will time out at 1031.190648s 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e1affd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f2e1c0a0e50 legacy=0x7f2e1c12e5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e1b7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f2e1c13e2c0 0x7f2e1c1d5030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59428/0 (socket says 172.21.15.171:59428) 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e1b7fe640 1 -- 172.21.15.171:0/168868665 learned_addr learned my addr 172.21.15.171:0/168868665 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236042479 0 0) 0x7f2e1c071dd0 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): my global_id is 4685 2024-04-25T23:56:20.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e08003530 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2336145156 0 0) 0x7f2e08003530 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e1c071dd0 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e14001d90 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): dump: 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.478 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3592553180 0 0) 0x7f2e1c139f90 con 0x7f2e1c137cb0 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient(hunting): my global_id is 4626 2024-04-25T23:56:20.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e08003530 con 0x7f2e1c137cb0 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2973552974 0 0) 0x7f2e1c071dd0 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 >> v1:172.21.15.106:6793/0 conn(0x7f2e1c0a0e50 legacy=0x7f2e1c12e5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 >> v1:172.21.15.106:6789/0 conn(0x7f2e1c137cb0 legacy=0x7f2e1c1d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 monclient: found mon.h 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e1c138920 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 5 monclient: authenticate success, global_id 4685 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: _renew_subs 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e1c13d1b0 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: _renew_subs 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e1c071320 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e14003cd0 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e197fa640 4 set_mon_vals no callback set 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e14004240 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.479+0000 7f2e037fe640 10 monclient: dump: 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:20.481 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.483+0000 7f2e2167b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.483+0000 7f2e2167b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:20.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.483+0000 7f2e2167b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.483+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2dfc005090 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.483+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2e14004460 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.483+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3889+0+0 (unknown 1297018163 0 0) 0x7f2e140449b0 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.483+0000 7f2e1affd640 10 monclient: get_auth_request con 0x7f2e08037800 auth_method 0 2024-04-25T23:56:20.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.487+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2e14015c90 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.487+0000 7f2e037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:20.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.487+0000 7f2e037fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:20.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.635+0000 7f2e2167b640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}] 2024-04-25T23:56:20.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.635+0000 7f2e2167b640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}] 2024-04-25T23:56:20.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.635+0000 7f2e2167b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.635+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"} v 0) -- 0x7f2dfc005380 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.723+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}]=0 set pool 3 pg_num_min to 0 v21) ==== 143+0+0 (unknown 3105387038 0 0) 0x7f2e14015590 con 0x7f2e1c13e2c0 2024-04-25T23:56:20.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.723+0000 7f2e037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}] 2024-04-25T23:56:20.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.723+0000 7f2e037fe640 10 monclient: _finish_command 2 = system:0 set pool 3 pg_num_min to 0 2024-04-25T23:56:20.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.815+0000 7f2e2167b640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}] 2024-04-25T23:56:20.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.815+0000 7f2e2167b640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}] 2024-04-25T23:56:20.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.815+0000 7f2e2167b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:20.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:20.815+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"} v 0) -- 0x7f2dfc000c00 con 0x7f2e1c13e2c0 2024-04-25T23:56:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.735+0000 7f2e037fe640 1 -- 172.21.15.171:0/168868665 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}]=0 set pool 3 pg_num_min to 0 v22) ==== 143+0+0 (unknown 4216300655 0 0) 0x7f2e1401e140 con 0x7f2e1c13e2c0 2024-04-25T23:56:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.735+0000 7f2e037fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_min", "val": "0"}] 2024-04-25T23:56:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.735+0000 7f2e037fe640 10 monclient: _finish_command 3 = system:0 set pool 3 pg_num_min to 0 2024-04-25T23:56:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 3 pg_num_min to 0 2024-04-25T23:56:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 >> v1:172.21.15.171:6812/722422047 conn(0x7f2e08037800 legacy=0x7f2e08039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 10 monclient: shutdown 2024-04-25T23:56:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 >> v1:172.21.15.171:6791/0 conn(0x7f2e1c13e2c0 legacy=0x7f2e1c1d5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 shutdown_connections 2024-04-25T23:56:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 >> 172.21.15.171:0/168868665 conn(0x7f2e1c0a7350 msgr2=0x7f2e1c136890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 shutdown_connections 2024-04-25T23:56:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.739+0000 7f2e2167b640 1 -- 172.21.15.171:0/168868665 wait complete. 2024-04-25T23:56:21.746 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool get testpool1234 pg_num_min 2024-04-25T23:56:21.746 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:21.746 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool get testpool1234 pg_num_min 2024-04-25T23:56:21.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: get_monmap_and_config 2024-04-25T23:56:21.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: build_initial_monmap 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: monmap: 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:21.886675+0000 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:21.886675+0000 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:21.870 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:21.871 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:21.871 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:21.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:21.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 Processor -- start 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- start start 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: init 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: _add_conns ranks=[5,6,8,3,1,4,2,7,0] 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient(hunting): picked mon.noname-h con 0x7f4f30135c20 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient(hunting): picked mon.noname-d con 0x7f4f30135760 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient(hunting): picked mon.noname-e con 0x7f4f3013c1a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:21.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3006b920 con 0x7f4f30135c20 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f30072480 con 0x7f4f30135760 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f30072760 con 0x7f4f3013c1a0 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient(hunting): authenticate will time out at 1032.593721s 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2ffff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4f3013c1a0 legacy=0x7f4f3013e590 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2f7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4f30135c20 0x7f4f30136000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59444/0 (socket says 172.21.15.171:59444) 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2f7fe640 1 -- 172.21.15.171:0/2464509571 learned_addr learned my addr 172.21.15.171:0/2464509571 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2547497743 0 0) 0x7f4f3006b920 con 0x7f4f30135c20 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient(hunting): my global_id is 4694 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f18003530 con 0x7f4f30135c20 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2031590823 0 0) 0x7f4f18003530 con 0x7f4f30135c20 2024-04-25T23:56:21.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 >> v1:172.21.15.106:6793/0 conn(0x7f4f3013c1a0 legacy=0x7f4f3013e590 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 >> v1:172.21.15.106:6792/0 conn(0x7f4f30135760 legacy=0x7f4f3013aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 monclient: found mon.noname-h 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f3006bcf0 con 0x7f4f30135c20 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f280017e0 con 0x7f4f30135c20 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: dump: 2024-04-25T23:56:21.877 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:21.878 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 5 monclient: authenticate success, global_id 4694 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f28001b40 con 0x7f4f30135c20 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 4 set_mon_vals no callback set 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 1 -- 172.21.15.171:0/2464509571 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f28004bf0 con 0x7f4f30135c20 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f2e7fc640 10 monclient: dump: 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:21.879 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:21.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: shutdown 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- 172.21.15.171:0/2464509571 >> v1:172.21.15.171:6791/0 conn(0x7f4f30135c20 legacy=0x7f4f30136000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- 172.21.15.171:0/2464509571 shutdown_connections 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- 172.21.15.171:0/2464509571 >> 172.21.15.171:0/2464509571 conn(0x7f4f300a73a0 msgr2=0x7f4f300a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- 172.21.15.171:0/2464509571 shutdown_connections 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 1 -- 172.21.15.171:0/2464509571 wait complete. 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: build_initial_monmap 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.883+0000 7f4f35e19640 10 monclient: monmap: 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:21.881 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 1 Processor -- start 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 1 -- start start 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient: init 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:21.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient: _add_conns ranks=[8,4,7,3,2,6,1,0,5] 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient(hunting): picked mon.noname-e con 0x7f4f30135760 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient(hunting): picked mon.noname-c con 0x7f4f30135c20 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient(hunting): picked mon.noname-i con 0x7f4f3013c1a0 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3009d750 con 0x7f4f30135c20 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f301333a0 con 0x7f4f3013c1a0 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f300a0790 con 0x7f4f30135760 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f35e19640 10 monclient(hunting): authenticate will time out at 1032.596747s 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f2ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f4f3013c1a0 legacy=0x7f4f301d2d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f2f7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4f30135760 legacy=0x7f4f30129700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:21.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:21.887+0000 7f4f2effd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f4f30135c20 legacy=0x7f4f301cf640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:22.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:22.091+0000 7f4f2ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f4f3013c1a0 legacy=0x7f4f301d2d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:22.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:22.091+0000 7f4f2effd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f4f30135c20 legacy=0x7f4f301cf640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:22.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:22.091+0000 7f4f2f7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4f30135760 legacy=0x7f4f30129700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:22.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:22.495+0000 7f4f2ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f4f3013c1a0 legacy=0x7f4f301d2d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:22.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:22.495+0000 7f4f2effd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f4f30135c20 legacy=0x7f4f301cf640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:22.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:22.495+0000 7f4f2f7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4f30135760 legacy=0x7f4f30129700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:23.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:23.299+0000 7f4f2ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f4f3013c1a0 legacy=0x7f4f301d2d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:23.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:23.299+0000 7f4f2effd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f4f30135c20 legacy=0x7f4f301cf640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:23.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:23.299+0000 7f4f2f7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4f30135760 legacy=0x7f4f30129700 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient(hunting): tick 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 1 monclient(hunting): continuing hunt 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4f30135760 legacy=0x7f4f30129700 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f4f3013c1a0 legacy=0x7f4f301d2d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f4f30135c20 legacy=0x7f4f301cf640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient: _add_conns ranks=[0,2,5,1,6,3] 2024-04-25T23:56:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f4f10003790 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f4f10007420 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient(hunting): picked mon.noname-h con 0x7f4f1000b1b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f300a0490 con 0x7f4f10003790 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3009d750 con 0x7f4f10007420 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f301333a0 con 0x7f4f1000b1b0 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f16ffd640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f2ffff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4f1000b1b0 0x7f4f1000d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59448/0 (socket says 172.21.15.171:59448) 2024-04-25T23:56:24.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f2ffff640 1 -- 172.21.15.171:0/2392550799 learned_addr learned my addr 172.21.15.171:0/2392550799 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:24.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3893476600 0 0) 0x7f4f301333a0 con 0x7f4f1000b1b0 2024-04-25T23:56:24.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:24.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:24.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): my global_id is 4703 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f1c003530 con 0x7f4f1000b1b0 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468702056 0 0) 0x7f4f300a0490 con 0x7f4f10003790 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): my global_id is 4635 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f301333a0 con 0x7f4f10003790 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4215496753 0 0) 0x7f4f3009d750 con 0x7f4f10007420 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): my global_id is 4538 2024-04-25T23:56:24.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f300a0490 con 0x7f4f10007420 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3097611750 0 0) 0x7f4f1c003530 con 0x7f4f1000b1b0 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f3009d750 con 0x7f4f1000b1b0 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f200046c0 con 0x7f4f1000b1b0 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): dump: 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:24.878 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1473219827 0 0) 0x7f4f300a0490 con 0x7f4f10007420 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f1c003530 con 0x7f4f10007420 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2005680232 0 0) 0x7f4f301333a0 con 0x7f4f10003790 2024-04-25T23:56:24.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f300a0490 con 0x7f4f10003790 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f24001ba0 con 0x7f4f10007420 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): dump: 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:24.880 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f28004b30 con 0x7f4f10003790 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient(hunting): dump: 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:24.881 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 775844497 0 0) 0x7f4f3009d750 con 0x7f4f1000b1b0 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 >> v1:172.21.15.106:6790/0 conn(0x7f4f10007420 legacy=0x7f4f100098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 >> v1:172.21.15.106:6789/0 conn(0x7f4f10003790 legacy=0x7f4f10005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:24.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 monclient: found mon.h 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f2ffff640 1 -- 172.21.15.171:0/2392550799 reap_dead start 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f300a0790 con 0x7f4f1000b1b0 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: _finish_auth 0 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 5 monclient: authenticate success, global_id 4703 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 10 monclient: _renew_subs 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f3009d470 con 0x7f4f1000b1b0 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 10 monclient: _renew_subs 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:24.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f3009e460 con 0x7f4f1000b1b0 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f20004ed0 con 0x7f4f1000b1b0 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f20004d00 con 0x7f4f1000b1b0 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f2dffb640 4 set_mon_vals no callback set 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 10 monclient: dump: 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:24.884 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4f2000ffc0 con 0x7f4f1000b1b0 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f35e19640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f08005090 con 0x7f4f1000b1b0 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(22..22 src has 1..22) ==== 3873+0+0 (unknown 1895140345 0 0) 0x7f4f20044720 con 0x7f4f1000b1b0 2024-04-25T23:56:24.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.891+0000 7f4f2f7fe640 10 monclient: get_auth_request con 0x7f4f1c038030 auth_method 0 2024-04-25T23:56:24.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.899+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f4f20015980 con 0x7f4f1000b1b0 2024-04-25T23:56:24.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.899+0000 7f4f17fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:24.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:24.899+0000 7f4f17fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:25.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.079+0000 7f4f35e19640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:25.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.079+0000 7f4f35e19640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:25.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.079+0000 7f4f35e19640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:25.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.079+0000 7f4f35e19640 1 -- 172.21.15.171:0/2392550799 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"} v 0) -- 0x7f4f08005b90 con 0x7f4f1000b1b0 2024-04-25T23:56:25.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.079+0000 7f4f17fff640 1 -- 172.21.15.171:0/2392550799 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}]=-2 option 'pg_num_min' is not set on pool 'testpool1234' v22) ==== 158+0+0 (unknown 4260761247 0 0) 0x7f4f20015280 con 0x7f4f1000b1b0 2024-04-25T23:56:25.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.079+0000 7f4f17fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_min"}] 2024-04-25T23:56:25.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.079+0000 7f4f17fff640 10 monclient: _finish_command 2 = mon:2 option 'pg_num_min' is not set on pool 'testpool1234' 2024-04-25T23:56:25.067 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOENT: option 'pg_num_min' is not set on pool 'testpool1234' 2024-04-25T23:56:25.072 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:25.072 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set testpool1234 pg_num_max 0 2024-04-25T23:56:25.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient: get_monmap_and_config 2024-04-25T23:56:25.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient: build_initial_monmap 2024-04-25T23:56:25.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient: monmap: 2024-04-25T23:56:25.192 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:25.192 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:25.192 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:25.211900+0000 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:25.211900+0000 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:25.193 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:25.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 1 Processor -- start 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 1 -- start start 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient: init 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient: _add_conns ranks=[2,4,1,5,0,8,3,7,6] 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient(hunting): picked mon.noname-b con 0x7f19200a1130 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient(hunting): picked mon.noname-c con 0x7f19200a1510 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient(hunting): picked mon.noname-f con 0x7f192013bbf0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19201363d0 con 0x7f192013bbf0 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19200a27e0 con 0x7f19200a1130 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f192009a480 con 0x7f19200a1510 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f192860a640 10 monclient(hunting): authenticate will time out at 1035.918712s 2024-04-25T23:56:25.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f1926ba7640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f192013bbf0 legacy=0x7f192013dfe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f1925ba5640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f19200a1510 legacy=0x7f19200a1970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19263a6640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f19200a1130 0x7f1920135cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:39608/0 (socket says 172.21.15.171:39608) 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19263a6640 1 -- 172.21.15.171:0/3120033655 learned_addr learned my addr 172.21.15.171:0/3120033655 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322587747 0 0) 0x7f19200a27e0 con 0x7f19200a1130 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 10 monclient(hunting): _negotiate 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 10 monclient(hunting): my global_id is 4547 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f190c003530 con 0x7f19200a1130 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3032675341 0 0) 0x7f190c003530 con 0x7f19200a1130 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.207+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 >> v1:172.21.15.106:6791/0 conn(0x7f19200a1510 legacy=0x7f19200a1970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 >> v1:172.21.15.171:6789/0 conn(0x7f192013bbf0 legacy=0x7f192013dfe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: _finish_hunting 0 2024-04-25T23:56:25.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 1 monclient: found mon.noname-b 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f192009a760 con 0x7f19200a1130 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: _finish_auth 0 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: _check_auth_tickets 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 5 monclient: authenticate success, global_id 4547 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f191c0017c0 con 0x7f19200a1130 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: dump: 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:25.202 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:25.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f191c001b20 con 0x7f19200a1130 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 4 set_mon_vals no callback set 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 1 -- 172.21.15.171:0/3120033655 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f191c001d50 con 0x7f19200a1130 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19253a4640 10 monclient: dump: 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:25.204 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: shutdown 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- 172.21.15.171:0/3120033655 >> v1:172.21.15.106:6790/0 conn(0x7f19200a1130 legacy=0x7f1920135cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- 172.21.15.171:0/3120033655 shutdown_connections 2024-04-25T23:56:25.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- 172.21.15.171:0/3120033655 >> 172.21.15.171:0/3120033655 conn(0x7f19200a67e0 msgr2=0x7f19200a6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- 172.21.15.171:0/3120033655 shutdown_connections 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- 172.21.15.171:0/3120033655 wait complete. 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: build_initial_monmap 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: monmap: 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:25.206 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 Processor -- start 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- start start 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: init 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: _add_conns ranks=[8,3,2,5,7,0,4,6,1] 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient(hunting): picked mon.noname-e con 0x7f19200a1130 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient(hunting): picked mon.noname-g con 0x7f19200a1510 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:25.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient(hunting): picked mon.noname-b con 0x7f192013bbf0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1920139880 con 0x7f192013bbf0 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1920137550 con 0x7f19200a1510 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1920073440 con 0x7f19200a1130 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient(hunting): authenticate will time out at 1035.922398s 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f19263a6640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f19200a1130 legacy=0x7f1920136730 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1925ba5640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f19200a1510 0x7f1920136e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:57830/0 (socket says 172.21.15.171:57830) 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1925ba5640 1 -- 172.21.15.171:0/168273131 learned_addr learned my addr 172.21.15.171:0/168273131 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867447631 0 0) 0x7f1920137550 con 0x7f19200a1510 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): my global_id is 4584 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1904003530 con 0x7f19200a1510 2024-04-25T23:56:25.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 26966856 0 0) 0x7f1904003530 con 0x7f19200a1510 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1920137550 con 0x7f19200a1510 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1910004330 con 0x7f19200a1510 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): dump: 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:25.209 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908230787 0 0) 0x7f1920139880 con 0x7f192013bbf0 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient(hunting): my global_id is 4556 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1904003530 con 0x7f192013bbf0 2024-04-25T23:56:25.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2601846164 0 0) 0x7f1920137550 con 0x7f19200a1510 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 >> v1:172.21.15.106:6793/0 conn(0x7f19200a1130 legacy=0x7f1920136730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 >> v1:172.21.15.106:6790/0 conn(0x7f192013bbf0 legacy=0x7f19201d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 monclient: found mon.g 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1920138fe0 con 0x7f19200a1510 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: _finish_auth 0 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 5 monclient: authenticate success, global_id 4584 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: _renew_subs 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1920139ca0 con 0x7f19200a1510 2024-04-25T23:56:25.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: _renew_subs 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1920138250 con 0x7f19200a1510 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1910004690 con 0x7f19200a1510 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1910004c00 con 0x7f19200a1510 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1917fff640 4 set_mon_vals no callback set 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.211+0000 7f1916ffd640 10 monclient: dump: 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:25.212 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.215+0000 7f192860a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.215+0000 7f192860a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.215+0000 7f192860a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.215+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1908005090 con 0x7f19200a1510 2024-04-25T23:56:25.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.215+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1910004e20 con 0x7f19200a1510 2024-04-25T23:56:25.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.215+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(22..22 src has 1..22) ==== 3873+0+0 (unknown 1895140345 0 0) 0x7f1910044760 con 0x7f19200a1510 2024-04-25T23:56:25.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.215+0000 7f19263a6640 10 monclient: get_auth_request con 0x7f1904037860 auth_method 0 2024-04-25T23:56:25.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.219+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1910015910 con 0x7f19200a1510 2024-04-25T23:56:25.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.219+0000 7f1916ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:25.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.219+0000 7f1916ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:25.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.379+0000 7f192860a640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}] 2024-04-25T23:56:25.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.379+0000 7f192860a640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}] 2024-04-25T23:56:25.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.379+0000 7f192860a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:25.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.379+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"} v 0) -- 0x7f1908005380 con 0x7f19200a1510 2024-04-25T23:56:25.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.766+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}]=0 set pool 3 pg_num_max to 0 v23) ==== 143+0+0 (unknown 2261640237 0 0) 0x7f191001ddc0 con 0x7f19200a1510 2024-04-25T23:56:25.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.766+0000 7f1916ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}] 2024-04-25T23:56:25.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.766+0000 7f1916ffd640 10 monclient: _finish_command 2 = system:0 set pool 3 pg_num_max to 0 2024-04-25T23:56:25.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.866+0000 7f192860a640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}] 2024-04-25T23:56:25.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.866+0000 7f192860a640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}] 2024-04-25T23:56:25.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.866+0000 7f192860a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:25.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:25.866+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"} v 0) -- 0x7f1908000c00 con 0x7f19200a1510 2024-04-25T23:56:26.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.770+0000 7f1916ffd640 1 -- 172.21.15.171:0/168273131 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}]=0 set pool 3 pg_num_max to 0 v24) ==== 143+0+0 (unknown 3358137705 0 0) 0x7f1910042420 con 0x7f19200a1510 2024-04-25T23:56:26.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.770+0000 7f1916ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "testpool1234", "var": "pg_num_max", "val": "0"}] 2024-04-25T23:56:26.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.770+0000 7f1916ffd640 10 monclient: _finish_command 3 = system:0 set pool 3 pg_num_max to 0 2024-04-25T23:56:26.757 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 3 pg_num_max to 0 2024-04-25T23:56:26.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 >> v1:172.21.15.171:6812/722422047 conn(0x7f1904037860 legacy=0x7f1904039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:26.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 10 monclient: shutdown 2024-04-25T23:56:26.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:26.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 >> v1:172.21.15.171:6790/0 conn(0x7f19200a1510 legacy=0x7f1920136e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:26.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 shutdown_connections 2024-04-25T23:56:26.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 >> 172.21.15.171:0/168273131 conn(0x7f19200a67e0 msgr2=0x7f192013dfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:26.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 shutdown_connections 2024-04-25T23:56:26.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.774+0000 7f192860a640 1 -- 172.21.15.171:0/168273131 wait complete. 2024-04-25T23:56:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool get testpool1234 pg_num_max 2024-04-25T23:56:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool get testpool1234 pg_num_max 2024-04-25T23:56:26.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient: get_monmap_and_config 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient: build_initial_monmap 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient: monmap: 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:26.916351+0000 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:26.916351+0000 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:26.897 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:26.898 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:26.898 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:26.898 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 1 Processor -- start 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 1 -- start start 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient: init 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient: _add_conns ranks=[1,7,3,4,2,5,6,0,8] 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient(hunting): picked mon.noname-f con 0x7f709c099c80 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.910+0000 7f70a2555640 10 monclient(hunting): picked mon.noname-i con 0x7f709c09c020 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): picked mon.noname-g con 0x7f709c13e540 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0a28d0 con 0x7f709c099c80 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c0a1dc0 con 0x7f709c13e540 2024-04-25T23:56:26.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c09cb00 con 0x7f709c09c020 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): authenticate will time out at 1037.624073s 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709bfff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f709c099c80 legacy=0x7f709c0a0fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709b7fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f709c09c020 legacy=0x7f709c0a16b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a0af2640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f709c13e540 0x7f709c140930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:57846/0 (socket says 172.21.15.171:57846) 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a0af2640 1 -- 172.21.15.171:0/268928254 learned_addr learned my addr 172.21.15.171:0/268928254 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026435524 0 0) 0x7f709c0a1dc0 con 0x7f709c13e540 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient(hunting): my global_id is 4593 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7084003530 con 0x7f709c13e540 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3920367247 0 0) 0x7f7084003530 con 0x7f709c13e540 2024-04-25T23:56:26.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 >> v1:172.21.15.171:6792/0 conn(0x7f709c09c020 legacy=0x7f709c0a16b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 >> v1:172.21.15.171:6789/0 conn(0x7f709c099c80 legacy=0x7f709c0a0fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 monclient: found mon.noname-g 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c09bc00 con 0x7f709c13e540 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: _finish_auth 0 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 5 monclient: authenticate success, global_id 4593 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7094001b40 con 0x7f709c13e540 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: dump: 2024-04-25T23:56:26.907 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:26.908 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7094001e30 con 0x7f709c13e540 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 4 set_mon_vals no callback set 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 1 -- 172.21.15.171:0/268928254 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7094004f70 con 0x7f709c13e540 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709affd640 10 monclient: dump: 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:26.909 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient: shutdown 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- 172.21.15.171:0/268928254 >> v1:172.21.15.171:6790/0 conn(0x7f709c13e540 legacy=0x7f709c140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- 172.21.15.171:0/268928254 shutdown_connections 2024-04-25T23:56:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- 172.21.15.171:0/268928254 >> 172.21.15.171:0/268928254 conn(0x7f709c0a6540 msgr2=0x7f709c0a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- 172.21.15.171:0/268928254 shutdown_connections 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- 172.21.15.171:0/268928254 wait complete. 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient: build_initial_monmap 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient: monmap: 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 Processor -- start 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- start start 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient: init 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient: _add_conns ranks=[6,2,8,1,5,7,4,3,0] 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): picked mon.noname-d con 0x7f709c099c80 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): picked mon.noname-b con 0x7f709c09c020 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): picked mon.noname-e con 0x7f709c13e540 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c13dd90 con 0x7f709c09c020 2024-04-25T23:56:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c13d910 con 0x7f709c099c80 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f709c070670 con 0x7f709c13e540 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a2555640 10 monclient(hunting): authenticate will time out at 1037.626896s 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f70a0af2640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f709c13e540 legacy=0x7f709c1d5030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709b7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f709c09c020 0x7f709c1d1900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:39630/0 (socket says 172.21.15.171:39630) 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f709b7fe640 1 -- 172.21.15.171:0/928879506 learned_addr learned my addr 172.21.15.171:0/928879506 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128303023 0 0) 0x7f709c13dd90 con 0x7f709c09c020 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): my global_id is 4565 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7088003530 con 0x7f709c09c020 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156041590 0 0) 0x7f709c13d910 con 0x7f709c099c80 2024-04-25T23:56:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 10 monclient(hunting): my global_id is 4659 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.914+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f709c13dd90 con 0x7f709c099c80 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 114325400 0 0) 0x7f7088003530 con 0x7f709c09c020 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f709c13d910 con 0x7f709c09c020 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7090004310 con 0x7f709c09c020 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient(hunting): dump: 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.914 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1957715314 0 0) 0x7f709c13dd90 con 0x7f709c099c80 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7088003530 con 0x7f709c099c80 2024-04-25T23:56:26.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f708c0041f0 con 0x7f709c099c80 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient(hunting): dump: 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:26.916 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3543331128 0 0) 0x7f709c13d910 con 0x7f709c09c020 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 >> v1:172.21.15.106:6793/0 conn(0x7f709c13e540 legacy=0x7f709c1d5030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 >> v1:172.21.15.106:6792/0 conn(0x7f709c099c80 legacy=0x7f709c1cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 monclient: found mon.b 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f709c070950 con 0x7f709c09c020 2024-04-25T23:56:26.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: _finish_auth 0 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 5 monclient: authenticate success, global_id 4565 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 10 monclient: _renew_subs 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f709c13dfd0 con 0x7f709c09c020 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 10 monclient: _renew_subs 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f709c13cf30 con 0x7f709c09c020 2024-04-25T23:56:26.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70900046e0 con 0x7f709c09c020 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7090004f50 con 0x7f709c09c020 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f709a7fc640 4 set_mon_vals no callback set 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 10 monclient: dump: 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:26.919 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f70a2555640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f707c005090 con 0x7f709c09c020 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f709000fcf0 con 0x7f709c09c020 2024-04-25T23:56:26.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(24..24 src has 1..24) ==== 3857+0+0 (unknown 3391443726 0 0) 0x7f7090044620 con 0x7f709c09c020 2024-04-25T23:56:26.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.918+0000 7f709bfff640 10 monclient: get_auth_request con 0x7f7088037d90 auth_method 0 2024-04-25T23:56:26.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.930+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7090015720 con 0x7f709c09c020 2024-04-25T23:56:26.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.930+0000 7f7098ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:26.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:26.930+0000 7f7098ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:27.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.094+0000 7f70a2555640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:27.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.094+0000 7f70a2555640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:27.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.094+0000 7f70a2555640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:27.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.094+0000 7f70a2555640 1 -- 172.21.15.171:0/928879506 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"} v 0) -- 0x7f707c005b90 con 0x7f709c09c020 2024-04-25T23:56:27.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.094+0000 7f7098ff9640 1 -- 172.21.15.171:0/928879506 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}]=-2 option 'pg_num_max' is not set on pool 'testpool1234' v24) ==== 158+0+0 (unknown 2544661327 0 0) 0x7f70900193d0 con 0x7f709c09c020 2024-04-25T23:56:27.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.094+0000 7f7098ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "testpool1234", "var": "pg_num_max"}] 2024-04-25T23:56:27.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.094+0000 7f7098ff9640 10 monclient: _finish_command 2 = mon:2 option 'pg_num_max' is not set on pool 'testpool1234' 2024-04-25T23:56:27.082 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOENT: option 'pg_num_max' is not set on pool 'testpool1234' 2024-04-25T23:56:27.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:27.089 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete testpool1234 testpool1234 --yes-i-really-really-mean-it 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: get_monmap_and_config 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: build_initial_monmap 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: monmap: 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:27.222720+0000 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:27.222720+0000 2024-04-25T23:56:27.203 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:27.204 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 Processor -- start 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- start start 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: init 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: _add_conns ranks=[1,3,0,4,6,8,7,5,2] 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient(hunting): picked mon.noname-f con 0x7f680009d3b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient(hunting): picked mon.noname-g con 0x7f680009d790 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient(hunting): picked mon.noname-a con 0x7f680009dbf0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:27.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f680006bdf0 con 0x7f680009dbf0 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68000a1140 con 0x7f680009d3b0 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68000a0810 con 0x7f680009d790 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient(hunting): authenticate will time out at 1037.929686s 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67feffd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f680009d3b0 legacy=0x7f6800135a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fe7fc640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f680009d790 0x7f680013a900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:57848/0 (socket says 172.21.15.171:57848) 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fe7fc640 1 -- 172.21.15.171:0/355226521 learned_addr learned my addr 172.21.15.171:0/355226521 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193104829 0 0) 0x7f68000a0810 con 0x7f680009d790 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient(hunting): my global_id is 4602 2024-04-25T23:56:27.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67ec003530 con 0x7f680009d790 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 611736537 0 0) 0x7f67ec003530 con 0x7f680009d790 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 >> v1:172.21.15.171:6789/0 conn(0x7f680009d3b0 legacy=0x7f6800135a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 >> v1:172.21.15.106:6789/0 conn(0x7f680009dbf0 legacy=0x7f680013e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 monclient: found mon.noname-g 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68000a4110 con 0x7f680009d790 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 5 monclient: authenticate success, global_id 4602 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67e80017c0 con 0x7f680009d790 2024-04-25T23:56:27.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: dump: 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:27.214 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67e8001b20 con 0x7f680009d790 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 4 set_mon_vals no callback set 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 1 -- 172.21.15.171:0/355226521 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67e8001d50 con 0x7f680009d790 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f67fdffb640 10 monclient: dump: 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:27.215 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:27.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: shutdown 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- 172.21.15.171:0/355226521 >> v1:172.21.15.171:6790/0 conn(0x7f680009d790 legacy=0x7f680013a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- 172.21.15.171:0/355226521 shutdown_connections 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- 172.21.15.171:0/355226521 >> 172.21.15.171:0/355226521 conn(0x7f68000a72a0 msgr2=0x7f68000a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- 172.21.15.171:0/355226521 shutdown_connections 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 1 -- 172.21.15.171:0/355226521 wait complete. 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: build_initial_monmap 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.218+0000 7f68054c6640 10 monclient: monmap: 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:27.217 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 Processor -- start 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 -- start start 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: init 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:27.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _add_conns ranks=[2,8,5,4,6,0,3,7,1] 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient(hunting): picked mon.noname-b con 0x7f680009d3b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient(hunting): picked mon.noname-e con 0x7f680009d790 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient(hunting): picked mon.noname-h con 0x7f680009dbf0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6800132510 con 0x7f680009d3b0 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6800134800 con 0x7f680009dbf0 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6800133f60 con 0x7f680009d790 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient(hunting): authenticate will time out at 1037.932743s 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67fe7fc640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f680009d790 legacy=0x7f680012b890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67ff7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f680009dbf0 0x7f68001d2440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59458/0 (socket says 172.21.15.171:59458) 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67ff7fe640 1 -- 172.21.15.171:0/732753844 learned_addr learned my addr 172.21.15.171:0/732753844 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953543100 0 0) 0x7f6800134800 con 0x7f680009dbf0 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:27.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): my global_id is 4712 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e0003530 con 0x7f680009dbf0 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1527316016 0 0) 0x7f67e0003530 con 0x7f680009dbf0 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6800134800 con 0x7f680009dbf0 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67f0001d80 con 0x7f680009dbf0 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): dump: 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:27.220 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147722648 0 0) 0x7f6800132510 con 0x7f680009d3b0 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:27.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient(hunting): my global_id is 4574 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67e0003530 con 0x7f680009d3b0 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3523066797 0 0) 0x7f6800134800 con 0x7f680009dbf0 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 >> v1:172.21.15.106:6793/0 conn(0x7f680009d790 legacy=0x7f680012b890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 >> v1:172.21.15.106:6790/0 conn(0x7f680009d3b0 legacy=0x7f6800134f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 monclient: found mon.h 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6800134240 con 0x7f680009dbf0 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:27.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 5 monclient: authenticate success, global_id 4712 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _renew_subs 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68001331e0 con 0x7f680009dbf0 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _renew_subs 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f680012c170 con 0x7f680009dbf0 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67f0003cd0 con 0x7f680009dbf0 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67f0004240 con 0x7f680009dbf0 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67fd7fa640 4 set_mon_vals no callback set 2024-04-25T23:56:27.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 10 monclient: dump: 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:27.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f67f0004460 con 0x7f680009dbf0 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e4005090 con 0x7f680009dbf0 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(24..24 src has 1..24) ==== 3857+0+0 (unknown 3391443726 0 0) 0x7f67f0044980 con 0x7f680009dbf0 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.222+0000 7f67feffd640 10 monclient: get_auth_request con 0x7f67e00377b0 auth_method 0 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.226+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f67f0015bc0 con 0x7f680009dbf0 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.226+0000 7f67f77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:27.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.226+0000 7f67f77fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:27.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.378+0000 7f68054c6640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:27.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.378+0000 7f68054c6640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:27.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.378+0000 7f68054c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:27.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.378+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67e4005380 con 0x7f680009dbf0 2024-04-25T23:56:27.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.786+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}]=0 pool 'testpool1234' removed v25) ==== 176+0+0 (unknown 2731928359 0 0) 0x7f67f0019870 con 0x7f680009dbf0 2024-04-25T23:56:27.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.786+0000 7f67f77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:27.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.786+0000 7f67f77fe640 10 monclient: _finish_command 2 = system:0 pool 'testpool1234' removed 2024-04-25T23:56:27.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.886+0000 7f68054c6640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:27.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.886+0000 7f68054c6640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:27.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.886+0000 7f68054c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:27.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.886+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67e40010a0 con 0x7f680009dbf0 2024-04-25T23:56:27.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.886+0000 7f67f77fe640 1 -- 172.21.15.171:0/732753844 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}]=0 pool 'testpool1234' does not exist v25) ==== 183+0+0 (unknown 3991880879 0 0) 0x7f67f001e130 con 0x7f680009dbf0 2024-04-25T23:56:27.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.886+0000 7f67f77fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "testpool1234", "pool2": "testpool1234", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:27.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.886+0000 7f67f77fe640 10 monclient: _finish_command 3 = system:0 pool 'testpool1234' does not exist 2024-04-25T23:56:27.874 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'testpool1234' does not exist 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 >> v1:172.21.15.171:6812/722422047 conn(0x7f67e00377b0 legacy=0x7f67e0039c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 10 monclient: shutdown 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 >> v1:172.21.15.171:6791/0 conn(0x7f680009dbf0 legacy=0x7f68001d2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 shutdown_connections 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 >> 172.21.15.171:0/732753844 conn(0x7f68000a72a0 msgr2=0x7f680012e570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 shutdown_connections 2024-04-25T23:56:27.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:27.890+0000 7f68054c6640 1 -- 172.21.15.171:0/732753844 wait complete. 2024-04-25T23:56:27.891 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool create foo 123 123 invalid foo-profile foo-rule 2024-04-25T23:56:27.892 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:27.892 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create foo 123 123 invalid foo-profile foo-rule 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient: get_monmap_and_config 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient: build_initial_monmap 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient: monmap: 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:28.031630+0000 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:28.031630+0000 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.012 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:28.013 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 1 Processor -- start 2024-04-25T23:56:28.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 1 -- start start 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient: init 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient: _add_conns ranks=[0,8,1,2,4,3,5,7,6] 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient(hunting): picked mon.noname-a con 0x7fdbe0132790 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient(hunting): picked mon.noname-e con 0x7fdbe00717a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient(hunting): picked mon.noname-f con 0x7fdbe013c000 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe006ea40 con 0x7fdbe0132790 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe0072340 con 0x7fdbe013c000 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe0072620 con 0x7fdbe00717a0 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbe4b34640 10 monclient(hunting): authenticate will time out at 1038.738657s 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbded9d640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fdbe013c000 legacy=0x7fdbe013e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:28.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbddd9b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fdbe00717a0 legacy=0x7fdbe013a8e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbde59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdbe0132790 0x7fdbe0132b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:49328/0 (socket says 172.21.15.171:49328) 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbde59c640 1 -- 172.21.15.171:0/2485631656 learned_addr learned my addr 172.21.15.171:0/2485631656 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581977004 0 0) 0x7fdbe006ea40 con 0x7fdbe0132790 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbdd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbdd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbdd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbdd59a640 10 monclient(hunting): my global_id is 4653 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.026+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbcc003530 con 0x7fdbe0132790 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 536346343 0 0) 0x7fdbcc003530 con 0x7fdbe0132790 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 >> v1:172.21.15.106:6793/0 conn(0x7fdbe00717a0 legacy=0x7fdbe013a8e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 >> v1:172.21.15.171:6789/0 conn(0x7fdbe013c000 legacy=0x7fdbe013e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: _finish_hunting 0 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 monclient: found mon.noname-a 2024-04-25T23:56:28.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe0071c70 con 0x7fdbe0132790 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: _finish_auth 0 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: _check_auth_tickets 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdbc80017c0 con 0x7fdbe0132790 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: dump: 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.023 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 5 monclient: authenticate success, global_id 4653 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbc8001b20 con 0x7fdbe0132790 2024-04-25T23:56:28.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 1 -- 172.21.15.171:0/2485631656 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdbc8001d50 con 0x7fdbe0132790 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 4 set_mon_vals no callback set 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbdd59a640 10 monclient: dump: 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.025 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient: shutdown 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- 172.21.15.171:0/2485631656 >> v1:172.21.15.106:6789/0 conn(0x7fdbe0132790 legacy=0x7fdbe0132b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- 172.21.15.171:0/2485631656 shutdown_connections 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- 172.21.15.171:0/2485631656 >> 172.21.15.171:0/2485631656 conn(0x7fdbe00a6180 msgr2=0x7fdbe00a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- 172.21.15.171:0/2485631656 shutdown_connections 2024-04-25T23:56:28.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- 172.21.15.171:0/2485631656 wait complete. 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient: build_initial_monmap 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient: monmap: 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:28.027 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 Processor -- start 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- start start 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient: init 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient: _add_conns ranks=[4,2,6,5,1,0,7,3,8] 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient(hunting): picked mon.noname-c con 0x7fdbe00717a0 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient(hunting): picked mon.noname-b con 0x7fdbe0132790 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient(hunting): picked mon.noname-d con 0x7fdbe013c000 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe01339e0 con 0x7fdbe0132790 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe009f5c0 con 0x7fdbe00717a0 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe01cb180 con 0x7fdbe013c000 2024-04-25T23:56:28.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbe4b34640 10 monclient(hunting): authenticate will time out at 1038.742627s 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbde59c640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fdbe00717a0 legacy=0x7fdbe01ca360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbded9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fdbe013c000 0x7fdbe01d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:49386/0 (socket says 172.21.15.171:49386) 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbded9d640 1 -- 172.21.15.171:0/1672553369 learned_addr learned my addr 172.21.15.171:0/1672553369 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469025509 0 0) 0x7fdbe01cb180 con 0x7fdbe013c000 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): my global_id is 4668 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbc0003530 con 0x7fdbe013c000 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051260879 0 0) 0x7fdbe01339e0 con 0x7fdbe0132790 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): my global_id is 4583 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbe01cb180 con 0x7fdbe0132790 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 494023301 0 0) 0x7fdbe01cb180 con 0x7fdbe0132790 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbe01339e0 con 0x7fdbe0132790 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdbd0004240 con 0x7fdbe0132790 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.030+0000 7fdbd6ffd640 10 monclient(hunting): dump: 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.030 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4283615382 0 0) 0x7fdbc0003530 con 0x7fdbe013c000 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdbe01cb180 con 0x7fdbe013c000 2024-04-25T23:56:28.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdbd8004560 con 0x7fdbe013c000 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient(hunting): dump: 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.032 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4118966615 0 0) 0x7fdbe01339e0 con 0x7fdbe0132790 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 >> v1:172.21.15.106:6792/0 conn(0x7fdbe013c000 legacy=0x7fdbe01d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 >> v1:172.21.15.106:6791/0 conn(0x7fdbe00717a0 legacy=0x7fdbe01ca360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 monclient: found mon.b 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe009fb10 con 0x7fdbe0132790 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:28.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 5 monclient: authenticate success, global_id 4583 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 10 monclient: _renew_subs 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe0133d90 con 0x7fdbe0132790 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 10 monclient: _renew_subs 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdbe0134e90 con 0x7fdbe0132790 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdbd00047e0 con 0x7fdbe0132790 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdbd0004d50 con 0x7fdbe0132790 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbdcd99640 4 set_mon_vals no callback set 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 10 monclient: dump: 2024-04-25T23:56:28.034 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.035 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbe4b34640 1 -- 172.21.15.171:0/1672553369 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbc4005090 con 0x7fdbe0132790 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdbd0004f70 con 0x7fdbe0132790 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 3506+0+0 (unknown 3054733866 0 0) 0x7fdbd0044400 con 0x7fdbe0132790 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.034+0000 7fdbde59c640 10 monclient: get_auth_request con 0x7fdbc0037de0 auth_method 0 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.046+0000 7fdbd6ffd640 1 -- 172.21.15.171:0/1672553369 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdbd00156c0 con 0x7fdbe0132790 2024-04-25T23:56:28.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.046+0000 7fdbd6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:28.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.046+0000 7fdbd6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:28.180 INFO:tasks.workunit.client.0.smithi171.stderr:foo-rule not valid: foo-rule not one of 'true', 'false' 2024-04-25T23:56:28.181 INFO:tasks.workunit.client.0.smithi171.stderr:Invalid command: unused arguments: ['foo-rule'] 2024-04-25T23:56:28.181 INFO:tasks.workunit.client.0.smithi171.stderr:osd pool create [] [] [] [] [] [] [] [] [] [] [--bulk] [] [] [--yes-i-really-mean-it] : create pool 2024-04-25T23:56:28.181 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: invalid command 2024-04-25T23:56:28.184 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:28.184 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create foo 123 123 replicated 2024-04-25T23:56:28.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.314+0000 7f2957487640 10 monclient: get_monmap_and_config 2024-04-25T23:56:28.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.314+0000 7f2957487640 10 monclient: build_initial_monmap 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.314+0000 7f2957487640 10 monclient: monmap: 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:28.321214+0000 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:28.321214+0000 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:28.302 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:28.303 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:28.303 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:28.303 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 Processor -- start 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- start start 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: init 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: _add_conns ranks=[0,4,2,3,6,7,1,8,5] 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient(hunting): picked mon.noname-a con 0x7f29500a5340 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient(hunting): picked mon.noname-c con 0x7f29500726f0 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient(hunting): picked mon.noname-b con 0x7f295013e320 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295006d630 con 0x7f29500a5340 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29500a3f50 con 0x7f295013e320 2024-04-25T23:56:28.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295006ed20 con 0x7f29500726f0 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient(hunting): authenticate will time out at 1039.028862s 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2954a22640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f29500726f0 legacy=0x7f295013cc00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2955223640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f29500a5340 0x7f2950071fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:49334/0 (socket says 172.21.15.171:49334) 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2955223640 1 -- 172.21.15.171:0/2740485694 learned_addr learned my addr 172.21.15.171:0/2740485694 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589990324 0 0) 0x7f295006d630 con 0x7f29500a5340 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): my global_id is 4662 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f293c003530 con 0x7f29500a5340 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1596255716 0 0) 0x7f29500a3f50 con 0x7f295013e320 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient(hunting): my global_id is 4592 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295006d630 con 0x7f295013e320 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3037469868 0 0) 0x7f295006d630 con 0x7f295013e320 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 >> v1:172.21.15.106:6791/0 conn(0x7f29500726f0 legacy=0x7f295013cc00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 >> v1:172.21.15.106:6789/0 conn(0x7f29500a5340 legacy=0x7f2950071fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 monclient: found mon.noname-b 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295006f000 con 0x7f295013e320 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: _finish_auth 0 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:28.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2948001b20 con 0x7f295013e320 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: dump: 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.309 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 5 monclient: authenticate success, global_id 4592 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2948001e10 con 0x7f295013e320 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 4 set_mon_vals no callback set 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 1 -- 172.21.15.171:0/2740485694 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2948003ce0 con 0x7f295013e320 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:28.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2947fff640 10 monclient: dump: 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.311 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: shutdown 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- 172.21.15.171:0/2740485694 >> v1:172.21.15.106:6790/0 conn(0x7f295013e320 legacy=0x7f2950140710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- 172.21.15.171:0/2740485694 shutdown_connections 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- 172.21.15.171:0/2740485694 >> 172.21.15.171:0/2740485694 conn(0x7f29500a4820 msgr2=0x7f29500a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- 172.21.15.171:0/2740485694 shutdown_connections 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- 172.21.15.171:0/2740485694 wait complete. 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: build_initial_monmap 2024-04-25T23:56:28.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: monmap: 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:28.313 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 Processor -- start 2024-04-25T23:56:28.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 1 -- start start 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.318+0000 7f2957487640 10 monclient: init 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _add_conns ranks=[5,0,3,7,4,6,1,8,2] 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient(hunting): picked mon.noname-h con 0x7f29500726f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient(hunting): picked mon.noname-a con 0x7f29500a5340 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient(hunting): picked mon.noname-g con 0x7f295013e320 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295009e380 con 0x7f29500a5340 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295009ced0 con 0x7f295013e320 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f295006dfa0 con 0x7f29500726f0 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient(hunting): authenticate will time out at 1039.032421s 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2955223640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f29500726f0 0x7f295012e100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59464/0 (socket says 172.21.15.171:59464) 2024-04-25T23:56:28.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2955223640 1 -- 172.21.15.171:0/1018102016 learned_addr learned my addr 172.21.15.171:0/1018102016 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4016439469 0 0) 0x7f295006dfa0 con 0x7f29500726f0 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): my global_id is 4721 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2934003530 con 0x7f29500726f0 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2043007581 0 0) 0x7f295009ced0 con 0x7f295013e320 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): my global_id is 4611 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295006dfa0 con 0x7f295013e320 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 47735783 0 0) 0x7f2934003530 con 0x7f29500726f0 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f295009ced0 con 0x7f29500726f0 2024-04-25T23:56:28.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f294c001910 con 0x7f29500726f0 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.321 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2326508390 0 0) 0x7f295006dfa0 con 0x7f295013e320 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2934003530 con 0x7f295013e320 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2948003d60 con 0x7f295013e320 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:28.322 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.323 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476599284 0 0) 0x7f295009e380 con 0x7f29500a5340 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient(hunting): my global_id is 4671 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f295006dfa0 con 0x7f29500a5340 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2428763788 0 0) 0x7f295009ced0 con 0x7f29500726f0 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 >> v1:172.21.15.171:6790/0 conn(0x7f295013e320 legacy=0x7f29501d9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 >> v1:172.21.15.106:6789/0 conn(0x7f29500a5340 legacy=0x7f29501d5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 monclient: found mon.h 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:28.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295006e410 con 0x7f29500726f0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 5 monclient: authenticate success, global_id 4721 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _renew_subs 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f295009e660 con 0x7f29500726f0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _renew_subs 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f295009ea80 con 0x7f29500726f0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f294c001c90 con 0x7f29500726f0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f294c004e60 con 0x7f29500726f0 2024-04-25T23:56:28.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f29477fe640 4 set_mon_vals no callback set 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 10 monclient: dump: 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:28.326 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2930005090 con 0x7f29500726f0 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f294c0050c0 con 0x7f29500726f0 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(25..25 src has 1..25) ==== 3506+0+0 (unknown 3054733866 0 0) 0x7f294c0442f0 con 0x7f29500726f0 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.322+0000 7f2954a22640 10 monclient: get_auth_request con 0x7f2934037e90 auth_method 0 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.326+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f294c0156f0 con 0x7f29500726f0 2024-04-25T23:56:28.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.326+0000 7f2945ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:28.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.326+0000 7f2945ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:28.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.486+0000 7f2957487640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}] 2024-04-25T23:56:28.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.486+0000 7f2957487640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}] 2024-04-25T23:56:28.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.486+0000 7f2957487640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:28.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.486+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"} v 0) -- 0x7f2930005380 con 0x7f29500726f0 2024-04-25T23:56:28.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.802+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}]=0 pool 'foo' created v26) ==== 154+0+0 (unknown 631208373 0 0) 0x7f294c014ff0 con 0x7f29500726f0 2024-04-25T23:56:28.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.802+0000 7f2945ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}] 2024-04-25T23:56:28.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.802+0000 7f2945ffb640 10 monclient: _finish_command 2 = system:0 pool 'foo' created 2024-04-25T23:56:28.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.918+0000 7f2957487640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}] 2024-04-25T23:56:28.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.918+0000 7f2957487640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}] 2024-04-25T23:56:28.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.918+0000 7f2957487640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:28.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.918+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"} v 0) -- 0x7f2930001150 con 0x7f29500726f0 2024-04-25T23:56:28.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.918+0000 7f2945ffb640 1 -- 172.21.15.171:0/1018102016 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}]=0 pool 'foo' already exists v26) ==== 161+0+0 (unknown 220057628 0 0) 0x7f294c019340 con 0x7f29500726f0 2024-04-25T23:56:28.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.918+0000 7f2945ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123, "pgp_num": 123, "pool_type": "replicated"}] 2024-04-25T23:56:28.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.918+0000 7f2945ffb640 10 monclient: _finish_command 3 = system:0 pool 'foo' already exists 2024-04-25T23:56:28.905 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'foo' already exists 2024-04-25T23:56:28.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 >> v1:172.21.15.171:6812/722422047 conn(0x7f2934037e90 legacy=0x7f293403a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 10 monclient: shutdown 2024-04-25T23:56:28.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:28.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 >> v1:172.21.15.171:6791/0 conn(0x7f29500726f0 legacy=0x7f295012e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:28.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 shutdown_connections 2024-04-25T23:56:28.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 >> 172.21.15.171:0/1018102016 conn(0x7f29500a4820 msgr2=0x7f29500a5c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:28.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 shutdown_connections 2024-04-25T23:56:28.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:28.922+0000 7f2957487640 1 -- 172.21.15.171:0/1018102016 wait complete. 2024-04-25T23:56:28.922 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create fooo 123 123 erasure default 2024-04-25T23:56:29.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.058+0000 7f5ac6572640 10 monclient: get_monmap_and_config 2024-04-25T23:56:29.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.058+0000 7f5ac6572640 10 monclient: build_initial_monmap 2024-04-25T23:56:29.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.058+0000 7f5ac6572640 10 monclient: monmap: 2024-04-25T23:56:29.046 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:29.046 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:29.065904+0000 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:29.065904+0000 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:29.047 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 Processor -- start 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- start start 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: init 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: _add_conns ranks=[3,5,0,7,6,1,2,4,8] 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient(hunting): picked mon.noname-g con 0x7f5ac0132790 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient(hunting): picked mon.noname-h con 0x7f5ac00717a0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:29.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient(hunting): picked mon.noname-a con 0x7f5ac013c000 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac006ea40 con 0x7f5ac013c000 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac0072340 con 0x7f5ac0132790 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac0072620 con 0x7f5ac00717a0 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient(hunting): authenticate will time out at 1039.773068s 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5ac0132790 0x7f5ac0132b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:57864/0 (socket says 172.21.15.171:57864) 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ab7fff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5ac00717a0 0x7f5ac013a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59478/0 (socket says 172.21.15.171:59478) 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abffff640 1 -- 172.21.15.171:0/2788838583 learned_addr learned my addr 172.21.15.171:0/2788838583 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561005269 0 0) 0x7f5ac0072340 con 0x7f5ac0132790 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): my global_id is 4620 2024-04-25T23:56:29.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aac003530 con 0x7f5ac0132790 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829027654 0 0) 0x7f5ac0072620 con 0x7f5ac00717a0 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient(hunting): my global_id is 4730 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ac0072340 con 0x7f5ac00717a0 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1503592512 0 0) 0x7f5aac003530 con 0x7f5ac0132790 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 >> v1:172.21.15.171:6791/0 conn(0x7f5ac00717a0 legacy=0x7f5ac013a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 >> v1:172.21.15.106:6789/0 conn(0x7f5ac013c000 legacy=0x7f5ac013e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 monclient: found mon.noname-g 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:29.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac0071c70 con 0x7f5ac0132790 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ab00017c0 con 0x7f5ac0132790 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: dump: 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:29.057 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 5 monclient: authenticate success, global_id 4620 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ab0001ae0 con 0x7f5ac0132790 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:29.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 4 set_mon_vals no callback set 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 1 -- 172.21.15.171:0/2788838583 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ab0001d50 con 0x7f5ac0132790 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5abf7fe640 10 monclient: dump: 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:29.059 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: shutdown 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- 172.21.15.171:0/2788838583 >> v1:172.21.15.171:6790/0 conn(0x7f5ac0132790 legacy=0x7f5ac0132b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- 172.21.15.171:0/2788838583 shutdown_connections 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- 172.21.15.171:0/2788838583 >> 172.21.15.171:0/2788838583 conn(0x7f5ac00a6180 msgr2=0x7f5ac00a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- 172.21.15.171:0/2788838583 shutdown_connections 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- 172.21.15.171:0/2788838583 wait complete. 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: build_initial_monmap 2024-04-25T23:56:29.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: monmap: 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:29.061 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 Processor -- start 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 1 -- start start 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.062+0000 7f5ac6572640 10 monclient: init 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _add_conns ranks=[6,1,4,8,3,2,0,5,7] 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient(hunting): picked mon.noname-d con 0x7f5ac00717a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient(hunting): picked mon.noname-f con 0x7f5ac0132790 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient(hunting): picked mon.noname-c con 0x7f5ac013c000 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac009fb10 con 0x7f5ac0132790 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac009f5c0 con 0x7f5ac013c000 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ab7fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5ac0132790 legacy=0x7f5ac006fca0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:29.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ac00703b0 con 0x7f5ac00717a0 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient(hunting): authenticate will time out at 1039.776446s 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac4b0f640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5ac013c000 legacy=0x7f5ac01d4680 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5ac00717a0 0x7f5ac006f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:49394/0 (socket says 172.21.15.171:49394) 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abffff640 1 -- 172.21.15.171:0/551420496 learned_addr learned my addr 172.21.15.171:0/551420496 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803382979 0 0) 0x7f5ac00703b0 con 0x7f5ac00717a0 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): my global_id is 4677 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aa0003530 con 0x7f5ac00717a0 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1061692084 0 0) 0x7f5aa0003530 con 0x7f5ac00717a0 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ac00703b0 con 0x7f5ac00717a0 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ab0001780 con 0x7f5ac00717a0 2024-04-25T23:56:29.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): dump: 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:29.064 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2845392244 0 0) 0x7f5ac00703b0 con 0x7f5ac00717a0 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 >> v1:172.21.15.106:6791/0 conn(0x7f5ac013c000 legacy=0x7f5ac01d4680 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 >> v1:172.21.15.171:6789/0 conn(0x7f5ac0132790 legacy=0x7f5ac006fca0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 monclient: found mon.d 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ac01335a0 con 0x7f5ac00717a0 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: _finish_auth 0 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:56:29.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 5 monclient: authenticate success, global_id 4677 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _renew_subs 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5ac0133e40 con 0x7f5ac00717a0 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _renew_subs 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5ac013b370 con 0x7f5ac00717a0 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ab0001d10 con 0x7f5ac00717a0 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abeffd640 4 set_mon_vals no callback set 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ab0001ae0 con 0x7f5ac00717a0 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:29.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5abd7fa640 10 monclient: dump: 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:29.067 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:29.068 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:29.068 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:29.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:29.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:29.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:29.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.066+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5aa4005090 con 0x7f5ac00717a0 2024-04-25T23:56:29.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.070+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5ab000fed0 con 0x7f5ac00717a0 2024-04-25T23:56:29.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.070+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(26..26 src has 1..26) ==== 3848+0+0 (unknown 533206722 0 0) 0x7f5ab00445f0 con 0x7f5ac00717a0 2024-04-25T23:56:29.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.070+0000 7f5ab7fff640 10 monclient: get_auth_request con 0x7f5aa00377e0 auth_method 0 2024-04-25T23:56:29.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.082+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5ab0015880 con 0x7f5ac00717a0 2024-04-25T23:56:29.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.082+0000 7f5abd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:29.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.082+0000 7f5abd7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.246+0000 7f5ac6572640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}] 2024-04-25T23:56:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.246+0000 7f5ac6572640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}] 2024-04-25T23:56:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.246+0000 7f5ac6572640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:29.246+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"} v 0) -- 0x7f5aa4005380 con 0x7f5ac00717a0 2024-04-25T23:56:30.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.830+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}]=0 pool 'fooo' created v28) ==== 188+0+0 (unknown 2510396809 0 0) 0x7f5ab0015180 con 0x7f5ac00717a0 2024-04-25T23:56:30.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.830+0000 7f5abd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}] 2024-04-25T23:56:30.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.830+0000 7f5abd7fa640 10 monclient: _finish_command 2 = system:0 pool 'fooo' created 2024-04-25T23:56:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.950+0000 7f5ac6572640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}] 2024-04-25T23:56:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.950+0000 7f5ac6572640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}] 2024-04-25T23:56:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.950+0000 7f5ac6572640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.950+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"} v 0) -- 0x7f5aa4001170 con 0x7f5ac00717a0 2024-04-25T23:56:30.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.950+0000 7f5abd7fa640 1 -- 172.21.15.171:0/551420496 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}]=0 pool 'fooo' already exists v28) ==== 195+0+0 (unknown 1249814627 0 0) 0x7f5ab001dcd0 con 0x7f5ac00717a0 2024-04-25T23:56:30.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.950+0000 7f5abd7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "fooo", "pg_num": 123, "pgp_num": 123, "pool_type": "erasure", "erasure_code_profile": "default"}] 2024-04-25T23:56:30.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.950+0000 7f5abd7fa640 10 monclient: _finish_command 3 = system:0 pool 'fooo' already exists 2024-04-25T23:56:30.937 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'fooo' already exists 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 >> v1:172.21.15.171:6812/722422047 conn(0x7f5aa00377e0 legacy=0x7f5aa0039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 10 monclient: shutdown 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 >> v1:172.21.15.106:6792/0 conn(0x7f5ac00717a0 legacy=0x7f5ac006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 shutdown_connections 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 >> 172.21.15.171:0/551420496 conn(0x7f5ac00a6180 msgr2=0x7f5ac012c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 shutdown_connections 2024-04-25T23:56:30.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:30.954+0000 7f5ac6572640 1 -- 172.21.15.171:0/551420496 wait complete. 2024-04-25T23:56:30.955 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create foooo 123 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient: get_monmap_and_config 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient: build_initial_monmap 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient: monmap: 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:31.092768+0000 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:31.092768+0000 2024-04-25T23:56:31.073 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:31.074 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:31.077 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:31.077 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 1 Processor -- start 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 1 -- start start 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient: init 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient: _add_conns ranks=[2,6,0,4,3,5,8,7,1] 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient(hunting): picked mon.noname-b con 0x7f6190072200 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient(hunting): picked mon.noname-d con 0x7f61900725e0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient(hunting): picked mon.noname-a con 0x7f6190137d40 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6190072a00 con 0x7f6190137d40 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61900a4550 con 0x7f6190072200 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619006d6b0 con 0x7f61900725e0 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:31.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.086+0000 7f6196559640 10 monclient(hunting): authenticate will time out at 1041.799757s 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618f7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f61900725e0 0x7f61900a3e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:43834/0 (socket says 172.21.15.171:43834) 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618ffff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f6190072200 0x7f61900a3730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:56270/0 (socket says 172.21.15.171:56270) 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618f7fe640 1 -- 172.21.15.171:0/194544538 learned_addr learned my addr 172.21.15.171:0/194544538 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6194af6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6190137d40 0x7f6190140bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:39322/0 (socket says 172.21.15.171:39322) 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285604017 0 0) 0x7f61900a4550 con 0x7f6190072200 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): my global_id is 4601 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6178003530 con 0x7f6190072200 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2614174421 0 0) 0x7f619006d6b0 con 0x7f61900725e0 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:31.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): my global_id is 4686 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61900a4550 con 0x7f61900725e0 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 442356381 0 0) 0x7f6190072a00 con 0x7f6190137d40 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient(hunting): my global_id is 4689 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f619006d6b0 con 0x7f6190137d40 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1401953106 0 0) 0x7f6178003530 con 0x7f6190072200 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 >> v1:172.21.15.106:6792/0 conn(0x7f61900725e0 legacy=0x7f61900a3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 >> v1:172.21.15.106:6789/0 conn(0x7f6190137d40 legacy=0x7f6190140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 monclient: found mon.noname-b 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:31.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f619006ede0 con 0x7f6190072200 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: _finish_auth 0 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61800016f0 con 0x7f6190072200 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: dump: 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:31.089 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 5 monclient: authenticate success, global_id 4601 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61800019a0 con 0x7f6190072200 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:31.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 1 -- 172.21.15.171:0/194544538 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6180004b30 con 0x7f6190072200 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f618effd640 10 monclient: dump: 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:31.091 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 4 set_mon_vals no callback set 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 10 monclient: shutdown 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 1 -- 172.21.15.171:0/194544538 >> v1:172.21.15.106:6790/0 conn(0x7f6190072200 legacy=0x7f61900a3730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 1 -- 172.21.15.171:0/194544538 shutdown_connections 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 1 -- 172.21.15.171:0/194544538 >> 172.21.15.171:0/194544538 conn(0x7f61900a8600 msgr2=0x7f61900a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 1 -- 172.21.15.171:0/194544538 shutdown_connections 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 1 -- 172.21.15.171:0/194544538 wait complete. 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 10 monclient: build_initial_monmap 2024-04-25T23:56:31.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 10 monclient: monmap: 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:31.093 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 1 Processor -- start 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 1 -- start start 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.090+0000 7f6196559640 10 monclient: init 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _add_conns ranks=[2,3,0,8,7,1,6,4,5] 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient(hunting): picked mon.noname-b con 0x7f6190072200 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient(hunting): picked mon.noname-g con 0x7f61900725e0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient(hunting): picked mon.noname-a con 0x7f6190137d40 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6190123b70 con 0x7f6190137d40 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619006e520 con 0x7f6190072200 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f619006e060 con 0x7f61900725e0 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient(hunting): authenticate will time out at 1041.804335s 2024-04-25T23:56:31.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618f7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f61900725e0 0x7f61901361b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:35770/0 (socket says 172.21.15.171:35770) 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618f7fe640 1 -- 172.21.15.171:0/3304434619 learned_addr learned my addr 172.21.15.171:0/3304434619 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2984135690 0 0) 0x7f619006e060 con 0x7f61900725e0 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): my global_id is 4629 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f617c003530 con 0x7f61900725e0 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3527587570 0 0) 0x7f619006e520 con 0x7f6190072200 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): my global_id is 4610 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f619006e060 con 0x7f6190072200 2024-04-25T23:56:31.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1787033800 0 0) 0x7f6190123b70 con 0x7f6190137d40 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): my global_id is 4698 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f619006e520 con 0x7f6190137d40 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 887912858 0 0) 0x7f617c003530 con 0x7f61900725e0 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6190123b70 con 0x7f61900725e0 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6184001b20 con 0x7f61900725e0 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): dump: 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.096 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1872664877 0 0) 0x7f6190123b70 con 0x7f61900725e0 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 >> v1:172.21.15.106:6790/0 conn(0x7f6190072200 legacy=0x7f61901cbf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:31.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 >> v1:172.21.15.106:6789/0 conn(0x7f6190137d40 legacy=0x7f61901d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: _finish_hunting 0 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 monclient: found mon.g 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6190123890 con 0x7f61900725e0 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: _finish_auth 0 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: _check_auth_tickets 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 5 monclient: authenticate success, global_id 4629 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _renew_subs 2024-04-25T23:56:31.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6190122130 con 0x7f61900725e0 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _renew_subs 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6190136a90 con 0x7f61900725e0 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61840010f0 con 0x7f61900725e0 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6184004de0 con 0x7f61900725e0 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618e7fc640 4 set_mon_vals no callback set 2024-04-25T23:56:31.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 10 monclient: dump: 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:31.100 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6184004f80 con 0x7f61900725e0 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6170005090 con 0x7f61900725e0 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(28..28 src has 1..28) ==== 4290+0+0 (unknown 2245054636 0 0) 0x7f6184044690 con 0x7f61900725e0 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.094+0000 7f618ffff640 10 monclient: get_auth_request con 0x7f617c037ad0 auth_method 0 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.098+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6184015700 con 0x7f61900725e0 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.098+0000 7f618cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:31.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.098+0000 7f618cff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.262+0000 7f6196559640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}] 2024-04-25T23:56:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.262+0000 7f6196559640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}] 2024-04-25T23:56:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.262+0000 7f6196559640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.262+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "foooo", "pg_num": 123} v 0) -- 0x7f6170005b90 con 0x7f61900725e0 2024-04-25T23:56:31.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.850+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}]=0 pool 'foooo' created v29) ==== 115+0+0 (unknown 795755057 0 0) 0x7f6184015000 con 0x7f61900725e0 2024-04-25T23:56:31.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.850+0000 7f618cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}] 2024-04-25T23:56:31.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:31.850+0000 7f618cff9640 10 monclient: _finish_command 2 = system:0 pool 'foooo' created 2024-04-25T23:56:31.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.006+0000 7f6196559640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}] 2024-04-25T23:56:31.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.006+0000 7f6196559640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}] 2024-04-25T23:56:31.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.006+0000 7f6196559640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:31.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.006+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "foooo", "pg_num": 123} v 0) -- 0x7f61700010a0 con 0x7f61900725e0 2024-04-25T23:56:31.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f618cff9640 1 -- 172.21.15.171:0/3304434619 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}]=0 pool 'foooo' already exists v29) ==== 122+0+0 (unknown 4284502079 0 0) 0x7f6184019350 con 0x7f61900725e0 2024-04-25T23:56:31.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f618cff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "foooo", "pg_num": 123}] 2024-04-25T23:56:31.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f618cff9640 10 monclient: _finish_command 3 = system:0 pool 'foooo' already exists 2024-04-25T23:56:31.995 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'foooo' already exists 2024-04-25T23:56:31.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 >> v1:172.21.15.171:6812/722422047 conn(0x7f617c037ad0 legacy=0x7f617c039f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:31.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 10 monclient: shutdown 2024-04-25T23:56:31.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:31.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 >> v1:172.21.15.171:6790/0 conn(0x7f61900725e0 legacy=0x7f61901361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:31.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 shutdown_connections 2024-04-25T23:56:31.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 >> 172.21.15.171:0/3304434619 conn(0x7f61900a8600 msgr2=0x7f61900a6ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:31.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 shutdown_connections 2024-04-25T23:56:31.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.010+0000 7f6196559640 1 -- 172.21.15.171:0/3304434619 wait complete. 2024-04-25T23:56:32.012 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create foo 123 2024-04-25T23:56:32.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.138+0000 7f81012d7640 10 monclient: get_monmap_and_config 2024-04-25T23:56:32.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.138+0000 7f81012d7640 10 monclient: build_initial_monmap 2024-04-25T23:56:32.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.138+0000 7f81012d7640 10 monclient: monmap: 2024-04-25T23:56:32.126 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:32.145943+0000 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:32.145943+0000 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:32.127 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 Processor -- start 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- start start 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient: init 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient: _add_conns ranks=[0,2,6,7,8,4,1,3,5] 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient(hunting): picked mon.noname-a con 0x7f80fc0a1530 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient(hunting): picked mon.noname-b con 0x7f80fc071c00 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient(hunting): picked mon.noname-d con 0x7f80fc071730 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc06ea70 con 0x7f80fc0a1530 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc0723d0 con 0x7f80fc071c00 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc072990 con 0x7f80fc071730 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient(hunting): authenticate will time out at 1042.852769s 2024-04-25T23:56:32.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80fa7fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f80fc071c00 0x7f80fc13ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:56300/0 (socket says 172.21.15.171:56300) 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80fa7fc640 1 -- 172.21.15.171:0/621960943 learned_addr learned my addr 172.21.15.171:0/621960943 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80faffd640 1 --1- 172.21.15.171:0/621960943 >> v1:172.21.15.106:6789/0 conn(0x7f80fc0a1530 0x7f80fc0a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:39346/0 (socket says 172.21.15.171:39346) 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693167020 0 0) 0x7f80fc072990 con 0x7f80fc071730 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): my global_id is 4695 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e4003530 con 0x7f80fc071730 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511219674 0 0) 0x7f80fc06ea70 con 0x7f80fc0a1530 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): my global_id is 4707 2024-04-25T23:56:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80fc072990 con 0x7f80fc0a1530 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226478015 0 0) 0x7f80fc0723d0 con 0x7f80fc071c00 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient(hunting): my global_id is 4619 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80fc06ea70 con 0x7f80fc071c00 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2350556256 0 0) 0x7f80fc06ea70 con 0x7f80fc071c00 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 >> v1:172.21.15.106:6792/0 conn(0x7f80fc071730 legacy=0x7f80fc13e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 >> v1:172.21.15.106:6789/0 conn(0x7f80fc0a1530 legacy=0x7f80fc0a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 monclient: found mon.noname-b 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc0a3100 con 0x7f80fc071c00 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80f00016e0 con 0x7f80fc071c00 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: dump: 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.139 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 5 monclient: authenticate success, global_id 4619 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80f0001940 con 0x7f80fc071c00 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:32.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 1 -- 172.21.15.171:0/621960943 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80f00048b0 con 0x7f80fc071c00 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f80f9ffb640 10 monclient: dump: 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.141 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 4 set_mon_vals no callback set 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 10 monclient: shutdown 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- 172.21.15.171:0/621960943 >> v1:172.21.15.106:6790/0 conn(0x7f80fc071c00 legacy=0x7f80fc13ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- 172.21.15.171:0/621960943 shutdown_connections 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- 172.21.15.171:0/621960943 >> 172.21.15.171:0/621960943 conn(0x7f80fc0a62d0 msgr2=0x7f80fc0a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- 172.21.15.171:0/621960943 shutdown_connections 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.142+0000 7f81012d7640 1 -- 172.21.15.171:0/621960943 wait complete. 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: build_initial_monmap 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: monmap: 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:32.143 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 Processor -- start 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 -- start start 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: init 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _add_conns ranks=[1,5,7,2,8,4,3,6,0] 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient(hunting): picked mon.noname-f con 0x7f80fc071730 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:32.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient(hunting): picked mon.noname-h con 0x7f80fc071c00 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient(hunting): picked mon.noname-i con 0x7f80fc0a1530 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc123e90 con 0x7f80fc071730 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc09f660 con 0x7f80fc071c00 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80faffd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f80fc071730 legacy=0x7f80fc1329e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80fc09fb20 con 0x7f80fc0a1530 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient(hunting): authenticate will time out at 1042.857137s 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fb7fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f80fc0a1530 legacy=0x7f80fc1d4920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fa7fc640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f80fc071c00 0x7f80fc1d11f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59952/0 (socket says 172.21.15.171:59952) 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fa7fc640 1 -- 172.21.15.171:0/466070644 learned_addr learned my addr 172.21.15.171:0/466070644 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184288774 0 0) 0x7f80fc09f660 con 0x7f80fc071c00 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): my global_id is 4739 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e8003530 con 0x7f80fc071c00 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3636003081 0 0) 0x7f80e8003530 con 0x7f80fc071c00 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80fc09f660 con 0x7f80fc071c00 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80f0001620 con 0x7f80fc071c00 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): dump: 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.146 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 819073387 0 0) 0x7f80fc09f660 con 0x7f80fc071c00 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6792/0 conn(0x7f80fc0a1530 legacy=0x7f80fc1d4920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:32.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6789/0 conn(0x7f80fc071730 legacy=0x7f80fc1329e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 monclient: found mon.h 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80fc0710b0 con 0x7f80fc071c00 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 5 monclient: authenticate success, global_id 4739 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _renew_subs 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80fc1235a0 con 0x7f80fc071c00 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fa7fc640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6791/0 conn(0x7f80fc071c00 legacy=0x7f80fc1d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-25T23:56:32.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fa7fc640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6791/0 conn(0x7f80fc071c00 legacy=0x7f80fc1d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fa7fc640 1 --1- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6791/0 conn(0x7f80fc071c00 0x7f80fc1d11f0 :-1 s=OPENED pgs=144 cs=1 l=1).handle_message read tag failed 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fa7fc640 1 --1- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6791/0 conn(0x7f80fc071c00 0x7f80fc1d11f0 :-1 s=OPENED pgs=144 cs=1 l=1).fault on lossy channel, failing 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _renew_subs 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f80fc1226b0 con 0x7f80fc071c00 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: ms_handle_reset current mon v1:172.21.15.171:6791/0 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6791/0 conn(0x7f80fc071c00 legacy=0x7f80fc1d11f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _add_conns ranks=[4,8,3,7,5,0,1,6,2] 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): picked mon.c con 0x7f80e8004e90 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): picked mon.e con 0x7f80e80090d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): picked mon.g con 0x7f80e800cfb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f80fc09f660 con 0x7f80e800cfb0 2024-04-25T23:56:32.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f80fc123e90 con 0x7f80e8004e90 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f80fc09fb20 con 0x7f80e80090d0 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fa7fc640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.106:6793/0 conn(0x7f80e80090d0 legacy=0x7f80e800b4c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80faffd640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.106:6791/0 conn(0x7f80e8004e90 legacy=0x7f80e80079b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3521066306 0 0) 0x7f80fc09f660 con 0x7f80e800cfb0 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f80e8011100 con 0x7f80e800cfb0 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2742142875 0 0) 0x7f80e8011100 con 0x7f80e800cfb0 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.106:6793/0 conn(0x7f80e80090d0 legacy=0x7f80e800b4c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.106:6791/0 conn(0x7f80e8004e90 legacy=0x7f80e80079b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:32.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 monclient: found mon.g 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80fb7fe640 1 -- 172.21.15.171:0/466070644 reap_dead start 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f80e8003530 con 0x7f80e800cfb0 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80f4001810 con 0x7f80e800cfb0 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: dump: 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.151 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80f4001f80 con 0x7f80e800cfb0 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80f97fa640 4 set_mon_vals no callback set 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80fc1226b0 con 0x7f80e800cfb0 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f80f400f700 con 0x7f80e800cfb0 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.146+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 6 ==== osd_map(29..29 src has 1..29) ==== 4634+0+0 (unknown 1471941590 0 0) 0x7f80f4043fc0 con 0x7f80e800cfb0 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.150+0000 7f80faffd640 10 monclient: get_auth_request con 0x7f80e803cc70 auth_method 0 2024-04-25T23:56:32.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.154+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f80f4014e80 con 0x7f80e800cfb0 2024-04-25T23:56:32.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.154+0000 7f80e37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:32.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.154+0000 7f80e37fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:32.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.314+0000 7f81012d7640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}] 2024-04-25T23:56:32.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.314+0000 7f81012d7640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}] 2024-04-25T23:56:32.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.314+0000 7f81012d7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.314+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "foo", "pg_num": 123} v 0) -- 0x7f80fc04f510 con 0x7f80e800cfb0 2024-04-25T23:56:32.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.318+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 8 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}]=0 pool 'foo' already exists v29) ==== 118+0+0 (unknown 1333109237 0 0) 0x7f80f4014780 con 0x7f80e800cfb0 2024-04-25T23:56:32.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.318+0000 7f80e37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}] 2024-04-25T23:56:32.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.318+0000 7f80e37fe640 10 monclient: _finish_command 2 = system:0 pool 'foo' already exists 2024-04-25T23:56:32.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.414+0000 7f81012d7640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}] 2024-04-25T23:56:32.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.414+0000 7f81012d7640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}] 2024-04-25T23:56:32.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.414+0000 7f81012d7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.414+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool create", "pool": "foo", "pg_num": 123} v 0) -- 0x7f80fc133170 con 0x7f80e800cfb0 2024-04-25T23:56:32.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.414+0000 7f80e37fe640 1 -- 172.21.15.171:0/466070644 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}]=0 pool 'foo' already exists v29) ==== 118+0+0 (unknown 1333109237 0 0) 0x7f80f401d330 con 0x7f80e800cfb0 2024-04-25T23:56:32.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.414+0000 7f80e37fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "foo", "pg_num": 123}] 2024-04-25T23:56:32.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.414+0000 7f80e37fe640 10 monclient: _finish_command 3 = system:0 pool 'foo' already exists 2024-04-25T23:56:32.401 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'foo' already exists 2024-04-25T23:56:32.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6812/722422047 conn(0x7f80e803cc70 legacy=0x7f80e803f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 10 monclient: shutdown 2024-04-25T23:56:32.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:32.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 >> v1:172.21.15.171:6790/0 conn(0x7f80e800cfb0 legacy=0x7f80e800f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 shutdown_connections 2024-04-25T23:56:32.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 >> 172.21.15.171:0/466070644 conn(0x7f80fc0a62d0 msgr2=0x7f80fc0a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:32.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 shutdown_connections 2024-04-25T23:56:32.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.418+0000 7f81012d7640 1 -- 172.21.15.171:0/466070644 wait complete. 2024-04-25T23:56:32.419 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set foo size 1 --yes-i-really-mean-it 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient: get_monmap_and_config 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient: build_initial_monmap 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient: monmap: 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:32.555705+0000 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:32.555705+0000 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:32.536 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:32.537 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 1 Processor -- start 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 1 -- start start 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient: init 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient: _add_conns ranks=[7,3,5,0,8,2,1,6,4] 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient(hunting): picked mon.noname-i con 0x7f2a981379d0 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient(hunting): picked mon.noname-g con 0x7f2a981384c0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient(hunting): picked mon.noname-h con 0x7f2a9813e620 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a980a2b00 con 0x7f2a981384c0 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a980a2de0 con 0x7f2a9813e620 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a980a17a0 con 0x7f2a981379d0 2024-04-25T23:56:32.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient(hunting): authenticate will time out at 1043.262713s 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9df6a640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f2a981379d0 legacy=0x7f2a98137db0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9d769640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2a981384c0 0x7f2a9813cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:35790/0 (socket says 172.21.15.171:35790) 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9d769640 1 -- 172.21.15.171:0/3302622071 learned_addr learned my addr 172.21.15.171:0/3302622071 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9e76b640 1 --1- 172.21.15.171:0/3302622071 >> v1:172.21.15.171:6791/0 conn(0x7f2a9813e620 0x7f2a98140a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:59968/0 (socket says 172.21.15.171:59968) 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344826524 0 0) 0x7f2a980a2de0 con 0x7f2a9813e620 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): my global_id is 4748 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a80003530 con 0x7f2a9813e620 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269998643 0 0) 0x7f2a980a2b00 con 0x7f2a981384c0 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient(hunting): my global_id is 4638 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a980a2de0 con 0x7f2a981384c0 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3113690687 0 0) 0x7f2a80003530 con 0x7f2a9813e620 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 >> v1:172.21.15.171:6792/0 conn(0x7f2a981379d0 legacy=0x7f2a98137db0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 >> v1:172.21.15.171:6790/0 conn(0x7f2a981384c0 legacy=0x7f2a9813cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: _finish_hunting 0 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 monclient: found mon.noname-h 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a980a3b20 con 0x7f2a9813e620 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: _finish_auth 0 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: _check_auth_tickets 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2a880017c0 con 0x7f2a9813e620 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 5 monclient: authenticate success, global_id 4748 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: dump: 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.547 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a88001a60 con 0x7f2a9813e620 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 1 -- 172.21.15.171:0/3302622071 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2a88004b30 con 0x7f2a9813e620 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2a9cf68640 10 monclient: dump: 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.548 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:32.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.550+0000 7f2aa01ce640 4 set_mon_vals no callback set 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: shutdown 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3302622071 >> v1:172.21.15.171:6791/0 conn(0x7f2a9813e620 legacy=0x7f2a98140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3302622071 shutdown_connections 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3302622071 >> 172.21.15.171:0/3302622071 conn(0x7f2a980a6b30 msgr2=0x7f2a980a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3302622071 shutdown_connections 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3302622071 wait complete. 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: build_initial_monmap 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: monmap: 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:32.550 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:32.551 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 Processor -- start 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- start start 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: init 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _add_conns ranks=[0,8,3,6,1,4,7,5,2] 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient(hunting): picked mon.noname-a con 0x7f2a981379d0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient(hunting): picked mon.noname-e con 0x7f2a981384c0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient(hunting): picked mon.noname-g con 0x7f2a9813e620 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a98137450 con 0x7f2a981379d0 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a981cd630 con 0x7f2a9813e620 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a980a0fa0 con 0x7f2a981384c0 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:32.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient(hunting): authenticate will time out at 1043.265927s 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a9e76b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2a9813e620 0x7f2a981d4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:35794/0 (socket says 172.21.15.171:35794) 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a9e76b640 1 -- 172.21.15.171:0/3248607973 learned_addr learned my addr 172.21.15.171:0/3248607973 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a9d769640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f2a981384c0 legacy=0x7f2a981ccf20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3652115843 0 0) 0x7f2a981cd630 con 0x7f2a9813e620 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): my global_id is 4647 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2a84003530 con 0x7f2a9813e620 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3923928465 0 0) 0x7f2a84003530 con 0x7f2a9813e620 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2a981cd630 con 0x7f2a9813e620 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2a88001c10 con 0x7f2a9813e620 2024-04-25T23:56:32.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): dump: 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.554 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4076789219 0 0) 0x7f2a981cd630 con 0x7f2a9813e620 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 >> v1:172.21.15.106:6793/0 conn(0x7f2a981384c0 legacy=0x7f2a981ccf20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 >> v1:172.21.15.106:6789/0 conn(0x7f2a981379d0 legacy=0x7f2a981cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 monclient: found mon.g 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a98138cd0 con 0x7f2a9813e620 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:32.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 5 monclient: authenticate success, global_id 4647 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _renew_subs 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2a9813c1e0 con 0x7f2a9813e620 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _renew_subs 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2a9813b2f0 con 0x7f2a9813e620 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2a88001a60 con 0x7f2a9813e620 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2a880011a0 con 0x7f2a9813e620 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a97fff640 4 set_mon_vals no callback set 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:32.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 10 monclient: dump: 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:32.557 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a78005090 con 0x7f2a9813e620 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.554+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2a8800fd20 con 0x7f2a9813e620 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.558+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(29..29 src has 1..29) ==== 4634+0+0 (unknown 1471941590 0 0) 0x7f2a88044960 con 0x7f2a9813e620 2024-04-25T23:56:32.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.558+0000 7f2a9df6a640 10 monclient: get_auth_request con 0x7f2a84037710 auth_method 0 2024-04-25T23:56:32.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.562+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2a88019490 con 0x7f2a9813e620 2024-04-25T23:56:32.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.562+0000 7f2a967fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:32.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.562+0000 7f2a967fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:32.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.714+0000 7f2aa01ce640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}] 2024-04-25T23:56:32.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.714+0000 7f2aa01ce640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}] 2024-04-25T23:56:32.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.714+0000 7f2aa01ce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.714+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true} v 0) -- 0x7f2a78005380 con 0x7f2a9813e620 2024-04-25T23:56:32.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.854+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}]=0 set pool 4 size to 1 v30) ==== 152+0+0 (unknown 919328176 0 0) 0x7f2a8801dd50 con 0x7f2a9813e620 2024-04-25T23:56:32.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.854+0000 7f2a967fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}] 2024-04-25T23:56:32.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.854+0000 7f2a967fc640 10 monclient: _finish_command 2 = system:0 set pool 4 size to 1 2024-04-25T23:56:32.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.998+0000 7f2aa01ce640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}] 2024-04-25T23:56:32.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.998+0000 7f2aa01ce640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}] 2024-04-25T23:56:32.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.998+0000 7f2aa01ce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:32.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:32.998+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true} v 0) -- 0x7f2a78001150 con 0x7f2a9813e620 2024-04-25T23:56:33.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.878+0000 7f2a967fc640 1 -- 172.21.15.171:0/3248607973 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}]=0 set pool 4 size to 1 v31) ==== 152+0+0 (unknown 2973845271 0 0) 0x7f2a88013580 con 0x7f2a9813e620 2024-04-25T23:56:33.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.878+0000 7f2a967fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "1", "yes_i_really_mean_it": true}] 2024-04-25T23:56:33.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.878+0000 7f2a967fc640 10 monclient: _finish_command 3 = system:0 set pool 4 size to 1 2024-04-25T23:56:33.869 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 4 size to 1 2024-04-25T23:56:33.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.894+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 >> v1:172.21.15.171:6812/722422047 conn(0x7f2a84037710 legacy=0x7f2a84039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:33.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.894+0000 7f2aa01ce640 10 monclient: shutdown 2024-04-25T23:56:33.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.894+0000 7f2aa01ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:33.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.894+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 >> v1:172.21.15.171:6790/0 conn(0x7f2a9813e620 legacy=0x7f2a981d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:33.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.894+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 shutdown_connections 2024-04-25T23:56:33.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.894+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 >> 172.21.15.171:0/3248607973 conn(0x7f2a980a6b30 msgr2=0x7f2a980a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:33.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.898+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 shutdown_connections 2024-04-25T23:56:33.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:33.898+0000 7f2aa01ce640 1 -- 172.21.15.171:0/3248607973 wait complete. 2024-04-25T23:56:33.913 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_config_value foo min_size 1 2024-04-25T23:56:33.913 INFO:tasks.workunit.client.0.smithi171.stderr:+ local pool_name config_opt expected_val val 2024-04-25T23:56:33.913 INFO:tasks.workunit.client.0.smithi171.stderr:+ pool_name=foo 2024-04-25T23:56:33.913 INFO:tasks.workunit.client.0.smithi171.stderr:+ config_opt=min_size 2024-04-25T23:56:33.913 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_val=1 2024-04-25T23:56:33.913 INFO:tasks.workunit.client.0.smithi171.stderr:++ get_config_value_or_die foo min_size 2024-04-25T23:56:33.913 INFO:tasks.workunit.client.0.smithi171.stderr:++ local pool_name config_opt raw val 2024-04-25T23:56:33.914 INFO:tasks.workunit.client.0.smithi171.stderr:++ pool_name=foo 2024-04-25T23:56:33.914 INFO:tasks.workunit.client.0.smithi171.stderr:++ config_opt=min_size 2024-04-25T23:56:33.914 INFO:tasks.workunit.client.0.smithi171.stderr:+++ ceph osd pool get foo min_size 2024-04-25T23:56:34.313 INFO:tasks.workunit.client.0.smithi171.stderr:++ raw='min_size: 1' 2024-04-25T23:56:34.313 INFO:tasks.workunit.client.0.smithi171.stderr:++ [[ 0 -ne 0 ]] 2024-04-25T23:56:34.313 INFO:tasks.workunit.client.0.smithi171.stderr:+++ echo min_size: 1 2024-04-25T23:56:34.313 INFO:tasks.workunit.client.0.smithi171.stderr:+++ sed -e 's/[{} "]//g' 2024-04-25T23:56:34.315 INFO:tasks.workunit.client.0.smithi171.stderr:++ raw=min_size:1 2024-04-25T23:56:34.315 INFO:tasks.workunit.client.0.smithi171.stderr:+++ cut -f2 -d: 2024-04-25T23:56:34.315 INFO:tasks.workunit.client.0.smithi171.stderr:+++ echo min_size:1 2024-04-25T23:56:34.316 INFO:tasks.workunit.client.0.smithi171.stderr:++ val=1 2024-04-25T23:56:34.316 INFO:tasks.workunit.client.0.smithi171.stderr:++ echo 1 2024-04-25T23:56:34.316 INFO:tasks.workunit.client.0.smithi171.stderr:++ return 0 2024-04-25T23:56:34.316 INFO:tasks.workunit.client.0.smithi171.stderr:+ val=1 2024-04-25T23:56:34.317 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 1 != \1 ]] 2024-04-25T23:56:34.317 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set foo size 4 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient: get_monmap_and_config 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient: build_initial_monmap 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient: monmap: 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:34.451737+0000 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:34.451737+0000 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:34.432 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:34.433 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:34.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 1 Processor -- start 2024-04-25T23:56:34.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 1 -- start start 2024-04-25T23:56:34.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient: init 2024-04-25T23:56:34.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:34.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient: _add_conns ranks=[4,0,6,5,8,1,7,2,3] 2024-04-25T23:56:34.441 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient(hunting): picked mon.noname-c con 0x7f72d006e480 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient(hunting): picked mon.noname-a con 0x7f72d006ef70 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient(hunting): picked mon.noname-d con 0x7f72d013aab0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d0070c60 con 0x7f72d006ef70 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d0070f40 con 0x7f72d006e480 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d006f980 con 0x7f72d013aab0 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 10 monclient(hunting): authenticate will time out at 1045.158556s 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d56b3640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f72d006e480 legacy=0x7f72d006e860 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d4eb2640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f72d006ef70 0x7f72d0139390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:39356/0 (socket says 172.21.15.171:39356) 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d5eb4640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f72d013aab0 0x7f72d013cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:43848/0 (socket says 172.21.15.171:43848) 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d4eb2640 1 -- 172.21.15.171:0/690028781 learned_addr learned my addr 172.21.15.171:0/690028781 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414883698 0 0) 0x7f72d0070c60 con 0x7f72d006ef70 2024-04-25T23:56:34.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): my global_id is 4716 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72bc003450 con 0x7f72d006ef70 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831216282 0 0) 0x7f72d006f980 con 0x7f72d013aab0 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient(hunting): my global_id is 4704 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72d0070c60 con 0x7f72d013aab0 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1873600735 0 0) 0x7f72bc003450 con 0x7f72d006ef70 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 >> v1:172.21.15.106:6792/0 conn(0x7f72d013aab0 legacy=0x7f72d013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 >> v1:172.21.15.106:6791/0 conn(0x7f72d006e480 legacy=0x7f72d006e860 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:34.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 monclient: found mon.noname-a 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d0072e40 con 0x7f72d006ef70 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient: _finish_auth 0 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72c00017c0 con 0x7f72d006ef70 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 5 monclient: authenticate success, global_id 4716 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72c7fff640 10 monclient: dump: 2024-04-25T23:56:34.444 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:34.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.446+0000 7f72d7917640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72c0001ae0 con 0x7f72d006ef70 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c7fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 4 set_mon_vals no callback set 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c7fff640 1 -- 172.21.15.171:0/690028781 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72c0004bf0 con 0x7f72d006ef70 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c7fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c7fff640 10 monclient: dump: 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:34.446 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: shutdown 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- 172.21.15.171:0/690028781 >> v1:172.21.15.106:6789/0 conn(0x7f72d006ef70 legacy=0x7f72d0139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:34.447 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- 172.21.15.171:0/690028781 shutdown_connections 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- 172.21.15.171:0/690028781 >> 172.21.15.171:0/690028781 conn(0x7f72d00a2690 msgr2=0x7f72d00a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- 172.21.15.171:0/690028781 shutdown_connections 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- 172.21.15.171:0/690028781 wait complete. 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: build_initial_monmap 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: monmap: 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:34.448 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 Processor -- start 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- start start 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: init 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: _add_conns ranks=[6,2,8,0,1,7,5,3,4] 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient(hunting): picked mon.noname-d con 0x7f72d006e480 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient(hunting): picked mon.noname-b con 0x7f72d006ef70 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient(hunting): picked mon.noname-e con 0x7f72d013aab0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:34.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d009d500 con 0x7f72d006ef70 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d0131ab0 con 0x7f72d006e480 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72d01c8bf0 con 0x7f72d013aab0 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient(hunting): authenticate will time out at 1045.162360s 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d5eb4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f72d013aab0 legacy=0x7f72d01d0750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d56b3640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f72d006e480 0x7f72d01313a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:43850/0 (socket says 172.21.15.171:43850) 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d56b3640 1 -- 172.21.15.171:0/3941272029 learned_addr learned my addr 172.21.15.171:0/3941272029 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 189337655 0 0) 0x7f72d009d500 con 0x7f72d006ef70 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): my global_id is 4637 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72b4003530 con 0x7f72d006ef70 2024-04-25T23:56:34.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1529889692 0 0) 0x7f72d0131ab0 con 0x7f72d006e480 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): my global_id is 4713 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72d009d500 con 0x7f72d006e480 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3560502822 0 0) 0x7f72b4003530 con 0x7f72d006ef70 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72d0131ab0 con 0x7f72d006ef70 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72c0004b30 con 0x7f72d006ef70 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.451 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1911760329 0 0) 0x7f72d009d500 con 0x7f72d006e480 2024-04-25T23:56:34.452 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72b4003530 con 0x7f72d006e480 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72cc004380 con 0x7f72d006e480 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:34.453 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3688761510 0 0) 0x7f72d0131ab0 con 0x7f72d006ef70 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 >> v1:172.21.15.106:6793/0 conn(0x7f72d013aab0 legacy=0x7f72d01d0750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 >> v1:172.21.15.106:6792/0 conn(0x7f72d006e480 legacy=0x7f72d01313a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 monclient: found mon.b 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72d0072300 con 0x7f72d006ef70 2024-04-25T23:56:34.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 5 monclient: authenticate success, global_id 4637 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: _renew_subs 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72d009f7f0 con 0x7f72d006ef70 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: _renew_subs 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.450+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f72d01c7d00 con 0x7f72d006ef70 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72c0001860 con 0x7f72d006ef70 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c77fe640 4 set_mon_vals no callback set 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72c00051b0 con 0x7f72d006ef70 2024-04-25T23:56:34.455 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 10 monclient: dump: 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:34.456 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72d7917640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72d7917640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72d7917640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72b0005090 con 0x7f72d006ef70 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f72c000ff50 con 0x7f72d006ef70 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(31..31 src has 1..31) ==== 4634+0+0 (unknown 544173280 0 0) 0x7f72c00448f0 con 0x7f72d006ef70 2024-04-25T23:56:34.457 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.454+0000 7f72d56b3640 10 monclient: get_auth_request con 0x7f72b4037d70 auth_method 0 2024-04-25T23:56:34.458 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.466+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f72c0015870 con 0x7f72d006ef70 2024-04-25T23:56:34.458 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.466+0000 7f72c5ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:34.458 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.466+0000 7f72c5ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:34.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.626+0000 7f72d7917640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}] 2024-04-25T23:56:34.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.626+0000 7f72d7917640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}] 2024-04-25T23:56:34.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.626+0000 7f72d7917640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:34.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.626+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"} v 0) -- 0x7f72b0005b90 con 0x7f72d006ef70 2024-04-25T23:56:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.874+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}]=0 set pool 4 size to 4 v32) ==== 122+0+0 (unknown 3836657792 0 0) 0x7f72c0015170 con 0x7f72d006ef70 2024-04-25T23:56:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.882+0000 7f72c5ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}] 2024-04-25T23:56:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:34.882+0000 7f72c5ffb640 10 monclient: _finish_command 2 = system:0 set pool 4 size to 4 2024-04-25T23:56:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.006+0000 7f72d7917640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}] 2024-04-25T23:56:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.006+0000 7f72d7917640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}] 2024-04-25T23:56:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.006+0000 7f72d7917640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.006+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"} v 0) -- 0x7f72b0005610 con 0x7f72d006ef70 2024-04-25T23:56:35.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.906+0000 7f72c5ffb640 1 -- 172.21.15.171:0/3941272029 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}]=0 set pool 4 size to 4 v33) ==== 122+0+0 (unknown 1714120015 0 0) 0x7f72c0014d10 con 0x7f72d006ef70 2024-04-25T23:56:35.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.906+0000 7f72c5ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "4"}] 2024-04-25T23:56:35.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.906+0000 7f72c5ffb640 10 monclient: _finish_command 3 = system:0 set pool 4 size to 4 2024-04-25T23:56:35.894 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 4 size to 4 2024-04-25T23:56:35.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 >> v1:172.21.15.171:6812/722422047 conn(0x7f72b4037d70 legacy=0x7f72b403a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:35.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 10 monclient: shutdown 2024-04-25T23:56:35.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:35.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 >> v1:172.21.15.106:6790/0 conn(0x7f72d006ef70 legacy=0x7f72d01cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:35.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 shutdown_connections 2024-04-25T23:56:35.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 >> 172.21.15.171:0/3941272029 conn(0x7f72d00a2690 msgr2=0x7f72d00a3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:35.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 shutdown_connections 2024-04-25T23:56:35.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:35.914+0000 7f72d7917640 1 -- 172.21.15.171:0/3941272029 wait complete. 2024-04-25T23:56:35.928 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_config_value foo min_size 2 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:+ local pool_name config_opt expected_val val 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:+ pool_name=foo 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:+ config_opt=min_size 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_val=2 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:++ get_config_value_or_die foo min_size 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:++ local pool_name config_opt raw val 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:++ pool_name=foo 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:++ config_opt=min_size 2024-04-25T23:56:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:+++ ceph osd pool get foo min_size 2024-04-25T23:56:36.352 INFO:tasks.workunit.client.0.smithi171.stderr:++ raw='min_size: 2' 2024-04-25T23:56:36.352 INFO:tasks.workunit.client.0.smithi171.stderr:++ [[ 0 -ne 0 ]] 2024-04-25T23:56:36.353 INFO:tasks.workunit.client.0.smithi171.stderr:+++ echo min_size: 2 2024-04-25T23:56:36.353 INFO:tasks.workunit.client.0.smithi171.stderr:+++ sed -e 's/[{} "]//g' 2024-04-25T23:56:36.354 INFO:tasks.workunit.client.0.smithi171.stderr:++ raw=min_size:2 2024-04-25T23:56:36.355 INFO:tasks.workunit.client.0.smithi171.stderr:+++ echo min_size:2 2024-04-25T23:56:36.355 INFO:tasks.workunit.client.0.smithi171.stderr:+++ cut -f2 -d: 2024-04-25T23:56:36.356 INFO:tasks.workunit.client.0.smithi171.stderr:++ val=2 2024-04-25T23:56:36.357 INFO:tasks.workunit.client.0.smithi171.stderr:++ echo 2 2024-04-25T23:56:36.357 INFO:tasks.workunit.client.0.smithi171.stderr:++ return 0 2024-04-25T23:56:36.357 INFO:tasks.workunit.client.0.smithi171.stderr:+ val=2 2024-04-25T23:56:36.357 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 2 != \2 ]] 2024-04-25T23:56:36.357 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set foo size 10 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.482+0000 7fc6a2b4c640 10 monclient: get_monmap_and_config 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.482+0000 7fc6a2b4c640 10 monclient: build_initial_monmap 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.482+0000 7fc6a2b4c640 10 monclient: monmap: 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:36.490431+0000 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:36.490431+0000 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:36.471 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:36.472 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:36.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 Processor -- start 2024-04-25T23:56:36.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- start start 2024-04-25T23:56:36.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: init 2024-04-25T23:56:36.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:36.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: _add_conns ranks=[6,2,3,5,1,0,7,8,4] 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient(hunting): picked mon.noname-d con 0x7fc69c0a3eb0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient(hunting): picked mon.noname-b con 0x7fc69c135ad0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient(hunting): picked mon.noname-g con 0x7fc69c13c020 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c09af50 con 0x7fc69c135ad0 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c0a4290 con 0x7fc69c13c020 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c136030 con 0x7fc69c0a3eb0 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient(hunting): authenticate will time out at 1047.197430s 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a10e9640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc69c13c020 0x7fc69c13e410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:35802/0 (socket says 172.21.15.171:35802) 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a10e9640 1 -- 172.21.15.171:0/3020998618 learned_addr learned my addr 172.21.15.171:0/3020998618 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460804740 0 0) 0x7fc69c0a4290 con 0x7fc69c13c020 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:36.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient(hunting): my global_id is 4656 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc684003530 con 0x7fc69c13c020 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2001680584 0 0) 0x7fc684003530 con 0x7fc69c13c020 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 >> v1:172.21.15.106:6792/0 conn(0x7fc69c0a3eb0 legacy=0x7fc69c09d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 >> v1:172.21.15.106:6790/0 conn(0x7fc69c135ad0 legacy=0x7fc69c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 monclient: found mon.noname-g 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c09dd60 con 0x7fc69c13c020 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:36.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 5 monclient: authenticate success, global_id 4656 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc6940017c0 con 0x7fc69c13c020 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: dump: 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:36.482 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:36.483 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc694001ab0 con 0x7fc69c13c020 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 1 -- 172.21.15.171:0/3020998618 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc694004bf0 con 0x7fc69c13c020 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 4 set_mon_vals no callback set 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:36.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc69b7fe640 10 monclient: dump: 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:36.485 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: shutdown 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3020998618 >> v1:172.21.15.171:6790/0 conn(0x7fc69c13c020 legacy=0x7fc69c13e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3020998618 shutdown_connections 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3020998618 >> 172.21.15.171:0/3020998618 conn(0x7fc69c0a72a0 msgr2=0x7fc69c0a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3020998618 shutdown_connections 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3020998618 wait complete. 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: build_initial_monmap 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: monmap: 2024-04-25T23:56:36.486 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:36.487 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 Processor -- start 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 1 -- start start 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.486+0000 7fc6a2b4c640 10 monclient: init 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _add_conns ranks=[5,8,3,7,2,6,0,1,4] 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient(hunting): picked mon.noname-h con 0x7fc69c0a3eb0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient(hunting): picked mon.noname-e con 0x7fc69c135ad0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient(hunting): picked mon.noname-g con 0x7fc69c13c020 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c09d420 con 0x7fc69c13c020 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c1cb2f0 con 0x7fc69c0a3eb0 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc69c11d2f0 con 0x7fc69c135ad0 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:36.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient(hunting): authenticate will time out at 1047.200412s 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a08e8640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc69c0a3eb0 0x7fc69c1324b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:60010/0 (socket says 172.21.15.171:60010) 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a08e8640 1 -- 172.21.15.171:0/3421863719 learned_addr learned my addr 172.21.15.171:0/3421863719 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a10e9640 1 --1- 172.21.15.171:0/3421863719 >> v1:172.21.15.171:6790/0 conn(0x7fc69c13c020 0x7fc69c1d2e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:35808/0 (socket says 172.21.15.171:35808) 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc69bfff640 1 -- 172.21.15.171:0/3421863719 >> v1:172.21.15.106:6793/0 conn(0x7fc69c135ad0 legacy=0x7fc69c1cf740 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556719924 0 0) 0x7fc69c09d420 con 0x7fc69c13c020 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): my global_id is 4665 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc688003530 con 0x7fc69c13c020 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101791635 0 0) 0x7fc69c1cb2f0 con 0x7fc69c0a3eb0 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:36.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): my global_id is 4775 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc69c09d420 con 0x7fc69c0a3eb0 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 906090984 0 0) 0x7fc688003530 con 0x7fc69c13c020 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc69c1cb2f0 con 0x7fc69c13c020 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc694001780 con 0x7fc69c13c020 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): dump: 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:36.490 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3272773265 0 0) 0x7fc69c09d420 con 0x7fc69c0a3eb0 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc688003530 con 0x7fc69c0a3eb0 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc690001a00 con 0x7fc69c0a3eb0 2024-04-25T23:56:36.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient(hunting): dump: 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:36.492 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4053232143 0 0) 0x7fc69c1cb2f0 con 0x7fc69c13c020 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 >> v1:172.21.15.106:6793/0 conn(0x7fc69c135ad0 legacy=0x7fc69c1cf740 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 >> v1:172.21.15.171:6791/0 conn(0x7fc69c0a3eb0 legacy=0x7fc69c1324b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: _finish_hunting 0 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 monclient: found mon.g 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:36.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc69c139dc0 con 0x7fc69c13c020 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: _finish_auth 0 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: _check_auth_tickets 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 5 monclient: authenticate success, global_id 4665 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _renew_subs 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc69c11db70 con 0x7fc69c13c020 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _renew_subs 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc69c1ca420 con 0x7fc69c13c020 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc694004c10 con 0x7fc69c13c020 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:36.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc6940051b0 con 0x7fc69c13c020 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc69affd640 4 set_mon_vals no callback set 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 10 monclient: dump: 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:36.495 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc69400ff50 con 0x7fc69c13c020 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc67c005090 con 0x7fc69c13c020 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(33..33 src has 1..33) ==== 4634+0+0 (unknown 3064446599 0 0) 0x7fc6940448e0 con 0x7fc69c13c020 2024-04-25T23:56:36.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.490+0000 7fc6a08e8640 10 monclient: get_auth_request con 0x7fc688037e00 auth_method 0 2024-04-25T23:56:36.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.494+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc6940157a0 con 0x7fc69c13c020 2024-04-25T23:56:36.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.494+0000 7fc6997fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:36.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.494+0000 7fc6997fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:36.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.642+0000 7fc6a2b4c640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}] 2024-04-25T23:56:36.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.642+0000 7fc6a2b4c640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}] 2024-04-25T23:56:36.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.642+0000 7fc6a2b4c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:36.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.642+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"} v 0) -- 0x7fc67c005b90 con 0x7fc69c13c020 2024-04-25T23:56:36.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.910+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}]=0 set pool 4 size to 10 v34) ==== 124+0+0 (unknown 1976903813 0 0) 0x7fc6940193f0 con 0x7fc69c13c020 2024-04-25T23:56:36.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.910+0000 7fc6997fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}] 2024-04-25T23:56:36.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:36.910+0000 7fc6997fa640 10 monclient: _finish_command 2 = system:0 set pool 4 size to 10 2024-04-25T23:56:37.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.058+0000 7fc6a2b4c640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}] 2024-04-25T23:56:37.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.058+0000 7fc6a2b4c640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}] 2024-04-25T23:56:37.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.058+0000 7fc6a2b4c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:37.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.058+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"} v 0) -- 0x7fc67c0010a0 con 0x7fc69c13c020 2024-04-25T23:56:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.938+0000 7fc6997fa640 1 -- 172.21.15.171:0/3421863719 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}]=0 set pool 4 size to 10 v35) ==== 124+0+0 (unknown 29507002 0 0) 0x7fc69401dcb0 con 0x7fc69c13c020 2024-04-25T23:56:37.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.938+0000 7fc6997fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "10"}] 2024-04-25T23:56:37.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.938+0000 7fc6997fa640 10 monclient: _finish_command 3 = system:0 set pool 4 size to 10 2024-04-25T23:56:37.933 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 4 size to 10 2024-04-25T23:56:37.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 >> v1:172.21.15.171:6812/722422047 conn(0x7fc688037e00 legacy=0x7fc68803a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:37.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 10 monclient: shutdown 2024-04-25T23:56:37.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:37.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 >> v1:172.21.15.171:6790/0 conn(0x7fc69c13c020 legacy=0x7fc69c1d2e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:37.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 shutdown_connections 2024-04-25T23:56:37.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 >> 172.21.15.171:0/3421863719 conn(0x7fc69c0a72a0 msgr2=0x7fc69c0a1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:37.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 shutdown_connections 2024-04-25T23:56:37.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:37.954+0000 7fc6a2b4c640 1 -- 172.21.15.171:0/3421863719 wait complete. 2024-04-25T23:56:37.984 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_config_value foo min_size 5 2024-04-25T23:56:37.984 INFO:tasks.workunit.client.0.smithi171.stderr:+ local pool_name config_opt expected_val val 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:+ pool_name=foo 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:+ config_opt=min_size 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_val=5 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:++ get_config_value_or_die foo min_size 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:++ local pool_name config_opt raw val 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:++ pool_name=foo 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:++ config_opt=min_size 2024-04-25T23:56:37.985 INFO:tasks.workunit.client.0.smithi171.stderr:+++ ceph osd pool get foo min_size 2024-04-25T23:56:41.420 INFO:tasks.workunit.client.0.smithi171.stderr:++ raw='min_size: 5' 2024-04-25T23:56:41.421 INFO:tasks.workunit.client.0.smithi171.stderr:++ [[ 0 -ne 0 ]] 2024-04-25T23:56:41.421 INFO:tasks.workunit.client.0.smithi171.stderr:+++ echo min_size: 5 2024-04-25T23:56:41.421 INFO:tasks.workunit.client.0.smithi171.stderr:+++ sed -e 's/[{} "]//g' 2024-04-25T23:56:41.422 INFO:tasks.workunit.client.0.smithi171.stderr:++ raw=min_size:5 2024-04-25T23:56:41.423 INFO:tasks.workunit.client.0.smithi171.stderr:+++ echo min_size:5 2024-04-25T23:56:41.423 INFO:tasks.workunit.client.0.smithi171.stderr:+++ cut -f2 -d: 2024-04-25T23:56:41.424 INFO:tasks.workunit.client.0.smithi171.stderr:++ val=5 2024-04-25T23:56:41.424 INFO:tasks.workunit.client.0.smithi171.stderr:++ echo 5 2024-04-25T23:56:41.424 INFO:tasks.workunit.client.0.smithi171.stderr:++ return 0 2024-04-25T23:56:41.425 INFO:tasks.workunit.client.0.smithi171.stderr:+ val=5 2024-04-25T23:56:41.425 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 5 != \5 ]] 2024-04-25T23:56:41.425 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool set foo size 0 2024-04-25T23:56:41.425 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:41.425 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set foo size 0 2024-04-25T23:56:41.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient: get_monmap_and_config 2024-04-25T23:56:41.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient: build_initial_monmap 2024-04-25T23:56:41.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient: monmap: 2024-04-25T23:56:41.544 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:41.544 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.544 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:41.563809+0000 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:41.563809+0000 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:41.545 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 1 Processor -- start 2024-04-25T23:56:41.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 1 -- start start 2024-04-25T23:56:41.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient: init 2024-04-25T23:56:41.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:41.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient: _add_conns ranks=[1,2,5,6,7,4,0,3,8] 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient(hunting): picked mon.noname-f con 0x7eff0c071f90 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient(hunting): picked mon.noname-b con 0x7eff0c137c90 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient(hunting): picked mon.noname-h con 0x7eff0c13e1e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0c06ec60 con 0x7eff0c071f90 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0c06ef40 con 0x7eff0c137c90 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0c070830 con 0x7eff0c13e1e0 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient(hunting): authenticate will time out at 1052.270641s 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff1187a640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7eff0c071f90 legacy=0x7eff0c072370 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff1207b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7eff0c13e1e0 0x7eff0c1405d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43216/0 (socket says 172.21.15.171:43216) 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff1207b640 1 -- 172.21.15.171:0/638363401 learned_addr learned my addr 172.21.15.171:0/638363401 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154073096 0 0) 0x7eff0c070830 con 0x7eff0c13e1e0 2024-04-25T23:56:41.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient(hunting): my global_id is 4793 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efef8003530 con 0x7eff0c13e1e0 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1438812892 0 0) 0x7efef8003530 con 0x7eff0c13e1e0 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 >> v1:172.21.15.106:6790/0 conn(0x7eff0c137c90 legacy=0x7eff0c13cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 >> v1:172.21.15.171:6789/0 conn(0x7eff0c071f90 legacy=0x7eff0c072370 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: _finish_hunting 0 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 monclient: found mon.noname-h 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c0a5250 con 0x7eff0c13e1e0 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: _finish_auth 0 2024-04-25T23:56:41.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: _check_auth_tickets 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7eff04001b40 con 0x7eff0c13e1e0 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: dump: 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.555 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 5 monclient: authenticate success, global_id 4793 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff04001ea0 con 0x7eff0c13e1e0 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff10878640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.558+0000 7eff13ade640 4 set_mon_vals no callback set 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff10878640 1 -- 172.21.15.171:0/638363401 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7eff040020d0 con 0x7eff0c13e1e0 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff10878640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:41.556 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff10878640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff10878640 10 monclient: dump: 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: shutdown 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/638363401 >> v1:172.21.15.171:6791/0 conn(0x7eff0c13e1e0 legacy=0x7eff0c1405d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/638363401 shutdown_connections 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/638363401 >> 172.21.15.171:0/638363401 conn(0x7eff0c0a8400 msgr2=0x7eff0c0a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/638363401 shutdown_connections 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/638363401 wait complete. 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: build_initial_monmap 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: monmap: 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:41.558 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 Processor -- start 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- start start 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: init 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _add_conns ranks=[3,0,8,6,2,5,7,4,1] 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient(hunting): picked mon.noname-g con 0x7eff0c071f90 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient(hunting): picked mon.noname-a con 0x7eff0c137c90 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient(hunting): picked mon.noname-e con 0x7eff0c13e1e0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0c13d0e0 con 0x7eff0c137c90 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0c13ce00 con 0x7eff0c071f90 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff0c13d3c0 con 0x7eff0c13e1e0 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient(hunting): authenticate will time out at 1052.273710s 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff1187a640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7eff0c071f90 0x7eff0c1369c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:55826/0 (socket says 172.21.15.171:55826) 2024-04-25T23:56:41.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff1187a640 1 -- 172.21.15.171:0/3910356519 learned_addr learned my addr 172.21.15.171:0/3910356519 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff1207b640 1 -- 172.21.15.171:0/3910356519 >> v1:172.21.15.106:6793/0 conn(0x7eff0c13e1e0 legacy=0x7eff0c1d49f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 533898703 0 0) 0x7eff0c13ce00 con 0x7eff0c071f90 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): my global_id is 4692 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efef0003530 con 0x7eff0c071f90 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1932265813 0 0) 0x7efef0003530 con 0x7eff0c071f90 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff0c13ce00 con 0x7eff0c071f90 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7eff08004300 con 0x7eff0c071f90 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): dump: 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.561 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.562 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052272988 0 0) 0x7eff0c13d0e0 con 0x7eff0c137c90 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient(hunting): my global_id is 4725 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efef0003530 con 0x7eff0c137c90 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 237210257 0 0) 0x7eff0c13ce00 con 0x7eff0c071f90 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 >> v1:172.21.15.106:6793/0 conn(0x7eff0c13e1e0 legacy=0x7eff0c1d49f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 >> v1:172.21.15.106:6789/0 conn(0x7eff0c137c90 legacy=0x7eff0c1d12c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 monclient: found mon.g 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:41.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff0c13bc90 con 0x7eff0c071f90 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 5 monclient: authenticate success, global_id 4692 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _renew_subs 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff0c1cc1c0 con 0x7eff0c071f90 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _renew_subs 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7eff0c1370d0 con 0x7eff0c071f90 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff080045f0 con 0x7eff0c071f90 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7eff08004b60 con 0x7eff0c071f90 2024-04-25T23:56:41.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff03fff640 4 set_mon_vals no callback set 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff027fc640 10 monclient: dump: 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.565 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.562+0000 7eff13ade640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efef4005090 con 0x7eff0c071f90 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.566+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7eff08004dc0 con 0x7eff0c071f90 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.566+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7eff08044990 con 0x7eff0c071f90 2024-04-25T23:56:41.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.566+0000 7eff11079640 10 monclient: get_auth_request con 0x7efef0037810 auth_method 0 2024-04-25T23:56:41.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.570+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7eff080157f0 con 0x7eff0c071f90 2024-04-25T23:56:41.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.570+0000 7eff027fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:41.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.570+0000 7eff027fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:41.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.718+0000 7eff13ade640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "0"}] 2024-04-25T23:56:41.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.718+0000 7eff13ade640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "0"}] 2024-04-25T23:56:41.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.718+0000 7eff13ade640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:41.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.718+0000 7eff13ade640 1 -- 172.21.15.171:0/3910356519 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "0"} v 0) -- 0x7efef4005b90 con 0x7eff0c071f90 2024-04-25T23:56:41.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.722+0000 7eff027fc640 1 -- 172.21.15.171:0/3910356519 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "0"}]=-22 pool size must be between 1 and 10 v35) ==== 136+0+0 (unknown 1184131494 0 0) 0x7eff080150f0 con 0x7eff0c071f90 2024-04-25T23:56:41.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.722+0000 7eff027fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "0"}] 2024-04-25T23:56:41.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.722+0000 7eff027fc640 10 monclient: _finish_command 2 = mon:22 pool size must be between 1 and 10 2024-04-25T23:56:41.707 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: pool size must be between 1 and 10 2024-04-25T23:56:41.711 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:41.711 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool set foo size 20 2024-04-25T23:56:41.711 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:41.711 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set foo size 20 2024-04-25T23:56:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient: get_monmap_and_config 2024-04-25T23:56:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient: build_initial_monmap 2024-04-25T23:56:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient: monmap: 2024-04-25T23:56:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:41.847901+0000 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:41.847901+0000 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:41.829 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 1 Processor -- start 2024-04-25T23:56:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 1 -- start start 2024-04-25T23:56:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient: init 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient: _add_conns ranks=[6,2,8,7,1,3,0,5,4] 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient(hunting): picked mon.noname-d con 0x7efdbc0a1340 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient(hunting): picked mon.noname-b con 0x7efdbc0a1720 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient(hunting): picked mon.noname-e con 0x7efdbc0a1b60 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc136320 con 0x7efdbc0a1720 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc072a00 con 0x7efdbc0a1340 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc072440 con 0x7efdbc0a1b60 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc328d640 10 monclient(hunting): authenticate will time out at 1052.554961s 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc182a640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7efdbc0a1b60 legacy=0x7efdbc13dfa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc1029640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7efdbc0a1340 0x7efdbc135c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:56564/0 (socket says 172.21.15.171:56564) 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdc1029640 1 -- 172.21.15.171:0/2544378332 learned_addr learned my addr 172.21.15.171:0/2544378332 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2527074565 0 0) 0x7efdbc136320 con 0x7efdbc0a1720 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): my global_id is 4682 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda8003530 con 0x7efdbc0a1720 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2004346106 0 0) 0x7efdbc072a00 con 0x7efdbc0a1340 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 10 monclient(hunting): my global_id is 4740 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.842+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc136320 con 0x7efdbc0a1340 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2750643983 0 0) 0x7efda8003530 con 0x7efdbc0a1720 2024-04-25T23:56:41.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 >> v1:172.21.15.106:6793/0 conn(0x7efdbc0a1b60 legacy=0x7efdbc13dfa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 >> v1:172.21.15.106:6792/0 conn(0x7efdbc0a1340 legacy=0x7efdbc135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 monclient: found mon.noname-b 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc072720 con 0x7efdbc0a1720 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: _finish_auth 0 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 5 monclient: authenticate success, global_id 4682 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb80017c0 con 0x7efdbc0a1720 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:41.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: dump: 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.840 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdb8001a70 con 0x7efdbc0a1720 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 4 set_mon_vals no callback set 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 1 -- 172.21.15.171:0/2544378332 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb8003960 con 0x7efdbc0a1720 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb3fff640 10 monclient: dump: 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.841 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: shutdown 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- 172.21.15.171:0/2544378332 >> v1:172.21.15.106:6790/0 conn(0x7efdbc0a1720 legacy=0x7efdbc13a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- 172.21.15.171:0/2544378332 shutdown_connections 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- 172.21.15.171:0/2544378332 >> 172.21.15.171:0/2544378332 conn(0x7efdbc0a8400 msgr2=0x7efdbc0a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- 172.21.15.171:0/2544378332 shutdown_connections 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- 172.21.15.171:0/2544378332 wait complete. 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: build_initial_monmap 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: monmap: 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:41.843 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 Processor -- start 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- start start 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: init 2024-04-25T23:56:41.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: _add_conns ranks=[2,6,5,7,3,0,1,8,4] 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient(hunting): picked mon.noname-b con 0x7efdbc0a1340 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient(hunting): picked mon.noname-d con 0x7efdbc0a1720 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient(hunting): picked mon.noname-h con 0x7efdbc0a1b60 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc120320 con 0x7efdbc0a1340 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc071870 con 0x7efdbc0a1b60 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdbc1209b0 con 0x7efdbc0a1720 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient(hunting): authenticate will time out at 1052.558580s 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc182a640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7efdbc0a1b60 0x7efdbc1d25d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43226/0 (socket says 172.21.15.171:43226) 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc182a640 1 -- 172.21.15.171:0/2201734839 learned_addr learned my addr 172.21.15.171:0/2201734839 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554746955 0 0) 0x7efdb4003dd0 con 0x7efdbc0a1b60 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): my global_id is 4802 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda0003530 con 0x7efdbc0a1b60 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3253089153 0 0) 0x7efdbc120320 con 0x7efdbc0a1340 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): my global_id is 4691 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdb4003dd0 con 0x7efdbc0a1340 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1712262280 0 0) 0x7efda0003530 con 0x7efdbc0a1b60 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdbc120320 con 0x7efdbc0a1b60 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb40047c0 con 0x7efdbc0a1b60 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:41.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.847 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994670797 0 0) 0x7efdbc1209b0 con 0x7efdbc0a1720 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient(hunting): my global_id is 4749 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda0003530 con 0x7efdbc0a1720 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1997259239 0 0) 0x7efdbc120320 con 0x7efdbc0a1b60 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 >> v1:172.21.15.106:6792/0 conn(0x7efdbc0a1720 legacy=0x7efdbc1ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 >> v1:172.21.15.106:6790/0 conn(0x7efdbc0a1340 legacy=0x7efdbc1349b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 monclient: found mon.h 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:41.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdbc121b80 con 0x7efdbc0a1b60 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 5 monclient: authenticate success, global_id 4802 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: _renew_subs 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efdbc121e60 con 0x7efdbc0a1b60 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: _renew_subs 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdc328d640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7efdbc1350c0 con 0x7efdbc0a1b60 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdb4004a20 con 0x7efdbc0a1b60 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb4004f10 con 0x7efdbc0a1b60 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:41.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb37fe640 4 set_mon_vals no callback set 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.846+0000 7efdb1ffb640 10 monclient: dump: 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:41.850 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.850+0000 7efdc328d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.850+0000 7efdc328d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.850+0000 7efdc328d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.850+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7efdb40050b0 con 0x7efdbc0a1b60 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.850+0000 7efdc328d640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd9c005090 con 0x7efdbc0a1b60 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.850+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7efdb4044d90 con 0x7efdbc0a1b60 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.850+0000 7efdc1029640 10 monclient: get_auth_request con 0x7efda0037af0 auth_method 0 2024-04-25T23:56:41.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.854+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7efdbc071870 con 0x7efdbc0a1b60 2024-04-25T23:56:41.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.854+0000 7efdb1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:41.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:41.854+0000 7efdb1ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:41.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.002+0000 7efdc328d640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "20"}] 2024-04-25T23:56:41.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.002+0000 7efdc328d640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "20"}] 2024-04-25T23:56:41.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.002+0000 7efdc328d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:41.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.002+0000 7efdc328d640 1 -- 172.21.15.171:0/2201734839 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "20"} v 0) -- 0x7efd9c005b90 con 0x7efdbc0a1b60 2024-04-25T23:56:41.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.006+0000 7efdb1ffb640 1 -- 172.21.15.171:0/2201734839 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "20"}]=-22 pool size must be between 1 and 10 v35) ==== 137+0+0 (unknown 1496131530 0 0) 0x7efdb4015bf0 con 0x7efdbc0a1b60 2024-04-25T23:56:41.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.006+0000 7efdb1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "foo", "var": "size", "val": "20"}] 2024-04-25T23:56:41.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.006+0000 7efdb1ffb640 10 monclient: _finish_command 2 = mon:22 pool size must be between 1 and 10 2024-04-25T23:56:41.992 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: pool size must be between 1 and 10 2024-04-25T23:56:41.996 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:41.997 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool delete foo 2024-04-25T23:56:41.997 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:41.997 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foo 2024-04-25T23:56:42.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient: get_monmap_and_config 2024-04-25T23:56:42.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient: build_initial_monmap 2024-04-25T23:56:42.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient: monmap: 2024-04-25T23:56:42.109 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:42.109 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.109 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:42.128929+0000 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:42.128929+0000 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:42.110 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 1 Processor -- start 2024-04-25T23:56:42.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 1 -- start start 2024-04-25T23:56:42.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient: init 2024-04-25T23:56:42.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:42.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient: _add_conns ranks=[0,5,8,2,3,7,4,6,1] 2024-04-25T23:56:42.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient(hunting): picked mon.noname-a con 0x7fa764135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient(hunting): picked mon.noname-h con 0x7fa7641356f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient(hunting): picked mon.noname-e con 0x7fa76413c130 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640a1da0 con 0x7fa764135bb0 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7640a1fe0 con 0x7fa7641356f0 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa764072720 con 0x7fa76413c130 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa76b7dd640 10 monclient(hunting): authenticate will time out at 1052.835779s 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa769d7a640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fa76413c130 legacy=0x7fa76413e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa768d78640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fa7641356f0 0x7fa76413aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43228/0 (socket says 172.21.15.171:43228) 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.122+0000 7fa768d78640 1 -- 172.21.15.171:0/1405109193 learned_addr learned my addr 172.21.15.171:0/1405109193 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066348982 0 0) 0x7fa7640a1fe0 con 0x7fa7641356f0 2024-04-25T23:56:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient(hunting): my global_id is 4811 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa750003530 con 0x7fa7641356f0 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1180813732 0 0) 0x7fa750003530 con 0x7fa7641356f0 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 >> v1:172.21.15.106:6793/0 conn(0x7fa76413c130 legacy=0x7fa76413e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 >> v1:172.21.15.106:6789/0 conn(0x7fa764135bb0 legacy=0x7fa764135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 monclient: found mon.noname-h 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640a17f0 con 0x7fa7641356f0 2024-04-25T23:56:42.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: _finish_auth 0 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 5 monclient: authenticate success, global_id 4811 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa7600017c0 con 0x7fa7641356f0 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: dump: 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa760001aa0 con 0x7fa7641356f0 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 1 -- 172.21.15.171:0/1405109193 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa760004bf0 con 0x7fa7641356f0 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 4 set_mon_vals no callback set 2024-04-25T23:56:42.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75bfff640 10 monclient: dump: 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.122 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: shutdown 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1405109193 >> v1:172.21.15.171:6791/0 conn(0x7fa7641356f0 legacy=0x7fa76413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1405109193 shutdown_connections 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1405109193 >> 172.21.15.171:0/1405109193 conn(0x7fa7640a2620 msgr2=0x7fa7640a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1405109193 shutdown_connections 2024-04-25T23:56:42.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1405109193 wait complete. 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: build_initial_monmap 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: monmap: 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:42.124 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 Processor -- start 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- start start 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: init 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: _add_conns ranks=[1,3,4,6,5,7,2,0,8] 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient(hunting): picked mon.noname-f con 0x7fa7641356f0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient(hunting): picked mon.noname-g con 0x7fa764135bb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient(hunting): picked mon.noname-c con 0x7fa76413c130 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:42.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa764071ef0 con 0x7fa7641356f0 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa76413ae50 con 0x7fa764135bb0 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7641cad30 con 0x7fa76413c130 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa769579640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fa7641356f0 legacy=0x7fa7641c9f10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient(hunting): authenticate will time out at 1052.838836s 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa768d78640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fa764135bb0 0x7fa7641ca620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:55836/0 (socket says 172.21.15.171:55836) 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa768d78640 1 -- 172.21.15.171:0/1589917029 learned_addr learned my addr 172.21.15.171:0/1589917029 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa769d7a640 1 -- 172.21.15.171:0/1589917029 >> v1:172.21.15.106:6791/0 conn(0x7fa76413c130 legacy=0x7fa7641d2460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645933725 0 0) 0x7fa76413ae50 con 0x7fa764135bb0 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): my global_id is 4701 2024-04-25T23:56:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa748003560 con 0x7fa764135bb0 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 982162731 0 0) 0x7fa748003560 con 0x7fa764135bb0 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa76413ae50 con 0x7fa764135bb0 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa760004b30 con 0x7fa764135bb0 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): dump: 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.127 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3375864368 0 0) 0x7fa76413ae50 con 0x7fa764135bb0 2024-04-25T23:56:42.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 >> v1:172.21.15.106:6791/0 conn(0x7fa76413c130 legacy=0x7fa7641d2460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 >> v1:172.21.15.171:6789/0 conn(0x7fa7641356f0 legacy=0x7fa7641c9f10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 monclient: found mon.g 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7640719a0 con 0x7fa764135bb0 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 5 monclient: authenticate success, global_id 4701 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: _renew_subs 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1589917029 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa76413a3d0 con 0x7fa764135bb0 2024-04-25T23:56:42.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: _renew_subs 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1589917029 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa764139c00 con 0x7fa764135bb0 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa760001aa0 con 0x7fa764135bb0 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa760001c70 con 0x7fa764135bb0 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa75b7fe640 4 set_mon_vals no callback set 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.126+0000 7fa759ffb640 10 monclient: dump: 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.130 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.131 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.132 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.132 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.132 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.132 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.132 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.130+0000 7fa76b7dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:42.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.130+0000 7fa76b7dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:42.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.130+0000 7fa76b7dd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:42.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.130+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1589917029 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa744005090 con 0x7fa764135bb0 2024-04-25T23:56:42.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.130+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa7600100f0 con 0x7fa764135bb0 2024-04-25T23:56:42.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.130+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7fa760044b30 con 0x7fa764135bb0 2024-04-25T23:56:42.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.130+0000 7fa769579640 10 monclient: get_auth_request con 0x7fa7480377d0 auth_method 0 2024-04-25T23:56:42.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.134+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa760015a50 con 0x7fa764135bb0 2024-04-25T23:56:42.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.134+0000 7fa759ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:42.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.134+0000 7fa759ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:42.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.290+0000 7fa76b7dd640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foo"}] 2024-04-25T23:56:42.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.290+0000 7fa76b7dd640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "foo"}] 2024-04-25T23:56:42.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.290+0000 7fa76b7dd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:42.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.290+0000 7fa76b7dd640 1 -- 172.21.15.171:0/1589917029 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "foo"} v 0) -- 0x7fa744005380 con 0x7fa764135bb0 2024-04-25T23:56:42.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.294+0000 7fa759ffb640 1 -- 172.21.15.171:0/1589917029 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foo"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool foo. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v35) ==== 274+0+0 (unknown 544749059 0 0) 0x7fa76001df00 con 0x7fa764135bb0 2024-04-25T23:56:42.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.294+0000 7fa759ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "foo"}] 2024-04-25T23:56:42.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.294+0000 7fa759ffb640 10 monclient: _finish_command 2 = mon:1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool foo. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2024-04-25T23:56:42.279 INFO:tasks.workunit.client.0.smithi171.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool foo. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2024-04-25T23:56:42.283 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:42.283 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool delete foo foo 2024-04-25T23:56:42.283 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:42.283 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foo foo 2024-04-25T23:56:42.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.410+0000 7f050ceb3640 10 monclient: get_monmap_and_config 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.410+0000 7f050ceb3640 10 monclient: build_initial_monmap 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.410+0000 7f050ceb3640 10 monclient: monmap: 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:42.418417+0000 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:42.418417+0000 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:42.399 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:42.400 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:42.400 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:42.400 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 Processor -- start 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- start start 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: init 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: _add_conns ranks=[6,4,3,2,1,5,8,0,7] 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient(hunting): picked mon.noname-d con 0x7f050806e410 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient(hunting): picked mon.noname-c con 0x7f050806ef00 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:42.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient(hunting): picked mon.noname-g con 0x7f050813aab0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0508070cd0 con 0x7f050813aab0 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050806f690 con 0x7f050806ef00 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080a1790 con 0x7f050806e410 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient(hunting): authenticate will time out at 1053.125407s 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f0505d9b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f050806ef00 legacy=0x7f0508139390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f0506d9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f050813aab0 0x7f050813cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:55848/0 (socket says 172.21.15.171:55848) 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f0506d9d640 1 -- 172.21.15.171:0/1067821488 learned_addr learned my addr 172.21.15.171:0/1067821488 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1797037078 0 0) 0x7f0508070cd0 con 0x7f050813aab0 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient(hunting): _negotiate 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient(hunting): my global_id is 4710 2024-04-25T23:56:42.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f0003450 con 0x7f050813aab0 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3505650996 0 0) 0x7f04f0003450 con 0x7f050813aab0 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 >> v1:172.21.15.106:6792/0 conn(0x7f050806e410 legacy=0x7f050806e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 >> v1:172.21.15.106:6791/0 conn(0x7f050806ef00 legacy=0x7f0508139390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: _finish_hunting 0 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 monclient: found mon.noname-g 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050806fbd0 con 0x7f050813aab0 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: _finish_auth 0 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: _check_auth_tickets 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04f80017c0 con 0x7f050813aab0 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 5 monclient: authenticate success, global_id 4710 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:42.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: dump: 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.410 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04f8001b20 con 0x7f050813aab0 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 4 set_mon_vals no callback set 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 1 -- 172.21.15.171:0/1067821488 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04f8001d50 con 0x7f050813aab0 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050559a640 10 monclient: dump: 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.411 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.412 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: shutdown 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- 172.21.15.171:0/1067821488 >> v1:172.21.15.171:6790/0 conn(0x7f050813aab0 legacy=0x7f050813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- 172.21.15.171:0/1067821488 shutdown_connections 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- 172.21.15.171:0/1067821488 >> 172.21.15.171:0/1067821488 conn(0x7f05080a62d0 msgr2=0x7f05080a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- 172.21.15.171:0/1067821488 shutdown_connections 2024-04-25T23:56:42.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- 172.21.15.171:0/1067821488 wait complete. 2024-04-25T23:56:42.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: build_initial_monmap 2024-04-25T23:56:42.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: monmap: 2024-04-25T23:56:42.414 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:42.414 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:42.415 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 Processor -- start 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 1 -- start start 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.414+0000 7f050ceb3640 10 monclient: init 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _add_conns ranks=[5,2,7,1,3,0,4,8,6] 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient(hunting): picked mon.noname-h con 0x7f050806e410 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient(hunting): picked mon.noname-b con 0x7f050806ef00 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient(hunting): picked mon.noname-i con 0x7f050813aab0 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0508070510 con 0x7f050806ef00 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050806ffc0 con 0x7f050806e410 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f050809b0a0 con 0x7f050813aab0 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient(hunting): authenticate will time out at 1053.128123s 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f0506d9d640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f050813aab0 legacy=0x7f05081d4a30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:42.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050659c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f050806e410 0x7f050809f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43236/0 (socket says 172.21.15.171:43236) 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050659c640 1 -- 172.21.15.171:0/4194868523 learned_addr learned my addr 172.21.15.171:0/4194868523 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 731912897 0 0) 0x7f050806ffc0 con 0x7f050806e410 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 4820 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e8003530 con 0x7f050806e410 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2564214582 0 0) 0x7f04e8003530 con 0x7f050806e410 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f050806ffc0 con 0x7f050806e410 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0500001a80 con 0x7f050806e410 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:42.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): dump: 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.418 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564200877 0 0) 0x7f04fc003dd0 con 0x7f050806ef00 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 4700 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e8003530 con 0x7f050806ef00 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3119856765 0 0) 0x7f050806ffc0 con 0x7f050806e410 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 >> v1:172.21.15.171:6792/0 conn(0x7f050813aab0 legacy=0x7f05081d4a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 >> v1:172.21.15.106:6790/0 conn(0x7f050806ef00 legacy=0x7f05081d1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:42.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 monclient: found mon.h 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f050809ad90 con 0x7f050806e410 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 5 monclient: authenticate success, global_id 4820 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _renew_subs 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0508131a90 con 0x7f050806e410 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _renew_subs 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:42.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0508130540 con 0x7f050806e410 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0500003950 con 0x7f050806e410 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0500003ec0 con 0x7f050806e410 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f0504d99640 4 set_mon_vals no callback set 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 10 monclient: dump: 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.421 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:42.422 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f050ceb3640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ec005090 con 0x7f050806e410 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f05000040e0 con 0x7f050806e410 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7f0500044990 con 0x7f050806e410 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.418+0000 7f0505d9b640 10 monclient: get_auth_request con 0x7f04e8037710 auth_method 0 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.422+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0500015930 con 0x7f050806e410 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.422+0000 7f04f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:42.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.422+0000 7f04f6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.574+0000 7f050ceb3640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo"}] 2024-04-25T23:56:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.574+0000 7f050ceb3640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo"}] 2024-04-25T23:56:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.574+0000 7f050ceb3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.574+0000 7f050ceb3640 1 -- 172.21.15.171:0/4194868523 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "foo", "pool2": "foo"} v 0) -- 0x7f04ec005b90 con 0x7f050806e410 2024-04-25T23:56:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.574+0000 7f04f6ffd640 1 -- 172.21.15.171:0/4194868523 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo"}]=-1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool foo. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. v35) ==== 290+0+0 (unknown 2967130567 0 0) 0x7f0500015230 con 0x7f050806e410 2024-04-25T23:56:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.574+0000 7f04f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo"}] 2024-04-25T23:56:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.574+0000 7f04f6ffd640 10 monclient: _finish_command 2 = mon:1 WARNING: this will *PERMANENTLY DESTROY* all data stored in pool foo. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2024-04-25T23:56:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in pool foo. If you are *ABSOLUTELY CERTAIN* that is what you want, pass the pool name *twice*, followed by --yes-i-really-really-mean-it. 2024-04-25T23:56:42.566 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:42.567 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool delete foo foo --force 2024-04-25T23:56:42.567 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:42.567 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foo foo --force 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient: get_monmap_and_config 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient: build_initial_monmap 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient: monmap: 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:42.706563+0000 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:42.706563+0000 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:42.687 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:42.688 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:42.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 1 Processor -- start 2024-04-25T23:56:42.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 1 -- start start 2024-04-25T23:56:42.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient: init 2024-04-25T23:56:42.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:42.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient: _add_conns ranks=[7,1,8,4,3,6,2,0,5] 2024-04-25T23:56:42.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient(hunting): picked mon.noname-i con 0x7f5d28135a00 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient(hunting): picked mon.noname-f con 0x7f5d280a1790 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient(hunting): picked mon.noname-e con 0x7f5d2813c130 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d280a1d80 con 0x7f5d280a1790 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d28072f70 con 0x7f5d28135a00 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d28072640 con 0x7f5d2813c130 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2e3d9640 10 monclient(hunting): authenticate will time out at 1053.413461s 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d27fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5d28135a00 legacy=0x7f5d28135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d277fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5d280a1790 legacy=0x7f5d2813aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:42.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.702+0000 7f5d2c976640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5d2813c130 legacy=0x7f5d2813e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:42.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.906+0000 7f5d27fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5d28135a00 legacy=0x7f5d28135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:42.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.906+0000 7f5d277fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5d280a1790 legacy=0x7f5d2813aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:42.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:42.906+0000 7f5d2c976640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5d2813c130 legacy=0x7f5d2813e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:43.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:43.310+0000 7f5d277fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5d280a1790 legacy=0x7f5d2813aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:43.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:43.310+0000 7f5d27fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5d28135a00 legacy=0x7f5d28135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:43.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:43.310+0000 7f5d2c976640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5d2813c130 legacy=0x7f5d2813e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:44.114+0000 7f5d277fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5d280a1790 legacy=0x7f5d2813aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:44.114+0000 7f5d27fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5d28135a00 legacy=0x7f5d28135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:44.114+0000 7f5d2c976640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5d2813c130 legacy=0x7f5d2813e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient(hunting): tick 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 1 monclient(hunting): continuing hunt 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5d2813c130 legacy=0x7f5d2813e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5d28135a00 legacy=0x7f5d28135de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5d280a1790 legacy=0x7f5d2813aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient: _add_conns ranks=[4,6,5,0,3,2] 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f5d14003790 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient(hunting): picked mon.noname-d con 0x7f5d14007420 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient(hunting): picked mon.noname-h con 0x7f5d1400b1b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:45.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d28072920 con 0x7f5d14003790 2024-04-25T23:56:45.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d280a1d80 con 0x7f5d1400b1b0 2024-04-25T23:56:45.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d28072f70 con 0x7f5d14007420 2024-04-25T23:56:45.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d25ffb640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:45.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d27fff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5d14003790 legacy=0x7f5d14005be0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:45.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d2c976640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5d1400b1b0 0x7f5d1400d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43250/0 (socket says 172.21.15.171:43250) 2024-04-25T23:56:45.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d2c976640 1 -- 172.21.15.171:0/3322349697 learned_addr learned my addr 172.21.15.171:0/3322349697 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1095029126 0 0) 0x7f5d280a1d80 con 0x7f5d1400b1b0 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): my global_id is 4829 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d10003530 con 0x7f5d1400b1b0 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918714883 0 0) 0x7f5d28072f70 con 0x7f5d14007420 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient(hunting): my global_id is 4767 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d280a1d80 con 0x7f5d14007420 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1251190347 0 0) 0x7f5d10003530 con 0x7f5d1400b1b0 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 >> v1:172.21.15.106:6792/0 conn(0x7f5d14007420 legacy=0x7f5d140098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:45.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 >> v1:172.21.15.106:6791/0 conn(0x7f5d14003790 legacy=0x7f5d14005be0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 monclient: found mon.noname-h 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d2c976640 1 -- 172.21.15.171:0/3322349697 reap_dead start 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d28072640 con 0x7f5d1400b1b0 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: _finish_auth 0 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d200045f0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: dump: 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.693 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d2e3d9640 5 monclient: authenticate success, global_id 4829 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d2e3d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d200048d0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 1 -- 172.21.15.171:0/3322349697 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d20004e40 con 0x7f5d1400b1b0 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d2e3d9640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d2e3d9640 4 set_mon_vals no callback set 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.706+0000 7f5d26ffd640 10 monclient: dump: 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:45.695 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient: shutdown 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/3322349697 >> v1:172.21.15.171:6791/0 conn(0x7f5d1400b1b0 legacy=0x7f5d1400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/3322349697 shutdown_connections 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/3322349697 >> 172.21.15.171:0/3322349697 conn(0x7f5d280a2690 msgr2=0x7f5d280a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/3322349697 shutdown_connections 2024-04-25T23:56:45.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/3322349697 wait complete. 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient: build_initial_monmap 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient: monmap: 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:45.700 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 Processor -- start 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- start start 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient: init 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient: _add_conns ranks=[3,2,5,4,6,1,0,8,7] 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient(hunting): picked mon.noname-g con 0x7f5d1400b1b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:45.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient(hunting): picked mon.noname-b con 0x7f5d2809d7d0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 10 monclient(hunting): picked mon.noname-h con 0x7f5d281cac50 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d281373b0 con 0x7f5d2809d7d0 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d28135e90 con 0x7f5d1400b1b0 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.710+0000 7f5d2e3d9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2809f6f0 con 0x7f5d281cac50 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient(hunting): authenticate will time out at 1056.420022s 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d27fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5d1400b1b0 0x7f5d281ca540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:55864/0 (socket says 172.21.15.171:55864) 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d27fff640 1 -- 172.21.15.171:0/2007032797 learned_addr learned my addr 172.21.15.171:0/2007032797 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2c976640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5d281cac50 0x7f5d281d2c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43266/0 (socket says 172.21.15.171:43266) 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443870190 0 0) 0x7f5d2809f6f0 con 0x7f5d281cac50 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:45.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): my global_id is 4838 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d140106d0 con 0x7f5d281cac50 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2476154692 0 0) 0x7f5d28135e90 con 0x7f5d1400b1b0 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): my global_id is 4719 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2809f6f0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762045091 0 0) 0x7f5d281373b0 con 0x7f5d2809d7d0 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): my global_id is 4709 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d28135e90 con 0x7f5d2809d7d0 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2155782502 0 0) 0x7f5d2809f6f0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d281373b0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1710413675 0 0) 0x7f5d140106d0 con 0x7f5d281cac50 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d2809f6f0 con 0x7f5d281cac50 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d180043b0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): dump: 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:45.704 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d20004590 con 0x7f5d281cac50 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient(hunting): dump: 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:45.705 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3164945227 0 0) 0x7f5d281373b0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 >> v1:172.21.15.171:6791/0 conn(0x7f5d281cac50 legacy=0x7f5d281d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 >> v1:172.21.15.106:6790/0 conn(0x7f5d2809d7d0 legacy=0x7f5d281cf560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 monclient: found mon.g 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:45.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2809fc40 con 0x7f5d1400b1b0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: _finish_auth 0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 5 monclient: authenticate success, global_id 4719 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient: _renew_subs 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2809e270 con 0x7f5d1400b1b0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient: _renew_subs 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5d28136df0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d180048d0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d18004e40 con 0x7f5d1400b1b0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:45.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d267fc640 4 set_mon_vals no callback set 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 10 monclient: dump: 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:45.708 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5d18004fe0 con 0x7f5d1400b1b0 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d2e3d9640 1 -- 172.21.15.171:0/2007032797 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d08005090 con 0x7f5d1400b1b0 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7f5d18044960 con 0x7f5d1400b1b0 2024-04-25T23:56:45.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.714+0000 7f5d277fe640 10 monclient: get_auth_request con 0x7f5d14038b60 auth_method 0 2024-04-25T23:56:45.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.718+0000 7f5d24ff9640 1 -- 172.21.15.171:0/2007032797 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5d18015760 con 0x7f5d1400b1b0 2024-04-25T23:56:45.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.718+0000 7f5d24ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:45.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:45.718+0000 7f5d24ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:45.868 INFO:tasks.workunit.client.0.smithi171.stderr:--force not valid: --force not one of 'true', 'false' 2024-04-25T23:56:45.868 INFO:tasks.workunit.client.0.smithi171.stderr:Invalid command: unused arguments: ['--force'] 2024-04-25T23:56:45.868 INFO:tasks.workunit.client.0.smithi171.stderr:osd pool delete [] [--yes-i-really-really-mean-it] [--yes-i-really-really-mean-it-not-faking] : delete pool 2024-04-25T23:56:45.868 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: invalid command 2024-04-25T23:56:45.871 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:45.871 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool delete foo fooo --yes-i-really-mean-it 2024-04-25T23:56:45.871 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:45.871 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foo fooo --yes-i-really-mean-it 2024-04-25T23:56:45.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient: get_monmap_and_config 2024-04-25T23:56:45.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient: build_initial_monmap 2024-04-25T23:56:45.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient: monmap: 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:46.003967+0000 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:46.003967+0000 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:45.985 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:45.986 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:45.986 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:45.986 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 1 Processor -- start 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 1 -- start start 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient: init 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient: _add_conns ranks=[8,0,6,4,7,5,1,2,3] 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient(hunting): picked mon.noname-e con 0x7f06b8134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient(hunting): picked mon.noname-a con 0x7f06b8134d50 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient(hunting): picked mon.noname-d con 0x7f06b8135150 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b8071330 con 0x7f06b8134d50 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b806fe10 con 0x7f06b8135150 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b8071610 con 0x7f06b8134970 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:45.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06c022a640 10 monclient(hunting): authenticate will time out at 1056.710851s 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bdfc6640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f06b8134970 legacy=0x7f06b80726e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bd7c5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f06b8134d50 0x7f06b81398d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42760/0 (socket says 172.21.15.171:42760) 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bd7c5640 1 -- 172.21.15.171:0/4210236654 learned_addr learned my addr 172.21.15.171:0/4210236654 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2075503865 0 0) 0x7f06b4001120 con 0x7f06b8134d50 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): _negotiate 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): my global_id is 4743 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06a4005740 con 0x7f06b8134d50 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832753965 0 0) 0x7f06b806fe10 con 0x7f06b8135150 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): _negotiate 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:45.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 10 monclient(hunting): my global_id is 4776 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.002+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06b4001120 con 0x7f06b8135150 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3640499621 0 0) 0x7f06b4001120 con 0x7f06b8135150 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 >> v1:172.21.15.106:6793/0 conn(0x7f06b8134970 legacy=0x7f06b80726e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 >> v1:172.21.15.106:6789/0 conn(0x7f06b8134d50 legacy=0x7f06b81398d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: _finish_hunting 0 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 monclient: found mon.noname-d 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b80718f0 con 0x7f06b8135150 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: _finish_auth 0 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: _check_auth_tickets 2024-04-25T23:56:45.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f06b0001a50 con 0x7f06b8135150 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: dump: 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:45.995 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 5 monclient: authenticate success, global_id 4776 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06b0001d40 con 0x7f06b8135150 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 4 set_mon_vals no callback set 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 1 -- 172.21.15.171:0/4210236654 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f06b0003ce0 con 0x7f06b8135150 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:45.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bcfc4640 10 monclient: dump: 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:45.997 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient: shutdown 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- 172.21.15.171:0/4210236654 >> v1:172.21.15.106:6792/0 conn(0x7f06b8135150 legacy=0x7f06b813d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- 172.21.15.171:0/4210236654 shutdown_connections 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- 172.21.15.171:0/4210236654 >> 172.21.15.171:0/4210236654 conn(0x7f06b80a7350 msgr2=0x7f06b80a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- 172.21.15.171:0/4210236654 shutdown_connections 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- 172.21.15.171:0/4210236654 wait complete. 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient: build_initial_monmap 2024-04-25T23:56:45.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient: monmap: 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:45.999 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 Processor -- start 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- start start 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient: init 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient: _add_conns ranks=[7,8,2,5,6,3,4,1,0] 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient(hunting): picked mon.noname-i con 0x7f06b8134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient(hunting): picked mon.noname-e con 0x7f06b8134d50 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient(hunting): picked mon.noname-b con 0x7f06b8135150 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b81228f0 con 0x7f06b8135150 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bdfc6640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f06b8134970 legacy=0x7f06b81c86f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b8120aa0 con 0x7f06b8134970 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b8070540 con 0x7f06b8134d50 2024-04-25T23:56:46.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06c022a640 10 monclient(hunting): authenticate will time out at 1056.714457s 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06bd7c5640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f06b8134d50 legacy=0x7f06b81cd6d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06be7c7640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f06b8135150 0x7f06b81d0e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:40824/0 (socket says 172.21.15.171:40824) 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06be7c7640 1 -- 172.21.15.171:0/2472505492 learned_addr learned my addr 172.21.15.171:0/2472505492 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463840148 0 0) 0x7f06b81228f0 con 0x7f06b8135150 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): my global_id is 4718 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f069c003530 con 0x7f06b8135150 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4209067778 0 0) 0x7f069c003530 con 0x7f06b8135150 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06b81228f0 con 0x7f06b8135150 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f06b0001a10 con 0x7f06b8135150 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:46.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): dump: 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:46.002 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4110312376 0 0) 0x7f06b81228f0 con 0x7f06b8135150 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 >> v1:172.21.15.106:6793/0 conn(0x7f06b8134d50 legacy=0x7f06b81cd6d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 >> v1:172.21.15.171:6792/0 conn(0x7f06b8134970 legacy=0x7f06b81c86f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 monclient: found mon.b 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b8070900 con 0x7f06b8135150 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.006+0000 7f06ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:46.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 5 monclient: authenticate success, global_id 4718 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 10 monclient: _renew_subs 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 1 -- 172.21.15.171:0/2472505492 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f06b8122610 con 0x7f06b8135150 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 10 monclient: _renew_subs 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 1 -- 172.21.15.171:0/2472505492 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f06b8122ee0 con 0x7f06b8135150 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f06b0001d40 con 0x7f06b8135150 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f06b0004540 con 0x7f06b8135150 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06af7fe640 4 set_mon_vals no callback set 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 10 monclient: dump: 2024-04-25T23:56:46.004 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:46.005 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:46.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:46.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:46.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:46.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06c022a640 1 -- 172.21.15.171:0/2472505492 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06a0005090 con 0x7f06b8135150 2024-04-25T23:56:46.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f06b0004760 con 0x7f06b8135150 2024-04-25T23:56:46.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7f06b0044d00 con 0x7f06b8135150 2024-04-25T23:56:46.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.010+0000 7f06bdfc6640 10 monclient: get_auth_request con 0x7f069c037780 auth_method 0 2024-04-25T23:56:46.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.022+0000 7f06ae7fc640 1 -- 172.21.15.171:0/2472505492 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f06b0015bc0 con 0x7f06b8135150 2024-04-25T23:56:46.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.022+0000 7f06ae7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:46.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.022+0000 7f06ae7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:--yes-i-really-mean-it not valid: --yes-i-really-mean-it not one of 'true', 'false' 2024-04-25T23:56:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:Invalid command: unused arguments: ['--yes-i-really-mean-it'] 2024-04-25T23:56:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:osd pool delete [] [--yes-i-really-really-mean-it] [--yes-i-really-really-mean-it-not-faking] : delete pool 2024-04-25T23:56:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: invalid command 2024-04-25T23:56:46.181 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:46.181 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd pool delete foo --yes-i-really-mean-it foo 2024-04-25T23:56:46.181 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:56:46.181 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foo --yes-i-really-mean-it foo 2024-04-25T23:56:46.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.314+0000 7fcd1d8ad640 10 monclient: get_monmap_and_config 2024-04-25T23:56:46.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.314+0000 7fcd1d8ad640 10 monclient: build_initial_monmap 2024-04-25T23:56:46.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.314+0000 7fcd1d8ad640 10 monclient: monmap: 2024-04-25T23:56:46.298 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:46.318067+0000 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:46.318067+0000 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:46.299 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:46.300 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:46.300 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:46.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 1 Processor -- start 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 1 -- start start 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient: init 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient: _add_conns ranks=[8,7,1,3,6,2,5,4,0] 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient(hunting): picked mon.noname-e con 0x7fcd18137960 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient(hunting): picked mon.noname-i con 0x7fcd180a4220 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient(hunting): picked mon.noname-f con 0x7fcd18138450 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180a48c0 con 0x7fcd18138450 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180a2f70 con 0x7fcd180a4220 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180a0d00 con 0x7fcd18137960 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd1d8ad640 10 monclient(hunting): authenticate will time out at 1057.024968s 2024-04-25T23:56:46.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd0ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fcd180a4220 legacy=0x7fcd1813ce90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:46.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd177fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fcd18138450 legacy=0x7fcd181405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:46.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.318+0000 7fcd16ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fcd18137960 legacy=0x7fcd18137d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:46.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.522+0000 7fcd177fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fcd18138450 legacy=0x7fcd181405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:46.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.522+0000 7fcd0ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fcd180a4220 legacy=0x7fcd1813ce90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:46.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.522+0000 7fcd16ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fcd18137960 legacy=0x7fcd18137d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:46.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.926+0000 7fcd177fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fcd18138450 legacy=0x7fcd181405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:46.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.926+0000 7fcd0ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fcd180a4220 legacy=0x7fcd1813ce90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:46.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:46.926+0000 7fcd16ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fcd18137960 legacy=0x7fcd18137d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:47.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:47.730+0000 7fcd177fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fcd18138450 legacy=0x7fcd181405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:47.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:47.730+0000 7fcd0ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fcd180a4220 legacy=0x7fcd1813ce90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:47.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:47.730+0000 7fcd16ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fcd18137960 legacy=0x7fcd18137d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:49.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient(hunting): tick 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 1 monclient(hunting): continuing hunt 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fcd18137960 legacy=0x7fcd18137d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fcd180a4220 legacy=0x7fcd1813ce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fcd18138450 legacy=0x7fcd181405c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient: _add_conns ranks=[5,3,2,0,6,4] 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient(hunting): picked mon.noname-h con 0x7fccf8003790 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient(hunting): picked mon.noname-g con 0x7fccf8007420 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient(hunting): picked mon.noname-b con 0x7fccf800b1b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180a29b0 con 0x7fccf800b1b0 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180a48c0 con 0x7fccf8007420 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180a2f70 con 0x7fccf8003790 2024-04-25T23:56:49.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd157fa640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:49.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd16ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fccf8003790 0x7fccf8005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43280/0 (socket says 172.21.15.171:43280) 2024-04-25T23:56:49.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd16ffd640 1 -- 172.21.15.171:0/3286898063 learned_addr learned my addr 172.21.15.171:0/3286898063 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:49.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3285319189 0 0) 0x7fcd180a29b0 con 0x7fccf800b1b0 2024-04-25T23:56:49.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): my global_id is 4727 2024-04-25T23:56:49.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd04003530 con 0x7fccf800b1b0 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3249791796 0 0) 0x7fcd180a2f70 con 0x7fccf8003790 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): my global_id is 4847 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd180a29b0 con 0x7fccf8003790 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852563544 0 0) 0x7fcd180a48c0 con 0x7fccf8007420 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient(hunting): my global_id is 4728 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd180a2f70 con 0x7fccf8007420 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2039602674 0 0) 0x7fcd04003530 con 0x7fccf800b1b0 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 >> v1:172.21.15.171:6791/0 conn(0x7fccf8003790 legacy=0x7fccf8005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:49.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 >> v1:172.21.15.171:6790/0 conn(0x7fccf8007420 legacy=0x7fccf80098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 monclient: found mon.noname-b 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd180a0d00 con 0x7fccf800b1b0 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd177fe640 1 -- 172.21.15.171:0/3286898063 reap_dead start 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd100044a0 con 0x7fccf800b1b0 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:49.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: dump: 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.307 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd1d8ad640 5 monclient: authenticate success, global_id 4727 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd1d8ad640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd10004700 con 0x7fccf800b1b0 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 1 -- 172.21.15.171:0/3286898063 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd10004bf0 con 0x7fccf800b1b0 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd1d8ad640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd1d8ad640 4 set_mon_vals no callback set 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.318+0000 7fcd167fc640 10 monclient: dump: 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.308 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient: shutdown 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/3286898063 >> v1:172.21.15.106:6790/0 conn(0x7fccf800b1b0 legacy=0x7fccf800d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:49.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/3286898063 shutdown_connections 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/3286898063 >> 172.21.15.171:0/3286898063 conn(0x7fcd180a9fc0 msgr2=0x7fcd180aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/3286898063 shutdown_connections 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/3286898063 wait complete. 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient: build_initial_monmap 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient: monmap: 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:49.310 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:49.311 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:49.312 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 Processor -- start 2024-04-25T23:56:49.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- start start 2024-04-25T23:56:49.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient: init 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient: _add_conns ranks=[7,6,0,2,3,5,4,8,1] 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient(hunting): picked mon.noname-i con 0x7fccf800b1b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient(hunting): picked mon.noname-d con 0x7fcd18136b90 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient(hunting): picked mon.noname-a con 0x7fcd181d2480 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd18124040 con 0x7fcd181d2480 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd18124320 con 0x7fcd18136b90 2024-04-25T23:56:49.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd180a1f50 con 0x7fccf800b1b0 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd1d8ad640 10 monclient(hunting): authenticate will time out at 1060.030917s 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd16ffd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fccf800b1b0 legacy=0x7fcd181cc3a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd177fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcd181d2480 0x7fcd181d4870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42768/0 (socket says 172.21.15.171:42768) 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd177fe640 1 -- 172.21.15.171:0/1392706836 learned_addr learned my addr 172.21.15.171:0/1392706836 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd0ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fcd18136b90 0x7fcd18136f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:56588/0 (socket says 172.21.15.171:56588) 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430568496 0 0) 0x7fcd18124040 con 0x7fcd181d2480 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): my global_id is 4752 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fccf800fff0 con 0x7fcd181d2480 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2976045850 0 0) 0x7fcd18124320 con 0x7fcd18136b90 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 10 monclient(hunting): my global_id is 4785 2024-04-25T23:56:49.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.322+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd18124040 con 0x7fcd18136b90 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 892300108 0 0) 0x7fccf800fff0 con 0x7fcd181d2480 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd18124320 con 0x7fcd181d2480 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd10004420 con 0x7fcd181d2480 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient(hunting): dump: 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.322 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.323 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2916617771 0 0) 0x7fcd18124040 con 0x7fcd18136b90 2024-04-25T23:56:49.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fccf800fff0 con 0x7fcd18136b90 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd000042b0 con 0x7fcd18136b90 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient(hunting): dump: 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.325 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2065372149 0 0) 0x7fcd18124320 con 0x7fcd181d2480 2024-04-25T23:56:49.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 >> v1:172.21.15.171:6792/0 conn(0x7fccf800b1b0 legacy=0x7fcd181cc3a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 >> v1:172.21.15.106:6792/0 conn(0x7fcd18136b90 legacy=0x7fcd18136f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 monclient: found mon.a 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd180a0fa0 con 0x7fcd181d2480 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: _finish_auth 0 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 5 monclient: authenticate success, global_id 4752 2024-04-25T23:56:49.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 10 monclient: _renew_subs 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcd18122030 con 0x7fcd181d2480 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 10 monclient: _renew_subs 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcd181d6160 con 0x7fcd181d2480 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd10004700 con 0x7fcd181d2480 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd15ffb640 4 set_mon_vals no callback set 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd10005450 con 0x7fcd181d2480 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 10 monclient: dump: 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.328 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:49.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:56:49.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd1d8ad640 1 -- 172.21.15.171:0/1392706836 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccfc005090 con 0x7fcd181d2480 2024-04-25T23:56:49.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcd100101f0 con 0x7fcd181d2480 2024-04-25T23:56:49.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7fcd10044bf0 con 0x7fcd181d2480 2024-04-25T23:56:49.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.326+0000 7fcd16ffd640 10 monclient: get_auth_request con 0x7fccf8038ee0 auth_method 0 2024-04-25T23:56:49.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.342+0000 7fcd14ff9640 1 -- 172.21.15.171:0/1392706836 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fcd10015b70 con 0x7fcd181d2480 2024-04-25T23:56:49.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.342+0000 7fcd14ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:49.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.342+0000 7fcd14ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:49.484 INFO:tasks.workunit.client.0.smithi171.stderr:foo not valid: foo not one of 'true', 'false' 2024-04-25T23:56:49.484 INFO:tasks.workunit.client.0.smithi171.stderr:Invalid command: unused arguments: ['foo'] 2024-04-25T23:56:49.485 INFO:tasks.workunit.client.0.smithi171.stderr:osd pool delete [] [--yes-i-really-really-mean-it] [--yes-i-really-really-mean-it-not-faking] : delete pool 2024-04-25T23:56:49.485 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: invalid command 2024-04-25T23:56:49.487 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:56:49.487 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foooo foooo --yes-i-really-really-mean-it 2024-04-25T23:56:49.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient: get_monmap_and_config 2024-04-25T23:56:49.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient: build_initial_monmap 2024-04-25T23:56:49.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient: monmap: 2024-04-25T23:56:49.596 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:49.596 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:49.615907+0000 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:49.615907+0000 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:49.597 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 1 Processor -- start 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 1 -- start start 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient: init 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient: _add_conns ranks=[5,3,4,7,6,8,1,0,2] 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient(hunting): picked mon.noname-h con 0x7f4b6809fa10 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient(hunting): picked mon.noname-g con 0x7f4b68135b70 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:49.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient(hunting): picked mon.noname-c con 0x7f4b68135f80 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b680687f0 con 0x7f4b68135b70 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6809da80 con 0x7f4b68135f80 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6809dfd0 con 0x7f4b6809fa10 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b70195640 10 monclient(hunting): authenticate will time out at 1060.323806s 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b6e732640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f4b68135f80 legacy=0x7f4b6813e170 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b6d730640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f4b68135b70 0x7f4b6813aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:55872/0 (socket says 172.21.15.171:55872) 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b6d730640 1 -- 172.21.15.171:0/600358959 learned_addr learned my addr 172.21.15.171:0/600358959 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.614+0000 7f4b6df31640 1 --1- 172.21.15.171:0/600358959 >> v1:172.21.15.171:6791/0 conn(0x7f4b6809fa10 0x7f4b6809fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43294/0 (socket says 172.21.15.171:43294) 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 368285587 0 0) 0x7f4b64001120 con 0x7f4b6809fa10 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): my global_id is 4856 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b54003530 con 0x7f4b6809fa10 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749739185 0 0) 0x7f4b680687f0 con 0x7f4b68135b70 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient(hunting): my global_id is 4737 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b64001120 con 0x7f4b68135b70 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1772559403 0 0) 0x7f4b64001120 con 0x7f4b68135b70 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 >> v1:172.21.15.171:6791/0 conn(0x7f4b6809fa10 legacy=0x7f4b6809fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 >> v1:172.21.15.106:6791/0 conn(0x7f4b68135f80 legacy=0x7f4b6813e170 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: _finish_hunting 0 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 monclient: found mon.noname-g 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:49.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b680a0500 con 0x7f4b68135b70 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: _finish_auth 0 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: _check_auth_tickets 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4b580017a0 con 0x7f4b68135b70 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 5 monclient: authenticate success, global_id 4737 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: dump: 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.608 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.609 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.609 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.609 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b58001a80 con 0x7f4b68135b70 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 1 -- 172.21.15.171:0/600358959 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4b58004bf0 con 0x7f4b68135b70 2024-04-25T23:56:49.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6cf2f640 10 monclient: dump: 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.611 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 4 set_mon_vals no callback set 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient: shutdown 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- 172.21.15.171:0/600358959 >> v1:172.21.15.171:6790/0 conn(0x7f4b68135b70 legacy=0x7f4b6813aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- 172.21.15.171:0/600358959 shutdown_connections 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- 172.21.15.171:0/600358959 >> 172.21.15.171:0/600358959 conn(0x7f4b680a2ee0 msgr2=0x7f4b680a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- 172.21.15.171:0/600358959 shutdown_connections 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- 172.21.15.171:0/600358959 wait complete. 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient: build_initial_monmap 2024-04-25T23:56:49.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient: monmap: 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:49.613 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 Processor -- start 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- start start 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient: init 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient: _add_conns ranks=[1,6,2,7,5,3,4,8,0] 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient(hunting): picked mon.noname-f con 0x7f4b6809fa10 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient(hunting): picked mon.noname-d con 0x7f4b68135b70 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient(hunting): picked mon.noname-b con 0x7f4b68135f80 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6809c180 con 0x7f4b6809fa10 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b6809c950 con 0x7f4b68135f80 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b681350e0 con 0x7f4b68135b70 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6df31640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f4b6809fa10 legacy=0x7f4b680981b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:56:49.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b70195640 10 monclient(hunting): authenticate will time out at 1060.326981s 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6d730640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4b68135b70 0x7f4b681d1b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:56590/0 (socket says 172.21.15.171:56590) 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b6d730640 1 -- 172.21.15.171:0/2344658128 learned_addr learned my addr 172.21.15.171:0/2344658128 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762427972 0 0) 0x7f4b681350e0 con 0x7f4b68135b70 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): my global_id is 4794 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b4c003530 con 0x7f4b68135b70 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929739373 0 0) 0x7f4b6809c950 con 0x7f4b68135f80 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:49.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 10 monclient(hunting): my global_id is 4736 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.618+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b681350e0 con 0x7f4b68135f80 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3173711183 0 0) 0x7f4b4c003530 con 0x7f4b68135b70 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b6809c950 con 0x7f4b68135b70 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4b58004b30 con 0x7f4b68135b70 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient(hunting): dump: 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4276363237 0 0) 0x7f4b681350e0 con 0x7f4b68135f80 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b4c003530 con 0x7f4b68135f80 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4b60004560 con 0x7f4b68135f80 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient(hunting): dump: 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.618 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1291350946 0 0) 0x7f4b6809c950 con 0x7f4b68135b70 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 >> v1:172.21.15.106:6790/0 conn(0x7f4b68135f80 legacy=0x7f4b681d5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 >> v1:172.21.15.171:6789/0 conn(0x7f4b6809fa10 legacy=0x7f4b680981b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 monclient: found mon.d 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b6809bea0 con 0x7f4b68135b70 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:49.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 5 monclient: authenticate success, global_id 4794 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 10 monclient: _renew_subs 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b6809a570 con 0x7f4b68135b70 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 10 monclient: _renew_subs 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b68098a90 con 0x7f4b68135b70 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b58001a80 con 0x7f4b68135b70 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4b58005240 con 0x7f4b68135b70 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5ffff640 4 set_mon_vals no callback set 2024-04-25T23:56:49.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 10 monclient: dump: 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:49.621 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b50005090 con 0x7f4b68135b70 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4b5800ffe0 con 0x7f4b68135b70 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(35..35 src has 1..35) ==== 4634+0+0 (unknown 3245660593 0 0) 0x7f4b58044a30 con 0x7f4b68135b70 2024-04-25T23:56:49.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.622+0000 7f4b6df31640 10 monclient: get_auth_request con 0x7f4b4c037c90 auth_method 0 2024-04-25T23:56:49.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.634+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f4b580158f0 con 0x7f4b68135b70 2024-04-25T23:56:49.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.634+0000 7f4b5e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:49.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.634+0000 7f4b5e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:49.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.794+0000 7f4b70195640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:49.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.794+0000 7f4b70195640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:49.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.794+0000 7f4b70195640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:49.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:49.794+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4b50005380 con 0x7f4b68135b70 2024-04-25T23:56:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.698+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}]=0 pool 'foooo' removed v36) ==== 155+0+0 (unknown 3709892992 0 0) 0x7f4b5801dda0 con 0x7f4b68135b70 2024-04-25T23:56:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.698+0000 7f4b5e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.698+0000 7f4b5e7fc640 10 monclient: _finish_command 2 = system:0 pool 'foooo' removed 2024-04-25T23:56:50.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.810+0000 7f4b70195640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:50.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.810+0000 7f4b70195640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:50.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.810+0000 7f4b70195640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:56:50.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.810+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4b50001150 con 0x7f4b68135b70 2024-04-25T23:56:50.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.810+0000 7f4b5e7fc640 1 -- 172.21.15.171:0/2344658128 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}]=0 pool 'foooo' does not exist v36) ==== 162+0+0 (unknown 936761669 0 0) 0x7f4b58040700 con 0x7f4b68135b70 2024-04-25T23:56:50.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.810+0000 7f4b5e7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "foooo", "pool2": "foooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:50.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.810+0000 7f4b5e7fc640 10 monclient: _finish_command 3 = system:0 pool 'foooo' does not exist 2024-04-25T23:56:50.795 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'foooo' does not exist 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 >> v1:172.21.15.171:6812/722422047 conn(0x7f4b4c037c90 legacy=0x7f4b4c03a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 10 monclient: shutdown 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 >> v1:172.21.15.106:6792/0 conn(0x7f4b68135b70 legacy=0x7f4b681d1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 shutdown_connections 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 >> 172.21.15.171:0/2344658128 conn(0x7f4b680a2ee0 msgr2=0x7f4b680999b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 shutdown_connections 2024-04-25T23:56:50.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.814+0000 7f4b70195640 1 -- 172.21.15.171:0/2344658128 wait complete. 2024-04-25T23:56:50.810 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete fooo fooo --yes-i-really-really-mean-it 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: get_monmap_and_config 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: build_initial_monmap 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: monmap: 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:50.942666+0000 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:50.942666+0000 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:50.923 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:50.924 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 1 Processor -- start 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 1 -- start start 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: init 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: _add_conns ranks=[8,6,3,2,1,5,0,7,4] 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient(hunting): picked mon.noname-e con 0x7ff48c0a1310 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient(hunting): picked mon.noname-d con 0x7ff48c070ed0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient(hunting): picked mon.noname-g con 0x7ff48c13b8d0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c072380 con 0x7ff48c13b8d0 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c0a1e00 con 0x7ff48c070ed0 2024-04-25T23:56:50.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c0a5330 con 0x7ff48c0a1310 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient(hunting): authenticate will time out at 1061.649996s 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48affd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff48c0a1310 legacy=0x7ff48c09f8f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48b7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff48c13b8d0 0x7ff48c13dcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:44510/0 (socket says 172.21.15.171:44510) 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48b7fe640 1 -- 172.21.15.171:0/2805111128 learned_addr learned my addr 172.21.15.171:0/2805111128 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884087028 0 0) 0x7ff4840014a0 con 0x7ff48c13b8d0 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient(hunting): my global_id is 4746 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff478003530 con 0x7ff48c13b8d0 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3285439497 0 0) 0x7ff478003530 con 0x7ff48c13b8d0 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 >> v1:172.21.15.106:6793/0 conn(0x7ff48c0a1310 legacy=0x7ff48c09f8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:50.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 >> v1:172.21.15.106:6792/0 conn(0x7ff48c070ed0 legacy=0x7ff48c0a16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 monclient: found mon.noname-g 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c142410 con 0x7ff48c13b8d0 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff484001d10 con 0x7ff48c13b8d0 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 5 monclient: authenticate success, global_id 4746 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:50.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: dump: 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:50.931 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff484002000 con 0x7ff48c13b8d0 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 1 -- 172.21.15.171:0/2805111128 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff484004f70 con 0x7ff48c13b8d0 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff48a7fc640 10 monclient: dump: 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:50.932 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 4 set_mon_vals no callback set 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 10 monclient: shutdown 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:50.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.942+0000 7ff491a4f640 1 -- 172.21.15.171:0/2805111128 >> v1:172.21.15.171:6790/0 conn(0x7ff48c13b8d0 legacy=0x7ff48c13dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- 172.21.15.171:0/2805111128 shutdown_connections 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- 172.21.15.171:0/2805111128 >> 172.21.15.171:0/2805111128 conn(0x7ff48c0a84f0 msgr2=0x7ff48c0a49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- 172.21.15.171:0/2805111128 shutdown_connections 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- 172.21.15.171:0/2805111128 wait complete. 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: build_initial_monmap 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: monmap: 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:50.934 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:50.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 Processor -- start 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- start start 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: init 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: _add_conns ranks=[0,2,3,6,5,1,7,8,4] 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient(hunting): picked mon.noname-a con 0x7ff48c070ed0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient(hunting): picked mon.noname-b con 0x7ff48c0a1310 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient(hunting): picked mon.noname-g con 0x7ff48c13b8d0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c06ede0 con 0x7ff48c070ed0 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c09e4a0 con 0x7ff48c0a1310 2024-04-25T23:56:50.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff48c09dc00 con 0x7ff48c13b8d0 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient(hunting): authenticate will time out at 1061.654132s 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff48b7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff48c13b8d0 0x7ff48c1d93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:44520/0 (socket says 172.21.15.171:44520) 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff48b7fe640 1 -- 172.21.15.171:0/3479933938 learned_addr learned my addr 172.21.15.171:0/3479933938 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871058534 0 0) 0x7ff48c09dc00 con 0x7ff48c13b8d0 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): my global_id is 4755 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff46c003560 con 0x7ff48c13b8d0 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 662459779 0 0) 0x7ff46c003560 con 0x7ff48c13b8d0 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff48c09dc00 con 0x7ff48c13b8d0 2024-04-25T23:56:50.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff484001dd0 con 0x7ff48c13b8d0 2024-04-25T23:56:50.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:50.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): dump: 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:50.942 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3861605073 0 0) 0x7ff48c06ede0 con 0x7ff48c070ed0 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient(hunting): my global_id is 4761 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff46c003560 con 0x7ff48c070ed0 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1669261527 0 0) 0x7ff48c09dc00 con 0x7ff48c13b8d0 2024-04-25T23:56:50.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 >> v1:172.21.15.106:6790/0 conn(0x7ff48c0a1310 legacy=0x7ff48c06d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 >> v1:172.21.15.106:6789/0 conn(0x7ff48c070ed0 legacy=0x7ff48c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 monclient: found mon.g 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff48c121a10 con 0x7ff48c13b8d0 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: _finish_auth 0 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 5 monclient: authenticate success, global_id 4755 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: _renew_subs 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff48c09c720 con 0x7ff48c13b8d0 2024-04-25T23:56:50.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: _renew_subs 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff48c06e1d0 con 0x7ff48c13b8d0 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff484005020 con 0x7ff48c13b8d0 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff484005590 con 0x7ff48c13b8d0 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff488ff9640 10 monclient: dump: 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:50.945 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.946+0000 7ff489ffb640 4 set_mon_vals no callback set 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.950+0000 7ff491a4f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:50.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.950+0000 7ff491a4f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:50.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.950+0000 7ff491a4f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:50.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.950+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff470005090 con 0x7ff48c13b8d0 2024-04-25T23:56:50.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.950+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff484005730 con 0x7ff48c13b8d0 2024-04-25T23:56:50.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.950+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(36..36 src has 1..36) ==== 4290+0+0 (unknown 3792005609 0 0) 0x7ff484044b60 con 0x7ff48c13b8d0 2024-04-25T23:56:50.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.950+0000 7ff48affd640 10 monclient: get_auth_request con 0x7ff46c0379d0 auth_method 0 2024-04-25T23:56:50.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.954+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff48c072380 con 0x7ff48c13b8d0 2024-04-25T23:56:50.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.954+0000 7ff488ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:50.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:50.954+0000 7ff488ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:51.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.126+0000 7ff491a4f640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:51.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.126+0000 7ff491a4f640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:51.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.126+0000 7ff491a4f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:51.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.126+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff470005380 con 0x7ff48c13b8d0 2024-04-25T23:56:51.635 INFO:tasks.ceph.mgr.x.smithi171.stderr:2024-04-25T23:56:51.650+0000 7f4251cf6640 -1 calc_pg_upmaps abort due to max <= 0 2024-04-25T23:56:51.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.694+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}]=0 pool 'fooo' removed v37) ==== 152+0+0 (unknown 3597054383 0 0) 0x7ff484015bd0 con 0x7ff48c13b8d0 2024-04-25T23:56:51.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.694+0000 7ff488ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:51.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.694+0000 7ff488ff9640 10 monclient: _finish_command 2 = system:0 pool 'fooo' removed 2024-04-25T23:56:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.818+0000 7ff491a4f640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.818+0000 7ff491a4f640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.818+0000 7ff491a4f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:56:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.818+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff470001150 con 0x7ff48c13b8d0 2024-04-25T23:56:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.818+0000 7ff488ff9640 1 -- 172.21.15.171:0/3479933938 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}]=0 pool 'fooo' does not exist v37) ==== 159+0+0 (unknown 4264090831 0 0) 0x7ff48401e020 con 0x7ff48c13b8d0 2024-04-25T23:56:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.818+0000 7ff488ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.818+0000 7ff488ff9640 10 monclient: _finish_command 3 = system:0 pool 'fooo' does not exist 2024-04-25T23:56:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'fooo' does not exist 2024-04-25T23:56:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 >> v1:172.21.15.171:6812/722422047 conn(0x7ff46c0379d0 legacy=0x7ff46c039e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 10 monclient: shutdown 2024-04-25T23:56:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 >> v1:172.21.15.171:6790/0 conn(0x7ff48c13b8d0 legacy=0x7ff48c1d93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 shutdown_connections 2024-04-25T23:56:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 >> 172.21.15.171:0/3479933938 conn(0x7ff48c0a84f0 msgr2=0x7ff48c1402e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 shutdown_connections 2024-04-25T23:56:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.822+0000 7ff491a4f640 1 -- 172.21.15.171:0/3479933938 wait complete. 2024-04-25T23:56:51.818 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foo foo --yes-i-really-really-mean-it 2024-04-25T23:56:51.911 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-04-25T23:56:51.911 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-04-25T23:56:51.911 INFO:tasks.ceph.mon.i:Restarting daemon 2024-04-25T23:56:51.911 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-04-25T23:56:51.914 INFO:tasks.ceph.mon.i:Started 2024-04-25T23:56:51.915 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-25T23:56:51.915 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-25T23:56:51.915 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T23:56:51.915 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T23:56:51.918 INFO:tasks.ceph.mon.c:Started 2024-04-25T23:56:51.918 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-25T23:56:51.918 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-04-25T23:56:51.918 INFO:tasks.ceph.mon.f:Restarting daemon 2024-04-25T23:56:51.918 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-04-25T23:56:51.921 INFO:tasks.ceph.mon.f:Started 2024-04-25T23:56:51.921 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-25T23:56:51.921 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-04-25T23:56:51.921 INFO:tasks.ceph.mon.e:Restarting daemon 2024-04-25T23:56:51.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-04-25T23:56:51.924 INFO:tasks.ceph.mon.e:Started 2024-04-25T23:56:51.924 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-25T23:56:51.924 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:56:51.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: get_monmap_and_config 2024-04-25T23:56:51.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: build_initial_monmap 2024-04-25T23:56:51.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: monmap: 2024-04-25T23:56:51.931 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:51.931 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:51.951197+0000 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:51.951197+0000 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:51.932 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 Processor -- start 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- start start 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: init 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: _add_conns ranks=[3,5,8,0,6,7,2,4,1] 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient(hunting): picked mon.noname-g con 0x7f5b640a05a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient(hunting): picked mon.noname-h con 0x7f5b6406bee0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient(hunting): picked mon.noname-e con 0x7f5b6409fec0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6406b610 con 0x7f5b640a05a0 2024-04-25T23:56:51.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6409ef20 con 0x7f5b6406bee0 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6409ec40 con 0x7f5b6409fec0 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient(hunting): authenticate will time out at 1062.657977s 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b62ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5b640a05a0 0x7f5b640a0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:44526/0 (socket says 172.21.15.171:44526) 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b62ffd640 1 -- 172.21.15.171:0/1106407650 learned_addr learned my addr 172.21.15.171:0/1106407650 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b627fc640 1 --1- 172.21.15.171:0/1106407650 >> v1:172.21.15.171:6791/0 conn(0x7f5b6406bee0 0x7f5b6413caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:37316/0 (socket says 172.21.15.171:37316) 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b637fe640 1 -- 172.21.15.171:0/1106407650 >> v1:172.21.15.106:6793/0 conn(0x7f5b6409fec0 legacy=0x7f5b641401d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385006279 0 0) 0x7f5b6409ef20 con 0x7f5b6406bee0 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): my global_id is 4865 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b50003530 con 0x7f5b6406bee0 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793869299 0 0) 0x7f5b6406b610 con 0x7f5b640a05a0 2024-04-25T23:56:51.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient(hunting): my global_id is 4764 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b6409ef20 con 0x7f5b640a05a0 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 748455171 0 0) 0x7f5b50003530 con 0x7f5b6406bee0 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 >> v1:172.21.15.106:6793/0 conn(0x7f5b6409fec0 legacy=0x7f5b641401d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 >> v1:172.21.15.171:6790/0 conn(0x7f5b640a05a0 legacy=0x7f5b640a0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 monclient: found mon.noname-h 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b640a1090 con 0x7f5b6406bee0 2024-04-25T23:56:51.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b4c0016f0 con 0x7f5b6406bee0 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 5 monclient: authenticate success, global_id 4865 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: dump: 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:51.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b4c001a10 con 0x7f5b6406bee0 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 1 -- 172.21.15.171:0/1106407650 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b4c004b30 con 0x7f5b6406bee0 2024-04-25T23:56:51.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 4 set_mon_vals no callback set 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b61ffb640 10 monclient: dump: 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 10 monclient: shutdown 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- 172.21.15.171:0/1106407650 >> v1:172.21.15.171:6791/0 conn(0x7f5b6406bee0 legacy=0x7f5b6413caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- 172.21.15.171:0/1106407650 shutdown_connections 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- 172.21.15.171:0/1106407650 >> 172.21.15.171:0/1106407650 conn(0x7f5b640a72a0 msgr2=0x7f5b640a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- 172.21.15.171:0/1106407650 shutdown_connections 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.950+0000 7f5b69445640 1 -- 172.21.15.171:0/1106407650 wait complete. 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: build_initial_monmap 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: monmap: 2024-04-25T23:56:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:51.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 1 Processor -- start 2024-04-25T23:56:51.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 1 -- start start 2024-04-25T23:56:51.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: init 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: _add_conns ranks=[0,5,2,7,8,1,3,4,6] 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient(hunting): picked mon.noname-a con 0x7f5b6409fec0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient(hunting): picked mon.noname-h con 0x7f5b640a05a0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient(hunting): picked mon.noname-b con 0x7f5b641bc090 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b641a90e0 con 0x7f5b6409fec0 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b640a0370 con 0x7f5b641bc090 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b6409d5e0 con 0x7f5b640a05a0 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient(hunting): authenticate will time out at 1062.662107s 2024-04-25T23:56:51.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b627fc640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5b640a05a0 0x7f5b641d1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:37324/0 (socket says 172.21.15.171:37324) 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b627fc640 1 -- 172.21.15.171:0/2890703929 learned_addr learned my addr 172.21.15.171:0/2890703929 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931226804 0 0) 0x7f5b6409d5e0 con 0x7f5b640a05a0 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): my global_id is 4874 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b44003530 con 0x7f5b640a05a0 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3048797108 0 0) 0x7f5b44003530 con 0x7f5b640a05a0 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b6409d5e0 con 0x7f5b640a05a0 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b4c0016b0 con 0x7f5b640a05a0 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): dump: 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:51.948 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:51.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614818020 0 0) 0x7f5b640a0370 con 0x7f5b641bc090 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): my global_id is 4754 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b44003530 con 0x7f5b641bc090 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2868906988 0 0) 0x7f5b641a90e0 con 0x7f5b6409fec0 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient(hunting): my global_id is 4770 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b640a0370 con 0x7f5b6409fec0 2024-04-25T23:56:51.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 218547057 0 0) 0x7f5b6409d5e0 con 0x7f5b640a05a0 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 >> v1:172.21.15.106:6790/0 conn(0x7f5b641bc090 legacy=0x7f5b641d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 >> v1:172.21.15.106:6789/0 conn(0x7f5b6409fec0 legacy=0x7f5b641bb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 monclient: found mon.h 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b641a8840 con 0x7f5b640a05a0 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 5 monclient: authenticate success, global_id 4874 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: _renew_subs 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:51.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b641bbe30 con 0x7f5b640a05a0 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: _renew_subs 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b6409c970 con 0x7f5b640a05a0 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b4c001a10 con 0x7f5b640a05a0 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b4c005180 con 0x7f5b640a05a0 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b617fa640 4 set_mon_vals no callback set 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.954+0000 7f5b5b7fe640 10 monclient: dump: 2024-04-25T23:56:51.952 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:51.953 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.958+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5b4c00ff20 con 0x7f5b640a05a0 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.958+0000 7f5b69445640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.958+0000 7f5b69445640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.958+0000 7f5b69445640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.958+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b48005090 con 0x7f5b640a05a0 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.958+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(37..37 src has 1..37) ==== 3940+0+0 (unknown 2764469090 0 0) 0x7f5b4c0446f0 con 0x7f5b640a05a0 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.958+0000 7f5b62ffd640 10 monclient: get_auth_request con 0x7f5b44037940 auth_method 0 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.962+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5b4c015860 con 0x7f5b640a05a0 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.962+0000 7f5b5b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:51.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:51.962+0000 7f5b5b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:52.008 INFO:tasks.ceph.mon.c.smithi106.stderr:2024-04-25T23:56:52.023+0000 7efc9acdac80 -1 mon.c@-1(???).log v0 log_external_backlog rewinding external_log_to from 19 -> 0 (sync_force? mon rebuild?) 2024-04-25T23:56:52.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.075+0000 7f639f3f0640 10 monclient: get_monmap_and_config 2024-04-25T23:56:52.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.075+0000 7f639f3f0640 10 monclient: build_initial_monmap 2024-04-25T23:56:52.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.075+0000 7f639f3f0640 10 monclient: monmap: 2024-04-25T23:56:52.064 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:56:52.064 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:52.064 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:56:52.082062+0000 2024-04-25T23:56:52.064 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:56:52.082062+0000 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 1 Processor -- start 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 1 -- start start 2024-04-25T23:56:52.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient: init 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient: _add_conns ranks=[2,8,5,1,6,4,0,3,7] 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient(hunting): picked mon.noname-b con 0x7f63980a1290 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient(hunting): picked mon.noname-e con 0x7f639809f770 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient(hunting): picked mon.noname-h con 0x7f639809fb70 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63980727a0 con 0x7f63980a1290 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63980724c0 con 0x7f639809fb70 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6398072a80 con 0x7f639809f770 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639f3f0640 10 monclient(hunting): authenticate will time out at 1067.608876s 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639c98b640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f639809f770 0x7f639813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45112/0 (socket says 172.21.15.106:45112) 2024-04-25T23:56:52.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:52.079+0000 7f639c98b640 1 -- 172.21.15.106:0/2655945965 learned_addr learned my addr 172.21.15.106:0/2655945965 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:56:52.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:52.142+0000 7f5b69445640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:52.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:52.142+0000 7f5b69445640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:52.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:52.142+0000 7f5b69445640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:52.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:52.142+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5b48005380 con 0x7f5b640a05a0 2024-04-25T23:56:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:54.954+0000 7f5b5a7fc640 10 monclient: tick 2024-04-25T23:56:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:54.954+0000 7f5b5a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:54.954+0000 7f5b5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:54.954+0000 7f5b5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient(hunting): tick 2024-04-25T23:56:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:56:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 1 monclient(hunting): continuing hunt 2024-04-25T23:56:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:56:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 1 -- 172.21.15.106:0/2655945965 >> v1:172.21.15.106:6793/0 conn(0x7f639809f770 legacy=0x7f639813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 1 -- 172.21.15.106:0/2655945965 >> v1:172.21.15.171:6791/0 conn(0x7f639809fb70 legacy=0x7f639813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 1 -- 172.21.15.106:0/2655945965 >> v1:172.21.15.106:6790/0 conn(0x7f63980a1290 legacy=0x7f63980a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient: _add_conns ranks=[3,7,0,1,4,6] 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient(hunting): picked mon.noname-g con 0x7f637c0037f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient(hunting): picked mon.noname-i con 0x7f637c007480 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient(hunting): picked mon.noname-a con 0x7f637c00b1b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 1 -- 172.21.15.106:0/2655945965 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f639806bfc0 con 0x7f637c00b1b0 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 1 -- 172.21.15.106:0/2655945965 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c00ffe0 con 0x7f637c0037f0 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 1 -- 172.21.15.106:0/2655945965 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637c011270 con 0x7f637c007480 2024-04-25T23:56:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:55.079+0000 7f638effd640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:55.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:55.954+0000 7f5b5a7fc640 10 monclient: tick 2024-04-25T23:56:55.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:55.954+0000 7f5b5a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:55.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:55.954+0000 7f5b5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:56.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:56.954+0000 7f5b5a7fc640 10 monclient: tick 2024-04-25T23:56:56.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:56.954+0000 7f5b5a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:56.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:56.954+0000 7f5b5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:57.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3447841844 0 0) 0x7f637c00ffe0 con 0x7f637c0037f0 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient(hunting): my global_id is 4773 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6384003530 con 0x7f637c0037f0 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4280407432 0 0) 0x7f6384003530 con 0x7f637c0037f0 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 >> v1:172.21.15.171:6792/0 conn(0x7f637c007480 legacy=0x7f637c0098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 >> v1:172.21.15.106:6789/0 conn(0x7f637c00b1b0 legacy=0x7f637c00d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:56:57.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 monclient: found mon.noname-g 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637c012500 con 0x7f637c0037f0 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: _finish_auth 0 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6394001780 con 0x7f637c0037f0 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f639d98d640 1 -- 172.21.15.106:0/2655945965 reap_dead start 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: dump: 2024-04-25T23:56:57.038 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:57.039 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:57.040 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:57.040 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:56:57.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f639f3f0640 5 monclient: authenticate success, global_id 4773 2024-04-25T23:56:57.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f639f3f0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:57.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6394001a50 con 0x7f637c0037f0 2024-04-25T23:56:57.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 1 -- 172.21.15.106:0/2655945965 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6394001cc0 con 0x7f637c0037f0 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f639f3f0640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f639f3f0640 4 set_mon_vals no callback set 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.051+0000 7f638ffff640 10 monclient: dump: 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.042 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient: shutdown 2024-04-25T23:56:57.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- 172.21.15.106:0/2655945965 >> v1:172.21.15.171:6790/0 conn(0x7f637c0037f0 legacy=0x7f637c005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- 172.21.15.106:0/2655945965 shutdown_connections 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- 172.21.15.106:0/2655945965 >> 172.21.15.106:0/2655945965 conn(0x7f639806b210 msgr2=0x7f639806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- 172.21.15.106:0/2655945965 shutdown_connections 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- 172.21.15.106:0/2655945965 wait complete. 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient: build_initial_monmap 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient: monmap: 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:56:57.044 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 Processor -- start 2024-04-25T23:56:57.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- start start 2024-04-25T23:56:57.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient: init 2024-04-25T23:56:57.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:57.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient: _add_conns ranks=[3,6,2,5,1,0,4,8,7] 2024-04-25T23:56:57.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient(hunting): picked mon.noname-g con 0x7f637c0037f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:57.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient(hunting): picked mon.noname-d con 0x7f6398120b80 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient(hunting): picked mon.noname-b con 0x7f63981cac10 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6398123530 con 0x7f63981cac10 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6398123810 con 0x7f637c0037f0 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63981cb0c0 con 0x7f6398120b80 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639f3f0640 10 monclient(hunting): authenticate will time out at 1072.587781s 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639d98d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f63981cac10 0x7f63981d2e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48808/0 (socket says 172.21.15.106:48808) 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.055+0000 7f639d98d640 1 -- 172.21.15.106:0/1275609921 learned_addr learned my addr 172.21.15.106:0/1275609921 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910528355 0 0) 0x7f6398123530 con 0x7f63981cac10 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:57.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): my global_id is 4763 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f637c005420 con 0x7f63981cac10 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897002913 0 0) 0x7f6398123810 con 0x7f637c0037f0 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): my global_id is 4782 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6398123530 con 0x7f637c0037f0 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4139469253 0 0) 0x7f637c005420 con 0x7f63981cac10 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6398123810 con 0x7f63981cac10 2024-04-25T23:56:57.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6390001b50 con 0x7f63981cac10 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): dump: 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:57.052 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 779047941 0 0) 0x7f6398123530 con 0x7f637c0037f0 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f637c005420 con 0x7f637c0037f0 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6394001860 con 0x7f637c0037f0 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:57.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient(hunting): dump: 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:57.054 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3634035712 0 0) 0x7f6398123810 con 0x7f63981cac10 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 >> v1:172.21.15.106:6792/0 conn(0x7f6398120b80 legacy=0x7f63981cf6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 >> v1:172.21.15.171:6790/0 conn(0x7f637c0037f0 legacy=0x7f63981ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 monclient: found mon.b 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6398122360 con 0x7f63981cac10 2024-04-25T23:56:57.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: _finish_auth 0 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 5 monclient: authenticate success, global_id 4763 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 10 monclient: _renew_subs 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63980a1f00 con 0x7f63981cac10 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 10 monclient: _renew_subs 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f63981244d0 con 0x7f63981cac10 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6390003980 con 0x7f63981cac10 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:57.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638f7fe640 4 set_mon_vals no callback set 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6390003ef0 con 0x7f63981cac10 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 10 monclient: dump: 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:57.057 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:57.058 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:57.058 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:57.058 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:57.058 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:57.059 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:57.059 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:57.059 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:56:57.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:57.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:57.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:57.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6378005090 con 0x7f63981cac10 2024-04-25T23:56:57.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6390004110 con 0x7f63981cac10 2024-04-25T23:56:57.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(37..37 src has 1..37) ==== 3940+0+0 (unknown 2764469090 0 0) 0x7f63900447a0 con 0x7f63981cac10 2024-04-25T23:56:57.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.059+0000 7f639d18c640 10 monclient: get_auth_request con 0x7f637c039210 auth_method 0 2024-04-25T23:56:57.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.063+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f63900158b0 con 0x7f63981cac10 2024-04-25T23:56:57.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.063+0000 7f638dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:57.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.063+0000 7f638dffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.291+0000 7f639f3f0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:56:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.291+0000 7f639f3f0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:56:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.291+0000 7f639f3f0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:56:57.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.291+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6378005380 con 0x7f63981cac10 2024-04-25T23:56:57.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f638dffb640 1 -- 172.21.15.106:0/1275609921 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2732 (unknown 254746657 0 2596532186) 0x7f63900151b0 con 0x7f63981cac10 2024-04-25T23:56:57.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f638dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:56:57.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f638dffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:56:57.281 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":18,"quorum":[0,1,2,3,5,6,7],"quorum_names":["a","f","b","g","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:56:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 >> v1:172.21.15.171:6812/722422047 conn(0x7f637c039210 legacy=0x7f637c03b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 10 monclient: shutdown 2024-04-25T23:56:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 >> v1:172.21.15.106:6790/0 conn(0x7f63981cac10 legacy=0x7f63981d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 shutdown_connections 2024-04-25T23:56:57.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 >> 172.21.15.106:0/1275609921 conn(0x7f639806b210 msgr2=0x7f63980a34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:57.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 shutdown_connections 2024-04-25T23:56:57.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:56:57.295+0000 7f639f3f0640 1 -- 172.21.15.106:0/1275609921 wait complete. 2024-04-25T23:56:57.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:57.953+0000 7f5b5a7fc640 10 monclient: tick 2024-04-25T23:56:57.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:57.953+0000 7f5b5a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:57.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:57.953+0000 7f5b5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:58.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.097+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}]=0 pool 'foo' removed v38) ==== 149+0+0 (unknown 422414212 0 0) 0x7f5b4c01a960 con 0x7f5b640a05a0 2024-04-25T23:56:58.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.097+0000 7f5b5b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.097+0000 7f5b5b7fe640 10 monclient: _finish_command 2 = system:0 pool 'foo' removed 2024-04-25T23:56:58.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.221+0000 7f5b69445640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.221+0000 7f5b69445640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.221+0000 7f5b69445640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:58.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.221+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5b480008e0 con 0x7f5b640a05a0 2024-04-25T23:56:58.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.221+0000 7f5b5b7fe640 1 -- 172.21.15.171:0/2890703929 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}]=0 pool 'foo' does not exist v38) ==== 156+0+0 (unknown 495831957 0 0) 0x7f5b4c01dd10 con 0x7f5b640a05a0 2024-04-25T23:56:58.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.221+0000 7f5b5b7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.221+0000 7f5b5b7fe640 10 monclient: _finish_command 3 = system:0 pool 'foo' does not exist 2024-04-25T23:56:58.206 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'foo' does not exist 2024-04-25T23:56:58.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 >> v1:172.21.15.171:6812/722422047 conn(0x7f5b44037940 legacy=0x7f5b44039e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 10 monclient: shutdown 2024-04-25T23:56:58.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 >> v1:172.21.15.171:6791/0 conn(0x7f5b640a05a0 legacy=0x7f5b641d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 shutdown_connections 2024-04-25T23:56:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 >> 172.21.15.171:0/2890703929 conn(0x7f5b640a72a0 msgr2=0x7f5b640a23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 shutdown_connections 2024-04-25T23:56:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.225+0000 7f5b69445640 1 -- 172.21.15.171:0/2890703929 wait complete. 2024-04-25T23:56:58.224 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete foo foo --yes-i-really-really-mean-it 2024-04-25T23:56:58.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.361+0000 7efdc8026640 10 monclient: get_monmap_and_config 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.361+0000 7efdc8026640 10 monclient: build_initial_monmap 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.361+0000 7efdc8026640 10 monclient: monmap: 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:58.366191+0000 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:58.366191+0000 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:58.347 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:58.348 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:58.348 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:58.348 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:58.348 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:58.348 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:58.348 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:58.348 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 Processor -- start 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- start start 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: init 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: _add_conns ranks=[2,1,4,5,8,3,7,0,6] 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient(hunting): picked mon.noname-b con 0x7efdc006e480 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient(hunting): picked mon.noname-f con 0x7efdc006ef70 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient(hunting): picked mon.noname-c con 0x7efdc013aab0 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc0070c60 con 0x7efdc006ef70 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc0070f40 con 0x7efdc006e480 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc006f980 con 0x7efdc013aab0 2024-04-25T23:56:58.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient(hunting): authenticate will time out at 1069.073047s 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc55c1640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7efdc006ef70 0x7efdc0139390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36298/0 (socket says 172.21.15.171:36298) 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc55c1640 1 -- 172.21.15.171:0/4047312092 learned_addr learned my addr 172.21.15.171:0/4047312092 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3653851038 0 0) 0x7efdc0070c60 con 0x7efdc006ef70 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient(hunting): _negotiate 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient(hunting): my global_id is 134101 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdac003530 con 0x7efdc006ef70 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 464580701 0 0) 0x7efdac003530 con 0x7efdc006ef70 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 >> v1:172.21.15.106:6791/0 conn(0x7efdc013aab0 legacy=0x7efdc013cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 >> v1:172.21.15.106:6790/0 conn(0x7efdc006e480 legacy=0x7efdc006e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: _finish_hunting 0 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 monclient: found mon.noname-f 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc0072e40 con 0x7efdc006ef70 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: _finish_auth 0 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: _check_auth_tickets 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb00017c0 con 0x7efdc006ef70 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: dump: 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.359 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.360 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 5 monclient: authenticate success, global_id 134101 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdb0001b20 con 0x7efdc006ef70 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 1 -- 172.21.15.171:0/4047312092 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb0001d50 con 0x7efdc006ef70 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc4dc0640 10 monclient: dump: 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.361 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.362 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 4 set_mon_vals no callback set 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: shutdown 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- 172.21.15.171:0/4047312092 >> v1:172.21.15.171:6789/0 conn(0x7efdc006ef70 legacy=0x7efdc0139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- 172.21.15.171:0/4047312092 shutdown_connections 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- 172.21.15.171:0/4047312092 >> 172.21.15.171:0/4047312092 conn(0x7efdc00a2690 msgr2=0x7efdc00a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- 172.21.15.171:0/4047312092 shutdown_connections 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- 172.21.15.171:0/4047312092 wait complete. 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: build_initial_monmap 2024-04-25T23:56:58.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: monmap: 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:58.364 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 Processor -- start 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 1 -- start start 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.365+0000 7efdc8026640 10 monclient: init 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _add_conns ranks=[4,0,6,2,1,3,5,8,7] 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient(hunting): picked mon.noname-c con 0x7efdc006e480 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient(hunting): picked mon.noname-a con 0x7efdc006ef70 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient(hunting): picked mon.noname-d con 0x7efdc013aab0 addr v1:172.21.15.106:6792/0 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc009e7d0 con 0x7efdc006ef70 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc01c7850 con 0x7efdc006e480 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdc011fa30 con 0x7efdc013aab0 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient(hunting): authenticate will time out at 1069.076361s 2024-04-25T23:56:58.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc55c1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efdc006ef70 0x7efdc01cf670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:36460/0 (socket says 172.21.15.171:36460) 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc55c1640 1 -- 172.21.15.171:0/2121403359 learned_addr learned my addr 172.21.15.171:0/2121403359 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488228322 0 0) 0x7efdc009e7d0 con 0x7efdc006ef70 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): my global_id is 4779 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efda4003530 con 0x7efdc006ef70 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484617733 0 0) 0x7efdc0070f40 con 0x7efdc006e480 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): my global_id is 134113 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdc009e7d0 con 0x7efdc006e480 2024-04-25T23:56:58.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1080701810 0 0) 0x7efdc011fa30 con 0x7efdc013aab0 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): my global_id is 4812 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdc0070f40 con 0x7efdc013aab0 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2328387461 0 0) 0x7efdc009e7d0 con 0x7efdc006e480 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdc011fa30 con 0x7efdc006e480 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3432929167 0 0) 0x7efda4003530 con 0x7efdc006ef70 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdc009e7d0 con 0x7efdc006ef70 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdbc0018b0 con 0x7efdc006e480 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:58.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): dump: 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.368 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb0001780 con 0x7efdc006ef70 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): dump: 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.369 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 595516820 0 0) 0x7efdc0070f40 con 0x7efdc013aab0 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efda4003530 con 0x7efdc013aab0 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdb8001ce0 con 0x7efdc013aab0 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient(hunting): dump: 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.370 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.371 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4054026843 0 0) 0x7efdc011fa30 con 0x7efdc006e480 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 >> v1:172.21.15.106:6792/0 conn(0x7efdc013aab0 legacy=0x7efdc01d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 >> v1:172.21.15.106:6789/0 conn(0x7efdc006ef70 legacy=0x7efdc01cf670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 monclient: found mon.c 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdc0134030 con 0x7efdc006e480 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:58.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 5 monclient: authenticate success, global_id 134113 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _renew_subs 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efdc011ead0 con 0x7efdc006e480 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _renew_subs 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7efdc01c6df0 con 0x7efdc006e480 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdbc001c80 con 0x7efdc006e480 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdbc003c10 con 0x7efdc006e480 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb7fff640 4 set_mon_vals no callback set 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 10 monclient: dump: 2024-04-25T23:56:58.373 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efda8005090 con 0x7efdc006e480 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7efdbc003e30 con 0x7efdc006e480 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7efdbc043160 con 0x7efdc006e480 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.369+0000 7efdc55c1640 10 monclient: get_auth_request con 0x7efda4038170 auth_method 0 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.381+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7efdc01c7850 con 0x7efdc006e480 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.381+0000 7efdb67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:58.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.381+0000 7efdb67fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:58.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.545+0000 7efdc8026640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.545+0000 7efdc8026640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.545+0000 7efdc8026640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:56:58.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.545+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true} v 0) -- 0x7efda8005380 con 0x7efdc006e480 2024-04-25T23:56:58.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.545+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}]=0 pool 'foo' does not exist v38) ==== 156+0+0 (unknown 495831957 0 0) 0x7efdbc014430 con 0x7efdc006e480 2024-04-25T23:56:58.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.549+0000 7efdb67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.549+0000 7efdb67fc640 10 monclient: _finish_command 2 = system:0 pool 'foo' does not exist 2024-04-25T23:56:58.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.641+0000 7efdc8026640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.641+0000 7efdc8026640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.641+0000 7efdc8026640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:56:58.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.641+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true} v 0) -- 0x7efda8001180 con 0x7efdc006e480 2024-04-25T23:56:58.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdb67fc640 1 -- 172.21.15.171:0/2121403359 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}]=0 pool 'foo' does not exist v38) ==== 156+0+0 (unknown 495831957 0 0) 0x7efda8001180 con 0x7efdc006e480 2024-04-25T23:56:58.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdb67fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "foo", "pool2": "foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdb67fc640 10 monclient: _finish_command 3 = system:0 pool 'foo' does not exist 2024-04-25T23:56:58.628 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'foo' does not exist 2024-04-25T23:56:58.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 >> v1:172.21.15.171:6812/722422047 conn(0x7efda4038170 legacy=0x7efda403a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 10 monclient: shutdown 2024-04-25T23:56:58.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:58.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 >> v1:172.21.15.106:6791/0 conn(0x7efdc006e480 legacy=0x7efdc0133920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 shutdown_connections 2024-04-25T23:56:58.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 >> 172.21.15.171:0/2121403359 conn(0x7efdc00a2690 msgr2=0x7efdc00a46a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:58.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 shutdown_connections 2024-04-25T23:56:58.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.645+0000 7efdc8026640 1 -- 172.21.15.171:0/2121403359 wait complete. 2024-04-25T23:56:58.644 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete fooo fooo --yes-i-really-really-mean-it 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient: get_monmap_and_config 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient: build_initial_monmap 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient: monmap: 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:58.783865+0000 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:58.783865+0000 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:58.772 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 1 Processor -- start 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 1 -- start start 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient: init 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient: _add_conns ranks=[5,4,2,8,3,0,7,1,6] 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient(hunting): picked mon.noname-h con 0x7fb26c135a00 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient(hunting): picked mon.noname-c con 0x7fb26c0a1790 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:58.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient(hunting): picked mon.noname-b con 0x7fb26c13c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26c0a1d80 con 0x7fb26c13c130 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26c072f70 con 0x7fb26c0a1790 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26c072640 con 0x7fb26c135a00 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient(hunting): authenticate will time out at 1069.490755s 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb272455640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb26c135a00 0x7fb26c135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:37350/0 (socket says 172.21.15.171:37350) 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb272455640 1 -- 172.21.15.171:0/152182234 learned_addr learned my addr 172.21.15.171:0/152182234 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47451745 0 0) 0x7fb26c072640 con 0x7fb26c135a00 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient(hunting): _negotiate 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient(hunting): my global_id is 4883 2024-04-25T23:56:58.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb258003530 con 0x7fb26c135a00 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2804970365 0 0) 0x7fb258003530 con 0x7fb26c135a00 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 >> v1:172.21.15.106:6791/0 conn(0x7fb26c0a1790 legacy=0x7fb26c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 >> v1:172.21.15.106:6790/0 conn(0x7fb26c13c130 legacy=0x7fb26c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: _finish_hunting 0 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 monclient: found mon.noname-h 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:56:58.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c072920 con 0x7fb26c135a00 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: _finish_auth 0 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: _check_auth_tickets 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2600017c0 con 0x7fb26c135a00 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: dump: 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.776 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 5 monclient: authenticate success, global_id 4883 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:58.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb260001ab0 con 0x7fb26c135a00 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb2746b9640 4 set_mon_vals no callback set 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 1 -- 172.21.15.171:0/152182234 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb260004bf0 con 0x7fb26c135a00 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.781+0000 7fb271453640 10 monclient: dump: 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.778 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: shutdown 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:58.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/152182234 >> v1:172.21.15.171:6791/0 conn(0x7fb26c135a00 legacy=0x7fb26c135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/152182234 shutdown_connections 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/152182234 >> 172.21.15.171:0/152182234 conn(0x7fb26c0a2690 msgr2=0x7fb26c0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/152182234 shutdown_connections 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/152182234 wait complete. 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: build_initial_monmap 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: monmap: 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:58.781 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:58.781 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.781 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:58.781 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:58.781 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:58.781 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 Processor -- start 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- start start 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: init 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _add_conns ranks=[8,4,1,0,6,3,5,2,7] 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient(hunting): picked mon.noname-e con 0x7fb26c0a1790 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:58.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient(hunting): picked mon.noname-c con 0x7fb26c135a00 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient(hunting): picked mon.noname-f con 0x7fb26c13c130 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26c09b550 con 0x7fb26c13c130 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26c09fc40 con 0x7fb26c135a00 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb26c09f6f0 con 0x7fb26c0a1790 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient(hunting): authenticate will time out at 1069.493770s 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb272c56640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb26c13c130 0x7fb26c1d4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36304/0 (socket says 172.21.15.171:36304) 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb272c56640 1 -- 172.21.15.171:0/136837480 learned_addr learned my addr 172.21.15.171:0/136837480 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1760637533 0 0) 0x7fb26c09b550 con 0x7fb26c13c130 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): _negotiate 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): my global_id is 134110 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb250003530 con 0x7fb26c13c130 2024-04-25T23:56:58.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 702408491 0 0) 0x7fb250003530 con 0x7fb26c13c130 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb26c09b550 con 0x7fb26c13c130 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb264001d40 con 0x7fb26c13c130 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): dump: 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.784 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2478132211 0 0) 0x7fb26c09b550 con 0x7fb26c13c130 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 >> v1:172.21.15.106:6793/0 conn(0x7fb26c0a1790 legacy=0x7fb26c09dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 >> v1:172.21.15.106:6791/0 conn(0x7fb26c135a00 legacy=0x7fb26c1d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:58.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: _finish_hunting 0 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 monclient: found mon.f 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb26c1337a0 con 0x7fb26c13c130 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: _finish_auth 0 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: _check_auth_tickets 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 5 monclient: authenticate success, global_id 134110 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _renew_subs 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb26c09b270 con 0x7fb26c13c130 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _renew_subs 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:58.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb26c071470 con 0x7fb26c13c130 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb264003c50 con 0x7fb26c13c130 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2640041c0 con 0x7fb26c13c130 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb270c52640 4 set_mon_vals no callback set 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 10 monclient: dump: 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:58.787 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb254005090 con 0x7fb26c13c130 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb2640043e0 con 0x7fb26c13c130 2024-04-25T23:56:58.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fb2640449a0 con 0x7fb26c13c130 2024-04-25T23:56:58.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.785+0000 7fb272455640 10 monclient: get_auth_request con 0x7fb250037830 auth_method 0 2024-04-25T23:56:58.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.793+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb264015c70 con 0x7fb26c13c130 2024-04-25T23:56:58.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.793+0000 7fb25effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:58.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.793+0000 7fb25effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:58.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.973+0000 7fb2746b9640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.973+0000 7fb2746b9640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.973+0000 7fb2746b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:58.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.973+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb254005380 con 0x7fb26c13c130 2024-04-25T23:56:58.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.973+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}]=0 pool 'fooo' does not exist v38) ==== 159+0+0 (unknown 940139346 0 0) 0x7fb264015570 con 0x7fb26c13c130 2024-04-25T23:56:58.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.973+0000 7fb25effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:58.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:58.973+0000 7fb25effd640 10 monclient: _finish_command 2 = system:0 pool 'fooo' does not exist 2024-04-25T23:56:59.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.101+0000 7fb2746b9640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.101+0000 7fb2746b9640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.101+0000 7fb2746b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:59.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.101+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb254001150 con 0x7fb26c13c130 2024-04-25T23:56:59.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb25effd640 1 -- 172.21.15.171:0/136837480 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}]=0 pool 'fooo' does not exist v38) ==== 159+0+0 (unknown 940139346 0 0) 0x7fb26401e120 con 0x7fb26c13c130 2024-04-25T23:56:59.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb25effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb25effd640 10 monclient: _finish_command 3 = system:0 pool 'fooo' does not exist 2024-04-25T23:56:59.087 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'fooo' does not exist 2024-04-25T23:56:59.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 >> v1:172.21.15.171:6812/722422047 conn(0x7fb250037830 legacy=0x7fb250039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 10 monclient: shutdown 2024-04-25T23:56:59.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:59.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 >> v1:172.21.15.171:6789/0 conn(0x7fb26c13c130 legacy=0x7fb26c1d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 shutdown_connections 2024-04-25T23:56:59.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 >> 172.21.15.171:0/136837480 conn(0x7fb26c0a2690 msgr2=0x7fb26c0a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:59.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 shutdown_connections 2024-04-25T23:56:59.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.105+0000 7fb2746b9640 1 -- 172.21.15.171:0/136837480 wait complete. 2024-04-25T23:56:59.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete fooo fooo --yes-i-really-really-mean-it 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: get_monmap_and_config 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: build_initial_monmap 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: monmap: 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:59.242658+0000 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:59.242658+0000 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:59.224 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 Processor -- start 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- start start 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: init 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: _add_conns ranks=[7,3,1,5,4,6,8,2,0] 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient(hunting): picked mon.noname-i con 0x7fa1b41379d0 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient(hunting): picked mon.noname-g con 0x7fa1b41384c0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient(hunting): picked mon.noname-f con 0x7fa1b413e620 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b40a2b00 con 0x7fa1b413e620 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b40a2de0 con 0x7fa1b41384c0 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b40a17a0 con 0x7fa1b41379d0 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient(hunting): authenticate will time out at 1069.949567s 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b3fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fa1b41384c0 0x7fa1b413cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:44562/0 (socket says 172.21.15.171:44562) 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b3fff640 1 -- 172.21.15.171:0/1014063479 learned_addr learned my addr 172.21.15.171:0/1014063479 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b8900640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fa1b41379d0 0x7fa1b4137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:58386/0 (socket says 172.21.15.171:58386) 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3925492619 0 0) 0x7fa1b40a2de0 con 0x7fa1b41384c0 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): my global_id is 4791 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa19c003530 con 0x7fa1b41384c0 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3662062454 0 0) 0x7fa1b40a17a0 con 0x7fa1b41379d0 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): my global_id is 134107 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1b40a2de0 con 0x7fa1b41379d0 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286664924 0 0) 0x7fa1b40a2b00 con 0x7fa1b413e620 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient(hunting): my global_id is 134119 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1b40a17a0 con 0x7fa1b413e620 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 904098681 0 0) 0x7fa19c003530 con 0x7fa1b41384c0 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 >> v1:172.21.15.171:6792/0 conn(0x7fa1b41379d0 legacy=0x7fa1b4137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 >> v1:172.21.15.171:6789/0 conn(0x7fa1b413e620 legacy=0x7fa1b4140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: _finish_hunting 0 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 monclient: found mon.noname-g 2024-04-25T23:56:59.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40a3b20 con 0x7fa1b41384c0 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: _finish_auth 0 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: _check_auth_tickets 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa1a40017c0 con 0x7fa1b41384c0 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: dump: 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.236 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 5 monclient: authenticate success, global_id 4791 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1a4001a60 con 0x7fa1b41384c0 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:59.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 1 -- 172.21.15.171:0/1014063479 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa1a4004bf0 con 0x7fa1b41384c0 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 4 set_mon_vals no callback set 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1b37fe640 10 monclient: dump: 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.238 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: shutdown 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- 172.21.15.171:0/1014063479 >> v1:172.21.15.171:6790/0 conn(0x7fa1b41384c0 legacy=0x7fa1b413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- 172.21.15.171:0/1014063479 shutdown_connections 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- 172.21.15.171:0/1014063479 >> 172.21.15.171:0/1014063479 conn(0x7fa1b40a6b30 msgr2=0x7fa1b40a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- 172.21.15.171:0/1014063479 shutdown_connections 2024-04-25T23:56:59.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 1 -- 172.21.15.171:0/1014063479 wait complete. 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: build_initial_monmap 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.241+0000 7fa1bab64640 10 monclient: monmap: 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:59.240 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 Processor -- start 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 -- start start 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: init 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _add_conns ranks=[1,7,0,4,2,3,5,8,6] 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient(hunting): picked mon.noname-f con 0x7fa1b41379d0 addr v1:172.21.15.171:6789/0 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient(hunting): picked mon.noname-i con 0x7fa1b41384c0 addr v1:172.21.15.171:6792/0 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient(hunting): picked mon.noname-a con 0x7fa1b413e620 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b413c210 con 0x7fa1b413e620 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b413c4f0 con 0x7fa1b41379d0 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1b413a8b0 con 0x7fa1b41384c0 2024-04-25T23:56:59.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient(hunting): authenticate will time out at 1069.952828s 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b8900640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa1b41379d0 0x7fa1b4139a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36318/0 (socket says 172.21.15.171:36318) 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b8900640 1 -- 172.21.15.171:0/949040636 learned_addr learned my addr 172.21.15.171:0/949040636 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2529719398 0 0) 0x7fa1b413c4f0 con 0x7fa1b41379d0 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): my global_id is 134128 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1a0003530 con 0x7fa1b41379d0 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 618933648 0 0) 0x7fa1b413a8b0 con 0x7fa1b41384c0 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): my global_id is 134116 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1b413c4f0 con 0x7fa1b41384c0 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1480021515 0 0) 0x7fa1a0003530 con 0x7fa1b41379d0 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1b413a8b0 con 0x7fa1b41379d0 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa1a80015e0 con 0x7fa1b41379d0 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): dump: 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.243 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2860966049 0 0) 0x7fa1b413c4f0 con 0x7fa1b41384c0 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1a0003530 con 0x7fa1b41384c0 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa1a40016c0 con 0x7fa1b41384c0 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): dump: 2024-04-25T23:56:59.244 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 649704727 0 0) 0x7fa1b413c210 con 0x7fa1b413e620 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient(hunting): my global_id is 4788 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1b413c4f0 con 0x7fa1b413e620 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1344230352 0 0) 0x7fa1b413a8b0 con 0x7fa1b41379d0 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 >> v1:172.21.15.171:6792/0 conn(0x7fa1b41384c0 legacy=0x7fa1b413a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 >> v1:172.21.15.106:6789/0 conn(0x7fa1b413e620 legacy=0x7fa1b41d4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: _finish_hunting 0 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 monclient: found mon.f 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1b40a0fa0 con 0x7fa1b41379d0 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: _finish_auth 0 2024-04-25T23:56:59.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: _check_auth_tickets 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 5 monclient: authenticate success, global_id 134128 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _renew_subs 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa1b4138cd0 con 0x7fa1b41379d0 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _renew_subs 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1b413bc50 con 0x7fa1b41379d0 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa1a8004aa0 con 0x7fa1b41379d0 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b2ffd640 4 set_mon_vals no callback set 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa1a8004f90 con 0x7fa1b41379d0 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:56:59.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 10 monclient: dump: 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa194005090 con 0x7fa1b41379d0 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa1a800fd30 con 0x7fa1b41379d0 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fa1a80445d0 con 0x7fa1b41379d0 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.245+0000 7fa1b3fff640 10 monclient: get_auth_request con 0x7fa1a0037e30 auth_method 0 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.249+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa1a80158a0 con 0x7fa1b41379d0 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.249+0000 7fa1b17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:59.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.249+0000 7fa1b17fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:59.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.417+0000 7fa1bab64640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.417+0000 7fa1bab64640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.417+0000 7fa1bab64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:59.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.417+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa194005380 con 0x7fa1b41379d0 2024-04-25T23:56:59.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.417+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}]=0 pool 'fooo' does not exist v38) ==== 159+0+0 (unknown 940139346 0 0) 0x7fa1a80151a0 con 0x7fa1b41379d0 2024-04-25T23:56:59.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.417+0000 7fa1b17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.417+0000 7fa1b17fa640 10 monclient: _finish_command 2 = system:0 pool 'fooo' does not exist 2024-04-25T23:56:59.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.517+0000 7fa1bab64640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.517+0000 7fa1bab64640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.517+0000 7fa1bab64640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:56:59.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.517+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa194001150 con 0x7fa1b41379d0 2024-04-25T23:56:59.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.517+0000 7fa1b17fa640 1 -- 172.21.15.171:0/949040636 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}]=0 pool 'fooo' does not exist v38) ==== 159+0+0 (unknown 940139346 0 0) 0x7fa1a801dd50 con 0x7fa1b41379d0 2024-04-25T23:56:59.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.517+0000 7fa1b17fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "fooo", "pool2": "fooo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.517+0000 7fa1b17fa640 10 monclient: _finish_command 3 = system:0 pool 'fooo' does not exist 2024-04-25T23:56:59.502 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'fooo' does not exist 2024-04-25T23:56:59.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 >> v1:172.21.15.171:6812/722422047 conn(0x7fa1a0037e30 legacy=0x7fa1a003a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 10 monclient: shutdown 2024-04-25T23:56:59.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:59.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 >> v1:172.21.15.171:6789/0 conn(0x7fa1b41379d0 legacy=0x7fa1b4139a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 shutdown_connections 2024-04-25T23:56:59.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 >> 172.21.15.171:0/949040636 conn(0x7fa1b40a6b30 msgr2=0x7fa1b40a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:59.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 shutdown_connections 2024-04-25T23:56:59.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.521+0000 7fa1bab64640 1 -- 172.21.15.171:0/949040636 wait complete. 2024-04-25T23:56:59.519 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool delete fuggg fuggg --yes-i-really-really-mean-it 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.653+0000 7f0783fa5640 10 monclient: get_monmap_and_config 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.653+0000 7f0783fa5640 10 monclient: build_initial_monmap 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.653+0000 7f0783fa5640 10 monclient: monmap: 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:56:59.658259+0000 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:56:59.658259+0000 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:59.639 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:59.640 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 Processor -- start 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- start start 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient: init 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient: _add_conns ranks=[8,4,3,5,2,7,0,6,1] 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient(hunting): picked mon.noname-e con 0x7f077c0a13f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient(hunting): picked mon.noname-c con 0x7f077c0a17d0 addr v1:172.21.15.106:6791/0 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient(hunting): picked mon.noname-g con 0x7f077c0a1c30 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:59.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c072d80 con 0x7f077c0a1c30 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c136370 con 0x7f077c0a17d0 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c0711c0 con 0x7f077c0a13f0 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient(hunting): authenticate will time out at 1070.365517s 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0782542640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f077c0a1c30 0x7f077c13e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:44572/0 (socket says 172.21.15.171:44572) 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0782542640 1 -- 172.21.15.171:0/1107040354 learned_addr learned my addr 172.21.15.171:0/1107040354 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3124004203 0 0) 0x7f077c072d80 con 0x7f077c0a1c30 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient(hunting): my global_id is 4800 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0768003530 con 0x7f077c0a1c30 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3769415708 0 0) 0x7f0768003530 con 0x7f077c0a1c30 2024-04-25T23:56:59.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 >> v1:172.21.15.106:6793/0 conn(0x7f077c0a13f0 legacy=0x7f077c135c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 >> v1:172.21.15.106:6791/0 conn(0x7f077c0a17d0 legacy=0x7f077c13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: _finish_hunting 0 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 monclient: found mon.noname-g 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c072470 con 0x7f077c0a1c30 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: _finish_auth 0 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: _check_auth_tickets 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0774001b40 con 0x7f077c0a1c30 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: dump: 2024-04-25T23:56:59.649 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.650 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 5 monclient: authenticate success, global_id 4800 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0774001e30 con 0x7f077c0a1c30 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 1 -- 172.21.15.171:0/1107040354 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0774004f70 con 0x7f077c0a1c30 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0780d3f640 10 monclient: dump: 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.651 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient: get_monmap_and_config success 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 4 set_mon_vals no callback set 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient: shutdown 2024-04-25T23:56:59.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- 172.21.15.171:0/1107040354 >> v1:172.21.15.171:6790/0 conn(0x7f077c0a1c30 legacy=0x7f077c13e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- 172.21.15.171:0/1107040354 shutdown_connections 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- 172.21.15.171:0/1107040354 >> 172.21.15.171:0/1107040354 conn(0x7f077c0a4820 msgr2=0x7f077c0a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- 172.21.15.171:0/1107040354 shutdown_connections 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 1 -- 172.21.15.171:0/1107040354 wait complete. 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient: build_initial_monmap 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.657+0000 7f0783fa5640 10 monclient: monmap: 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.653 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 Processor -- start 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 -- start start 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: init 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _reopen_session rank -1 2024-04-25T23:56:59.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _add_conns ranks=[5,3,0,2,1,4,8,6,7] 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient(hunting): picked mon.noname-h con 0x7f077c0a13f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient(hunting): picked mon.noname-g con 0x7f077c0a17d0 addr v1:172.21.15.171:6790/0 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient(hunting): picked mon.noname-a con 0x7f077c0a1c30 addr v1:172.21.15.106:6789/0 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c124be0 con 0x7f077c0a1c30 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c1247c0 con 0x7f077c0a17d0 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c071980 con 0x7f077c0a13f0 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient(hunting): _renew_subs 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient(hunting): authenticate will time out at 1070.368612s 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0781540640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f077c0a17d0 0x7f077c1cf730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:44576/0 (socket says 172.21.15.171:44576) 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0781540640 1 -- 172.21.15.171:0/1264968870 learned_addr learned my addr 172.21.15.171:0/1264968870 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036360099 0 0) 0x7f077c071980 con 0x7f077c0a13f0 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): my global_id is 4892 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0760003530 con 0x7f077c0a13f0 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413951317 0 0) 0x7f077c1247c0 con 0x7f077c0a17d0 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): my global_id is 4809 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f077c071980 con 0x7f077c0a17d0 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4152879204 0 0) 0x7f0760003530 con 0x7f077c0a13f0 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f077c1247c0 con 0x7f077c0a13f0 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 718751805 0 0) 0x7f077c071980 con 0x7f077c0a17d0 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0760003530 con 0x7f077c0a17d0 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 660318395 0 0) 0x7f077c072470 con 0x7f077c0a1c30 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _negotiate 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:56:59.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): my global_id is 4797 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f077c071980 con 0x7f077c0a1c30 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0778001990 con 0x7f077c0a13f0 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): dump: 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.657 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f076c001a60 con 0x7f077c0a17d0 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient(hunting): dump: 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.658 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3476045199 0 0) 0x7f077c1247c0 con 0x7f077c0a13f0 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 >> v1:172.21.15.171:6790/0 conn(0x7f077c0a17d0 legacy=0x7f077c1cf730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 >> v1:172.21.15.106:6789/0 conn(0x7f077c0a1c30 legacy=0x7f077c1d2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: _finish_hunting 0 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 monclient: found mon.h 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c0a2100 con 0x7f077c0a13f0 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: _finish_auth 0 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: _check_auth_tickets 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 5 monclient: authenticate success, global_id 4892 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _renew_subs 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f077c1224d0 con 0x7f077c0a13f0 2024-04-25T23:56:59.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _renew_subs 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f077c134250 con 0x7f077c0a13f0 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0778001b30 con 0x7f077c0a13f0 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0778003c10 con 0x7f077c0a13f0 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0773fff640 4 set_mon_vals no callback set 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 10 monclient: dump: 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:56:59.661 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:59.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0764005090 con 0x7f077c0a13f0 2024-04-25T23:56:59.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0778003e30 con 0x7f077c0a13f0 2024-04-25T23:56:59.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7f0778043210 con 0x7f077c0a13f0 2024-04-25T23:56:59.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.661+0000 7f0781540640 10 monclient: get_auth_request con 0x7f0760037f90 auth_method 0 2024-04-25T23:56:59.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.665+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f07780144a0 con 0x7f077c0a13f0 2024-04-25T23:56:59.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.665+0000 7f07727fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:56:59.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.665+0000 7f07727fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:56:59.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.829+0000 7f0783fa5640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.829+0000 7f0783fa5640 10 monclient: _send_command 2 [{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.829+0000 7f0783fa5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:59.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.829+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0764005380 con 0x7f077c0a13f0 2024-04-25T23:56:59.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.833+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}]=0 pool 'fuggg' does not exist v38) ==== 162+0+0 (unknown 2356159631 0 0) 0x7f0778018150 con 0x7f077c0a13f0 2024-04-25T23:56:59.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.833+0000 7f07727fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.833+0000 7f07727fc640 10 monclient: _finish_command 2 = system:0 pool 'fuggg' does not exist 2024-04-25T23:56:59.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.925+0000 7f0783fa5640 10 start_mon_command cmd=[{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.925+0000 7f0783fa5640 10 monclient: _send_command 3 [{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.925+0000 7f0783fa5640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:56:59.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.925+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true} v 0) -- 0x7f0764001150 con 0x7f077c0a13f0 2024-04-25T23:56:59.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f07727fc640 1 -- 172.21.15.171:0/1264968870 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}]=0 pool 'fuggg' does not exist v38) ==== 162+0+0 (unknown 2356159631 0 0) 0x7f077801ca10 con 0x7f077c0a13f0 2024-04-25T23:56:59.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f07727fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool delete", "pool": "fuggg", "pool2": "fuggg", "yes_i_really_really_mean_it": true}] 2024-04-25T23:56:59.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f07727fc640 10 monclient: _finish_command 3 = system:0 pool 'fuggg' does not exist 2024-04-25T23:56:59.912 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'fuggg' does not exist 2024-04-25T23:56:59.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 >> v1:172.21.15.171:6812/722422047 conn(0x7f0760037f90 legacy=0x7f076003a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 10 monclient: shutdown 2024-04-25T23:56:59.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:56:59.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 >> v1:172.21.15.171:6791/0 conn(0x7f077c0a13f0 legacy=0x7f077c1ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:56:59.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 shutdown_connections 2024-04-25T23:56:59.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 >> 172.21.15.171:0/1264968870 conn(0x7f077c0a4820 msgr2=0x7f077c0a6af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:56:59.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 shutdown_connections 2024-04-25T23:56:59.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:56:59.929+0000 7f0783fa5640 1 -- 172.21.15.171:0/1264968870 wait complete. 2024-04-25T23:56:59.928 INFO:tasks.workunit.client.0.smithi171.stdout:OK 2024-04-25T23:56:59.929 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo OK 2024-04-25T23:56:59.930 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T23:56:59.930 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T23:56:59.982 INFO:tasks.workunit:Running workunits matching mon/crush_ops.sh on client.0... 2024-04-25T23:56:59.983 INFO:tasks.workunit:Running workunit mon/crush_ops.sh... 2024-04-25T23:56:59.983 DEBUG:teuthology.orchestra.run.smithi171:workunit test mon/crush_ops.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/crush_ops.sh 2024-04-25T23:57:00.035 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush dump 2024-04-25T23:57:00.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.165+0000 7f9a27ca8640 10 monclient: get_monmap_and_config 2024-04-25T23:57:00.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.165+0000 7f9a27ca8640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.165+0000 7f9a27ca8640 10 monclient: monmap: 2024-04-25T23:57:00.151 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:00.151 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.151 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:00.170255+0000 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:00.170255+0000 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 Processor -- start 2024-04-25T23:57:00.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- start start 2024-04-25T23:57:00.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: init 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: _add_conns ranks=[5,2,1,4,6,7,3,8,0] 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): picked mon.noname-h con 0x7f9a20132a30 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): picked mon.noname-b con 0x7f9a200727b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): picked mon.noname-f con 0x7f9a20132e10 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a20136400 con 0x7f9a20132e10 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2009fa80 con 0x7f9a200727b0 2024-04-25T23:57:00.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2009b890 con 0x7f9a20132a30 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): authenticate will time out at 1070.876925s 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a26245640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9a20132e10 0x7f9a2013e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36330/0 (socket says 172.21.15.171:36330) 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a26245640 1 -- 172.21.15.171:0/748448409 learned_addr learned my addr 172.21.15.171:0/748448409 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a25a44640 1 --1- 172.21.15.171:0/748448409 >> v1:172.21.15.171:6791/0 conn(0x7f9a20132a30 0x7f9a201355e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:37374/0 (socket says 172.21.15.171:37374) 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 172914835 0 0) 0x7f9a20136400 con 0x7f9a20132e10 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): my global_id is 134137 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a0c003530 con 0x7f9a20132e10 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3203251508 0 0) 0x7f9a2009b890 con 0x7f9a20132a30 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient(hunting): my global_id is 4901 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a20136400 con 0x7f9a20132a30 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2228678033 0 0) 0x7f9a0c003530 con 0x7f9a20132e10 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 >> v1:172.21.15.171:6791/0 conn(0x7f9a20132a30 legacy=0x7f9a201355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 >> v1:172.21.15.106:6790/0 conn(0x7f9a200727b0 legacy=0x7f9a20135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 monclient: found mon.noname-f 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a200a3500 con 0x7f9a20132e10 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a18001b40 con 0x7f9a20132e10 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 5 monclient: authenticate success, global_id 134137 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: dump: 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.162 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a18001e20 con 0x7f9a20132e10 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 1 -- 172.21.15.171:0/748448409 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a18004f70 con 0x7f9a20132e10 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 4 set_mon_vals no callback set 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a24a42640 10 monclient: dump: 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.164 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: shutdown 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- 172.21.15.171:0/748448409 >> v1:172.21.15.171:6789/0 conn(0x7f9a20132e10 legacy=0x7f9a2013e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- 172.21.15.171:0/748448409 shutdown_connections 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- 172.21.15.171:0/748448409 >> 172.21.15.171:0/748448409 conn(0x7f9a200a67e0 msgr2=0x7f9a200a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- 172.21.15.171:0/748448409 shutdown_connections 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- 172.21.15.171:0/748448409 wait complete. 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: monmap: 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:00.165 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 Processor -- start 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- start start 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: init 2024-04-25T23:57:00.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient: _add_conns ranks=[4,3,6,0,1,8,2,5,7] 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): picked mon.noname-c con 0x7f9a200727b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): picked mon.noname-g con 0x7f9a20132a30 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): picked mon.noname-d con 0x7f9a20132e10 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a201219d0 con 0x7f9a20132a30 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2009e020 con 0x7f9a200727b0 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a2009ade0 con 0x7f9a20132e10 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a27ca8640 10 monclient(hunting): authenticate will time out at 1070.879863s 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a25243640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f9a20132a30 0x7f9a2009d910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:44584/0 (socket says 172.21.15.171:44584) 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.169+0000 7f9a25243640 1 -- 172.21.15.171:0/606641045 learned_addr learned my addr 172.21.15.171:0/606641045 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121409648 0 0) 0x7f9a201219d0 con 0x7f9a20132a30 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): my global_id is 4818 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a04003530 con 0x7f9a20132a30 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4225994483 0 0) 0x7f9a04003530 con 0x7f9a20132a30 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a201219d0 con 0x7f9a20132a30 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193963675 0 0) 0x7f9a2009ade0 con 0x7f9a20132e10 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): my global_id is 4821 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a04003530 con 0x7f9a20132e10 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a10001a00 con 0x7f9a20132a30 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): dump: 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.169 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3484992502 0 0) 0x7f9a2009e020 con 0x7f9a200727b0 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient(hunting): my global_id is 134140 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a2009ade0 con 0x7f9a200727b0 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1141447459 0 0) 0x7f9a201219d0 con 0x7f9a20132a30 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 >> v1:172.21.15.106:6792/0 conn(0x7f9a20132e10 legacy=0x7f9a201d4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 >> v1:172.21.15.106:6791/0 conn(0x7f9a200727b0 legacy=0x7f9a2009d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 monclient: found mon.g 2024-04-25T23:57:00.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a2009e610 con 0x7f9a20132a30 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 5 monclient: authenticate success, global_id 4818 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 10 monclient: _renew_subs 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a2009f170 con 0x7f9a20132a30 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 10 monclient: _renew_subs 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a20121cb0 con 0x7f9a20132a30 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a100038d0 con 0x7f9a20132a30 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a10003e40 con 0x7f9a20132a30 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a17fff640 4 set_mon_vals no callback set 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 10 monclient: dump: 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.172 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9a10004060 con 0x7f9a20132a30 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7f9a10044510 con 0x7f9a20132a30 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a20068fb0 con 0x7f9a20132a30 2024-04-25T23:57:00.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.173+0000 7f9a25a44640 10 monclient: get_auth_request con 0x7f9a04037a40 auth_method 0 2024-04-25T23:57:00.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.177+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9a10015840 con 0x7f9a20132a30 2024-04-25T23:57:00.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.177+0000 7f9a167fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.177+0000 7f9a167fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:00.296 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:57:00.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.345+0000 7f9a27ca8640 10 start_mon_command cmd=[{"prefix": "osd crush dump"}] 2024-04-25T23:57:00.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.345+0000 7f9a27ca8640 10 monclient: _send_command 2 [{"prefix": "osd crush dump"}] 2024-04-25T23:57:00.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.345+0000 7f9a27ca8640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:00.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.345+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush dump"} v 0) -- 0x7f9a20072e40 con 0x7f9a20132a30 2024-04-25T23:57:00.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.345+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush dump"}]=0 v38) ==== 62+0+7331 (unknown 2541289373 0 2198571024) 0x7f9a10015140 con 0x7f9a20132a30 2024-04-25T23:57:00.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.345+0000 7f9a167fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush dump"}] 2024-04-25T23:57:00.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.345+0000 7f9a167fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient: get_monmap_and_config 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient: monmap: 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:00.440496+0000 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:00.440496+0000 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.422 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.437+0000 7f9a27ca8640 10 start_mon_command cmd=[{"prefix": "osd crush dump"}] 2024-04-25T23:57:00.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.437+0000 7f9a27ca8640 10 monclient: _send_command 3 [{"prefix": "osd crush dump"}] 2024-04-25T23:57:00.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.437+0000 7f9a27ca8640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:00.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.437+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush dump"} v 0) -- 0x7f9a20135a30 con 0x7f9a20132a30 2024-04-25T23:57:00.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.437+0000 7f9a167fc640 1 -- 172.21.15.171:0/606641045 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush dump"}]=0 v38) ==== 62+0+7331 (unknown 2541289373 0 2198571024) 0x7f9a1001dcf0 con 0x7f9a20132a30 2024-04-25T23:57:00.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.437+0000 7f9a167fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush dump"}] 2024-04-25T23:57:00.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.437+0000 7f9a167fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout:{ 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: "devices": [ 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 0, 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "osd.0", 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: "class": "ssd" 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 1, 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "osd.1", 2024-04-25T23:57:00.425 INFO:tasks.workunit.client.0.smithi171.stdout: "class": "ssd" 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 2, 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "osd.2", 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: "class": "ssd" 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 3, 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "osd.3", 2024-04-25T23:57:00.426 INFO:tasks.workunit.client.0.smithi171.stdout: "class": "ssd" 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 4, 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "osd.4", 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: "class": "ssd" 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 5, 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "osd.5", 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: "class": "ssd" 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: "types": [ 2024-04-25T23:57:00.427 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 0, 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "osd" 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 1, 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "host" 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 2, 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "chassis" 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 3, 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "rack" 2024-04-25T23:57:00.428 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 4, 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "row" 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 5, 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "pdu" 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 6, 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "pod" 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.429 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 7, 2024-04-25T23:57:00.430 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "room" 2024-04-25T23:57:00.430 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.430 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.430 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 8, 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "datacenter" 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 9, 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "zone" 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 10, 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "region" 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 11, 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "root" 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.431 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "buckets": [ 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -1, 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "default", 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 11, 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "type_name": "root", 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 34560, 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "alg": "straw2", 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "hash": "rjenkins1", 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "items": [ 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -3, 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 0 2024-04-25T23:57:00.432 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -5, 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 1 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -2, 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "default~ssd", 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 11, 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "type_name": "root", 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 34560, 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "alg": "straw2", 2024-04-25T23:57:00.433 INFO:tasks.workunit.client.0.smithi171.stdout: "hash": "rjenkins1", 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: "items": [ 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -4, 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 0 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -6, 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 1 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.434 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -3, 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "smithi106", 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 1, 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "type_name": "host", 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "alg": "straw2", 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "hash": "rjenkins1", 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "items": [ 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 1, 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 0 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.435 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 2, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 1 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 0, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 2 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -4, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "smithi106~ssd", 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 1, 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "type_name": "host", 2024-04-25T23:57:00.436 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "alg": "straw2", 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "hash": "rjenkins1", 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "items": [ 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 1, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 0 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 2, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 1 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 0, 2024-04-25T23:57:00.437 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 2 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -5, 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "smithi171", 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 1, 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "type_name": "host", 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "alg": "straw2", 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "hash": "rjenkins1", 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: "items": [ 2024-04-25T23:57:00.438 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 5, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 0 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 3, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 1 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 4, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 2 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.439 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "id": -6, 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "name": "smithi171~ssd", 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "type_id": 1, 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "type_name": "host", 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 17280, 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "alg": "straw2", 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "hash": "rjenkins1", 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "items": [ 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 5, 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 0 2024-04-25T23:57:00.440 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 3, 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 1 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "id": 4, 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "weight": 5760, 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "pos": 2 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "rules": [ 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.441 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_id": 0, 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_name": "replicated_rule", 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "type": 1, 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "steps": [ 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "take", 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "item": -1, 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "item_name": "default" 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "choose_firstn", 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 0, 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: "type": "osd" 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.442 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "emit" 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_id": 1, 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_name": "erasure-code", 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "type": 3, 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "steps": [ 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "set_chooseleaf_tries", 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 5 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.443 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "set_choose_tries", 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 100 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "take", 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "item": -1, 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "item_name": "default" 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "choose_indep", 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 0, 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "type": "osd" 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.444 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "emit" 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "tunables": { 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "choose_local_tries": 0, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "choose_local_fallback_tries": 0, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "choose_total_tries": 50, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "chooseleaf_descend_once": 1, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "chooseleaf_vary_r": 1, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "chooseleaf_stable": 1, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "msr_descents": 100, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "msr_collision_tries": 100, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "straw_calc_version": 1, 2024-04-25T23:57:00.445 INFO:tasks.workunit.client.0.smithi171.stdout: "allowed_bucket_algs": 54, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "profile": "jewel", 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "optimal_tunables": 1, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "legacy_tunables": 0, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "minimum_required_version": "jewel", 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "require_feature_tunables": 1, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "require_feature_tunables2": 1, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "has_v2_rules": 1, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "require_feature_tunables3": 1, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "has_v3_rules": 0, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "has_v4_buckets": 1, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "require_feature_tunables5": 1, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "has_v5_rules": 0, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "has_msr_rules": 0 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.446 INFO:tasks.workunit.client.0.smithi171.stdout: "choose_args": {} 2024-04-25T23:57:00.447 INFO:tasks.workunit.client.0.smithi171.stdout:} 2024-04-25T23:57:00.447 INFO:tasks.workunit.client.0.smithi171.stdout: 2024-04-25T23:57:00.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 >> v1:172.21.15.171:6812/722422047 conn(0x7f9a04037a40 legacy=0x7f9a04039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 10 monclient: shutdown 2024-04-25T23:57:00.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.448 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 >> v1:172.21.15.171:6790/0 conn(0x7f9a20132a30 legacy=0x7f9a2009d910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 shutdown_connections 2024-04-25T23:57:00.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 >> 172.21.15.171:0/606641045 conn(0x7f9a200a67e0 msgr2=0x7f9a20131d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 shutdown_connections 2024-04-25T23:57:00.449 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.441+0000 7f9a27ca8640 1 -- 172.21.15.171:0/606641045 wait complete. 2024-04-25T23:57:00.449 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule dump 2024-04-25T23:57:00.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 1 Processor -- start 2024-04-25T23:57:00.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 1 -- start start 2024-04-25T23:57:00.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient: init 2024-04-25T23:57:00.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient: _add_conns ranks=[2,4,3,5,0,1,7,6,8] 2024-04-25T23:57:00.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient(hunting): picked mon.noname-b con 0x7fc3841311d0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient(hunting): picked mon.noname-c con 0x7fc38409c570 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 10 monclient(hunting): picked mon.noname-g con 0x7fc38409c970 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.435+0000 7fc388d6b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38409d160 con 0x7fc3841311d0 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38409b8b0 con 0x7fc38409c970 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc38409bb90 con 0x7fc38409c570 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient(hunting): authenticate will time out at 1075.968075s 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38259c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc3841311d0 0x7fc3841315b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48824/0 (socket says 172.21.15.106:48824) 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38259c640 1 -- 172.21.15.106:0/1878483290 learned_addr learned my addr 172.21.15.106:0/1878483290 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776204008 0 0) 0x7fc38409d160 con 0x7fc3841311d0 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): my global_id is 4799 2024-04-25T23:57:00.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc370003530 con 0x7fc3841311d0 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643172 0 0) 0x7fc38409bb90 con 0x7fc38409c570 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient(hunting): my global_id is 134149 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc38409d160 con 0x7fc38409c570 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4066119257 0 0) 0x7fc370003530 con 0x7fc3841311d0 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 >> v1:172.21.15.106:6791/0 conn(0x7fc38409c570 legacy=0x7fc38413ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 >> v1:172.21.15.171:6790/0 conn(0x7fc38409c970 legacy=0x7fc384140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 monclient: found mon.noname-b 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3840a6f70 con 0x7fc3841311d0 2024-04-25T23:57:00.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc37c0017c0 con 0x7fc3841311d0 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 5 monclient: authenticate success, global_id 4799 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: dump: 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.457 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc37c001ae0 con 0x7fc3841311d0 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 4 set_mon_vals no callback set 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 1 -- 172.21.15.106:0/1878483290 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc37c004bf0 con 0x7fc3841311d0 2024-04-25T23:57:00.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38159a640 10 monclient: dump: 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.459 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient: shutdown 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- 172.21.15.106:0/1878483290 >> v1:172.21.15.106:6790/0 conn(0x7fc3841311d0 legacy=0x7fc3841315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- 172.21.15.106:0/1878483290 shutdown_connections 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- 172.21.15.106:0/1878483290 >> 172.21.15.106:0/1878483290 conn(0x7fc3840a6220 msgr2=0x7fc3840a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- 172.21.15.106:0/1878483290 shutdown_connections 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- 172.21.15.106:0/1878483290 wait complete. 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient: monmap: 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:00.460 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 Processor -- start 2024-04-25T23:57:00.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- start start 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient: init 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient: _add_conns ranks=[0,8,1,2,5,4,7,6,3] 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient(hunting): picked mon.noname-a con 0x7fc38409c570 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient(hunting): picked mon.noname-e con 0x7fc38409c970 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient(hunting): picked mon.noname-f con 0x7fc3841311d0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc384071460 con 0x7fc38409c570 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc384071fc0 con 0x7fc3841311d0 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc384071900 con 0x7fc38409c970 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc388d6b640 10 monclient(hunting): authenticate will time out at 1075.971113s 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38259c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc38409c570 0x7fc38406fbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39742/0 (socket says 172.21.15.106:39742) 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc38259c640 1 -- 172.21.15.106:0/2147401035 learned_addr learned my addr 172.21.15.106:0/2147401035 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:00.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484834864 0 0) 0x7fc384071460 con 0x7fc38409c570 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): my global_id is 4806 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc364003530 con 0x7fc38409c570 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2359046902 0 0) 0x7fc384071900 con 0x7fc38409c970 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): my global_id is 134117 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc384071460 con 0x7fc38409c970 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3007604112 0 0) 0x7fc384071fc0 con 0x7fc3841311d0 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): my global_id is 134146 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc384071900 con 0x7fc3841311d0 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1643605751 0 0) 0x7fc364003530 con 0x7fc38409c570 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc384071fc0 con 0x7fc38409c570 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc37c004b30 con 0x7fc38409c570 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): dump: 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.464 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3186767762 0 0) 0x7fc384071460 con 0x7fc38409c970 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc364003530 con 0x7fc38409c970 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc374001a60 con 0x7fc38409c970 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.439+0000 7fc37affd640 10 monclient(hunting): dump: 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.466 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1103793008 0 0) 0x7fc384071fc0 con 0x7fc38409c570 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 >> v1:172.21.15.106:6793/0 conn(0x7fc38409c970 legacy=0x7fc3840702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 >> v1:172.21.15.171:6789/0 conn(0x7fc3841311d0 legacy=0x7fc3841d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 monclient: found mon.a 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc384130510 con 0x7fc38409c570 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 5 monclient: authenticate success, global_id 4806 2024-04-25T23:57:00.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 10 monclient: _renew_subs 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc384072f20 con 0x7fc38409c570 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 10 monclient: _renew_subs 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3840709f0 con 0x7fc38409c570 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc37c001ae0 con 0x7fc38409c570 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc37c001d10 con 0x7fc38409c570 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc380d99640 4 set_mon_vals no callback set 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 10 monclient: dump: 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.468 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc37c010050 con 0x7fc38409c570 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fc37c044540 con 0x7fc38409c570 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc368005090 con 0x7fc38409c570 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.443+0000 7fc381d9b640 10 monclient: get_auth_request con 0x7fc364037d90 auth_method 0 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.447+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc37c0158d0 con 0x7fc38409c570 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.447+0000 7fc37affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.447+0000 7fc37affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:00.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient: get_monmap_and_config 2024-04-25T23:57:00.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.552 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient: monmap: 2024-04-25T23:57:00.552 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:00.552 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:00.571803+0000 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:00.571803+0000 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.553 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 1 Processor -- start 2024-04-25T23:57:00.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 1 -- start start 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient: init 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient: _add_conns ranks=[1,4,2,5,0,7,3,6,8] 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient(hunting): picked mon.noname-f con 0x7fd4e006fe00 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient(hunting): picked mon.noname-c con 0x7fd4e006f600 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient(hunting): picked mon.noname-b con 0x7fd4e00701e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e006fa00 con 0x7fd4e006fe00 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e0135400 con 0x7fd4e00701e0 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e0071670 con 0x7fd4e006f600 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient(hunting): authenticate will time out at 1071.278847s 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e5f42640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd4e006fe00 0x7fd4e01345e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:57558/0 (socket says 172.21.15.171:57558) 2024-04-25T23:57:00.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e5f42640 1 -- 172.21.15.171:0/958697330 learned_addr learned my addr 172.21.15.171:0/958697330 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2863764403 0 0) 0x7fd4e006fa00 con 0x7fd4e006fe00 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient(hunting): my global_id is 134155 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4cc003530 con 0x7fd4e006fe00 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 784593459 0 0) 0x7fd4cc003530 con 0x7fd4e006fe00 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 >> v1:172.21.15.106:6791/0 conn(0x7fd4e006f600 legacy=0x7fd4e0134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 >> v1:172.21.15.106:6790/0 conn(0x7fd4e00701e0 legacy=0x7fd4e013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 monclient: found mon.noname-f 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e0070630 con 0x7fd4e006fe00 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4dc0017c0 con 0x7fd4e006fe00 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 5 monclient: authenticate success, global_id 134155 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: dump: 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.565 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4dc001a30 con 0x7fd4e006fe00 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 1 -- 172.21.15.171:0/958697330 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4dc004bf0 con 0x7fd4e006fe00 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e4f40640 10 monclient: dump: 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.567 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.569+0000 7fd4e81a6640 4 set_mon_vals no callback set 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: shutdown 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/958697330 >> v1:172.21.15.171:6789/0 conn(0x7fd4e006fe00 legacy=0x7fd4e01345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/958697330 shutdown_connections 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/958697330 >> 172.21.15.171:0/958697330 conn(0x7fd4e00a2620 msgr2=0x7fd4e00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/958697330 shutdown_connections 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/958697330 wait complete. 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: monmap: 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.568 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 Processor -- start 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- start start 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: init 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _add_conns ranks=[0,7,1,8,5,4,3,6,2] 2024-04-25T23:57:00.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient(hunting): picked mon.noname-a con 0x7fd4e006f600 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient(hunting): picked mon.noname-i con 0x7fd4e006fe00 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient(hunting): picked mon.noname-f con 0x7fd4e00701e0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e011cf90 con 0x7fd4e006f600 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e0070d60 con 0x7fd4e00701e0 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4e0070880 con 0x7fd4e006fe00 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient(hunting): authenticate will time out at 1071.281874s 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e6743640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd4e00701e0 0x7fd4e01d0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:57564/0 (socket says 172.21.15.171:57564) 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e6743640 1 -- 172.21.15.171:0/620949375 learned_addr learned my addr 172.21.15.171:0/620949375 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e5741640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fd4e006fe00 0x7fd4e011c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:37318/0 (socket says 172.21.15.171:37318) 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3039109566 0 0) 0x7fd4e0070d60 con 0x7fd4e00701e0 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): my global_id is 134164 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c4003530 con 0x7fd4e00701e0 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3540655753 0 0) 0x7fd4e0070880 con 0x7fd4e006fe00 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): my global_id is 134125 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4e0070d60 con 0x7fd4e006fe00 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 523037697 0 0) 0x7fd4c4003530 con 0x7fd4e00701e0 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4e0070880 con 0x7fd4e00701e0 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4d8001d40 con 0x7fd4e00701e0 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): dump: 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.572 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 926570538 0 0) 0x7fd4e011cf90 con 0x7fd4e006f600 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): my global_id is 4815 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c4003530 con 0x7fd4e006f600 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3103563024 0 0) 0x7fd4e0070d60 con 0x7fd4e006fe00 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4e011cf90 con 0x7fd4e006fe00 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4d0001a60 con 0x7fd4e006fe00 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:00.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient(hunting): dump: 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.574 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2414641280 0 0) 0x7fd4e0070880 con 0x7fd4e00701e0 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 >> v1:172.21.15.171:6792/0 conn(0x7fd4e006fe00 legacy=0x7fd4e011c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 >> v1:172.21.15.106:6789/0 conn(0x7fd4e006f600 legacy=0x7fd4e011c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 monclient: found mon.f 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4e011f520 con 0x7fd4e00701e0 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 5 monclient: authenticate success, global_id 134164 2024-04-25T23:57:00.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _renew_subs 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd4e011f800 con 0x7fd4e00701e0 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _renew_subs 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd4e009f420 con 0x7fd4e00701e0 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4d8002000 con 0x7fd4e00701e0 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4d8003f90 con 0x7fd4e00701e0 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d7fff640 4 set_mon_vals no callback set 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 10 monclient: dump: 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.576 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4c8005090 con 0x7fd4e00701e0 2024-04-25T23:57:00.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.573+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd4d8004130 con 0x7fd4e00701e0 2024-04-25T23:57:00.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.577+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fd4d80446f0 con 0x7fd4e00701e0 2024-04-25T23:57:00.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.577+0000 7fd4e5f42640 10 monclient: get_auth_request con 0x7fd4c4038030 auth_method 0 2024-04-25T23:57:00.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.581+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd4d80159e0 con 0x7fd4e00701e0 2024-04-25T23:57:00.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.581+0000 7fd4d67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.581+0000 7fd4d67fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:00.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.667+0000 7fc388d6b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:57:00.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.667+0000 7fc388d6b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:00.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.667+0000 7fc388d6b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.667+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc368005380 con 0x7fc38409c570 2024-04-25T23:57:00.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.667+0000 7fc37affd640 1 -- 172.21.15.106:0/2147401035 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 163587269) 0x7fc37c0151d0 con 0x7fc38409c570 2024-04-25T23:57:00.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.667+0000 7fc37affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:00.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.667+0000 7fc37affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:00.654 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":20,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:57:00.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 >> v1:172.21.15.171:6812/722422047 conn(0x7fc364037d90 legacy=0x7fc36403a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 10 monclient: shutdown 2024-04-25T23:57:00.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 >> v1:172.21.15.106:6789/0 conn(0x7fc38409c570 legacy=0x7fc38406fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 shutdown_connections 2024-04-25T23:57:00.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 >> 172.21.15.106:0/2147401035 conn(0x7fc3840a6220 msgr2=0x7fc384129fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 shutdown_connections 2024-04-25T23:57:00.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.671+0000 7fc388d6b640 1 -- 172.21.15.106:0/2147401035 wait complete. 2024-04-25T23:57:00.672 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-25T23:57:00.672 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-25T23:57:00.672 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:57:00.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.729+0000 7fd4e81a6640 10 start_mon_command cmd=[{"prefix": "osd crush rule dump"}] 2024-04-25T23:57:00.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.729+0000 7fd4e81a6640 10 monclient: _send_command 2 [{"prefix": "osd crush rule dump"}] 2024-04-25T23:57:00.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.729+0000 7fd4e81a6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.729+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rule dump"} v 0) -- 0x7fd4c8005380 con 0x7fd4e00701e0 2024-04-25T23:57:00.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.733+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rule dump"}]=0 v38) ==== 67+0+1058 (unknown 2656755985 0 3068570633) 0x7fd4d80152e0 con 0x7fd4e00701e0 2024-04-25T23:57:00.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.733+0000 7fd4d67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule dump"}] 2024-04-25T23:57:00.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.733+0000 7fd4d67fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: get_monmap_and_config 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: monmap: 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:00.814552+0000 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:00.814552+0000 2024-04-25T23:57:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.796 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 Processor -- start 2024-04-25T23:57:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- start start 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: init 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: _add_conns ranks=[6,3,5,8,0,4,7,1,2] 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient(hunting): picked mon.noname-d con 0x7faf90134610 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient(hunting): picked mon.noname-g con 0x7faf9009cda0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient(hunting): picked mon.noname-h con 0x7faf9013dfc0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9009c960 con 0x7faf9009cda0 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9009bca0 con 0x7faf9013dfc0 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9009bf80 con 0x7faf90134610 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient(hunting): authenticate will time out at 1076.341973s 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf94dfa640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7faf90134610 0x7faf901349f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38746/0 (socket says 172.21.15.106:38746) 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf94dfa640 1 -- 172.21.15.106:0/1073327923 learned_addr learned my addr 172.21.15.106:0/1073327923 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3752945276 0 0) 0x7faf9009bf80 con 0x7faf90134610 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient(hunting): my global_id is 4830 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf80003530 con 0x7faf90134610 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3307333974 0 0) 0x7faf80003530 con 0x7faf90134610 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 >> v1:172.21.15.171:6791/0 conn(0x7faf9013dfc0 legacy=0x7faf901403b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 >> v1:172.21.15.171:6790/0 conn(0x7faf9009cda0 legacy=0x7faf9013c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 monclient: found mon.noname-d 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:00.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9009c260 con 0x7faf90134610 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf840017c0 con 0x7faf90134610 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: dump: 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.807 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 5 monclient: authenticate success, global_id 4830 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf84001ab0 con 0x7faf90134610 2024-04-25T23:57:00.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 4 set_mon_vals no callback set 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 1 -- 172.21.15.106:0/1073327923 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf84004bf0 con 0x7faf90134610 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf8f7fe640 10 monclient: dump: 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.809 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: shutdown 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- 172.21.15.106:0/1073327923 >> v1:172.21.15.106:6792/0 conn(0x7faf90134610 legacy=0x7faf901349f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- 172.21.15.106:0/1073327923 shutdown_connections 2024-04-25T23:57:00.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- 172.21.15.106:0/1073327923 >> 172.21.15.106:0/1073327923 conn(0x7faf9006b3e0 msgr2=0x7faf9006b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- 172.21.15.106:0/1073327923 shutdown_connections 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 1 -- 172.21.15.106:0/1073327923 wait complete. 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.811+0000 7faf9705e640 10 monclient: monmap: 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.811 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 Processor -- start 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 -- start start 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient: init 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient: _add_conns ranks=[2,3,7,4,1,8,6,0,5] 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient(hunting): picked mon.noname-b con 0x7faf9009cda0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient(hunting): picked mon.noname-g con 0x7faf90134610 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient(hunting): picked mon.noname-i con 0x7faf9013dfc0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf9009b380 con 0x7faf9009cda0 2024-04-25T23:57:00.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf901377f0 con 0x7faf90134610 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf90139ae0 con 0x7faf9013dfc0 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient(hunting): authenticate will time out at 1076.344842s 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf94dfa640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7faf9009cda0 0x7faf901ccce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48836/0 (socket says 172.21.15.106:48836) 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf94dfa640 1 -- 172.21.15.106:0/3844218132 learned_addr learned my addr 172.21.15.106:0/3844218132 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145961788 0 0) 0x7faf9009b380 con 0x7faf9009cda0 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): my global_id is 4817 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf74003530 con 0x7faf9009cda0 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1086203246 0 0) 0x7faf74003530 con 0x7faf9009cda0 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf9009b380 con 0x7faf9009cda0 2024-04-25T23:57:00.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf84001780 con 0x7faf9009cda0 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): dump: 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.814 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2405407003 0 0) 0x7faf901377f0 con 0x7faf90134610 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): my global_id is 4845 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf74003530 con 0x7faf90134610 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2943606976 0 0) 0x7faf9009b380 con 0x7faf9009cda0 2024-04-25T23:57:00.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.171:6792/0 conn(0x7faf9013dfc0 legacy=0x7faf901d53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.171:6790/0 conn(0x7faf90134610 legacy=0x7faf901d1c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 monclient: found mon.b 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf9013a4c0 con 0x7faf9009cda0 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 5 monclient: authenticate success, global_id 4817 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient: _renew_subs 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf90138020 con 0x7faf9009cda0 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient: _renew_subs 2024-04-25T23:57:00.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faf90136bb0 con 0x7faf9009cda0 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf84001c60 con 0x7faf9009cda0 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf84001ab0 con 0x7faf9009cda0 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8effd640 4 set_mon_vals no callback set 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: dump: 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.817 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7faf840100f0 con 0x7faf9009cda0 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf700065d0 con 0x7faf70002870 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7faf84044630 con 0x7faf9009cda0 2024-04-25T23:57:00.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1145632361 0 0) 0x7faf700065d0 con 0x7faf70002870 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient(hunting): my global_id is 4824 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf9009b380 con 0x7faf70002870 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf955fb640 10 monclient: get_auth_request con 0x7faf74037a30 auth_method 0 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 764261955 0 0) 0x7faf9009b380 con 0x7faf70002870 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf700065d0 con 0x7faf70002870 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf7c001930 con 0x7faf70002870 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: dump: 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.819 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 580895127 0 0) 0x7faf700065d0 con 0x7faf70002870 2024-04-25T23:57:00.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf7000a160 con 0x7faf70002870 2024-04-25T23:57:00.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7faf7c003600 con 0x7faf70002870 2024-04-25T23:57:00.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:00.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.106:6789/0 conn(0x7faf70002870 legacy=0x7faf70004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.815+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.106:6789/0 conn(0x7faf70002870 legacy=0x7faf70004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:00.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.829+0000 7fd4e81a6640 10 start_mon_command cmd=[{"prefix": "osd crush rule dump"}] 2024-04-25T23:57:00.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.829+0000 7fd4e81a6640 10 monclient: _send_command 3 [{"prefix": "osd crush rule dump"}] 2024-04-25T23:57:00.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.829+0000 7fd4e81a6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.829+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rule dump"} v 0) -- 0x7fd4c80010a0 con 0x7fd4e00701e0 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.829+0000 7fd4d67fc640 1 -- 172.21.15.171:0/620949375 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rule dump"}]=0 v38) ==== 67+0+1058 (unknown 2656755985 0 3068570633) 0x7fd4d8019630 con 0x7fd4e00701e0 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.829+0000 7fd4d67fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule dump"}] 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.829+0000 7fd4d67fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stdout:[ 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_id": 0, 2024-04-25T23:57:00.823 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_name": "replicated_rule", 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "type": 1, 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "steps": [ 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "take", 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "item": -1, 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "item_name": "default" 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "choose_firstn", 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 0, 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "type": "osd" 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "emit" 2024-04-25T23:57:00.824 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_id": 1, 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "rule_name": "erasure-code", 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "type": 3, 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "steps": [ 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "set_chooseleaf_tries", 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 5 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "set_choose_tries", 2024-04-25T23:57:00.825 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 100 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "take", 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: "item": -1, 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: "item_name": "default" 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "choose_indep", 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: "num": 0, 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: "type": "osd" 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:57:00.826 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:57:00.827 INFO:tasks.workunit.client.0.smithi171.stdout: "op": "emit" 2024-04-25T23:57:00.827 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.827 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:57:00.827 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:57:00.827 INFO:tasks.workunit.client.0.smithi171.stdout:] 2024-04-25T23:57:00.827 INFO:tasks.workunit.client.0.smithi171.stdout: 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf70009e30 con 0x7faf700090f0 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388912746 0 0) 0x7faf70009e30 con 0x7faf700090f0 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient(hunting): my global_id is 4833 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf700065d0 con 0x7faf700090f0 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2640242886 0 0) 0x7faf700065d0 con 0x7faf700090f0 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf70009e30 con 0x7faf700090f0 2024-04-25T23:57:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf7c003ce0 con 0x7faf700090f0 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient: dump: 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1828660156 0 0) 0x7faf70009e30 con 0x7faf700090f0 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faf7000c3a0 con 0x7faf700090f0 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 1684751170) 0x7faf7c0050f0 con 0x7faf700090f0 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.106:6789/0 conn(0x7faf700090f0 legacy=0x7faf70009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf8d7fa640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.106:6789/0 conn(0x7faf700090f0 legacy=0x7faf70009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 >> v1:172.21.15.171:6812/722422047 conn(0x7fd4c4038030 legacy=0x7fd4c403a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 10 monclient: shutdown 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 >> v1:172.21.15.171:6789/0 conn(0x7fd4e00701e0 legacy=0x7fd4e01d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 shutdown_connections 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 >> 172.21.15.171:0/620949375 conn(0x7fd4e00a2620 msgr2=0x7fd4e00a4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 shutdown_connections 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.833+0000 7fd4e81a6640 1 -- 172.21.15.171:0/620949375 wait complete. 2024-04-25T23:57:00.832 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls 2024-04-25T23:57:00.832 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:00.832 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:00.832 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 139382, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-25T23:57:00.833 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:00.834 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:00.836 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:00.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:00.838 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.839 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:00.840 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:00.841 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.844 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:00.845 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.847 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:00.848 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.849 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:00.850 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:00.851 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:00.851 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:00.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.171:6812/722422047 conn(0x7faf74037a30 legacy=0x7faf74039ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 10 monclient: shutdown 2024-04-25T23:57:00.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 >> v1:172.21.15.106:6790/0 conn(0x7faf9009cda0 legacy=0x7faf901ccce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf955fb640 1 -- 172.21.15.106:0/3844218132 reap_dead start 2024-04-25T23:57:00.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf955fb640 1 -- 172.21.15.106:0/3844218132 reap_dead start 2024-04-25T23:57:00.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 shutdown_connections 2024-04-25T23:57:00.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 >> 172.21.15.106:0/3844218132 conn(0x7faf9006b3e0 msgr2=0x7faf901403b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 shutdown_connections 2024-04-25T23:57:00.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.823+0000 7faf9705e640 1 -- 172.21.15.106:0/3844218132 wait complete. 2024-04-25T23:57:00.853 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:00.853 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-25T23:57:00.853 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient: get_monmap_and_config 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient: monmap: 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:00.959463+0000 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:00.959463+0000 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.940 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.941 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 1 Processor -- start 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 1 -- start start 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient: init 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient: _add_conns ranks=[7,4,3,1,0,2,6,5,8] 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient(hunting): picked mon.noname-i con 0x7ff9940a0a00 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient(hunting): picked mon.noname-c con 0x7ff9940a0010 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient(hunting): picked mon.noname-g con 0x7ff9940a0de0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:00.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9940a34d0 con 0x7ff9940a0de0 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99409e210 con 0x7ff9940a0010 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99409e760 con 0x7ff9940a0a00 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 10 monclient(hunting): authenticate will time out at 1071.667140s 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff993fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7ff9940a0a00 0x7ff9940a26b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:37322/0 (socket says 172.21.15.171:37322) 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff993fff640 1 -- 172.21.15.171:0/649816371 learned_addr learned my addr 172.21.15.171:0/649816371 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156812540 0 0) 0x7ff99409e760 con 0x7ff9940a0a00 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): my global_id is 134143 2024-04-25T23:57:00.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff97c003530 con 0x7ff9940a0a00 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1768405655 0 0) 0x7ff9940a34d0 con 0x7ff9940a0de0 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient(hunting): my global_id is 4854 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff99409e760 con 0x7ff9940a0de0 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2751824831 0 0) 0x7ff97c003530 con 0x7ff9940a0a00 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 >> v1:172.21.15.106:6791/0 conn(0x7ff9940a0010 legacy=0x7ff9940a2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 >> v1:172.21.15.171:6790/0 conn(0x7ff9940a0de0 legacy=0x7ff9941408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 monclient: found mon.noname-i 2024-04-25T23:57:00.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99406c030 con 0x7ff9940a0a00 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff984001800 con 0x7ff9940a0a00 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff992ffd640 10 monclient: dump: 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.952 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 5 monclient: authenticate success, global_id 134143 2024-04-25T23:57:00.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.957+0000 7ff99a592640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff984001ad0 con 0x7ff9940a0a00 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff992ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff992ffd640 1 -- 172.21.15.171:0/649816371 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff984004bf0 con 0x7ff9940a0a00 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff992ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff992ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff992ffd640 10 monclient: dump: 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.954 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 4 set_mon_vals no callback set 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: shutdown 2024-04-25T23:57:00.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/649816371 >> v1:172.21.15.171:6792/0 conn(0x7ff9940a0a00 legacy=0x7ff9940a26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/649816371 shutdown_connections 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/649816371 >> 172.21.15.171:0/649816371 conn(0x7ff9940a7320 msgr2=0x7ff9940a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/649816371 shutdown_connections 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/649816371 wait complete. 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: monmap: 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.956 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 Processor -- start 2024-04-25T23:57:00.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- start start 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: init 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _add_conns ranks=[4,0,7,6,3,2,8,5,1] 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient(hunting): picked mon.noname-c con 0x7ff9940a0010 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient(hunting): picked mon.noname-a con 0x7ff9940a0a00 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient(hunting): picked mon.noname-i con 0x7ff9940a0de0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99413e3c0 con 0x7ff9940a0a00 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99409e430 con 0x7ff9940a0010 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9940a07d0 con 0x7ff9940a0de0 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient(hunting): authenticate will time out at 1071.669930s 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff998b2f640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7ff9940a0de0 0x7ff9941d4440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:37330/0 (socket says 172.21.15.171:37330) 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff998b2f640 1 -- 172.21.15.171:0/1859402169 learned_addr learned my addr 172.21.15.171:0/1859402169 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:00.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836195547 0 0) 0x7ff9940a07d0 con 0x7ff9940a0de0 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): my global_id is 134152 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff980003530 con 0x7ff9940a0de0 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2797237162 0 0) 0x7ff980003530 con 0x7ff9940a0de0 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9940a07d0 con 0x7ff9940a0de0 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff98c001d20 con 0x7ff9940a0de0 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.959 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.960 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1695253428 0 0) 0x7ff99409e430 con 0x7ff9940a0010 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient(hunting): my global_id is 134176 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff980003530 con 0x7ff9940a0010 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1459525013 0 0) 0x7ff9940a07d0 con 0x7ff9940a0de0 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 >> v1:172.21.15.106:6791/0 conn(0x7ff9940a0010 legacy=0x7ff9941cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 >> v1:172.21.15.106:6789/0 conn(0x7ff9940a0a00 legacy=0x7ff994141080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 monclient: found mon.i 2024-04-25T23:57:00.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff99413f870 con 0x7ff9940a0de0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 5 monclient: authenticate success, global_id 134152 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _renew_subs 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff99413e110 con 0x7ff9940a0de0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _renew_subs 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff994141960 con 0x7ff9940a0de0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff98c003cb0 con 0x7ff9940a0de0 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff98c004220 con 0x7ff9940a0de0 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff9927fc640 4 set_mon_vals no callback set 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 10 monclient: dump: 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.963 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff974005090 con 0x7ff9940a0de0 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff98c0043c0 con 0x7ff9940a0de0 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7ff98c0447e0 con 0x7ff9940a0de0 2024-04-25T23:57:00.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.961+0000 7ff993fff640 10 monclient: get_auth_request con 0x7ff980037820 auth_method 0 2024-04-25T23:57:00.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.969+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff98c015ab0 con 0x7ff9940a0de0 2024-04-25T23:57:00.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.969+0000 7ff990ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:00.969+0000 7ff990ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.979+0000 7f51ed913640 10 monclient: get_monmap_and_config 2024-04-25T23:57:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.979+0000 7f51ed913640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.979+0000 7f51ed913640 10 monclient: monmap: 2024-04-25T23:57:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:00.986114+0000 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:00.986114+0000 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.968 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 Processor -- start 2024-04-25T23:57:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- start start 2024-04-25T23:57:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: init 2024-04-25T23:57:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: _add_conns ranks=[7,2,6,0,8,4,3,1,5] 2024-04-25T23:57:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): picked mon.noname-i con 0x7f51e8135870 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): picked mon.noname-b con 0x7f51e81353b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): picked mon.noname-d con 0x7f51e813bdf0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e806f2d0 con 0x7f51e81353b0 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e8072330 con 0x7f51e813bdf0 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e8072610 con 0x7f51e8135870 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): authenticate will time out at 1076.512956s 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e67fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f51e81353b0 0x7f51e813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48846/0 (socket says 172.21.15.106:48846) 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e67fc640 1 -- 172.21.15.106:0/3933752960 learned_addr learned my addr 172.21.15.106:0/3933752960 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1414316981 0 0) 0x7f51e806f2d0 con 0x7f51e81353b0 2024-04-25T23:57:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): my global_id is 4826 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51d0003530 con 0x7f51e81353b0 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113092099 0 0) 0x7f51e8072330 con 0x7f51e813bdf0 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): my global_id is 4839 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e806f2d0 con 0x7f51e813bdf0 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539777050 0 0) 0x7f51e8072610 con 0x7f51e8135870 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient(hunting): my global_id is 134161 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e8072330 con 0x7f51e8135870 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 510101732 0 0) 0x7f51d0003530 con 0x7f51e81353b0 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 >> v1:172.21.15.171:6792/0 conn(0x7f51e8135870 legacy=0x7f51e8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 >> v1:172.21.15.106:6792/0 conn(0x7f51e813bdf0 legacy=0x7f51e813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 monclient: found mon.noname-b 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e80a3260 con 0x7f51e81353b0 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51dc0017c0 con 0x7f51e81353b0 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: dump: 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 5 monclient: authenticate success, global_id 4826 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51dc001a60 con 0x7f51e81353b0 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 1 -- 172.21.15.106:0/3933752960 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51dc004bf0 con 0x7f51e81353b0 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 4 set_mon_vals no callback set 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e5ffb640 10 monclient: dump: 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: shutdown 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- 172.21.15.106:0/3933752960 >> v1:172.21.15.106:6790/0 conn(0x7f51e81353b0 legacy=0x7f51e813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- 172.21.15.106:0/3933752960 shutdown_connections 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- 172.21.15.106:0/3933752960 >> 172.21.15.106:0/3933752960 conn(0x7f51e80a64e0 msgr2=0x7f51e80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- 172.21.15.106:0/3933752960 shutdown_connections 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- 172.21.15.106:0/3933752960 wait complete. 2024-04-25T23:57:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: build_initial_monmap 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: monmap: 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 Processor -- start 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- start start 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: init 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient: _add_conns ranks=[0,5,7,3,8,2,1,4,6] 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): picked mon.noname-a con 0x7f51e81353b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): picked mon.noname-h con 0x7f51e8135870 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): picked mon.noname-i con 0x7f51e813bdf0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e811c0d0 con 0x7f51e81353b0 2024-04-25T23:57:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e811e350 con 0x7f51e8135870 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51e81350e0 con 0x7f51e813bdf0 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51ed913640 10 monclient(hunting): authenticate will time out at 1076.515795s 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e6ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f51e81353b0 0x7f51e81349d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39772/0 (socket says 172.21.15.106:39772) 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.983+0000 7f51e6ffd640 1 -- 172.21.15.106:0/3241948020 learned_addr learned my addr 172.21.15.106:0/3241948020 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2321144485 0 0) 0x7f51e811c0d0 con 0x7f51e81353b0 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): my global_id is 4851 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51d4003560 con 0x7f51e81353b0 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514152381 0 0) 0x7f51e81350e0 con 0x7f51e813bdf0 2024-04-25T23:57:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): my global_id is 134170 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e811c0d0 con 0x7f51e813bdf0 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593317151 0 0) 0x7f51e811e350 con 0x7f51e8135870 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): my global_id is 4919 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e81350e0 con 0x7f51e8135870 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4014509678 0 0) 0x7f51d4003560 con 0x7f51e81353b0 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51e811e350 con 0x7f51e81353b0 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51d8001e60 con 0x7f51e81353b0 2024-04-25T23:57:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): dump: 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4173457833 0 0) 0x7f51e811c0d0 con 0x7f51e813bdf0 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51d4003560 con 0x7f51e813bdf0 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51e0001880 con 0x7f51e813bdf0 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): dump: 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 358752734 0 0) 0x7f51e81350e0 con 0x7f51e8135870 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51e811c0d0 con 0x7f51e8135870 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51dc004b30 con 0x7f51e8135870 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): dump: 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2035659426 0 0) 0x7f51e811e350 con 0x7f51e81353b0 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.171:6792/0 conn(0x7f51e813bdf0 legacy=0x7f51e81d44f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.171:6791/0 conn(0x7f51e8135870 legacy=0x7f51e81cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 monclient: found mon.a 2024-04-25T23:57:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e81cc860 con 0x7f51e81353b0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: _finish_auth 0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 5 monclient: authenticate success, global_id 4851 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 10 monclient: _renew_subs 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f51e81d5c10 con 0x7f51e81353b0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 10 monclient: _renew_subs 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f51e81d5fb0 con 0x7f51e81353b0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f51d8003c50 con 0x7f51e81353b0 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51d80041c0 con 0x7f51e81353b0 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51e57fa640 4 set_mon_vals no callback set 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: dump: 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f51c80065d0 con 0x7f51c8002870 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f51d8004360 con 0x7f51e81353b0 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7f51d8044710 con 0x7f51e81353b0 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92390697 0 0) 0x7f51c80065d0 con 0x7f51c8002870 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient(hunting): my global_id is 4835 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51e811e350 con 0x7f51c8002870 2024-04-25T23:57:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51e77fe640 10 monclient: get_auth_request con 0x7f51d40381b0 auth_method 0 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2411856301 0 0) 0x7f51e811e350 con 0x7f51c8002870 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51c80065d0 con 0x7f51c8002870 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51dc004f00 con 0x7f51c8002870 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: dump: 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 717407452 0 0) 0x7f51c80065d0 con 0x7f51c8002870 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f51c800a160 con 0x7f51c8002870 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f51dc00a480 con 0x7f51c8002870 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.106:6790/0 conn(0x7f51c8002870 legacy=0x7f51c8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.987+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.106:6790/0 conn(0x7f51c8002870 legacy=0x7f51c8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f51c8009e50 con 0x7f51c8009110 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674278893 0 0) 0x7f51c8009e50 con 0x7f51c8009110 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient(hunting): my global_id is 4844 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51c80065d0 con 0x7f51c8009110 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2168970039 0 0) 0x7f51c80065d0 con 0x7f51c8009110 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51c8009e50 con 0x7f51c8009110 2024-04-25T23:57:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51dc005430 con 0x7f51c8009110 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient: dump: 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.002 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2122950137 0 0) 0x7f51c8009e50 con 0x7f51c8009110 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f51c800c3e0 con 0x7f51c8009110 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 4118548636) 0x7f51dc0057d0 con 0x7f51c8009110 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.106:6790/0 conn(0x7f51c8009110 legacy=0x7f51c80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51cffff640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.106:6790/0 conn(0x7f51c8009110 legacy=0x7f51c80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 139558, 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:01.023 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.171:6812/722422047 conn(0x7f51d40381b0 legacy=0x7f51d403a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 10 monclient: shutdown 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 >> v1:172.21.15.106:6789/0 conn(0x7f51e81353b0 legacy=0x7f51e81349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51e77fe640 1 -- 172.21.15.106:0/3241948020 reap_dead start 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51e77fe640 1 -- 172.21.15.106:0/3241948020 reap_dead start 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 shutdown_connections 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 >> 172.21.15.106:0/3241948020 conn(0x7f51e80a64e0 msgr2=0x7f51e813a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 shutdown_connections 2024-04-25T23:57:01.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:00.995+0000 7f51ed913640 1 -- 172.21.15.106:0/3241948020 wait complete. 2024-04-25T23:57:01.026 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:01.026 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-25T23:57:01.026 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-25T23:57:01.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.129+0000 7ff99a592640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:01.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.129+0000 7ff99a592640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:01.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.129+0000 7ff99a592640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:01.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.129+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7ff974005380 con 0x7ff9940a0de0 2024-04-25T23:57:01.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.129+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v38) ==== 65+0+29 (unknown 535663125 0 852635902) 0x7ff98c0153b0 con 0x7ff9940a0de0 2024-04-25T23:57:01.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.129+0000 7ff990ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:01.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.129+0000 7ff990ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.147+0000 7fb881700640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.147+0000 7fb881700640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.147+0000 7fb881700640 10 monclient: monmap: 2024-04-25T23:57:01.134 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.134 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.134 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:01.153768+0000 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:01.153768+0000 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.135 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.136 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.136 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.136 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.136 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 Processor -- start 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- start start 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: init 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: _add_conns ranks=[1,2,6,5,7,3,8,4,0] 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): picked mon.noname-f con 0x7fb87c135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): picked mon.noname-b con 0x7fb87c1353b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): picked mon.noname-d con 0x7fb87c13bdf0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87c06f2d0 con 0x7fb87c135870 2024-04-25T23:57:01.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87c072330 con 0x7fb87c1353b0 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87c072610 con 0x7fb87c13bdf0 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): authenticate will time out at 1076.680921s 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb87a7fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb87c1353b0 0x7fb87c13a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48876/0 (socket says 172.21.15.106:48876) 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb87a7fc640 1 -- 172.21.15.106:0/3137326116 learned_addr learned my addr 172.21.15.106:0/3137326116 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3141045430 0 0) 0x7fb87c072610 con 0x7fb87c13bdf0 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): my global_id is 4848 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb864003530 con 0x7fb87c13bdf0 2024-04-25T23:57:01.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3470727125 0 0) 0x7fb87c072330 con 0x7fb87c1353b0 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient(hunting): my global_id is 4853 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c072610 con 0x7fb87c1353b0 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3223063462 0 0) 0x7fb864003530 con 0x7fb87c13bdf0 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 >> v1:172.21.15.106:6790/0 conn(0x7fb87c1353b0 legacy=0x7fb87c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 >> v1:172.21.15.171:6789/0 conn(0x7fb87c135870 legacy=0x7fb87c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 monclient: found mon.noname-d 2024-04-25T23:57:01.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87c0a3260 con 0x7fb87c13bdf0 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb874001ab0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 5 monclient: authenticate success, global_id 4848 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: dump: 2024-04-25T23:57:01.145 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.146 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb874001d00 con 0x7fb87c13bdf0 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 1 -- 172.21.15.106:0/3137326116 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb874003ce0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 4 set_mon_vals no callback set 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb879ffb640 10 monclient: dump: 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.148 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: shutdown 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- 172.21.15.106:0/3137326116 >> v1:172.21.15.106:6792/0 conn(0x7fb87c13bdf0 legacy=0x7fb87c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- 172.21.15.106:0/3137326116 shutdown_connections 2024-04-25T23:57:01.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- 172.21.15.106:0/3137326116 >> 172.21.15.106:0/3137326116 conn(0x7fb87c0a64e0 msgr2=0x7fb87c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- 172.21.15.106:0/3137326116 shutdown_connections 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- 172.21.15.106:0/3137326116 wait complete. 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: monmap: 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.150 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 Processor -- start 2024-04-25T23:57:01.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- start start 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: init 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient: _add_conns ranks=[3,7,2,4,5,6,0,1,8] 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): picked mon.noname-g con 0x7fb87c1353b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): picked mon.noname-i con 0x7fb87c135870 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): picked mon.noname-b con 0x7fb87c13bdf0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87c131480 con 0x7fb87c13bdf0 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87c09f930 con 0x7fb87c1353b0 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb87c070ec0 con 0x7fb87c135870 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.151+0000 7fb881700640 10 monclient(hunting): authenticate will time out at 1076.683923s 2024-04-25T23:57:01.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb87b7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb87c13bdf0 0x7fb87c1d4b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48880/0 (socket says 172.21.15.106:48880) 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb87b7fe640 1 -- 172.21.15.106:0/857734281 learned_addr learned my addr 172.21.15.106:0/857734281 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 181208791 0 0) 0x7fb87c131480 con 0x7fb87c13bdf0 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): my global_id is 4862 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb868003560 con 0x7fb87c13bdf0 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874072841 0 0) 0x7fb87c09f930 con 0x7fb87c1353b0 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): my global_id is 4863 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c131480 con 0x7fb87c1353b0 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2222362982 0 0) 0x7fb87c070ec0 con 0x7fb87c135870 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): my global_id is 134179 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c09f930 con 0x7fb87c135870 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1308066998 0 0) 0x7fb868003560 con 0x7fb87c13bdf0 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb87c070ec0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb874001670 con 0x7fb87c13bdf0 2024-04-25T23:57:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): dump: 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.155 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.156 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.156 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.156 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.156 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.156 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.156 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.155+0000 7fb8637fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3556941513 0 0) 0x7fb87c070ec0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.171:6792/0 conn(0x7fb87c135870 legacy=0x7fb87c1d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.171:6790/0 conn(0x7fb87c1353b0 legacy=0x7fb87c134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 monclient: found mon.b 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb87c070420 con 0x7fb87c13bdf0 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 5 monclient: authenticate success, global_id 4862 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 10 monclient: _renew_subs 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb87c1ccb30 con 0x7fb87c13bdf0 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 10 monclient: _renew_subs 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb87c1cc0d0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb874003f50 con 0x7fb87c13bdf0 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8740044c0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: dump: 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8797fa640 4 set_mon_vals no callback set 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb87c075890 con 0x7fb87c09ca60 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2794304861 0 0) 0x7fb87c075890 con 0x7fb87c09ca60 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient(hunting): my global_id is 134185 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c070ec0 con 0x7fb87c09ca60 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb8740046e0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fb8740446c0 con 0x7fb87c13bdf0 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1766970576 0 0) 0x7fb87c070ec0 con 0x7fb87c09ca60 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb87c075890 con 0x7fb87c09ca60 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb86c0018a0 con 0x7fb87c09ca60 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: dump: 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 556180967 0 0) 0x7fb87c075890 con 0x7fb87c09ca60 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb87c09f440 con 0x7fb87c09ca60 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb87a7fc640 10 monclient: get_auth_request con 0x7fb868037a60 auth_method 0 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb86c001c50 con 0x7fb87c09ca60 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.163+0000 7fb8637fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.167+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.106:6791/0 conn(0x7fb87c09ca60 legacy=0x7fb87c09ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.167+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.106:6791/0 conn(0x7fb87c09ca60 legacy=0x7fb87c09ce40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb87c062e50 con 0x7fb87c09d550 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324202233 0 0) 0x7fb87c062e50 con 0x7fb87c09d550 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient(hunting): my global_id is 134194 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c075890 con 0x7fb87c09d550 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1260914379 0 0) 0x7fb87c075890 con 0x7fb87c09d550 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb87c062e50 con 0x7fb87c09d550 2024-04-25T23:57:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb86c003b90 con 0x7fb87c09d550 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient: dump: 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 925441500 0 0) 0x7fb87c062e50 con 0x7fb87c09d550 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb87c06c310 con 0x7fb87c09d550 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 731507298) 0x7fb86c003ef0 con 0x7fb87c09d550 2024-04-25T23:57:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.106:6791/0 conn(0x7fb87c09d550 legacy=0x7fb87c1da260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb8637fe640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.106:6791/0 conn(0x7fb87c09d550 legacy=0x7fb87c1da260 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:01.170 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9151, 2024-04-25T23:57:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:01.171 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:01.173 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.174 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.175 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:01.176 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:01.177 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.178 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.179 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.180 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.182 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:01.195 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.171:6812/722422047 conn(0x7fb868037a60 legacy=0x7fb868039f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 10 monclient: shutdown 2024-04-25T23:57:01.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 >> v1:172.21.15.106:6790/0 conn(0x7fb87c13bdf0 legacy=0x7fb87c1d4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb87b7fe640 1 -- 172.21.15.106:0/857734281 reap_dead start 2024-04-25T23:57:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb87b7fe640 1 -- 172.21.15.106:0/857734281 reap_dead start 2024-04-25T23:57:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 shutdown_connections 2024-04-25T23:57:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 >> 172.21.15.106:0/857734281 conn(0x7fb87c0a64e0 msgr2=0x7fb87c0a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 shutdown_connections 2024-04-25T23:57:01.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.171+0000 7fb881700640 1 -- 172.21.15.106:0/857734281 wait complete. 2024-04-25T23:57:01.197 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:01.197 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-25T23:57:01.198 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:57:01.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7ff974000bd0 con 0x7ff9940a0de0 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff990ff9640 1 -- 172.21.15.171:0/1859402169 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v38) ==== 65+0+29 (unknown 535663125 0 852635902) 0x7ff98c019700 con 0x7ff9940a0de0 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff990ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff990ff9640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stdout:replicated_rule 2024-04-25T23:57:01.208 INFO:tasks.workunit.client.0.smithi171.stdout:erasure-code 2024-04-25T23:57:01.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 >> v1:172.21.15.171:6812/722422047 conn(0x7ff980037820 legacy=0x7ff980039ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 10 monclient: shutdown 2024-04-25T23:57:01.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 >> v1:172.21.15.171:6792/0 conn(0x7ff9940a0de0 legacy=0x7ff9941d4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 shutdown_connections 2024-04-25T23:57:01.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 >> 172.21.15.171:0/1859402169 conn(0x7ff9940a7320 msgr2=0x7ff9940a5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 shutdown_connections 2024-04-25T23:57:01.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.225+0000 7ff99a592640 1 -- 172.21.15.171:0/1859402169 wait complete. 2024-04-25T23:57:01.223 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule list 2024-04-25T23:57:01.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.327+0000 7f9979901640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.327+0000 7f9979901640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.327+0000 7f9979901640 10 monclient: monmap: 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:01.334078+0000 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:01.334078+0000 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.315 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.316 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.316 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.316 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.316 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.316 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.316 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 Processor -- start 2024-04-25T23:57:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- start start 2024-04-25T23:57:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: init 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: _add_conns ranks=[5,6,2,4,8,3,7,0,1] 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient(hunting): picked mon.noname-h con 0x7f9974070ae0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient(hunting): picked mon.noname-d con 0x7f9974071910 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient(hunting): picked mon.noname-b con 0x7f997413bed0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9974072480 con 0x7f997413bed0 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9974072760 con 0x7f9974070ae0 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99740a3790 con 0x7f9974071910 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient(hunting): authenticate will time out at 1076.861381s 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f99737fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f997413bed0 0x7f997413e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48892/0 (socket says 172.21.15.106:48892) 2024-04-25T23:57:01.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f99737fe640 1 -- 172.21.15.106:0/3764453876 learned_addr learned my addr 172.21.15.106:0/3764453876 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1782453524 0 0) 0x7f9974072480 con 0x7f997413bed0 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): my global_id is 4871 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f995c003530 con 0x7f997413bed0 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3852257529 0 0) 0x7f99740a3790 con 0x7f9974071910 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): my global_id is 4857 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9974072480 con 0x7f9974071910 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589261069 0 0) 0x7f9974072760 con 0x7f9974070ae0 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient(hunting): my global_id is 4928 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99740a3790 con 0x7f9974070ae0 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3796012909 0 0) 0x7f995c003530 con 0x7f997413bed0 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 >> v1:172.21.15.106:6792/0 conn(0x7f9974071910 legacy=0x7f997413a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 >> v1:172.21.15.171:6791/0 conn(0x7f9974070ae0 legacy=0x7f9974070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 monclient: found mon.noname-b 2024-04-25T23:57:01.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99740a40b0 con 0x7f997413bed0 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f996c001b40 con 0x7f997413bed0 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: dump: 2024-04-25T23:57:01.328 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.329 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 5 monclient: authenticate success, global_id 4871 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f996c001e60 con 0x7f997413bed0 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 1 -- 172.21.15.106:0/3764453876 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f996c004f70 con 0x7f997413bed0 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 4 set_mon_vals no callback set 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9971ffb640 10 monclient: dump: 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: shutdown 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- 172.21.15.106:0/3764453876 >> v1:172.21.15.106:6790/0 conn(0x7f997413bed0 legacy=0x7f997413e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- 172.21.15.106:0/3764453876 shutdown_connections 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- 172.21.15.106:0/3764453876 >> 172.21.15.106:0/3764453876 conn(0x7f99740a83a0 msgr2=0x7f99740a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- 172.21.15.106:0/3764453876 shutdown_connections 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- 172.21.15.106:0/3764453876 wait complete. 2024-04-25T23:57:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: monmap: 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 Processor -- start 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 1 -- start start 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.331+0000 7f9979901640 10 monclient: init 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient: _add_conns ranks=[5,3,0,6,8,2,1,7,4] 2024-04-25T23:57:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient(hunting): picked mon.noname-h con 0x7f9974070ae0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient(hunting): picked mon.noname-g con 0x7f9974071910 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient(hunting): picked mon.noname-a con 0x7f997413bed0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9974132800 con 0x7f997413bed0 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9974130920 con 0x7f9974071910 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f997413b320 con 0x7f9974070ae0 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient(hunting): authenticate will time out at 1076.864480s 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f99737fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f997413bed0 0x7f997413a620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39780/0 (socket says 172.21.15.106:39780) 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f99737fe640 1 -- 172.21.15.106:0/1184687526 learned_addr learned my addr 172.21.15.106:0/1184687526 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469917112 0 0) 0x7f9974132800 con 0x7f997413bed0 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): my global_id is 4860 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9960003530 con 0x7f997413bed0 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440471136 0 0) 0x7f9974130920 con 0x7f9974071910 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): my global_id is 4872 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9974132800 con 0x7f9974071910 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600850330 0 0) 0x7f997413b320 con 0x7f9974070ae0 2024-04-25T23:57:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): my global_id is 4937 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9974130920 con 0x7f9974070ae0 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3949670239 0 0) 0x7f9960003530 con 0x7f997413bed0 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f997413b320 con 0x7f997413bed0 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f996c004eb0 con 0x7f997413bed0 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): dump: 2024-04-25T23:57:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3584110135 0 0) 0x7f9974132800 con 0x7f9974071910 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9960003530 con 0x7f9974071910 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9968001a60 con 0x7f9974071910 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): dump: 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2285388139 0 0) 0x7f997413b320 con 0x7f997413bed0 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.171:6791/0 conn(0x7f9974070ae0 legacy=0x7f9974139800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.171:6790/0 conn(0x7f9974071910 legacy=0x7f9974139f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 monclient: found mon.a 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9974132520 con 0x7f997413bed0 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 5 monclient: authenticate success, global_id 4860 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient: _renew_subs 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f99741360a0 con 0x7f997413bed0 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient: _renew_subs 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f99741d3b00 con 0x7f997413bed0 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f996c001be0 con 0x7f997413bed0 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f996c005490 con 0x7f997413bed0 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f99717fa640 4 set_mon_vals no callback set 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: dump: 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f99540065d0 con 0x7f9954002870 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f996c010230 con 0x7f997413bed0 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7f996c044730 con 0x7f997413bed0 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1749098010 0 0) 0x7f99540065d0 con 0x7f9954002870 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient(hunting): my global_id is 4866 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f997413b320 con 0x7f9954002870 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1186042231 0 0) 0x7f997413b320 con 0x7f9954002870 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f99727fc640 10 monclient: get_auth_request con 0x7f9960037f10 auth_method 0 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f99540065d0 con 0x7f9954002870 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99640018f0 con 0x7f9954002870 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: dump: 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3401542436 0 0) 0x7f99540065d0 con 0x7f9954002870 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f995400a160 con 0x7f9954002870 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9964001cd0 con 0x7f9954002870 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.106:6792/0 conn(0x7f9954002870 legacy=0x7f9954004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.335+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.106:6792/0 conn(0x7f9954002870 legacy=0x7f9954004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9954009e30 con 0x7f99540090f0 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1806422764 0 0) 0x7f9954009e30 con 0x7f99540090f0 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient(hunting): my global_id is 4875 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99540065d0 con 0x7f99540090f0 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1649157714 0 0) 0x7f99540065d0 con 0x7f99540090f0 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9954009e30 con 0x7f99540090f0 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9964003bd0 con 0x7f99540090f0 2024-04-25T23:57:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient: dump: 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3167193949 0 0) 0x7f9954009e30 con 0x7f99540090f0 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f995400c3a0 con 0x7f99540090f0 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3419281902) 0x7f9964003f10 con 0x7f99540090f0 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.106:6792/0 conn(0x7f99540090f0 legacy=0x7f9954009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f995bfff640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.106:6792/0 conn(0x7f99540090f0 legacy=0x7f9954009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.353 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 139882, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:01.372 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:01.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.171:6812/722422047 conn(0x7f9960037f10 legacy=0x7f996003a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 10 monclient: shutdown 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 >> v1:172.21.15.106:6789/0 conn(0x7f997413bed0 legacy=0x7f997413a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f99737fe640 1 -- 172.21.15.106:0/1184687526 reap_dead start 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f99737fe640 1 -- 172.21.15.106:0/1184687526 reap_dead start 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 shutdown_connections 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 >> 172.21.15.106:0/1184687526 conn(0x7f99740a83a0 msgr2=0x7f997413e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 shutdown_connections 2024-04-25T23:57:01.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.343+0000 7f9979901640 1 -- 172.21.15.106:0/1184687526 wait complete. 2024-04-25T23:57:01.376 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:01.376 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-25T23:57:01.376 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-25T23:57:01.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.353+0000 7f98ac16d640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.353+0000 7f98ac16d640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.353+0000 7f98ac16d640 10 monclient: monmap: 2024-04-25T23:57:01.382 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:01.382 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:01.357073+0000 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:01.357073+0000 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.353+0000 7f98ac16d640 1 Processor -- start 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.353+0000 7f98ac16d640 1 -- start start 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.353+0000 7f98ac16d640 10 monclient: init 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: _add_conns ranks=[3,7,1,0,6,4,5,8,2] 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): picked mon.noname-g con 0x7f98a40a3930 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): picked mon.noname-i con 0x7f98a4138150 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): picked mon.noname-f con 0x7f98a4138570 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a40a2b70 con 0x7f98a4138570 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a40a2e50 con 0x7f98a40a3930 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a40a4460 con 0x7f98a4138150 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): authenticate will time out at 1072.064532s 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a9f09640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f98a40a3930 0x7f98a4137a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:36368/0 (socket says 172.21.15.171:36368) 2024-04-25T23:57:01.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a9f09640 1 -- 172.21.15.171:0/2443973861 learned_addr learned my addr 172.21.15.171:0/2443973861 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2347372211 0 0) 0x7f98a40a2e50 con 0x7f98a40a3930 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): my global_id is 4881 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9890003530 con 0x7f98a40a3930 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223879922 0 0) 0x7f98a40a4460 con 0x7f98a4138150 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): my global_id is 134188 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a40a2e50 con 0x7f98a4138150 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1346345098 0 0) 0x7f98a40a2b70 con 0x7f98a4138570 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient(hunting): my global_id is 134182 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a40a4460 con 0x7f98a4138570 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2352083902 0 0) 0x7f9890003530 con 0x7f98a40a3930 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 >> v1:172.21.15.171:6792/0 conn(0x7f98a4138150 legacy=0x7f98a413cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 >> v1:172.21.15.171:6789/0 conn(0x7f98a4138570 legacy=0x7f98a41406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 monclient: found mon.noname-g 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a40a1810 con 0x7f98a40a3930 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f98a00017c0 con 0x7f98a40a3930 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 5 monclient: authenticate success, global_id 4881 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: dump: 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.387 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98a0001ae0 con 0x7f98a40a3930 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 4 set_mon_vals no callback set 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 1 -- 172.21.15.171:0/2443973861 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f98a0004bf0 con 0x7f98a40a3930 2024-04-25T23:57:01.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a8f07640 10 monclient: dump: 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.389 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: shutdown 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- 172.21.15.171:0/2443973861 >> v1:172.21.15.171:6790/0 conn(0x7f98a40a3930 legacy=0x7f98a4137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- 172.21.15.171:0/2443973861 shutdown_connections 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- 172.21.15.171:0/2443973861 >> 172.21.15.171:0/2443973861 conn(0x7f98a40a6d70 msgr2=0x7f98a40a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- 172.21.15.171:0/2443973861 shutdown_connections 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- 172.21.15.171:0/2443973861 wait complete. 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: monmap: 2024-04-25T23:57:01.390 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.391 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 Processor -- start 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- start start 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: init 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient: _add_conns ranks=[8,1,2,7,0,6,4,5,3] 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): picked mon.noname-e con 0x7f98a40a3930 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): picked mon.noname-f con 0x7f98a4138150 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): picked mon.noname-b con 0x7f98a4138570 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a4138d40 con 0x7f98a4138150 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a40a1030 con 0x7f98a4138570 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98a4123ec0 con 0x7f98a40a3930 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98ac16d640 10 monclient(hunting): authenticate will time out at 1072.067364s 2024-04-25T23:57:01.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a9708640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f98a4138150 0x7f98a41d1920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:57568/0 (socket says 172.21.15.171:57568) 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f98a9708640 1 -- 172.21.15.171:0/2359375526 learned_addr learned my addr 172.21.15.171:0/2359375526 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482037618 0 0) 0x7f98a4138d40 con 0x7f98a4138150 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): my global_id is 134191 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9888003530 con 0x7f98a4138150 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968609835 0 0) 0x7f98a40a1030 con 0x7f98a4138570 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): my global_id is 4880 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a4138d40 con 0x7f98a4138570 2024-04-25T23:57:01.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1469222850 0 0) 0x7f98a4123ec0 con 0x7f98a40a3930 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 10 monclient(hunting): my global_id is 134126 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98a40a1030 con 0x7f98a40a3930 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.357+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3396082444 0 0) 0x7f9888003530 con 0x7f98a4138150 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98a4123ec0 con 0x7f98a4138150 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f98940019a0 con 0x7f98a4138150 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient(hunting): dump: 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.394 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3789258912 0 0) 0x7f98a4138d40 con 0x7f98a4138570 2024-04-25T23:57:01.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9888003530 con 0x7f98a4138570 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1777558954 0 0) 0x7f98a40a1030 con 0x7f98a40a3930 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98a4138d40 con 0x7f98a40a3930 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1997445445 0 0) 0x7f98a4123ec0 con 0x7f98a4138150 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 >> v1:172.21.15.106:6793/0 conn(0x7f98a40a3930 legacy=0x7f98a41367e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 >> v1:172.21.15.106:6790/0 conn(0x7f98a4138570 legacy=0x7f98a41d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 monclient: found mon.f 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a41241a0 con 0x7f98a4138150 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 5 monclient: authenticate success, global_id 134191 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 10 monclient: _renew_subs 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f98a4122760 con 0x7f98a4138150 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 10 monclient: _renew_subs 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f98a41370c0 con 0x7f98a4138150 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9894003950 con 0x7f98a4138150 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9894003e40 con 0x7f98a4138150 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989bfff640 4 set_mon_vals no callback set 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 10 monclient: dump: 2024-04-25T23:57:01.397 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.398 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9894003fe0 con 0x7f98a4138150 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f988c005090 con 0x7f98a4138150 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7f9894044440 con 0x7f98a4138150 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.361+0000 7f98a9f09640 10 monclient: get_auth_request con 0x7f9888037d00 auth_method 0 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.365+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9894015650 con 0x7f98a4138150 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.365+0000 7f989a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.365+0000 7f989a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:01.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.507+0000 7f2add82c640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.507+0000 7f2add82c640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.507+0000 7f2add82c640 10 monclient: monmap: 2024-04-25T23:57:01.493 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.493 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:01.512845+0000 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:01.512845+0000 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.494 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.507+0000 7f2add82c640 1 Processor -- start 2024-04-25T23:57:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.507+0000 7f2add82c640 1 -- start start 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.507+0000 7f2add82c640 10 monclient: init 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: _add_conns ranks=[5,2,3,7,4,8,1,6,0] 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): picked mon.noname-h con 0x7f2ad8135870 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): picked mon.noname-b con 0x7f2ad81353b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): picked mon.noname-g con 0x7f2ad813bdf0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad806f2d0 con 0x7f2ad81353b0 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad8072330 con 0x7f2ad813bdf0 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad8072610 con 0x7f2ad8135870 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): authenticate will time out at 1077.040761s 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad67fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f2ad81353b0 0x7f2ad813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48896/0 (socket says 172.21.15.106:48896) 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad67fc640 1 -- 172.21.15.106:0/2755716080 learned_addr learned my addr 172.21.15.106:0/2755716080 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281279786 0 0) 0x7f2ad806f2d0 con 0x7f2ad81353b0 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): my global_id is 4889 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac0003530 con 0x7f2ad81353b0 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204991937 0 0) 0x7f2ad8072330 con 0x7f2ad813bdf0 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient(hunting): my global_id is 4890 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad806f2d0 con 0x7f2ad813bdf0 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2820736642 0 0) 0x7f2ac0003530 con 0x7f2ad81353b0 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 >> v1:172.21.15.171:6791/0 conn(0x7f2ad8135870 legacy=0x7f2ad8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 >> v1:172.21.15.171:6790/0 conn(0x7f2ad813bdf0 legacy=0x7f2ad813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 monclient: found mon.noname-b 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad80a3260 con 0x7f2ad81353b0 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2acc0017c0 con 0x7f2ad81353b0 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: dump: 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.506 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 5 monclient: authenticate success, global_id 4889 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2acc001ae0 con 0x7f2ad81353b0 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 4 set_mon_vals no callback set 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 1 -- 172.21.15.106:0/2755716080 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2acc004bf0 con 0x7f2ad81353b0 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2ad5ffb640 10 monclient: dump: 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: shutdown 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- 172.21.15.106:0/2755716080 >> v1:172.21.15.106:6790/0 conn(0x7f2ad81353b0 legacy=0x7f2ad813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- 172.21.15.106:0/2755716080 shutdown_connections 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- 172.21.15.106:0/2755716080 >> 172.21.15.106:0/2755716080 conn(0x7f2ad80a64e0 msgr2=0x7f2ad80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- 172.21.15.106:0/2755716080 shutdown_connections 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- 172.21.15.106:0/2755716080 wait complete. 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: monmap: 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 Processor -- start 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- start start 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: init 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient: _add_conns ranks=[3,7,1,8,2,4,5,0,6] 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): picked mon.noname-g con 0x7f2ad81353b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): picked mon.noname-i con 0x7f2ad8135870 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): picked mon.noname-f con 0x7f2ad813bdf0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad8134b00 con 0x7f2ad813bdf0 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad809e370 con 0x7f2ad81353b0 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2ad809f930 con 0x7f2ad8135870 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.511+0000 7f2add82c640 10 monclient(hunting): authenticate will time out at 1077.043833s 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2ad6ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2ad81353b0 0x7f2ad8133ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:37460/0 (socket says 172.21.15.106:37460) 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2ad6ffd640 1 -- 172.21.15.106:0/2565760678 learned_addr learned my addr 172.21.15.106:0/2565760678 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3405511685 0 0) 0x7f2ad809e370 con 0x7f2ad81353b0 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): my global_id is 4899 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ac4003530 con 0x7f2ad81353b0 2024-04-25T23:57:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3865617697 0 0) 0x7f2ad809f930 con 0x7f2ad8135870 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): my global_id is 134197 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad809e370 con 0x7f2ad8135870 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 154840128 0 0) 0x7f2ad8134b00 con 0x7f2ad813bdf0 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): my global_id is 134200 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad809f930 con 0x7f2ad813bdf0 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2054174198 0 0) 0x7f2ad809e370 con 0x7f2ad8135870 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ad8134b00 con 0x7f2ad8135870 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2acc004b30 con 0x7f2ad8135870 2024-04-25T23:57:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): dump: 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2081346390 0 0) 0x7f2ad809f930 con 0x7f2ad813bdf0 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ad809e370 con 0x7f2ad813bdf0 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2ad0001d00 con 0x7f2ad813bdf0 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): dump: 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 732156344 0 0) 0x7f2ac4003530 con 0x7f2ad81353b0 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ad809f930 con 0x7f2ad81353b0 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2ac8001ac0 con 0x7f2ad81353b0 2024-04-25T23:57:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): dump: 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4011103842 0 0) 0x7f2ad8134b00 con 0x7f2ad8135870 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.171:6790/0 conn(0x7f2ad81353b0 legacy=0x7f2ad8133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.171:6789/0 conn(0x7f2ad813bdf0 legacy=0x7f2ad81d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 monclient: found mon.i 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ad809f470 con 0x7f2ad8135870 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 5 monclient: authenticate success, global_id 134197 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 10 monclient: _renew_subs 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2ad8070840 con 0x7f2ad8135870 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 10 monclient: _renew_subs 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f2ad806fee0 con 0x7f2ad8135870 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2acc0010b0 con 0x7f2ad8135870 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2acc0051b0 con 0x7f2ad8135870 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2ad57fa640 4 set_mon_vals no callback set 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: dump: 2024-04-25T23:57:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.519 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ab80065d0 con 0x7f2ab8002870 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915822605 0 0) 0x7f2ab80065d0 con 0x7f2ab8002870 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient(hunting): my global_id is 134135 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ad8134b00 con 0x7f2ab8002870 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2826185427 0 0) 0x7f2ad8134b00 con 0x7f2ab8002870 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ab80065d0 con 0x7f2ab8002870 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2ac8003b90 con 0x7f2ab8002870 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: dump: 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3669001366 0 0) 0x7f2ab80065d0 con 0x7f2ab8002870 2024-04-25T23:57:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2ab800a160 con 0x7f2ab8002870 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2acc00ff50 con 0x7f2ad8135870 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7f2acc0444c0 con 0x7f2ad8135870 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2ac8003fa0 con 0x7f2ab8002870 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.106:6793/0 conn(0x7f2ab8002870 legacy=0x7f2ab8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.106:6793/0 conn(0x7f2ab8002870 legacy=0x7f2ab8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.515+0000 7f2ad77fe640 10 monclient: get_auth_request con 0x7f2ac4038210 auth_method 0 2024-04-25T23:57:01.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.517+0000 7f98ac16d640 10 start_mon_command cmd=[{"prefix": "osd crush rule list"}] 2024-04-25T23:57:01.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.517+0000 7f98ac16d640 10 monclient: _send_command 2 [{"prefix": "osd crush rule list"}] 2024-04-25T23:57:01.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.517+0000 7f98ac16d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.517+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rule list"} v 0) -- 0x7f988c005380 con 0x7f98a4138150 2024-04-25T23:57:01.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.521+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rule list"}]=0 v38) ==== 67+0+29 (unknown 300370255 0 852635902) 0x7f9894019300 con 0x7f98a4138150 2024-04-25T23:57:01.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.521+0000 7f989a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule list"}] 2024-04-25T23:57:01.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.521+0000 7f989a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2ab8009e60 con 0x7f2ab8009120 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739624785 0 0) 0x7f2ab8009e60 con 0x7f2ab8009120 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient(hunting): my global_id is 134144 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ab80065d0 con 0x7f2ab8009120 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3922539837 0 0) 0x7f2ab80065d0 con 0x7f2ab8009120 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2ab8009e60 con 0x7f2ab8009120 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2ac8004440 con 0x7f2ab8009120 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient: dump: 2024-04-25T23:57:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.526 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1345156946 0 0) 0x7f2ab8009e60 con 0x7f2ab8009120 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2ab800c3e0 con 0x7f2ab8009120 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 1852086786) 0x7f2ac8005c50 con 0x7f2ab8009120 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.106:6793/0 conn(0x7f2ab8009120 legacy=0x7f2ab80095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2abffff640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.106:6793/0 conn(0x7f2ab8009120 legacy=0x7f2ab80095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9503, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:01.545 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.171:6812/722422047 conn(0x7f2ac4038210 legacy=0x7f2ac403a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 10 monclient: shutdown 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 >> v1:172.21.15.171:6792/0 conn(0x7f2ad8135870 legacy=0x7f2ad81343f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2ad77fe640 1 -- 172.21.15.106:0/2565760678 reap_dead start 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2ad77fe640 1 -- 172.21.15.106:0/2565760678 reap_dead start 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 shutdown_connections 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 >> 172.21.15.106:0/2565760678 conn(0x7f2ad80a64e0 msgr2=0x7f2ad813c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 shutdown_connections 2024-04-25T23:57:01.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.523+0000 7f2add82c640 1 -- 172.21.15.106:0/2565760678 wait complete. 2024-04-25T23:57:01.547 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:01.548 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-25T23:57:01.548 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-25T23:57:01.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.609+0000 7f98ac16d640 10 start_mon_command cmd=[{"prefix": "osd crush rule list"}] 2024-04-25T23:57:01.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.609+0000 7f98ac16d640 10 monclient: _send_command 3 [{"prefix": "osd crush rule list"}] 2024-04-25T23:57:01.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.609+0000 7f98ac16d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.609+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rule list"} v 0) -- 0x7f988c000bd0 con 0x7f98a4138150 2024-04-25T23:57:01.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.609+0000 7f989a7fc640 1 -- 172.21.15.171:0/2359375526 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rule list"}]=0 v38) ==== 67+0+29 (unknown 300370255 0 852635902) 0x7f989401dbc0 con 0x7f98a4138150 2024-04-25T23:57:01.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.609+0000 7f989a7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule list"}] 2024-04-25T23:57:01.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.609+0000 7f989a7fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:01.595 INFO:tasks.workunit.client.0.smithi171.stdout:replicated_rule 2024-04-25T23:57:01.595 INFO:tasks.workunit.client.0.smithi171.stdout:erasure-code 2024-04-25T23:57:01.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 >> v1:172.21.15.171:6812/722422047 conn(0x7f9888037d00 legacy=0x7f988803a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 10 monclient: shutdown 2024-04-25T23:57:01.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 >> v1:172.21.15.171:6789/0 conn(0x7f98a4138150 legacy=0x7f98a41d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 shutdown_connections 2024-04-25T23:57:01.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 >> 172.21.15.171:0/2359375526 conn(0x7f98a40a6d70 msgr2=0x7f98a40a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 shutdown_connections 2024-04-25T23:57:01.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.613+0000 7f98ac16d640 1 -- 172.21.15.171:0/2359375526 wait complete. 2024-04-25T23:57:01.610 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule create-simple foo default host 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient: monmap: 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:01.676564+0000 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:01.676564+0000 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.657 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.658 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.658 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.658 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.658 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.658 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.658 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.658 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 1 Processor -- start 2024-04-25T23:57:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 1 -- start start 2024-04-25T23:57:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient: init 2024-04-25T23:57:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient: _add_conns ranks=[3,0,8,7,2,5,6,4,1] 2024-04-25T23:57:01.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient(hunting): picked mon.noname-g con 0x7f0afc134970 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient(hunting): picked mon.noname-a con 0x7f0afc0a4820 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient(hunting): picked mon.noname-e con 0x7f0afc13e200 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc06dd40 con 0x7f0afc0a4820 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc0a2b10 con 0x7f0afc134970 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc0a2df0 con 0x7f0afc13e200 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b036e2640 10 monclient(hunting): authenticate will time out at 1077.203659s 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b01c7f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0afc13e200 0x7f0afc1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:43794/0 (socket says 172.21.15.106:43794) 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b00c7d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0afc0a4820 0x7f0afc13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39784/0 (socket says 172.21.15.106:39784) 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.671+0000 7f0b01c7f640 1 -- 172.21.15.106:0/1102903507 learned_addr learned my addr 172.21.15.106:0/1102903507 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874673326 0 0) 0x7f0afc0a2df0 con 0x7f0afc13e200 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): my global_id is 134153 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae8003530 con 0x7f0afc13e200 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1831753921 0 0) 0x7f0afc06dd40 con 0x7f0afc0a4820 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): my global_id is 4869 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0afc0a2df0 con 0x7f0afc0a4820 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 814860263 0 0) 0x7f0afc0a2b10 con 0x7f0afc134970 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient(hunting): my global_id is 4908 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0afc06dd40 con 0x7f0afc134970 2024-04-25T23:57:01.667 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2967324850 0 0) 0x7f0ae8003530 con 0x7f0afc13e200 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 >> v1:172.21.15.171:6790/0 conn(0x7f0afc134970 legacy=0x7f0afc134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 >> v1:172.21.15.106:6789/0 conn(0x7f0afc0a4820 legacy=0x7f0afc13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 monclient: found mon.noname-e 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc0a30d0 con 0x7f0afc13e200 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0af4001b40 con 0x7f0afc13e200 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 5 monclient: authenticate success, global_id 134153 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: dump: 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.669 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0af4001df0 con 0x7f0afc13e200 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 1 -- 172.21.15.106:0/1102903507 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0af4004f70 con 0x7f0afc13e200 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 4 set_mon_vals no callback set 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af3fff640 10 monclient: dump: 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.670 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: shutdown 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- 172.21.15.106:0/1102903507 >> v1:172.21.15.106:6793/0 conn(0x7f0afc13e200 legacy=0x7f0afc1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- 172.21.15.106:0/1102903507 shutdown_connections 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- 172.21.15.106:0/1102903507 >> 172.21.15.106:0/1102903507 conn(0x7f0afc0a9e20 msgr2=0x7f0afc0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- 172.21.15.106:0/1102903507 shutdown_connections 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- 172.21.15.106:0/1102903507 wait complete. 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: monmap: 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 Processor -- start 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- start start 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: init 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: _add_conns ranks=[5,2,7,1,8,6,0,3,4] 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient(hunting): picked mon.noname-h con 0x7f0afc0a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient(hunting): picked mon.noname-b con 0x7f0afc134970 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient(hunting): picked mon.noname-i con 0x7f0afc13e200 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc0a1a40 con 0x7f0afc134970 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc0a1e00 con 0x7f0afc0a4820 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0afc134030 con 0x7f0afc13e200 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient(hunting): authenticate will time out at 1077.206876s 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b00c7d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f0afc134970 0x7f0afc1d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48910/0 (socket says 172.21.15.106:48910) 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b00c7d640 1 -- 172.21.15.106:0/3199645666 learned_addr learned my addr 172.21.15.106:0/3199645666 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1648972531 0 0) 0x7f0aec001960 con 0x7f0afc134970 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): my global_id is 4898 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae0003530 con 0x7f0afc134970 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080199754 0 0) 0x7f0afc134030 con 0x7f0afc13e200 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): my global_id is 134206 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0aec001960 con 0x7f0afc13e200 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3588137032 0 0) 0x7f0ae0003530 con 0x7f0afc134970 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0afc134030 con 0x7f0afc134970 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0aec001c50 con 0x7f0afc134970 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.676 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1157602829 0 0) 0x7f0afc0a1e00 con 0x7f0afc0a4820 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): my global_id is 4955 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae0003530 con 0x7f0afc0a4820 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2475694606 0 0) 0x7f0aec001960 con 0x7f0afc13e200 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0afc0a1e00 con 0x7f0afc13e200 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0af4004eb0 con 0x7f0afc13e200 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.678 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 494633244 0 0) 0x7f0afc134030 con 0x7f0afc134970 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.171:6792/0 conn(0x7f0afc13e200 legacy=0x7f0afc1d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.171:6791/0 conn(0x7f0afc0a4820 legacy=0x7f0afc13cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 monclient: found mon.b 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0afc13b310 con 0x7f0afc134970 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 5 monclient: authenticate success, global_id 4898 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: _renew_subs 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0afc13b5f0 con 0x7f0afc134970 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: _renew_subs 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0afc1ccad0 con 0x7f0afc134970 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0aec004aa0 con 0x7f0afc134970 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0aec005010 con 0x7f0afc134970 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af37fe640 4 set_mon_vals no callback set 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.675+0000 7f0af1ffb640 10 monclient: dump: 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0b036e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0adc0065d0 con 0x7f0adc002870 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0aec005270 con 0x7f0afc134970 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7f0aec044760 con 0x7f0afc134970 2024-04-25T23:57:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0b01c7f640 10 monclient: get_auth_request con 0x7f0ae0037f70 auth_method 0 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3156102474 0 0) 0x7f0adc0065d0 con 0x7f0adc002870 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient(hunting): my global_id is 134209 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0afc134030 con 0x7f0adc002870 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1858064911 0 0) 0x7f0afc134030 con 0x7f0adc002870 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0adc0065d0 con 0x7f0adc002870 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0af80019b0 con 0x7f0adc002870 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient: dump: 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4244826137 0 0) 0x7f0adc0065d0 con 0x7f0adc002870 2024-04-25T23:57:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0adc00a160 con 0x7f0adc002870 2024-04-25T23:57:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0af8003600 con 0x7f0adc002870 2024-04-25T23:57:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.171:6789/0 conn(0x7f0adc002870 legacy=0x7f0adc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.679+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.171:6789/0 conn(0x7f0adc002870 legacy=0x7f0adc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0adc009e50 con 0x7f0adc009110 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623211144 0 0) 0x7f0adc009e50 con 0x7f0adc009110 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient(hunting): my global_id is 134218 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0adc0065d0 con 0x7f0adc009110 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 318034489 0 0) 0x7f0adc0065d0 con 0x7f0adc009110 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0adc009e50 con 0x7f0adc009110 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0af8003ce0 con 0x7f0adc009110 2024-04-25T23:57:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient: dump: 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3585231359 0 0) 0x7f0adc009e50 con 0x7f0adc009110 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0adc00c3e0 con 0x7f0adc009110 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2851653015) 0x7f0af8005210 con 0x7f0adc009110 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.171:6789/0 conn(0x7f0adc009110 legacy=0x7f0adc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0af1ffb640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.171:6789/0 conn(0x7f0adc009110 legacy=0x7f0adc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.687 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9679, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:01.688 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.689 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.690 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:01.691 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.692 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:01.693 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.695 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.696 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.697 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.698 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:01.705 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.171:6812/722422047 conn(0x7f0ae0037f70 legacy=0x7f0ae003a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 10 monclient: shutdown 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 >> v1:172.21.15.106:6790/0 conn(0x7f0afc134970 legacy=0x7f0afc1d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b01c7f640 1 -- 172.21.15.106:0/3199645666 reap_dead start 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b01c7f640 1 -- 172.21.15.106:0/3199645666 reap_dead start 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 shutdown_connections 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 >> 172.21.15.106:0/3199645666 conn(0x7f0afc0a9e20 msgr2=0x7f0afc134f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 shutdown_connections 2024-04-25T23:57:01.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.687+0000 7f0b036e2640 1 -- 172.21.15.106:0/3199645666 wait complete. 2024-04-25T23:57:01.707 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:01.707 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-25T23:57:01.708 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:57:01.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient: monmap: 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:01.748097+0000 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:01.748097+0000 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.729 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.730 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.730 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.730 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 1 Processor -- start 2024-04-25T23:57:01.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 1 -- start start 2024-04-25T23:57:01.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient: init 2024-04-25T23:57:01.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient: _add_conns ranks=[2,6,3,8,5,0,7,4,1] 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient(hunting): picked mon.noname-b con 0x7fd62c135a00 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient(hunting): picked mon.noname-d con 0x7fd62c0a1790 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient(hunting): picked mon.noname-g con 0x7fd62c13c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c0a1d80 con 0x7fd62c135a00 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c072f70 con 0x7fd62c13c130 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c072640 con 0x7fd62c0a1790 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient(hunting): authenticate will time out at 1072.454906s 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62ad9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd62c13c130 0x7fd62c13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:36380/0 (socket says 172.21.15.171:36380) 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62ad9d640 1 -- 172.21.15.171:0/955639765 learned_addr learned my addr 172.21.15.171:0/955639765 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890010803 0 0) 0x7fd62c072f70 con 0x7fd62c13c130 2024-04-25T23:57:01.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): my global_id is 4917 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd614003530 con 0x7fd62c13c130 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1672345797 0 0) 0x7fd62c0a1d80 con 0x7fd62c135a00 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): my global_id is 4907 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd62c072f70 con 0x7fd62c135a00 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172443690 0 0) 0x7fd62c072640 con 0x7fd62c0a1790 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient(hunting): my global_id is 4884 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd62c0a1d80 con 0x7fd62c0a1790 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 737507500 0 0) 0x7fd614003530 con 0x7fd62c13c130 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 >> v1:172.21.15.106:6792/0 conn(0x7fd62c0a1790 legacy=0x7fd62c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 >> v1:172.21.15.106:6790/0 conn(0x7fd62c135a00 legacy=0x7fd62c135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 monclient: found mon.noname-g 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c072920 con 0x7fd62c13c130 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd624001b40 con 0x7fd62c13c130 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 5 monclient: authenticate success, global_id 4917 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: dump: 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.741 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd624001df0 con 0x7fd62c13c130 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 1 -- 172.21.15.171:0/955639765 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd624004f70 con 0x7fd62c13c130 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd62959a640 10 monclient: dump: 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.742 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.745+0000 7fd630caf640 4 set_mon_vals no callback set 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: shutdown 2024-04-25T23:57:01.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/955639765 >> v1:172.21.15.171:6790/0 conn(0x7fd62c13c130 legacy=0x7fd62c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/955639765 shutdown_connections 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/955639765 >> 172.21.15.171:0/955639765 conn(0x7fd62c0a2690 msgr2=0x7fd62c0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/955639765 shutdown_connections 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/955639765 wait complete. 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: monmap: 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.744 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 Processor -- start 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- start start 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: init 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _add_conns ranks=[1,2,0,3,8,7,4,5,6] 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient(hunting): picked mon.noname-f con 0x7fd62c0a1790 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient(hunting): picked mon.noname-b con 0x7fd62c135a00 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:01.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient(hunting): picked mon.noname-a con 0x7fd62c13c130 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c0703b0 con 0x7fd62c13c130 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c09fc40 con 0x7fd62c0a1790 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd62c09f6f0 con 0x7fd62c135a00 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient(hunting): authenticate will time out at 1072.458045s 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd629d9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd62c135a00 0x7fd62c06fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:42128/0 (socket says 172.21.15.171:42128) 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd629d9b640 1 -- 172.21.15.171:0/2627558547 learned_addr learned my addr 172.21.15.171:0/2627558547 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:01.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672338769 0 0) 0x7fd62c09f6f0 con 0x7fd62c135a00 2024-04-25T23:57:01.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): my global_id is 4916 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd60c003530 con 0x7fd62c135a00 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1172566580 0 0) 0x7fd62c0703b0 con 0x7fd62c13c130 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): my global_id is 4878 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd62c09f6f0 con 0x7fd62c13c130 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174710905 0 0) 0x7fd62c09fc40 con 0x7fd62c0a1790 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): my global_id is 134227 2024-04-25T23:57:01.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd62c0703b0 con 0x7fd62c0a1790 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 490026930 0 0) 0x7fd60c003530 con 0x7fd62c135a00 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd62c09fc40 con 0x7fd62c135a00 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2881254849 0 0) 0x7fd62c0703b0 con 0x7fd62c0a1790 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd60c003530 con 0x7fd62c0a1790 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd620001ae0 con 0x7fd62c135a00 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): dump: 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.749 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.750 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.750 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.750 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.750 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.750 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.750 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.750 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 214888269 0 0) 0x7fd62c09f6f0 con 0x7fd62c13c130 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd62c0703b0 con 0x7fd62c13c130 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd61c0019e0 con 0x7fd62c0a1790 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): dump: 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.752 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd624001ba0 con 0x7fd62c13c130 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient(hunting): dump: 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.753 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1389782883 0 0) 0x7fd60c003530 con 0x7fd62c0a1790 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 >> v1:172.21.15.106:6790/0 conn(0x7fd62c135a00 legacy=0x7fd62c06fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 >> v1:172.21.15.106:6789/0 conn(0x7fd62c13c130 legacy=0x7fd62c1d4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 monclient: found mon.f 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd62c131870 con 0x7fd62c0a1790 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 5 monclient: authenticate success, global_id 134227 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _renew_subs 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd62c070630 con 0x7fd62c0a1790 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _renew_subs 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd62c071450 con 0x7fd62c0a1790 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd61c001ca0 con 0x7fd62c0a1790 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61bfff640 4 set_mon_vals no callback set 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd61c003bf0 con 0x7fd62c0a1790 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 10 monclient: dump: 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.756 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd61c00e990 con 0x7fd62c0a1790 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.749+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd610005090 con 0x7fd62c0a1790 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.753+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fd61c0430d0 con 0x7fd62c0a1790 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.753+0000 7fd629d9b640 10 monclient: get_auth_request con 0x7fd60c038100 auth_method 0 2024-04-25T23:57:01.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.757+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd61c014470 con 0x7fd62c0a1790 2024-04-25T23:57:01.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.757+0000 7fd61affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.757+0000 7fd61affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.835+0000 7fafd6ba4640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.835+0000 7fafd6ba4640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.835+0000 7fafd6ba4640 10 monclient: monmap: 2024-04-25T23:57:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:01.841976+0000 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:01.841976+0000 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.824 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 Processor -- start 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- start start 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: init 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: _add_conns ranks=[8,1,0,2,7,3,6,5,4] 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient(hunting): picked mon.noname-e con 0x7fafd0134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient(hunting): picked mon.noname-f con 0x7fafd00a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient(hunting): picked mon.noname-a con 0x7fafd013e200 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd006dd40 con 0x7fafd013e200 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd00a2b10 con 0x7fafd00a4820 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd00a2df0 con 0x7fafd0134970 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient(hunting): authenticate will time out at 1077.369403s 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd4940640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fafd0134970 0x7fafd0134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:43798/0 (socket says 172.21.15.106:43798) 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd5141640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fafd013e200 0x7fafd01405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39790/0 (socket says 172.21.15.106:39790) 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd4940640 1 -- 172.21.15.106:0/2395331177 learned_addr learned my addr 172.21.15.106:0/2395331177 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448741063 0 0) 0x7fafd00a2df0 con 0x7fafd0134970 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): my global_id is 134162 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafb8003530 con 0x7fafd0134970 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1689231224 0 0) 0x7fafd006dd40 con 0x7fafd013e200 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient(hunting): my global_id is 4887 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd00a2df0 con 0x7fafd013e200 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4236206886 0 0) 0x7fafb8003530 con 0x7fafd0134970 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 >> v1:172.21.15.171:6789/0 conn(0x7fafd00a4820 legacy=0x7fafd013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 >> v1:172.21.15.106:6789/0 conn(0x7fafd013e200 legacy=0x7fafd01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 monclient: found mon.noname-e 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:57:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd00a30d0 con 0x7fafd0134970 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafcc0017c0 con 0x7fafd0134970 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 5 monclient: authenticate success, global_id 134162 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: dump: 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafcc0019f0 con 0x7fafd0134970 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 4 set_mon_vals no callback set 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 1 -- 172.21.15.106:0/2395331177 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafcc004bf0 con 0x7fafd0134970 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafc77fe640 10 monclient: dump: 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: shutdown 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- 172.21.15.106:0/2395331177 >> v1:172.21.15.106:6793/0 conn(0x7fafd0134970 legacy=0x7fafd0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- 172.21.15.106:0/2395331177 shutdown_connections 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- 172.21.15.106:0/2395331177 >> 172.21.15.106:0/2395331177 conn(0x7fafd00a9e20 msgr2=0x7fafd00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- 172.21.15.106:0/2395331177 shutdown_connections 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- 172.21.15.106:0/2395331177 wait complete. 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: monmap: 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 Processor -- start 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 1 -- start start 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.839+0000 7fafd6ba4640 10 monclient: init 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient: _add_conns ranks=[1,5,4,6,3,8,0,7,2] 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient(hunting): picked mon.noname-f con 0x7fafd00a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient(hunting): picked mon.noname-h con 0x7fafd0134970 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient(hunting): picked mon.noname-c con 0x7fafd013e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd013b430 con 0x7fafd00a4820 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd01396d0 con 0x7fafd013e200 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafd013bcb0 con 0x7fafd0134970 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient(hunting): authenticate will time out at 1077.372416s 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd5141640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fafd013e200 0x7fafd01d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50726/0 (socket says 172.21.15.106:50726) 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd5141640 1 -- 172.21.15.106:0/536189137 learned_addr learned my addr 172.21.15.106:0/536189137 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399887605 0 0) 0x7fafd01396d0 con 0x7fafd013e200 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): my global_id is 134203 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc003530 con 0x7fafd013e200 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 264120857 0 0) 0x7fafbc003530 con 0x7fafd013e200 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafd01396d0 con 0x7fafd013e200 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1014218910 0 0) 0x7fafd013b430 con 0x7fafd00a4820 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): my global_id is 134245 2024-04-25T23:57:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafbc003530 con 0x7fafd00a4820 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafc8001d00 con 0x7fafd013e200 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): dump: 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3884673121 0 0) 0x7fafd01396d0 con 0x7fafd013e200 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.171:6791/0 conn(0x7fafd0134970 legacy=0x7fafd0138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.171:6789/0 conn(0x7fafd00a4820 legacy=0x7fafd01388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 monclient: found mon.c 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafd00a1e00 con 0x7fafd013e200 2024-04-25T23:57:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 5 monclient: authenticate success, global_id 134203 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient: _renew_subs 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fafd013d6f0 con 0x7fafd013e200 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient: _renew_subs 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fafd013a110 con 0x7fafd013e200 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafc8004e20 con 0x7fafd013e200 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafc8001f70 con 0x7fafd013e200 2024-04-25T23:57:01.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc6ffd640 4 set_mon_vals no callback set 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: dump: 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.843 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fafb00065d0 con 0x7fafb0002870 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fafc800ff10 con 0x7fafd013e200 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fafc80447d0 con 0x7fafd013e200 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc7fff640 10 monclient: get_auth_request con 0x7fafbc0378c0 auth_method 0 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2116483277 0 0) 0x7fafb00065d0 con 0x7fafb0002870 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient(hunting): my global_id is 4926 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafd01396d0 con 0x7fafb0002870 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4262382811 0 0) 0x7fafd01396d0 con 0x7fafb0002870 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafb00065d0 con 0x7fafb0002870 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafcc004b30 con 0x7fafb0002870 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 10 monclient: dump: 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.845 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 36537966 0 0) 0x7fafb00065d0 con 0x7fafb0002870 2024-04-25T23:57:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.843+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fafb000a160 con 0x7fafb0002870 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.847+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fafcc001240 con 0x7fafb0002870 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.847+0000 7fafc57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.847+0000 7fafc57fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.847+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.171:6790/0 conn(0x7fafb0002870 legacy=0x7fafb0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.847+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.171:6790/0 conn(0x7fafb0002870 legacy=0x7fafb0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafd6ba4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fafb0009e50 con 0x7fafb0009110 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2414870434 0 0) 0x7fafb0009e50 con 0x7fafb0009110 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 10 monclient(hunting): my global_id is 4935 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafb00065d0 con 0x7fafb0009110 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2667415427 0 0) 0x7fafb00065d0 con 0x7fafb0009110 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafb0009e50 con 0x7fafb0009110 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafcc0017c0 con 0x7fafb0009110 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 10 monclient: dump: 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 80515626 0 0) 0x7fafb0009e50 con 0x7fafb0009110 2024-04-25T23:57:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fafb000c3e0 con 0x7fafb0009110 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.851+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1151810296) 0x7fafcc005340 con 0x7fafb0009110 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafc57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafc57fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.171:6790/0 conn(0x7fafb0009110 legacy=0x7fafb00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafc57fa640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.171:6790/0 conn(0x7fafb0009110 legacy=0x7fafb00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:01.851 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 140375, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:01.852 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.853 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.854 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:01.855 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:01.856 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.857 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.858 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.860 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:01.863 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:01.865 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.866 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.867 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:01.868 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:01.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:01.870 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:01.870 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.171:6812/722422047 conn(0x7fafbc0378c0 legacy=0x7fafbc039d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 10 monclient: shutdown 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 >> v1:172.21.15.106:6791/0 conn(0x7fafd013e200 legacy=0x7fafd01d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd5141640 1 -- 172.21.15.106:0/536189137 reap_dead start 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd5141640 1 -- 172.21.15.106:0/536189137 reap_dead start 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 shutdown_connections 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 >> 172.21.15.106:0/536189137 conn(0x7fafd00a9e20 msgr2=0x7fafd00a85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 shutdown_connections 2024-04-25T23:57:01.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.855+0000 7fafd6ba4640 1 -- 172.21.15.106:0/536189137 wait complete. 2024-04-25T23:57:01.872 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:01.872 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-25T23:57:01.872 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:57:01.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.921+0000 7fd630caf640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:01.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.921+0000 7fd630caf640 10 monclient: _send_command 2 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:01.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.921+0000 7fd630caf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:01.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:01.921+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"} v 0) -- 0x7fd610005380 con 0x7fd62c0a1790 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient: get_monmap_and_config 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient: build_initial_monmap 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient: monmap: 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:02.004623+0000 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:02.004623+0000 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:01.986 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 1 Processor -- start 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 1 -- start start 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient: init 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient: _add_conns ranks=[5,4,0,3,7,8,6,2,1] 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient(hunting): picked mon.noname-h con 0x7fb8640a1c30 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient(hunting): picked mon.noname-c con 0x7fb86409c140 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient(hunting): picked mon.noname-a con 0x7fb8640a2720 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86409b760 con 0x7fb8640a2720 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86409a9a0 con 0x7fb86409c140 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86409aec0 con 0x7fb8640a1c30 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86c4a4640 10 monclient(hunting): authenticate will time out at 1077.531731s 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86aa41640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb8640a2720 0x7fb86413e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39792/0 (socket says 172.21.15.106:39792) 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb869a3f640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fb86409c140 0x7fb86413ac40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50742/0 (socket says 172.21.15.106:50742) 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:01.999+0000 7fb86aa41640 1 -- 172.21.15.106:0/3028407847 learned_addr learned my addr 172.21.15.106:0/3028407847 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165520746 0 0) 0x7fb86409b760 con 0x7fb8640a2720 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): my global_id is 4896 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb850003530 con 0x7fb8640a2720 2024-04-25T23:57:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 437311342 0 0) 0x7fb86409a9a0 con 0x7fb86409c140 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): my global_id is 134212 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb86409b760 con 0x7fb86409c140 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500073953 0 0) 0x7fb86409aec0 con 0x7fb8640a1c30 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _negotiate 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient(hunting): my global_id is 4973 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb86409a9a0 con 0x7fb8640a1c30 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3992509406 0 0) 0x7fb850003530 con 0x7fb8640a2720 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 >> v1:172.21.15.171:6791/0 conn(0x7fb8640a1c30 legacy=0x7fb8640a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 >> v1:172.21.15.106:6791/0 conn(0x7fb86409c140 legacy=0x7fb86413ac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: _finish_hunting 0 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 monclient: found mon.noname-a 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb864067e60 con 0x7fb8640a2720 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: _finish_auth 0 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: _check_auth_tickets 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb85c001b40 con 0x7fb8640a2720 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: dump: 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:01.998 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 5 monclient: authenticate success, global_id 4896 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb85c001da0 con 0x7fb8640a2720 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 1 -- 172.21.15.106:0/3028407847 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb85c004f70 con 0x7fb8640a2720 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 4 set_mon_vals no callback set 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86923e640 10 monclient: dump: 2024-04-25T23:57:01.999 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.000 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: shutdown 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3028407847 >> v1:172.21.15.106:6789/0 conn(0x7fb8640a2720 legacy=0x7fb86413e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3028407847 shutdown_connections 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3028407847 >> 172.21.15.106:0/3028407847 conn(0x7fb8640a2d20 msgr2=0x7fb8640a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3028407847 shutdown_connections 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3028407847 wait complete. 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: monmap: 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:02.001 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 Processor -- start 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- start start 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: init 2024-04-25T23:57:02.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: _add_conns ranks=[7,2,8,6,5,4,3,1,0] 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient(hunting): picked mon.noname-i con 0x7fb86409c140 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient(hunting): picked mon.noname-b con 0x7fb8640a1c30 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient(hunting): picked mon.noname-e con 0x7fb8640a2720 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86413e680 con 0x7fb8640a1c30 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8641cacc0 con 0x7fb86409c140 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb86413d1d0 con 0x7fb8640a2720 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient(hunting): authenticate will time out at 1077.535006s 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb869a3f640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb8640a1c30 0x7fb8641ca5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48916/0 (socket says 172.21.15.106:48916) 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb869a3f640 1 -- 172.21.15.106:0/3513974860 learned_addr learned my addr 172.21.15.106:0/3513974860 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2972170964 0 0) 0x7fb86413d1d0 con 0x7fb8640a2720 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): my global_id is 134171 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb848003560 con 0x7fb8640a2720 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2891500436 0 0) 0x7fb86413e680 con 0x7fb8640a1c30 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): my global_id is 4925 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb86413d1d0 con 0x7fb8640a1c30 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2436482034 0 0) 0x7fb848003560 con 0x7fb8640a2720 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb86413e680 con 0x7fb8640a2720 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb85c001a40 con 0x7fb8640a2720 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:57:02.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): dump: 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.005 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1399130134 0 0) 0x7fb86413d1d0 con 0x7fb8640a1c30 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb848003560 con 0x7fb8640a1c30 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 759078333 0 0) 0x7fb8641cacc0 con 0x7fb86409c140 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): my global_id is 134215 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb86413d1d0 con 0x7fb86409c140 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb860001520 con 0x7fb8640a1c30 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient(hunting): dump: 2024-04-25T23:57:02.006 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.007 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2246133878 0 0) 0x7fb86413e680 con 0x7fb8640a2720 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.171:6792/0 conn(0x7fb86409c140 legacy=0x7fb8641c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.106:6790/0 conn(0x7fb8640a1c30 legacy=0x7fb8641ca5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 monclient: found mon.e 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb86413e960 con 0x7fb8640a2720 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 5 monclient: authenticate success, global_id 134171 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: _renew_subs 2024-04-25T23:57:02.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb86409c5f0 con 0x7fb8640a2720 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: _renew_subs 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb86413e3a0 con 0x7fb8640a2720 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb85c004f90 con 0x7fb8640a2720 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb85c001550 con 0x7fb8640a2720 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb868a3d640 4 set_mon_vals no callback set 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.003+0000 7fb85affd640 10 monclient: dump: 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.009 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb86c4a4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb84c0065d0 con 0x7fb84c002870 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb85c010120 con 0x7fb8640a2720 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(38..38 src has 1..38) ==== 3598+0+0 (unknown 1041058586 0 0) 0x7fb85c0447f0 con 0x7fb8640a2720 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2309750486 0 0) 0x7fb84c0065d0 con 0x7fb84c002870 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient(hunting): my global_id is 4982 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb86413e680 con 0x7fb84c002870 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb869a3f640 10 monclient: get_auth_request con 0x7fb848038100 auth_method 0 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3469753751 0 0) 0x7fb86413e680 con 0x7fb84c002870 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb84c0065d0 con 0x7fb84c002870 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb854001930 con 0x7fb84c002870 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:02.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient: dump: 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.012 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4092225542 0 0) 0x7fb84c0065d0 con 0x7fb84c002870 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb84c00a160 con 0x7fb84c002870 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb854004650 con 0x7fb84c002870 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.171:6791/0 conn(0x7fb84c002870 legacy=0x7fb84c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.007+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.171:6791/0 conn(0x7fb84c002870 legacy=0x7fb84c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:02.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb84c009e30 con 0x7fb84c0090f0 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592869430 0 0) 0x7fb84c009e30 con 0x7fb84c0090f0 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient(hunting): my global_id is 4991 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb84c0065d0 con 0x7fb84c0090f0 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4233383349 0 0) 0x7fb84c0065d0 con 0x7fb84c0090f0 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb84c009e30 con 0x7fb84c0090f0 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb854003bd0 con 0x7fb84c0090f0 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient: dump: 2024-04-25T23:57:02.015 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.016 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4240235708 0 0) 0x7fb84c009e30 con 0x7fb84c0090f0 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb84c00c3a0 con 0x7fb84c0090f0 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2754787521) 0x7fb854004880 con 0x7fb84c0090f0 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.171:6791/0 conn(0x7fb84c0090f0 legacy=0x7fb84c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb85affd640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.171:6791/0 conn(0x7fb84c0090f0 legacy=0x7fb84c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:02.017 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 140519, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:02.018 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:02.019 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:02.020 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:02.021 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:02.022 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.023 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.024 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.025 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:02.027 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:02.029 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.032 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:02.034 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.035 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.036 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:02.036 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.171:6812/722422047 conn(0x7fb848038100 legacy=0x7fb84803a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 10 monclient: shutdown 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 >> v1:172.21.15.106:6793/0 conn(0x7fb8640a2720 legacy=0x7fb8641d24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86aa41640 1 -- 172.21.15.106:0/3513974860 reap_dead start 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86aa41640 1 -- 172.21.15.106:0/3513974860 reap_dead start 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 shutdown_connections 2024-04-25T23:57:02.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 >> 172.21.15.106:0/3513974860 conn(0x7fb8640a2d20 msgr2=0x7fb864135050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 shutdown_connections 2024-04-25T23:57:02.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.015+0000 7fb86c4a4640 1 -- 172.21.15.106:0/3513974860 wait complete. 2024-04-25T23:57:02.038 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:02.038 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-25T23:57:02.038 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.167+0000 7fda73847640 10 monclient: get_monmap_and_config 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.167+0000 7fda73847640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.167+0000 7fda73847640 10 monclient: monmap: 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:02.173440+0000 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:02.173440+0000 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.155 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 1 Processor -- start 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 1 -- start start 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient: init 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient: _add_conns ranks=[1,8,6,2,5,4,7,0,3] 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient(hunting): picked mon.noname-f con 0x7fda6c0a0360 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient(hunting): picked mon.noname-e con 0x7fda6c135f50 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient(hunting): picked mon.noname-d con 0x7fda6c13bed0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c0a0b00 con 0x7fda6c0a0360 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c0a0d40 con 0x7fda6c13bed0 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c09ab20 con 0x7fda6c135f50 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda73847640 10 monclient(hunting): authenticate will time out at 1077.700941s 2024-04-25T23:57:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda70de2640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fda6c135f50 0x7fda6c13a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:43820/0 (socket says 172.21.15.106:43820) 2024-04-25T23:57:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.171+0000 7fda70de2640 1 -- 172.21.15.106:0/2616948425 learned_addr learned my addr 172.21.15.106:0/2616948425 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3164234600 0 0) 0x7fda6c0a0d40 con 0x7fda6c13bed0 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): my global_id is 4893 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda58003530 con 0x7fda6c13bed0 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3529319511 0 0) 0x7fda6c09ab20 con 0x7fda6c135f50 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient(hunting): my global_id is 134180 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda6c0a0d40 con 0x7fda6c135f50 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 964736577 0 0) 0x7fda58003530 con 0x7fda6c13bed0 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 >> v1:172.21.15.106:6793/0 conn(0x7fda6c135f50 legacy=0x7fda6c13a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 >> v1:172.21.15.171:6789/0 conn(0x7fda6c0a0360 legacy=0x7fda6c135840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.175+0000 7fda63fff640 1 monclient: found mon.noname-d 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c0a0170 con 0x7fda6c13bed0 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda64001b40 con 0x7fda6c13bed0 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 5 monclient: authenticate success, global_id 4893 2024-04-25T23:57:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: dump: 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.165 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda64001df0 con 0x7fda6c13bed0 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 1 -- 172.21.15.106:0/2616948425 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda64003cc0 con 0x7fda6c13bed0 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 4 set_mon_vals no callback set 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda63fff640 10 monclient: dump: 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.166 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.167 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.181+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}]=0 v39) ==== 126+0+0 (unknown 2240183908 0 0) 0x7fd61c013d70 con 0x7fd62c0a1790 2024-04-25T23:57:02.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.181+0000 7fd61affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.181+0000 7fd61affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:02.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: shutdown 2024-04-25T23:57:02.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- 172.21.15.106:0/2616948425 >> v1:172.21.15.106:6792/0 conn(0x7fda6c13bed0 legacy=0x7fda6c13e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- 172.21.15.106:0/2616948425 shutdown_connections 2024-04-25T23:57:02.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- 172.21.15.106:0/2616948425 >> 172.21.15.106:0/2616948425 conn(0x7fda6c0a36e0 msgr2=0x7fda6c0a3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- 172.21.15.106:0/2616948425 shutdown_connections 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- 172.21.15.106:0/2616948425 wait complete. 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: monmap: 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.174 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 Processor -- start 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- start start 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: init 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: _add_conns ranks=[1,8,7,5,4,6,0,2,3] 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient(hunting): picked mon.noname-f con 0x7fda6c0a0360 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient(hunting): picked mon.noname-e con 0x7fda6c135f50 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient(hunting): picked mon.noname-i con 0x7fda6c13bed0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c13fc10 con 0x7fda6c0a0360 2024-04-25T23:57:02.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c13fef0 con 0x7fda6c13bed0 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6c13e5c0 con 0x7fda6c135f50 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient(hunting): authenticate will time out at 1077.710464s 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda70de2640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fda6c135f50 0x7fda6c13c9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:43832/0 (socket says 172.21.15.106:43832) 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda70de2640 1 -- 172.21.15.106:0/1230709531 learned_addr learned my addr 172.21.15.106:0/1230709531 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489597187 0 0) 0x7fda6c13e5c0 con 0x7fda6c135f50 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): my global_id is 134189 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda50003530 con 0x7fda6c135f50 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2272125762 0 0) 0x7fda50003530 con 0x7fda6c135f50 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda6c13e5c0 con 0x7fda6c135f50 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475421135 0 0) 0x7fda6c13fc10 con 0x7fda6c0a0360 2024-04-25T23:57:02.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): my global_id is 134254 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda50003530 con 0x7fda6c0a0360 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda5c001a40 con 0x7fda6c135f50 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4076684164 0 0) 0x7fda6c13e5c0 con 0x7fda6c135f50 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.171:6792/0 conn(0x7fda6c13bed0 legacy=0x7fda6c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.171:6789/0 conn(0x7fda6c0a0360 legacy=0x7fda6c13c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 monclient: found mon.e 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda6c072530 con 0x7fda6c135f50 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 5 monclient: authenticate success, global_id 134189 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: _renew_subs 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda6c1367b0 con 0x7fda6c135f50 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: _renew_subs 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fda6c1d5ba0 con 0x7fda6c135f50 2024-04-25T23:57:02.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda5c004aa0 con 0x7fda6c135f50 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda5c004f90 con 0x7fda6c135f50 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda637fe640 4 set_mon_vals no callback set 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.179+0000 7fda61ffb640 10 monclient: dump: 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.180 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fda5c00fd30 con 0x7fda6c135f50 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda73847640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda4c0065d0 con 0x7fda4c002870 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(39..39 src has 1..39) ==== 3657+0+0 (unknown 709175337 0 0) 0x7fda5c044530 con 0x7fda6c135f50 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda71de4640 10 monclient: get_auth_request con 0x7fda50037900 auth_method 0 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3423999708 0 0) 0x7fda4c0065d0 con 0x7fda4c002870 2024-04-25T23:57:02.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient(hunting): my global_id is 134233 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda6c13e5c0 con 0x7fda4c002870 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1460452941 0 0) 0x7fda6c13e5c0 con 0x7fda4c002870 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda4c0065d0 con 0x7fda4c002870 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda68001890 con 0x7fda4c002870 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient: dump: 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.182 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1768537198 0 0) 0x7fda4c0065d0 con 0x7fda4c002870 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda4c00a160 con 0x7fda4c002870 2024-04-25T23:57:02.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fda68001cd0 con 0x7fda4c002870 2024-04-25T23:57:02.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:02.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.171:6792/0 conn(0x7fda4c002870 legacy=0x7fda4c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.183+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.171:6792/0 conn(0x7fda4c002870 legacy=0x7fda4c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda4c009e30 con 0x7fda4c0090f0 2024-04-25T23:57:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2917129519 0 0) 0x7fda4c009e30 con 0x7fda4c0090f0 2024-04-25T23:57:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient(hunting): my global_id is 134242 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda4c0065d0 con 0x7fda4c0090f0 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2629522633 0 0) 0x7fda4c0065d0 con 0x7fda4c0090f0 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda4c009e30 con 0x7fda4c0090f0 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda68003bb0 con 0x7fda4c0090f0 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient: dump: 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.186 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 473793941 0 0) 0x7fda4c009e30 con 0x7fda4c0090f0 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fda4c00c3a0 con 0x7fda4c0090f0 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 275078418) 0x7fda68003f10 con 0x7fda4c0090f0 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.171:6792/0 conn(0x7fda4c0090f0 legacy=0x7fda4c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda61ffb640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.171:6792/0 conn(0x7fda4c0090f0 legacy=0x7fda4c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 10191, 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:02.188 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:02.189 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:02.190 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:02.191 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:02.193 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:02.194 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.195 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:02.196 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.197 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:02.198 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:02.200 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:02.202 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.203 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.204 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:02.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:02.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:02.207 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:02.208 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:02.208 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:02.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:02.208 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:02.208 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:02.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.171:6812/722422047 conn(0x7fda50037900 legacy=0x7fda50039dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 10 monclient: shutdown 2024-04-25T23:57:02.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 >> v1:172.21.15.106:6793/0 conn(0x7fda6c135f50 legacy=0x7fda6c13c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda71de4640 1 -- 172.21.15.106:0/1230709531 reap_dead start 2024-04-25T23:57:02.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda71de4640 1 -- 172.21.15.106:0/1230709531 reap_dead start 2024-04-25T23:57:02.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 shutdown_connections 2024-04-25T23:57:02.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 >> 172.21.15.106:0/1230709531 conn(0x7fda6c0a36e0 msgr2=0x7fda6c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 shutdown_connections 2024-04-25T23:57:02.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.191+0000 7fda73847640 1 -- 172.21.15.106:0/1230709531 wait complete. 2024-04-25T23:57:02.210 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:02.210 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-25T23:57:02.210 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-25T23:57:02.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 10 monclient: _send_command 3 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:02.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"} v 0) -- 0x7fd610001150 con 0x7fd62c0a1790 2024-04-25T23:57:02.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd61affd640 1 -- 172.21.15.171:0/2627558547 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}]=0 rule foo already exists v39) ==== 149+0+0 (unknown 703702327 0 0) 0x7fd61c0180c0 con 0x7fd62c0a1790 2024-04-25T23:57:02.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd61affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd61affd640 10 monclient: _finish_command 3 = system:0 rule foo already exists 2024-04-25T23:57:02.269 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo already exists 2024-04-25T23:57:02.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 >> v1:172.21.15.171:6812/722422047 conn(0x7fd60c038100 legacy=0x7fd60c03a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 10 monclient: shutdown 2024-04-25T23:57:02.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.285+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 >> v1:172.21.15.171:6789/0 conn(0x7fd62c0a1790 legacy=0x7fd62c06f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.289+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 shutdown_connections 2024-04-25T23:57:02.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.289+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 >> 172.21.15.171:0/2627558547 conn(0x7fd62c0a2690 msgr2=0x7fd62c0a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.289+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 shutdown_connections 2024-04-25T23:57:02.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.289+0000 7fd630caf640 1 -- 172.21.15.171:0/2627558547 wait complete. 2024-04-25T23:57:02.285 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule create-simple foo default host 2024-04-25T23:57:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient: get_monmap_and_config 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient: monmap: 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:02.340455+0000 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:02.340455+0000 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.321 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.322 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.322 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 1 Processor -- start 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 1 -- start start 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient: init 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient: _add_conns ranks=[0,3,8,6,7,5,4,1,2] 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient(hunting): picked mon.noname-a con 0x7f89a40a3670 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient(hunting): picked mon.noname-g con 0x7f89a4137620 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient(hunting): picked mon.noname-e con 0x7f89a41381c0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:02.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a406da10 con 0x7f89a40a3670 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a406e310 con 0x7f89a4137620 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a406e030 con 0x7f89a41381c0 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a8e5a640 10 monclient(hunting): authenticate will time out at 1077.867520s 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a259c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f89a40a3670 0x7f89a4137ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39800/0 (socket says 172.21.15.106:39800) 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a259c640 1 -- 172.21.15.106:0/70784774 learned_addr learned my addr 172.21.15.106:0/70784774 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2560446328 0 0) 0x7f89a406da10 con 0x7f89a40a3670 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): my global_id is 4905 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f898c003530 con 0x7f89a40a3670 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703459893 0 0) 0x7f89a406e030 con 0x7f89a41381c0 2024-04-25T23:57:02.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 10 monclient(hunting): my global_id is 134198 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.335+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a406da10 con 0x7f89a41381c0 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 212555038 0 0) 0x7f898c003530 con 0x7f89a40a3670 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 >> v1:172.21.15.106:6793/0 conn(0x7f89a41381c0 legacy=0x7f89a4140070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 >> v1:172.21.15.171:6790/0 conn(0x7f89a4137620 legacy=0x7f89a413c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 monclient: found mon.noname-a 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40708d0 con 0x7f89a40a3670 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89980017c0 con 0x7f89a40a3670 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 5 monclient: authenticate success, global_id 4905 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: dump: 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.331 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8998001a30 con 0x7f89a40a3670 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 4 set_mon_vals no callback set 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 1 -- 172.21.15.106:0/70784774 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8998004bf0 con 0x7f89a40a3670 2024-04-25T23:57:02.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a159a640 10 monclient: dump: 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.333 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: shutdown 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/70784774 >> v1:172.21.15.106:6789/0 conn(0x7f89a40a3670 legacy=0x7f89a4137ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/70784774 shutdown_connections 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/70784774 >> 172.21.15.106:0/70784774 conn(0x7f89a406b210 msgr2=0x7f89a406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/70784774 shutdown_connections 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/70784774 wait complete. 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: monmap: 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:02.334 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 Processor -- start 2024-04-25T23:57:02.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- start start 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: init 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _add_conns ranks=[5,0,7,3,2,1,8,6,4] 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient(hunting): picked mon.noname-h con 0x7f89a40a3670 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient(hunting): picked mon.noname-a con 0x7f89a41381c0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient(hunting): picked mon.noname-i con 0x7f89a4134ac0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a41cd6b0 con 0x7f89a41381c0 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a4136290 con 0x7f89a40a3670 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89a4072af0 con 0x7f89a4134ac0 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient(hunting): authenticate will time out at 1077.870255s 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a1d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f89a41381c0 0x7f89a41ccfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39802/0 (socket says 172.21.15.106:39802) 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a1d9b640 1 -- 172.21.15.106:0/2548517635 learned_addr learned my addr 172.21.15.106:0/2548517635 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 348764544 0 0) 0x7f89a41cd6b0 con 0x7f89a41381c0 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): my global_id is 4914 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8984003530 con 0x7f89a41381c0 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3624691390 0 0) 0x7f8984003530 con 0x7f89a41381c0 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89a41cd6b0 con 0x7f89a41381c0 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8994001ae0 con 0x7f89a41381c0 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4153479968 0 0) 0x7f89a4136290 con 0x7f89a40a3670 2024-04-25T23:57:02.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient(hunting): my global_id is 5000 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8984003530 con 0x7f89a40a3670 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 914676647 0 0) 0x7f89a41cd6b0 con 0x7f89a41381c0 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 >> v1:172.21.15.171:6792/0 conn(0x7f89a4134ac0 legacy=0x7f89a41d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 >> v1:172.21.15.171:6791/0 conn(0x7f89a40a3670 legacy=0x7f89a41cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 monclient: found mon.a 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89a40726e0 con 0x7f89a41381c0 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 5 monclient: authenticate success, global_id 4914 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _renew_subs 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89a4138720 con 0x7f89a41381c0 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _renew_subs 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f89a4135fe0 con 0x7f89a41381c0 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8994003950 con 0x7f89a41381c0 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8994003ec0 con 0x7f89a41381c0 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a0d99640 4 set_mon_vals no callback set 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 10 monclient: dump: 2024-04-25T23:57:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:02.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8994004060 con 0x7f89a41381c0 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.339+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8988005090 con 0x7f89a41381c0 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.343+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(39..39 src has 1..39) ==== 3657+0+0 (unknown 709175337 0 0) 0x7f8994044670 con 0x7f89a41381c0 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.343+0000 7f89a259c640 10 monclient: get_auth_request con 0x7f89840378e0 auth_method 0 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.347+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f89940158a0 con 0x7f89a41381c0 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.347+0000 7f8992ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.347+0000 7f8992ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:02.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient: get_monmap_and_config 2024-04-25T23:57:02.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient: monmap: 2024-04-25T23:57:02.408 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:02.408 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:02.427545+0000 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:02.427545+0000 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.409 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 1 Processor -- start 2024-04-25T23:57:02.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 1 -- start start 2024-04-25T23:57:02.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient: init 2024-04-25T23:57:02.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient: _add_conns ranks=[7,8,1,6,0,3,2,5,4] 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient(hunting): picked mon.noname-i con 0x7f640c06e480 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient(hunting): picked mon.noname-e con 0x7f640c06ef70 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient(hunting): picked mon.noname-f con 0x7f640c13aab0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c070c60 con 0x7f640c13aab0 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c070f40 con 0x7f640c06e480 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c06f980 con 0x7f640c06ef70 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 10 monclient(hunting): authenticate will time out at 1073.135096s 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640bfff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f640c06e480 0x7f640c06e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:37344/0 (socket says 172.21.15.171:37344) 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f64109bf640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f640c13aab0 0x7f640c13cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:57596/0 (socket says 172.21.15.171:57596) 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640bfff640 1 -- 172.21.15.171:0/2728703794 learned_addr learned my addr 172.21.15.171:0/2728703794 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240844804 0 0) 0x7f640c070f40 con 0x7f640c06e480 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.413 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): my global_id is 134260 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63f4004640 con 0x7f640c06e480 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2438154139 0 0) 0x7f640c070c60 con 0x7f640c13aab0 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient(hunting): my global_id is 134263 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f640c070f40 con 0x7f640c13aab0 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2663504554 0 0) 0x7f640c070f40 con 0x7f640c13aab0 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 >> v1:172.21.15.106:6793/0 conn(0x7f640c06ef70 legacy=0x7f640c139390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 >> v1:172.21.15.171:6792/0 conn(0x7f640c06e480 legacy=0x7f640c06e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 monclient: found mon.noname-f 2024-04-25T23:57:02.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c072e40 con 0x7f640c13aab0 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6404001aa0 con 0x7f640c13aab0 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 5 monclient: authenticate success, global_id 134263 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f640affd640 10 monclient: dump: 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.415 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.425+0000 7f6412422640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6404001d10 con 0x7f640c13aab0 2024-04-25T23:57:02.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640affd640 1 -- 172.21.15.171:0/2728703794 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6404004eb0 con 0x7f640c13aab0 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 4 set_mon_vals no callback set 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640affd640 10 monclient: dump: 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.417 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: shutdown 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- 172.21.15.171:0/2728703794 >> v1:172.21.15.171:6789/0 conn(0x7f640c13aab0 legacy=0x7f640c13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- 172.21.15.171:0/2728703794 shutdown_connections 2024-04-25T23:57:02.418 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- 172.21.15.171:0/2728703794 >> 172.21.15.171:0/2728703794 conn(0x7f640c0a2690 msgr2=0x7f640c0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- 172.21.15.171:0/2728703794 shutdown_connections 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- 172.21.15.171:0/2728703794 wait complete. 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: monmap: 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.419 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.420 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.420 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.420 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.420 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 Processor -- start 2024-04-25T23:57:02.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- start start 2024-04-25T23:57:02.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: init 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: _add_conns ranks=[0,7,5,3,6,1,8,4,2] 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient(hunting): picked mon.noname-a con 0x7f640c06e480 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient(hunting): picked mon.noname-i con 0x7f640c06ef70 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient(hunting): picked mon.noname-h con 0x7f640c13aab0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c072300 con 0x7f640c06e480 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c0702c0 con 0x7f640c13aab0 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f640c11ff60 con 0x7f640c06ef70 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient(hunting): authenticate will time out at 1073.138226s 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640b7fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f640c06ef70 0x7f640c1cf620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:37350/0 (socket says 172.21.15.171:37350) 2024-04-25T23:57:02.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640b7fe640 1 -- 172.21.15.171:0/3266771671 learned_addr learned my addr 172.21.15.171:0/3266771671 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747833319 0 0) 0x7f640c11ff60 con 0x7f640c06ef70 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): my global_id is 134269 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63f8003530 con 0x7f640c06ef70 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 805373410 0 0) 0x7f640c0702c0 con 0x7f640c13aab0 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): my global_id is 5009 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f640c11ff60 con 0x7f640c13aab0 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2759183696 0 0) 0x7f63f8003530 con 0x7f640c06ef70 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f640c0702c0 con 0x7f640c06ef70 2024-04-25T23:57:02.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1733837100 0 0) 0x7f640c11ff60 con 0x7f640c13aab0 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63f8003530 con 0x7f640c13aab0 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6400001b60 con 0x7f640c06ef70 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.426 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6404004f70 con 0x7f640c13aab0 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.427 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2669573261 0 0) 0x7f640c072300 con 0x7f640c06e480 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient(hunting): my global_id is 4923 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f640c11ff60 con 0x7f640c06e480 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1000356463 0 0) 0x7f640c0702c0 con 0x7f640c06ef70 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 >> v1:172.21.15.171:6791/0 conn(0x7f640c13aab0 legacy=0x7f640c1d2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 >> v1:172.21.15.106:6789/0 conn(0x7f640c06e480 legacy=0x7f640c135880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 monclient: found mon.i 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f640c122250 con 0x7f640c06ef70 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 5 monclient: authenticate success, global_id 134269 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: _renew_subs 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f640c1cad20 con 0x7f640c06ef70 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: _renew_subs 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f640c1ca500 con 0x7f640c06ef70 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64000038d0 con 0x7f640c06ef70 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6400003e40 con 0x7f640c06ef70 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f640a7fc640 4 set_mon_vals no callback set 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6408ff9640 10 monclient: dump: 2024-04-25T23:57:02.430 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.431 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.429+0000 7f6412422640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.433+0000 7f6412422640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.433+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6400003fe0 con 0x7f640c06ef70 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.433+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ec005090 con 0x7f640c06ef70 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.433+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(39..39 src has 1..39) ==== 3657+0+0 (unknown 709175337 0 0) 0x7f64000445f0 con 0x7f640c06ef70 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.433+0000 7f640bfff640 10 monclient: get_auth_request con 0x7f63f8037d50 auth_method 0 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.437+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6400015840 con 0x7f640c06ef70 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.437+0000 7f6408ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.437+0000 7f6408ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.555+0000 7f89a8e5a640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-25T23:57:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.555+0000 7f89a8e5a640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-25T23:57:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.555+0000 7f89a8e5a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:02.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.555+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f8988005b90 con 0x7f89a41381c0 2024-04-25T23:57:02.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.555+0000 7f8992ffd640 1 -- 172.21.15.106:0/2548517635 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f89940151a0 con 0x7f89a41381c0 2024-04-25T23:57:02.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.555+0000 7f8992ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-25T23:57:02.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.555+0000 7f8992ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:02.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=19,config=2,health=12,kv=10,logm=57} crc {auth=2052613834,config=692619927,health=3977944326,kv=3875002534,logm=3942371142}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=18,config=2,health=12,kv=10,logm=58} crc {auth=2445869244,config=692619927,health=3977944326,kv=3875002534,logm=3698231661}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=19,config=2,health=12,kv=10,logm=57} crc {auth=1353428024,config=692619927,health=3977944326,kv=3875002534,logm=4155909237}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=20,config=1,health=12,kv=10,logm=57} crc {auth=212342021,config=3678701417,health=3977944326,kv=3875002534,logm=2471786410}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=18,config=2,health=12,kv=10,logm=58} crc {auth=94969741,config=692619927,health=3977944326,kv=3875002534,logm=225267253}) 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=18,config=2,health=11,kv=9,logm=60} crc {auth=4286758353,config=692619927,health=3172947059,kv=524469624,logm=2025313913}) 2024-04-25T23:57:02.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=2,health=11,kv=10,logm=58} crc {auth=976812185,config=692619927,health=3926953126,kv=3875002534,logm=214054457}) 2024-04-25T23:57:02.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 >> v1:172.21.15.171:6812/722422047 conn(0x7f89840378e0 legacy=0x7f8984039da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=558254242,config=692619927,health=548468587,kv=3875002534,logm=825510488}) 2024-04-25T23:57:02.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 10 monclient: shutdown 2024-04-25T23:57:02.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 >> v1:172.21.15.106:6789/0 conn(0x7f89a41381c0 legacy=0x7f89a41ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=19,config=2,health=12,kv=10,logm=57} crc {auth=2052613834,config=692619927,health=3977944326,kv=3875002534,logm=1354112192}) 2024-04-25T23:57:02.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 shutdown_connections 2024-04-25T23:57:02.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 >> 172.21.15.106:0/2548517635 conn(0x7f89a406b210 msgr2=0x7f89a40a7490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 shutdown_connections 2024-04-25T23:57:02.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:02.559+0000 7f89a8e5a640 1 -- 172.21.15.106:0/2548517635 wait complete. 2024-04-25T23:57:02.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3606979982}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=406904194}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3103037728}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1570377431}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=670312227}) 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2121413484}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149152149}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1447120441}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3036372005}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2405195832}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.563+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3562158875}) 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2543901554}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1416675589}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=134663707}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=210640137}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3353845806}) 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=411685228}) 2024-04-25T23:57:02.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.567+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3233917611}) 2024-04-25T23:57:02.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=455203204}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1826059787}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=921540980}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2365919528}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4219227298}) 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3479528045}) 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3879953805}) 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2878044763}) 2024-04-25T23:57:02.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.571+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1490350054}) 2024-04-25T23:57:02.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3746623619}) 2024-04-25T23:57:02.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1300770233}) 2024-04-25T23:57:02.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3055790818}) 2024-04-25T23:57:02.563 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3678831061}) 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1654652000}) 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3568607747}) 2024-04-25T23:57:02.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2543727558}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3673677343}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.575+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2774013325}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3875370342}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=343313682}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3545696499}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2606163524}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3414968463}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3572594166}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3662808446}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=862620685}) 2024-04-25T23:57:02.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.579+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1453284751}) 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4027058918}) 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2410807297}) 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1342121586}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3026750842}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1696056271}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=491499019}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=822506958}) 2024-04-25T23:57:02.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=357040638}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1467838866}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=90,mdsmap=3,mgr=7} crc {logm=343319963,mdsmap=2840952586,mgr=3816727542}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=817727036,mdsmap=2840952586,mgr=3169905386}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=90,mdsmap=3,mgr=7} crc {logm=715566516,mdsmap=2840952586,mgr=3816727542}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=89,mdsmap=3,mgr=8} crc {logm=2562823259,mdsmap=2840952586,mgr=1156056737}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.583+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=2638736838,mdsmap=2840952586,mgr=3169905386}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=1494659636,mdsmap=2840952586,mgr=506063867}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=3072953485,mdsmap=2840952586,mgr=506063867}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=90,mdsmap=3,mgr=6,mgr_command_descs=1} crc {logm=1187043986,mdsmap=2840952586,mgr=2773441474,mgr_command_descs=3057339438}) 2024-04-25T23:57:02.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=1485759245,mdsmap=2840952586,mgr=506063867}) 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=1,health=12,kv=10,logm=57} crc {auth=212342021,config=1228700967,health=3977944326,kv=3875002534,logm=921362872}) 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=19,config=1,health=12,kv=10,logm=58} crc {auth=3298379988,config=3678701417,health=3977944326,kv=3875002534,logm=1533569933}) 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=20,config=2,health=12,kv=10,logm=56} crc {auth=212342021,config=692619927,health=1503412351,kv=3875002534,logm=2649033402}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=20,config=2,health=11,kv=10,logm=57} crc {auth=212342021,config=692619927,health=548468587,kv=3875002534,logm=2720653875}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=19,config=1,health=12,kv=10,logm=58} crc {auth=728337777,config=1228700967,health=3977944326,kv=3875002534,logm=85394596}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=19,config=2,health=11,kv=8,logm=60} crc {auth=2957261889,config=692619927,health=3172947059,kv=3210745004,logm=197096128}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=1,health=12,kv=10,logm=58} crc {auth=3568221323,config=1228700967,health=3977944326,kv=3875002534,logm=117263310}) 2024-04-25T23:57:02.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=1,health=11,kv=9,logm=60} crc {auth=2957261889,config=1228700967,health=3926953126,kv=340114565,logm=2173095719}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.587+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=18,config=2,health=11,kv=10,logm=59} crc {auth=1784300512,config=692619927,health=2681726216,kv=3875002534,logm=2783144528}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4010655723}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1044581}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2055761244}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3764162344}) 2024-04-25T23:57:02.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3609346632}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1175700640}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1137432080}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1489416317}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.591+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=444239862}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3630492342}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=542534712}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3383390462}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3686139228}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1464784513}) 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3216924321}) 2024-04-25T23:57:02.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3116776439}) 2024-04-25T23:57:02.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1245717980}) 2024-04-25T23:57:02.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.595+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=992551353}) 2024-04-25T23:57:02.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.605+0000 7f6412422640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.605+0000 7f6412422640 10 monclient: _send_command 2 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.605+0000 7f6412422640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:02.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.605+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"} v 0) -- 0x7f63ec005380 con 0x7f640c06ef70 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3171489049}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1616074971}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3450600889}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3531962120}) 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1616074971}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=274004319}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3149136242}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1772927748}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.599+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2432027682}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3316869543}) 2024-04-25T23:57:02.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2057007135}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3681005514}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3656694979}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2057007135}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2923377057}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3437922961}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=247641065}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1615213589}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1507098923}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2732535576}) 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1942600939}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.603+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1962848463}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2732535576}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2616655429}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=569948729}) 2024-04-25T23:57:02.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4284582403}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3157164475}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=917487935}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=827590729}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1354969057}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2526113714}) 2024-04-25T23:57:02.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=827590729}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2296484354}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4079742539}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3092502673}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.607+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=206056376}) 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3669457506}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2247806477}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3951932212}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2478783452}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2247806477}) 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3957145979}) 2024-04-25T23:57:02.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3338843107}) 2024-04-25T23:57:02.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1982849603}) 2024-04-25T23:57:02.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.611+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2627672220}) 2024-04-25T23:57:02.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=50} crc {logm=2932071913,mdsmap=3140514009,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3585156200,mon_config_key=809949667,monmap=828017138,osd_metadata=2883694957,osd_pg_creating=1515308889,osdmap=2696559650}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=7,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=55} crc {logm=1835923485,mdsmap=2840952586,mgr=194085940,mgr_metadata=177654402,mgrstat=2672142963,mon_config_key=2901941722,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=1154348339}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=8,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=50} crc {logm=2932071913,mdsmap=2840952586,mgr=119571008,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=4015075610,mon_config_key=160787317,monmap=828017138,osd_metadata=1249858579,osd_pg_creating=1515308889,osdmap=3239461666}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=7,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=49} crc {logm=2217786069,mdsmap=2840952586,mgr=1156056738,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=914247793,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=2704913065}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=7,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=55} crc {logm=1835923485,mdsmap=2840952586,mgr=194085940,mgr_metadata=177654402,mgrstat=2672142963,mon_config_key=2901941722,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=1154348339}) 2024-04-25T23:57:02.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=7,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=2815325771,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=1603743053}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=51} crc {logm=2673997283,mdsmap=2840952586,mgr=2218744211,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3034661034,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=147897146}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=48} crc {logm=429915371,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=3183981761,monmap=375078350,osd_metadata=857068958,osd_pg_creating=1515308889,osdmap=3666286502}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.615+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=8,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=50} crc {logm=2932071913,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339439,mgr_metadata=177654402,mgrstat=2038837155,mon_config_key=150075512,monmap=828017138,osd_metadata=1249858579,osd_pg_creating=1515308889,osdmap=1083922095}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=30} crc {osdmap=904034313}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=30} crc {osdmap=3100942741}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=31} crc {osdmap=2660785855}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=29} crc {osdmap=2207146668}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=30} crc {osdmap=3100942741}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=32} crc {osdmap=4257645600}) 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=30} crc {osdmap=793994726}) 2024-04-25T23:57:02.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:57:02.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=31} crc {osdmap=1593257661}) 2024-04-25T23:57:02.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:57:02.619+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=30} crc {osdmap=549873740}) 2024-04-25T23:57:02.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.637+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}]=0 rule foo already exists v39) ==== 149+0+0 (unknown 703702327 0 0) 0x7f6400015140 con 0x7f640c06ef70 2024-04-25T23:57:02.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.637+0000 7f6408ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.637+0000 7f6408ff9640 10 monclient: _finish_command 2 = system:0 rule foo already exists 2024-04-25T23:57:02.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.733+0000 7f6412422640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.733+0000 7f6412422640 10 monclient: _send_command 3 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.733+0000 7f6412422640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:57:02.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.733+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"} v 0) -- 0x7f63ec001150 con 0x7f640c06ef70 2024-04-25T23:57:02.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.733+0000 7f6408ff9640 1 -- 172.21.15.171:0/3266771671 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}]=0 rule foo already exists v39) ==== 149+0+0 (unknown 703702327 0 0) 0x7f6400019490 con 0x7f640c06ef70 2024-04-25T23:57:02.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.733+0000 7f6408ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule create-simple", "name": "foo", "root": "default", "type": "host"}] 2024-04-25T23:57:02.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.733+0000 7f6408ff9640 10 monclient: _finish_command 3 = system:0 rule foo already exists 2024-04-25T23:57:02.718 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo already exists 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 >> v1:172.21.15.171:6812/722422047 conn(0x7f63f8037d50 legacy=0x7f63f803a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 10 monclient: shutdown 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 >> v1:172.21.15.171:6792/0 conn(0x7f640c06ef70 legacy=0x7f640c1cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 shutdown_connections 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 >> 172.21.15.171:0/3266771671 conn(0x7f640c0a2690 msgr2=0x7f640c0a4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 shutdown_connections 2024-04-25T23:57:02.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.737+0000 7f6412422640 1 -- 172.21.15.171:0/3266771671 wait complete. 2024-04-25T23:57:02.733 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule create-simple bar default host 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 10 monclient: get_monmap_and_config 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 10 monclient: monmap: 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:02.873269+0000 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:02.873269+0000 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.854 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.855 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 1 Processor -- start 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 1 -- start start 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 10 monclient: init 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 10 monclient: _add_conns ranks=[4,3,2,0,1,5,7,6,8] 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.869+0000 7f21e85a1640 10 monclient(hunting): picked mon.noname-c con 0x7f21e006f950 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): picked mon.noname-g con 0x7f21e01378f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): picked mon.noname-b con 0x7f21e013b400 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e00a1e70 con 0x7f21e013b400 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e00714e0 con 0x7f21e01378f0 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e00717c0 con 0x7f21e006f950 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): authenticate will time out at 1073.580054s 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e5b3c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f21e01378f0 0x7f21e0139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:36392/0 (socket says 172.21.15.171:36392) 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e5b3c640 1 -- 172.21.15.171:0/4275695667 learned_addr learned my addr 172.21.15.171:0/4275695667 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 288738351 0 0) 0x7f21e00714e0 con 0x7f21e01378f0 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient(hunting): my global_id is 4953 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21cc003530 con 0x7f21e01378f0 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3814012192 0 0) 0x7f21cc003530 con 0x7f21e01378f0 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 >> v1:172.21.15.106:6791/0 conn(0x7f21e006f950 legacy=0x7f21e006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 >> v1:172.21.15.106:6790/0 conn(0x7f21e013b400 legacy=0x7f21e013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 monclient: found mon.noname-g 2024-04-25T23:57:02.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0071aa0 con 0x7f21e01378f0 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 5 monclient: authenticate success, global_id 4953 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21dc0017c0 con 0x7f21e01378f0 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: dump: 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.863 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21dc001ab0 con 0x7f21e01378f0 2024-04-25T23:57:02.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 1 -- 172.21.15.171:0/4275695667 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21dc004bf0 con 0x7f21e01378f0 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e533b640 10 monclient: dump: 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.865 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 4 set_mon_vals no callback set 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: shutdown 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- 172.21.15.171:0/4275695667 >> v1:172.21.15.171:6790/0 conn(0x7f21e01378f0 legacy=0x7f21e0139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- 172.21.15.171:0/4275695667 shutdown_connections 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- 172.21.15.171:0/4275695667 >> 172.21.15.171:0/4275695667 conn(0x7f21e00a2690 msgr2=0x7f21e00a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- 172.21.15.171:0/4275695667 shutdown_connections 2024-04-25T23:57:02.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- 172.21.15.171:0/4275695667 wait complete. 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: build_initial_monmap 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: monmap: 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:02.867 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 Processor -- start 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- start start 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: init 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: _add_conns ranks=[6,3,8,4,1,2,0,5,7] 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): picked mon.noname-d con 0x7f21e006f950 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): picked mon.noname-g con 0x7f21e01378f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): picked mon.noname-e con 0x7f21e013b400 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e0070760 con 0x7f21e01378f0 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e009ecf0 con 0x7f21e006f950 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21e0070b40 con 0x7f21e013b400 2024-04-25T23:57:02.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient(hunting): authenticate will time out at 1073.583160s 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e5b3c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f21e01378f0 0x7f21e009e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:36396/0 (socket says 172.21.15.171:36396) 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e5b3c640 1 -- 172.21.15.171:0/1727922334 learned_addr learned my addr 172.21.15.171:0/1727922334 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3019484405 0 0) 0x7f21e0071aa0 con 0x7f21e01378f0 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): my global_id is 4962 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21c4003530 con 0x7f21e01378f0 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2728263086 0 0) 0x7f21c4003530 con 0x7f21e01378f0 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21e0071aa0 con 0x7f21e01378f0 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21dc004b30 con 0x7f21e01378f0 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:02.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.870 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 833392618 0 0) 0x7f21e0071aa0 con 0x7f21e01378f0 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 >> v1:172.21.15.106:6793/0 conn(0x7f21e013b400 legacy=0x7f21e01d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 >> v1:172.21.15.106:6792/0 conn(0x7f21e006f950 legacy=0x7f21e009ded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 monclient: found mon.g 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21e0132d10 con 0x7f21e01378f0 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:02.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 5 monclient: authenticate success, global_id 4962 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: _renew_subs 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f21e0132470 con 0x7f21e01378f0 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: _renew_subs 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f21e0133130 con 0x7f21e01378f0 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21dc001c60 con 0x7f21e01378f0 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21dc0054e0 con 0x7f21e01378f0 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.873+0000 7f21e4b3a640 4 set_mon_vals no callback set 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21d6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21d6ffd640 10 monclient: dump: 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:02.872 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:02.873 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f21dc010280 con 0x7f21e01378f0 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21e85a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21e85a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21e85a1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(39..39 src has 1..39) ==== 3657+0+0 (unknown 709175337 0 0) 0x7f21dc044700 con 0x7f21e01378f0 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21e004f5b0 con 0x7f21e01378f0 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.877+0000 7f21e633d640 10 monclient: get_auth_request con 0x7f21c40378d0 auth_method 0 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.881+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f21e0070760 con 0x7f21e01378f0 2024-04-25T23:57:02.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.881+0000 7f21d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:02.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:02.881+0000 7f21d6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:03.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.045+0000 7f21e85a1640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}] 2024-04-25T23:57:03.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.045+0000 7f21e85a1640 10 monclient: _send_command 2 [{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}] 2024-04-25T23:57:03.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.045+0000 7f21e85a1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.045+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"} v 0) -- 0x7f21e013a2f0 con 0x7f21e01378f0 2024-04-25T23:57:03.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.233+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}]=0 v40) ==== 126+0+0 (unknown 3432132072 0 0) 0x7f21dc019580 con 0x7f21e01378f0 2024-04-25T23:57:03.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.233+0000 7f21d6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}] 2024-04-25T23:57:03.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.233+0000 7f21d6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:03.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.333+0000 7f21e85a1640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}] 2024-04-25T23:57:03.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.333+0000 7f21e85a1640 10 monclient: _send_command 3 [{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}] 2024-04-25T23:57:03.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.333+0000 7f21e85a1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.333+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"} v 0) -- 0x7f21e00008e0 con 0x7f21e01378f0 2024-04-25T23:57:03.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21d6ffd640 1 -- 172.21.15.171:0/1727922334 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}]=0 rule bar already exists v40) ==== 149+0+0 (unknown 1256885253 0 0) 0x7f21dc01de40 con 0x7f21e01378f0 2024-04-25T23:57:03.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21d6ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule create-simple", "name": "bar", "root": "default", "type": "host"}] 2024-04-25T23:57:03.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21d6ffd640 10 monclient: _finish_command 3 = system:0 rule bar already exists 2024-04-25T23:57:03.319 INFO:tasks.workunit.client.0.smithi171.stderr:rule bar already exists 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 >> v1:172.21.15.171:6812/722422047 conn(0x7f21c40378d0 legacy=0x7f21c4039d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 10 monclient: shutdown 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 >> v1:172.21.15.171:6790/0 conn(0x7f21e01378f0 legacy=0x7f21e009e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 shutdown_connections 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 >> 172.21.15.171:0/1727922334 conn(0x7f21e00a2690 msgr2=0x7f21e012e6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 shutdown_connections 2024-04-25T23:57:03.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.337+0000 7f21e85a1640 1 -- 172.21.15.171:0/1727922334 wait complete. 2024-04-25T23:57:03.336 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm-device-class all 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.469+0000 7fa834395640 10 monclient: get_monmap_and_config 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.469+0000 7fa834395640 10 monclient: build_initial_monmap 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.469+0000 7fa834395640 10 monclient: monmap: 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:03.473078+0000 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:03.473078+0000 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:03.454 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:03.455 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:03.455 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:03.455 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:03.455 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:03.455 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:03.455 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:03.455 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:03.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.469+0000 7fa834395640 1 Processor -- start 2024-04-25T23:57:03.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.469+0000 7fa834395640 1 -- start start 2024-04-25T23:57:03.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.469+0000 7fa834395640 10 monclient: init 2024-04-25T23:57:03.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.469+0000 7fa834395640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:03.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: _add_conns ranks=[6,2,3,0,8,1,7,5,4] 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): picked mon.noname-d con 0x7fa82c135bb0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): picked mon.noname-b con 0x7fa82c1356f0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): picked mon.noname-g con 0x7fa82c13c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0a1da0 con 0x7fa82c1356f0 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0a1fe0 con 0x7fa82c13c130 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c072720 con 0x7fa82c135bb0 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): authenticate will time out at 1074.180113s 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa832932640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fa82c13c130 0x7fa82c13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:36404/0 (socket says 172.21.15.171:36404) 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa832932640 1 -- 172.21.15.171:0/3045898392 learned_addr learned my addr 172.21.15.171:0/3045898392 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2784367021 0 0) 0x7fa82c0a1fe0 con 0x7fa82c13c130 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient(hunting): _negotiate 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:03.462 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient(hunting): my global_id is 4971 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa818003530 con 0x7fa82c13c130 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2086440311 0 0) 0x7fa818003530 con 0x7fa82c13c130 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 >> v1:172.21.15.106:6792/0 conn(0x7fa82c135bb0 legacy=0x7fa82c135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 >> v1:172.21.15.106:6790/0 conn(0x7fa82c1356f0 legacy=0x7fa82c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: _finish_hunting 0 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 monclient: found mon.noname-g 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c0a17f0 con 0x7fa82c13c130 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: _finish_auth 0 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: _check_auth_tickets 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:03.463 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa824001b40 con 0x7fa82c13c130 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: dump: 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.464 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 5 monclient: authenticate success, global_id 4971 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa824001e30 con 0x7fa82c13c130 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 4 set_mon_vals no callback set 2024-04-25T23:57:03.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 1 -- 172.21.15.171:0/3045898392 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa824004f70 con 0x7fa82c13c130 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa83112f640 10 monclient: dump: 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.466 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: shutdown 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- 172.21.15.171:0/3045898392 >> v1:172.21.15.171:6790/0 conn(0x7fa82c13c130 legacy=0x7fa82c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- 172.21.15.171:0/3045898392 shutdown_connections 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- 172.21.15.171:0/3045898392 >> 172.21.15.171:0/3045898392 conn(0x7fa82c0a2620 msgr2=0x7fa82c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- 172.21.15.171:0/3045898392 shutdown_connections 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- 172.21.15.171:0/3045898392 wait complete. 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: build_initial_monmap 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: monmap: 2024-04-25T23:57:03.467 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:03.468 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 Processor -- start 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- start start 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: init 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient: _add_conns ranks=[8,3,2,4,5,0,1,7,6] 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): picked mon.noname-e con 0x7fa82c1356f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): picked mon.noname-g con 0x7fa82c135bb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): picked mon.noname-b con 0x7fa82c13c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c071ef0 con 0x7fa82c13c130 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c131820 con 0x7fa82c135bb0 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa82c0719a0 con 0x7fa82c1356f0 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa834395640 10 monclient(hunting): authenticate will time out at 1074.183195s 2024-04-25T23:57:03.469 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa831930640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fa82c135bb0 0x7fa82c09da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:36406/0 (socket says 172.21.15.171:36406) 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa831930640 1 -- 172.21.15.171:0/3326097998 learned_addr learned my addr 172.21.15.171:0/3326097998 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3138380516 0 0) 0x7fa82c131820 con 0x7fa82c135bb0 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): my global_id is 4980 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa810003530 con 0x7fa82c135bb0 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1732231995 0 0) 0x7fa810003530 con 0x7fa82c135bb0 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa82c131820 con 0x7fa82c135bb0 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa81c001ae0 con 0x7fa82c135bb0 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:03.470 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.471 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3649390611 0 0) 0x7fa82c0a17f0 con 0x7fa82c13c130 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 10 monclient(hunting): my global_id is 4952 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa810003530 con 0x7fa82c13c130 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 404695302 0 0) 0x7fa82c131820 con 0x7fa82c135bb0 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.473+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 >> v1:172.21.15.106:6793/0 conn(0x7fa82c1356f0 legacy=0x7fa82c09d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 >> v1:172.21.15.106:6790/0 conn(0x7fa82c13c130 legacy=0x7fa82c09e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 1 monclient: found mon.g 2024-04-25T23:57:03.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa82c12f540 con 0x7fa82c135bb0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 5 monclient: authenticate success, global_id 4980 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 10 monclient: _renew_subs 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa82c135180 con 0x7fa82c135bb0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 10 monclient: _renew_subs 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa82c1d5bb0 con 0x7fa82c135bb0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa81c003950 con 0x7fa82c135bb0 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:03.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa81c003ec0 con 0x7fa82c135bb0 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa83092e640 4 set_mon_vals no callback set 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 10 monclient: dump: 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.474 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa81c004060 con 0x7fa82c135bb0 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa814005090 con 0x7fa82c135bb0 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(40..40 src has 1..40) ==== 3716+0+0 (unknown 2979015948 0 0) 0x7fa81c044540 con 0x7fa82c135bb0 2024-04-25T23:57:03.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.477+0000 7fa832131640 10 monclient: get_auth_request con 0x7fa810037840 auth_method 0 2024-04-25T23:57:03.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.481+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa81c015870 con 0x7fa82c135bb0 2024-04-25T23:57:03.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.481+0000 7fa822ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:03.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.481+0000 7fa822ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:03.564 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-25T23:57:03.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:57:03.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.649+0000 7fa834395640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["all"]}] 2024-04-25T23:57:03.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.649+0000 7fa834395640 10 monclient: _send_command 2 [{"prefix": "osd crush rm-device-class", "ids": ["all"]}] 2024-04-25T23:57:03.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.649+0000 7fa834395640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:03.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:03.649+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["all"]} v 0) -- 0x7fa814005380 con 0x7fa82c135bb0 2024-04-25T23:57:03.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient: get_monmap_and_config 2024-04-25T23:57:03.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient: build_initial_monmap 2024-04-25T23:57:03.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient: monmap: 2024-04-25T23:57:03.693 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:03.693 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.693 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:03.712692+0000 2024-04-25T23:57:03.693 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:03.712692+0000 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:03.694 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 1 Processor -- start 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 1 -- start start 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient: init 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient: _add_conns ranks=[1,4,7,0,8,5,6,2,3] 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient(hunting): picked mon.noname-f con 0x7f6780135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient(hunting): picked mon.noname-c con 0x7f67801353b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient(hunting): picked mon.noname-i con 0x7f678013bdf0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678006f2d0 con 0x7f6780135870 2024-04-25T23:57:03.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6780072330 con 0x7f67801353b0 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6780072610 con 0x7f678013bdf0 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.707+0000 7f6787508640 10 monclient(hunting): authenticate will time out at 1079.239887s 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6784aa3640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f67801353b0 0x7f678013a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50752/0 (socket says 172.21.15.106:50752) 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6784aa3640 1 -- 172.21.15.106:0/657838929 learned_addr learned my addr 172.21.15.106:0/657838929 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1716909803 0 0) 0x7f6780072330 con 0x7f67801353b0 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient(hunting): my global_id is 134230 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f676c003530 con 0x7f67801353b0 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2673251671 0 0) 0x7f676c003530 con 0x7f67801353b0 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 >> v1:172.21.15.171:6792/0 conn(0x7f678013bdf0 legacy=0x7f678013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 >> v1:172.21.15.171:6789/0 conn(0x7f6780135870 legacy=0x7f6780135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 monclient: found mon.noname-c 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67800a3260 con 0x7f67801353b0 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67700017c0 con 0x7f67801353b0 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: dump: 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.703 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 5 monclient: authenticate success, global_id 134230 2024-04-25T23:57:03.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6770001ab0 con 0x7f67801353b0 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 1 -- 172.21.15.106:0/657838929 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6770004bf0 con 0x7f67801353b0 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 4 set_mon_vals no callback set 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6777fff640 10 monclient: dump: 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: shutdown 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- 172.21.15.106:0/657838929 >> v1:172.21.15.106:6791/0 conn(0x7f67801353b0 legacy=0x7f678013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- 172.21.15.106:0/657838929 shutdown_connections 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- 172.21.15.106:0/657838929 >> 172.21.15.106:0/657838929 conn(0x7f67800a64e0 msgr2=0x7f67800a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:03.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- 172.21.15.106:0/657838929 shutdown_connections 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- 172.21.15.106:0/657838929 wait complete. 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: build_initial_monmap 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: monmap: 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:03.707 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 Processor -- start 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- start start 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: init 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: _add_conns ranks=[7,1,2,6,4,3,0,5,8] 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient(hunting): picked mon.noname-i con 0x7f67801353b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient(hunting): picked mon.noname-f con 0x7f6780135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient(hunting): picked mon.noname-b con 0x7f678013bdf0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678009e730 con 0x7f6780135870 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6780131c80 con 0x7f678013bdf0 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6780131f60 con 0x7f67801353b0 2024-04-25T23:57:03.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient(hunting): authenticate will time out at 1079.242807s 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6785aa5640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f678013bdf0 0x7f67801d23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48922/0 (socket says 172.21.15.106:48922) 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6785aa5640 1 -- 172.21.15.106:0/785654008 learned_addr learned my addr 172.21.15.106:0/785654008 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955842404 0 0) 0x7f6780131c80 con 0x7f678013bdf0 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): my global_id is 4961 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6764003530 con 0x7f678013bdf0 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1312179234 0 0) 0x7f6764003530 con 0x7f678013bdf0 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6780131c80 con 0x7f678013bdf0 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6778001cc0 con 0x7f678013bdf0 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:03.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.710 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3774246004 0 0) 0x7f678009e730 con 0x7f6780135870 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): my global_id is 134281 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6764003530 con 0x7f6780135870 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4255263953 0 0) 0x7f6780131f60 con 0x7f67801353b0 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient(hunting): my global_id is 134287 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f678009e730 con 0x7f67801353b0 2024-04-25T23:57:03.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1666822479 0 0) 0x7f6780131c80 con 0x7f678013bdf0 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 >> v1:172.21.15.171:6792/0 conn(0x7f67801353b0 legacy=0x7f67801c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 >> v1:172.21.15.171:6789/0 conn(0x7f6780135870 legacy=0x7f6780134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 monclient: found mon.b 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6780132240 con 0x7f678013bdf0 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 5 monclient: authenticate success, global_id 4961 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: _renew_subs 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6780135170 con 0x7f678013bdf0 2024-04-25T23:57:03.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: _renew_subs 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f67801c7620 con 0x7f678013bdf0 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6778002080 con 0x7f678013bdf0 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f6775ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.711+0000 7f67777fe640 4 set_mon_vals no callback set 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6778004010 con 0x7f678013bdf0 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6775ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6775ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6775ffb640 10 monclient: dump: 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:03.713 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6787508640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6787508640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:03.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6787508640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6778004230 con 0x7f678013bdf0 2024-04-25T23:57:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6760005090 con 0x7f678013bdf0 2024-04-25T23:57:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(40..40 src has 1..40) ==== 3716+0+0 (unknown 2979015948 0 0) 0x7f67780446d0 con 0x7f678013bdf0 2024-04-25T23:57:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.715+0000 7f67852a4640 10 monclient: get_auth_request con 0x7f6764037930 auth_method 0 2024-04-25T23:57:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.719+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6778015a60 con 0x7f678013bdf0 2024-04-25T23:57:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.719+0000 7f6775ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:03.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.719+0000 7f6775ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:03.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.939+0000 7f6787508640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:57:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.939+0000 7f6787508640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.939+0000 7f6787508640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.939+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6760005380 con 0x7f678013bdf0 2024-04-25T23:57:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.939+0000 7f6775ffb640 1 -- 172.21.15.106:0/785654008 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1938607898) 0x7f6778019710 con 0x7f678013bdf0 2024-04-25T23:57:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.939+0000 7f6775ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:03.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.939+0000 7f6775ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:03.927 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":20,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:57:03.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 >> v1:172.21.15.171:6812/722422047 conn(0x7f6764037930 legacy=0x7f6764039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 10 monclient: shutdown 2024-04-25T23:57:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 >> v1:172.21.15.106:6790/0 conn(0x7f678013bdf0 legacy=0x7f67801d23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 shutdown_connections 2024-04-25T23:57:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 >> 172.21.15.106:0/785654008 conn(0x7f67800a64e0 msgr2=0x7f67800a2130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 shutdown_connections 2024-04-25T23:57:03.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:03.943+0000 7f6787508640 1 -- 172.21.15.106:0/785654008 wait complete. 2024-04-25T23:57:03.944 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-25T23:57:03.944 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-25T23:57:03.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-25T23:57:03.944 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient: get_monmap_and_config 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient: monmap: 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:04.084279+0000 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:04.084279+0000 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.065 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.066 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.066 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 1 Processor -- start 2024-04-25T23:57:04.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 1 -- start start 2024-04-25T23:57:04.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient: init 2024-04-25T23:57:04.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient: _add_conns ranks=[2,1,4,0,5,8,6,7,3] 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient(hunting): picked mon.noname-b con 0x7fb3440a5030 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient(hunting): picked mon.noname-f con 0x7fb344072710 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient(hunting): picked mon.noname-c con 0x7fb344072b70 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb344137d60 con 0x7fb344072710 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb344138550 con 0x7fb3440a5030 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34406cf60 con 0x7fb344072b70 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.079+0000 7fb34c599640 10 monclient(hunting): authenticate will time out at 1079.611957s 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34a335640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb3440a5030 0x7fb344137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48928/0 (socket says 172.21.15.106:48928) 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34a335640 1 -- 172.21.15.106:0/783047848 learned_addr learned my addr 172.21.15.106:0/783047848 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34ab36640 1 --1- 172.21.15.106:0/783047848 >> v1:172.21.15.106:6791/0 conn(0x7fb344072b70 0x7fb3441400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50762/0 (socket says 172.21.15.106:50762) 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2947716036 0 0) 0x7fb34406cf60 con 0x7fb344072b70 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): my global_id is 134239 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb330003530 con 0x7fb344072b70 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453658640 0 0) 0x7fb344138550 con 0x7fb3440a5030 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient(hunting): my global_id is 4970 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34406cf60 con 0x7fb3440a5030 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2116722948 0 0) 0x7fb34406cf60 con 0x7fb3440a5030 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 >> v1:172.21.15.106:6791/0 conn(0x7fb344072b70 legacy=0x7fb3441400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 >> v1:172.21.15.171:6789/0 conn(0x7fb344072710 legacy=0x7fb34413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 monclient: found mon.noname-b 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34406e240 con 0x7fb3440a5030 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3400017c0 con 0x7fb3440a5030 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: dump: 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.075 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 5 monclient: authenticate success, global_id 4970 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb3400019b0 con 0x7fb3440a5030 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 1 -- 172.21.15.106:0/783047848 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb340004bf0 con 0x7fb3440a5030 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb349333640 10 monclient: dump: 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.077 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 4 set_mon_vals no callback set 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: shutdown 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- 172.21.15.106:0/783047848 >> v1:172.21.15.106:6790/0 conn(0x7fb3440a5030 legacy=0x7fb344137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- 172.21.15.106:0/783047848 shutdown_connections 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- 172.21.15.106:0/783047848 >> 172.21.15.106:0/783047848 conn(0x7fb3440a83a0 msgr2=0x7fb3440a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- 172.21.15.106:0/783047848 shutdown_connections 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- 172.21.15.106:0/783047848 wait complete. 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: monmap: 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.079 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 Processor -- start 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- start start 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: init 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: _add_conns ranks=[6,1,4,8,5,3,0,7,2] 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient(hunting): picked mon.noname-d con 0x7fb344072710 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient(hunting): picked mon.noname-f con 0x7fb344072b70 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient(hunting): picked mon.noname-c con 0x7fb3440a5030 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34406d4c0 con 0x7fb344072b70 2024-04-25T23:57:04.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34413e0d0 con 0x7fb3440a5030 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3441403c0 con 0x7fb344072710 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient(hunting): authenticate will time out at 1079.614947s 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34a335640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb344072710 0x7fb3441363e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38822/0 (socket says 172.21.15.106:38822) 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34ab36640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fb3440a5030 0x7fb3441d42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50774/0 (socket says 172.21.15.106:50774) 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34a335640 1 -- 172.21.15.106:0/4136298714 learned_addr learned my addr 172.21.15.106:0/4136298714 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171011898 0 0) 0x7fb3441403c0 con 0x7fb344072710 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): my global_id is 4920 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb328003530 con 0x7fb344072710 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905136772 0 0) 0x7fb34413e0d0 con 0x7fb3440a5030 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): my global_id is 134248 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3441403c0 con 0x7fb3440a5030 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1245918901 0 0) 0x7fb328003530 con 0x7fb344072710 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb34413e0d0 con 0x7fb344072710 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746894372 0 0) 0x7fb344137d60 con 0x7fb344072b70 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): my global_id is 134299 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb328003530 con 0x7fb344072b70 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 748274812 0 0) 0x7fb3441403c0 con 0x7fb3440a5030 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb344137d60 con 0x7fb3440a5030 2024-04-25T23:57:04.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3400047f0 con 0x7fb344072710 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): dump: 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.083 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb33c001730 con 0x7fb3440a5030 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient(hunting): dump: 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.084 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3447738963 0 0) 0x7fb34413e0d0 con 0x7fb344072710 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.106:6791/0 conn(0x7fb3440a5030 legacy=0x7fb3441d42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.171:6789/0 conn(0x7fb344072b70 legacy=0x7fb3441c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 monclient: found mon.d 2024-04-25T23:57:04.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb344136af0 con 0x7fb344072710 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb33affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 5 monclient: authenticate success, global_id 4920 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: _renew_subs 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3441c9100 con 0x7fb344072710 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: _renew_subs 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.083+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb3441d5bc0 con 0x7fb344072710 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb340004ea0 con 0x7fb344072710 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb340005390 con 0x7fb344072710 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb348b32640 4 set_mon_vals no callback set 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: dump: 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.088 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb340010130 con 0x7fb344072710 2024-04-25T23:57:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb34c599640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb32c0065d0 con 0x7fb32c002870 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(40..40 src has 1..40) ==== 3716+0+0 (unknown 2979015948 0 0) 0x7fb340044540 con 0x7fb344072710 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 289959166 0 0) 0x7fb32c0065d0 con 0x7fb32c002870 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient(hunting): my global_id is 4932 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34413e0d0 con 0x7fb32c002870 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb34ab36640 10 monclient: get_auth_request con 0x7fb328037fb0 auth_method 0 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4014148598 0 0) 0x7fb34413e0d0 con 0x7fb32c002870 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb32c0065d0 con 0x7fb32c002870 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb334001980 con 0x7fb32c002870 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:04.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: dump: 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.092 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4289484800 0 0) 0x7fb32c0065d0 con 0x7fb32c002870 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb32c00a160 con 0x7fb32c002870 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb334004650 con 0x7fb32c002870 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.106:6789/0 conn(0x7fb32c002870 legacy=0x7fb32c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.087+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.106:6789/0 conn(0x7fb32c002870 legacy=0x7fb32c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.091+0000 7fb34c599640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.091+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb32c009e30 con 0x7fb32c0090f0 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301242900 0 0) 0x7fb32c009e30 con 0x7fb32c0090f0 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient(hunting): my global_id is 4941 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb32c0065d0 con 0x7fb32c0090f0 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2126652343 0 0) 0x7fb32c0065d0 con 0x7fb32c0090f0 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb32c009e30 con 0x7fb32c0090f0 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb334003c30 con 0x7fb32c0090f0 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient: dump: 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.094 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2218646090 0 0) 0x7fb32c009e30 con 0x7fb32c0090f0 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb32c00c3a0 con 0x7fb32c0090f0 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 2158685266) 0x7fb334003ea0 con 0x7fb32c0090f0 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.106:6789/0 conn(0x7fb32c0090f0 legacy=0x7fb32c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb33affd640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.106:6789/0 conn(0x7fb32c0090f0 legacy=0x7fb32c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 142654, 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:04.096 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.097 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.098 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:04.099 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:04.100 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:04.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.102 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:04.104 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:04.106 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.108 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:04.110 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.112 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.114 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:04.114 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.171:6812/722422047 conn(0x7fb328037fb0 legacy=0x7fb32803a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 10 monclient: shutdown 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 >> v1:172.21.15.106:6792/0 conn(0x7fb344072710 legacy=0x7fb3441363e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34ab36640 1 -- 172.21.15.106:0/4136298714 reap_dead start 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34ab36640 1 -- 172.21.15.106:0/4136298714 reap_dead start 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 shutdown_connections 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 >> 172.21.15.106:0/4136298714 conn(0x7fb3440a83a0 msgr2=0x7fb344140cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 shutdown_connections 2024-04-25T23:57:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.095+0000 7fb34c599640 1 -- 172.21.15.106:0/4136298714 wait complete. 2024-04-25T23:57:04.116 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:04.116 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-25T23:57:04.116 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:57:04.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:04.245+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["all"]}]=0 done removing class of osd(s): 0,1,2,3,4,5 v41) ==== 131+0+0 (unknown 961951500 0 0) 0x7fa81c015170 con 0x7fa82c135bb0 2024-04-25T23:57:04.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:04.249+0000 7fa822ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm-device-class", "ids": ["all"]}] 2024-04-25T23:57:04.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:04.249+0000 7fa822ffd640 10 monclient: _finish_command 2 = system:0 done removing class of osd(s): 0,1,2,3,4,5 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient: get_monmap_and_config 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient: monmap: 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:04.251737+0000 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:04.251737+0000 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.232 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 1 Processor -- start 2024-04-25T23:57:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 1 -- start start 2024-04-25T23:57:04.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient: init 2024-04-25T23:57:04.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient: _add_conns ranks=[2,3,7,6,4,0,1,5,8] 2024-04-25T23:57:04.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient(hunting): picked mon.noname-b con 0x7ff3740a1bc0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:04.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient(hunting): picked mon.noname-g con 0x7ff3740a26b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:04.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient(hunting): picked mon.noname-i con 0x7ff3740a0240 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:04.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff374072f40 con 0x7ff3740a1bc0 2024-04-25T23:57:04.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37409b160 con 0x7ff3740a26b0 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37409be20 con 0x7ff3740a0240 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff379241640 10 monclient(hunting): authenticate will time out at 1079.779702s 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff372d9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7ff3740a1bc0 0x7ff3740a1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48934/0 (socket says 172.21.15.106:48934) 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.247+0000 7ff372d9d640 1 -- 172.21.15.106:0/178387616 learned_addr learned my addr 172.21.15.106:0/178387616 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3262796124 0 0) 0x7ff374072f40 con 0x7ff3740a1bc0 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): my global_id is 4979 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff35c003530 con 0x7ff3740a1bc0 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160206068 0 0) 0x7ff37409be20 con 0x7ff3740a0240 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient(hunting): my global_id is 134296 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff374072f40 con 0x7ff3740a0240 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 766922356 0 0) 0x7ff35c003530 con 0x7ff3740a1bc0 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 >> v1:172.21.15.171:6792/0 conn(0x7ff3740a0240 legacy=0x7ff37413e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 >> v1:172.21.15.171:6790/0 conn(0x7ff3740a26b0 legacy=0x7ff37413a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 monclient: found mon.noname-b 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37406c420 con 0x7ff3740a1bc0 2024-04-25T23:57:04.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff3640017c0 con 0x7ff3740a1bc0 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: dump: 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.245 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 5 monclient: authenticate success, global_id 4979 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:04.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff364001ae0 con 0x7ff3740a1bc0 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 1 -- 172.21.15.106:0/178387616 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff364004bf0 con 0x7ff3740a1bc0 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff371d9b640 10 monclient: dump: 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.247 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 4 set_mon_vals no callback set 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: shutdown 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- 172.21.15.106:0/178387616 >> v1:172.21.15.106:6790/0 conn(0x7ff3740a1bc0 legacy=0x7ff3740a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- 172.21.15.106:0/178387616 shutdown_connections 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- 172.21.15.106:0/178387616 >> 172.21.15.106:0/178387616 conn(0x7ff37406b210 msgr2=0x7ff37406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- 172.21.15.106:0/178387616 shutdown_connections 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- 172.21.15.106:0/178387616 wait complete. 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: monmap: 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.249 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 Processor -- start 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- start start 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: init 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: _add_conns ranks=[8,7,2,4,5,0,6,3,1] 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient(hunting): picked mon.noname-e con 0x7ff3740a0240 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient(hunting): picked mon.noname-i con 0x7ff3740a1bc0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient(hunting): picked mon.noname-b con 0x7ff3740a26b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37409e4d0 con 0x7ff3740a26b0 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff374072c30 con 0x7ff3740a1bc0 2024-04-25T23:57:04.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff37409f2e0 con 0x7ff3740a0240 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient(hunting): authenticate will time out at 1079.782587s 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff372d9d640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7ff3740a0240 0x7ff37409d6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:43850/0 (socket says 172.21.15.106:43850) 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff372d9d640 1 -- 172.21.15.106:0/2711919598 learned_addr learned my addr 172.21.15.106:0/2711919598 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff37359e640 1 --1- 172.21.15.106:0/2711919598 >> v1:172.21.15.106:6790/0 conn(0x7ff3740a26b0 0x7ff3741d4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48942/0 (socket says 172.21.15.106:48942) 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1917087299 0 0) 0x7ff37409f2e0 con 0x7ff3740a0240 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): my global_id is 134234 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff360003530 con 0x7ff3740a0240 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721132381 0 0) 0x7ff37409e4d0 con 0x7ff3740a26b0 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): my global_id is 4988 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff37409f2e0 con 0x7ff3740a26b0 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054672415 0 0) 0x7ff374072c30 con 0x7ff3740a1bc0 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): my global_id is 134305 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff37409e4d0 con 0x7ff3740a1bc0 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2215958553 0 0) 0x7ff360003530 con 0x7ff3740a0240 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff374072c30 con 0x7ff3740a0240 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff364004b30 con 0x7ff3740a0240 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): dump: 2024-04-25T23:57:04.252 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.253 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 680329290 0 0) 0x7ff374072c30 con 0x7ff3740a0240 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.171:6792/0 conn(0x7ff3740a1bc0 legacy=0x7ff37409ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.106:6790/0 conn(0x7ff3740a26b0 legacy=0x7ff3741d4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 monclient: found mon.e 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff37413d080 con 0x7ff3740a0240 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 5 monclient: authenticate success, global_id 134234 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: _renew_subs 2024-04-25T23:57:04.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff37413d920 con 0x7ff3740a0240 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: _renew_subs 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff37413c190 con 0x7ff3740a0240 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff364001ae0 con 0x7ff3740a0240 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff364001c90 con 0x7ff3740a0240 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff37159a640 4 set_mon_vals no callback set 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.251+0000 7ff35b7fe640 10 monclient: dump: 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.255 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff379241640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff3540065d0 con 0x7ff354002870 2024-04-25T23:57:04.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff3640100f0 con 0x7ff3740a0240 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(41..41 src has 1..41) ==== 3412+0+0 (unknown 2101141767 0 0) 0x7ff364044580 con 0x7ff3740a0240 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723609016 0 0) 0x7ff3540065d0 con 0x7ff354002870 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient(hunting): my global_id is 4997 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff374072c30 con 0x7ff354002870 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff37359e640 10 monclient: get_auth_request con 0x7ff360037890 auth_method 0 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 184096044 0 0) 0x7ff374072c30 con 0x7ff354002870 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3540065d0 con 0x7ff354002870 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff368001790 con 0x7ff354002870 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient: dump: 2024-04-25T23:57:04.257 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.258 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3842114995 0 0) 0x7ff3540065d0 con 0x7ff354002870 2024-04-25T23:57:04.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff35400a160 con 0x7ff354002870 2024-04-25T23:57:04.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff368001bc0 con 0x7ff354002870 2024-04-25T23:57:04.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:04.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.106:6790/0 conn(0x7ff354002870 legacy=0x7ff354004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.255+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.106:6790/0 conn(0x7ff354002870 legacy=0x7ff354004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff379241640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:04.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff354009e50 con 0x7ff354009110 2024-04-25T23:57:04.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564131272 0 0) 0x7ff354009e50 con 0x7ff354009110 2024-04-25T23:57:04.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff35b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff35b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff35b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff35b7fe640 10 monclient(hunting): my global_id is 5006 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.259+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3540065d0 con 0x7ff354009110 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3187668999 0 0) 0x7ff3540065d0 con 0x7ff354009110 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff354009e50 con 0x7ff354009110 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff368003b30 con 0x7ff354009110 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 10 monclient: dump: 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.261 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1197050072 0 0) 0x7ff354009e50 con 0x7ff354009110 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff35400c3e0 con 0x7ff354009110 2024-04-25T23:57:04.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 689394155) 0x7ff368005040 con 0x7ff354009110 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.106:6790/0 conn(0x7ff354009110 legacy=0x7ff3540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff35b7fe640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.106:6790/0 conn(0x7ff354009110 legacy=0x7ff3540095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 142826, 2024-04-25T23:57:04.263 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:04.264 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.265 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:04.266 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:04.267 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.268 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.272 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.273 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:04.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.278 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.280 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.281 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:04.282 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.171:6812/722422047 conn(0x7ff360037890 legacy=0x7ff360039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 10 monclient: shutdown 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 >> v1:172.21.15.106:6793/0 conn(0x7ff3740a0240 legacy=0x7ff37409d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff37359e640 1 -- 172.21.15.106:0/2711919598 reap_dead start 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff37359e640 1 -- 172.21.15.106:0/2711919598 reap_dead start 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 shutdown_connections 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 >> 172.21.15.106:0/2711919598 conn(0x7ff37406b210 msgr2=0x7ff3741369d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 shutdown_connections 2024-04-25T23:57:04.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.263+0000 7ff379241640 1 -- 172.21.15.106:0/2711919598 wait complete. 2024-04-25T23:57:04.285 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:04.285 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-25T23:57:04.285 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-25T23:57:04.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:04.349+0000 7fa834395640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["all"]}] 2024-04-25T23:57:04.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:04.349+0000 7fa834395640 10 monclient: _send_command 3 [{"prefix": "osd crush rm-device-class", "ids": ["all"]}] 2024-04-25T23:57:04.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:04.349+0000 7fa834395640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:04.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:04.349+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["all"]} v 0) -- 0x7fa814002220 con 0x7fa82c135bb0 2024-04-25T23:57:04.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 10 monclient: get_monmap_and_config 2024-04-25T23:57:04.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 10 monclient: monmap: 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:04.420958+0000 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:04.420958+0000 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.402 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.403 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 1 Processor -- start 2024-04-25T23:57:04.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 1 -- start start 2024-04-25T23:57:04.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 10 monclient: init 2024-04-25T23:57:04.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.415+0000 7f5af44fa640 10 monclient: _add_conns ranks=[4,0,6,5,8,3,2,1,7] 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): picked mon.noname-c con 0x7f5aec134820 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): picked mon.noname-a con 0x7f5aec0725d0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): picked mon.noname-d con 0x7f5aec13ace0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec071270 con 0x7f5aec0725d0 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec0714e0 con 0x7f5aec134820 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec0729f0 con 0x7f5aec13ace0 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): authenticate will time out at 1079.948101s 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af2296640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f5aec134820 0x7f5aec134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50790/0 (socket says 172.21.15.106:50790) 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af2a97640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5aec13ace0 0x7f5aec13d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38826/0 (socket says 172.21.15.106:38826) 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af2296640 1 -- 172.21.15.106:0/3443583883 learned_addr learned my addr 172.21.15.106:0/3443583883 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440394889 0 0) 0x7f5adc0014a0 con 0x7f5aec134820 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): my global_id is 134257 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ad4003530 con 0x7f5aec134820 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1047084161 0 0) 0x7f5aec0729f0 con 0x7f5aec13ace0 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): my global_id is 4929 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5adc0014a0 con 0x7f5aec13ace0 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1336150535 0 0) 0x7f5aec071270 con 0x7f5aec0725d0 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient(hunting): my global_id is 4950 2024-04-25T23:57:04.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aec0729f0 con 0x7f5aec0725d0 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2154811642 0 0) 0x7f5ad4003530 con 0x7f5aec134820 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 >> v1:172.21.15.106:6792/0 conn(0x7f5aec13ace0 legacy=0x7f5aec13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 >> v1:172.21.15.106:6789/0 conn(0x7f5aec0725d0 legacy=0x7f5aec1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 monclient: found mon.noname-c 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec0717c0 con 0x7f5aec134820 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5adc001d10 con 0x7f5aec134820 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:57:04.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: dump: 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 5 monclient: authenticate success, global_id 134257 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5adc001fb0 con 0x7f5aec134820 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 1 -- 172.21.15.106:0/3443583883 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5adc004f70 con 0x7f5aec134820 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 4 set_mon_vals no callback set 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1294640 10 monclient: dump: 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.415 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient: shutdown 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- 172.21.15.106:0/3443583883 >> v1:172.21.15.106:6791/0 conn(0x7f5aec134820 legacy=0x7f5aec134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- 172.21.15.106:0/3443583883 shutdown_connections 2024-04-25T23:57:04.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- 172.21.15.106:0/3443583883 >> 172.21.15.106:0/3443583883 conn(0x7f5aec0a64e0 msgr2=0x7f5aec0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- 172.21.15.106:0/3443583883 shutdown_connections 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- 172.21.15.106:0/3443583883 wait complete. 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient: monmap: 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.417 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 Processor -- start 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- start start 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient: init 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient: _add_conns ranks=[8,4,0,2,6,7,1,3,5] 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): picked mon.noname-e con 0x7f5aec0725d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): picked mon.noname-c con 0x7f5aec134820 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): picked mon.noname-a con 0x7f5aec13ace0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec1278e0 con 0x7f5aec13ace0 2024-04-25T23:57:04.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec072c60 con 0x7f5aec134820 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5aec0706a0 con 0x7f5aec0725d0 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af44fa640 10 monclient(hunting): authenticate will time out at 1079.951462s 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1a95640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f5aec134820 0x7f5aec1cf930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50798/0 (socket says 172.21.15.106:50798) 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5af1a95640 1 -- 172.21.15.106:0/1891595215 learned_addr learned my addr 172.21.15.106:0/1891595215 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3139881285 0 0) 0x7f5aec072c60 con 0x7f5aec134820 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): my global_id is 134266 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ad8003530 con 0x7f5aec134820 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366239771 0 0) 0x7f5aec0706a0 con 0x7f5aec0725d0 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): my global_id is 134243 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aec072c60 con 0x7f5aec0725d0 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 101627185 0 0) 0x7f5aec1278e0 con 0x7f5aec13ace0 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 10 monclient(hunting): my global_id is 4959 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.419+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aec0706a0 con 0x7f5aec13ace0 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2414898904 0 0) 0x7f5ad8003530 con 0x7f5aec134820 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5aec1278e0 con 0x7f5aec134820 2024-04-25T23:57:04.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ae0001680 con 0x7f5aec134820 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): dump: 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.421 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 700741414 0 0) 0x7f5aec0706a0 con 0x7f5aec13ace0 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ad8003530 con 0x7f5aec13ace0 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ae4001940 con 0x7f5aec13ace0 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): dump: 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.422 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1803421868 0 0) 0x7f5aec072c60 con 0x7f5aec0725d0 2024-04-25T23:57:04.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5aec0706a0 con 0x7f5aec0725d0 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5adc001d10 con 0x7f5aec0725d0 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): dump: 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.424 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3250060931 0 0) 0x7f5aec1278e0 con 0x7f5aec134820 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.106:6793/0 conn(0x7f5aec0725d0 legacy=0x7f5aec1ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.106:6789/0 conn(0x7f5aec13ace0 legacy=0x7f5aec1d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 monclient: found mon.c 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5aec129450 con 0x7f5aec134820 2024-04-25T23:57:04.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 5 monclient: authenticate success, global_id 134266 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 10 monclient: _renew_subs 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5aec129730 con 0x7f5aec134820 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ae00038b0 con 0x7f5aec134820 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ae0003e20 con 0x7f5aec134820 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af0a93640 4 set_mon_vals no callback set 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: dump: 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.426 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.427 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 10 monclient: _renew_subs 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5aec129b50 con 0x7f5aec134820 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5aec126cb0 con 0x7f5aec1268d0 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5ae0004040 con 0x7f5aec134820 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(41..41 src has 1..41) ==== 3412+0+0 (unknown 2101141767 0 0) 0x7f5ae00443a0 con 0x7f5aec134820 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769117362 0 0) 0x7f5aec126cb0 con 0x7f5aec1268d0 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient(hunting): my global_id is 134275 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aec1278e0 con 0x7f5aec1268d0 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1368239153 0 0) 0x7f5aec1278e0 con 0x7f5aec1268d0 2024-04-25T23:57:04.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5aec126cb0 con 0x7f5aec1268d0 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5adc004f40 con 0x7f5aec1268d0 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: dump: 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.429 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5af2a97640 10 monclient: get_auth_request con 0x7f5ad80381a0 auth_method 0 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2891358419 0 0) 0x7f5aec126cb0 con 0x7f5aec1268d0 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5aec13e7c0 con 0x7f5aec1268d0 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5adc007310 con 0x7f5aec1268d0 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.106:6791/0 conn(0x7f5aec1268d0 legacy=0x7f5aec12a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.423+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.106:6791/0 conn(0x7f5aec1268d0 legacy=0x7f5aec12a350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:04.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5aec075890 con 0x7f5aec1cb090 2024-04-25T23:57:04.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603860981 0 0) 0x7f5aec075890 con 0x7f5aec1cb090 2024-04-25T23:57:04.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient(hunting): my global_id is 134284 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5aec126cb0 con 0x7f5aec1cb090 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3722418916 0 0) 0x7f5aec126cb0 con 0x7f5aec1cb090 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5aec075890 con 0x7f5aec1cb090 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5adc005650 con 0x7f5aec1cb090 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient: dump: 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.433 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 320685539 0 0) 0x7f5aec075890 con 0x7f5aec1cb090 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5aec062e50 con 0x7f5aec1cb090 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 4099401694) 0x7f5adc009da0 con 0x7f5aec1cb090 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:04.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.106:6791/0 conn(0x7f5aec1cb090 legacy=0x7f5aec12aa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5aeaffd640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.106:6791/0 conn(0x7f5aec1cb090 legacy=0x7f5aec12aa60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 12411, 2024-04-25T23:57:04.435 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:04.436 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.437 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:04.438 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.439 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.440 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.441 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.444 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:04.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.447 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:04.451 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.452 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:04.453 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.171:6812/722422047 conn(0x7f5ad80381a0 legacy=0x7f5ad803a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 10 monclient: shutdown 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 >> v1:172.21.15.106:6791/0 conn(0x7f5aec134820 legacy=0x7f5aec1cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af2a97640 1 -- 172.21.15.106:0/1891595215 reap_dead start 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af2a97640 1 -- 172.21.15.106:0/1891595215 reap_dead start 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 shutdown_connections 2024-04-25T23:57:04.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 >> 172.21.15.106:0/1891595215 conn(0x7f5aec0a64e0 msgr2=0x7f5aec124360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 shutdown_connections 2024-04-25T23:57:04.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.431+0000 7f5af44fa640 1 -- 172.21.15.106:0/1891595215 wait complete. 2024-04-25T23:57:04.455 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:04.455 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-25T23:57:04.455 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: get_monmap_and_config 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: monmap: 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:04.590582+0000 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:04.590582+0000 2024-04-25T23:57:04.571 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.572 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 Processor -- start 2024-04-25T23:57:04.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- start start 2024-04-25T23:57:04.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: init 2024-04-25T23:57:04.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: _add_conns ranks=[4,0,5,1,2,3,8,6,7] 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient(hunting): picked mon.noname-c con 0x7f3590072170 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient(hunting): picked mon.noname-a con 0x7f359006c610 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient(hunting): picked mon.noname-h con 0x7f359006ca30 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3590068070 con 0x7f359006c610 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35900a3f60 con 0x7f3590072170 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35900a41c0 con 0x7f359006ca30 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient(hunting): authenticate will time out at 1080.117758s 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f359006c610 0x7f359013cb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39848/0 (socket says 172.21.15.106:39848) 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358ffff640 1 -- 172.21.15.106:0/1761173993 learned_addr learned my addr 172.21.15.106:0/1761173993 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035117368 0 0) 0x7f3590068070 con 0x7f359006c610 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): my global_id is 4968 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f357c003530 con 0x7f359006c610 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500967672 0 0) 0x7f35900a3f60 con 0x7f3590072170 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient(hunting): my global_id is 134293 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3590068070 con 0x7f3590072170 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2472367269 0 0) 0x7f357c003530 con 0x7f359006c610 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 >> v1:172.21.15.171:6791/0 conn(0x7f359006ca30 legacy=0x7f3590140280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 >> v1:172.21.15.106:6791/0 conn(0x7f3590072170 legacy=0x7f3590072550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 monclient: found mon.noname-a 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f359006e140 con 0x7f359006c610 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35780017c0 con 0x7f359006c610 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: dump: 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.583 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.584 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 5 monclient: authenticate success, global_id 4968 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3578001a70 con 0x7f359006c610 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 1 -- 172.21.15.106:0/1761173993 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3578004bf0 con 0x7f359006c610 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f358f7fe640 10 monclient: dump: 2024-04-25T23:57:04.585 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.586 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 4 set_mon_vals no callback set 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 10 monclient: shutdown 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- 172.21.15.106:0/1761173993 >> v1:172.21.15.106:6789/0 conn(0x7f359006c610 legacy=0x7f359013cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- 172.21.15.106:0/1761173993 shutdown_connections 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- 172.21.15.106:0/1761173993 >> 172.21.15.106:0/1761173993 conn(0x7f359006b210 msgr2=0x7f359006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- 172.21.15.106:0/1761173993 shutdown_connections 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.587+0000 7f3596c87640 1 -- 172.21.15.106:0/1761173993 wait complete. 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: monmap: 2024-04-25T23:57:04.587 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.588 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 Processor -- start 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 -- start start 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: init 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: _add_conns ranks=[8,1,5,3,6,7,2,0,4] 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient(hunting): picked mon.noname-e con 0x7f359006c610 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient(hunting): picked mon.noname-f con 0x7f359006ca30 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient(hunting): picked mon.noname-h con 0x7f3590072170 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35901cd6b0 con 0x7f359006ca30 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359006d930 con 0x7f3590072170 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f359006d3e0 con 0x7f359006c610 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient(hunting): authenticate will time out at 1080.120998s 2024-04-25T23:57:04.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3594a23640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f359006c610 0x7f35901cc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:43868/0 (socket says 172.21.15.106:43868) 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3594a23640 1 -- 172.21.15.106:0/1860203975 learned_addr learned my addr 172.21.15.106:0/1860203975 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1164094338 0 0) 0x7f359006d3e0 con 0x7f359006c610 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): my global_id is 134252 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3570003560 con 0x7f359006c610 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1263030606 0 0) 0x7f3570003560 con 0x7f359006c610 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f359006d3e0 con 0x7f359006c610 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3588001d80 con 0x7f359006c610 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:57:04.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): dump: 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121380340 0 0) 0x7f359006d930 con 0x7f3590072170 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): my global_id is 5027 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3570003560 con 0x7f3590072170 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275586869 0 0) 0x7f35901cd6b0 con 0x7f359006ca30 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): my global_id is 134308 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f359006d930 con 0x7f359006ca30 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 955329741 0 0) 0x7f359006d3e0 con 0x7f359006c610 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.171:6791/0 conn(0x7f3590072170 legacy=0x7f35901d4af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.171:6789/0 conn(0x7f359006ca30 legacy=0x7f35901ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 monclient: found mon.e 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35901415e0 con 0x7f359006c610 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 5 monclient: authenticate success, global_id 134252 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: _renew_subs 2024-04-25T23:57:04.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3590122f80 con 0x7f359006c610 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: _renew_subs 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f3590123d00 con 0x7f359006c610 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3588003cd0 con 0x7f359006c610 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3588004240 con 0x7f359006c610 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: dump: 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.594 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.595 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358effd640 4 set_mon_vals no callback set 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f35880043e0 con 0x7f359006c610 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(41..41 src has 1..41) ==== 3412+0+0 (unknown 2101141767 0 0) 0x7f3588044740 con 0x7f359006c610 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3590122790 con 0x7f35901223b0 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358ffff640 10 monclient: get_auth_request con 0x7f3570037ab0 auth_method 0 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712172972 0 0) 0x7f3590122790 con 0x7f35901223b0 2024-04-25T23:57:04.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient(hunting): my global_id is 4938 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f359006d3e0 con 0x7f35901223b0 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2918450798 0 0) 0x7f359006d3e0 con 0x7f35901223b0 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3590122790 con 0x7f35901223b0 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3580001830 con 0x7f35901223b0 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 10 monclient: dump: 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.597 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2305303602 0 0) 0x7f3590122790 con 0x7f35901223b0 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.591+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3590067160 con 0x7f35901223b0 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.595+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3580004630 con 0x7f35901223b0 2024-04-25T23:57:04.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.595+0000 7f358d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.595+0000 7f358d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:04.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.595+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.106:6792/0 conn(0x7f35901223b0 legacy=0x7f35900623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.595+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.106:6792/0 conn(0x7f35901223b0 legacy=0x7f35900623f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:04.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3590062e50 con 0x7f359002d180 2024-04-25T23:57:04.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953758629 0 0) 0x7f3590062e50 con 0x7f359002d180 2024-04-25T23:57:04.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient(hunting): my global_id is 4947 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3590122790 con 0x7f359002d180 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2817681642 0 0) 0x7f3590122790 con 0x7f359002d180 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3590062e50 con 0x7f359002d180 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3580003c30 con 0x7f359002d180 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient: dump: 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.601 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 571254420 0 0) 0x7f3590062e50 con 0x7f359002d180 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3590072be0 con 0x7f359002d180 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1925590692) 0x7f3580003eb0 con 0x7f359002d180 2024-04-25T23:57:04.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.106:6792/0 conn(0x7f359002d180 legacy=0x7f35900a0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f358d7fa640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.106:6792/0 conn(0x7f359002d180 legacy=0x7f35900a0010 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:04.603 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 143138, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.604 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:04.605 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.606 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:04.607 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.608 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:04.609 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.611 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.612 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.616 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.617 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.619 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.620 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.621 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.622 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:04.622 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:04.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.171:6812/722422047 conn(0x7f3570037ab0 legacy=0x7f3570039f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 10 monclient: shutdown 2024-04-25T23:57:04.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 >> v1:172.21.15.106:6793/0 conn(0x7f359006c610 legacy=0x7f35901cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3595224640 1 -- 172.21.15.106:0/1860203975 reap_dead start 2024-04-25T23:57:04.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3595224640 1 -- 172.21.15.106:0/1860203975 reap_dead start 2024-04-25T23:57:04.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 shutdown_connections 2024-04-25T23:57:04.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 >> 172.21.15.106:0/1860203975 conn(0x7f359006b210 msgr2=0x7f35900a6730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 shutdown_connections 2024-04-25T23:57:04.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.599+0000 7f3596c87640 1 -- 172.21.15.106:0/1860203975 wait complete. 2024-04-25T23:57:04.624 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:04.624 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-25T23:57:04.624 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.759+0000 7fc34867d640 10 monclient: get_monmap_and_config 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.759+0000 7fc34867d640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: monmap: 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:04.766367+0000 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:04.766367+0000 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.747 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.748 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.748 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 Processor -- start 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- start start 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: init 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: _add_conns ranks=[2,3,1,0,5,6,4,7,8] 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient(hunting): picked mon.noname-b con 0x7fc3400a4f60 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient(hunting): picked mon.noname-g con 0x7fc3400a4680 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient(hunting): picked mon.noname-f con 0x7fc34013e060 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400a5a50 con 0x7fc34013e060 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400a2610 con 0x7fc3400a4f60 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400a3e30 con 0x7fc3400a4680 2024-04-25T23:57:04.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient(hunting): authenticate will time out at 1080.293699s 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc346419640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc3400a4f60 0x7fc3400a5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48976/0 (socket says 172.21.15.106:48976) 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc346419640 1 -- 172.21.15.106:0/524528712 learned_addr learned my addr 172.21.15.106:0/524528712 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382216477 0 0) 0x7fc3400a2610 con 0x7fc3400a4f60 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient(hunting): my global_id is 5015 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc32c003530 con 0x7fc3400a4f60 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1155426483 0 0) 0x7fc32c003530 con 0x7fc3400a4f60 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 >> v1:172.21.15.171:6790/0 conn(0x7fc3400a4680 legacy=0x7fc34013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 >> v1:172.21.15.171:6789/0 conn(0x7fc34013e060 legacy=0x7fc340140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 monclient: found mon.noname-b 2024-04-25T23:57:04.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3400a1310 con 0x7fc3400a4f60 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3300017c0 con 0x7fc3400a4f60 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 5 monclient: authenticate success, global_id 5015 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: dump: 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.760 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.761 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc330001a20 con 0x7fc3400a4f60 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 4 set_mon_vals no callback set 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 1 -- 172.21.15.106:0/524528712 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc330004bf0 con 0x7fc3400a4f60 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc345417640 10 monclient: dump: 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.762 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: shutdown 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- 172.21.15.106:0/524528712 >> v1:172.21.15.106:6790/0 conn(0x7fc3400a4f60 legacy=0x7fc3400a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- 172.21.15.106:0/524528712 shutdown_connections 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- 172.21.15.106:0/524528712 >> 172.21.15.106:0/524528712 conn(0x7fc3400a9c80 msgr2=0x7fc3400aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- 172.21.15.106:0/524528712 shutdown_connections 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 1 -- 172.21.15.106:0/524528712 wait complete. 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.763+0000 7fc34867d640 10 monclient: monmap: 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.764 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 Processor -- start 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 -- start start 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient: init 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient: _add_conns ranks=[6,3,8,7,0,4,2,5,1] 2024-04-25T23:57:04.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient(hunting): picked mon.noname-d con 0x7fc3400a4680 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient(hunting): picked mon.noname-g con 0x7fc3400a4f60 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient(hunting): picked mon.noname-e con 0x7fc34013e060 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3401cd1e0 con 0x7fc3400a4f60 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400a40e0 con 0x7fc3400a4680 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3400a1b90 con 0x7fc34013e060 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient(hunting): authenticate will time out at 1080.296654s 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc346419640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc3400a4680 0x7fc3401cc3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38860/0 (socket says 172.21.15.106:38860) 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc346419640 1 -- 172.21.15.106:0/1927739937 learned_addr learned my addr 172.21.15.106:0/1927739937 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1860275792 0 0) 0x7fc3400a40e0 con 0x7fc3400a4680 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): my global_id is 4956 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc324003530 con 0x7fc3400a4680 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1393556421 0 0) 0x7fc3400a1b90 con 0x7fc34013e060 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): my global_id is 134261 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3400a40e0 con 0x7fc34013e060 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1275651293 0 0) 0x7fc324003530 con 0x7fc3400a4680 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3400a1b90 con 0x7fc3400a4680 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc330001740 con 0x7fc3400a4680 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.767 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 188901548 0 0) 0x7fc3401cd1e0 con 0x7fc3400a4f60 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): my global_id is 5007 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc324003530 con 0x7fc3400a4f60 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3623464872 0 0) 0x7fc3400a40e0 con 0x7fc34013e060 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3401cd1e0 con 0x7fc34013e060 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc338001c00 con 0x7fc34013e060 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.769 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3435290855 0 0) 0x7fc3400a1b90 con 0x7fc3400a4680 2024-04-25T23:57:04.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.106:6793/0 conn(0x7fc34013e060 legacy=0x7fc3401d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.171:6790/0 conn(0x7fc3400a4f60 legacy=0x7fc3401ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 monclient: found mon.d 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc34009f4a0 con 0x7fc3400a4680 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 5 monclient: authenticate success, global_id 4956 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient: _renew_subs 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc34009f780 con 0x7fc3400a4680 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient: _renew_subs 2024-04-25T23:57:04.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3400a0700 con 0x7fc3400a4680 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc330001a20 con 0x7fc3400a4680 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc330004c70 con 0x7fc3400a4680 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc344c16640 4 set_mon_vals no callback set 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: dump: 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.772 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3280065d0 con 0x7fc328002870 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc33000fe40 con 0x7fc3400a4680 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(41..41 src has 1..41) ==== 3412+0+0 (unknown 2101141767 0 0) 0x7fc330044550 con 0x7fc3400a4680 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113031646 0 0) 0x7fc3280065d0 con 0x7fc328002870 2024-04-25T23:57:04.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient(hunting): my global_id is 134270 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3400a1b90 con 0x7fc328002870 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3438958219 0 0) 0x7fc3400a1b90 con 0x7fc328002870 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3280065d0 con 0x7fc328002870 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc346c1a640 10 monclient: get_auth_request con 0x7fc324037fe0 auth_method 0 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc33c001840 con 0x7fc328002870 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: dump: 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.774 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2365988329 0 0) 0x7fc3280065d0 con 0x7fc328002870 2024-04-25T23:57:04.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc32800a160 con 0x7fc328002870 2024-04-25T23:57:04.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc33c004650 con 0x7fc328002870 2024-04-25T23:57:04.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:04.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.106:6793/0 conn(0x7fc328002870 legacy=0x7fc328004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.767+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.106:6793/0 conn(0x7fc328002870 legacy=0x7fc328004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc328009e30 con 0x7fc3280090f0 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130574587 0 0) 0x7fc328009e30 con 0x7fc3280090f0 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient(hunting): my global_id is 134279 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3280065d0 con 0x7fc3280090f0 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3368883285 0 0) 0x7fc3280065d0 con 0x7fc3280090f0 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc328009e30 con 0x7fc3280090f0 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc33c003bf0 con 0x7fc3280090f0 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient: dump: 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.779 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3528504263 0 0) 0x7fc328009e30 con 0x7fc3280090f0 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc32800c3a0 con 0x7fc3280090f0 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 960559329) 0x7fc33c003e60 con 0x7fc3280090f0 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.106:6793/0 conn(0x7fc3280090f0 legacy=0x7fc328009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc336ffd640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.106:6793/0 conn(0x7fc3280090f0 legacy=0x7fc328009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:04.780 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 12755, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:04.781 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.782 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.783 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:04.784 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.785 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:04.787 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.789 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:04.793 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.795 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.796 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:04.798 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:04.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.171:6812/722422047 conn(0x7fc324037fe0 legacy=0x7fc32403a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 10 monclient: shutdown 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 >> v1:172.21.15.106:6792/0 conn(0x7fc3400a4680 legacy=0x7fc3401cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc346c1a640 1 -- 172.21.15.106:0/1927739937 reap_dead start 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc346c1a640 1 -- 172.21.15.106:0/1927739937 reap_dead start 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 shutdown_connections 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 >> 172.21.15.106:0/1927739937 conn(0x7fc3400a9c80 msgr2=0x7fc3401377d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 shutdown_connections 2024-04-25T23:57:04.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.775+0000 7fc34867d640 1 -- 172.21.15.106:0/1927739937 wait complete. 2024-04-25T23:57:04.800 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:04.800 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-25T23:57:04.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-25T23:57:04.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: get_monmap_and_config 2024-04-25T23:57:04.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: monmap: 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:04.939084+0000 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:04.939084+0000 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.920 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.921 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 Processor -- start 2024-04-25T23:57:04.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- start start 2024-04-25T23:57:04.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: init 2024-04-25T23:57:04.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: _add_conns ranks=[7,6,2,4,8,3,1,5,0] 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient(hunting): picked mon.noname-i con 0x7fd43c134760 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient(hunting): picked mon.noname-d con 0x7fd43c0a0d70 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient(hunting): picked mon.noname-b con 0x7fd43c13df70 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c06b910 con 0x7fd43c13df70 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c09fac0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c0a0080 con 0x7fd43c134760 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient(hunting): authenticate will time out at 1080.466289s 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43bfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fd43c0a0d70 0x7fd43c13c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38862/0 (socket says 172.21.15.106:38862) 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43bfff640 1 -- 172.21.15.106:0/2140342949 learned_addr learned my addr 172.21.15.106:0/2140342949 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd441353640 1 --1- 172.21.15.106:0/2140342949 >> v1:172.21.15.106:6790/0 conn(0x7fd43c13df70 0x7fd43c140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48992/0 (socket says 172.21.15.106:48992) 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497941949 0 0) 0x7fd43c09fac0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): my global_id is 4965 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd424003530 con 0x7fd43c0a0d70 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859467680 0 0) 0x7fd43c06b910 con 0x7fd43c13df70 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient(hunting): my global_id is 5024 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd43c09fac0 con 0x7fd43c13df70 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3448273112 0 0) 0x7fd424003530 con 0x7fd43c0a0d70 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 >> v1:172.21.15.171:6792/0 conn(0x7fd43c134760 legacy=0x7fd43c134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 >> v1:172.21.15.106:6790/0 conn(0x7fd43c13df70 legacy=0x7fd43c140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 monclient: found mon.noname-d 2024-04-25T23:57:04.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c09f280 con 0x7fd43c0a0d70 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4300017c0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 5 monclient: authenticate success, global_id 4965 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: dump: 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.931 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd430001aa0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 1 -- 172.21.15.106:0/2140342949 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd430004bf0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 4 set_mon_vals no callback set 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd43b7fe640 10 monclient: dump: 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.933 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 10 monclient: shutdown 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- 172.21.15.106:0/2140342949 >> v1:172.21.15.106:6792/0 conn(0x7fd43c0a0d70 legacy=0x7fd43c13c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- 172.21.15.106:0/2140342949 shutdown_connections 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- 172.21.15.106:0/2140342949 >> 172.21.15.106:0/2140342949 conn(0x7fd43c0a7240 msgr2=0x7fd43c0a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- 172.21.15.106:0/2140342949 shutdown_connections 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.935+0000 7fd442db6640 1 -- 172.21.15.106:0/2140342949 wait complete. 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: build_initial_monmap 2024-04-25T23:57:04.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: monmap: 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:04.935 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 Processor -- start 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 -- start start 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: init 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: _add_conns ranks=[2,1,3,6,5,7,4,8,0] 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient(hunting): picked mon.noname-b con 0x7fd43c0a0d70 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient(hunting): picked mon.noname-f con 0x7fd43c134760 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient(hunting): picked mon.noname-g con 0x7fd43c13df70 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c072500 con 0x7fd43c134760 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c072930 con 0x7fd43c0a0d70 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd43c12c880 con 0x7fd43c13df70 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient(hunting): authenticate will time out at 1080.469306s 2024-04-25T23:57:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd440b52640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd43c0a0d70 0x7fd43c13e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49004/0 (socket says 172.21.15.106:49004) 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd440b52640 1 -- 172.21.15.106:0/2835100625 learned_addr learned my addr 172.21.15.106:0/2835100625 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001745498 0 0) 0x7fd43c072930 con 0x7fd43c0a0d70 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): my global_id is 5033 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd428003530 con 0x7fd43c0a0d70 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3402372567 0 0) 0x7fd428003530 con 0x7fd43c0a0d70 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd43c072930 con 0x7fd43c0a0d70 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd42c001ae0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): dump: 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354423979 0 0) 0x7fd43c12c880 con 0x7fd43c13df70 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): my global_id is 5016 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd428003530 con 0x7fd43c13df70 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1248062541 0 0) 0x7fd43c09f280 con 0x7fd43c134760 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): my global_id is 134326 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd43c12c880 con 0x7fd43c134760 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4191930112 0 0) 0x7fd43c072930 con 0x7fd43c0a0d70 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.171:6790/0 conn(0x7fd43c13df70 legacy=0x7fd43c13f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.171:6789/0 conn(0x7fd43c134760 legacy=0x7fd43c13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 monclient: found mon.b 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd43c13ff40 con 0x7fd43c0a0d70 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 5 monclient: authenticate success, global_id 5033 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: _renew_subs 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd43c12cfe0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: _renew_subs 2024-04-25T23:57:04.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd43c140650 con 0x7fd43c0a0d70 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd42c003950 con 0x7fd43c0a0d70 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd42c003ec0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd43affd640 4 set_mon_vals no callback set 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient: dump: 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.941 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd41c0065d0 con 0x7fd41c002870 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd42c0040e0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(41..41 src has 1..41) ==== 3412+0+0 (unknown 2101141767 0 0) 0x7fd42c0445b0 con 0x7fd43c0a0d70 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4057351112 0 0) 0x7fd41c0065d0 con 0x7fd41c002870 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 10 monclient(hunting): my global_id is 134335 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd43c072930 con 0x7fd41c002870 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.939+0000 7fd441353640 10 monclient: get_auth_request con 0x7fd428037930 auth_method 0 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2621460798 0 0) 0x7fd43c072930 con 0x7fd41c002870 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd41c0065d0 con 0x7fd41c002870 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4300011e0 con 0x7fd41c002870 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 10 monclient: dump: 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.943 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2262420103 0 0) 0x7fd41c0065d0 con 0x7fd41c002870 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd41c00a160 con 0x7fd41c002870 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd430001d00 con 0x7fd41c002870 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.171:6789/0 conn(0x7fd41c002870 legacy=0x7fd41c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.943+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.171:6789/0 conn(0x7fd41c002870 legacy=0x7fd41c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.947+0000 7fd442db6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.947+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd41c009e30 con 0x7fd41c0090f0 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2793617902 0 0) 0x7fd41c009e30 con 0x7fd41c0090f0 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient(hunting): my global_id is 134344 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd41c0065d0 con 0x7fd41c0090f0 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1289535992 0 0) 0x7fd41c0065d0 con 0x7fd41c0090f0 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd41c009e30 con 0x7fd41c0090f0 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd430005000 con 0x7fd41c0090f0 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:04.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient: dump: 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:04.947 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1856164317 0 0) 0x7fd41c009e30 con 0x7fd41c0090f0 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd41c00c3a0 con 0x7fd41c0090f0 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 3468395057) 0x7fd4300052e0 con 0x7fd41c0090f0 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.171:6789/0 conn(0x7fd41c0090f0 legacy=0x7fd41c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd4397fa640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.171:6789/0 conn(0x7fd41c0090f0 legacy=0x7fd41c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:04.948 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 12943, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:04.949 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.950 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.951 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:04.952 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:04.953 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.955 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.956 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:04.960 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.963 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:04.964 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.965 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:04.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:04.967 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:04.967 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.171:6812/722422047 conn(0x7fd428037930 legacy=0x7fd428039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 10 monclient: shutdown 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 >> v1:172.21.15.106:6790/0 conn(0x7fd43c0a0d70 legacy=0x7fd43c13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd441353640 1 -- 172.21.15.106:0/2835100625 reap_dead start 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd441353640 1 -- 172.21.15.106:0/2835100625 reap_dead start 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 shutdown_connections 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 >> 172.21.15.106:0/2835100625 conn(0x7fd43c0a7240 msgr2=0x7fd43c133210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 shutdown_connections 2024-04-25T23:57:04.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:04.951+0000 7fd442db6640 1 -- 172.21.15.106:0/2835100625 wait complete. 2024-04-25T23:57:04.969 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:04.969 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-25T23:57:04.969 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:57:05.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.103+0000 7f3346f06640 10 monclient: get_monmap_and_config 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.103+0000 7f3346f06640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.103+0000 7f3346f06640 10 monclient: monmap: 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:05.108836+0000 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:05.108836+0000 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.090 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.091 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.091 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.091 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.091 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.091 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.091 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.103+0000 7f3346f06640 1 Processor -- start 2024-04-25T23:57:05.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.103+0000 7f3346f06640 1 -- start start 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.103+0000 7f3346f06640 10 monclient: init 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: _add_conns ranks=[2,0,1,8,5,7,3,4,6] 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): picked mon.noname-b con 0x7f33400a1c30 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): picked mon.noname-a con 0x7f33400a2010 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): picked mon.noname-f con 0x7f334013dc40 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334009c5b0 con 0x7f33400a2010 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334009c2d0 con 0x7f334013dc40 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33400a3a70 con 0x7f33400a1c30 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): authenticate will time out at 1080.636534s 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f33400a2010 0x7f33400a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39862/0 (socket says 172.21.15.106:39862) 2024-04-25T23:57:05.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3344ca2640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f33400a1c30 0x7f334009aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49008/0 (socket says 172.21.15.106:49008) 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333ffff640 1 -- 172.21.15.106:0/3657181195 learned_addr learned my addr 172.21.15.106:0/3657181195 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 79784685 0 0) 0x7f3334001120 con 0x7f33400a2010 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): my global_id is 4977 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3328003530 con 0x7f33400a2010 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76608198 0 0) 0x7f33400a3a70 con 0x7f33400a1c30 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient(hunting): my global_id is 5042 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3334001120 con 0x7f33400a1c30 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1246605371 0 0) 0x7f3328003530 con 0x7f33400a2010 2024-04-25T23:57:05.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 >> v1:172.21.15.106:6790/0 conn(0x7f33400a1c30 legacy=0x7f334009aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 >> v1:172.21.15.171:6789/0 conn(0x7f334013dc40 legacy=0x7f3340140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 monclient: found mon.noname-a 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3340144780 con 0x7f33400a2010 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3334001990 con 0x7f33400a2010 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: dump: 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.101 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 5 monclient: authenticate success, global_id 4977 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3334001cb0 con 0x7f33400a2010 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 4 set_mon_vals no callback set 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 1 -- 172.21.15.106:0/3657181195 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3334004bf0 con 0x7f33400a2010 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333f7fe640 10 monclient: dump: 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.103 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: shutdown 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- 172.21.15.106:0/3657181195 >> v1:172.21.15.106:6789/0 conn(0x7f33400a2010 legacy=0x7f33400a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- 172.21.15.106:0/3657181195 shutdown_connections 2024-04-25T23:57:05.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- 172.21.15.106:0/3657181195 >> 172.21.15.106:0/3657181195 conn(0x7f33400a2d20 msgr2=0x7f33400a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- 172.21.15.106:0/3657181195 shutdown_connections 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- 172.21.15.106:0/3657181195 wait complete. 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: monmap: 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.105 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 Processor -- start 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- start start 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: init 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient: _add_conns ranks=[6,0,4,8,5,7,1,3,2] 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): picked mon.noname-d con 0x7f33400a1c30 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): picked mon.noname-a con 0x7f33400a2010 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): picked mon.noname-c con 0x7f334013dc40 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334009fc50 con 0x7f33400a2010 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33401cd4b0 con 0x7f334013dc40 2024-04-25T23:57:05.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3340131e20 con 0x7f33400a1c30 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3346f06640 10 monclient(hunting): authenticate will time out at 1080.639525s 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3344ca2640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f33400a1c30 0x7f33401cc690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38870/0 (socket says 172.21.15.106:38870) 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f3344ca2640 1 -- 172.21.15.106:0/228337159 learned_addr learned my addr 172.21.15.106:0/228337159 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333ffff640 1 --1- 172.21.15.106:0/228337159 >> v1:172.21.15.106:6789/0 conn(0x7f33400a2010 0x7f33401ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39864/0 (socket says 172.21.15.106:39864) 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1333481192 0 0) 0x7f334009fc50 con 0x7f33400a2010 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): my global_id is 4986 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f332c003530 con 0x7f33400a2010 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972373318 0 0) 0x7f3340131e20 con 0x7f33400a1c30 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 10 monclient(hunting): my global_id is 4974 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.107+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f334009fc50 con 0x7f33400a1c30 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130963508 0 0) 0x7f33401cd4b0 con 0x7f334013dc40 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): my global_id is 134302 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3340131e20 con 0x7f334013dc40 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1939012104 0 0) 0x7f332c003530 con 0x7f33400a2010 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33401cd4b0 con 0x7f33400a2010 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3334004b30 con 0x7f33400a2010 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): dump: 2024-04-25T23:57:05.108 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 621341784 0 0) 0x7f334009fc50 con 0x7f33400a1c30 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f332c003530 con 0x7f33400a1c30 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f33300019e0 con 0x7f33400a1c30 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): dump: 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.110 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3246296002 0 0) 0x7f3340131e20 con 0x7f334013dc40 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f334009fc50 con 0x7f334013dc40 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3338001bb0 con 0x7f334013dc40 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): dump: 2024-04-25T23:57:05.111 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.112 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3112948159 0 0) 0x7f332c003530 con 0x7f33400a1c30 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.106:6791/0 conn(0x7f334013dc40 legacy=0x7f33401d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.106:6789/0 conn(0x7f33400a2010 legacy=0x7f33401ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 monclient: found mon.d 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3340132fd0 con 0x7f33400a1c30 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 5 monclient: authenticate success, global_id 4974 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 10 monclient: _renew_subs 2024-04-25T23:57:05.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f33401332b0 con 0x7f33400a1c30 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 10 monclient: _renew_subs 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3340134020 con 0x7f33400a1c30 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3330001d00 con 0x7f33400a1c30 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3330004de0 con 0x7f33400a1c30 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333effd640 4 set_mon_vals no callback set 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: dump: 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.114 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f33200065d0 con 0x7f3320002870 2024-04-25T23:57:05.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f333000fb80 con 0x7f33400a1c30 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(41..41 src has 1..41) ==== 3412+0+0 (unknown 2101141767 0 0) 0x7f3330044380 con 0x7f33400a1c30 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1005492154 0 0) 0x7f33200065d0 con 0x7f3320002870 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f33454a3640 10 monclient: get_auth_request con 0x7f332c038150 auth_method 0 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient(hunting): my global_id is 5025 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f332c003530 con 0x7f3320002870 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3968086812 0 0) 0x7f332c003530 con 0x7f3320002870 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f33200065d0 con 0x7f3320002870 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3334001cb0 con 0x7f3320002870 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: dump: 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.116 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 355691965 0 0) 0x7f33200065d0 con 0x7f3320002870 2024-04-25T23:57:05.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f332000a160 con 0x7f3320002870 2024-04-25T23:57:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3334005760 con 0x7f3320002870 2024-04-25T23:57:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.171:6790/0 conn(0x7f3320002870 legacy=0x7f3320004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.111+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.171:6790/0 conn(0x7f3320002870 legacy=0x7f3320004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f3346f06640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3320009e50 con 0x7f3320009110 2024-04-25T23:57:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3956123678 0 0) 0x7f3320009e50 con 0x7f3320009110 2024-04-25T23:57:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 10 monclient(hunting): my global_id is 5034 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33200065d0 con 0x7f3320009110 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3792398200 0 0) 0x7f33200065d0 con 0x7f3320009110 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3320009e50 con 0x7f3320009110 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3334005ec0 con 0x7f3320009110 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 10 monclient: dump: 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.120 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1064890975 0 0) 0x7f3320009e50 con 0x7f3320009110 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.119+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f332000c3e0 con 0x7f3320009110 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 3847017095) 0x7f3334008210 con 0x7f3320009110 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f333d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f333d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.171:6790/0 conn(0x7f3320009110 legacy=0x7f33200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f333d7fa640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.171:6790/0 conn(0x7f3320009110 legacy=0x7f33200095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 143643, 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:05.122 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.123 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.124 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:05.125 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.126 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:05.127 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:05.128 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.129 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.129 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.129 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:05.129 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:05.129 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.132 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.133 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:05.135 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:05.136 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.137 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:05.140 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:05.141 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.171:6812/722422047 conn(0x7f332c038150 legacy=0x7f332c03a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 10 monclient: shutdown 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 >> v1:172.21.15.106:6792/0 conn(0x7f33400a1c30 legacy=0x7f33401cc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f33454a3640 1 -- 172.21.15.106:0/228337159 reap_dead start 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f33454a3640 1 -- 172.21.15.106:0/228337159 reap_dead start 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 shutdown_connections 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 >> 172.21.15.106:0/228337159 conn(0x7f33400a2d20 msgr2=0x7f3340142f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 shutdown_connections 2024-04-25T23:57:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.123+0000 7f3346f06640 1 -- 172.21.15.106:0/228337159 wait complete. 2024-04-25T23:57:05.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:05.144 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-25T23:57:05.144 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:57:05.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.249+0000 7fa822ffd640 1 -- 172.21.15.171:0/3326097998 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["all"]}]=0 osd.0 belongs to no class, osd.1 belongs to no class, osd.2 belongs to no class, osd.3 belongs to no class, osd.4 belongs to no class, osd.5 belongs to no class, done removing class of osd(s): v42) ==== 282+0+0 (unknown 2903863430 0 0) 0x7fa81c0194c0 con 0x7fa82c135bb0 2024-04-25T23:57:05.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.249+0000 7fa822ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm-device-class", "ids": ["all"]}] 2024-04-25T23:57:05.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.249+0000 7fa822ffd640 10 monclient: _finish_command 3 = system:0 osd.0 belongs to no class, osd.1 belongs to no class, osd.2 belongs to no class, osd.3 belongs to no class, osd.4 belongs to no class, osd.5 belongs to no class, done removing class of osd(s): 2024-04-25T23:57:05.235 INFO:tasks.workunit.client.0.smithi171.stderr:osd.0 belongs to no class, osd.1 belongs to no class, osd.2 belongs to no class, osd.3 belongs to no class, osd.4 belongs to no class, osd.5 belongs to no class, done removing class of osd(s): 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 >> v1:172.21.15.171:6812/722422047 conn(0x7fa810037840 legacy=0x7fa810039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 10 monclient: shutdown 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 >> v1:172.21.15.171:6790/0 conn(0x7fa82c135bb0 legacy=0x7fa82c09da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 shutdown_connections 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 >> 172.21.15.171:0/3326097998 conn(0x7fa82c0a2620 msgr2=0x7fa82c13ac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 shutdown_connections 2024-04-25T23:57:05.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.253+0000 7fa834395640 1 -- 172.21.15.171:0/3326097998 wait complete. 2024-04-25T23:57:05.254 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush set-device-class ssd osd.0 2024-04-25T23:57:05.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: get_monmap_and_config 2024-04-25T23:57:05.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: monmap: 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:05.279305+0000 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:05.279305+0000 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.260 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.261 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.261 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 Processor -- start 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- start start 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: init 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: _add_conns ranks=[3,5,4,7,6,0,1,8,2] 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient(hunting): picked mon.noname-g con 0x7ff68c134970 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient(hunting): picked mon.noname-h con 0x7ff68c0a4820 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient(hunting): picked mon.noname-c con 0x7ff68c13e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c06dd40 con 0x7ff68c134970 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c0a2b10 con 0x7ff68c13e200 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c0a2df0 con 0x7ff68c0a4820 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient(hunting): authenticate will time out at 1080.806141s 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff691012640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7ff68c13e200 0x7ff68c1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50844/0 (socket says 172.21.15.106:50844) 2024-04-25T23:57:05.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff691012640 1 -- 172.21.15.106:0/3016019026 learned_addr learned my addr 172.21.15.106:0/3016019026 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201256843 0 0) 0x7ff68c0a2b10 con 0x7ff68c13e200 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): my global_id is 134311 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff674003530 con 0x7ff68c13e200 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511294396 0 0) 0x7ff68c06dd40 con 0x7ff68c134970 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): my global_id is 5043 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68c0a2b10 con 0x7ff68c134970 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791310016 0 0) 0x7ff68c0a2df0 con 0x7ff68c0a4820 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient(hunting): my global_id is 5036 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68c06dd40 con 0x7ff68c0a4820 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 496901372 0 0) 0x7ff674003530 con 0x7ff68c13e200 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 >> v1:172.21.15.171:6791/0 conn(0x7ff68c0a4820 legacy=0x7ff68c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 >> v1:172.21.15.171:6790/0 conn(0x7ff68c134970 legacy=0x7ff68c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 monclient: found mon.noname-c 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c0a30d0 con 0x7ff68c13e200 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff684001ac0 con 0x7ff68c13e200 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: dump: 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.272 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 5 monclient: authenticate success, global_id 134311 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff684001d20 con 0x7ff68c13e200 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 1 -- 172.21.15.106:0/3016019026 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff684004c30 con 0x7ff68c13e200 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff68b7fe640 10 monclient: dump: 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.273 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 4 set_mon_vals no callback set 2024-04-25T23:57:05.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 10 monclient: shutdown 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- 172.21.15.106:0/3016019026 >> v1:172.21.15.106:6791/0 conn(0x7ff68c13e200 legacy=0x7ff68c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- 172.21.15.106:0/3016019026 shutdown_connections 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- 172.21.15.106:0/3016019026 >> 172.21.15.106:0/3016019026 conn(0x7ff68c0a9e20 msgr2=0x7ff68c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- 172.21.15.106:0/3016019026 shutdown_connections 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.275+0000 7ff692a75640 1 -- 172.21.15.106:0/3016019026 wait complete. 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: monmap: 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.275 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 Processor -- start 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 -- start start 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: init 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: _add_conns ranks=[0,8,2,3,6,5,4,7,1] 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient(hunting): picked mon.noname-a con 0x7ff68c0a4820 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:05.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient(hunting): picked mon.noname-e con 0x7ff68c134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient(hunting): picked mon.noname-b con 0x7ff68c13e200 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c0a1e00 con 0x7ff68c0a4820 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c0a1a40 con 0x7ff68c13e200 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff68c136d00 con 0x7ff68c134970 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient(hunting): authenticate will time out at 1080.809283s 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff690811640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff68c0a4820 0x7ff68c13ca90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39872/0 (socket says 172.21.15.106:39872) 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff690811640 1 -- 172.21.15.106:0/1860278463 learned_addr learned my addr 172.21.15.106:0/1860278463 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3193785046 0 0) 0x7ff68c0a1e00 con 0x7ff68c0a4820 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): my global_id is 4995 2024-04-25T23:57:05.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff678003530 con 0x7ff68c0a4820 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990750753 0 0) 0x7ff68c0a1a40 con 0x7ff68c13e200 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): my global_id is 5051 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68c0a1e00 con 0x7ff68c13e200 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2396049426 0 0) 0x7ff68c136d00 con 0x7ff68c134970 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): my global_id is 134288 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68c0a1a40 con 0x7ff68c134970 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1346067280 0 0) 0x7ff678003530 con 0x7ff68c0a4820 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff68c136d00 con 0x7ff68c0a4820 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 565358154 0 0) 0x7ff68c0a1a40 con 0x7ff68c134970 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff678003530 con 0x7ff68c134970 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2166072102 0 0) 0x7ff68c0a1e00 con 0x7ff68c13e200 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff68c0a1a40 con 0x7ff68c13e200 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff67c001aa0 con 0x7ff68c0a4820 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): dump: 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.279 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff6800019e0 con 0x7ff68c134970 2024-04-25T23:57:05.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): dump: 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.281 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff684001a40 con 0x7ff68c13e200 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): dump: 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.282 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 474896678 0 0) 0x7ff68c136d00 con 0x7ff68c0a4820 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.106:6793/0 conn(0x7ff68c134970 legacy=0x7ff68c1d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.106:6790/0 conn(0x7ff68c13e200 legacy=0x7ff68c1d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 monclient: found mon.a 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff68c139310 con 0x7ff68c0a4820 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 5 monclient: authenticate success, global_id 4995 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: _renew_subs 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff68c138a70 con 0x7ff68c0a4820 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: _renew_subs 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff68c13d1a0 con 0x7ff68c0a4820 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff67c0038d0 con 0x7ff68c0a4820 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff67c003dc0 con 0x7ff68c0a4820 2024-04-25T23:57:05.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff68affd640 4 set_mon_vals no callback set 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: dump: 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.285 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff66c0065d0 con 0x7ff66c002870 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff67c003f60 con 0x7ff68c0a4820 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7ff67c0444c0 con 0x7ff68c0a4820 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3374506064 0 0) 0x7ff66c0065d0 con 0x7ff66c002870 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff691012640 10 monclient: get_auth_request con 0x7ff6780381a0 auth_method 0 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient(hunting): my global_id is 5045 2024-04-25T23:57:05.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff68c136d00 con 0x7ff66c002870 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2935654344 0 0) 0x7ff68c136d00 con 0x7ff66c002870 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff66c0065d0 con 0x7ff66c002870 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff680003c10 con 0x7ff66c002870 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.279+0000 7ff6897fa640 10 monclient: dump: 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.287 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.283+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 643764168 0 0) 0x7ff66c0065d0 con 0x7ff66c002870 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.283+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff66c00a160 con 0x7ff66c002870 2024-04-25T23:57:05.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.283+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff680003fe0 con 0x7ff66c002870 2024-04-25T23:57:05.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.283+0000 7ff6897fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.283+0000 7ff6897fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:05.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.283+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.171:6791/0 conn(0x7ff66c002870 legacy=0x7ff66c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.283+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.171:6791/0 conn(0x7ff66c002870 legacy=0x7ff66c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff692a75640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:05.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff66c009e30 con 0x7ff66c0090f0 2024-04-25T23:57:05.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023621969 0 0) 0x7ff66c009e30 con 0x7ff66c0090f0 2024-04-25T23:57:05.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff6897fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff6897fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff6897fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff6897fa640 10 monclient(hunting): my global_id is 5054 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.287+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff66c0065d0 con 0x7ff66c0090f0 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 327910499 0 0) 0x7ff66c0065d0 con 0x7ff66c0090f0 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff66c009e30 con 0x7ff66c0090f0 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff6800047d0 con 0x7ff66c0090f0 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 10 monclient: dump: 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.291 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2307849228 0 0) 0x7ff66c009e30 con 0x7ff66c0090f0 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff66c00c3a0 con 0x7ff66c0090f0 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3470943892) 0x7ff680005b50 con 0x7ff66c0090f0 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:05.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.171:6791/0 conn(0x7ff66c0090f0 legacy=0x7ff66c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff6897fa640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.171:6791/0 conn(0x7ff66c0090f0 legacy=0x7ff66c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 143795, 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:05.293 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 7, 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.294 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.295 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:05.296 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.297 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:05.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.299 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:05.301 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:05.303 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:05.305 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.306 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:05.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.309 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:05.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:05.311 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.171:6812/722422047 conn(0x7ff6780381a0 legacy=0x7ff67803a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 10 monclient: shutdown 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 >> v1:172.21.15.106:6789/0 conn(0x7ff68c0a4820 legacy=0x7ff68c13ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff691012640 1 -- 172.21.15.106:0/1860278463 reap_dead start 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff691012640 1 -- 172.21.15.106:0/1860278463 reap_dead start 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 shutdown_connections 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 >> 172.21.15.106:0/1860278463 conn(0x7ff68c0a9e20 msgr2=0x7ff68c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 shutdown_connections 2024-04-25T23:57:05.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.291+0000 7ff692a75640 1 -- 172.21.15.106:0/1860278463 wait complete. 2024-04-25T23:57:05.313 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:05.314 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-25T23:57:05.314 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-25T23:57:05.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.389+0000 7fcafa2bb640 10 monclient: get_monmap_and_config 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.389+0000 7fcafa2bb640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.389+0000 7fcafa2bb640 10 monclient: monmap: 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:05.393025+0000 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:05.393025+0000 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.374 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.375 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.389+0000 7fcafa2bb640 1 Processor -- start 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.389+0000 7fcafa2bb640 1 -- start start 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.389+0000 7fcafa2bb640 10 monclient: init 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient: _add_conns ranks=[4,3,2,7,8,1,0,5,6] 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient(hunting): picked mon.noname-c con 0x7fcaf4137880 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient(hunting): picked mon.noname-g con 0x7fcaf4138370 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:05.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient(hunting): picked mon.noname-b con 0x7fcaf40a47e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40a2ea0 con 0x7fcaf40a47e0 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40a2bc0 con 0x7fcaf4138370 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40a28e0 con 0x7fcaf4137880 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient(hunting): authenticate will time out at 1076.100486s 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf37fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fcaf4138370 0x7fcaf413cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:36410/0 (socket says 172.21.15.171:36410) 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf37fe640 1 -- 172.21.15.171:0/3353435281 learned_addr learned my addr 172.21.15.171:0/3353435281 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080285702 0 0) 0x7fcaf40a2bc0 con 0x7fcaf4138370 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): my global_id is 5052 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcae0003530 con 0x7fcaf4138370 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3746037386 0 0) 0x7fcaec001120 con 0x7fcaf40a47e0 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): my global_id is 5060 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaf40a2bc0 con 0x7fcaf40a47e0 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931547754 0 0) 0x7fcaf40a28e0 con 0x7fcaf4137880 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient(hunting): my global_id is 134320 2024-04-25T23:57:05.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaec001120 con 0x7fcaf4137880 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3857216475 0 0) 0x7fcae0003530 con 0x7fcaf4138370 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 >> v1:172.21.15.106:6791/0 conn(0x7fcaf4137880 legacy=0x7fcaf4137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 >> v1:172.21.15.106:6790/0 conn(0x7fcaf40a47e0 legacy=0x7fcaf4140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 monclient: found mon.noname-g 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf40a4230 con 0x7fcaf4138370 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcadc0017c0 con 0x7fcaf4138370 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 5 monclient: authenticate success, global_id 5052 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: dump: 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.387 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcadc001a70 con 0x7fcaf4138370 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 1 -- 172.21.15.171:0/3353435281 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcadc004bf0 con 0x7fcaf4138370 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 4 set_mon_vals no callback set 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcaf2ffd640 10 monclient: dump: 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.389 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient: shutdown 2024-04-25T23:57:05.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- 172.21.15.171:0/3353435281 >> v1:172.21.15.171:6790/0 conn(0x7fcaf4138370 legacy=0x7fcaf413cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- 172.21.15.171:0/3353435281 shutdown_connections 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- 172.21.15.171:0/3353435281 >> 172.21.15.171:0/3353435281 conn(0x7fcaf40a9ee0 msgr2=0x7fcaf40aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- 172.21.15.171:0/3353435281 shutdown_connections 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- 172.21.15.171:0/3353435281 wait complete. 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient: monmap: 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:05.391 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 Processor -- start 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 1 -- start start 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.393+0000 7fcafa2bb640 10 monclient: init 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _add_conns ranks=[2,8,1,5,6,4,3,7,0] 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient(hunting): picked mon.noname-b con 0x7fcaf40a47e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient(hunting): picked mon.noname-e con 0x7fcaf4137880 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient(hunting): picked mon.noname-f con 0x7fcaf4138370 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40a0f10 con 0x7fcaf4138370 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf40a1e80 con 0x7fcaf40a47e0 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcaf4133eb0 con 0x7fcaf4137880 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient(hunting): authenticate will time out at 1076.104363s 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf8858640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fcaf4138370 0x7fcaf41d4d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:57600/0 (socket says 172.21.15.171:57600) 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf8858640 1 -- 172.21.15.171:0/4161341202 learned_addr learned my addr 172.21.15.171:0/4161341202 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4240472544 0 0) 0x7fcaf40a2bc0 con 0x7fcaf4138370 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): my global_id is 134362 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcad4003530 con 0x7fcaf4138370 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 789140284 0 0) 0x7fcaf4133eb0 con 0x7fcaf4137880 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): my global_id is 134297 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaf40a2bc0 con 0x7fcaf4137880 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1272203366 0 0) 0x7fcaf40a1e80 con 0x7fcaf40a47e0 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): my global_id is 5069 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcaf4133eb0 con 0x7fcaf40a47e0 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3533468576 0 0) 0x7fcad4003530 con 0x7fcaf4138370 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcaf40a1e80 con 0x7fcaf4138370 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcaec001c30 con 0x7fcaf4138370 2024-04-25T23:57:05.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.396 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2825766607 0 0) 0x7fcaf40a2bc0 con 0x7fcaf4137880 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcad4003530 con 0x7fcaf4137880 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcadc001780 con 0x7fcaf4137880 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:05.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.398 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 841151626 0 0) 0x7fcaf40a1e80 con 0x7fcaf4138370 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6793/0 conn(0x7fcaf4137880 legacy=0x7fcaf4132530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6790/0 conn(0x7fcaf40a47e0 legacy=0x7fcaf4131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 monclient: found mon.f 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcaf4132c40 con 0x7fcaf4138370 2024-04-25T23:57:05.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 5 monclient: authenticate success, global_id 134362 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _renew_subs 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcaf4135550 con 0x7fcaf4138370 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _renew_subs 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fcaf41345a0 con 0x7fcaf4138370 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcaec0038d0 con 0x7fcaf4138370 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcaec003e40 con 0x7fcaf4138370 2024-04-25T23:57:05.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf27fc640 4 set_mon_vals no callback set 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 10 monclient: dump: 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.401 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcad8005090 con 0x7fcaf4138370 2024-04-25T23:57:05.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcaec004060 con 0x7fcaf4138370 2024-04-25T23:57:05.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7fcaec044680 con 0x7fcaf4138370 2024-04-25T23:57:05.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.397+0000 7fcaf3fff640 10 monclient: get_auth_request con 0x7fcad4037e90 auth_method 0 2024-04-25T23:57:05.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.401+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fcaf40a0f10 con 0x7fcaf4138370 2024-04-25T23:57:05.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.401+0000 7fcaf0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.401+0000 7fcaf0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:05.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: get_monmap_and_config 2024-04-25T23:57:05.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: monmap: 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:05.447157+0000 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:05.447157+0000 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.428 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.429 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.429 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.429 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.429 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 Processor -- start 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- start start 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: init 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: _add_conns ranks=[7,6,2,0,5,3,4,8,1] 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient(hunting): picked mon.noname-i con 0x7fc8a0134970 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient(hunting): picked mon.noname-d con 0x7fc8a00a4820 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient(hunting): picked mon.noname-b con 0x7fc8a013e200 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a006dd40 con 0x7fc8a013e200 2024-04-25T23:57:05.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a00a2b10 con 0x7fc8a00a4820 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a00a2df0 con 0x7fc8a0134970 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient(hunting): authenticate will time out at 1080.974274s 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a6030640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc8a013e200 0x7fc8a01405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:49022/0 (socket says 172.21.15.106:49022) 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a6030640 1 -- 172.21.15.106:0/687894080 learned_addr learned my addr 172.21.15.106:0/687894080 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3050748949 0 0) 0x7fc8a006dd40 con 0x7fc8a013e200 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): my global_id is 5078 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88c003530 con 0x7fc8a013e200 2024-04-25T23:57:05.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638714407 0 0) 0x7fc8a00a2b10 con 0x7fc8a00a4820 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): my global_id is 4983 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a006dd40 con 0x7fc8a00a4820 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1132007818 0 0) 0x7fc8a00a2df0 con 0x7fc8a0134970 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient(hunting): my global_id is 134323 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a00a2b10 con 0x7fc8a0134970 2024-04-25T23:57:05.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3735670836 0 0) 0x7fc88c003530 con 0x7fc8a013e200 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 >> v1:172.21.15.171:6792/0 conn(0x7fc8a0134970 legacy=0x7fc8a0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 >> v1:172.21.15.106:6792/0 conn(0x7fc8a00a4820 legacy=0x7fc8a013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 monclient: found mon.noname-b 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a00a30d0 con 0x7fc8a013e200 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc898001b40 con 0x7fc8a013e200 2024-04-25T23:57:05.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 5 monclient: authenticate success, global_id 5078 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: dump: 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.443 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc898001d70 con 0x7fc8a013e200 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 1 -- 172.21.15.106:0/687894080 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc898004f70 con 0x7fc8a013e200 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:05.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 4 set_mon_vals no callback set 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a482d640 10 monclient: dump: 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.445 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 10 monclient: shutdown 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- 172.21.15.106:0/687894080 >> v1:172.21.15.106:6790/0 conn(0x7fc8a013e200 legacy=0x7fc8a01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- 172.21.15.106:0/687894080 shutdown_connections 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- 172.21.15.106:0/687894080 >> 172.21.15.106:0/687894080 conn(0x7fc8a00a9e20 msgr2=0x7fc8a00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- 172.21.15.106:0/687894080 shutdown_connections 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.443+0000 7fc8a7a93640 1 -- 172.21.15.106:0/687894080 wait complete. 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: monmap: 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.447 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 Processor -- start 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 -- start start 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: init 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: _add_conns ranks=[1,5,3,6,0,4,7,8,2] 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient(hunting): picked mon.noname-f con 0x7fc8a00a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:05.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient(hunting): picked mon.noname-h con 0x7fc8a0134970 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient(hunting): picked mon.noname-g con 0x7fc8a013e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a013a200 con 0x7fc8a00a4820 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a00a1e00 con 0x7fc8a013e200 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8a00a1a40 con 0x7fc8a0134970 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient(hunting): authenticate will time out at 1080.977285s 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a6030640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc8a013e200 0x7fc8a01d4eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:37564/0 (socket says 172.21.15.106:37564) 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a6030640 1 -- 172.21.15.106:0/3576029944 learned_addr learned my addr 172.21.15.106:0/3576029944 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923198996 0 0) 0x7fc8a00a1e00 con 0x7fc8a013e200 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): my global_id is 5061 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc884003530 con 0x7fc8a013e200 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203163024 0 0) 0x7fc8a00a1a40 con 0x7fc8a0134970 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): my global_id is 5063 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a00a1e00 con 0x7fc8a0134970 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3150327875 0 0) 0x7fc8a013a200 con 0x7fc8a00a4820 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): my global_id is 134371 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a00a1a40 con 0x7fc8a00a4820 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3152057892 0 0) 0x7fc8a00a1a40 con 0x7fc8a00a4820 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8a013a200 con 0x7fc8a00a4820 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1902153861 0 0) 0x7fc8a00a1e00 con 0x7fc8a0134970 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8a00a1a40 con 0x7fc8a0134970 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc890001b00 con 0x7fc8a00a4820 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): dump: 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.451 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.452 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc89c001480 con 0x7fc8a0134970 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): dump: 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.453 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4266319738 0 0) 0x7fc884003530 con 0x7fc8a013e200 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8a00a1e00 con 0x7fc8a013e200 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc898004fd0 con 0x7fc8a013e200 2024-04-25T23:57:05.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient(hunting): dump: 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.455 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3912184883 0 0) 0x7fc8a013a200 con 0x7fc8a00a4820 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6791/0 conn(0x7fc8a0134970 legacy=0x7fc8a01d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6790/0 conn(0x7fc8a013e200 legacy=0x7fc8a01d4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 monclient: found mon.f 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8a013c560 con 0x7fc8a00a4820 2024-04-25T23:57:05.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 5 monclient: authenticate success, global_id 134371 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: _renew_subs 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc8a013bcc0 con 0x7fc8a00a4820 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: _renew_subs 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc8a013cd10 con 0x7fc8a00a4820 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc890001ca0 con 0x7fc8a00a4820 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc890003c10 con 0x7fc8a00a4820 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc897fff640 4 set_mon_vals no callback set 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 10 monclient: dump: 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.458 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc8880065d0 con 0x7fc888002870 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.447+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc89000e9b0 con 0x7fc8a00a4820 2024-04-25T23:57:05.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7fc890043230 con 0x7fc8a00a4820 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 675485156 0 0) 0x7fc8880065d0 con 0x7fc888002870 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient(hunting): my global_id is 134332 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8a013a200 con 0x7fc888002870 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8a6030640 10 monclient: get_auth_request con 0x7fc8840380a0 auth_method 0 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2372437175 0 0) 0x7fc8a013a200 con 0x7fc888002870 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8880065d0 con 0x7fc888002870 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc89c003940 con 0x7fc888002870 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:05.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient: dump: 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.461 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1370308308 0 0) 0x7fc8880065d0 con 0x7fc888002870 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc88800a160 con 0x7fc888002870 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc89c003d30 con 0x7fc888002870 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6792/0 conn(0x7fc888002870 legacy=0x7fc888004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.451+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6792/0 conn(0x7fc888002870 legacy=0x7fc888004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.455+0000 7fc8a7a93640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:05.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.455+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc888009e30 con 0x7fc8880090f0 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 270335212 0 0) 0x7fc888009e30 con 0x7fc8880090f0 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient(hunting): my global_id is 134341 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8880065d0 con 0x7fc8880090f0 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2963344666 0 0) 0x7fc8880065d0 con 0x7fc8880090f0 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc888009e30 con 0x7fc8880090f0 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc89c0044d0 con 0x7fc8880090f0 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:05.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient: dump: 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.467 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3428998251 0 0) 0x7fc888009e30 con 0x7fc8880090f0 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc88800c3a0 con 0x7fc8880090f0 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 3526442855) 0x7fc89c0059a0 con 0x7fc8880090f0 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6792/0 conn(0x7fc8880090f0 legacy=0x7fc888009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8967fc640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6792/0 conn(0x7fc8880090f0 legacy=0x7fc888009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 20, 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 13459, 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:57:05.469 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 7, 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:05.470 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.471 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.472 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:05.473 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:05.474 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:05.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.476 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:05.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.478 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.483 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.488 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:05.489 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:05.490 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:05.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6812/722422047 conn(0x7fc8840380a0 legacy=0x7fc88403a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 10 monclient: shutdown 2024-04-25T23:57:05.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 >> v1:172.21.15.171:6789/0 conn(0x7fc8a00a4820 legacy=0x7fc8a012d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a6030640 1 -- 172.21.15.106:0/3576029944 reap_dead start 2024-04-25T23:57:05.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a6030640 1 -- 172.21.15.106:0/3576029944 reap_dead start 2024-04-25T23:57:05.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 shutdown_connections 2024-04-25T23:57:05.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 >> 172.21.15.106:0/3576029944 conn(0x7fc8a00a9e20 msgr2=0x7fc8a00a7d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 shutdown_connections 2024-04-25T23:57:05.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.459+0000 7fc8a7a93640 1 -- 172.21.15.106:0/3576029944 wait complete. 2024-04-25T23:57:05.493 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:57:05.493 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['f', 'e', 'i', 'c'] 2024-04-25T23:57:05.493 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-25T23:57:05.493 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-04-25T23:57:05.494 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-25T23:57:05.494 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-04-25T23:57:05.494 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf8858640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6789/0 conn(0x7fcaf4138370 legacy=0x7fcaf41d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf8858640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6789/0 conn(0x7fcaf4138370 legacy=0x7fcaf41d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf8858640 1 --1- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6789/0 conn(0x7fcaf4138370 0x7fcaf41d4d00 :-1 s=OPENED pgs=105 cs=1 l=1).handle_message read tag failed 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf8858640 1 --1- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6789/0 conn(0x7fcaf4138370 0x7fcaf41d4d00 :-1 s=OPENED pgs=105 cs=1 l=1).fault on lossy channel, failing 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: ms_handle_reset current mon v1:172.21.15.171:6789/0 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6789/0 conn(0x7fcaf4138370 legacy=0x7fcaf41d4d00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: _add_conns ranks=[8,0,5,7,4,1,2,3,6] 2024-04-25T23:57:05.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): picked mon.e con 0x7fcaf4137880 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:05.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): picked mon.a con 0x7fcad4041d90 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:05.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): picked mon.h con 0x7fcad4045e30 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:05.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcaf40a1e80 con 0x7fcad4041d90 2024-04-25T23:57:05.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcad4003530 con 0x7fcad4045e30 2024-04-25T23:57:05.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcaf40a2bc0 con 0x7fcaf4137880 2024-04-25T23:57:05.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1392980319 0 0) 0x7fcad4003530 con 0x7fcad4045e30 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6791/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fcad404bf20 con 0x7fcad4045e30 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341669461 0 0) 0x7fcaf40a2bc0 con 0x7fcaf4137880 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6793/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fcad4003530 con 0x7fcaf4137880 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1408139274 0 0) 0x7fcaf40a1e80 con 0x7fcad4041d90 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6789/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fcaf40a2bc0 con 0x7fcad4041d90 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1043630840 0 0) 0x7fcad4003530 con 0x7fcaf4137880 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6791/0 conn(0x7fcad4045e30 legacy=0x7fcad40482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6789/0 conn(0x7fcad4041d90 legacy=0x7fcad4044220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.504 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 monclient: found mon.e 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7fcad404cf50 con 0x7fcaf4137880 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcadc0011d0 con 0x7fcaf4137880 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: dump: 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.505 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.506 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.507 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.507 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcadc005120 con 0x7fcaf4137880 2024-04-25T23:57:05.507 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.507 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf27fc640 4 set_mon_vals no callback set 2024-04-25T23:57:05.507 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.517+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcadc00fed0 con 0x7fcaf4137880 2024-04-25T23:57:05.513 INFO:tasks.ceph.mon.f:Stopped 2024-04-25T23:57:05.513 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-04-25T23:57:05.513 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-25T23:57:05.513 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-04-25T23:57:05.513 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf37fe640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6793/0 conn(0x7fcaf4137880 legacy=0x7fcad40404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf37fe640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6793/0 conn(0x7fcaf4137880 legacy=0x7fcad40404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf37fe640 1 --1- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6793/0 conn(0x7fcaf4137880 0x7fcad40404f0 :-1 s=OPENED pgs=71 cs=1 l=1).handle_message read tag failed 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf37fe640 1 --1- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6793/0 conn(0x7fcaf4137880 0x7fcad40404f0 :-1 s=OPENED pgs=71 cs=1 l=1).fault on lossy channel, failing 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: ms_handle_reset current mon v1:172.21.15.106:6793/0 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf8858640 1 -- 172.21.15.171:0/4161341202 reap_dead start 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6793/0 conn(0x7fcaf4137880 legacy=0x7fcad40404f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: _add_conns ranks=[3,2,4,6,1,7] 2024-04-25T23:57:05.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): picked mon.g con 0x7fcad404cb50 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:05.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): picked mon.b con 0x7fcad404aef0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:05.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): picked mon.c con 0x7fcad404b2d0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:05.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcad4003530 con 0x7fcad404aef0 2024-04-25T23:57:05.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcad404bf20 con 0x7fcad404cb50 2024-04-25T23:57:05.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcaf40a1e80 con 0x7fcad404b2d0 2024-04-25T23:57:05.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755988120 0 0) 0x7fcad4003530 con 0x7fcad404aef0 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fcad404f130 con 0x7fcad404aef0 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476742476 0 0) 0x7fcad404bf20 con 0x7fcad404cb50 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.171:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fcad4003530 con 0x7fcad404cb50 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922398931 0 0) 0x7fcaf40a1e80 con 0x7fcad404b2d0 2024-04-25T23:57:05.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6791/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7fcad404bf20 con 0x7fcad404b2d0 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 3726839464 0 0) 0x7fcad404f130 con 0x7fcad404aef0 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6791/0 conn(0x7fcad404b2d0 legacy=0x7fcad404b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6790/0 conn(0x7fcad404cb50 legacy=0x7fcad40482f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 monclient: found mon.b 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+}) -- 0x7fcad4052160 con 0x7fcad404aef0 2024-04-25T23:57:05.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcaec015a00 con 0x7fcad404aef0 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: dump: 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.522 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.523 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:05.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcaec015300 con 0x7fcad404aef0 2024-04-25T23:57:05.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf1ffb640 4 set_mon_vals no callback set 2024-04-25T23:57:05.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.533+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcaec042510 con 0x7fcad404aef0 2024-04-25T23:57:05.525 INFO:tasks.ceph.mon.e:Stopped 2024-04-25T23:57:05.525 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-04-25T23:57:05.525 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i store 2024-04-25T23:57:05.525 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i sync_force --yes-i-really-mean-it 2024-04-25T23:57:05.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.569+0000 7fcafa2bb640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}] 2024-04-25T23:57:05.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.573+0000 7fcafa2bb640 10 monclient: _send_command 2 [{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}] 2024-04-25T23:57:05.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.573+0000 7fcafa2bb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:05.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:05.573+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]} v 0) -- 0x7fcacc0050f0 con 0x7fcad404aef0 2024-04-25T23:57:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient: get_monmap_and_config 2024-04-25T23:57:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient: monmap: 2024-04-25T23:57:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:05.704744+0000 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:05.704744+0000 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.686 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 1 Processor -- start 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 1 -- start start 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient: init 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient: _add_conns ranks=[8,6,0,1,7,3,4,2,5] 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient(hunting): picked mon.noname-e con 0x7f7d04134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient(hunting): picked mon.noname-d con 0x7f7d040a4820 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient(hunting): picked mon.noname-a con 0x7f7d0413e200 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0406dd40 con 0x7f7d0413e200 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d040a2b10 con 0x7f7d040a4820 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d040a2df0 con 0x7f7d04134970 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d0b9dc640 10 monclient(hunting): authenticate will time out at 1081.231937s 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.699+0000 7f7d09778640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f7d04134970 legacy=0x7f7d04134d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d09f79640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7d0413e200 0x7f7d041405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47844/0 (socket says 172.21.15.106:47844) 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d09f79640 1 -- 172.21.15.106:0/207447359 learned_addr learned my addr 172.21.15.106:0/207447359 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d08f77640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f7d040a4820 0x7f7d0413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:51822/0 (socket says 172.21.15.106:51822) 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1642315918 0 0) 0x7f7d0406dd40 con 0x7f7d0413e200 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): my global_id is 5004 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cf0003530 con 0x7f7d0413e200 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338775544 0 0) 0x7f7d040a2b10 con 0x7f7d040a4820 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient(hunting): my global_id is 4992 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d0406dd40 con 0x7f7d040a4820 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3627319656 0 0) 0x7f7cf0003530 con 0x7f7d0413e200 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 >> v1:172.21.15.106:6793/0 conn(0x7f7d04134970 legacy=0x7f7d04134d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 >> v1:172.21.15.106:6792/0 conn(0x7f7d040a4820 legacy=0x7f7d0413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 monclient: found mon.noname-a 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d040a30d0 con 0x7f7d0413e200 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cfc001b40 con 0x7f7d0413e200 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: dump: 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 5 monclient: authenticate success, global_id 5004 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cfc001df0 con 0x7f7d0413e200 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 1 -- 172.21.15.106:0/207447359 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cfc004f70 con 0x7f7d0413e200 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 4 set_mon_vals no callback set 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfbfff640 10 monclient: dump: 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: shutdown 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/207447359 >> v1:172.21.15.106:6789/0 conn(0x7f7d0413e200 legacy=0x7f7d041405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/207447359 shutdown_connections 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/207447359 >> 172.21.15.106:0/207447359 conn(0x7f7d040a9e20 msgr2=0x7f7d040aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/207447359 shutdown_connections 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/207447359 wait complete. 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: monmap: 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.701 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 Processor -- start 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- start start 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: init 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: _add_conns ranks=[6,8,3,4,2,1,0,7,5] 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient(hunting): picked mon.noname-d con 0x7f7d040a4820 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient(hunting): picked mon.noname-e con 0x7f7d04134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient(hunting): picked mon.noname-g con 0x7f7d0413e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d041396d0 con 0x7f7d0413e200 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d0413bef0 con 0x7f7d040a4820 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d040a1e00 con 0x7f7d04134970 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient(hunting): authenticate will time out at 1081.234830s 2024-04-25T23:57:05.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d08f77640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f7d04134970 legacy=0x7f7d04138fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d09778640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f7d040a4820 0x7f7d041388b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:51824/0 (socket says 172.21.15.106:51824) 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d09778640 1 -- 172.21.15.106:0/3774582876 learned_addr learned my addr 172.21.15.106:0/3774582876 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 468764394 0 0) 0x7f7d0413bef0 con 0x7f7d040a4820 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): my global_id is 5001 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce8003530 con 0x7f7d040a4820 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2316956126 0 0) 0x7f7ce8003530 con 0x7f7d040a4820 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d0413bef0 con 0x7f7d040a4820 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cf4004300 con 0x7f7d040a4820 2024-04-25T23:57:05.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.705 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 704646487 0 0) 0x7f7d0413bef0 con 0x7f7d040a4820 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.106:6793/0 conn(0x7f7d04134970 legacy=0x7f7d04138fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.171:6790/0 conn(0x7f7d0413e200 legacy=0x7f7d041d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 monclient: found mon.d 2024-04-25T23:57:05.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d0413b930 con 0x7f7d040a4820 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 5 monclient: authenticate success, global_id 5001 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: _renew_subs 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d0413bc10 con 0x7f7d040a4820 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: _renew_subs 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d04133f70 con 0x7f7d040a4820 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cf40045f0 con 0x7f7d040a4820 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cf4004b60 con 0x7f7d040a4820 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cfb7fe640 4 set_mon_vals no callback set 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.703+0000 7f7cf9ffb640 10 monclient: dump: 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.708 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7d0b9dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7ce40065d0 con 0x7f7ce4002870 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7cf4004d00 con 0x7f7d040a4820 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7f7cf4044480 con 0x7f7d040a4820 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7d09f79640 10 monclient: get_auth_request con 0x7f7ce80377e0 auth_method 0 2024-04-25T23:57:05.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412418441 0 0) 0x7f7ce40065d0 con 0x7f7ce4002870 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient(hunting): my global_id is 134350 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d0413bef0 con 0x7f7ce4002870 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2632719596 0 0) 0x7f7d0413bef0 con 0x7f7ce4002870 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce40065d0 con 0x7f7ce4002870 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7d00001720 con 0x7f7ce4002870 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:05.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient: dump: 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.711 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1073800294 0 0) 0x7f7ce40065d0 con 0x7f7ce4002870 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ce400a160 con 0x7f7ce4002870 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7d00001cb0 con 0x7f7ce4002870 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.171:6792/0 conn(0x7f7ce4002870 legacy=0x7f7ce4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.707+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.171:6792/0 conn(0x7f7ce4002870 legacy=0x7f7ce4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7d0b9dc640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-25T23:57:05.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7ce4009e40 con 0x7f7ce4009100 2024-04-25T23:57:05.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3002829583 0 0) 0x7f7ce4009e40 con 0x7f7ce4009100 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 10 monclient(hunting): my global_id is 134359 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ce40065d0 con 0x7f7ce4009100 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1050681791 0 0) 0x7f7ce40065d0 con 0x7f7ce4009100 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ce4009e40 con 0x7f7ce4009100 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7d00004d20 con 0x7f7ce4009100 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 10 monclient: dump: 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.714 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2739281108 0 0) 0x7f7ce4009e40 con 0x7f7ce4009100 2024-04-25T23:57:05.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.715+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f7ce400c3e0 con 0x7f7ce4009100 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f7d00005060 con 0x7f7ce4009100 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7cf9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7cf9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.171:6792/0 conn(0x7f7ce4009100 legacy=0x7f7ce4009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-25T23:57:05.716 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7cf9ffb640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.171:6792/0 conn(0x7f7ce4009100 legacy=0x7f7ce4009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.171:6812/722422047 conn(0x7f7ce80377e0 legacy=0x7f7ce8039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 10 monclient: shutdown 2024-04-25T23:57:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 >> v1:172.21.15.106:6792/0 conn(0x7f7d040a4820 legacy=0x7f7d041388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d09f79640 1 -- 172.21.15.106:0/3774582876 reap_dead start 2024-04-25T23:57:05.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d09f79640 1 -- 172.21.15.106:0/3774582876 reap_dead start 2024-04-25T23:57:05.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 shutdown_connections 2024-04-25T23:57:05.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 >> 172.21.15.106:0/3774582876 conn(0x7f7d040a9e20 msgr2=0x7f7d04067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 shutdown_connections 2024-04-25T23:57:05.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.719+0000 7f7d0b9dc640 1 -- 172.21.15.106:0/3774582876 wait complete. 2024-04-25T23:57:05.719 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-04-25T23:57:05.719 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-04-25T23:57:05.719 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:57:05.741 INFO:tasks.ceph.mon.i:Stopped 2024-04-25T23:57:05.741 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-25T23:57:05.741 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-25T23:57:05.741 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T23:57:05.741 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:57:05.751 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T23:57:05.751 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-04-25T23:57:05.751 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:57:05.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e is failed for ~0s 2024-04-25T23:57:05.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i is failed for ~0s 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient: get_monmap_and_config 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient: monmap: 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:05.931437+0000 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:05.931437+0000 2024-04-25T23:57:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.913 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 1 Processor -- start 2024-04-25T23:57:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 1 -- start start 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient: init 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient: _add_conns ranks=[5,3,6,1,0,7,8,2,4] 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient(hunting): picked mon.noname-h con 0x7f21ac06e3e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient(hunting): picked mon.noname-g con 0x7f21ac06fba0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient(hunting): picked mon.noname-d con 0x7f21ac06eed0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac070f80 con 0x7f21ac06fba0 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac071e00 con 0x7f21ac06e3e0 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac0709c0 con 0x7f21ac06eed0 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient(hunting): authenticate will time out at 1081.458783s 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21ab7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f21ac06eed0 0x7f21ac13c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:51834/0 (socket says 172.21.15.106:51834) 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21ab7fe640 1 -- 172.21.15.106:0/3594188886 learned_addr learned my addr 172.21.15.106:0/3594188886 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745096261 0 0) 0x7f21ac0709c0 con 0x7f21ac06eed0 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient(hunting): my global_id is 5010 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2198003450 con 0x7f21ac06eed0 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1533110286 0 0) 0x7f2198003450 con 0x7f21ac06eed0 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 >> v1:172.21.15.171:6791/0 conn(0x7f21ac06e3e0 legacy=0x7f21ac06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 >> v1:172.21.15.171:6790/0 conn(0x7f21ac06fba0 legacy=0x7f21ac1391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 monclient: found mon.noname-d 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac070ca0 con 0x7f21ac06eed0 2024-04-25T23:57:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21a40017c0 con 0x7f21ac06eed0 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: dump: 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 5 monclient: authenticate success, global_id 5010 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21a4001ab0 con 0x7f21ac06eed0 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 1 -- 172.21.15.106:0/3594188886 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21a4004bf0 con 0x7f21ac06eed0 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21b1a38640 4 set_mon_vals no callback set 2024-04-25T23:57:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.927+0000 7f21a9ffb640 10 monclient: dump: 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: shutdown 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3594188886 >> v1:172.21.15.106:6792/0 conn(0x7f21ac06eed0 legacy=0x7f21ac13c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3594188886 shutdown_connections 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3594188886 >> 172.21.15.106:0/3594188886 conn(0x7f21ac0a64e0 msgr2=0x7f21ac0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3594188886 shutdown_connections 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3594188886 wait complete. 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: build_initial_monmap 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: monmap: 2024-04-25T23:57:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 Processor -- start 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- start start 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: init 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _add_conns ranks=[7,6,8,4,3,1,5,0,2] 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient(hunting): picked mon.noname-i con 0x7f21ac06e3e0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient(hunting): picked mon.noname-d con 0x7f21ac06eed0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient(hunting): picked mon.noname-e con 0x7f21ac06fba0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac072060 con 0x7f21ac06eed0 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac1a9ef0 con 0x7f21ac06e3e0 2024-04-25T23:57:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21ac1aa1d0 con 0x7f21ac06fba0 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21ab7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f21ac06fba0 legacy=0x7f21ac1d5420 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient(hunting): authenticate will time out at 1081.461848s 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21aaffd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f21ac06e3e0 legacy=0x7f21ac1cccd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21aa7fc640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f21ac06eed0 0x7f21ac1d1cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:51850/0 (socket says 172.21.15.106:51850) 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21aa7fc640 1 -- 172.21.15.106:0/3559160031 learned_addr learned my addr 172.21.15.106:0/3559160031 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 376610997 0 0) 0x7f219c0014e0 con 0x7f21ac06eed0 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): my global_id is 5019 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f218c003530 con 0x7f21ac06eed0 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2347611339 0 0) 0x7f218c003530 con 0x7f21ac06eed0 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f219c0014e0 con 0x7f21ac06eed0 2024-04-25T23:57:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f219c001f90 con 0x7f21ac06eed0 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): dump: 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2303758097 0 0) 0x7f219c0014e0 con 0x7f21ac06eed0 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 >> v1:172.21.15.106:6793/0 conn(0x7f21ac06fba0 legacy=0x7f21ac1d5420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 >> v1:172.21.15.171:6792/0 conn(0x7f21ac06e3e0 legacy=0x7f21ac1cccd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 monclient: found mon.d 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21ac1a8660 con 0x7f21ac06eed0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 5 monclient: authenticate success, global_id 5019 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _renew_subs 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f21ac1aa4b0 con 0x7f21ac06eed0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _renew_subs 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f21ac1a75b0 con 0x7f21ac06eed0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f219c003d80 con 0x7f21ac06eed0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f219c0042f0 con 0x7f21ac06eed0 2024-04-25T23:57:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a97fa640 4 set_mon_vals no callback set 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 10 monclient: dump: 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f219c004490 con 0x7f21ac06eed0 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2190005090 con 0x7f21ac06eed0 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.931+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7f219c0449a0 con 0x7f21ac06eed0 2024-04-25T23:57:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.935+0000 7f21aaffd640 10 monclient: get_auth_request con 0x7f218c037780 auth_method 0 2024-04-25T23:57:05.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.939+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f21ac072060 con 0x7f21ac06eed0 2024-04-25T23:57:05.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.939+0000 7f21a3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:05.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:05.939+0000 7f21a3fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.159+0000 7f21b1a38640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:57:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.159+0000 7f21b1a38640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.159+0000 7f21b1a38640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.159+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2190005380 con 0x7f21ac06eed0 2024-04-25T23:57:06.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.159+0000 7f21a3fff640 1 -- 172.21.15.106:0/3559160031 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 3758347925) 0x7f21ac070f80 con 0x7f21ac06eed0 2024-04-25T23:57:06.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.159+0000 7f21a3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:06.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.159+0000 7f21a3fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:06.145 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":20,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":7,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:57:06.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 >> v1:172.21.15.171:6812/722422047 conn(0x7f218c037780 legacy=0x7f218c039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:06.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 10 monclient: shutdown 2024-04-25T23:57:06.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:06.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 >> v1:172.21.15.106:6792/0 conn(0x7f21ac06eed0 legacy=0x7f21ac1d1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:06.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 shutdown_connections 2024-04-25T23:57:06.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 >> 172.21.15.106:0/3559160031 conn(0x7f21ac0a64e0 msgr2=0x7f21ac0a4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:06.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 shutdown_connections 2024-04-25T23:57:06.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:06.163+0000 7f21b1a38640 1 -- 172.21.15.106:0/3559160031 wait complete. 2024-04-25T23:57:08.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:08.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:08.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:08.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:08.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:08.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:08.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:08.397+0000 7fcaeb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:09.164 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient: get_monmap_and_config 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient: build_initial_monmap 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient: monmap: 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:09.315318+0000 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:09.315318+0000 2024-04-25T23:57:09.296 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:09.297 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:09.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 1 Processor -- start 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 1 -- start start 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient: init 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient: _add_conns ranks=[3,8,1,0,2,4,5,6,7] 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient(hunting): picked mon.noname-g con 0x7fd280135870 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient(hunting): picked mon.noname-e con 0x7fd2801353b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient(hunting): picked mon.noname-f con 0x7fd28013bdf0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28006f2d0 con 0x7fd28013bdf0 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd280072330 con 0x7fd280135870 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd280072610 con 0x7fd2801353b0 2024-04-25T23:57:09.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:09.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd287b18640 10 monclient(hunting): authenticate will time out at 1084.842529s 2024-04-25T23:57:09.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd2850b3640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fd2801353b0 legacy=0x7fd28013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:09.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd2860b5640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fd28013bdf0 legacy=0x7fd28013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:09.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd2858b4640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd280135870 0x7fd280135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:38154/0 (socket says 172.21.15.106:38154) 2024-04-25T23:57:09.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.311+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 learned_addr learned my addr 172.21.15.106:0/3519549524 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:09.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:09.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:09.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:09.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.515+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd2801353b0 legacy=0x7fd28013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:09.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.515+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd28013bdf0 legacy=0x7fd28013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:09.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.919+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd2801353b0 legacy=0x7fd28013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:09.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:09.919+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd28013bdf0 legacy=0x7fd28013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:10.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:10.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:10.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:10.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:10.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:10.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:10.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:10.722+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd2801353b0 legacy=0x7fd28013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:10.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:10.722+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd28013bdf0 legacy=0x7fd28013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:11.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:11.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:11.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:11.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:11.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:11.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:12.051 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.e has been restored 2024-04-25T23:57:12.052 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.i has been restored 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient(hunting): tick 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd2801353b0 legacy=0x7fd28013a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6790/0 conn(0x7fd280135870 legacy=0x7fd280135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd28013bdf0 legacy=0x7fd28013e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient: _add_conns ranks=[2,0,5,7,4,6] 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fd26c0037b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fd26c0073a0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-h con 0x7fd26c00b130 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:12.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2800a3260 con 0x7fd26c0073a0 2024-04-25T23:57:12.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28006f2d0 con 0x7fd26c0037b0 2024-04-25T23:57:12.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd280072610 con 0x7fd26c00b130 2024-04-25T23:57:12.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:12.314+0000 7fd27f7fe640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:12.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:12.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:12.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:12.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:12.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:12.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:13.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:13.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:13.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:13.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:13.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:13.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:14.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:14.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:14.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:14.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:14.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:14.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:15.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient(hunting): tick 2024-04-25T23:57:15.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6791/0 conn(0x7fd26c00b130 legacy=0x7fd26c00d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6790/0 conn(0x7fd26c0037b0 legacy=0x7fd26c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6789/0 conn(0x7fd26c0073a0 legacy=0x7fd26c009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient: _add_conns ranks=[4,7,6] 2024-04-25T23:57:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fd26c011070 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 reap_dead start 2024-04-25T23:57:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-i con 0x7fd26c013370 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-d con 0x7fd26c00a030 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c012030 con 0x7fd26c011070 2024-04-25T23:57:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c00a4f0 con 0x7fd26c00a030 2024-04-25T23:57:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c00a6c0 con 0x7fd26c013370 2024-04-25T23:57:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd27f7fe640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.310+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c015760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:15.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:15.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:15.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:15.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:15.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:15.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:15.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.514+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:15.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.514+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c015760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.918+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:15.918+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c015760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:16.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:16.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:16.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:16.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:16.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:16.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:16.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:16.722+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:16.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:16.722+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c015760 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:17.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:17.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:17.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:17.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:17.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:17.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:18.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient(hunting): tick 2024-04-25T23:57:18.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:18.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:18.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c015760 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6792/0 conn(0x7fd26c00a030 legacy=0x7fd26c009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient: _add_conns ranks=[1,8,4,3,7,5,0,6,2] 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-f con 0x7fd26c00a890 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-e con 0x7fd26c00e4d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-c con 0x7fd26c011070 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c005c50 con 0x7fd26c00a890 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c012030 con 0x7fd26c011070 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c00a6c0 con 0x7fd26c00e4d0 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd27f7fe640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd26c00e4d0 legacy=0x7fd26c00c5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:18.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.314+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd26c00a890 legacy=0x7fd26c00ddc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:18.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:18.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:18.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:18.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:18.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:18.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:18.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:18.397+0000 7fcaeb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.518+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.518+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd26c00e4d0 legacy=0x7fd26c00c5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:18.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.518+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd26c00a890 legacy=0x7fd26c00ddc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.922+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.922+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd26c00e4d0 legacy=0x7fd26c00c5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:18.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:18.922+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd26c00a890 legacy=0x7fd26c00ddc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:19.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:19.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:19.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:19.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:19.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:19.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:19.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:19.726+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:19.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:19.726+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd26c00e4d0 legacy=0x7fd26c00c5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:19.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:19.726+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd26c00a890 legacy=0x7fd26c00ddc0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:20.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:20.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:20.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:20.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:20.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:20.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient(hunting): tick 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6793/0 conn(0x7fd26c00e4d0 legacy=0x7fd26c00c5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6791/0 conn(0x7fd26c011070 legacy=0x7fd26c0114b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6789/0 conn(0x7fd26c00a890 legacy=0x7fd26c00ddc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient: _add_conns ranks=[7,5,6,3,2,0] 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 reap_dead start 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-i con 0x7fd26c013370 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:21.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-h con 0x7fd26c00a890 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:21.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-d con 0x7fd26c00a030 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:21.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c00ac70 con 0x7fd26c00a890 2024-04-25T23:57:21.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c005c50 con 0x7fd26c00a030 2024-04-25T23:57:21.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c012030 con 0x7fd26c013370 2024-04-25T23:57:21.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd27f7fe640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:21.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.314+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c00cd00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:21.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:21.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:21.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:21.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:21.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:21.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:21.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.518+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c00cd00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:21.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:21.922+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c00cd00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:22.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:22.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:22.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:22.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:22.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:22.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:22.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:22.726+0000 7fd2858b4640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c00cd00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:23.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:23.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:23.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:23.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:23.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:23.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient(hunting): tick 2024-04-25T23:57:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6792/0 conn(0x7fd26c013370 legacy=0x7fd26c00cd00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6792/0 conn(0x7fd26c00a030 legacy=0x7fd26c00d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:24.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6791/0 conn(0x7fd26c00a890 legacy=0x7fd26c011450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient: _add_conns ranks=[0,2,3] 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fd26c006290 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-b con 0x7fd26c00c5d0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient(hunting): picked mon.noname-g con 0x7fd26c006d80 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c00a6c0 con 0x7fd26c006290 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c012030 con 0x7fd26c00c5d0 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd26c00ca20 con 0x7fd26c006d80 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd27f7fe640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6790/0 conn(0x7fd26c00c5d0 legacy=0x7fd26c006670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd2850b3640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6790/0 conn(0x7fd26c00c5d0 legacy=0x7fd26c006670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T23:57:24.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:24.314+0000 7fd2850b3640 1 --1- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6790/0 conn(0x7fd26c00c5d0 0x7fd26c006670 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=0).handle_connect_reply_1 read connect reply failed 2024-04-25T23:57:24.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:24.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:24.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:24.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:24.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:24.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3756594256 0 0) 0x7fd26c00ca20 con 0x7fd26c006d80 2024-04-25T23:57:25.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient(hunting): my global_id is 5088 2024-04-25T23:57:25.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd268003530 con 0x7fd26c006d80 2024-04-25T23:57:25.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2232328023 0 0) 0x7fd268003530 con 0x7fd26c006d80 2024-04-25T23:57:25.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6790/0 conn(0x7fd26c00c5d0 legacy=0x7fd26c006670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.106:6789/0 conn(0x7fd26c006290 legacy=0x7fd26c009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 monclient: found mon.noname-g 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c01fef0 con 0x7fd26c006d80 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2860b5640 1 -- 172.21.15.106:0/3519549524 reap_dead start 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd2700040d0 con 0x7fd26c006d80 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: dump: 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.278 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 5 monclient: authenticate success, global_id 5088 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd270004370 con 0x7fd26c006d80 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 1 -- 172.21.15.106:0/3519549524 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd2700048e0 con 0x7fd26c006d80 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd2848b2640 10 monclient: dump: 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.280 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 4 set_mon_vals no callback set 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 10 monclient: shutdown 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 1 -- 172.21.15.106:0/3519549524 >> v1:172.21.15.171:6790/0 conn(0x7fd26c006d80 legacy=0x7fd26c01b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 1 -- 172.21.15.106:0/3519549524 shutdown_connections 2024-04-25T23:57:25.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 1 -- 172.21.15.106:0/3519549524 >> 172.21.15.106:0/3519549524 conn(0x7fd2800a64e0 msgr2=0x7fd2800a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:25.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 1 -- 172.21.15.106:0/3519549524 shutdown_connections 2024-04-25T23:57:25.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 1 -- 172.21.15.106:0/3519549524 wait complete. 2024-04-25T23:57:25.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 10 monclient: build_initial_monmap 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.290+0000 7fd287b18640 10 monclient: monmap: 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:25.287 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 Processor -- start 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 -- start start 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: init 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _add_conns ranks=[7,6,0,4,8,3,1,2,5] 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient(hunting): picked mon.noname-i con 0x7fd26c006d80 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:25.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient(hunting): picked mon.noname-d con 0x7fd280138c20 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient(hunting): picked mon.noname-a con 0x7fd2801d2aa0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28013c970 con 0x7fd2801d2aa0 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28009f470 con 0x7fd280138c20 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28013a130 con 0x7fd26c006d80 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient(hunting): authenticate will time out at 1100.824971s 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd2858b4640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fd26c006d80 legacy=0x7fd280138510 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd2850b3640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fd280138c20 0x7fd280139040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:57190/0 (socket says 172.21.15.106:57190) 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd2860b5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd2801d2aa0 0x7fd2801d4e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:37608/0 (socket says 172.21.15.106:37608) 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd2850b3640 1 -- 172.21.15.106:0/2235475814 learned_addr learned my addr 172.21.15.106:0/2235475814 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064656675 0 0) 0x7fd28009f470 con 0x7fd280138c20 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): my global_id is 5028 2024-04-25T23:57:25.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd26c00ae80 con 0x7fd280138c20 2024-04-25T23:57:25.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3213762540 0 0) 0x7fd26c00ae80 con 0x7fd280138c20 2024-04-25T23:57:25.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd28009f470 con 0x7fd280138c20 2024-04-25T23:57:25.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd274004350 con 0x7fd280138c20 2024-04-25T23:57:25.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:25.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:25.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): dump: 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.291 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4218365329 0 0) 0x7fd28009f470 con 0x7fd280138c20 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 >> v1:172.21.15.171:6792/0 conn(0x7fd26c006d80 legacy=0x7fd280138510 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 >> v1:172.21.15.106:6789/0 conn(0x7fd2801d2aa0 legacy=0x7fd2801d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 monclient: found mon.d 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28013cd30 con 0x7fd280138c20 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 5 monclient: authenticate success, global_id 5028 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _renew_subs 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd280141f20 con 0x7fd280138c20 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _renew_subs 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fd2801d65b0 con 0x7fd280138c20 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2740047e0 con 0x7fd280138c20 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd274004d50 con 0x7fd280138c20 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27ffff640 4 set_mon_vals no callback set 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:25.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 10 monclient: dump: 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.294 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd274005fa0 con 0x7fd280138c20 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd260005090 con 0x7fd280138c20 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.294+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7fd2740443c0 con 0x7fd280138c20 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.298+0000 7fd2858b4640 10 monclient: get_auth_request con 0x7fd26c03a990 auth_method 0 2024-04-25T23:57:25.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.302+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd2740156e0 con 0x7fd280138c20 2024-04-25T23:57:25.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.302+0000 7fd27e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.302+0000 7fd27e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:25.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:25.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:25.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:25.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:25.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.518+0000 7fd287b18640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.518+0000 7fd287b18640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.518+0000 7fd287b18640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.518+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd260005380 con 0x7fd280138c20 2024-04-25T23:57:25.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.518+0000 7fd27e7fc640 1 -- 172.21.15.106:0/2235475814 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2720 (unknown 254746657 0 2766775810) 0x7fd274014fe0 con 0x7fd280138c20 2024-04-25T23:57:25.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.518+0000 7fd27e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:57:25.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.518+0000 7fd27e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:25.505 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":26,"quorum":[0,2,3,5,6],"quorum_names":["a","b","g","h","d"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 >> v1:172.21.15.171:6812/722422047 conn(0x7fd26c03a990 legacy=0x7fd26c03ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 10 monclient: shutdown 2024-04-25T23:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:25.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 >> v1:172.21.15.106:6792/0 conn(0x7fd280138c20 legacy=0x7fd280139040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 shutdown_connections 2024-04-25T23:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 >> 172.21.15.106:0/2235475814 conn(0x7fd2800a64e0 msgr2=0x7fd2800a4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 shutdown_connections 2024-04-25T23:57:25.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.522+0000 7fd287b18640 1 -- 172.21.15.106:0/2235475814 wait complete. 2024-04-25T23:57:25.523 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-04-25T23:57:25.523 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-04-25T23:57:25.523 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:57:25.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.658+0000 7fe0b478b640 10 monclient: get_monmap_and_config 2024-04-25T23:57:25.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.658+0000 7fe0b478b640 10 monclient: build_initial_monmap 2024-04-25T23:57:25.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.658+0000 7fe0b478b640 10 monclient: monmap: 2024-04-25T23:57:25.645 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:25.664699+0000 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:25.664699+0000 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:25.646 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.658+0000 7fe0b478b640 1 Processor -- start 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.658+0000 7fe0b478b640 1 -- start start 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.658+0000 7fe0b478b640 10 monclient: init 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: _add_conns ranks=[5,2,0,1,6,3,8,7,4] 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): picked mon.noname-h con 0x7fe0ac06e3e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): picked mon.noname-b con 0x7fe0ac06fba0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): picked mon.noname-a con 0x7fe0ac06eed0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ac070f80 con 0x7fe0ac06eed0 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ac071e00 con 0x7fe0ac06fba0 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ac0709c0 con 0x7fe0ac06e3e0 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:25.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): authenticate will time out at 1101.192636s 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1d26640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fe0ac06fba0 0x7fe0ac1391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:33276/0 (socket says 172.21.15.106:33276) 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1d26640 1 -- 172.21.15.106:0/2385799132 learned_addr learned my addr 172.21.15.106:0/2385799132 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176108072 0 0) 0x7fe0a40014a0 con 0x7fe0ac06eed0 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): my global_id is 5013 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe098003530 con 0x7fe0ac06eed0 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553868666 0 0) 0x7fe0ac071e00 con 0x7fe0ac06fba0 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient(hunting): my global_id is 5087 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0a40014a0 con 0x7fe0ac06fba0 2024-04-25T23:57:25.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1909224874 0 0) 0x7fe098003530 con 0x7fe0ac06eed0 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 >> v1:172.21.15.171:6791/0 conn(0x7fe0ac06e3e0 legacy=0x7fe0ac06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 >> v1:172.21.15.106:6790/0 conn(0x7fe0ac06fba0 legacy=0x7fe0ac1391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 monclient: found mon.noname-a 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac070ca0 con 0x7fe0ac06eed0 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0a4001d10 con 0x7fe0ac06eed0 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 5 monclient: authenticate success, global_id 5013 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: dump: 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.654 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0a4001f80 con 0x7fe0ac06eed0 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 4 set_mon_vals no callback set 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 1 -- 172.21.15.106:0/2385799132 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0a4003ce0 con 0x7fe0ac06eed0 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1525640 10 monclient: dump: 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.655 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: shutdown 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:25.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- 172.21.15.106:0/2385799132 >> v1:172.21.15.106:6789/0 conn(0x7fe0ac06eed0 legacy=0x7fe0ac13c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- 172.21.15.106:0/2385799132 shutdown_connections 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- 172.21.15.106:0/2385799132 >> 172.21.15.106:0/2385799132 conn(0x7fe0ac0a64e0 msgr2=0x7fe0ac0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- 172.21.15.106:0/2385799132 shutdown_connections 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- 172.21.15.106:0/2385799132 wait complete. 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: build_initial_monmap 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: monmap: 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:25.657 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 Processor -- start 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- start start 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: init 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient: _add_conns ranks=[1,3,7,8,5,2,6,0,4] 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): picked mon.noname-f con 0x7fe0ac06e3e0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): picked mon.noname-g con 0x7fe0ac06eed0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:25.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): picked mon.noname-i con 0x7fe0ac06fba0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ac09e460 con 0x7fe0ac06e3e0 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ac120960 con 0x7fe0ac06eed0 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0ac121620 con 0x7fe0ac06fba0 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b478b640 10 monclient(hunting): authenticate will time out at 1101.195544s 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b2d28640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fe0ac06fba0 legacy=0x7fe0ac1d4e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b2527640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fe0ac06e3e0 legacy=0x7fe0ac137860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1d26640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fe0ac06eed0 0x7fe0ac1d16e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:39790/0 (socket says 172.21.15.106:39790) 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.662+0000 7fe0b1d26640 1 -- 172.21.15.106:0/3303373931 learned_addr learned my addr 172.21.15.106:0/3303373931 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283044843 0 0) 0x7fe0ac120960 con 0x7fe0ac06eed0 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): my global_id is 5097 2024-04-25T23:57:25.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe090003530 con 0x7fe0ac06eed0 2024-04-25T23:57:25.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 576266645 0 0) 0x7fe090003530 con 0x7fe0ac06eed0 2024-04-25T23:57:25.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0ac120960 con 0x7fe0ac06eed0 2024-04-25T23:57:25.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe09c001970 con 0x7fe0ac06eed0 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.664 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 966514347 0 0) 0x7fe0ac120960 con 0x7fe0ac06eed0 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.171:6792/0 conn(0x7fe0ac06fba0 legacy=0x7fe0ac1d4e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.171:6789/0 conn(0x7fe0ac06e3e0 legacy=0x7fe0ac137860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 monclient: found mon.g 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0ac122960 con 0x7fe0ac06eed0 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 5 monclient: authenticate success, global_id 5097 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 10 monclient: _renew_subs 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe0ac121a70 con 0x7fe0ac06eed0 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 10 monclient: _renew_subs 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe0ac137f70 con 0x7fe0ac06eed0 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe09c001cf0 con 0x7fe0ac06eed0 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe09c004de0 con 0x7fe0ac06eed0 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b0d24640 4 set_mon_vals no callback set 2024-04-25T23:57:25.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: dump: 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.667 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe0940065d0 con 0x7fe094002870 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423162121 0 0) 0x7fe0940065d0 con 0x7fe094002870 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient(hunting): my global_id is 5022 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0ac120960 con 0x7fe094002870 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe09c00fb80 con 0x7fe0ac06eed0 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7fe09c0443f0 con 0x7fe0ac06eed0 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 48201458 0 0) 0x7fe0ac120960 con 0x7fe094002870 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0940065d0 con 0x7fe094002870 2024-04-25T23:57:25.668 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0a80017a0 con 0x7fe094002870 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: dump: 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.669 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 744347631 0 0) 0x7fe0940065d0 con 0x7fe094002870 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe09400a160 con 0x7fe094002870 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0b2d28640 10 monclient: get_auth_request con 0x7fe090037850 auth_method 0 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe0a8001b80 con 0x7fe094002870 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.106:6789/0 conn(0x7fe094002870 legacy=0x7fe094004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.666+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.106:6789/0 conn(0x7fe094002870 legacy=0x7fe094004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe094009e50 con 0x7fe094009110 2024-04-25T23:57:25.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827731850 0 0) 0x7fe094009e50 con 0x7fe094009110 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient(hunting): my global_id is 5031 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0940065d0 con 0x7fe094009110 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 980991348 0 0) 0x7fe0940065d0 con 0x7fe094009110 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe094009e50 con 0x7fe094009110 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0a8003c30 con 0x7fe094009110 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient: dump: 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.671 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 641225776 0 0) 0x7fe094009e50 con 0x7fe094009110 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe09400c3e0 con 0x7fe094009110 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7523 (unknown 0 0 41762177) 0x7fe0a8003e60 con 0x7fe094009110 2024-04-25T23:57:25.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.106:6789/0 conn(0x7fe094009110 legacy=0x7fe0940095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0a2ffd640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.106:6789/0 conn(0x7fe094009110 legacy=0x7fe0940095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 26, 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 164233, 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:25.673 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.674 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.675 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:25.676 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.677 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.678 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.679 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.680 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.681 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.682 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.683 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:25.684 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.685 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:25.686 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.687 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.688 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:25.689 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:25.690 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.171:6812/722422047 conn(0x7fe090037850 legacy=0x7fe090039d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 10 monclient: shutdown 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 >> v1:172.21.15.171:6790/0 conn(0x7fe0ac06eed0 legacy=0x7fe0ac1d16e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b2d28640 1 -- 172.21.15.106:0/3303373931 reap_dead start 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b2d28640 1 -- 172.21.15.106:0/3303373931 reap_dead start 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 shutdown_connections 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 >> 172.21.15.106:0/3303373931 conn(0x7fe0ac0a64e0 msgr2=0x7fe0ac0a4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:25.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 shutdown_connections 2024-04-25T23:57:25.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.674+0000 7fe0b478b640 1 -- 172.21.15.106:0/3303373931 wait complete. 2024-04-25T23:57:25.693 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:57:25.693 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon b 2024-04-25T23:57:25.693 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:57:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: get_monmap_and_config 2024-04-25T23:57:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: build_initial_monmap 2024-04-25T23:57:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: monmap: 2024-04-25T23:57:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:25.799 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:25.818756+0000 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:25.818756+0000 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:25.800 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 Processor -- start 2024-04-25T23:57:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- start start 2024-04-25T23:57:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: init 2024-04-25T23:57:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: _add_conns ranks=[0,8,3,7,6,5,1,4,2] 2024-04-25T23:57:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient(hunting): picked mon.noname-a con 0x7fcc04134820 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:25.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient(hunting): picked mon.noname-e con 0x7fcc040725d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient(hunting): picked mon.noname-g con 0x7fcc0413ace0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc04071270 con 0x7fcc04134820 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc040714e0 con 0x7fcc0413ace0 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc040729f0 con 0x7fcc040725d0 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient(hunting): authenticate will time out at 1101.345870s 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc037fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fcc040725d0 legacy=0x7fcc041395c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc03fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcc04134820 0x7fcc04134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58722/0 (socket says 172.21.15.106:58722) 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc03fff640 1 -- 172.21.15.106:0/1727411651 learned_addr learned my addr 172.21.15.106:0/1727411651 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3457517980 0 0) 0x7fcc04071270 con 0x7fcc04134820 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient(hunting): my global_id is 5040 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbec003530 con 0x7fcc04134820 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2709295634 0 0) 0x7fcbec003530 con 0x7fcc04134820 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 >> v1:172.21.15.106:6793/0 conn(0x7fcc040725d0 legacy=0x7fcc041395c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 >> v1:172.21.15.171:6790/0 conn(0x7fcc0413ace0 legacy=0x7fcc0413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 monclient: found mon.noname-a 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc040717c0 con 0x7fcc04134820 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbfc0017c0 con 0x7fcc04134820 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: dump: 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.810 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 5 monclient: authenticate success, global_id 5040 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbfc001b20 con 0x7fcc04134820 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 4 set_mon_vals no callback set 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 1 -- 172.21.15.106:0/1727411651 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbfc001d50 con 0x7fcc04134820 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc02ffd640 10 monclient: dump: 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.811 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: shutdown 2024-04-25T23:57:25.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- 172.21.15.106:0/1727411651 >> v1:172.21.15.106:6789/0 conn(0x7fcc04134820 legacy=0x7fcc04134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- 172.21.15.106:0/1727411651 shutdown_connections 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- 172.21.15.106:0/1727411651 >> 172.21.15.106:0/1727411651 conn(0x7fcc040a64e0 msgr2=0x7fcc040a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- 172.21.15.106:0/1727411651 shutdown_connections 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 1 -- 172.21.15.106:0/1727411651 wait complete. 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: build_initial_monmap 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.814+0000 7fcc0a358640 10 monclient: monmap: 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:25.813 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 Processor -- start 2024-04-25T23:57:25.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 -- start start 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient: init 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient: _add_conns ranks=[6,5,1,2,3,0,4,8,7] 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient(hunting): picked mon.noname-d con 0x7fcc040725d0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient(hunting): picked mon.noname-h con 0x7fcc04134820 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient(hunting): picked mon.noname-f con 0x7fcc0413ace0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc0409ca40 con 0x7fcc0413ace0 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc040706a0 con 0x7fcc04134820 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc04072c60 con 0x7fcc040725d0 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient(hunting): authenticate will time out at 1101.348762s 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc03fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fcc040725d0 0x7fcc041293d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:54698/0 (socket says 172.21.15.106:54698) 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc03fff640 1 -- 172.21.15.106:0/2301324264 learned_addr learned my addr 172.21.15.106:0/2301324264 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc088f5640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.171:6789/0 conn(0x7fcc0413ace0 legacy=0x7fcc041d09d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:25.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373844765 0 0) 0x7fcc04072c60 con 0x7fcc040725d0 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): my global_id is 5037 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbf0003530 con 0x7fcc040725d0 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1961875631 0 0) 0x7fcbf0003530 con 0x7fcc040725d0 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcc04072c60 con 0x7fcc040725d0 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbfc001780 con 0x7fcc040725d0 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.816 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 99639776 0 0) 0x7fcc04072c60 con 0x7fcc040725d0 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.171:6791/0 conn(0x7fcc04134820 legacy=0x7fcc041cd2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.171:6789/0 conn(0x7fcc0413ace0 legacy=0x7fcc041d09d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 monclient: found mon.d 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0409c760 con 0x7fcc040725d0 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 5 monclient: authenticate success, global_id 5037 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient: _renew_subs 2024-04-25T23:57:25.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0409b870 con 0x7fcc040725d0 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient: _renew_subs 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fcc0409b600 con 0x7fcc040725d0 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbfc001b20 con 0x7fcc040725d0 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbfc005350 con 0x7fcc040725d0 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc027fc640 4 set_mon_vals no callback set 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: dump: 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.819 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcbe40065d0 con 0x7fcbe4002870 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcbfc0100f0 con 0x7fcc040725d0 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7fcbfc044520 con 0x7fcc040725d0 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294783605 0 0) 0x7fcbe40065d0 con 0x7fcbe4002870 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient(hunting): my global_id is 5096 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc04072c60 con 0x7fcbe4002870 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2268600861 0 0) 0x7fcc04072c60 con 0x7fcbe4002870 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbe40065d0 con 0x7fcbe4002870 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbf8004380 con 0x7fcbe4002870 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: dump: 2024-04-25T23:57:25.821 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.822 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc088f5640 10 monclient: get_auth_request con 0x7fcbf0037760 auth_method 0 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3330904347 0 0) 0x7fcbe40065d0 con 0x7fcbe4002870 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbe400a160 con 0x7fcbe4002870 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcbf80067d0 con 0x7fcbe4002870 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.106:6790/0 conn(0x7fcbe4002870 legacy=0x7fcbe4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.818+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.106:6790/0 conn(0x7fcbe4002870 legacy=0x7fcbe4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:25.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcbe4009e50 con 0x7fcbe4009110 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903963029 0 0) 0x7fcbe4009e50 con 0x7fcbe4009110 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient(hunting): my global_id is 5105 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbe40065d0 con 0x7fcbe4009110 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 82881676 0 0) 0x7fcbe40065d0 con 0x7fcbe4009110 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbe4009e50 con 0x7fcbe4009110 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbf8004e10 con 0x7fcbe4009110 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient: dump: 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.826 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1371457147 0 0) 0x7fcbe4009e50 con 0x7fcbe4009110 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcbe400c3e0 con 0x7fcbe4009110 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7861 (unknown 0 0 330243809) 0x7fcbf80062e0 con 0x7fcbe4009110 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.106:6790/0 conn(0x7fcbe4009110 legacy=0x7fcbe40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc00ff9640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.106:6790/0 conn(0x7fcbe4009110 legacy=0x7fcbe40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:25.827 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 26, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 164389, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:25.828 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:25.829 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.830 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:25.831 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.832 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:25.835 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:25.837 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.839 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:25.840 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:25.842 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.843 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:25.844 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:25.845 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:25.846 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.171:6812/722422047 conn(0x7fcbf0037760 legacy=0x7fcbf0039c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 10 monclient: shutdown 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 >> v1:172.21.15.106:6792/0 conn(0x7fcc040725d0 legacy=0x7fcc041293d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc088f5640 1 -- 172.21.15.106:0/2301324264 reap_dead start 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc088f5640 1 -- 172.21.15.106:0/2301324264 reap_dead start 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 shutdown_connections 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 >> 172.21.15.106:0/2301324264 conn(0x7fcc040a64e0 msgr2=0x7fcc040a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 shutdown_connections 2024-04-25T23:57:25.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.826+0000 7fcc0a358640 1 -- 172.21.15.106:0/2301324264 wait complete. 2024-04-25T23:57:25.849 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:57:25.849 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon d 2024-04-25T23:57:25.849 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: get_monmap_and_config 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: build_initial_monmap 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: monmap: 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:25.979399+0000 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:25.979399+0000 2024-04-25T23:57:25.960 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:25.961 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 1 Processor -- start 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 1 -- start start 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: init 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: _add_conns ranks=[6,3,2,5,0,4,7,1,8] 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient(hunting): picked mon.noname-d con 0x7f0028134970 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient(hunting): picked mon.noname-g con 0x7f00280a4820 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient(hunting): picked mon.noname-b con 0x7f002813e200 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002806dd40 con 0x7f002813e200 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00280a2b10 con 0x7f00280a4820 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00280a2df0 con 0x7f0028134970 2024-04-25T23:57:25.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient(hunting): authenticate will time out at 1101.506496s 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002ce22640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f0028134970 0x7f0028134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:54706/0 (socket says 172.21.15.106:54706) 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002ce22640 1 -- 172.21.15.106:0/897728342 learned_addr learned my addr 172.21.15.106:0/897728342 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983528043 0 0) 0x7f002806dd40 con 0x7f002813e200 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): my global_id is 5114 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0010003530 con 0x7f002813e200 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026700377 0 0) 0x7f00280a2df0 con 0x7f0028134970 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient(hunting): my global_id is 5046 2024-04-25T23:57:25.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f002806dd40 con 0x7f0028134970 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2993294986 0 0) 0x7f002806dd40 con 0x7f0028134970 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 >> v1:172.21.15.171:6790/0 conn(0x7f00280a4820 legacy=0x7f002813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 >> v1:172.21.15.106:6790/0 conn(0x7f002813e200 legacy=0x7f00281405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 monclient: found mon.noname-d 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00280a30d0 con 0x7f0028134970 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00180016d0 con 0x7f0028134970 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: dump: 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.971 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 5 monclient: authenticate success, global_id 5046 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00180019c0 con 0x7f0028134970 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 4 set_mon_vals no callback set 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 1 -- 172.21.15.106:0/897728342 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00180048b0 con 0x7f0028134970 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f00277fe640 10 monclient: dump: 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.972 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 10 monclient: shutdown 2024-04-25T23:57:25.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.974+0000 7f002f086640 1 -- 172.21.15.106:0/897728342 >> v1:172.21.15.106:6792/0 conn(0x7f0028134970 legacy=0x7f0028134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- 172.21.15.106:0/897728342 shutdown_connections 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- 172.21.15.106:0/897728342 >> 172.21.15.106:0/897728342 conn(0x7f00280a9e20 msgr2=0x7f00280aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- 172.21.15.106:0/897728342 shutdown_connections 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- 172.21.15.106:0/897728342 wait complete. 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: build_initial_monmap 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: monmap: 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:25.974 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 Processor -- start 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- start start 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: init 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: _add_conns ranks=[8,0,1,6,4,7,5,3,2] 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient(hunting): picked mon.noname-e con 0x7f00280a4820 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:25.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient(hunting): picked mon.noname-a con 0x7f0028134970 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient(hunting): picked mon.noname-f con 0x7f002813e200 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0028138da0 con 0x7f0028134970 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002ce22640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f00280a4820 legacy=0x7f002812a7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0028139080 con 0x7f002813e200 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00280a1e00 con 0x7f00280a4820 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient(hunting): authenticate will time out at 1101.509640s 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f0027fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0028134970 0x7f00281d17d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58732/0 (socket says 172.21.15.106:58732) 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f0027fff640 1 -- 172.21.15.106:0/1121090565 learned_addr learned my addr 172.21.15.106:0/1121090565 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002d623640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.171:6789/0 conn(0x7f002813e200 legacy=0x7f00281d4f00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409905765 0 0) 0x7f0028138da0 con 0x7f0028134970 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): my global_id is 5049 2024-04-25T23:57:25.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0014003530 con 0x7f0028134970 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3488375703 0 0) 0x7f0014003530 con 0x7f0028134970 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0028138da0 con 0x7f0028134970 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f001c001a60 con 0x7f0028134970 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): dump: 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.977 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 51643077 0 0) 0x7f0028138da0 con 0x7f0028134970 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.106:6793/0 conn(0x7f00280a4820 legacy=0x7f002812a7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.171:6789/0 conn(0x7f002813e200 legacy=0x7f00281d4f00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 monclient: found mon.a 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:25.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0028138ac0 con 0x7f0028134970 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 5 monclient: authenticate success, global_id 5049 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: _renew_subs 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0028137470 con 0x7f0028134970 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: _renew_subs 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f00281366d0 con 0x7f0028134970 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f001c0038d0 con 0x7f0028134970 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f001c003e40 con 0x7f0028134970 2024-04-25T23:57:25.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f0026ffd640 4 set_mon_vals no callback set 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: dump: 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.980 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f00080065d0 con 0x7f0008002870 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f001c003fe0 con 0x7f0028134970 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7f001c0444a0 con 0x7f0028134970 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013540351 0 0) 0x7f00080065d0 con 0x7f0008002870 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient(hunting): my global_id is 5055 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0028138da0 con 0x7f0008002870 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1981009691 0 0) 0x7f0028138da0 con 0x7f0008002870 2024-04-25T23:57:25.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00080065d0 con 0x7f0008002870 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0018001d00 con 0x7f0008002870 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 10 monclient: dump: 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.982 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f002d623640 10 monclient: get_auth_request con 0x7f00140376a0 auth_method 0 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.978+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2914586467 0 0) 0x7f00080065d0 con 0x7f0008002870 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.982+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f000800a160 con 0x7f0008002870 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.982+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0018001560 con 0x7f0008002870 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.982+0000 7f00257fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.982+0000 7f00257fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.982+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.106:6792/0 conn(0x7f0008002870 legacy=0x7f0008004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.982+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.106:6792/0 conn(0x7f0008002870 legacy=0x7f0008004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0008009e30 con 0x7f00080090f0 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492826226 0 0) 0x7f0008009e30 con 0x7f00080090f0 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient(hunting): my global_id is 5064 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00080065d0 con 0x7f00080090f0 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2021700111 0 0) 0x7f00080065d0 con 0x7f00080090f0 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0008009e30 con 0x7f00080090f0 2024-04-25T23:57:25.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00180017a0 con 0x7f00080090f0 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient: dump: 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:25.986 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 522432716 0 0) 0x7f0008009e30 con 0x7f00080090f0 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f000800c3a0 con 0x7f00080090f0 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7691 (unknown 0 0 1761565278) 0x7f0018007230 con 0x7f00080090f0 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.106:6792/0 conn(0x7f00080090f0 legacy=0x7f0008009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f00257fa640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.106:6792/0 conn(0x7f00080090f0 legacy=0x7f0008009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:25.987 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 26, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 164525, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:57:25.988 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.989 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:25.991 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:25.992 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.994 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.995 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.996 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.997 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:25.998 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:25.999 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.000 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.001 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.002 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.003 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.004 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:26.005 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.171:6812/722422047 conn(0x7f00140376a0 legacy=0x7f0014039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 10 monclient: shutdown 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 >> v1:172.21.15.106:6789/0 conn(0x7f0028134970 legacy=0x7f00281d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002d623640 1 -- 172.21.15.106:0/1121090565 reap_dead start 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002d623640 1 -- 172.21.15.106:0/1121090565 reap_dead start 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 shutdown_connections 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 >> 172.21.15.106:0/1121090565 conn(0x7f00280a9e20 msgr2=0x7f0028130d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 shutdown_connections 2024-04-25T23:57:26.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:25.986+0000 7f002f086640 1 -- 172.21.15.106:0/1121090565 wait complete. 2024-04-25T23:57:26.008 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:57:26.008 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2024-04-25T23:57:26.008 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:57:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: get_monmap_and_config 2024-04-25T23:57:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: build_initial_monmap 2024-04-25T23:57:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: monmap: 2024-04-25T23:57:26.123 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:26.142697+0000 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:26.142697+0000 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:26.125 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 Processor -- start 2024-04-25T23:57:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- start start 2024-04-25T23:57:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: init 2024-04-25T23:57:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: _add_conns ranks=[1,6,8,7,4,5,0,2,3] 2024-04-25T23:57:26.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient(hunting): picked mon.noname-f con 0x7f4f2409c340 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient(hunting): picked mon.noname-d con 0x7f4f2409c720 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient(hunting): picked mon.noname-e con 0x7f4f2413c030 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f24133db0 con 0x7f4f2409c340 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f240a0020 con 0x7f4f2409c720 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f2409fa60 con 0x7f4f2413c030 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient(hunting): authenticate will time out at 1101.670000s 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f23fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4f2413c030 legacy=0x7f4f2413e420 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f22ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4f2409c720 0x7f4f2413a910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:54726/0 (socket says 172.21.15.106:54726) 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f22ffd640 1 -- 172.21.15.106:0/2084152912 learned_addr learned my addr 172.21.15.106:0/2084152912 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f237fe640 1 -- 172.21.15.106:0/2084152912 >> v1:172.21.15.171:6789/0 conn(0x7f4f2409c340 legacy=0x7f4f241336a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1066126136 0 0) 0x7f4f240a0020 con 0x7f4f2409c720 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient(hunting): my global_id is 5073 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f0c003530 con 0x7f4f2409c720 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3773353673 0 0) 0x7f4f0c003530 con 0x7f4f2409c720 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 >> v1:172.21.15.106:6793/0 conn(0x7f4f2413c030 legacy=0x7f4f2413e420 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 >> v1:172.21.15.171:6789/0 conn(0x7f4f2409c340 legacy=0x7f4f241336a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 monclient: found mon.noname-d 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:26.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2409fd40 con 0x7f4f2409c720 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f180017c0 con 0x7f4f2409c720 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 5 monclient: authenticate success, global_id 5073 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: dump: 2024-04-25T23:57:26.135 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.136 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f18001b20 con 0x7f4f2409c720 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:26.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 1 -- 172.21.15.106:0/2084152912 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f18001d50 con 0x7f4f2409c720 2024-04-25T23:57:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 4 set_mon_vals no callback set 2024-04-25T23:57:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f227fc640 10 monclient: dump: 2024-04-25T23:57:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.138 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.142 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: shutdown 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- 172.21.15.106:0/2084152912 >> v1:172.21.15.106:6792/0 conn(0x7f4f2409c720 legacy=0x7f4f2413a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- 172.21.15.106:0/2084152912 shutdown_connections 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- 172.21.15.106:0/2084152912 >> 172.21.15.106:0/2084152912 conn(0x7f4f240a2db0 msgr2=0x7f4f240a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- 172.21.15.106:0/2084152912 shutdown_connections 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 1 -- 172.21.15.106:0/2084152912 wait complete. 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: build_initial_monmap 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.138+0000 7f4f29e88640 10 monclient: monmap: 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:26.143 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:26.144 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 Processor -- start 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 -- start start 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient: init 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient: _add_conns ranks=[5,3,6,8,0,1,4,7,2] 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient(hunting): picked mon.noname-h con 0x7f4f2409c340 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient(hunting): picked mon.noname-g con 0x7f4f2409c720 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient(hunting): picked mon.noname-d con 0x7f4f2413c030 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f24067c60 con 0x7f4f2409c720 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f241ca5f0 con 0x7f4f2409c340 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f24137c90 con 0x7f4f2413c030 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient(hunting): authenticate will time out at 1101.672795s 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f23fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4f2413c030 0x7f4f241d29b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:54742/0 (socket says 172.21.15.106:54742) 2024-04-25T23:57:26.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f23fff640 1 -- 172.21.15.106:0/614694598 learned_addr learned my addr 172.21.15.106:0/614694598 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840918667 0 0) 0x7f4f24137c90 con 0x7f4f2413c030 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): my global_id is 5082 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f10003530 con 0x7f4f2413c030 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1555423314 0 0) 0x7f4f10003530 con 0x7f4f2413c030 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f24137c90 con 0x7f4f2413c030 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f1c004560 con 0x7f4f2413c030 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): dump: 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.146 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.147 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733523989 0 0) 0x7f4f2409fd40 con 0x7f4f2409c720 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): my global_id is 5124 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f10003530 con 0x7f4f2409c720 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3091976885 0 0) 0x7f4f24137c90 con 0x7f4f2413c030 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.171:6791/0 conn(0x7f4f2409c340 legacy=0x7f4f2413aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.171:6790/0 conn(0x7f4f2409c720 legacy=0x7f4f241cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 monclient: found mon.d 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:26.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f24137f70 con 0x7f4f2413c030 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: _finish_auth 0 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 5 monclient: authenticate success, global_id 5082 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient: _renew_subs 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2413b180 con 0x7f4f2413c030 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient: _renew_subs 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f24136f70 con 0x7f4f2413c030 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f1c004850 con 0x7f4f2413c030 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f1c004dc0 con 0x7f4f2413c030 2024-04-25T23:57:26.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: dump: 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.150 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f21ffb640 4 set_mon_vals no callback set 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f24068750 con 0x7f4f240726c0 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4f1c004fe0 con 0x7f4f2413c030 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(42..42 src has 1..42) ==== 3412+0+0 (unknown 3781989754 0 0) 0x7f4f1c044640 con 0x7f4f2413c030 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251577274 0 0) 0x7f4f24068750 con 0x7f4f240726c0 2024-04-25T23:57:26.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient(hunting): my global_id is 5133 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f24137c90 con 0x7f4f240726c0 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f22ffd640 10 monclient: get_auth_request con 0x7f4f10037860 auth_method 0 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1183078259 0 0) 0x7f4f24137c90 con 0x7f4f240726c0 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f24068750 con 0x7f4f240726c0 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f14004080 con 0x7f4f240726c0 2024-04-25T23:57:26.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 10 monclient: dump: 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.153 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2920462297 0 0) 0x7f4f24068750 con 0x7f4f240726c0 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.142+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f24072aa0 con 0x7f4f240726c0 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.146+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4f14005620 con 0x7f4f240726c0 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.146+0000 7f4f0bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.146+0000 7f4f0bfff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.146+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.171:6790/0 conn(0x7f4f240726c0 legacy=0x7f4f2406f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.146+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.171:6790/0 conn(0x7f4f240726c0 legacy=0x7f4f2406f4a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f29e88640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f2413b3b0 con 0x7f4f2402d010 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3811396991 0 0) 0x7f4f2413b3b0 con 0x7f4f2402d010 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 10 monclient(hunting): my global_id is 5142 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f24068750 con 0x7f4f2402d010 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 960222393 0 0) 0x7f4f24068750 con 0x7f4f2402d010 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f2413b3b0 con 0x7f4f2402d010 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f14004ab0 con 0x7f4f2402d010 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:26.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.150+0000 7f4f0bfff640 10 monclient: dump: 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.157 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1774963344 0 0) 0x7f4f2413b3b0 con 0x7f4f2402d010 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f24067160 con 0x7f4f2402d010 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7521 (unknown 0 0 1993228335) 0x7f4f14004d60 con 0x7f4f2402d010 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f0bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f0bfff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.171:6790/0 conn(0x7f4f2402d010 legacy=0x7f4f2406fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f0bfff640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.171:6790/0 conn(0x7f4f2402d010 legacy=0x7f4f2406fbb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:26.158 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 26, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 164679, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:26.159 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:26.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:26.161 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:26.162 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:26.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:26.164 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:26.167 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:26.169 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.171 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:26.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.174 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:26.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:26.176 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:26.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.171:6812/722422047 conn(0x7f4f10037860 legacy=0x7f4f10039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 10 monclient: shutdown 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 >> v1:172.21.15.106:6792/0 conn(0x7f4f2413c030 legacy=0x7f4f241d29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f23fff640 1 -- 172.21.15.106:0/614694598 reap_dead start 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f23fff640 1 -- 172.21.15.106:0/614694598 reap_dead start 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 shutdown_connections 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 >> 172.21.15.106:0/614694598 conn(0x7f4f240a2db0 msgr2=0x7f4f240a1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 shutdown_connections 2024-04-25T23:57:26.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.154+0000 7f4f29e88640 1 -- 172.21.15.106:0/614694598 wait complete. 2024-04-25T23:57:26.178 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:57:26.178 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-04-25T23:57:26.179 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:57:26.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.309+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}]=0 set osd(s) 0 to class 'ssd' v43) ==== 135+0+0 (unknown 2565673951 0 0) 0x7fcaf40a2ea0 con 0x7fcad404aef0 2024-04-25T23:57:26.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.309+0000 7fcaf0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}] 2024-04-25T23:57:26.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.309+0000 7fcaf0ff9640 10 monclient: _finish_command 2 = system:0 set osd(s) 0 to class 'ssd' 2024-04-25T23:57:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient: get_monmap_and_config 2024-04-25T23:57:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient: build_initial_monmap 2024-04-25T23:57:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient: monmap: 2024-04-25T23:57:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:26.296 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.297 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:57:26.315710+0000 2024-04-25T23:57:26.297 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:57:26.315710+0000 2024-04-25T23:57:26.297 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:26.297 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:26.298 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 1 Processor -- start 2024-04-25T23:57:26.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 1 -- start start 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient: init 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient: _add_conns ranks=[5,4,8,7,3,0,2,1,6] 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient(hunting): picked mon.noname-h con 0x7f4938134970 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient(hunting): picked mon.noname-c con 0x7f49380a4820 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient(hunting): picked mon.noname-e con 0x7f493813e200 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493806dd40 con 0x7f49380a4820 2024-04-25T23:57:26.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49380a2b10 con 0x7f4938134970 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49380a2df0 con 0x7f493813e200 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f493d50b640 10 monclient(hunting): authenticate will time out at 1101.843304s 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f49377fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f493813e200 legacy=0x7f49381405f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f49367fc640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f49380a4820 legacy=0x7f493813cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f4936ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4938134970 0x7f4938134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:51300/0 (socket says 172.21.15.106:51300) 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f4936ffd640 1 -- 172.21.15.106:0/3447212208 learned_addr learned my addr 172.21.15.106:0/3447212208 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.310+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72757555 0 0) 0x7f49380a2b10 con 0x7f4938134970 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient(hunting): my global_id is 5108 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4920003530 con 0x7f4938134970 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3237095704 0 0) 0x7f4920003530 con 0x7f4938134970 2024-04-25T23:57:26.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 >> v1:172.21.15.106:6793/0 conn(0x7f493813e200 legacy=0x7f49381405f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 >> v1:172.21.15.106:6791/0 conn(0x7f49380a4820 legacy=0x7f493813cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 monclient: found mon.noname-h 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49380a30d0 con 0x7f4938134970 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f49280017c0 con 0x7f4938134970 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: dump: 2024-04-25T23:57:26.313 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.314 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.315 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 5 monclient: authenticate success, global_id 5108 2024-04-25T23:57:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:26.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4928001a20 con 0x7f4938134970 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 4 set_mon_vals no callback set 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 1 -- 172.21.15.106:0/3447212208 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4928004bf0 con 0x7f4938134970 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4935ffb640 10 monclient: dump: 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.316 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: shutdown 2024-04-25T23:57:26.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:26.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- 172.21.15.106:0/3447212208 >> v1:172.21.15.171:6791/0 conn(0x7f4938134970 legacy=0x7f4938134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- 172.21.15.106:0/3447212208 shutdown_connections 2024-04-25T23:57:26.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- 172.21.15.106:0/3447212208 >> 172.21.15.106:0/3447212208 conn(0x7f49380a9e20 msgr2=0x7f49380aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:26.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- 172.21.15.106:0/3447212208 shutdown_connections 2024-04-25T23:57:26.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- 172.21.15.106:0/3447212208 wait complete. 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: build_initial_monmap 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: monmap: 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:26.319 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 Processor -- start 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- start start 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: init 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: _add_conns ranks=[0,1,3,5,7,4,8,2,6] 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient(hunting): picked mon.noname-a con 0x7f49380a4820 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:26.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient(hunting): picked mon.noname-f con 0x7f4938134970 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient(hunting): picked mon.noname-g con 0x7f493813e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493813c230 con 0x7f49380a4820 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f49381396d0 con 0x7f4938134970 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f493813d7a0 con 0x7f493813e200 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient(hunting): authenticate will time out at 1101.846561s 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4936ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f49380a4820 0x7f49381388b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58740/0 (socket says 172.21.15.106:58740) 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f4936ffd640 1 -- 172.21.15.106:0/167655358 learned_addr learned my addr 172.21.15.106:0/167655358 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:57:26.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f49367fc640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6789/0 conn(0x7f4938134970 legacy=0x7f4938138fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2465147284 0 0) 0x7f49380a30d0 con 0x7f49380a4820 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): my global_id is 5058 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4924003530 con 0x7f49380a4820 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2019065138 0 0) 0x7f4924003530 con 0x7f49380a4820 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49380a30d0 con 0x7f49380a4820 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f49280016c0 con 0x7f49380a4820 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:26.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): dump: 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.323 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3335966117 0 0) 0x7f49380a30d0 con 0x7f49380a4820 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6790/0 conn(0x7f493813e200 legacy=0x7f49381d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6789/0 conn(0x7f4938134970 legacy=0x7f4938138fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 monclient: found mon.a 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4938139ab0 con 0x7f49380a4820 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 5 monclient: authenticate success, global_id 5058 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: _renew_subs 2024-04-25T23:57:26.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f493813be10 con 0x7f49380a4820 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: _renew_subs 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4938133f50 con 0x7f49380a4820 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4928001a20 con 0x7f49380a4820 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4928001c50 con 0x7f49380a4820 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f49357fa640 4 set_mon_vals no callback set 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f491f7fe640 10 monclient: dump: 2024-04-25T23:57:26.325 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.326 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.314+0000 7f493d50b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f49180065d0 con 0x7f4918002870 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f49280100f0 con 0x7f49380a4820 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(43..43 src has 1..43) ==== 3636+0+0 (unknown 2690507560 0 0) 0x7f4928044610 con 0x7f49380a4820 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f49377fe640 10 monclient: get_auth_request con 0x7f4924037780 auth_method 0 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268594937 0 0) 0x7f49180065d0 con 0x7f4918002870 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient(hunting): my global_id is 5117 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49380a30d0 con 0x7f4918002870 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 141310626 0 0) 0x7f49380a30d0 con 0x7f4918002870 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f49180065d0 con 0x7f4918002870 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f492c004110 con 0x7f4918002870 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient: dump: 2024-04-25T23:57:26.328 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.329 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1000219238 0 0) 0x7f49180065d0 con 0x7f4918002870 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f491800a160 con 0x7f4918002870 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f492c006490 con 0x7f4918002870 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6791/0 conn(0x7f4918002870 legacy=0x7f4918004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.318+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6791/0 conn(0x7f4918002870 legacy=0x7f4918004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:57:26.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4918009e50 con 0x7f4918009110 2024-04-25T23:57:26.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 224862710 0 0) 0x7f4918009e50 con 0x7f4918009110 2024-04-25T23:57:26.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient(hunting): my global_id is 5126 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f49180065d0 con 0x7f4918009110 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4244194302 0 0) 0x7f49180065d0 con 0x7f4918009110 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4918009e50 con 0x7f4918009110 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f492c004ad0 con 0x7f4918009110 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient: dump: 2024-04-25T23:57:26.332 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.333 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3928407455 0 0) 0x7f4918009e50 con 0x7f4918009110 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f491800c3e0 con 0x7f4918009110 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7691 (unknown 0 0 3437451111) 0x7f492c005f00 con 0x7f4918009110 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6791/0 conn(0x7f4918009110 legacy=0x7f49180095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f491f7fe640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6791/0 conn(0x7f4918009110 legacy=0x7f49180095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 26, 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 164831, 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: 6 2024-04-25T23:57:26.335 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:26.336 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:26.337 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:57:26.338 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:57:26.339 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:57:26.341 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:57:26.341 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:57:26.341 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:57:26.342 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:57:26.343 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:57:26.344 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.345 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:57:26.347 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.348 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.349 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:57:26.350 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.352 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.353 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.354 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:57:26.355 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.356 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:57:26.357 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:57:26.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.171:6812/722422047 conn(0x7f4924037780 legacy=0x7f4924039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 10 monclient: shutdown 2024-04-25T23:57:26.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:26.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 >> v1:172.21.15.106:6789/0 conn(0x7f49380a4820 legacy=0x7f49381388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f49377fe640 1 -- 172.21.15.106:0/167655358 reap_dead start 2024-04-25T23:57:26.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f49377fe640 1 -- 172.21.15.106:0/167655358 reap_dead start 2024-04-25T23:57:26.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 shutdown_connections 2024-04-25T23:57:26.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 >> 172.21.15.106:0/167655358 conn(0x7f49380a9e20 msgr2=0x7f4938134d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:26.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 shutdown_connections 2024-04-25T23:57:26.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:57:26.326+0000 7f493d50b640 1 -- 172.21.15.106:0/167655358 wait complete. 2024-04-25T23:57:26.362 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-25T23:57:26.363 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-25T23:57:26.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.397+0000 7fcaeb7fe640 10 monclient: tick 2024-04-25T23:57:26.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.397+0000 7fcaeb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:26.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.397+0000 7fcaeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:26.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.409+0000 7fcafa2bb640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}] 2024-04-25T23:57:26.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.409+0000 7fcafa2bb640 10 monclient: _send_command 3 [{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}] 2024-04-25T23:57:26.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.409+0000 7fcafa2bb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:26.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.409+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]} v 0) -- 0x7fcacc0053b0 con 0x7fcad404aef0 2024-04-25T23:57:26.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcaf0ff9640 1 -- 172.21.15.171:0/4161341202 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}]=0 osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. set osd(s) to class 'ssd' v44) ==== 237+0+0 (unknown 2761511203 0 0) 0x7fcaec0150d0 con 0x7fcad404aef0 2024-04-25T23:57:26.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcaf0ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["osd.0"]}] 2024-04-25T23:57:26.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcaf0ff9640 10 monclient: _finish_command 3 = system:0 osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. set osd(s) to class 'ssd' 2024-04-25T23:57:26.472 INFO:tasks.workunit.client.0.smithi171.stderr:osd.0 already set to class ssd. set-device-class item id 0 name 'osd.0' device_class 'ssd': no change. set osd(s) to class 'ssd' 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.171:6812/722422047 conn(0x7fcad4037e90 legacy=0x7fcad403a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 10 monclient: shutdown 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 >> v1:172.21.15.106:6790/0 conn(0x7fcad404aef0 legacy=0x7fcad4044180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 shutdown_connections 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 >> 172.21.15.171:0/4161341202 conn(0x7fcaf40a9ee0 msgr2=0x7fcaf41308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 shutdown_connections 2024-04-25T23:57:26.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.489+0000 7fcafa2bb640 1 -- 172.21.15.171:0/4161341202 wait complete. 2024-04-25T23:57:26.496 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush set-device-class hdd osd.1 2024-04-25T23:57:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.625+0000 7f8c80fc4640 10 monclient: get_monmap_and_config 2024-04-25T23:57:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.625+0000 7f8c80fc4640 10 monclient: build_initial_monmap 2024-04-25T23:57:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.625+0000 7f8c80fc4640 10 monclient: monmap: 2024-04-25T23:57:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:26.630327+0000 2024-04-25T23:57:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:26.630327+0000 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:26.612 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:26.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 Processor -- start 2024-04-25T23:57:26.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- start start 2024-04-25T23:57:26.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient: init 2024-04-25T23:57:26.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:26.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient: _add_conns ranks=[0,4,8,6,3,2,5,7,1] 2024-04-25T23:57:26.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient(hunting): picked mon.noname-a con 0x7f8c7c0a1530 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient(hunting): picked mon.noname-c con 0x7f8c7c071c00 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient(hunting): picked mon.noname-e con 0x7f8c7c071730 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c06ea70 con 0x7f8c7c0a1530 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c0723d0 con 0x7f8c7c071c00 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c072990 con 0x7f8c7c071730 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient(hunting): authenticate will time out at 1097.337229s 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c7ad9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8c7c071730 legacy=0x7f8c7c13e2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c71d9b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f8c7c071c00 legacy=0x7f8c7c13ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c7a59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8c7c0a1530 0x7f8c7c0a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:33014/0 (socket says 172.21.15.171:33014) 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c7a59c640 1 -- 172.21.15.171:0/3800358287 learned_addr learned my addr 172.21.15.171:0/3800358287 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 131121926 0 0) 0x7f8c7c06ea70 con 0x7f8c7c0a1530 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient(hunting): my global_id is 5067 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c68003530 con 0x7f8c7c0a1530 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3490206533 0 0) 0x7f8c68003530 con 0x7f8c7c0a1530 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 >> v1:172.21.15.106:6793/0 conn(0x7f8c7c071730 legacy=0x7f8c7c13e2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 >> v1:172.21.15.106:6791/0 conn(0x7f8c7c071c00 legacy=0x7f8c7c13ab90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 monclient: found mon.noname-a 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c0a3100 con 0x7f8c7c0a1530 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: _finish_auth 0 2024-04-25T23:57:26.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c6c0017c0 con 0x7f8c7c0a1530 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: dump: 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.618 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 5 monclient: authenticate success, global_id 5067 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c6c001a20 con 0x7f8c7c0a1530 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 1 -- 172.21.15.171:0/3800358287 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c6c001c90 con 0x7f8c7c0a1530 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:26.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 4 set_mon_vals no callback set 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c79d9b640 10 monclient: dump: 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.620 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 10 monclient: shutdown 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- 172.21.15.171:0/3800358287 >> v1:172.21.15.106:6789/0 conn(0x7f8c7c0a1530 legacy=0x7f8c7c0a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- 172.21.15.171:0/3800358287 shutdown_connections 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- 172.21.15.171:0/3800358287 >> 172.21.15.171:0/3800358287 conn(0x7f8c7c0a62d0 msgr2=0x7f8c7c0a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- 172.21.15.171:0/3800358287 shutdown_connections 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.629+0000 7f8c80fc4640 1 -- 172.21.15.171:0/3800358287 wait complete. 2024-04-25T23:57:26.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: build_initial_monmap 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: monmap: 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:26.622 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:26.623 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:26.623 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:26.623 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:26.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 Processor -- start 2024-04-25T23:57:26.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 -- start start 2024-04-25T23:57:26.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: init 2024-04-25T23:57:26.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:26.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _add_conns ranks=[0,8,1,6,4,2,5,7,3] 2024-04-25T23:57:26.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient(hunting): picked mon.noname-a con 0x7f8c7c071730 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:26.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient(hunting): picked mon.noname-e con 0x7f8c7c071c00 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:26.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient(hunting): picked mon.noname-f con 0x7f8c7c0a1530 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c067c10 con 0x7f8c7c071730 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c09f660 con 0x7f8c7c0a1530 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c7c121370 con 0x7f8c7c071c00 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient(hunting): authenticate will time out at 1097.341086s 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c7ad9d640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f8c7c0a1530 legacy=0x7f8c7c1d4be0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c71d9b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8c7c071c00 legacy=0x7f8c7c1d14b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c7a59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8c7c071730 0x7f8c7c1329b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:33024/0 (socket says 172.21.15.171:33024) 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c7a59c640 1 -- 172.21.15.171:0/1226470271 learned_addr learned my addr 172.21.15.171:0/1226470271 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944452202 0 0) 0x7f8c7c067c10 con 0x7f8c7c071730 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:26.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): my global_id is 5076 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c5c003530 con 0x7f8c7c071730 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2271614325 0 0) 0x7f8c5c003530 con 0x7f8c7c071730 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8c7c067c10 con 0x7f8c7c071730 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c6c0016c0 con 0x7f8c7c071730 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): dump: 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.628 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2523257278 0 0) 0x7f8c7c067c10 con 0x7f8c7c071730 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 >> v1:172.21.15.106:6793/0 conn(0x7f8c7c071c00 legacy=0x7f8c7c1d14b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:26.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 >> v1:172.21.15.171:6789/0 conn(0x7f8c7c0a1530 legacy=0x7f8c7c1d4be0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 monclient: found mon.a 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7c071180 con 0x7f8c7c071730 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 5 monclient: authenticate success, global_id 5076 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _renew_subs 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7c1220b0 con 0x7f8c7c071730 2024-04-25T23:57:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _renew_subs 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8c7c120c00 con 0x7f8c7c071730 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c6c001a20 con 0x7f8c7c071730 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c6c005230 con 0x7f8c7c071730 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c7959a640 4 set_mon_vals no callback set 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c737fe640 10 monclient: dump: 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:26.631 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.633+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c60005090 con 0x7f8c7c071730 2024-04-25T23:57:26.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.637+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8c6c00ffd0 con 0x7f8c7c071730 2024-04-25T23:57:26.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.637+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(44..44 src has 1..44) ==== 3636+0+0 (unknown 3558857157 0 0) 0x7f8c6c044640 con 0x7f8c7c071730 2024-04-25T23:57:26.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.637+0000 7f8c71d9b640 10 monclient: get_auth_request con 0x7f8c5c0376a0 auth_method 0 2024-04-25T23:57:26.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.649+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8c6c0159a0 con 0x7f8c7c071730 2024-04-25T23:57:26.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.649+0000 7f8c737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:26.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.649+0000 7f8c737fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:26.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.809+0000 7f8c80fc4640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}] 2024-04-25T23:57:26.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.809+0000 7f8c80fc4640 10 monclient: _send_command 2 [{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}] 2024-04-25T23:57:26.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.809+0000 7f8c80fc4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:26.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:26.809+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]} v 0) -- 0x7f8c60005380 con 0x7f8c7c071730 2024-04-25T23:57:27.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:27.497+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}]=0 set osd(s) 1 to class 'hdd' v45) ==== 135+0+0 (unknown 2816690131 0 0) 0x7f8c6c0152a0 con 0x7f8c7c071730 2024-04-25T23:57:27.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:27.497+0000 7f8c737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}] 2024-04-25T23:57:27.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:27.497+0000 7f8c737fe640 10 monclient: _finish_command 2 = system:0 set osd(s) 1 to class 'hdd' 2024-04-25T23:57:27.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:27.593+0000 7f8c80fc4640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}] 2024-04-25T23:57:27.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:27.593+0000 7f8c80fc4640 10 monclient: _send_command 3 [{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}] 2024-04-25T23:57:27.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:27.593+0000 7f8c80fc4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:27.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:27.593+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]} v 0) -- 0x7f8c600010a0 con 0x7f8c7c071730 2024-04-25T23:57:28.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.505+0000 7f8c737fe640 1 -- 172.21.15.171:0/1226470271 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}]=0 osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. set osd(s) to class 'hdd' v46) ==== 237+0+0 (unknown 3790924378 0 0) 0x7f8c6c0423f0 con 0x7f8c7c071730 2024-04-25T23:57:28.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.505+0000 7f8c737fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush set-device-class", "class": "hdd", "ids": ["osd.1"]}] 2024-04-25T23:57:28.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.505+0000 7f8c737fe640 10 monclient: _finish_command 3 = system:0 osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. set osd(s) to class 'hdd' 2024-04-25T23:57:28.489 INFO:tasks.workunit.client.0.smithi171.stderr:osd.1 already set to class hdd. set-device-class item id 1 name 'osd.1' device_class 'hdd': no change. set osd(s) to class 'hdd' 2024-04-25T23:57:28.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 >> v1:172.21.15.171:6812/722422047 conn(0x7f8c5c0376a0 legacy=0x7f8c5c039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:28.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 10 monclient: shutdown 2024-04-25T23:57:28.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:28.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 >> v1:172.21.15.106:6789/0 conn(0x7f8c7c071730 legacy=0x7f8c7c1329b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:28.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 shutdown_connections 2024-04-25T23:57:28.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 >> 172.21.15.171:0/1226470271 conn(0x7f8c7c0a62d0 msgr2=0x7f8c7c1bb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:28.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 shutdown_connections 2024-04-25T23:57:28.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.509+0000 7f8c80fc4640 1 -- 172.21.15.171:0/1226470271 wait complete. 2024-04-25T23:57:28.510 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule create-replicated foo-ssd default host ssd 2024-04-25T23:57:28.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient: get_monmap_and_config 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient: build_initial_monmap 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient: monmap: 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:28.648863+0000 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:28.648863+0000 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:28.630 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:28.631 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:28.631 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:28.631 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:28.631 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:28.631 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:28.631 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:28.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 1 Processor -- start 2024-04-25T23:57:28.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 1 -- start start 2024-04-25T23:57:28.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient: init 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient: _add_conns ranks=[7,3,6,0,8,4,1,2,5] 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient(hunting): picked mon.noname-i con 0x7fed880996b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient(hunting): picked mon.noname-g con 0x7fed88136010 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient(hunting): picked mon.noname-d con 0x7fed88136430 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8809a580 con 0x7fed88136010 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8809aad0 con 0x7fed88136430 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8809a7f0 con 0x7fed880996b0 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8c96a640 10 monclient(hunting): authenticate will time out at 1099.355756s 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed8659c640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fed880996b0 legacy=0x7fed88099a90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed85d9b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fed88136010 0x7fed8813aae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38090/0 (socket says 172.21.15.171:38090) 2024-04-25T23:57:28.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.645+0000 7fed85d9b640 1 -- 172.21.15.171:0/2284261258 learned_addr learned my addr 172.21.15.171:0/2284261258 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1647312873 0 0) 0x7fed8809a580 con 0x7fed88136010 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient(hunting): my global_id is 5160 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed74003530 con 0x7fed88136010 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3233861309 0 0) 0x7fed74003530 con 0x7fed88136010 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 >> v1:172.21.15.171:6792/0 conn(0x7fed880996b0 legacy=0x7fed88099a90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:28.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 >> v1:172.21.15.106:6792/0 conn(0x7fed88136430 legacy=0x7fed8813e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: _finish_hunting 0 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 monclient: found mon.noname-g 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed88075480 con 0x7fed88136010 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: _finish_auth 0 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: _check_auth_tickets 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:28.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fed780017c0 con 0x7fed88136010 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: dump: 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:28.641 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 5 monclient: authenticate success, global_id 5160 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fed78001b20 con 0x7fed88136010 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 4 set_mon_vals no callback set 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 1 -- 172.21.15.171:0/2284261258 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fed78001d50 con 0x7fed88136010 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:28.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8559a640 10 monclient: dump: 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:28.643 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient: shutdown 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- 172.21.15.171:0/2284261258 >> v1:172.21.15.171:6790/0 conn(0x7fed88136010 legacy=0x7fed8813aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- 172.21.15.171:0/2284261258 shutdown_connections 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- 172.21.15.171:0/2284261258 >> 172.21.15.171:0/2284261258 conn(0x7fed880a2e70 msgr2=0x7fed880a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- 172.21.15.171:0/2284261258 shutdown_connections 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- 172.21.15.171:0/2284261258 wait complete. 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient: build_initial_monmap 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient: monmap: 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:28.644 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 Processor -- start 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- start start 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient: init 2024-04-25T23:57:28.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient: _add_conns ranks=[1,7,2,4,5,8,3,0,6] 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient(hunting): picked mon.noname-f con 0x7fed880996b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient(hunting): picked mon.noname-i con 0x7fed88136010 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient(hunting): picked mon.noname-b con 0x7fed88136430 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8809fde0 con 0x7fed880996b0 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8809eb90 con 0x7fed88136430 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed8813ecf0 con 0x7fed88136010 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8659c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fed880996b0 legacy=0x7fed8813ded0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed85d9b640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fed88136010 legacy=0x7fed8813e5e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed8c96a640 10 monclient(hunting): authenticate will time out at 1099.358969s 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed86d9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fed88136430 0x7fed881d4b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:38236/0 (socket says 172.21.15.171:38236) 2024-04-25T23:57:28.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed86d9d640 1 -- 172.21.15.171:0/1206683854 learned_addr learned my addr 172.21.15.171:0/1206683854 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1637101717 0 0) 0x7fed8809eb90 con 0x7fed88136430 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed7effd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed7effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed7effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed7effd640 10 monclient(hunting): my global_id is 5123 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.649+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed68003530 con 0x7fed88136430 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 879980300 0 0) 0x7fed68003530 con 0x7fed88136430 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fed8809eb90 con 0x7fed88136430 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fed80001d50 con 0x7fed88136430 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient(hunting): dump: 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:28.647 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:28.648 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3556808400 0 0) 0x7fed8809eb90 con 0x7fed88136430 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 >> v1:172.21.15.171:6792/0 conn(0x7fed88136010 legacy=0x7fed8813e5e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 >> v1:172.21.15.171:6789/0 conn(0x7fed880996b0 legacy=0x7fed8813ded0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 monclient: found mon.b 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed8809d870 con 0x7fed88136430 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: _finish_auth 0 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:28.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 5 monclient: authenticate success, global_id 5123 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 10 monclient: _renew_subs 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fed880a0230 con 0x7fed88136430 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 10 monclient: _renew_subs 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fed8809e8b0 con 0x7fed88136430 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fed80002090 con 0x7fed88136430 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed84d99640 4 set_mon_vals no callback set 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fed80003f90 con 0x7fed88136430 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:28.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 10 monclient: dump: 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:28.651 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed6c005090 con 0x7fed88136430 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fed800041b0 con 0x7fed88136430 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(46..46 src has 1..46) ==== 3868+0+0 (unknown 2685021079 0 0) 0x7fed800448b0 con 0x7fed88136430 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.653+0000 7fed8659c640 10 monclient: get_auth_request con 0x7fed68037830 auth_method 0 2024-04-25T23:57:28.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.665+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fed8809aad0 con 0x7fed88136430 2024-04-25T23:57:28.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.665+0000 7fed7effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:28.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.665+0000 7fed7effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:28.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.821+0000 7fed8c96a640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}] 2024-04-25T23:57:28.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.821+0000 7fed8c96a640 10 monclient: _send_command 2 [{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}] 2024-04-25T23:57:28.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.821+0000 7fed8c96a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:28.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:28.821+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"} v 0) -- 0x7fed6c005380 con 0x7fed88136430 2024-04-25T23:57:29.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.517+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}]=0 v47) ==== 150+0+0 (unknown 617647234 0 0) 0x7fed80015a70 con 0x7fed88136430 2024-04-25T23:57:29.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.517+0000 7fed7effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}] 2024-04-25T23:57:29.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.517+0000 7fed7effd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:29.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.613+0000 7fed8c96a640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}] 2024-04-25T23:57:29.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.613+0000 7fed8c96a640 10 monclient: _send_command 3 [{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}] 2024-04-25T23:57:29.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.613+0000 7fed8c96a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:29.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.613+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"} v 0) -- 0x7fed6c005ac0 con 0x7fed88136430 2024-04-25T23:57:29.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed7effd640 1 -- 172.21.15.171:0/1206683854 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}]=0 rule foo-ssd already exists v47) ==== 177+0+0 (unknown 2970939114 0 0) 0x7fed8001df20 con 0x7fed88136430 2024-04-25T23:57:29.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed7effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule create-replicated", "name": "foo-ssd", "root": "default", "type": "host", "class": "ssd"}] 2024-04-25T23:57:29.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed7effd640 10 monclient: _finish_command 3 = system:0 rule foo-ssd already exists 2024-04-25T23:57:29.600 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo-ssd already exists 2024-04-25T23:57:29.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 >> v1:172.21.15.171:6812/722422047 conn(0x7fed68037830 legacy=0x7fed68039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:29.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 10 monclient: shutdown 2024-04-25T23:57:29.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:29.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 >> v1:172.21.15.106:6790/0 conn(0x7fed88136430 legacy=0x7fed881d4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:29.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 shutdown_connections 2024-04-25T23:57:29.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 >> 172.21.15.171:0/1206683854 conn(0x7fed880a2e70 msgr2=0x7fed880a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:29.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 shutdown_connections 2024-04-25T23:57:29.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.617+0000 7fed8c96a640 1 -- 172.21.15.171:0/1206683854 wait complete. 2024-04-25T23:57:29.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule create-replicated foo-hdd default host hdd 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient: get_monmap_and_config 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient: build_initial_monmap 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient: monmap: 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:29.760979+0000 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:29.760979+0000 2024-04-25T23:57:29.742 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:29.743 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 1 Processor -- start 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 1 -- start start 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient: init 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient: _add_conns ranks=[4,1,2,3,8,6,5,7,0] 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient(hunting): picked mon.noname-c con 0x7fc0cc0a5230 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient(hunting): picked mon.noname-f con 0x7fc0cc0a49c0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient(hunting): picked mon.noname-b con 0x7fc0cc13e230 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc0a19c0 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc0a27e0 con 0x7fc0cc13e230 2024-04-25T23:57:29.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc0a2ac0 con 0x7fc0cc0a5230 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0d1fcc640 10 monclient(hunting): authenticate will time out at 1100.467984s 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.757+0000 7fc0caffd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fc0cc0a49c0 legacy=0x7fc0cc13cb10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0cb7fe640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fc0cc0a5230 legacy=0x7fc0cc0a5610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0cbfff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc0cc13e230 0x7fc0cc140620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:38250/0 (socket says 172.21.15.171:38250) 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0cbfff640 1 -- 172.21.15.171:0/1707746165 learned_addr learned my addr 172.21.15.171:0/1707746165 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3868975599 0 0) 0x7fc0cc0a27e0 con 0x7fc0cc13e230 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient(hunting): my global_id is 5132 2024-04-25T23:57:29.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0b8003530 con 0x7fc0cc13e230 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 193520061 0 0) 0x7fc0b8003530 con 0x7fc0cc13e230 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 >> v1:172.21.15.106:6791/0 conn(0x7fc0cc0a5230 legacy=0x7fc0cc0a5610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 >> v1:172.21.15.171:6789/0 conn(0x7fc0cc0a49c0 legacy=0x7fc0cc13cb10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 monclient: found mon.noname-b 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc0a2da0 con 0x7fc0cc13e230 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 5 monclient: authenticate success, global_id 5132 2024-04-25T23:57:29.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0bc0017c0 con 0x7fc0cc13e230 2024-04-25T23:57:29.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:29.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:29.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:29.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: dump: 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:29.755 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0bc001a20 con 0x7fc0cc13e230 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 4 set_mon_vals no callback set 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 1 -- 172.21.15.171:0/1707746165 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0bc004bf0 con 0x7fc0cc13e230 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:29.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0ca7fc640 10 monclient: dump: 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:29.757 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient: shutdown 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1707746165 >> v1:172.21.15.106:6790/0 conn(0x7fc0cc13e230 legacy=0x7fc0cc140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1707746165 shutdown_connections 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1707746165 >> 172.21.15.171:0/1707746165 conn(0x7fc0cc0a6ac0 msgr2=0x7fc0cc0a6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:29.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1707746165 shutdown_connections 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1707746165 wait complete. 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient: build_initial_monmap 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient: monmap: 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:29.759 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 Processor -- start 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- start start 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient: init 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient: _add_conns ranks=[5,6,0,4,1,3,8,7,2] 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient(hunting): picked mon.noname-h con 0x7fc0cc0a49c0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:29.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient(hunting): picked mon.noname-d con 0x7fc0cc0a5230 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient(hunting): picked mon.noname-a con 0x7fc0cc13e230 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc0a5000 con 0x7fc0cc13e230 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc121f90 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0cc122270 con 0x7fc0cc0a5230 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0d1fcc640 10 monclient(hunting): authenticate will time out at 1100.471362s 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0cb7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc0cc0a49c0 0x7fc0cc1cc3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45378/0 (socket says 172.21.15.171:45378) 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0cb7fe640 1 -- 172.21.15.171:0/1997105687 learned_addr learned my addr 172.21.15.171:0/1997105687 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2140242318 0 0) 0x7fc0cc121f90 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0c3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0c3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:29.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0c3fff640 10 monclient(hunting): my global_id is 5135 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ac003530 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.761+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 56904267 0 0) 0x7fc0ac003530 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0cc121f90 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0c4004700 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): dump: 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.762 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2281072094 0 0) 0x7fc0cc0a2da0 con 0x7fc0cc13e230 2024-04-25T23:57:29.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): my global_id is 5085 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0ac003530 con 0x7fc0cc13e230 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090819442 0 0) 0x7fc0cc122270 con 0x7fc0cc0a5230 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient(hunting): my global_id is 5100 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0cc0a2da0 con 0x7fc0cc0a5230 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2782801661 0 0) 0x7fc0cc121f90 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 >> v1:172.21.15.106:6792/0 conn(0x7fc0cc0a5230 legacy=0x7fc0cc1ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 >> v1:172.21.15.106:6789/0 conn(0x7fc0cc13e230 legacy=0x7fc0cc1d4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:29.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 monclient: found mon.h 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0cc1cd1d0 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 5 monclient: authenticate success, global_id 5135 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 10 monclient: _renew_subs 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:29.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc0cc09f7f0 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 10 monclient: _renew_subs 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc0cc09ec70 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0c40049f0 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0c4004f60 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c9ffb640 4 set_mon_vals no callback set 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:29.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 10 monclient: dump: 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:29.767 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc0c4005180 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0b0005090 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(47..47 src has 1..47) ==== 3931+0+0 (unknown 1107172262 0 0) 0x7fc0c4044b50 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.765+0000 7fc0caffd640 10 monclient: get_auth_request con 0x7fc0ac0379f0 auth_method 0 2024-04-25T23:57:29.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.769+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc0c4015cd0 con 0x7fc0cc0a49c0 2024-04-25T23:57:29.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.769+0000 7fc0c3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:29.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.769+0000 7fc0c3fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:29.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.933+0000 7fc0d1fcc640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}] 2024-04-25T23:57:29.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.933+0000 7fc0d1fcc640 10 monclient: _send_command 2 [{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}] 2024-04-25T23:57:29.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.933+0000 7fc0d1fcc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:29.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:29.933+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"} v 0) -- 0x7fc0b0005380 con 0x7fc0cc0a49c0 2024-04-25T23:57:30.511 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.525+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}]=0 v48) ==== 150+0+0 (unknown 3144599289 0 0) 0x7fc0c40155d0 con 0x7fc0cc0a49c0 2024-04-25T23:57:30.511 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.525+0000 7fc0c3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}] 2024-04-25T23:57:30.511 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.525+0000 7fc0c3fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:30.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.629+0000 7fc0d1fcc640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}] 2024-04-25T23:57:30.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.629+0000 7fc0d1fcc640 10 monclient: _send_command 3 [{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}] 2024-04-25T23:57:30.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.629+0000 7fc0d1fcc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:30.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.629+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"} v 0) -- 0x7fc0b0005620 con 0x7fc0cc0a49c0 2024-04-25T23:57:30.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.633+0000 7fc0c3fff640 1 -- 172.21.15.171:0/1997105687 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}]=0 rule foo-hdd already exists v48) ==== 177+0+0 (unknown 2860057506 0 0) 0x7fc0c401e180 con 0x7fc0cc0a49c0 2024-04-25T23:57:30.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.633+0000 7fc0c3fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule create-replicated", "name": "foo-hdd", "root": "default", "type": "host", "class": "hdd"}] 2024-04-25T23:57:30.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.633+0000 7fc0c3fff640 10 monclient: _finish_command 3 = system:0 rule foo-hdd already exists 2024-04-25T23:57:30.617 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo-hdd already exists 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 >> v1:172.21.15.171:6812/722422047 conn(0x7fc0ac0379f0 legacy=0x7fc0ac039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 10 monclient: shutdown 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 >> v1:172.21.15.171:6791/0 conn(0x7fc0cc0a49c0 legacy=0x7fc0cc1cc3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 shutdown_connections 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 >> 172.21.15.171:0/1997105687 conn(0x7fc0cc0a6ac0 msgr2=0x7fc0cc1380b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 shutdown_connections 2024-04-25T23:57:30.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.637+0000 7fc0d1fcc640 1 -- 172.21.15.171:0/1997105687 wait complete. 2024-04-25T23:57:30.635 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls-by-class ssd 2024-04-25T23:57:30.635 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo-ssd 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 10 monclient: get_monmap_and_config 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 10 monclient: build_initial_monmap 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 10 monclient: monmap: 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:30.773086+0000 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:30.773086+0000 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:30.754 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:30.755 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:30.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 1 Processor -- start 2024-04-25T23:57:30.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 1 -- start start 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 10 monclient: init 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.769+0000 7f131f379640 10 monclient: _add_conns ranks=[4,3,1,6,5,8,0,7,2] 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): picked mon.noname-c con 0x7f13180a1530 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): picked mon.noname-g con 0x7f1318071c00 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): picked mon.noname-f con 0x7f1318071730 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131806ea70 con 0x7f1318071730 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13180723d0 con 0x7f1318071c00 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1318072990 con 0x7f13180a1530 2024-04-25T23:57:30.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): authenticate will time out at 1101.480154s 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131d916640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f1318071730 legacy=0x7f131813e2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131d115640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f13180a1530 legacy=0x7f13180a1910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131c914640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f1318071c00 0x7f131813ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51638/0 (socket says 172.21.15.171:51638) 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131c914640 1 -- 172.21.15.171:0/950165852 learned_addr learned my addr 172.21.15.171:0/950165852 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 180376512 0 0) 0x7f13180723d0 con 0x7f1318071c00 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient(hunting): my global_id is 5169 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1304003530 con 0x7f1318071c00 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3966758049 0 0) 0x7f1304003530 con 0x7f1318071c00 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 >> v1:172.21.15.106:6791/0 conn(0x7f13180a1530 legacy=0x7f13180a1910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:30.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 >> v1:172.21.15.171:6789/0 conn(0x7f1318071730 legacy=0x7f131813e2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 monclient: found mon.noname-g 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13180a3100 con 0x7f1318071c00 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: _finish_auth 0 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13140017c0 con 0x7f1318071c00 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 5 monclient: authenticate success, global_id 5169 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: dump: 2024-04-25T23:57:30.764 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:30.765 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1314001b20 con 0x7f1318071c00 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 1 -- 172.21.15.171:0/950165852 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1314001d50 con 0x7f1318071c00 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130ffff640 10 monclient: dump: 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:30.766 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 4 set_mon_vals no callback set 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient: shutdown 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- 172.21.15.171:0/950165852 >> v1:172.21.15.171:6790/0 conn(0x7f1318071c00 legacy=0x7f131813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:30.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- 172.21.15.171:0/950165852 shutdown_connections 2024-04-25T23:57:30.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- 172.21.15.171:0/950165852 >> 172.21.15.171:0/950165852 conn(0x7f13180a62d0 msgr2=0x7f13180a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:30.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- 172.21.15.171:0/950165852 shutdown_connections 2024-04-25T23:57:30.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- 172.21.15.171:0/950165852 wait complete. 2024-04-25T23:57:30.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient: build_initial_monmap 2024-04-25T23:57:30.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient: monmap: 2024-04-25T23:57:30.769 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:30.769 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:30.769 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:30.769 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:30.769 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:30.769 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:30.769 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 Processor -- start 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- start start 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient: init 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:30.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient: _add_conns ranks=[7,3,0,8,6,5,2,1,4] 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): picked mon.noname-i con 0x7f1318071730 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): picked mon.noname-g con 0x7f13180a1530 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): picked mon.noname-a con 0x7f1318133150 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131809f660 con 0x7f1318133150 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131809fb20 con 0x7f13180a1530 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131811fb80 con 0x7f1318071730 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131f379640 10 monclient(hunting): authenticate will time out at 1101.483433s 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131d115640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f1318071730 legacy=0x7f1318132a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131c914640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f13180a1530 0x7f13181cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51646/0 (socket says 172.21.15.171:51646) 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f131c914640 1 -- 172.21.15.171:0/966240944 learned_addr learned my addr 172.21.15.171:0/966240944 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678280536 0 0) 0x7f131809fb20 con 0x7f13180a1530 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:30.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130dffb640 10 monclient(hunting): my global_id is 5178 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12fc003530 con 0x7f13180a1530 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.773+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3302279355 0 0) 0x7f12fc003530 con 0x7f13180a1530 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f131809fb20 con 0x7f13180a1530 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1314001780 con 0x7f13180a1530 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): dump: 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:30.772 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2461251913 0 0) 0x7f131809f660 con 0x7f1318133150 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:30.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient(hunting): my global_id is 5094 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12fc003530 con 0x7f1318133150 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1151088361 0 0) 0x7f131809fb20 con 0x7f13180a1530 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 >> v1:172.21.15.171:6792/0 conn(0x7f1318071730 legacy=0x7f1318132a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 >> v1:172.21.15.106:6789/0 conn(0x7f1318133150 legacy=0x7f13181d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 monclient: found mon.g 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1318120420 con 0x7f13180a1530 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:30.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 5 monclient: authenticate success, global_id 5178 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 10 monclient: _renew_subs 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f131811e9e0 con 0x7f13180a1530 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 10 monclient: _renew_subs 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13181ca7f0 con 0x7f13180a1530 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1314005010 con 0x7f13180a1530 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1314001b00 con 0x7f13180a1530 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130f7fe640 4 set_mon_vals no callback set 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 10 monclient: dump: 2024-04-25T23:57:30.775 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:30.776 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f8005090 con 0x7f13180a1530 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1314010100 con 0x7f13180a1530 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(48..48 src has 1..48) ==== 3994+0+0 (unknown 1376840539 0 0) 0x7f1314044810 con 0x7f13180a1530 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.777+0000 7f131d115640 10 monclient: get_auth_request con 0x7f12fc037710 auth_method 0 2024-04-25T23:57:30.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.781+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f13140159b0 con 0x7f13180a1530 2024-04-25T23:57:30.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.781+0000 7f130dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:30.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.781+0000 7f130dffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.949+0000 7f131f379640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.949+0000 7f131f379640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.949+0000 7f131f379640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:30.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.949+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "ssd"} v 0) -- 0x7f12f8005b90 con 0x7f13180a1530 2024-04-25T23:57:30.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.953+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "ssd"}]=0 v48) ==== 90+0+8 (unknown 4243305861 0 905510949) 0x7f131401de00 con 0x7f13180a1530 2024-04-25T23:57:30.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.953+0000 7f130dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:30.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:30.953+0000 7f130dffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:31.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.049+0000 7f131f379640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.049+0000 7f131f379640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.049+0000 7f131f379640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.049+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "ssd"} v 0) -- 0x7f12f80010a0 con 0x7f13180a1530 2024-04-25T23:57:31.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.049+0000 7f130dffb640 1 -- 172.21.15.171:0/966240944 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "ssd"}]=0 v48) ==== 90+0+8 (unknown 4243305861 0 905510949) 0x7f1314042460 con 0x7f13180a1530 2024-04-25T23:57:31.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.049+0000 7f130dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.049+0000 7f130dffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:31.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 >> v1:172.21.15.171:6812/722422047 conn(0x7f12fc037710 legacy=0x7f12fc039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 10 monclient: shutdown 2024-04-25T23:57:31.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:31.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 >> v1:172.21.15.171:6790/0 conn(0x7f13180a1530 legacy=0x7f13181cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 shutdown_connections 2024-04-25T23:57:31.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 >> 172.21.15.171:0/966240944 conn(0x7f13180a62d0 msgr2=0x7f13180a47a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:31.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 shutdown_connections 2024-04-25T23:57:31.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.053+0000 7f131f379640 1 -- 172.21.15.171:0/966240944 wait complete. 2024-04-25T23:57:31.054 INFO:tasks.workunit.client.0.smithi171.stdout:foo-ssd 2024-04-25T23:57:31.055 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls-by-class ssd 2024-04-25T23:57:31.055 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false grep foo-hdd 2024-04-25T23:57:31.055 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:57:31.055 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo-hdd 2024-04-25T23:57:31.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient: get_monmap_and_config 2024-04-25T23:57:31.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient: build_initial_monmap 2024-04-25T23:57:31.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient: monmap: 2024-04-25T23:57:31.170 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:31.170 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.170 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:31.188841+0000 2024-04-25T23:57:31.170 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:31.188841+0000 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 1 Processor -- start 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 1 -- start start 2024-04-25T23:57:31.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient: init 2024-04-25T23:57:31.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:31.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient: _add_conns ranks=[6,1,0,2,3,8,5,4,7] 2024-04-25T23:57:31.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient(hunting): picked mon.noname-d con 0x7f58e00a1530 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:31.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient(hunting): picked mon.noname-f con 0x7f58e0071c00 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:31.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient(hunting): picked mon.noname-a con 0x7f58e0071730 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:31.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e006ea70 con 0x7f58e0071730 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e00723d0 con 0x7f58e0071c00 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e0072990 con 0x7f58e00a1530 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58e4f8b640 10 monclient(hunting): authenticate will time out at 1101.895896s 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.185+0000 7f58ddd9b640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f58e0071c00 legacy=0x7f58e013ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58de59c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f58e00a1530 0x7f58e00a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:41070/0 (socket says 172.21.15.171:41070) 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58de59c640 1 -- 172.21.15.171:0/493735039 learned_addr learned my addr 172.21.15.171:0/493735039 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ded9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f58e0071730 0x7f58e013e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:55404/0 (socket says 172.21.15.171:55404) 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292592549 0 0) 0x7f58e0072990 con 0x7f58e00a1530 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): my global_id is 5109 2024-04-25T23:57:31.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c8003530 con 0x7f58e00a1530 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301666784 0 0) 0x7f58e006ea70 con 0x7f58e0071730 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient(hunting): my global_id is 5103 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58e0072990 con 0x7f58e0071730 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22658240 0 0) 0x7f58c8003530 con 0x7f58e00a1530 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 >> v1:172.21.15.171:6789/0 conn(0x7f58e0071c00 legacy=0x7f58e013ab90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 >> v1:172.21.15.106:6789/0 conn(0x7f58e0071730 legacy=0x7f58e013e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: _finish_hunting 0 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 monclient: found mon.noname-d 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:31.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e00a3100 con 0x7f58e00a1530 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: _finish_auth 0 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: _check_auth_tickets 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58d00017c0 con 0x7f58e00a1530 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: dump: 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.183 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 5 monclient: authenticate success, global_id 5109 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58d0001ae0 con 0x7f58e00a1530 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 4 set_mon_vals no callback set 2024-04-25T23:57:31.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 1 -- 172.21.15.171:0/493735039 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58d0004bf0 con 0x7f58e00a1530 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58dd59a640 10 monclient: dump: 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.185 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient: shutdown 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- 172.21.15.171:0/493735039 >> v1:172.21.15.106:6792/0 conn(0x7f58e00a1530 legacy=0x7f58e00a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- 172.21.15.171:0/493735039 shutdown_connections 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- 172.21.15.171:0/493735039 >> 172.21.15.171:0/493735039 conn(0x7f58e00a62d0 msgr2=0x7f58e00a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- 172.21.15.171:0/493735039 shutdown_connections 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- 172.21.15.171:0/493735039 wait complete. 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient: build_initial_monmap 2024-04-25T23:57:31.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient: monmap: 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:31.187 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 Processor -- start 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- start start 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient: init 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient: _add_conns ranks=[5,1,4,7,3,8,0,6,2] 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient(hunting): picked mon.noname-h con 0x7f58e0071730 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient(hunting): picked mon.noname-f con 0x7f58e0071c00 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient(hunting): picked mon.noname-c con 0x7f58e00a1530 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e009fb20 con 0x7f58e0071c00 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e01223e0 con 0x7f58e00a1530 2024-04-25T23:57:31.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58e01cce40 con 0x7f58e0071730 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58e4f8b640 10 monclient(hunting): authenticate will time out at 1101.899571s 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ddd9b640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f58e0071c00 legacy=0x7f58e01cbf50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58de59c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f58e0071730 0x7f58e0132a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45492/0 (socket says 172.21.15.171:45492) 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58de59c640 1 -- 172.21.15.171:0/3102138251 learned_addr learned my addr 172.21.15.171:0/3102138251 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ded9d640 1 -- 172.21.15.171:0/3102138251 >> v1:172.21.15.106:6791/0 conn(0x7f58e00a1530 legacy=0x7f58e01d4290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829767158 0 0) 0x7f58e01cce40 con 0x7f58e0071730 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ceffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ceffd640 10 monclient(hunting): my global_id is 5144 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.189+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58c0003530 con 0x7f58e0071730 2024-04-25T23:57:31.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1461497000 0 0) 0x7f58c0003530 con 0x7f58e0071730 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58e01cce40 con 0x7f58e0071730 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58d0001780 con 0x7f58e0071730 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient(hunting): dump: 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.190 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1277303286 0 0) 0x7f58e01cce40 con 0x7f58e0071730 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 >> v1:172.21.15.106:6791/0 conn(0x7f58e00a1530 legacy=0x7f58e01d4290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 >> v1:172.21.15.171:6789/0 conn(0x7f58e0071c00 legacy=0x7f58e01cbf50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 monclient: found mon.h 2024-04-25T23:57:31.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58e0122100 con 0x7f58e0071730 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 5 monclient: authenticate success, global_id 5144 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 10 monclient: _renew_subs 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58e01209d0 con 0x7f58e0071730 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 10 monclient: _renew_subs 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f58e0133110 con 0x7f58e0071730 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58d0001ae0 con 0x7f58e0071730 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:31.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58d0001d10 con 0x7f58e0071730 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58dcd99640 4 set_mon_vals no callback set 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 10 monclient: dump: 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.193 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f58d0010070 con 0x7f58e0071730 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58c4005090 con 0x7f58e0071730 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(48..48 src has 1..48) ==== 3994+0+0 (unknown 1376840539 0 0) 0x7f58d00447d0 con 0x7f58e0071730 2024-04-25T23:57:31.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.193+0000 7f58ddd9b640 10 monclient: get_auth_request con 0x7f58c00377d0 auth_method 0 2024-04-25T23:57:31.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.197+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f58d0015970 con 0x7f58e0071730 2024-04-25T23:57:31.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.197+0000 7f58ceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:31.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.197+0000 7f58ceffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:31.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.361+0000 7f58e4f8b640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.361+0000 7f58e4f8b640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.361+0000 7f58e4f8b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:31.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.361+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "ssd"} v 0) -- 0x7f58c4005b90 con 0x7f58e0071730 2024-04-25T23:57:31.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.361+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "ssd"}]=0 v48) ==== 90+0+8 (unknown 4243305861 0 905510949) 0x7f58d0015270 con 0x7f58e0071730 2024-04-25T23:57:31.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.361+0000 7f58ceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.361+0000 7f58ceffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:31.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.457+0000 7f58e4f8b640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.457+0000 7f58e4f8b640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.457+0000 7f58e4f8b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:31.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.457+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "ssd"} v 0) -- 0x7f58c40010a0 con 0x7f58e0071730 2024-04-25T23:57:31.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.457+0000 7f58ceffd640 1 -- 172.21.15.171:0/3102138251 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "ssd"}]=0 v48) ==== 90+0+8 (unknown 4243305861 0 905510949) 0x7f58d001ddc0 con 0x7f58e0071730 2024-04-25T23:57:31.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.457+0000 7f58ceffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls-by-class", "class": "ssd"}] 2024-04-25T23:57:31.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.457+0000 7f58ceffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:31.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 >> v1:172.21.15.171:6812/722422047 conn(0x7f58c00377d0 legacy=0x7f58c0039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.444 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 10 monclient: shutdown 2024-04-25T23:57:31.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:31.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 >> v1:172.21.15.171:6791/0 conn(0x7f58e0071730 legacy=0x7f58e0132a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 shutdown_connections 2024-04-25T23:57:31.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 >> 172.21.15.171:0/3102138251 conn(0x7f58e00a62d0 msgr2=0x7f58e00a43b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:31.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 shutdown_connections 2024-04-25T23:57:31.445 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.461+0000 7f58e4f8b640 1 -- 172.21.15.171:0/3102138251 wait complete. 2024-04-25T23:57:31.459 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:57:31.460 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls-by-class hdd 2024-04-25T23:57:31.460 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo-hdd 2024-04-25T23:57:31.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.593+0000 7f95c0e79640 10 monclient: get_monmap_and_config 2024-04-25T23:57:31.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.593+0000 7f95c0e79640 10 monclient: build_initial_monmap 2024-04-25T23:57:31.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.593+0000 7f95c0e79640 10 monclient: monmap: 2024-04-25T23:57:31.578 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:31.597534+0000 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:31.597534+0000 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:31.579 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:31.580 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.585 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.593+0000 7f95c0e79640 1 Processor -- start 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.593+0000 7f95c0e79640 1 -- start start 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.593+0000 7f95c0e79640 10 monclient: init 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: _add_conns ranks=[3,4,6,2,8,0,5,7,1] 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): picked mon.noname-g con 0x7f95bc0a1530 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): picked mon.noname-c con 0x7f95bc071c00 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): picked mon.noname-d con 0x7f95bc071730 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:31.586 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc06ea70 con 0x7f95bc0a1530 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc0723d0 con 0x7f95bc071c00 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc072990 con 0x7f95bc071730 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): authenticate will time out at 1102.304455s 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95ba59c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f95bc0a1530 0x7f95bc0a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51648/0 (socket says 172.21.15.171:51648) 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95ba59c640 1 -- 172.21.15.171:0/4229957844 learned_addr learned my addr 172.21.15.171:0/4229957844 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b9d9b640 1 -- 172.21.15.171:0/4229957844 >> v1:172.21.15.106:6791/0 conn(0x7f95bc071c00 legacy=0x7f95bc13ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989323582 0 0) 0x7f95bc06ea70 con 0x7f95bc0a1530 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient(hunting): my global_id is 5187 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95a4003530 con 0x7f95bc0a1530 2024-04-25T23:57:31.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3765531055 0 0) 0x7f95a4003530 con 0x7f95bc0a1530 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 >> v1:172.21.15.106:6792/0 conn(0x7f95bc071730 legacy=0x7f95bc13e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 >> v1:172.21.15.106:6791/0 conn(0x7f95bc071c00 legacy=0x7f95bc13ab90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: _finish_hunting 0 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 monclient: found mon.noname-g 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc0a3100 con 0x7f95bc0a1530 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: _finish_auth 0 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: _check_auth_tickets 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f95b00017c0 con 0x7f95bc0a1530 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:31.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: dump: 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.589 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 5 monclient: authenticate success, global_id 5187 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95b0001b20 con 0x7f95bc0a1530 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 1 -- 172.21.15.171:0/4229957844 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f95b0004bf0 con 0x7f95bc0a1530 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 4 set_mon_vals no callback set 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95b959a640 10 monclient: dump: 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.590 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: shutdown 2024-04-25T23:57:31.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- 172.21.15.171:0/4229957844 >> v1:172.21.15.171:6790/0 conn(0x7f95bc0a1530 legacy=0x7f95bc0a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- 172.21.15.171:0/4229957844 shutdown_connections 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- 172.21.15.171:0/4229957844 >> 172.21.15.171:0/4229957844 conn(0x7f95bc0a62d0 msgr2=0x7f95bc0a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- 172.21.15.171:0/4229957844 shutdown_connections 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- 172.21.15.171:0/4229957844 wait complete. 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: build_initial_monmap 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: monmap: 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.592 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 Processor -- start 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- start start 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: init 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:31.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient: _add_conns ranks=[7,6,3,2,0,4,5,1,8] 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): picked mon.noname-i con 0x7f95bc071730 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): picked mon.noname-d con 0x7f95bc071c00 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): picked mon.noname-g con 0x7f95bc0a1530 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc120230 con 0x7f95bc0a1530 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc11ff50 con 0x7f95bc071c00 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95ba59c640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f95bc071730 legacy=0x7f95bc1c9eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95bc11e7f0 con 0x7f95bc071730 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95c0e79640 10 monclient(hunting): authenticate will time out at 1102.307499s 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95bad9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f95bc0a1530 0x7f95bc1d2050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51664/0 (socket says 172.21.15.171:51664) 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95bad9d640 1 -- 172.21.15.171:0/2786984617 learned_addr learned my addr 172.21.15.171:0/2786984617 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 911602042 0 0) 0x7f95bc120230 con 0x7f95bc0a1530 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95aaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:31.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95aaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95aaffd640 10 monclient(hunting): my global_id is 5196 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c003530 con 0x7f95bc0a1530 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.597+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3102643753 0 0) 0x7f959c003530 con 0x7f95bc0a1530 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95bc120230 con 0x7f95bc0a1530 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f95b4001d80 con 0x7f95bc0a1530 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient(hunting): dump: 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.595 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2098462651 0 0) 0x7f95bc120230 con 0x7f95bc0a1530 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 >> v1:172.21.15.171:6792/0 conn(0x7f95bc071730 legacy=0x7f95bc1c9eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:31.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 >> v1:172.21.15.106:6792/0 conn(0x7f95bc071c00 legacy=0x7f95bc132870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 monclient: found mon.g 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95bc132f80 con 0x7f95bc0a1530 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 5 monclient: authenticate success, global_id 5196 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 10 monclient: _renew_subs 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f95bc1331b0 con 0x7f95bc0a1530 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 10 monclient: _renew_subs 2024-04-25T23:57:31.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f95bc1d3940 con 0x7f95bc0a1530 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95b4003c50 con 0x7f95bc0a1530 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f95b40041c0 con 0x7f95bc0a1530 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95b8d99640 4 set_mon_vals no callback set 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 10 monclient: dump: 2024-04-25T23:57:31.598 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.599 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95a0005090 con 0x7f95bc0a1530 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f95b40043e0 con 0x7f95bc0a1530 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(49..49 src has 1..49) ==== 3994+0+0 (unknown 3640395523 0 0) 0x7f95b4044ac0 con 0x7f95bc0a1530 2024-04-25T23:57:31.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.601+0000 7f95ba59c640 10 monclient: get_auth_request con 0x7f959c037800 auth_method 0 2024-04-25T23:57:31.601 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.605+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f95b4015c40 con 0x7f95bc0a1530 2024-04-25T23:57:31.601 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.605+0000 7f95aaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:31.601 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.605+0000 7f95aaffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:31.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.761+0000 7f95c0e79640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:31.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.761+0000 7f95c0e79640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:31.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.761+0000 7f95c0e79640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.761+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "hdd"} v 0) -- 0x7f95a0005b90 con 0x7f95bc0a1530 2024-04-25T23:57:31.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.761+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "hdd"}]=0 v49) ==== 90+0+8 (unknown 2503567150 0 1286160932) 0x7f95b4015540 con 0x7f95bc0a1530 2024-04-25T23:57:31.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.761+0000 7f95aaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:31.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.761+0000 7f95aaffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:31.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:31.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:31.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:31.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "hdd"} v 0) -- 0x7f95a00010a0 con 0x7f95bc0a1530 2024-04-25T23:57:31.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95aaffd640 1 -- 172.21.15.171:0/2786984617 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "hdd"}]=0 v49) ==== 90+0+8 (unknown 2503567150 0 1286160932) 0x7f95b401e0f0 con 0x7f95bc0a1530 2024-04-25T23:57:31.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95aaffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:31.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95aaffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 >> v1:172.21.15.171:6812/722422047 conn(0x7f959c037800 legacy=0x7f959c039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 10 monclient: shutdown 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 >> v1:172.21.15.171:6790/0 conn(0x7f95bc0a1530 legacy=0x7f95bc1d2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 shutdown_connections 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 >> 172.21.15.171:0/2786984617 conn(0x7f95bc0a62d0 msgr2=0x7f95bc0a44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 shutdown_connections 2024-04-25T23:57:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.852+0000 7f95c0e79640 1 -- 172.21.15.171:0/2786984617 wait complete. 2024-04-25T23:57:31.851 INFO:tasks.workunit.client.0.smithi171.stdout:foo-hdd 2024-04-25T23:57:31.852 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls-by-class hdd 2024-04-25T23:57:31.852 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false grep foo-ssd 2024-04-25T23:57:31.852 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:57:31.852 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo-ssd 2024-04-25T23:57:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.980+0000 7fde4ee47640 10 monclient: get_monmap_and_config 2024-04-25T23:57:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.980+0000 7fde4ee47640 10 monclient: build_initial_monmap 2024-04-25T23:57:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.980+0000 7fde4ee47640 10 monclient: monmap: 2024-04-25T23:57:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:31.986421+0000 2024-04-25T23:57:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:31.986421+0000 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:31.968 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 Processor -- start 2024-04-25T23:57:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- start start 2024-04-25T23:57:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: init 2024-04-25T23:57:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: _add_conns ranks=[1,6,5,3,2,7,8,4,0] 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient(hunting): picked mon.noname-f con 0x7fde48137880 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient(hunting): picked mon.noname-d con 0x7fde48138370 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient(hunting): picked mon.noname-h con 0x7fde480a47e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde480a2ea0 con 0x7fde48137880 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde480a2bc0 con 0x7fde480a47e0 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde480a28e0 con 0x7fde48138370 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4cbe3640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fde48137880 legacy=0x7fde48137c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient(hunting): authenticate will time out at 1102.693350s 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4d3e4640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fde480a47e0 0x7fde48140520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45504/0 (socket says 172.21.15.171:45504) 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4d3e4640 1 -- 172.21.15.171:0/3529140019 learned_addr learned my addr 172.21.15.171:0/3529140019 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2416023221 0 0) 0x7fde480a2bc0 con 0x7fde480a47e0 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient(hunting): my global_id is 5153 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde2c003530 con 0x7fde480a47e0 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3065040146 0 0) 0x7fde2c003530 con 0x7fde480a47e0 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 >> v1:172.21.15.106:6792/0 conn(0x7fde48138370 legacy=0x7fde4813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 >> v1:172.21.15.171:6789/0 conn(0x7fde48137880 legacy=0x7fde48137c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 monclient: found mon.noname-h 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde480a4230 con 0x7fde480a47e0 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde40001b40 con 0x7fde480a47e0 2024-04-25T23:57:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 5 monclient: authenticate success, global_id 5153 2024-04-25T23:57:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: dump: 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde40001da0 con 0x7fde480a47e0 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 1 -- 172.21.15.171:0/3529140019 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde40004f70 con 0x7fde480a47e0 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde477fe640 10 monclient: dump: 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 4 set_mon_vals no callback set 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: shutdown 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- 172.21.15.171:0/3529140019 >> v1:172.21.15.171:6791/0 conn(0x7fde480a47e0 legacy=0x7fde48140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- 172.21.15.171:0/3529140019 shutdown_connections 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- 172.21.15.171:0/3529140019 >> 172.21.15.171:0/3529140019 conn(0x7fde480a9ee0 msgr2=0x7fde480aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- 172.21.15.171:0/3529140019 shutdown_connections 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- 172.21.15.171:0/3529140019 wait complete. 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: build_initial_monmap 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: monmap: 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:31.980 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:31.981 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 Processor -- start 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 1 -- start start 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.984+0000 7fde4ee47640 10 monclient: init 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 10 monclient: _add_conns ranks=[4,1,7,5,3,8,2,6,0] 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 10 monclient(hunting): picked mon.noname-c con 0x7fde480a47e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 10 monclient(hunting): picked mon.noname-f con 0x7fde48137880 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 10 monclient(hunting): picked mon.noname-i con 0x7fde48138370 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde480a0f10 con 0x7fde48137880 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde48135100 con 0x7fde480a47e0 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde481375c0 con 0x7fde48138370 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:31.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4ee47640 10 monclient(hunting): authenticate will time out at 1102.696504s 2024-04-25T23:57:31.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4d3e4640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fde48138370 legacy=0x7fde481d46c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:31.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde47fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fde48137880 legacy=0x7fde48136eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:31.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:31.988+0000 7fde4cbe3640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fde480a47e0 legacy=0x7fde481cc380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:32.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:32.192+0000 7fde4d3e4640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fde48138370 legacy=0x7fde481d46c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:32.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:32.192+0000 7fde47fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fde48137880 legacy=0x7fde48136eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:32.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:32.192+0000 7fde4cbe3640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fde480a47e0 legacy=0x7fde481cc380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:32.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:32.596+0000 7fde47fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fde48137880 legacy=0x7fde48136eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:32.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:32.596+0000 7fde4d3e4640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fde48138370 legacy=0x7fde481d46c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:32.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:32.596+0000 7fde4cbe3640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fde480a47e0 legacy=0x7fde481cc380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:33.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:33.400+0000 7fde4d3e4640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fde48138370 legacy=0x7fde481d46c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:33.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:33.400+0000 7fde47fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fde48137880 legacy=0x7fde48136eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:33.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:33.400+0000 7fde4cbe3640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fde480a47e0 legacy=0x7fde481cc380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient(hunting): tick 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fde48138370 legacy=0x7fde481d46c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fde480a47e0 legacy=0x7fde481cc380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fde48137880 legacy=0x7fde48136eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient: _add_conns ranks=[5,6,8,3,2,0] 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient(hunting): picked mon.noname-h con 0x7fde24003790 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient(hunting): picked mon.noname-d con 0x7fde24007420 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient(hunting): picked mon.noname-e con 0x7fde2400b1b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde481343a0 con 0x7fde24003790 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde480a0f10 con 0x7fde24007420 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fde48135100 con 0x7fde2400b1b0 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde3ffff640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4d3e4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fde2400b1b0 legacy=0x7fde2400d670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4cbe3640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fde24003790 0x7fde24005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45520/0 (socket says 172.21.15.171:45520) 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4cbe3640 1 -- 172.21.15.171:0/358107880 learned_addr learned my addr 172.21.15.171:0/358107880 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448758654 0 0) 0x7fde481343a0 con 0x7fde24003790 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): my global_id is 5162 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde30003530 con 0x7fde24003790 2024-04-25T23:57:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 855101976 0 0) 0x7fde480a0f10 con 0x7fde24007420 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): my global_id is 5145 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fde481343a0 con 0x7fde24007420 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2461892864 0 0) 0x7fde30003530 con 0x7fde24003790 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde480a0f10 con 0x7fde24003790 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde380044b0 con 0x7fde24003790 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): dump: 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3911225436 0 0) 0x7fde481343a0 con 0x7fde24007420 2024-04-25T23:57:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fde30003530 con 0x7fde24007420 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde340019f0 con 0x7fde24007420 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient(hunting): dump: 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2490607849 0 0) 0x7fde480a0f10 con 0x7fde24003790 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 >> v1:172.21.15.106:6793/0 conn(0x7fde2400b1b0 legacy=0x7fde2400d670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 >> v1:172.21.15.106:6792/0 conn(0x7fde24007420 legacy=0x7fde240098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 monclient: found mon.h 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4d3e4640 1 -- 172.21.15.171:0/358107880 reap_dead start 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde481375c0 con 0x7fde24003790 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4ee47640 5 monclient: authenticate success, global_id 5162 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4ee47640 10 monclient: _renew_subs 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4ee47640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fde48136eb0 con 0x7fde24003790 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4ee47640 10 monclient: _renew_subs 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4ee47640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fde48137370 con 0x7fde24003790 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fde380049c0 con 0x7fde24003790 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fde38004eb0 con 0x7fde24003790 2024-04-25T23:57:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde46ffd640 4 set_mon_vals no callback set 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.988+0000 7fde457fa640 10 monclient: dump: 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:34.982 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:34.983 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:34.983 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:34.983 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:34.983 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.992+0000 7fde4ee47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.992+0000 7fde4ee47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.992+0000 7fde4ee47640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.992+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde28005090 con 0x7fde24003790 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.992+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fde380050d0 con 0x7fde24003790 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.992+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(49..49 src has 1..49) ==== 3994+0+0 (unknown 3640395523 0 0) 0x7fde38044830 con 0x7fde24003790 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:34.992+0000 7fde47fff640 10 monclient: get_auth_request con 0x7fde30037c90 auth_method 0 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.000+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fde38015970 con 0x7fde24003790 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.000+0000 7fde457fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:34.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.000+0000 7fde457fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:35.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.188+0000 7fde4ee47640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:35.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.188+0000 7fde4ee47640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:35.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.188+0000 7fde4ee47640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.188+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "hdd"} v 0) -- 0x7fde28005b90 con 0x7fde24003790 2024-04-25T23:57:35.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.188+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "hdd"}]=0 v49) ==== 90+0+8 (unknown 2503567150 0 1286160932) 0x7fde38015270 con 0x7fde24003790 2024-04-25T23:57:35.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.188+0000 7fde457fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:35.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.188+0000 7fde457fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:35.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:35.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:35.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rule ls-by-class", "class": "hdd"} v 0) -- 0x7fde280010a0 con 0x7fde24003790 2024-04-25T23:57:35.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde457fa640 1 -- 172.21.15.171:0/358107880 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls-by-class", "class": "hdd"}]=0 v49) ==== 90+0+8 (unknown 2503567150 0 1286160932) 0x7fde3801de20 con 0x7fde24003790 2024-04-25T23:57:35.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde457fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls-by-class", "class": "hdd"}] 2024-04-25T23:57:35.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde457fa640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 >> v1:172.21.15.171:6812/722422047 conn(0x7fde30037c90 legacy=0x7fde3003a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 10 monclient: shutdown 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 >> v1:172.21.15.171:6791/0 conn(0x7fde24003790 legacy=0x7fde24005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 shutdown_connections 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 >> 172.21.15.171:0/358107880 conn(0x7fde480a9ee0 msgr2=0x7fde48130830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 shutdown_connections 2024-04-25T23:57:35.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.288+0000 7fde4ee47640 1 -- 172.21.15.171:0/358107880 wait complete. 2024-04-25T23:57:35.290 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:57:35.290 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd erasure-code-profile set ec-foo-ssd crush-device-class=ssd m=2 k=2 2024-04-25T23:57:35.410 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.424+0000 7f72afa38640 10 monclient: get_monmap_and_config 2024-04-25T23:57:35.410 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.424+0000 7f72afa38640 10 monclient: build_initial_monmap 2024-04-25T23:57:35.410 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.424+0000 7f72afa38640 10 monclient: monmap: 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:35.429676+0000 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:35.429676+0000 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:35.411 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:35.412 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:35.412 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.424+0000 7f72afa38640 1 Processor -- start 2024-04-25T23:57:35.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.424+0000 7f72afa38640 1 -- start start 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.424+0000 7f72afa38640 10 monclient: init 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient: _add_conns ranks=[0,8,1,2,7,4,5,3,6] 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient(hunting): picked mon.noname-a con 0x7f72a8135a00 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient(hunting): picked mon.noname-e con 0x7f72a80a1790 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient(hunting): picked mon.noname-f con 0x7f72a813c130 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a80a1d80 con 0x7f72a8135a00 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a8072f70 con 0x7f72a813c130 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a8072640 con 0x7f72a80a1790 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient(hunting): authenticate will time out at 1106.136589s 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72adfd5640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f72a813c130 legacy=0x7f72a813e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:35.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72acfd3640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f72a80a1790 legacy=0x7f72a813aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72ad7d4640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f72a8135a00 0x7f72a8135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:55408/0 (socket says 172.21.15.171:55408) 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72ad7d4640 1 -- 172.21.15.171:0/3573347643 learned_addr learned my addr 172.21.15.171:0/3573347643 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571496743 0 0) 0x7f72a80a1d80 con 0x7f72a8135a00 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient(hunting): my global_id is 5112 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7294003530 con 0x7f72a8135a00 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1406218473 0 0) 0x7f7294003530 con 0x7f72a8135a00 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 >> v1:172.21.15.106:6793/0 conn(0x7f72a80a1790 legacy=0x7f72a813aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 >> v1:172.21.15.171:6789/0 conn(0x7f72a813c130 legacy=0x7f72a813e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 monclient: found mon.noname-a 2024-04-25T23:57:35.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a8072920 con 0x7f72a8135a00 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: _finish_auth 0 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72a40017c0 con 0x7f72a8135a00 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: dump: 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.417 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.418 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 5 monclient: authenticate success, global_id 5112 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72a4001ab0 con 0x7f72a8135a00 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 1 -- 172.21.15.171:0/3573347643 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72a4004bf0 con 0x7f72a8135a00 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f729ffff640 10 monclient: dump: 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.419 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 4 set_mon_vals no callback set 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient: shutdown 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- 172.21.15.171:0/3573347643 >> v1:172.21.15.106:6789/0 conn(0x7f72a8135a00 legacy=0x7f72a8135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- 172.21.15.171:0/3573347643 shutdown_connections 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- 172.21.15.171:0/3573347643 >> 172.21.15.171:0/3573347643 conn(0x7f72a80a2690 msgr2=0x7f72a80a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- 172.21.15.171:0/3573347643 shutdown_connections 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- 172.21.15.171:0/3573347643 wait complete. 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient: build_initial_monmap 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient: monmap: 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:35.421 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 Processor -- start 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 1 -- start start 2024-04-25T23:57:35.422 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.428+0000 7f72afa38640 10 monclient: init 2024-04-25T23:57:35.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:35.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _add_conns ranks=[8,5,7,1,4,2,3,6,0] 2024-04-25T23:57:35.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient(hunting): picked mon.noname-e con 0x7f72a80a1790 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:35.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient(hunting): picked mon.noname-h con 0x7f72a8135a00 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:35.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient(hunting): picked mon.noname-i con 0x7f72a813c130 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:35.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a8131aa0 con 0x7f72a8135a00 2024-04-25T23:57:35.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a80703b0 con 0x7f72a813c130 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72a8134a20 con 0x7f72a80a1790 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient(hunting): authenticate will time out at 1106.140249s 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72adfd5640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f72a813c130 legacy=0x7f72a81d4530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72ad7d4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f72a80a1790 legacy=0x7f72a806f590 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72acfd3640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f72a8135a00 0x7f72a806fca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45534/0 (socket says 172.21.15.171:45534) 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72acfd3640 1 -- 172.21.15.171:0/1797576116 learned_addr learned my addr 172.21.15.171:0/1797576116 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3444229404 0 0) 0x7f72a8131aa0 con 0x7f72a8135a00 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): my global_id is 5171 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f728c003530 con 0x7f72a8135a00 2024-04-25T23:57:35.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1445144359 0 0) 0x7f728c003530 con 0x7f72a8135a00 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72a8131aa0 con 0x7f72a8135a00 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7298004330 con 0x7f72a8135a00 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): dump: 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.427 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4197394467 0 0) 0x7f72a8131aa0 con 0x7f72a8135a00 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 >> v1:172.21.15.106:6793/0 conn(0x7f72a80a1790 legacy=0x7f72a806f590 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 >> v1:172.21.15.171:6792/0 conn(0x7f72a813c130 legacy=0x7f72a81d4530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 monclient: found mon.h 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72a8070b10 con 0x7f72a8135a00 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 5 monclient: authenticate success, global_id 5171 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _renew_subs 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72a80711d0 con 0x7f72a8135a00 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _renew_subs 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f72a8132060 con 0x7f72a8135a00 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7298004690 con 0x7f72a8135a00 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7298004c00 con 0x7f72a8135a00 2024-04-25T23:57:35.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729f7fe640 4 set_mon_vals no callback set 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 10 monclient: dump: 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.430 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7288005090 con 0x7f72a8135a00 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7298004da0 con 0x7f72a8135a00 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(49..49 src has 1..49) ==== 3994+0+0 (unknown 3640395523 0 0) 0x7f7298044720 con 0x7f72a8135a00 2024-04-25T23:57:35.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.432+0000 7f72ad7d4640 10 monclient: get_auth_request con 0x7f728c037800 auth_method 0 2024-04-25T23:57:35.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.436+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7298015860 con 0x7f72a8135a00 2024-04-25T23:57:35.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.436+0000 7f729dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:35.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.436+0000 7f729dffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:35.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.596+0000 7f72afa38640 10 start_mon_command cmd=[{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}] 2024-04-25T23:57:35.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.596+0000 7f72afa38640 10 monclient: _send_command 2 [{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}] 2024-04-25T23:57:35.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.596+0000 7f72afa38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.596+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]} v 0) -- 0x7f7288005380 con 0x7f72a8135a00 2024-04-25T23:57:35.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.700+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}]=0 v50) ==== 151+0+0 (unknown 3080718669 0 0) 0x7f7298015160 con 0x7f72a8135a00 2024-04-25T23:57:35.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.700+0000 7f729dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}] 2024-04-25T23:57:35.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.700+0000 7f729dffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:35.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.796+0000 7f72afa38640 10 start_mon_command cmd=[{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}] 2024-04-25T23:57:35.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.796+0000 7f72afa38640 10 monclient: _send_command 3 [{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}] 2024-04-25T23:57:35.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.796+0000 7f72afa38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:35.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.796+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]} v 0) -- 0x7f7288005620 con 0x7f72a8135a00 2024-04-25T23:57:35.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f729dffb640 1 -- 172.21.15.171:0/1797576116 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}]=0 v50) ==== 151+0+0 (unknown 3080718669 0 0) 0x7f729801dd10 con 0x7f72a8135a00 2024-04-25T23:57:35.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f729dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd erasure-code-profile set", "name": "ec-foo-ssd", "profile": ["crush-device-class=ssd", "m=2", "k=2"]}] 2024-04-25T23:57:35.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f729dffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:35.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 >> v1:172.21.15.171:6812/722422047 conn(0x7f728c037800 legacy=0x7f728c039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 10 monclient: shutdown 2024-04-25T23:57:35.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:35.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 >> v1:172.21.15.171:6791/0 conn(0x7f72a8135a00 legacy=0x7f72a806fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 shutdown_connections 2024-04-25T23:57:35.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 >> 172.21.15.171:0/1797576116 conn(0x7f72a80a2690 msgr2=0x7f72a812f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:35.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 shutdown_connections 2024-04-25T23:57:35.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.800+0000 7f72afa38640 1 -- 172.21.15.171:0/1797576116 wait complete. 2024-04-25T23:57:35.799 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create ec-foo 2 erasure ec-foo-ssd 2024-04-25T23:57:35.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient: get_monmap_and_config 2024-04-25T23:57:35.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient: build_initial_monmap 2024-04-25T23:57:35.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient: monmap: 2024-04-25T23:57:35.920 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:35.939574+0000 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:35.939574+0000 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:35.921 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:35.922 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 1 Processor -- start 2024-04-25T23:57:35.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 1 -- start start 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient: init 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient: _add_conns ranks=[6,5,3,4,7,0,8,2,1] 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient(hunting): picked mon.noname-d con 0x7f5f24137960 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient(hunting): picked mon.noname-h con 0x7f5f240a4220 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient(hunting): picked mon.noname-g con 0x7f5f24138450 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f240a48c0 con 0x7f5f24138450 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f240a2f70 con 0x7f5f240a4220 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f240a0d00 con 0x7f5f24137960 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient(hunting): authenticate will time out at 1106.646639s 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f1bfff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5f240a4220 0x7f5f2413ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45544/0 (socket says 172.21.15.171:45544) 2024-04-25T23:57:35.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f1bfff640 1 -- 172.21.15.171:0/3456021530 learned_addr learned my addr 172.21.15.171:0/3456021530 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117979111 0 0) 0x7f5f240a2f70 con 0x7f5f240a4220 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): my global_id is 5180 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f10003530 con 0x7f5f240a4220 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 764972521 0 0) 0x7f5f240a48c0 con 0x7f5f24138450 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient(hunting): my global_id is 5205 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f240a2f70 con 0x7f5f24138450 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3339245165 0 0) 0x7f5f240a2f70 con 0x7f5f24138450 2024-04-25T23:57:35.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 >> v1:172.21.15.106:6792/0 conn(0x7f5f24137960 legacy=0x7f5f24137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 >> v1:172.21.15.171:6791/0 conn(0x7f5f240a4220 legacy=0x7f5f2413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 monclient: found mon.noname-g 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f240a29b0 con 0x7f5f24138450 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f1c001b40 con 0x7f5f24138450 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: dump: 2024-04-25T23:57:35.931 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.932 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 5 monclient: authenticate success, global_id 5205 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f1c001db0 con 0x7f5f24138450 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f292c3640 4 set_mon_vals no callback set 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 1 -- 172.21.15.171:0/3456021530 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f1c003ce0 con 0x7f5f24138450 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.936+0000 7f5f227fc640 10 monclient: dump: 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.933 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient: shutdown 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- 172.21.15.171:0/3456021530 >> v1:172.21.15.171:6790/0 conn(0x7f5f24138450 legacy=0x7f5f241405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- 172.21.15.171:0/3456021530 shutdown_connections 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- 172.21.15.171:0/3456021530 >> 172.21.15.171:0/3456021530 conn(0x7f5f240a9fc0 msgr2=0x7f5f240aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- 172.21.15.171:0/3456021530 shutdown_connections 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- 172.21.15.171:0/3456021530 wait complete. 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient: build_initial_monmap 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient: monmap: 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:35.935 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 Processor -- start 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- start start 2024-04-25T23:57:35.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient: init 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient: _add_conns ranks=[7,4,6,2,0,5,3,8,1] 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient(hunting): picked mon.noname-i con 0x7f5f240a4220 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient(hunting): picked mon.noname-c con 0x7f5f24137960 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient(hunting): picked mon.noname-d con 0x7f5f24138450 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f22ffd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5f240a4220 legacy=0x7f5f241cc180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f241242a0 con 0x7f5f24137960 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f240a1f50 con 0x7f5f24138450 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f240a0fa0 con 0x7f5f240a4220 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f292c3640 10 monclient(hunting): authenticate will time out at 1106.650284s 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1bfff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5f24137960 legacy=0x7f5f24136b90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f237fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5f24138450 0x7f5f241d44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:41134/0 (socket says 172.21.15.171:41134) 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f237fe640 1 -- 172.21.15.171:0/1334355772 learned_addr learned my addr 172.21.15.171:0/1334355772 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:35.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735884188 0 0) 0x7f5f240a1f50 con 0x7f5f24138450 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): my global_id is 5163 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f04003530 con 0x7f5f24138450 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3059790729 0 0) 0x7f5f04003530 con 0x7f5f24138450 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f240a1f50 con 0x7f5f24138450 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f1c003cc0 con 0x7f5f24138450 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): dump: 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.938 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.940+0000 7f5f1b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3380866952 0 0) 0x7f5f240a1f50 con 0x7f5f24138450 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 >> v1:172.21.15.171:6792/0 conn(0x7f5f240a4220 legacy=0x7f5f241cc180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 >> v1:172.21.15.106:6791/0 conn(0x7f5f24137960 legacy=0x7f5f24136b90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 monclient: found mon.d 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f24122260 con 0x7f5f24138450 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 5 monclient: authenticate success, global_id 5163 2024-04-25T23:57:35.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 10 monclient: _renew_subs 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f24122ed0 con 0x7f5f24138450 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 10 monclient: _renew_subs 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f24137470 con 0x7f5f24138450 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f1c001db0 con 0x7f5f24138450 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f217fa640 4 set_mon_vals no callback set 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f1c0042d0 con 0x7f5f24138450 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 10 monclient: dump: 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:35.941 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:35.942 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f08005090 con 0x7f5f24138450 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5f1c0044f0 con 0x7f5f24138450 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(50..50 src has 1..50) ==== 4291+0+0 (unknown 2447648136 0 0) 0x7f5f1c044b40 con 0x7f5f24138450 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.944+0000 7f5f22ffd640 10 monclient: get_auth_request con 0x7f5f04037790 auth_method 0 2024-04-25T23:57:35.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.956+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5f1c015bb0 con 0x7f5f24138450 2024-04-25T23:57:35.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.956+0000 7f5f1b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:35.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:35.956+0000 7f5f1b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:36.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:36.120+0000 7f5f292c3640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}] 2024-04-25T23:57:36.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:36.120+0000 7f5f292c3640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}] 2024-04-25T23:57:36.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:36.120+0000 7f5f292c3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:36.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:36.120+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"} v 0) -- 0x7f5f08005380 con 0x7f5f24138450 2024-04-25T23:57:37.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.492+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}]=0 pool 'ec-foo' created v52) ==== 177+0+0 (unknown 410854682 0 0) 0x7f5f1c01e060 con 0x7f5f24138450 2024-04-25T23:57:37.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.492+0000 7f5f1b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}] 2024-04-25T23:57:37.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.492+0000 7f5f1b7fe640 10 monclient: _finish_command 2 = system:0 pool 'ec-foo' created 2024-04-25T23:57:37.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.588+0000 7f5f292c3640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}] 2024-04-25T23:57:37.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.588+0000 7f5f292c3640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}] 2024-04-25T23:57:37.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.588+0000 7f5f292c3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:37.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.588+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"} v 0) -- 0x7f5f08001170 con 0x7f5f24138450 2024-04-25T23:57:37.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.592+0000 7f5f1b7fe640 1 -- 172.21.15.171:0/1334355772 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}]=0 pool 'ec-foo' already exists v52) ==== 184+0+0 (unknown 1973264386 0 0) 0x7f5f1c040be0 con 0x7f5f24138450 2024-04-25T23:57:37.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.592+0000 7f5f1b7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "ec-foo", "pg_num": 2, "pool_type": "erasure", "erasure_code_profile": "ec-foo-ssd"}] 2024-04-25T23:57:37.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.592+0000 7f5f1b7fe640 10 monclient: _finish_command 3 = system:0 pool 'ec-foo' already exists 2024-04-25T23:57:37.577 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'ec-foo' already exists 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.592+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 >> v1:172.21.15.171:6812/722422047 conn(0x7f5f04037790 legacy=0x7f5f04039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.592+0000 7f5f292c3640 10 monclient: shutdown 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.592+0000 7f5f292c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.592+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 >> v1:172.21.15.106:6792/0 conn(0x7f5f24138450 legacy=0x7f5f241d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.596+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 shutdown_connections 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.596+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 >> 172.21.15.171:0/1334355772 conn(0x7f5f240a9fc0 msgr2=0x7f5f241bf900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.596+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 shutdown_connections 2024-04-25T23:57:37.579 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.596+0000 7f5f292c3640 1 -- 172.21.15.171:0/1334355772 wait complete. 2024-04-25T23:57:37.594 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool rm ec-foo ec-foo --yes-i-really-really-mean-it 2024-04-25T23:57:37.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.728+0000 7f46ca5ab640 10 monclient: get_monmap_and_config 2024-04-25T23:57:37.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.728+0000 7f46ca5ab640 10 monclient: build_initial_monmap 2024-04-25T23:57:37.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.728+0000 7f46ca5ab640 10 monclient: monmap: 2024-04-25T23:57:37.715 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:37.715 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:37.715 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:37.734275+0000 2024-04-25T23:57:37.715 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:37.734275+0000 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:37.716 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:37.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 Processor -- start 2024-04-25T23:57:37.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- start start 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: init 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: _add_conns ranks=[3,0,6,8,7,4,5,2,1] 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): picked mon.noname-g con 0x7f46c41379d0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): picked mon.noname-a con 0x7f46c41384c0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): picked mon.noname-d con 0x7f46c413e620 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c40a2b00 con 0x7f46c41384c0 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c40a2de0 con 0x7f46c41379d0 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c40a17a0 con 0x7f46c413e620 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): authenticate will time out at 1108.441103s 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c3fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f46c41379d0 0x7f46c4137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51686/0 (socket says 172.21.15.171:51686) 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c3fff640 1 -- 172.21.15.171:0/529501385 learned_addr learned my addr 172.21.15.171:0/529501385 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:37.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2310676313 0 0) 0x7f46c40a2de0 con 0x7f46c41379d0 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient(hunting): my global_id is 5214 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46b0003530 con 0x7f46c41379d0 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c8b48640 1 -- 172.21.15.171:0/529501385 >> v1:172.21.15.106:6792/0 conn(0x7f46c413e620 legacy=0x7f46c4140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 15 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c8b48640 1 -- 172.21.15.171:0/529501385 >> v1:172.21.15.106:6792/0 conn(0x7f46c413e620 legacy=0x7f46c4140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c8b48640 1 --1- 172.21.15.171:0/529501385 >> v1:172.21.15.106:6792/0 conn(0x7f46c413e620 0x7f46c4140a10 :-1 s=OPENED pgs=253 cs=1 l=1).handle_message read tag failed 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c8b48640 1 --1- 172.21.15.171:0/529501385 >> v1:172.21.15.106:6792/0 conn(0x7f46c413e620 0x7f46c4140a10 :-1 s=OPENED pgs=253 cs=1 l=1).fault on lossy channel, failing 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2165084230 0 0) 0x7f46b0003530 con 0x7f46c41379d0 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 >> v1:172.21.15.106:6792/0 conn(0x7f46c413e620 legacy=0x7f46c4140a10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 >> v1:172.21.15.106:6789/0 conn(0x7f46c41384c0 legacy=0x7f46c413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:37.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 monclient: found mon.noname-g 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c40a3b20 con 0x7f46c41379d0 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: ms_handle_reset stray mon v1:172.21.15.106:6792/0 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46b4001b40 con 0x7f46c41379d0 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: dump: 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.725 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 5 monclient: authenticate success, global_id 5214 2024-04-25T23:57:37.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46b4001ea0 con 0x7f46c41379d0 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 4 set_mon_vals no callback set 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 1 -- 172.21.15.171:0/529501385 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46b40020d0 con 0x7f46c41379d0 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c2ffd640 10 monclient: dump: 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:37.727 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: shutdown 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- 172.21.15.171:0/529501385 >> v1:172.21.15.171:6790/0 conn(0x7f46c41379d0 legacy=0x7f46c4137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- 172.21.15.171:0/529501385 shutdown_connections 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- 172.21.15.171:0/529501385 >> 172.21.15.171:0/529501385 conn(0x7f46c40a6b30 msgr2=0x7f46c40a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:37.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- 172.21.15.171:0/529501385 shutdown_connections 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- 172.21.15.171:0/529501385 wait complete. 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: build_initial_monmap 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: monmap: 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:37.729 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 Processor -- start 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- start start 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: init 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient: _add_conns ranks=[4,7,0,8,5,3,2,1,6] 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): picked mon.noname-c con 0x7f46c41379d0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): picked mon.noname-i con 0x7f46c41384c0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): picked mon.noname-a con 0x7f46c413e620 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c40a0fa0 con 0x7f46c413e620 2024-04-25T23:57:37.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c409e210 con 0x7f46c41379d0 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46c4138cd0 con 0x7f46c41384c0 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46c37fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f46c41384c0 legacy=0x7f46c41d1b50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.732+0000 7f46ca5ab640 10 monclient(hunting): authenticate will time out at 1108.443995s 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c3fff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f46c41379d0 legacy=0x7f46c409fa20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c8b48640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f46c413e620 0x7f46c41d5280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:55426/0 (socket says 172.21.15.171:55426) 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c8b48640 1 -- 172.21.15.171:0/127964501 learned_addr learned my addr 172.21.15.171:0/127964501 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445446742 0 0) 0x7f46c40a17a0 con 0x7f46c413e620 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): my global_id is 5130 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46a4003530 con 0x7f46c413e620 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1132288352 0 0) 0x7f46a4003530 con 0x7f46c413e620 2024-04-25T23:57:37.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46c40a17a0 con 0x7f46c413e620 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46bc001a10 con 0x7f46c413e620 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:37.732 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1253674140 0 0) 0x7f46c40a17a0 con 0x7f46c413e620 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 >> v1:172.21.15.171:6792/0 conn(0x7f46c41384c0 legacy=0x7f46c41d1b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 >> v1:172.21.15.106:6791/0 conn(0x7f46c41379d0 legacy=0x7f46c409fa20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 monclient: found mon.a 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46c409c200 con 0x7f46c413e620 2024-04-25T23:57:37.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 5 monclient: authenticate success, global_id 5130 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 10 monclient: _renew_subs 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46c409e4f0 con 0x7f46c413e620 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 10 monclient: _renew_subs 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f46c41cca70 con 0x7f46c413e620 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46bc0038d0 con 0x7f46c413e620 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c27fc640 4 set_mon_vals no callback set 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46bc003e40 con 0x7f46c413e620 2024-04-25T23:57:37.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 10 monclient: dump: 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:37.735 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a8005090 con 0x7f46c413e620 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f46bc004060 con 0x7f46c413e620 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(52..52 src has 1..52) ==== 4732+0+0 (unknown 1857081448 0 0) 0x7f46bc044930 con 0x7f46c413e620 2024-04-25T23:57:37.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.736+0000 7f46c3fff640 10 monclient: get_auth_request con 0x7f46a4037780 auth_method 0 2024-04-25T23:57:37.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.752+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f46c40a0fa0 con 0x7f46c413e620 2024-04-25T23:57:37.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.752+0000 7f46c0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:37.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.752+0000 7f46c0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:37.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.912+0000 7f46ca5ab640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:37.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.912+0000 7f46ca5ab640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:37.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.912+0000 7f46ca5ab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:37.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:37.912+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true} v 0) -- 0x7f46a8005380 con 0x7f46c413e620 2024-04-25T23:57:38.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.488+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}]=0 pool 'ec-foo' removed v53) ==== 154+0+0 (unknown 458821254 0 0) 0x7f46bc015790 con 0x7f46c413e620 2024-04-25T23:57:38.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.488+0000 7f46c0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:38.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.488+0000 7f46c0ff9640 10 monclient: _finish_command 2 = system:0 pool 'ec-foo' removed 2024-04-25T23:57:38.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.588+0000 7f46ca5ab640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:38.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.588+0000 7f46ca5ab640 10 monclient: _send_command 3 [{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:38.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.588+0000 7f46ca5ab640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:38.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.588+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true} v 0) -- 0x7f46a8001150 con 0x7f46c413e620 2024-04-25T23:57:38.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.588+0000 7f46c0ff9640 1 -- 172.21.15.171:0/127964501 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}]=0 pool 'ec-foo' does not exist v53) ==== 161+0+0 (unknown 1709975918 0 0) 0x7f46bc015090 con 0x7f46c413e620 2024-04-25T23:57:38.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.588+0000 7f46c0ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool rm", "pool": "ec-foo", "pool2": "ec-foo", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:38.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.588+0000 7f46c0ff9640 10 monclient: _finish_command 3 = system:0 pool 'ec-foo' does not exist 2024-04-25T23:57:38.575 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'ec-foo' does not exist 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 >> v1:172.21.15.171:6812/722422047 conn(0x7f46a4037780 legacy=0x7f46a4039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 10 monclient: shutdown 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 >> v1:172.21.15.106:6789/0 conn(0x7f46c413e620 legacy=0x7f46c41d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 shutdown_connections 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 >> 172.21.15.171:0/127964501 conn(0x7f46c40a6b30 msgr2=0x7f46c41359d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 shutdown_connections 2024-04-25T23:57:38.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.592+0000 7f46ca5ab640 1 -- 172.21.15.171:0/127964501 wait complete. 2024-04-25T23:57:38.593 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls 2024-04-25T23:57:38.594 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo 2024-04-25T23:57:38.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient: get_monmap_and_config 2024-04-25T23:57:38.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient: build_initial_monmap 2024-04-25T23:57:38.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient: monmap: 2024-04-25T23:57:38.702 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:38.702 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:38.702 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:38.720840+0000 2024-04-25T23:57:38.702 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:38.720840+0000 2024-04-25T23:57:38.703 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:38.703 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:38.703 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:38.703 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:38.703 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:38.704 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:38.704 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:38.704 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:38.704 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:38.704 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:38.704 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:38.705 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 1 Processor -- start 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 1 -- start start 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient: init 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient: _add_conns ranks=[4,2,7,3,8,5,6,0,1] 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient(hunting): picked mon.noname-c con 0x7f59a006e4f0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient(hunting): picked mon.noname-b con 0x7f59a006efe0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient(hunting): picked mon.noname-i con 0x7f59a013aa40 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a0070df0 con 0x7f59a006efe0 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a00710d0 con 0x7f59a006e4f0 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a0072f10 con 0x7f59a013aa40 2024-04-25T23:57:38.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a82fa640 10 monclient(hunting): authenticate will time out at 1109.427612s 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a6897640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f59a013aa40 legacy=0x7f59a013ce30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a6096640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f59a006e4f0 legacy=0x7f59a006e8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.716+0000 7f59a5895640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f59a006efe0 0x7f59a0139320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:45066/0 (socket says 172.21.15.171:45066) 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5895640 1 -- 172.21.15.171:0/1072522835 learned_addr learned my addr 172.21.15.171:0/1072522835 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419198382 0 0) 0x7f59a0070df0 con 0x7f59a006efe0 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient(hunting): _negotiate 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient(hunting): my global_id is 5141 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f598c003450 con 0x7f59a006efe0 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 560228065 0 0) 0x7f598c003450 con 0x7f59a006efe0 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 >> v1:172.21.15.171:6792/0 conn(0x7f59a013aa40 legacy=0x7f59a013ce30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:38.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 >> v1:172.21.15.106:6791/0 conn(0x7f59a006e4f0 legacy=0x7f59a006e8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:38.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: _finish_hunting 0 2024-04-25T23:57:38.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 monclient: found mon.noname-b 2024-04-25T23:57:38.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:38.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:38.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a006fa90 con 0x7f59a006efe0 2024-04-25T23:57:38.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: _finish_auth 0 2024-04-25T23:57:38.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: _check_auth_tickets 2024-04-25T23:57:38.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:38.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59900017c0 con 0x7f59a006efe0 2024-04-25T23:57:38.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:38.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:38.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: dump: 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:38.717 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 5 monclient: authenticate success, global_id 5141 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5990001a20 con 0x7f59a006efe0 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:38.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 4 set_mon_vals no callback set 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 1 -- 172.21.15.171:0/1072522835 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5990004bf0 con 0x7f59a006efe0 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5094640 10 monclient: dump: 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.719 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient: shutdown 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- 172.21.15.171:0/1072522835 >> v1:172.21.15.106:6790/0 conn(0x7f59a006efe0 legacy=0x7f59a0139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:38.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- 172.21.15.171:0/1072522835 shutdown_connections 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- 172.21.15.171:0/1072522835 >> 172.21.15.171:0/1072522835 conn(0x7f59a00a2620 msgr2=0x7f59a00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- 172.21.15.171:0/1072522835 shutdown_connections 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- 172.21.15.171:0/1072522835 wait complete. 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient: build_initial_monmap 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient: monmap: 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:38.721 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:38.722 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 Processor -- start 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- start start 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient: init 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient: _add_conns ranks=[3,8,0,7,1,5,6,4,2] 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient(hunting): picked mon.noname-g con 0x7f59a006e4f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient(hunting): picked mon.noname-e con 0x7f59a006efe0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:38.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient(hunting): picked mon.noname-a con 0x7f59a013aa40 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a0070930 con 0x7f59a013aa40 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a00703e0 con 0x7f59a006e4f0 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a0121d90 con 0x7f59a006efe0 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a82fa640 10 monclient(hunting): authenticate will time out at 1109.431223s 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a5895640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f59a006efe0 legacy=0x7f59a01d11b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a6096640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f59a006e4f0 0x7f59a01338d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51690/0 (socket says 172.21.15.171:51690) 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f59a6096640 1 -- 172.21.15.171:0/4225443873 learned_addr learned my addr 172.21.15.171:0/4225443873 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093483819 0 0) 0x7f59a00703e0 con 0x7f59a006e4f0 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:38.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): my global_id is 5223 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5984003530 con 0x7f59a006e4f0 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3386942470 0 0) 0x7f5984003530 con 0x7f59a006e4f0 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a00703e0 con 0x7f59a006e4f0 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f599c004330 con 0x7f59a006e4f0 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.725 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.720+0000 7f5996ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1671218399 0 0) 0x7f59a0070930 con 0x7f59a013aa40 2024-04-25T23:57:38.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient(hunting): my global_id is 5139 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5984003530 con 0x7f59a013aa40 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2676640866 0 0) 0x7f59a00703e0 con 0x7f59a006e4f0 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 >> v1:172.21.15.106:6793/0 conn(0x7f59a006efe0 legacy=0x7f59a01d11b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 >> v1:172.21.15.106:6789/0 conn(0x7f59a013aa40 legacy=0x7f59a01d48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 monclient: found mon.g 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:38.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a0122070 con 0x7f59a006e4f0 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 5 monclient: authenticate success, global_id 5223 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 10 monclient: _renew_subs 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59a0120630 con 0x7f59a006e4f0 2024-04-25T23:57:38.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 10 monclient: _renew_subs 2024-04-25T23:57:38.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:38.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f59a01341b0 con 0x7f59a006e4f0 2024-04-25T23:57:38.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f599c004620 con 0x7f59a006e4f0 2024-04-25T23:57:38.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:38.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f599c004b90 con 0x7f59a006e4f0 2024-04-25T23:57:38.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5997fff640 4 set_mon_vals no callback set 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 10 monclient: dump: 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:38.730 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:38.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5988005090 con 0x7f59a006e4f0 2024-04-25T23:57:38.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f599c004db0 con 0x7f59a006e4f0 2024-04-25T23:57:38.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(53..53 src has 1..53) ==== 4377+0+0 (unknown 3272218934 0 0) 0x7f599c044870 con 0x7f59a006e4f0 2024-04-25T23:57:38.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.724+0000 7f59a5895640 10 monclient: get_auth_request con 0x7f59840377b0 auth_method 0 2024-04-25T23:57:38.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.728+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f599c015910 con 0x7f59a006e4f0 2024-04-25T23:57:38.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.728+0000 7f5996ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:38.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.728+0000 7f5996ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:38.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.892+0000 7f59a82fa640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:38.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.892+0000 7f59a82fa640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:38.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.892+0000 7f59a82fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:38.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.892+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f5988005380 con 0x7f59a006e4f0 2024-04-25T23:57:38.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.892+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v53) ==== 65+0+60 (unknown 506267362 0 1596542489) 0x7f599c015210 con 0x7f59a006e4f0 2024-04-25T23:57:38.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.892+0000 7f5996ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:38.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.892+0000 7f5996ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:38.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.984+0000 7f59a82fa640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:38.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.984+0000 7f59a82fa640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:38.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.984+0000 7f59a82fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:38.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.984+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f5988000bd0 con 0x7f59a006e4f0 2024-04-25T23:57:38.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.984+0000 7f5996ffd640 1 -- 172.21.15.171:0/4225443873 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v53) ==== 65+0+60 (unknown 506267362 0 1596542489) 0x7f599c019560 con 0x7f59a006e4f0 2024-04-25T23:57:38.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.984+0000 7f5996ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:38.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.984+0000 7f5996ffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 >> v1:172.21.15.171:6812/722422047 conn(0x7f59840377b0 legacy=0x7f5984039c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 10 monclient: shutdown 2024-04-25T23:57:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 >> v1:172.21.15.171:6790/0 conn(0x7f59a006e4f0 legacy=0x7f59a01338d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 shutdown_connections 2024-04-25T23:57:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 >> 172.21.15.171:0/4225443873 conn(0x7f59a00a2620 msgr2=0x7f59a009f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 shutdown_connections 2024-04-25T23:57:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:38.988+0000 7f59a82fa640 1 -- 172.21.15.171:0/4225443873 wait complete. 2024-04-25T23:57:38.986 INFO:tasks.workunit.client.0.smithi171.stdout:foo 2024-04-25T23:57:38.986 INFO:tasks.workunit.client.0.smithi171.stdout:foo-ssd 2024-04-25T23:57:38.986 INFO:tasks.workunit.client.0.smithi171.stdout:foo-hdd 2024-04-25T23:57:38.986 INFO:tasks.workunit.client.0.smithi171.stdout:ec-foo 2024-04-25T23:57:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rename foo foo-asdf 2024-04-25T23:57:39.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.120+0000 7f8ec507c640 10 monclient: get_monmap_and_config 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.120+0000 7f8ec507c640 10 monclient: build_initial_monmap 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.120+0000 7f8ec507c640 10 monclient: monmap: 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:39.125986+0000 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:39.125986+0000 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:39.107 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:39.108 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:39.108 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:39.108 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:39.108 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:39.108 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 Processor -- start 2024-04-25T23:57:39.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- start start 2024-04-25T23:57:39.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: init 2024-04-25T23:57:39.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:39.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: _add_conns ranks=[3,4,0,7,6,2,8,1,5] 2024-04-25T23:57:39.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient(hunting): picked mon.noname-g con 0x7f8ec01379d0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient(hunting): picked mon.noname-c con 0x7f8ec01384c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient(hunting): picked mon.noname-a con 0x7f8ec013e620 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec00a2b00 con 0x7f8ec013e620 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec00a2de0 con 0x7f8ec01379d0 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec00a17a0 con 0x7f8ec01384c0 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient(hunting): authenticate will time out at 1109.833513s 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebed9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f8ec01379d0 0x7f8ec0137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51704/0 (socket says 172.21.15.171:51704) 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebed9d640 1 -- 172.21.15.171:0/972235735 learned_addr learned my addr 172.21.15.171:0/972235735 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebe59c640 1 -- 172.21.15.171:0/972235735 >> v1:172.21.15.106:6791/0 conn(0x7f8ec01384c0 legacy=0x7f8ec013cf00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331099789 0 0) 0x7f8ec00a2de0 con 0x7f8ec01379d0 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient(hunting): _negotiate 2024-04-25T23:57:39.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient(hunting): my global_id is 5232 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eac003530 con 0x7f8ec01379d0 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1232319275 0 0) 0x7f8eac003530 con 0x7f8ec01379d0 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 >> v1:172.21.15.106:6791/0 conn(0x7f8ec01384c0 legacy=0x7f8ec013cf00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 >> v1:172.21.15.106:6789/0 conn(0x7f8ec013e620 legacy=0x7f8ec0140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: _finish_hunting 0 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 monclient: found mon.noname-g 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec00a3b20 con 0x7f8ec01379d0 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: _finish_auth 0 2024-04-25T23:57:39.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: _check_auth_tickets 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8eb00017c0 con 0x7f8ec01379d0 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: dump: 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.115 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 5 monclient: authenticate success, global_id 5232 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8eb0001b20 con 0x7f8ec01379d0 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 4 set_mon_vals no callback set 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 1 -- 172.21.15.171:0/972235735 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8eb0001d50 con 0x7f8ec01379d0 2024-04-25T23:57:39.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ebdd9b640 10 monclient: dump: 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.117 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: shutdown 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- 172.21.15.171:0/972235735 >> v1:172.21.15.171:6790/0 conn(0x7f8ec01379d0 legacy=0x7f8ec0137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- 172.21.15.171:0/972235735 shutdown_connections 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- 172.21.15.171:0/972235735 >> 172.21.15.171:0/972235735 conn(0x7f8ec00a6b30 msgr2=0x7f8ec00a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- 172.21.15.171:0/972235735 shutdown_connections 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- 172.21.15.171:0/972235735 wait complete. 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: build_initial_monmap 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: monmap: 2024-04-25T23:57:39.118 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:39.119 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 Processor -- start 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 1 -- start start 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.124+0000 7f8ec507c640 10 monclient: init 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _add_conns ranks=[7,4,0,8,2,6,1,5,3] 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient(hunting): picked mon.noname-i con 0x7f8ec01379d0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient(hunting): picked mon.noname-c con 0x7f8ec01384c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient(hunting): picked mon.noname-a con 0x7f8ec013e620 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec013a890 con 0x7f8ec013e620 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec013c6c0 con 0x7f8ec01384c0 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ebed9d640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f8ec01379d0 legacy=0x7f8ec0139a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ec013c9a0 con 0x7f8ec01379d0 2024-04-25T23:57:39.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient(hunting): authenticate will time out at 1109.836473s 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ebe59c640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f8ec01384c0 legacy=0x7f8ec013a180 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ebf59e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8ec013e620 0x7f8ec01d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:55462/0 (socket says 172.21.15.171:55462) 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ebf59e640 1 -- 172.21.15.171:0/2707049195 learned_addr learned my addr 172.21.15.171:0/2707049195 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879232106 0 0) 0x7f8ec013a890 con 0x7f8ec013e620 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): my global_id is 5157 2024-04-25T23:57:39.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ea0003530 con 0x7f8ec013e620 2024-04-25T23:57:39.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3572661564 0 0) 0x7f8ea0003530 con 0x7f8ec013e620 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ec013a890 con 0x7f8ec013e620 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8eb8001d50 con 0x7f8ec013e620 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): dump: 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.124 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 978869250 0 0) 0x7f8ec013a890 con 0x7f8ec013e620 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 >> v1:172.21.15.171:6792/0 conn(0x7f8ec01379d0 legacy=0x7f8ec0139a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 >> v1:172.21.15.106:6791/0 conn(0x7f8ec01384c0 legacy=0x7f8ec013a180 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 monclient: found mon.a 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:39.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ec013adf0 con 0x7f8ec013e620 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 5 monclient: authenticate success, global_id 5157 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _renew_subs 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ec013d830 con 0x7f8ec013e620 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _renew_subs 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ec013cf90 con 0x7f8ec013e620 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8eb8002090 con 0x7f8ec013e620 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:39.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ebd59a640 4 set_mon_vals no callback set 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8eb8003f90 con 0x7f8ec013e620 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 10 monclient: dump: 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.127 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ea4005090 con 0x7f8ec013e620 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.128+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8eb80041b0 con 0x7f8ec013e620 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.132+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(53..53 src has 1..53) ==== 4377+0+0 (unknown 3272218934 0 0) 0x7f8eb8044a60 con 0x7f8ec013e620 2024-04-25T23:57:39.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.132+0000 7f8ebed9d640 10 monclient: get_auth_request con 0x7f8ea00377e0 auth_method 0 2024-04-25T23:57:39.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.144+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8eb8015a80 con 0x7f8ec013e620 2024-04-25T23:57:39.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.144+0000 7f8eb77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:39.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.144+0000 7f8eb77fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:39.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.308+0000 7f8ec507c640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.308+0000 7f8ec507c640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.308+0000 7f8ec507c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:39.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.308+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"} v 0) -- 0x7f8ea4005380 con 0x7f8ec013e620 2024-04-25T23:57:39.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.512+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}]=0 v54) ==== 110+0+0 (unknown 4084335562 0 0) 0x7f8eb8015380 con 0x7f8ec013e620 2024-04-25T23:57:39.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.512+0000 7f8eb77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.512+0000 7f8eb77fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:39.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.604+0000 7f8ec507c640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.604+0000 7f8ec507c640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.604+0000 7f8ec507c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:39.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.604+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"} v 0) -- 0x7f8ea4005ac0 con 0x7f8ec013e620 2024-04-25T23:57:39.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8eb77fe640 1 -- 172.21.15.171:0/2707049195 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}]=0 already renamed to 'foo-asdf' v54) ==== 139+0+0 (unknown 204296079 0 0) 0x7f8eb801df30 con 0x7f8ec013e620 2024-04-25T23:57:39.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8eb77fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8eb77fe640 10 monclient: _finish_command 3 = system:0 already renamed to 'foo-asdf' 2024-04-25T23:57:39.592 INFO:tasks.workunit.client.0.smithi171.stderr:already renamed to 'foo-asdf' 2024-04-25T23:57:39.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 >> v1:172.21.15.171:6812/722422047 conn(0x7f8ea00377e0 legacy=0x7f8ea0039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 10 monclient: shutdown 2024-04-25T23:57:39.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:39.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 >> v1:172.21.15.106:6789/0 conn(0x7f8ec013e620 legacy=0x7f8ec01d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 shutdown_connections 2024-04-25T23:57:39.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 >> 172.21.15.171:0/2707049195 conn(0x7f8ec00a6b30 msgr2=0x7f8ec00a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:39.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 shutdown_connections 2024-04-25T23:57:39.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.608+0000 7f8ec507c640 1 -- 172.21.15.171:0/2707049195 wait complete. 2024-04-25T23:57:39.608 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rename foo foo-asdf 2024-04-25T23:57:39.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient: get_monmap_and_config 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient: build_initial_monmap 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient: monmap: 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:39.744000+0000 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:39.744000+0000 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:39.725 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:39.726 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:39.726 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:39.726 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:39.726 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 1 Processor -- start 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 1 -- start start 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient: init 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient: _add_conns ranks=[8,0,7,3,6,2,1,4,5] 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient(hunting): picked mon.noname-e con 0x7f65ac134c70 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient(hunting): picked mon.noname-a con 0x7f65ac135050 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 10 monclient(hunting): picked mon.noname-i con 0x7f65ac13af70 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac09c4e0 con 0x7f65ac135050 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.740+0000 7f65b239e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac09c7c0 con 0x7f65ac13af70 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac09caa0 con 0x7f65ac134c70 2024-04-25T23:57:39.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient(hunting): authenticate will time out at 1110.452019s 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b093b640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f65ac13af70 legacy=0x7f65ac13d360 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65abfff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f65ac134c70 legacy=0x7f65ac134530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65ab7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f65ac135050 0x7f65ac139850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:55478/0 (socket says 172.21.15.171:55478) 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65ab7fe640 1 -- 172.21.15.171:0/772681375 learned_addr learned my addr 172.21.15.171:0/772681375 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858812760 0 0) 0x7f65ac09c4e0 con 0x7f65ac135050 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient(hunting): my global_id is 5166 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6594003530 con 0x7f65ac135050 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1818872109 0 0) 0x7f6594003530 con 0x7f65ac135050 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 >> v1:172.21.15.106:6793/0 conn(0x7f65ac134c70 legacy=0x7f65ac134530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:39.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 >> v1:172.21.15.171:6792/0 conn(0x7f65ac13af70 legacy=0x7f65ac13d360 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 monclient: found mon.noname-a 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac09d1a0 con 0x7f65ac135050 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f65a00017c0 con 0x7f65ac135050 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: dump: 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.732 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 5 monclient: authenticate success, global_id 5166 2024-04-25T23:57:39.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65a0001b20 con 0x7f65ac135050 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 4 set_mon_vals no callback set 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 1 -- 172.21.15.171:0/772681375 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f65a0001d50 con 0x7f65ac135050 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65aaffd640 10 monclient: dump: 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.734 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient: shutdown 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- 172.21.15.171:0/772681375 >> v1:172.21.15.106:6789/0 conn(0x7f65ac135050 legacy=0x7f65ac139850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- 172.21.15.171:0/772681375 shutdown_connections 2024-04-25T23:57:39.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- 172.21.15.171:0/772681375 >> 172.21.15.171:0/772681375 conn(0x7f65ac0a2e70 msgr2=0x7f65ac0a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- 172.21.15.171:0/772681375 shutdown_connections 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- 172.21.15.171:0/772681375 wait complete. 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient: build_initial_monmap 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient: monmap: 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:39.736 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 Processor -- start 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- start start 2024-04-25T23:57:39.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient: init 2024-04-25T23:57:39.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient: _add_conns ranks=[7,3,0,6,1,2,8,4,5] 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient(hunting): picked mon.noname-i con 0x7f65ac134c70 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient(hunting): picked mon.noname-g con 0x7f65ac135050 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient(hunting): picked mon.noname-a con 0x7f65ac13af70 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac1378e0 con 0x7f65ac13af70 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65abfff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f65ac134c70 legacy=0x7f65ac09d770 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac09e590 con 0x7f65ac135050 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65ac136ac0 con 0x7f65ac134c70 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65b239e640 10 monclient(hunting): authenticate will time out at 1110.455556s 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65ab7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f65ac135050 0x7f65ac09de80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51710/0 (socket says 172.21.15.171:51710) 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65ab7fe640 1 -- 172.21.15.171:0/1717483656 learned_addr learned my addr 172.21.15.171:0/1717483656 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:39.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274328946 0 0) 0x7f65ac09e590 con 0x7f65ac135050 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65a8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65a8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65a8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65a8ff9640 10 monclient(hunting): my global_id is 5241 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.744+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6598003530 con 0x7f65ac135050 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2593563384 0 0) 0x7f6598003530 con 0x7f65ac135050 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f65ac09e590 con 0x7f65ac135050 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f65a0001780 con 0x7f65ac135050 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:39.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.743 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3820124088 0 0) 0x7f65ac09e590 con 0x7f65ac135050 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 >> v1:172.21.15.171:6792/0 conn(0x7f65ac134c70 legacy=0x7f65ac09d770 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 >> v1:172.21.15.106:6789/0 conn(0x7f65ac13af70 legacy=0x7f65ac1d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 monclient: found mon.g 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65ac137040 con 0x7f65ac135050 2024-04-25T23:57:39.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 5 monclient: authenticate success, global_id 5241 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 10 monclient: _renew_subs 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f65ac137320 con 0x7f65ac135050 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 10 monclient: _renew_subs 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f65ac09e8a0 con 0x7f65ac135050 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f65a0001b20 con 0x7f65ac135050 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f65a0005350 con 0x7f65ac135050 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a9ffb640 4 set_mon_vals no callback set 2024-04-25T23:57:39.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 10 monclient: dump: 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:39.746 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f65a00100f0 con 0x7f65ac135050 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c005090 con 0x7f65ac135050 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(54..54 src has 1..54) ==== 4382+0+0 (unknown 1999875942 0 0) 0x7f65a00449b0 con 0x7f65ac135050 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.748+0000 7f65abfff640 10 monclient: get_auth_request con 0x7f65980376a0 auth_method 0 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.752+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f65a0015970 con 0x7f65ac135050 2024-04-25T23:57:39.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.752+0000 7f65a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:39.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.752+0000 7f65a8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:39.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.908+0000 7f65b239e640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.908+0000 7f65b239e640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.908+0000 7f65b239e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:39.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.908+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"} v 0) -- 0x7f658c005380 con 0x7f65ac135050 2024-04-25T23:57:39.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.912+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}]=0 already renamed to 'foo-asdf' v54) ==== 139+0+0 (unknown 204296079 0 0) 0x7f65a001de20 con 0x7f65ac135050 2024-04-25T23:57:39.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.912+0000 7f65a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:39.912+0000 7f65a8ff9640 10 monclient: _finish_command 2 = system:0 already renamed to 'foo-asdf' 2024-04-25T23:57:39.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.000+0000 7f65b239e640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.000+0000 7f65b239e640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.000+0000 7f65b239e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:39.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.000+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"} v 0) -- 0x7f658c000c30 con 0x7f65ac135050 2024-04-25T23:57:39.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65a8ff9640 1 -- 172.21.15.171:0/1717483656 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}]=0 already renamed to 'foo-asdf' v54) ==== 139+0+0 (unknown 204296079 0 0) 0x7f65a00434c0 con 0x7f65ac135050 2024-04-25T23:57:39.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65a8ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rename", "srcname": "foo", "dstname": "foo-asdf"}] 2024-04-25T23:57:39.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65a8ff9640 10 monclient: _finish_command 3 = system:0 already renamed to 'foo-asdf' 2024-04-25T23:57:39.988 INFO:tasks.workunit.client.0.smithi171.stderr:already renamed to 'foo-asdf' 2024-04-25T23:57:39.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 >> v1:172.21.15.171:6812/722422047 conn(0x7f65980376a0 legacy=0x7f6598039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 10 monclient: shutdown 2024-04-25T23:57:39.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:39.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 >> v1:172.21.15.171:6790/0 conn(0x7f65ac135050 legacy=0x7f65ac09de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:39.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 shutdown_connections 2024-04-25T23:57:39.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 >> 172.21.15.171:0/1717483656 conn(0x7f65ac0a2e70 msgr2=0x7f65ac13d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:39.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 shutdown_connections 2024-04-25T23:57:39.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.004+0000 7f65b239e640 1 -- 172.21.15.171:0/1717483656 wait complete. 2024-04-25T23:57:40.003 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rename bar bar-asdf 2024-04-25T23:57:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.132+0000 7f5860526640 10 monclient: get_monmap_and_config 2024-04-25T23:57:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.132+0000 7f5860526640 10 monclient: build_initial_monmap 2024-04-25T23:57:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: monmap: 2024-04-25T23:57:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:40.138519+0000 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:40.138519+0000 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:40.121 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 Processor -- start 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- start start 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: init 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: _add_conns ranks=[0,4,3,5,6,2,8,7,1] 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient(hunting): picked mon.noname-a con 0x7f58581379d0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient(hunting): picked mon.noname-c con 0x7f58581384c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient(hunting): picked mon.noname-g con 0x7f585813e620 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:40.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58580a2b00 con 0x7f58581379d0 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58580a2de0 con 0x7f585813e620 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58580a17a0 con 0x7f58581384c0 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient(hunting): authenticate will time out at 1110.845473s 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585dac1640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f58581384c0 legacy=0x7f585813cf00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585eac3640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f585813e620 0x7f5858140a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51720/0 (socket says 172.21.15.171:51720) 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585eac3640 1 -- 172.21.15.171:0/4133439206 learned_addr learned my addr 172.21.15.171:0/4133439206 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705193907 0 0) 0x7f58580a2de0 con 0x7f585813e620 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient(hunting): _negotiate 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient(hunting): my global_id is 5250 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5844003530 con 0x7f585813e620 2024-04-25T23:57:40.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2783679930 0 0) 0x7f5844003530 con 0x7f585813e620 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 >> v1:172.21.15.106:6791/0 conn(0x7f58581384c0 legacy=0x7f585813cf00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 >> v1:172.21.15.106:6789/0 conn(0x7f58581379d0 legacy=0x7f5858137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: _finish_hunting 0 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 monclient: found mon.noname-g 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58580a3b20 con 0x7f585813e620 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: _finish_auth 0 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: _check_auth_tickets 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:40.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5850001b40 con 0x7f585813e620 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: dump: 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.129 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 5 monclient: authenticate success, global_id 5250 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5850001ea0 con 0x7f585813e620 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 1 -- 172.21.15.171:0/4133439206 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58500020d0 con 0x7f585813e620 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:40.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f585d2c0640 10 monclient: dump: 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.131 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 4 set_mon_vals no callback set 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: shutdown 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- 172.21.15.171:0/4133439206 >> v1:172.21.15.171:6790/0 conn(0x7f585813e620 legacy=0x7f5858140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- 172.21.15.171:0/4133439206 shutdown_connections 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- 172.21.15.171:0/4133439206 >> 172.21.15.171:0/4133439206 conn(0x7f58580a6b30 msgr2=0x7f58580a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- 172.21.15.171:0/4133439206 shutdown_connections 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- 172.21.15.171:0/4133439206 wait complete. 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: build_initial_monmap 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: monmap: 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 Processor -- start 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 1 -- start start 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.136+0000 7f5860526640 10 monclient: init 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _add_conns ranks=[4,7,3,1,5,0,2,6,8] 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient(hunting): picked mon.noname-c con 0x7f58581379d0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient(hunting): picked mon.noname-i con 0x7f58581384c0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient(hunting): picked mon.noname-g con 0x7f585813e620 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585813c450 con 0x7f585813e620 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585813c730 con 0x7f58581379d0 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f585812e570 con 0x7f58581384c0 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient(hunting): authenticate will time out at 1110.848348s 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f585dac1640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f58581384c0 legacy=0x7f585812de60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f585eac3640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f585813e620 0x7f58581d4c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51732/0 (socket says 172.21.15.171:51732) 2024-04-25T23:57:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f585eac3640 1 -- 172.21.15.171:0/4152217971 learned_addr learned my addr 172.21.15.171:0/4152217971 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f585e2c2640 1 -- 172.21.15.171:0/4152217971 >> v1:172.21.15.106:6791/0 conn(0x7f58581379d0 legacy=0x7f585812d750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684877124 0 0) 0x7f585813c450 con 0x7f585813e620 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): my global_id is 5259 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f583c003530 con 0x7f585813e620 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2858683546 0 0) 0x7f583c003530 con 0x7f585813e620 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f585813c450 con 0x7f585813e620 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5850001b00 con 0x7f585813e620 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): dump: 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1764613946 0 0) 0x7f585813c450 con 0x7f585813e620 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 >> v1:172.21.15.171:6792/0 conn(0x7f58581384c0 legacy=0x7f585812de60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 >> v1:172.21.15.106:6791/0 conn(0x7f58581379d0 legacy=0x7f585812d750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 monclient: found mon.g 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58581376b0 con 0x7f585813e620 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: _finish_auth 0 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 5 monclient: authenticate success, global_id 5259 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _renew_subs 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58580a0fa0 con 0x7f585813e620 2024-04-25T23:57:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _renew_subs 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f585813ca10 con 0x7f585813e620 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5850001390 con 0x7f585813e620 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5850005630 con 0x7f585813e620 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f585cabf640 4 set_mon_vals no callback set 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 10 monclient: dump: 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5850010450 con 0x7f585813e620 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(54..54 src has 1..54) ==== 4382+0+0 (unknown 1999875942 0 0) 0x7f5850044bf0 con 0x7f585813e620 2024-04-25T23:57:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5840005090 con 0x7f585813e620 2024-04-25T23:57:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.140+0000 7f585e2c2640 10 monclient: get_auth_request con 0x7f583c037780 auth_method 0 2024-04-25T23:57:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.144+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5850015c70 con 0x7f585813e620 2024-04-25T23:57:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.144+0000 7f584effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.144+0000 7f584effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:40.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.308+0000 7f5860526640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}] 2024-04-25T23:57:40.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.308+0000 7f5860526640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}] 2024-04-25T23:57:40.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.308+0000 7f5860526640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.308+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"} v 0) -- 0x7f5840005380 con 0x7f585813e620 2024-04-25T23:57:40.512 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.528+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}]=0 v55) ==== 110+0+0 (unknown 946741588 0 0) 0x7f5850015570 con 0x7f585813e620 2024-04-25T23:57:40.512 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.528+0000 7f584effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}] 2024-04-25T23:57:40.512 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.528+0000 7f584effd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:40.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.628+0000 7f5860526640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}] 2024-04-25T23:57:40.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.628+0000 7f5860526640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}] 2024-04-25T23:57:40.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.628+0000 7f5860526640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.628+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"} v 0) -- 0x7f5840005ac0 con 0x7f585813e620 2024-04-25T23:57:40.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f584effd640 1 -- 172.21.15.171:0/4152217971 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}]=0 already renamed to 'bar-asdf' v55) ==== 139+0+0 (unknown 896107872 0 0) 0x7f58500138d0 con 0x7f585813e620 2024-04-25T23:57:40.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f584effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rename", "srcname": "bar", "dstname": "bar-asdf"}] 2024-04-25T23:57:40.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f584effd640 10 monclient: _finish_command 3 = system:0 already renamed to 'bar-asdf' 2024-04-25T23:57:40.615 INFO:tasks.workunit.client.0.smithi171.stderr:already renamed to 'bar-asdf' 2024-04-25T23:57:40.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 >> v1:172.21.15.171:6812/722422047 conn(0x7f583c037780 legacy=0x7f583c039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:40.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 10 monclient: shutdown 2024-04-25T23:57:40.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:40.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 >> v1:172.21.15.171:6790/0 conn(0x7f585813e620 legacy=0x7f58581d4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:40.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 shutdown_connections 2024-04-25T23:57:40.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 >> 172.21.15.171:0/4152217971 conn(0x7f58580a6b30 msgr2=0x7f58580a49e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:40.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 shutdown_connections 2024-04-25T23:57:40.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.632+0000 7f5860526640 1 -- 172.21.15.171:0/4152217971 wait complete. 2024-04-25T23:57:40.633 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls 2024-04-25T23:57:40.633 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo-asdf 2024-04-25T23:57:40.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient: get_monmap_and_config 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient: build_initial_monmap 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient: monmap: 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:40.767800+0000 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:40.767800+0000 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.749 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:40.750 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 1 Processor -- start 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 1 -- start start 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient: init 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient: _add_conns ranks=[6,7,1,0,5,2,3,8,4] 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient(hunting): picked mon.noname-d con 0x7f2cbc06fe00 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient(hunting): picked mon.noname-i con 0x7f2cbc06f600 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient(hunting): picked mon.noname-f con 0x7f2cbc0701e0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cbc06fa00 con 0x7f2cbc0701e0 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cbc135400 con 0x7f2cbc06fe00 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cbc071670 con 0x7f2cbc06f600 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cc1b51640 10 monclient(hunting): authenticate will time out at 1111.474981s 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cbaffd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f2cbc06f600 legacy=0x7f2cbc134cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cbbfff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f2cbc0701e0 legacy=0x7f2cbc13d930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cbb7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f2cbc06fe00 0x7f2cbc1345e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:43388/0 (socket says 172.21.15.171:43388) 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cbb7fe640 1 -- 172.21.15.171:0/4182444014 learned_addr learned my addr 172.21.15.171:0/4182444014 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042349633 0 0) 0x7f2cbc135400 con 0x7f2cbc06fe00 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cba7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cba7fc640 10 monclient(hunting): my global_id is 5172 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.764+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca4005740 con 0x7f2cbc06fe00 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2640594084 0 0) 0x7f2ca4005740 con 0x7f2cbc06fe00 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 >> v1:172.21.15.171:6792/0 conn(0x7f2cbc06f600 legacy=0x7f2cbc134cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 >> v1:172.21.15.171:6789/0 conn(0x7f2cbc0701e0 legacy=0x7f2cbc13d930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 monclient: found mon.noname-d 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc070630 con 0x7f2cbc06fe00 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:40.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2cac0017c0 con 0x7f2cbc06fe00 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 5 monclient: authenticate success, global_id 5172 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: dump: 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.759 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cac001ab0 con 0x7f2cbc06fe00 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:40.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 4 set_mon_vals no callback set 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 1 -- 172.21.15.171:0/4182444014 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2cac004bf0 con 0x7f2cbc06fe00 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cba7fc640 10 monclient: dump: 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.761 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: shutdown 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- 172.21.15.171:0/4182444014 >> v1:172.21.15.106:6792/0 conn(0x7f2cbc06fe00 legacy=0x7f2cbc1345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- 172.21.15.171:0/4182444014 shutdown_connections 2024-04-25T23:57:40.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- 172.21.15.171:0/4182444014 >> 172.21.15.171:0/4182444014 conn(0x7f2cbc0a2620 msgr2=0x7f2cbc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- 172.21.15.171:0/4182444014 shutdown_connections 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- 172.21.15.171:0/4182444014 wait complete. 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: build_initial_monmap 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: monmap: 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:40.763 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 Processor -- start 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- start start 2024-04-25T23:57:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: init 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: _add_conns ranks=[1,3,7,6,4,2,8,0,5] 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient(hunting): picked mon.noname-f con 0x7f2cbc06f600 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient(hunting): picked mon.noname-g con 0x7f2cbc06fe00 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient(hunting): picked mon.noname-i con 0x7f2cbc0701e0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cbc070d60 con 0x7f2cbc06f600 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cbb7fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f2cbc06f600 legacy=0x7f2cbc1ccb20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cbc070880 con 0x7f2cbc06fe00 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cbc125870 con 0x7f2cbc0701e0 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient(hunting): authenticate will time out at 1111.478314s 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cbbfff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f2cbc0701e0 legacy=0x7f2cbc1d4e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:40.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cbaffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2cbc06fe00 0x7f2cbc1d1740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60224/0 (socket says 172.21.15.171:60224) 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cbaffd640 1 -- 172.21.15.171:0/3948739374 learned_addr learned my addr 172.21.15.171:0/3948739374 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692725429 0 0) 0x7f2cbc070880 con 0x7f2cbc06fe00 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): my global_id is 5268 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ca8003530 con 0x7f2cbc06fe00 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2539497204 0 0) 0x7f2ca8003530 con 0x7f2cbc06fe00 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2cbc070880 con 0x7f2cbc06fe00 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2cb0004300 con 0x7f2cbc06fe00 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:40.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): dump: 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.767 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 287621047 0 0) 0x7f2cbc070880 con 0x7f2cbc06fe00 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 >> v1:172.21.15.171:6792/0 conn(0x7f2cbc0701e0 legacy=0x7f2cbc1d4e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 >> v1:172.21.15.171:6789/0 conn(0x7f2cbc06f600 legacy=0x7f2cbc1ccb20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 monclient: found mon.g 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc127880 con 0x7f2cbc06fe00 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:40.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 5 monclient: authenticate success, global_id 5268 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: _renew_subs 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2cbc127b60 con 0x7f2cbc06fe00 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: _renew_subs 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2cbc1cd230 con 0x7f2cbc06fe00 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2cb00045f0 con 0x7f2cbc06fe00 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2cb0004b60 con 0x7f2cbc06fe00 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2cb9ffb640 4 set_mon_vals no callback set 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:40.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 10 monclient: dump: 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:40.770 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:40.771 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:40.771 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:40.771 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:40.771 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:40.771 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:40.771 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.768+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2cb0004d80 con 0x7f2cbc06fe00 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.772+0000 7f2cc1b51640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.772+0000 7f2cc1b51640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.772+0000 7f2cc1b51640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.772+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c005090 con 0x7f2cbc06fe00 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.772+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(55..55 src has 1..55) ==== 4387+0+0 (unknown 2277463944 0 0) 0x7f2cb0044980 con 0x7f2cbc06fe00 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.772+0000 7f2cbb7fe640 10 monclient: get_auth_request con 0x7f2ca8037770 auth_method 0 2024-04-25T23:57:40.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.776+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2cb00158d0 con 0x7f2cbc06fe00 2024-04-25T23:57:40.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.776+0000 7f2ca3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:40.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.776+0000 7f2ca3fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:40.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.936+0000 7f2cc1b51640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:40.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.936+0000 7f2cc1b51640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:40.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.936+0000 7f2cc1b51640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:40.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.936+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f2c9c005380 con 0x7f2cbc06fe00 2024-04-25T23:57:40.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.936+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v55) ==== 65+0+70 (unknown 3646917667 0 3909614116) 0x7f2cb0019520 con 0x7f2cbc06fe00 2024-04-25T23:57:40.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.936+0000 7f2ca3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:40.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:40.936+0000 7f2ca3fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:41.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.024+0000 7f2cc1b51640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.024+0000 7f2cc1b51640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.024+0000 7f2cc1b51640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:41.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.024+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f2c9c000c00 con 0x7f2cbc06fe00 2024-04-25T23:57:41.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.024+0000 7f2ca3fff640 1 -- 172.21.15.171:0/3948739374 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v55) ==== 65+0+70 (unknown 3646917667 0 3909614116) 0x7f2cb001aa30 con 0x7f2cbc06fe00 2024-04-25T23:57:41.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.024+0000 7f2ca3fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.024+0000 7f2ca3fff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:41.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 >> v1:172.21.15.171:6812/722422047 conn(0x7f2ca8037770 legacy=0x7f2ca8039c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:41.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 10 monclient: shutdown 2024-04-25T23:57:41.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:41.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 >> v1:172.21.15.171:6790/0 conn(0x7f2cbc06fe00 legacy=0x7f2cbc1d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:41.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 shutdown_connections 2024-04-25T23:57:41.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 >> 172.21.15.171:0/3948739374 conn(0x7f2cbc0a2620 msgr2=0x7f2cbc09ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:41.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 shutdown_connections 2024-04-25T23:57:41.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.028+0000 7f2cc1b51640 1 -- 172.21.15.171:0/3948739374 wait complete. 2024-04-25T23:57:41.025 INFO:tasks.workunit.client.0.smithi171.stdout:foo-asdf 2024-04-25T23:57:41.026 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls 2024-04-25T23:57:41.026 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep bar-asdf 2024-04-25T23:57:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient: get_monmap_and_config 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient: build_initial_monmap 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient: monmap: 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:41.159967+0000 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:41.159967+0000 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:41.142 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:41.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 1 Processor -- start 2024-04-25T23:57:41.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 1 -- start start 2024-04-25T23:57:41.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient: init 2024-04-25T23:57:41.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:41.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient: _add_conns ranks=[7,4,5,3,8,0,6,2,1] 2024-04-25T23:57:41.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient(hunting): picked mon.noname-i con 0x7f72f006fe00 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient(hunting): picked mon.noname-c con 0x7f72f006f600 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient(hunting): picked mon.noname-h con 0x7f72f00701e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f006fa00 con 0x7f72f006f600 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f0135400 con 0x7f72f00701e0 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f0071670 con 0x7f72f006fe00 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient(hunting): authenticate will time out at 1111.866860s 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ef7fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f72f006fe00 legacy=0x7f72f01345e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72eeffd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f72f006f600 legacy=0x7f72f0134cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72effff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f72f00701e0 0x7f72f013d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:58320/0 (socket says 172.21.15.171:58320) 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72effff640 1 -- 172.21.15.171:0/3486542463 learned_addr learned my addr 172.21.15.171:0/3486542463 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:41.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3306774704 0 0) 0x7f72f0135400 con 0x7f72f00701e0 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient(hunting): my global_id is 5189 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72d8003530 con 0x7f72f00701e0 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781978498 0 0) 0x7f72d8003530 con 0x7f72f00701e0 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 >> v1:172.21.15.171:6792/0 conn(0x7f72f006fe00 legacy=0x7f72f01345e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 >> v1:172.21.15.106:6791/0 conn(0x7f72f006f600 legacy=0x7f72f0134cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 monclient: found mon.noname-h 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:57:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f0070630 con 0x7f72f00701e0 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72e8001b40 con 0x7f72f00701e0 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: dump: 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.154 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 5 monclient: authenticate success, global_id 5189 2024-04-25T23:57:41.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72e8001e30 con 0x7f72f00701e0 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 1 -- 172.21.15.171:0/3486542463 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72e8004f70 con 0x7f72f00701e0 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72f5cb4640 4 set_mon_vals no callback set 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.156+0000 7f72ee7fc640 10 monclient: dump: 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.156 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:41.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: shutdown 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/3486542463 >> v1:172.21.15.171:6791/0 conn(0x7f72f00701e0 legacy=0x7f72f013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/3486542463 shutdown_connections 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/3486542463 >> 172.21.15.171:0/3486542463 conn(0x7f72f00a2620 msgr2=0x7f72f00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/3486542463 shutdown_connections 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/3486542463 wait complete. 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: build_initial_monmap 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: monmap: 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:41.158 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:41.159 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 Processor -- start 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- start start 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: init 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _add_conns ranks=[6,2,3,4,8,0,5,7,1] 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient(hunting): picked mon.noname-d con 0x7f72f006f600 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient(hunting): picked mon.noname-b con 0x7f72f006fe00 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient(hunting): picked mon.noname-g con 0x7f72f00701e0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:41.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f0124720 con 0x7f72f006fe00 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f01cd320 con 0x7f72f00701e0 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72f0070880 con 0x7f72f006f600 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient(hunting): authenticate will time out at 1111.869949s 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72effff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f72f00701e0 0x7f72f01d4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60232/0 (socket says 172.21.15.171:60232) 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72effff640 1 -- 172.21.15.171:0/303271217 learned_addr learned my addr 172.21.15.171:0/303271217 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2128029222 0 0) 0x7f72f01cd320 con 0x7f72f00701e0 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:41.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): my global_id is 5277 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72dc003530 con 0x7f72f00701e0 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 849043329 0 0) 0x7f72dc003530 con 0x7f72f00701e0 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72f01cd320 con 0x7f72f00701e0 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72e8001b00 con 0x7f72f00701e0 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): dump: 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.162 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:41.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3460016948 0 0) 0x7f72f01cd320 con 0x7f72f00701e0 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 >> v1:172.21.15.106:6792/0 conn(0x7f72f006f600 legacy=0x7f72f01cc500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 >> v1:172.21.15.106:6790/0 conn(0x7f72f006fe00 legacy=0x7f72f01ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 monclient: found mon.g 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f006f040 con 0x7f72f00701e0 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 5 monclient: authenticate success, global_id 5277 2024-04-25T23:57:41.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _renew_subs 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72f0124a00 con 0x7f72f00701e0 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _renew_subs 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f72f0123df0 con 0x7f72f00701e0 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72e8001e30 con 0x7f72f00701e0 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72e8002060 con 0x7f72f00701e0 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72edffb640 4 set_mon_vals no callback set 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 10 monclient: dump: 2024-04-25T23:57:41.165 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:41.166 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f72e80103d0 con 0x7f72f00701e0 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72d0005090 con 0x7f72f00701e0 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(55..55 src has 1..55) ==== 4387+0+0 (unknown 2277463944 0 0) 0x7f72e8044d60 con 0x7f72f00701e0 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.160+0000 7f72ef7fe640 10 monclient: get_auth_request con 0x7f72dc037780 auth_method 0 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.168+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f72e8015d70 con 0x7f72f00701e0 2024-04-25T23:57:41.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.168+0000 7f72d7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:41.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.168+0000 7f72d7fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:41.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.328+0000 7f72f5cb4640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.328+0000 7f72f5cb4640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.328+0000 7f72f5cb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:41.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.328+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f72d0005380 con 0x7f72f00701e0 2024-04-25T23:57:41.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.328+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v55) ==== 65+0+70 (unknown 3646917667 0 3909614116) 0x7f72e8015670 con 0x7f72f00701e0 2024-04-25T23:57:41.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.328+0000 7f72d7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.328+0000 7f72d7fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:41.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.416+0000 7f72f5cb4640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.416+0000 7f72f5cb4640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.416+0000 7f72f5cb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:41.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.416+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f72d0000bd0 con 0x7f72f00701e0 2024-04-25T23:57:41.403 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72d7fff640 1 -- 172.21.15.171:0/303271217 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v55) ==== 65+0+70 (unknown 3646917667 0 3909614116) 0x7f72e801e1c0 con 0x7f72f00701e0 2024-04-25T23:57:41.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72d7fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:41.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72d7fff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:41.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 >> v1:172.21.15.171:6812/722422047 conn(0x7f72dc037780 legacy=0x7f72dc039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:41.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 10 monclient: shutdown 2024-04-25T23:57:41.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:41.406 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 >> v1:172.21.15.171:6790/0 conn(0x7f72f00701e0 legacy=0x7f72f01d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:41.406 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 shutdown_connections 2024-04-25T23:57:41.406 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 >> 172.21.15.171:0/303271217 conn(0x7f72f00a2620 msgr2=0x7f72f0131b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:41.406 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 shutdown_connections 2024-04-25T23:57:41.406 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:41.420+0000 7f72f5cb4640 1 -- 172.21.15.171:0/303271217 wait complete. 2024-04-25T23:57:41.419 INFO:tasks.workunit.client.0.smithi171.stdout:bar-asdf 2024-04-25T23:57:41.420 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rm foo 2024-04-25T23:57:41.420 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'does not exist' 2024-04-25T23:57:44.831 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:44.736+0000 7fe7577fe640 1 -- 172.21.15.171:0/1974216389 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo"}]=0 rule foo does not exist v55) ==== 103+0+0 (unknown 3048478203 0 0) 0x7fe7500159a0 con 0x7fe7601cc450 2024-04-25T23:57:44.832 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:44.736+0000 7fe7577fe640 10 monclient: _finish_command 2 = system:0 rule foo does not exist 2024-04-25T23:57:44.832 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:44.832+0000 7fe7577fe640 1 -- 172.21.15.171:0/1974216389 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo"}]=0 rule foo does not exist v55) ==== 103+0+0 (unknown 3048478203 0 0) 0x7fe7500152a0 con 0x7fe7601cc450 2024-04-25T23:57:44.832 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:44.832+0000 7fe7577fe640 10 monclient: _finish_command 3 = system:0 rule foo does not exist 2024-04-25T23:57:44.832 INFO:tasks.workunit.client.0.smithi171.stdout:rule foo does not exist 2024-04-25T23:57:44.833 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rm bar 2024-04-25T23:57:44.833 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'does not exist' 2024-04-25T23:57:45.226 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:45.136+0000 7f572dffb640 1 -- 172.21.15.171:0/3484913003 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "bar"}]=0 rule bar does not exist v55) ==== 103+0+0 (unknown 3569920944 0 0) 0x7f5730015520 con 0x7f573813e360 2024-04-25T23:57:45.226 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:45.136+0000 7f572dffb640 10 monclient: _finish_command 2 = system:0 rule bar does not exist 2024-04-25T23:57:45.226 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:45.224+0000 7f572dffb640 1 -- 172.21.15.171:0/3484913003 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "bar"}]=0 rule bar does not exist v55) ==== 103+0+0 (unknown 3569920944 0 0) 0x7f573001e0d0 con 0x7f573813e360 2024-04-25T23:57:45.226 INFO:tasks.workunit.client.0.smithi171.stdout:2024-04-25T23:57:45.224+0000 7f572dffb640 10 monclient: _finish_command 3 = system:0 rule bar does not exist 2024-04-25T23:57:45.226 INFO:tasks.workunit.client.0.smithi171.stdout:rule bar does not exist 2024-04-25T23:57:45.227 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rename foo-asdf foo 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: get_monmap_and_config 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: build_initial_monmap 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: monmap: 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:45.359185+0000 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:45.359185+0000 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:45.340 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:45.341 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:45.341 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:45.341 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:45.341 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:45.341 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:45.341 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:45.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 Processor -- start 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- start start 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: init 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: _add_conns ranks=[7,6,2,1,5,8,0,4,3] 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient(hunting): picked mon.noname-i con 0x7f9574135a00 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient(hunting): picked mon.noname-d con 0x7f95740a1790 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient(hunting): picked mon.noname-b con 0x7f957413c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95740a1d80 con 0x7f957413c130 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9574072f70 con 0x7f95740a1790 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9574072640 con 0x7f9574135a00 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient(hunting): authenticate will time out at 1116.066037s 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957932a640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f9574135a00 legacy=0x7f9574135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:45.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f9579b2b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f957413c130 0x7f957413e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:53298/0 (socket says 172.21.15.171:53298) 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f9579b2b640 1 -- 172.21.15.171:0/2298712538 learned_addr learned my addr 172.21.15.171:0/2298712538 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221601957 0 0) 0x7f95740a1d80 con 0x7f957413c130 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): my global_id is 5186 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9560003530 con 0x7f957413c130 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644660603 0 0) 0x7f9574072f70 con 0x7f95740a1790 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient(hunting): my global_id is 5199 2024-04-25T23:57:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95740a1d80 con 0x7f95740a1790 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 234946511 0 0) 0x7f9560003530 con 0x7f957413c130 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 >> v1:172.21.15.171:6792/0 conn(0x7f9574135a00 legacy=0x7f9574135de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 >> v1:172.21.15.106:6792/0 conn(0x7f95740a1790 legacy=0x7f957413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 monclient: found mon.noname-b 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9574072920 con 0x7f957413c130 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: _finish_auth 0 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f956c001a70 con 0x7f957413c130 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:45.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: dump: 2024-04-25T23:57:45.348 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:45.348 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:45.348 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:45.348 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:45.349 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 5 monclient: authenticate success, global_id 5186 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f956c001d20 con 0x7f957413c130 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 1 -- 172.21.15.171:0/2298712538 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f956c004f70 con 0x7f957413c130 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f956bfff640 10 monclient: dump: 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:45.350 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:45.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 4 set_mon_vals no callback set 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 10 monclient: shutdown 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- 172.21.15.171:0/2298712538 >> v1:172.21.15.106:6790/0 conn(0x7f957413c130 legacy=0x7f957413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- 172.21.15.171:0/2298712538 shutdown_connections 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- 172.21.15.171:0/2298712538 >> 172.21.15.171:0/2298712538 conn(0x7f95740a2690 msgr2=0x7f95740a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.356+0000 7f957b58e640 1 -- 172.21.15.171:0/2298712538 shutdown_connections 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 1 -- 172.21.15.171:0/2298712538 wait complete. 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient: build_initial_monmap 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient: monmap: 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:45.352 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 1 Processor -- start 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 1 -- start start 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient: init 2024-04-25T23:57:45.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient: _add_conns ranks=[1,8,4,5,3,7,2,0,6] 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient(hunting): picked mon.noname-f con 0x7f95740a1790 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient(hunting): picked mon.noname-e con 0x7f9574135a00 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient(hunting): picked mon.noname-c con 0x7f957413c130 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9574136a80 con 0x7f95740a1790 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957409fc40 con 0x7f957413c130 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957932a640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f95740a1790 legacy=0x7f95741ca570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957409f6f0 con 0x7f9574135a00 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f957b58e640 10 monclient(hunting): authenticate will time out at 1116.069414s 2024-04-25T23:57:45.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f9578b29640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9574135a00 legacy=0x7f95741cf4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:45.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.360+0000 7f9579b2b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f957413c130 legacy=0x7f95741d2c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:45.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.564+0000 7f957932a640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f95740a1790 legacy=0x7f95741ca570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:45.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.564+0000 7f9578b29640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9574135a00 legacy=0x7f95741cf4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:45.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.564+0000 7f9579b2b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f957413c130 legacy=0x7f95741d2c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:45.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.968+0000 7f957932a640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f95740a1790 legacy=0x7f95741ca570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:45.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.968+0000 7f9579b2b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f957413c130 legacy=0x7f95741d2c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:45.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:45.968+0000 7f9578b29640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9574135a00 legacy=0x7f95741cf4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:46.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:46.772+0000 7f957932a640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f95740a1790 legacy=0x7f95741ca570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:46.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:46.772+0000 7f9579b2b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f957413c130 legacy=0x7f95741d2c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:46.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:46.772+0000 7f9578b29640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9574135a00 legacy=0x7f95741cf4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:48.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient(hunting): tick 2024-04-25T23:57:48.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:48.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:48.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9574135a00 legacy=0x7f95741cf4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f957413c130 legacy=0x7f95741d2c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f95740a1790 legacy=0x7f95741ca570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient: _add_conns ranks=[5,7,3,2,0,6] 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient(hunting): picked mon.noname-h con 0x7f955c003790 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient(hunting): picked mon.noname-i con 0x7f955c007420 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient(hunting): picked mon.noname-g con 0x7f955c00b1b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95741367a0 con 0x7f955c00b1b0 2024-04-25T23:57:48.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9574136a80 con 0x7f955c003790 2024-04-25T23:57:48.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957409fc40 con 0x7f955c007420 2024-04-25T23:57:48.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9568ff9640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:48.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9578b29640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f955c007420 legacy=0x7f955c0098e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:48.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f957932a640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f955c003790 0x7f955c005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:58332/0 (socket says 172.21.15.171:58332) 2024-04-25T23:57:48.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f957932a640 1 -- 172.21.15.171:0/879269117 learned_addr learned my addr 172.21.15.171:0/879269117 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3736228393 0 0) 0x7f95741367a0 con 0x7f955c00b1b0 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): my global_id is 5313 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9558003530 con 0x7f955c00b1b0 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3341913592 0 0) 0x7f9574136a80 con 0x7f955c003790 2024-04-25T23:57:48.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): my global_id is 5198 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95741367a0 con 0x7f955c003790 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 26806787 0 0) 0x7f9558003530 con 0x7f955c00b1b0 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9574136a80 con 0x7f955c00b1b0 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 977316651 0 0) 0x7f95741367a0 con 0x7f955c003790 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9558003530 con 0x7f955c003790 2024-04-25T23:57:48.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f956c001a70 con 0x7f955c00b1b0 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:48.354 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9564004410 con 0x7f955c003790 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.360+0000 7f9569ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:48.356 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 583000251 0 0) 0x7f9574136a80 con 0x7f955c00b1b0 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 >> v1:172.21.15.171:6792/0 conn(0x7f955c007420 legacy=0x7f955c0098e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 >> v1:172.21.15.171:6791/0 conn(0x7f955c003790 legacy=0x7f955c005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 monclient: found mon.g 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9579b2b640 1 -- 172.21.15.171:0/879269117 reap_dead start 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:48.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f957409f6f0 con 0x7f955c00b1b0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 5 monclient: authenticate success, global_id 5313 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 10 monclient: _renew_subs 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9574136d60 con 0x7f955c00b1b0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 10 monclient: _renew_subs 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9574137180 con 0x7f955c00b1b0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f956c004f20 con 0x7f955c00b1b0 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:48.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f956c005490 con 0x7f955c00b1b0 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f956b7fe640 4 set_mon_vals no callback set 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 10 monclient: dump: 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:48.359 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9550005090 con 0x7f955c00b1b0 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f956c0056b0 con 0x7f955c00b1b0 2024-04-25T23:57:48.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(55..55 src has 1..55) ==== 4387+0+0 (unknown 2277463944 0 0) 0x7f956c0448d0 con 0x7f955c00b1b0 2024-04-25T23:57:48.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.364+0000 7f957932a640 10 monclient: get_auth_request con 0x7f9558037c30 auth_method 0 2024-04-25T23:57:48.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.372+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f956c015940 con 0x7f955c00b1b0 2024-04-25T23:57:48.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.372+0000 7f9569ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:48.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.372+0000 7f9569ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:48.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.556+0000 7f957b58e640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:48.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.556+0000 7f957b58e640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:48.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.556+0000 7f957b58e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:48.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.556+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"} v 0) -- 0x7f9550005380 con 0x7f955c00b1b0 2024-04-25T23:57:48.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.704+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}]=0 v56) ==== 110+0+0 (unknown 58632444 0 0) 0x7f956c015240 con 0x7f955c00b1b0 2024-04-25T23:57:48.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.704+0000 7f9569ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:48.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.704+0000 7f9569ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:48.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.808+0000 7f957b58e640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:48.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.808+0000 7f957b58e640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:48.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.808+0000 7f957b58e640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:48.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.808+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"} v 0) -- 0x7f9550005be0 con 0x7f955c00b1b0 2024-04-25T23:57:48.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f9569ffb640 1 -- 172.21.15.171:0/879269117 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}]=0 already renamed to 'foo' v56) ==== 134+0+0 (unknown 2746865145 0 0) 0x7f956c042390 con 0x7f955c00b1b0 2024-04-25T23:57:48.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f9569ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:48.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f9569ffb640 10 monclient: _finish_command 3 = system:0 already renamed to 'foo' 2024-04-25T23:57:48.796 INFO:tasks.workunit.client.0.smithi171.stderr:already renamed to 'foo' 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 >> v1:172.21.15.171:6812/722422047 conn(0x7f9558037c30 legacy=0x7f955803a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 10 monclient: shutdown 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 >> v1:172.21.15.171:6790/0 conn(0x7f955c00b1b0 legacy=0x7f955c00d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 shutdown_connections 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 >> 172.21.15.171:0/879269117 conn(0x7f95740a2690 msgr2=0x7f95740a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 shutdown_connections 2024-04-25T23:57:48.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.812+0000 7f957b58e640 1 -- 172.21.15.171:0/879269117 wait complete. 2024-04-25T23:57:48.813 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rename foo-asdf foo 2024-04-25T23:57:48.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient: get_monmap_and_config 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient: build_initial_monmap 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient: monmap: 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:48.952034+0000 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:48.952034+0000 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:48.933 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:48.934 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:48.934 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:48.934 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:48.934 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:48.934 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:48.934 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 1 Processor -- start 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 1 -- start start 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient: init 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient: _add_conns ranks=[3,6,1,4,2,7,8,5,0] 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient(hunting): picked mon.noname-g con 0x7f7f54075220 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient(hunting): picked mon.noname-d con 0x7f7f54136230 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient(hunting): picked mon.noname-f con 0x7f7f5413c140 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5409a7a0 con 0x7f7f5413c140 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f54136610 con 0x7f7f54075220 2024-04-25T23:57:48.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f540a0320 con 0x7f7f54136230 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5ab00640 10 monclient(hunting): authenticate will time out at 1119.659302s 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5909d640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f7f5413c140 legacy=0x7f7f5413e530 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5889c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f7f54075220 0x7f7f54135b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60292/0 (socket says 172.21.15.171:60292) 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f5889c640 1 -- 172.21.15.171:0/3715297973 learned_addr learned my addr 172.21.15.171:0/3715297973 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207472188 0 0) 0x7f7f48001120 con 0x7f7f54075220 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f537fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f537fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f537fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f537fe640 10 monclient(hunting): my global_id is 5322 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.948+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f44003530 con 0x7f7f54075220 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2060131872 0 0) 0x7f7f44003530 con 0x7f7f54075220 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 >> v1:172.21.15.106:6792/0 conn(0x7f7f54136230 legacy=0x7f7f5413aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 >> v1:172.21.15.171:6789/0 conn(0x7f7f5413c140 legacy=0x7f7f5413e530 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 monclient: found mon.noname-g 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f540a2c10 con 0x7f7f54075220 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 5 monclient: authenticate success, global_id 5322 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f48001990 con 0x7f7f54075220 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: dump: 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f48001c80 con 0x7f7f54075220 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 1 -- 172.21.15.171:0/3715297973 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f48004bf0 con 0x7f7f54075220 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 4 set_mon_vals no callback set 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f537fe640 10 monclient: dump: 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.945 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient: shutdown 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- 172.21.15.171:0/3715297973 >> v1:172.21.15.171:6790/0 conn(0x7f7f54075220 legacy=0x7f7f54135b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- 172.21.15.171:0/3715297973 shutdown_connections 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- 172.21.15.171:0/3715297973 >> 172.21.15.171:0/3715297973 conn(0x7f7f540a66c0 msgr2=0x7f7f540a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- 172.21.15.171:0/3715297973 shutdown_connections 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- 172.21.15.171:0/3715297973 wait complete. 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient: build_initial_monmap 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient: monmap: 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.947 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 Processor -- start 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- start start 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient: init 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:48.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient: _add_conns ranks=[8,0,4,1,3,5,7,6,2] 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient(hunting): picked mon.noname-e con 0x7f7f54075220 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient(hunting): picked mon.noname-a con 0x7f7f54136230 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient(hunting): picked mon.noname-c con 0x7f7f5413c140 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5412c3a0 con 0x7f7f54136230 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5409c770 con 0x7f7f5413c140 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f5412e260 con 0x7f7f54075220 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5ab00640 10 monclient(hunting): authenticate will time out at 1119.662450s 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5889c640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f7f54075220 legacy=0x7f7f5412b580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f5909d640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f7f5413c140 legacy=0x7f7f541d4a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f53fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7f54136230 0x7f7f5412bc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:44094/0 (socket says 172.21.15.171:44094) 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f53fff640 1 -- 172.21.15.171:0/2970325591 learned_addr learned my addr 172.21.15.171:0/2970325591 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2027917361 0 0) 0x7f7f5412c3a0 con 0x7f7f54136230 2024-04-25T23:57:48.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): _negotiate 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): my global_id is 5202 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f38003530 con 0x7f7f54136230 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1689462975 0 0) 0x7f7f38003530 con 0x7f7f54136230 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f5412c3a0 con 0x7f7f54136230 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f40001b20 con 0x7f7f54136230 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): dump: 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.950 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.952+0000 7f7f517fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:48.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1755071150 0 0) 0x7f7f5412c3a0 con 0x7f7f54136230 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 >> v1:172.21.15.106:6793/0 conn(0x7f7f54075220 legacy=0x7f7f5412b580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 >> v1:172.21.15.106:6791/0 conn(0x7f7f5413c140 legacy=0x7f7f541d4a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: _finish_hunting 0 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 monclient: found mon.a 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f5412d120 con 0x7f7f54136230 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: _finish_auth 0 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: _check_auth_tickets 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 5 monclient: authenticate success, global_id 5202 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 10 monclient: _renew_subs 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f5412e8b0 con 0x7f7f54136230 2024-04-25T23:57:48.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 10 monclient: _renew_subs 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f5412f130 con 0x7f7f54136230 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f40003920 con 0x7f7f54136230 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f40003e90 con 0x7f7f54136230 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f527fc640 4 set_mon_vals no callback set 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 10 monclient: dump: 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:48.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:48.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:48.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f34005090 con 0x7f7f54136230 2024-04-25T23:57:48.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7f400040b0 con 0x7f7f54136230 2024-04-25T23:57:48.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(56..56 src has 1..56) ==== 4382+0+0 (unknown 1332475467 0 0) 0x7f7f40044850 con 0x7f7f54136230 2024-04-25T23:57:48.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.956+0000 7f7f5889c640 10 monclient: get_auth_request con 0x7f7f380377f0 auth_method 0 2024-04-25T23:57:48.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.968+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7f40015870 con 0x7f7f54136230 2024-04-25T23:57:48.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.968+0000 7f7f517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:48.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:48.968+0000 7f7f517fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:49.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.132+0000 7f7f5ab00640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:49.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.132+0000 7f7f5ab00640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:49.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.132+0000 7f7f5ab00640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:49.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.132+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"} v 0) -- 0x7f7f34005380 con 0x7f7f54136230 2024-04-25T23:57:49.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.136+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}]=0 already renamed to 'foo' v56) ==== 134+0+0 (unknown 2746865145 0 0) 0x7f7f40015170 con 0x7f7f54136230 2024-04-25T23:57:49.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.136+0000 7f7f517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:49.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.136+0000 7f7f517fa640 10 monclient: _finish_command 2 = system:0 already renamed to 'foo' 2024-04-25T23:57:49.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.232+0000 7f7f5ab00640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.232+0000 7f7f5ab00640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.232+0000 7f7f5ab00640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:57:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.232+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"} v 0) -- 0x7f7f340010a0 con 0x7f7f54136230 2024-04-25T23:57:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f517fa640 1 -- 172.21.15.171:0/2970325591 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}]=0 already renamed to 'foo' v56) ==== 134+0+0 (unknown 2746865145 0 0) 0x7f7f4001dcc0 con 0x7f7f54136230 2024-04-25T23:57:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f517fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rename", "srcname": "foo-asdf", "dstname": "foo"}] 2024-04-25T23:57:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f517fa640 10 monclient: _finish_command 3 = system:0 already renamed to 'foo' 2024-04-25T23:57:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:already renamed to 'foo' 2024-04-25T23:57:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 >> v1:172.21.15.171:6812/722422047 conn(0x7f7f380377f0 legacy=0x7f7f38039cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 10 monclient: shutdown 2024-04-25T23:57:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 >> v1:172.21.15.106:6789/0 conn(0x7f7f54136230 legacy=0x7f7f5412bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 shutdown_connections 2024-04-25T23:57:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 >> 172.21.15.171:0/2970325591 conn(0x7f7f540a66c0 msgr2=0x7f7f5413ad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 shutdown_connections 2024-04-25T23:57:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.236+0000 7f7f5ab00640 1 -- 172.21.15.171:0/2970325591 wait complete. 2024-04-25T23:57:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rename bar-asdf bar 2024-04-25T23:57:49.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient: get_monmap_and_config 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient: build_initial_monmap 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient: monmap: 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:49.376107+0000 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:49.376107+0000 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:49.357 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:49.358 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:49.358 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:49.358 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:49.358 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:49.358 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 1 Processor -- start 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 1 -- start start 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient: init 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient: _add_conns ranks=[3,6,0,2,7,8,4,1,5] 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient(hunting): picked mon.noname-g con 0x7f6f8c0a0000 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient(hunting): picked mon.noname-d con 0x7f6f8c1344d0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:49.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 10 monclient(hunting): picked mon.noname-a con 0x7f6f8c134940 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.372+0000 7f6f93465640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c09e720 con 0x7f6f8c134940 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c09f800 con 0x7f6f8c0a0000 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c09f240 con 0x7f6f8c1344d0 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient(hunting): authenticate will time out at 1120.084070s 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f91201640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6f8c0a0000 0x7f6f8c133dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60302/0 (socket says 172.21.15.171:60302) 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f91201640 1 -- 172.21.15.171:0/2070917603 learned_addr learned my addr 172.21.15.171:0/2070917603 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2694129125 0 0) 0x7f6f8c09f800 con 0x7f6f8c0a0000 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient(hunting): my global_id is 5331 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f78003530 con 0x7f6f8c0a0000 2024-04-25T23:57:49.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4215216572 0 0) 0x7f6f78003530 con 0x7f6f8c0a0000 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 >> v1:172.21.15.106:6792/0 conn(0x7f6f8c1344d0 legacy=0x7f6f8c1390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 >> v1:172.21.15.106:6789/0 conn(0x7f6f8c134940 legacy=0x7f6f8c13c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 monclient: found mon.noname-g 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c09f520 con 0x7f6f8c0a0000 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 5 monclient: authenticate success, global_id 5331 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f880017c0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:49.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: dump: 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.364 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f88001ab0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 1 -- 172.21.15.171:0/2070917603 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f88004bf0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f83fff640 10 monclient: dump: 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.365 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 4 set_mon_vals no callback set 2024-04-25T23:57:49.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient: shutdown 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- 172.21.15.171:0/2070917603 >> v1:172.21.15.171:6790/0 conn(0x7f6f8c0a0000 legacy=0x7f6f8c133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- 172.21.15.171:0/2070917603 shutdown_connections 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- 172.21.15.171:0/2070917603 >> 172.21.15.171:0/2070917603 conn(0x7f6f8c0a66c0 msgr2=0x7f6f8c0a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- 172.21.15.171:0/2070917603 shutdown_connections 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- 172.21.15.171:0/2070917603 wait complete. 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient: build_initial_monmap 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient: monmap: 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.367 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 Processor -- start 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- start start 2024-04-25T23:57:49.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient: init 2024-04-25T23:57:49.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:49.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient: _add_conns ranks=[6,7,1,5,8,0,2,3,4] 2024-04-25T23:57:49.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient(hunting): picked mon.noname-d con 0x7f6f8c0a0000 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:49.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient(hunting): picked mon.noname-i con 0x7f6f8c1344d0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:49.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient(hunting): picked mon.noname-f con 0x7f6f8c134940 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c0728c0 con 0x7f6f8c134940 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c1307b0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f8c070d50 con 0x7f6f8c1344d0 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f93465640 10 monclient(hunting): authenticate will time out at 1120.086968s 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f90a00640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6f8c1344d0 legacy=0x7f6f8c1300a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f91a02640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6f8c134940 legacy=0x7f6f8c1d4e80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f91201640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6f8c0a0000 0x7f6f8c12f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:43428/0 (socket says 172.21.15.171:43428) 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f91201640 1 -- 172.21.15.171:0/2931194178 learned_addr learned my addr 172.21.15.171:0/2931194178 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818731902 0 0) 0x7f6f8c1307b0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f81ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f81ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:49.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f81ffb640 10 monclient(hunting): my global_id is 5226 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.376+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f70003530 con 0x7f6f8c0a0000 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1503407227 0 0) 0x7f6f70003530 con 0x7f6f8c0a0000 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f8c1307b0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f88004b30 con 0x7f6f8c0a0000 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.373 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 463003814 0 0) 0x7f6f8c1307b0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 >> v1:172.21.15.171:6792/0 conn(0x7f6f8c1344d0 legacy=0x7f6f8c1300a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:49.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 >> v1:172.21.15.171:6789/0 conn(0x7f6f8c134940 legacy=0x7f6f8c1d4e80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 monclient: found mon.d 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f8c072ba0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 5 monclient: authenticate success, global_id 5226 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 10 monclient: _renew_subs 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f8c09e930 con 0x7f6f8c0a0000 2024-04-25T23:57:49.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 10 monclient: _renew_subs 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f8c071160 con 0x7f6f8c0a0000 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f88001ab0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f837fe640 4 set_mon_vals no callback set 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f88001ce0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 10 monclient: dump: 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.376 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f6c005090 con 0x7f6f8c0a0000 2024-04-25T23:57:49.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6f880100e0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(56..56 src has 1..56) ==== 4382+0+0 (unknown 1332475467 0 0) 0x7f6f88044930 con 0x7f6f8c0a0000 2024-04-25T23:57:49.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.380+0000 7f6f90a00640 10 monclient: get_auth_request con 0x7f6f700377a0 auth_method 0 2024-04-25T23:57:49.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.392+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6f880159b0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.392+0000 7f6f81ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:49.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.392+0000 7f6f81ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:49.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.556+0000 7f6f93465640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}] 2024-04-25T23:57:49.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.556+0000 7f6f93465640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}] 2024-04-25T23:57:49.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.556+0000 7f6f93465640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.556+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"} v 0) -- 0x7f6f6c005380 con 0x7f6f8c0a0000 2024-04-25T23:57:49.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.728+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}]=0 v57) ==== 110+0+0 (unknown 1868979467 0 0) 0x7f6f880152b0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.728+0000 7f6f81ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}] 2024-04-25T23:57:49.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.728+0000 7f6f81ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:49.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.832+0000 7f6f93465640 10 start_mon_command cmd=[{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}] 2024-04-25T23:57:49.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.832+0000 7f6f93465640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}] 2024-04-25T23:57:49.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.832+0000 7f6f93465640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.832+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"} v 0) -- 0x7f6f6c005ac0 con 0x7f6f8c0a0000 2024-04-25T23:57:49.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.832+0000 7f6f81ffb640 1 -- 172.21.15.171:0/2931194178 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}]=0 already renamed to 'bar' v57) ==== 134+0+0 (unknown 852271798 0 0) 0x7f6f88040920 con 0x7f6f8c0a0000 2024-04-25T23:57:49.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.832+0000 7f6f81ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rename", "srcname": "bar-asdf", "dstname": "bar"}] 2024-04-25T23:57:49.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.832+0000 7f6f81ffb640 10 monclient: _finish_command 3 = system:0 already renamed to 'bar' 2024-04-25T23:57:49.819 INFO:tasks.workunit.client.0.smithi171.stderr:already renamed to 'bar' 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 >> v1:172.21.15.171:6812/722422047 conn(0x7f6f700377a0 legacy=0x7f6f70039c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 10 monclient: shutdown 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 >> v1:172.21.15.106:6792/0 conn(0x7f6f8c0a0000 legacy=0x7f6f8c12f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 shutdown_connections 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 >> 172.21.15.171:0/2931194178 conn(0x7f6f8c0a66c0 msgr2=0x7f6f8c09c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 shutdown_connections 2024-04-25T23:57:49.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.836+0000 7f6f93465640 1 -- 172.21.15.171:0/2931194178 wait complete. 2024-04-25T23:57:49.837 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls 2024-04-25T23:57:49.837 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false grep foo-asdf 2024-04-25T23:57:49.837 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:57:49.837 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo-asdf 2024-04-25T23:57:49.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient: get_monmap_and_config 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient: build_initial_monmap 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient: monmap: 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:49.967301+0000 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:49.967301+0000 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:49.949 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:49.950 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:49.950 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:49.950 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:49.950 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 1 Processor -- start 2024-04-25T23:57:49.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 1 -- start start 2024-04-25T23:57:49.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient: init 2024-04-25T23:57:49.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient: _add_conns ranks=[0,1,4,3,5,2,8,6,7] 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient(hunting): picked mon.noname-a con 0x7f53d0135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient(hunting): picked mon.noname-f con 0x7f53d01356f0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient(hunting): picked mon.noname-c con 0x7f53d013c130 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d00a1da0 con 0x7f53d0135bb0 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d00a1fe0 con 0x7f53d01356f0 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d0072720 con 0x7f53d013c130 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 10 monclient(hunting): authenticate will time out at 1120.674167s 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53c67fc640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f53d01356f0 legacy=0x7f53d013aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53cf7fe640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f53d013c130 legacy=0x7f53d013e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ceffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f53d0135bb0 0x7f53d0135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:44114/0 (socket says 172.21.15.171:44114) 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ceffd640 1 -- 172.21.15.171:0/2227931697 learned_addr learned my addr 172.21.15.171:0/2227931697 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:49.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2333609393 0 0) 0x7f53d00a1da0 con 0x7f53d0135bb0 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient(hunting): my global_id is 5220 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53bc003530 con 0x7f53d0135bb0 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3115892263 0 0) 0x7f53bc003530 con 0x7f53d0135bb0 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 >> v1:172.21.15.106:6791/0 conn(0x7f53d013c130 legacy=0x7f53d013e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 >> v1:172.21.15.171:6789/0 conn(0x7f53d01356f0 legacy=0x7f53d013aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 monclient: found mon.noname-a 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d00a17f0 con 0x7f53d0135bb0 2024-04-25T23:57:49.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f53c00017c0 con 0x7f53d0135bb0 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53ce7fc640 10 monclient: dump: 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.957 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 5 monclient: authenticate success, global_id 5220 2024-04-25T23:57:49.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.964+0000 7f53d54b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53c0001a20 con 0x7f53d0135bb0 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53ce7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53ce7fc640 1 -- 172.21.15.171:0/2227931697 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f53c0004bf0 con 0x7f53d0135bb0 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 4 set_mon_vals no callback set 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53ce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53ce7fc640 10 monclient: dump: 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.959 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient: shutdown 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:49.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- 172.21.15.171:0/2227931697 >> v1:172.21.15.106:6789/0 conn(0x7f53d0135bb0 legacy=0x7f53d0135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- 172.21.15.171:0/2227931697 shutdown_connections 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- 172.21.15.171:0/2227931697 >> 172.21.15.171:0/2227931697 conn(0x7f53d00a2620 msgr2=0x7f53d00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- 172.21.15.171:0/2227931697 shutdown_connections 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- 172.21.15.171:0/2227931697 wait complete. 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient: build_initial_monmap 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient: monmap: 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:49.961 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 Processor -- start 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- start start 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient: init 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient: _add_conns ranks=[1,0,6,2,7,4,8,5,3] 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient(hunting): picked mon.noname-f con 0x7f53d01356f0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:49.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient(hunting): picked mon.noname-a con 0x7f53d0135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient(hunting): picked mon.noname-d con 0x7f53d013c130 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d0070c40 con 0x7f53d0135bb0 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d01345c0 con 0x7f53d01356f0 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53d00709b0 con 0x7f53d013c130 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53d54b8640 10 monclient(hunting): authenticate will time out at 1120.678469s 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53ceffd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f53d01356f0 legacy=0x7f53d0133eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53cf7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f53d013c130 0x7f53d01d4aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:43432/0 (socket says 172.21.15.171:43432) 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c67fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f53d0135bb0 0x7f53d01d1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:44116/0 (socket says 172.21.15.171:44116) 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53cf7fe640 1 -- 172.21.15.171:0/920311851 learned_addr learned my addr 172.21.15.171:0/920311851 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3054452515 0 0) 0x7f53d0070c40 con 0x7f53d0135bb0 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:49.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): my global_id is 5229 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53b0003530 con 0x7f53d0135bb0 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112686495 0 0) 0x7f53d00709b0 con 0x7f53d013c130 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): my global_id is 5235 2024-04-25T23:57:49.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d0070c40 con 0x7f53d013c130 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3225509149 0 0) 0x7f53d0070c40 con 0x7f53d013c130 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53d00709b0 con 0x7f53d013c130 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f53c8004630 con 0x7f53d013c130 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): dump: 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1504726885 0 0) 0x7f53b0003530 con 0x7f53d0135bb0 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.968+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53d0070c40 con 0x7f53d0135bb0 2024-04-25T23:57:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f53b8004270 con 0x7f53d0135bb0 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient(hunting): dump: 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.969 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 603253101 0 0) 0x7f53d00709b0 con 0x7f53d013c130 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 >> v1:172.21.15.171:6789/0 conn(0x7f53d01356f0 legacy=0x7f53d0133eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 >> v1:172.21.15.106:6789/0 conn(0x7f53d0135bb0 legacy=0x7f53d01d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 monclient: found mon.d 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d011d850 con 0x7f53d013c130 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 5 monclient: authenticate success, global_id 5235 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 10 monclient: _renew_subs 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f53d011c170 con 0x7f53d013c130 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 10 monclient: _renew_subs 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f53d006fac0 con 0x7f53d013c130 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53c8004b40 con 0x7f53d013c130 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f53c8005030 con 0x7f53d013c130 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53cdffb640 4 set_mon_vals no callback set 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 10 monclient: dump: 2024-04-25T23:57:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:49.972 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53b4005090 con 0x7f53d013c130 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f53c80052d0 con 0x7f53d013c130 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(57..57 src has 1..57) ==== 4377+0+0 (unknown 3935098498 0 0) 0x7f53c8044a70 con 0x7f53d013c130 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.972+0000 7f53ceffd640 10 monclient: get_auth_request con 0x7f53b0037d90 auth_method 0 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.984+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f53c80159d0 con 0x7f53d013c130 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.984+0000 7f53c7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:49.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:49.984+0000 7f53c7fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.136+0000 7f53d54b8640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.136+0000 7f53d54b8640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.136+0000 7f53d54b8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.136+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f53b4005380 con 0x7f53d013c130 2024-04-25T23:57:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.136+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v57) ==== 65+0+60 (unknown 2262488454 0 1596542489) 0x7f53c80152d0 con 0x7f53d013c130 2024-04-25T23:57:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.136+0000 7f53c7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.136+0000 7f53c7fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:50.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.224+0000 7f53d54b8640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.224+0000 7f53d54b8640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.224+0000 7f53d54b8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.224+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f53b4005ac0 con 0x7f53d013c130 2024-04-25T23:57:50.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.224+0000 7f53c7fff640 1 -- 172.21.15.171:0/920311851 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v57) ==== 65+0+60 (unknown 2262488454 0 1596542489) 0x7f53c8019620 con 0x7f53d013c130 2024-04-25T23:57:50.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.224+0000 7f53c7fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.224+0000 7f53c7fff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:50.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 >> v1:172.21.15.171:6812/722422047 conn(0x7f53b0037d90 legacy=0x7f53b003a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 10 monclient: shutdown 2024-04-25T23:57:50.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:50.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 >> v1:172.21.15.106:6792/0 conn(0x7f53d013c130 legacy=0x7f53d01d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 shutdown_connections 2024-04-25T23:57:50.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 >> 172.21.15.171:0/920311851 conn(0x7f53d00a2620 msgr2=0x7f53d013e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:50.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 shutdown_connections 2024-04-25T23:57:50.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.228+0000 7f53d54b8640 1 -- 172.21.15.171:0/920311851 wait complete. 2024-04-25T23:57:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:57:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule ls 2024-04-25T23:57:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false grep bar-asdf 2024-04-25T23:57:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:57:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep bar-asdf 2024-04-25T23:57:50.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient: get_monmap_and_config 2024-04-25T23:57:50.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient: build_initial_monmap 2024-04-25T23:57:50.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient: monmap: 2024-04-25T23:57:50.336 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:50.336 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.336 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:50.355437+0000 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:50.355437+0000 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:50.337 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 1 Processor -- start 2024-04-25T23:57:50.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 1 -- start start 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient: init 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient: _add_conns ranks=[6,1,7,3,5,8,0,4,2] 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient(hunting): picked mon.noname-d con 0x7f89cc06e4f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient(hunting): picked mon.noname-f con 0x7f89cc06efe0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient(hunting): picked mon.noname-i con 0x7f89cc13aa40 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc070df0 con 0x7f89cc06efe0 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc0710d0 con 0x7f89cc06e4f0 2024-04-25T23:57:50.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc072f10 con 0x7f89cc13aa40 2024-04-25T23:57:50.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:50.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient(hunting): authenticate will time out at 1121.062286s 2024-04-25T23:57:50.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89cb7fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f89cc13aa40 legacy=0x7f89cc13ce30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:50.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89c27fc640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f89cc06efe0 legacy=0x7f89cc139320 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:50.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89caffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f89cc06e4f0 0x7f89cc06e8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:50524/0 (socket says 172.21.15.171:50524) 2024-04-25T23:57:50.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89caffd640 1 -- 172.21.15.171:0/1422040038 learned_addr learned my addr 172.21.15.171:0/1422040038 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:50.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772354395 0 0) 0x7f89cc0710d0 con 0x7f89cc06e4f0 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient(hunting): my global_id is 5244 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b8003450 con 0x7f89cc06e4f0 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1630596488 0 0) 0x7f89b8003450 con 0x7f89cc06e4f0 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 >> v1:172.21.15.171:6792/0 conn(0x7f89cc13aa40 legacy=0x7f89cc13ce30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 >> v1:172.21.15.171:6789/0 conn(0x7f89cc06efe0 legacy=0x7f89cc139320 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 monclient: found mon.noname-d 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc06fa90 con 0x7f89cc06e4f0 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:50.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89bc0017c0 con 0x7f89cc06e4f0 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: dump: 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.348 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.349 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 5 monclient: authenticate success, global_id 5244 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89bc001b20 con 0x7f89cc06e4f0 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 1 -- 172.21.15.171:0/1422040038 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89bc001d50 con 0x7f89cc06e4f0 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89d1a27640 4 set_mon_vals no callback set 2024-04-25T23:57:50.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.352+0000 7f89ca7fc640 10 monclient: dump: 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.351 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.352 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.353 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: shutdown 2024-04-25T23:57:50.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:50.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/1422040038 >> v1:172.21.15.106:6792/0 conn(0x7f89cc06e4f0 legacy=0x7f89cc06e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/1422040038 shutdown_connections 2024-04-25T23:57:50.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/1422040038 >> 172.21.15.171:0/1422040038 conn(0x7f89cc0a2620 msgr2=0x7f89cc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:50.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/1422040038 shutdown_connections 2024-04-25T23:57:50.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/1422040038 wait complete. 2024-04-25T23:57:50.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: build_initial_monmap 2024-04-25T23:57:50.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: monmap: 2024-04-25T23:57:50.354 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:50.354 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:50.355 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:50.355 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:50.355 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:50.355 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.355 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:50.355 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:50.355 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 Processor -- start 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- start start 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: init 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _add_conns ranks=[3,4,2,0,1,8,5,7,6] 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient(hunting): picked mon.noname-g con 0x7f89cc06e4f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient(hunting): picked mon.noname-c con 0x7f89cc06efe0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient(hunting): picked mon.noname-b con 0x7f89cc13aa40 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:50.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc0703e0 con 0x7f89cc13aa40 2024-04-25T23:57:50.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc070930 con 0x7f89cc06e4f0 2024-04-25T23:57:50.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89cc1316e0 con 0x7f89cc06efe0 2024-04-25T23:57:50.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:50.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient(hunting): authenticate will time out at 1121.065933s 2024-04-25T23:57:50.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89caffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f89cc06e4f0 0x7f89cc139be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60524/0 (socket says 172.21.15.171:60524) 2024-04-25T23:57:50.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89caffd640 1 -- 172.21.15.171:0/3240021932 learned_addr learned my addr 172.21.15.171:0/3240021932 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:50.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c27fc640 1 -- 172.21.15.171:0/3240021932 >> v1:172.21.15.106:6791/0 conn(0x7f89cc06efe0 legacy=0x7f89cc1ccfb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:50.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573923323 0 0) 0x7f89cc070930 con 0x7f89cc06e4f0 2024-04-25T23:57:50.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:50.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:50.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:50.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): my global_id is 5340 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89ac003530 con 0x7f89cc06e4f0 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1669887145 0 0) 0x7f89ac003530 con 0x7f89cc06e4f0 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89cc070930 con 0x7f89cc06e4f0 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89bc001780 con 0x7f89cc06e4f0 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): dump: 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.360 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 795848761 0 0) 0x7f89cc0703e0 con 0x7f89cc13aa40 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient(hunting): my global_id is 5195 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89ac003530 con 0x7f89cc13aa40 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2643912697 0 0) 0x7f89cc070930 con 0x7f89cc06e4f0 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 >> v1:172.21.15.106:6791/0 conn(0x7f89cc06efe0 legacy=0x7f89cc1ccfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 >> v1:172.21.15.106:6790/0 conn(0x7f89cc13aa40 legacy=0x7f89cc1d06e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 monclient: found mon.g 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:50.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89cc131f80 con 0x7f89cc06e4f0 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: _finish_auth 0 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 5 monclient: authenticate success, global_id 5340 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _renew_subs 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89cc130020 con 0x7f89cc06e4f0 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _renew_subs 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f89cc12f350 con 0x7f89cc06e4f0 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89bc001b20 con 0x7f89cc06e4f0 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:50.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89bc005350 con 0x7f89cc06e4f0 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c9ffb640 4 set_mon_vals no callback set 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 10 monclient: dump: 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.364 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.365 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89b0005090 con 0x7f89cc06e4f0 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f89bc0100f0 con 0x7f89cc06e4f0 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.356+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(57..57 src has 1..57) ==== 4377+0+0 (unknown 3935098498 0 0) 0x7f89bc044ad0 con 0x7f89cc06e4f0 2024-04-25T23:57:50.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.360+0000 7f89c27fc640 10 monclient: get_auth_request con 0x7f89ac0378a0 auth_method 0 2024-04-25T23:57:50.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.364+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f89bc015a90 con 0x7f89cc06e4f0 2024-04-25T23:57:50.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.364+0000 7f89c8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:50.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.364+0000 7f89c8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:50.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.516+0000 7f89d1a27640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.516+0000 7f89d1a27640 10 monclient: _send_command 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.516+0000 7f89d1a27640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:50.501 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.516+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f89b0005380 con 0x7f89cc06e4f0 2024-04-25T23:57:50.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.516+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v57) ==== 65+0+60 (unknown 2262488454 0 1596542489) 0x7f89bc01df40 con 0x7f89cc06e4f0 2024-04-25T23:57:50.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.516+0000 7f89c8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.516+0000 7f89c8ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:50.599 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.612+0000 7f89d1a27640 10 start_mon_command cmd=[{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.599 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.612+0000 7f89d1a27640 10 monclient: _send_command 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.599 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.612+0000 7f89d1a27640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:50.599 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.612+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule ls"} v 0) -- 0x7f89b0000bd0 con 0x7f89cc06e4f0 2024-04-25T23:57:50.599 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89c8ff9640 1 -- 172.21.15.171:0/3240021932 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule ls"}]=0 v57) ==== 65+0+60 (unknown 2262488454 0 1596542489) 0x7f89bc0425a0 con 0x7f89cc06e4f0 2024-04-25T23:57:50.599 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89c8ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule ls"}] 2024-04-25T23:57:50.599 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89c8ff9640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:57:50.601 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 >> v1:172.21.15.171:6812/722422047 conn(0x7f89ac0378a0 legacy=0x7f89ac039d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.601 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 10 monclient: shutdown 2024-04-25T23:57:50.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:50.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 >> v1:172.21.15.171:6790/0 conn(0x7f89cc06e4f0 legacy=0x7f89cc139be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 shutdown_connections 2024-04-25T23:57:50.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 >> 172.21.15.171:0/3240021932 conn(0x7f89cc0a2620 msgr2=0x7f89cc0a3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:50.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 shutdown_connections 2024-04-25T23:57:50.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.616+0000 7f89d1a27640 1 -- 172.21.15.171:0/3240021932 wait complete. 2024-04-25T23:57:50.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:57:50.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rm foo 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.748+0000 7f47dfe40640 10 monclient: get_monmap_and_config 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.748+0000 7f47dfe40640 10 monclient: build_initial_monmap 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.748+0000 7f47dfe40640 10 monclient: monmap: 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:50.754270+0000 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:50.754270+0000 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:50.735 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:50.736 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 Processor -- start 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- start start 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient: init 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient: _add_conns ranks=[5,2,7,8,3,1,0,4,6] 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient(hunting): picked mon.noname-h con 0x7f47d8135a10 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient(hunting): picked mon.noname-b con 0x7f47d81355c0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient(hunting): picked mon.noname-i con 0x7f47d813c000 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d80a0900 con 0x7f47d81355c0 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d8072300 con 0x7f47d8135a10 2024-04-25T23:57:50.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d80725e0 con 0x7f47d813c000 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient(hunting): authenticate will time out at 1121.461814s 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47de3dd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f47d813c000 legacy=0x7f47d813e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47ddbdc640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f47d8135a10 0x7f47d8135df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39318/0 (socket says 172.21.15.171:39318) 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47ddbdc640 1 -- 172.21.15.171:0/2604472570 learned_addr learned my addr 172.21.15.171:0/2604472570 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3778133180 0 0) 0x7f47d8072300 con 0x7f47d8135a10 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient(hunting): _negotiate 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient(hunting): my global_id is 5207 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47c4003530 con 0x7f47d8135a10 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3838378666 0 0) 0x7f47c4003530 con 0x7f47d8135a10 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 >> v1:172.21.15.171:6792/0 conn(0x7f47d813c000 legacy=0x7f47d813e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:50.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 >> v1:172.21.15.106:6790/0 conn(0x7f47d81355c0 legacy=0x7f47d813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: _finish_hunting 0 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 monclient: found mon.noname-h 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d80a4080 con 0x7f47d8135a10 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: _finish_auth 0 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: _check_auth_tickets 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f47d40017c0 con 0x7f47d8135a10 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: dump: 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.745 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.746 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 5 monclient: authenticate success, global_id 5207 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47d4001b20 con 0x7f47d8135a10 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 1 -- 172.21.15.171:0/2604472570 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f47d4001d50 con 0x7f47d8135a10 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 4 set_mon_vals no callback set 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dcbda640 10 monclient: dump: 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.747 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient: shutdown 2024-04-25T23:57:50.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- 172.21.15.171:0/2604472570 >> v1:172.21.15.171:6791/0 conn(0x7f47d8135a10 legacy=0x7f47d8135df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- 172.21.15.171:0/2604472570 shutdown_connections 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- 172.21.15.171:0/2604472570 >> 172.21.15.171:0/2604472570 conn(0x7f47d80a7210 msgr2=0x7f47d80a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- 172.21.15.171:0/2604472570 shutdown_connections 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 1 -- 172.21.15.171:0/2604472570 wait complete. 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient: build_initial_monmap 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.752+0000 7f47dfe40640 10 monclient: monmap: 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.749 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 Processor -- start 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 -- start start 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: init 2024-04-25T23:57:50.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _add_conns ranks=[6,7,8,5,3,4,1,0,2] 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient(hunting): picked mon.noname-d con 0x7f47d81355c0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient(hunting): picked mon.noname-i con 0x7f47d8135a10 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient(hunting): picked mon.noname-e con 0x7f47d813c000 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d809b390 con 0x7f47d81355c0 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d80a05d0 con 0x7f47d8135a10 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47d806fab0 con 0x7f47d813c000 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient(hunting): authenticate will time out at 1121.464699s 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dd3db640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f47d8135a10 legacy=0x7f47d81d1840 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47de3dd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f47d813c000 legacy=0x7f47d81d4f70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ddbdc640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f47d81355c0 0x7f47d809ebc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:50538/0 (socket says 172.21.15.171:50538) 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ddbdc640 1 -- 172.21.15.171:0/1818753313 learned_addr learned my addr 172.21.15.171:0/1818753313 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:50.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1158692793 0 0) 0x7f47d809b390 con 0x7f47d81355c0 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): my global_id is 5253 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47bc003530 con 0x7f47d81355c0 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1900890656 0 0) 0x7f47bc003530 con 0x7f47d81355c0 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47d809b390 con 0x7f47d81355c0 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f47d4001780 con 0x7f47d81355c0 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): dump: 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.752 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1870874563 0 0) 0x7f47d809b390 con 0x7f47d81355c0 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 >> v1:172.21.15.106:6793/0 conn(0x7f47d813c000 legacy=0x7f47d81d4f70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 >> v1:172.21.15.171:6792/0 conn(0x7f47d8135a10 legacy=0x7f47d81d1840 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 monclient: found mon.d 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47d813b1a0 con 0x7f47d81355c0 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 5 monclient: authenticate success, global_id 5253 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _renew_subs 2024-04-25T23:57:50.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47d809b670 con 0x7f47d81355c0 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _renew_subs 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f47d809aa60 con 0x7f47d81355c0 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47d4001b20 con 0x7f47d81355c0 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f47d4001090 con 0x7f47d81355c0 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47cffff640 4 set_mon_vals no callback set 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 10 monclient: dump: 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.755 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:50.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47c0005090 con 0x7f47d81355c0 2024-04-25T23:57:50.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f47d400ff40 con 0x7f47d81355c0 2024-04-25T23:57:50.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(57..57 src has 1..57) ==== 4377+0+0 (unknown 3935098498 0 0) 0x7f47d4044860 con 0x7f47d81355c0 2024-04-25T23:57:50.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.756+0000 7f47dd3db640 10 monclient: get_auth_request con 0x7f47bc037780 auth_method 0 2024-04-25T23:57:50.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.772+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f47d401dd30 con 0x7f47d81355c0 2024-04-25T23:57:50.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.772+0000 7f47ce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:50.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.772+0000 7f47ce7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:50.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.932+0000 7f47dfe40640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:50.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.932+0000 7f47dfe40640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:50.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.932+0000 7f47dfe40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:50.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:50.932+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule rm", "name": "foo"} v 0) -- 0x7f47c0005380 con 0x7f47d81355c0 2024-04-25T23:57:51.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.740+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo"}]=0 v58) ==== 80+0+0 (unknown 130220181 0 0) 0x7f47d40408b0 con 0x7f47d81355c0 2024-04-25T23:57:51.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.740+0000 7f47ce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:51.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.740+0000 7f47ce7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:51.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.844+0000 7f47dfe40640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:51.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.844+0000 7f47dfe40640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:51.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.844+0000 7f47dfe40640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:51.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.844+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule rm", "name": "foo"} v 0) -- 0x7f47c0005770 con 0x7f47d81355c0 2024-04-25T23:57:51.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.844+0000 7f47ce7fc640 1 -- 172.21.15.171:0/1818753313 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo"}]=0 rule foo does not exist v58) ==== 103+0+0 (unknown 77879010 0 0) 0x7f47d4040af0 con 0x7f47d81355c0 2024-04-25T23:57:51.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.844+0000 7f47ce7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:51.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.844+0000 7f47ce7fc640 10 monclient: _finish_command 3 = system:0 rule foo does not exist 2024-04-25T23:57:51.831 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo does not exist 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 >> v1:172.21.15.171:6812/722422047 conn(0x7f47bc037780 legacy=0x7f47bc039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 10 monclient: shutdown 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 >> v1:172.21.15.106:6792/0 conn(0x7f47d81355c0 legacy=0x7f47d809ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 shutdown_connections 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 >> 172.21.15.171:0/1818753313 conn(0x7f47d80a7210 msgr2=0x7f47d8131a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 shutdown_connections 2024-04-25T23:57:51.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.848+0000 7f47dfe40640 1 -- 172.21.15.171:0/1818753313 wait complete. 2024-04-25T23:57:51.847 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rm foo 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.976+0000 7fc9c3390640 10 monclient: get_monmap_and_config 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.976+0000 7fc9c3390640 10 monclient: build_initial_monmap 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.976+0000 7fc9c3390640 10 monclient: monmap: 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:51.981100+0000 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:51.981100+0000 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:51.962 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:51.963 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:51.963 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:51.963 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:51.963 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:51.963 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:51.963 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:51.963 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.976+0000 7fc9c3390640 1 Processor -- start 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.976+0000 7fc9c3390640 1 -- start start 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.976+0000 7fc9c3390640 10 monclient: init 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: _add_conns ranks=[3,2,4,6,1,7,0,5,8] 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): picked mon.noname-g con 0x7fc9bc137de0 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): picked mon.noname-b con 0x7fc9bc09cd90 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:51.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): picked mon.noname-c con 0x7fc9bc13e360 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc09c950 con 0x7fc9bc09cd90 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc09bf70 con 0x7fc9bc137de0 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc09c250 con 0x7fc9bc13e360 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c112c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc9bc137de0 0x7fc9bc1381c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60532/0 (socket says 172.21.15.171:60532) 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c112c640 1 -- 172.21.15.171:0/1081401633 learned_addr learned my addr 172.21.15.171:0/1081401633 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): authenticate will time out at 1122.688305s 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c192d640 1 -- 172.21.15.171:0/1081401633 >> v1:172.21.15.106:6791/0 conn(0x7fc9bc13e360 legacy=0x7fc9bc140750 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 601717314 0 0) 0x7fc9bc09bf70 con 0x7fc9bc137de0 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient(hunting): my global_id is 5349 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9a8003530 con 0x7fc9bc137de0 2024-04-25T23:57:51.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3691966430 0 0) 0x7fc9a8003530 con 0x7fc9bc137de0 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 >> v1:172.21.15.106:6791/0 conn(0x7fc9bc13e360 legacy=0x7fc9bc140750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 >> v1:172.21.15.106:6790/0 conn(0x7fc9bc09cd90 legacy=0x7fc9bc13cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 monclient: found mon.noname-g 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc09d1b0 con 0x7fc9bc137de0 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: _finish_auth 0 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9b4001b40 con 0x7fc9bc137de0 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 5 monclient: authenticate success, global_id 5349 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:51.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: dump: 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:51.973 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc9b4001ea0 con 0x7fc9bc137de0 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 1 -- 172.21.15.171:0/1081401633 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9b4004f70 con 0x7fc9bc137de0 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 4 set_mon_vals no callback set 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b3fff640 10 monclient: dump: 2024-04-25T23:57:51.974 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:51.975 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: shutdown 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- 172.21.15.171:0/1081401633 >> v1:172.21.15.171:6790/0 conn(0x7fc9bc137de0 legacy=0x7fc9bc1381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- 172.21.15.171:0/1081401633 shutdown_connections 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- 172.21.15.171:0/1081401633 >> 172.21.15.171:0/1081401633 conn(0x7fc9bc0a2de0 msgr2=0x7fc9bc0a31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- 172.21.15.171:0/1081401633 shutdown_connections 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- 172.21.15.171:0/1081401633 wait complete. 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: build_initial_monmap 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: monmap: 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:51.976 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 Processor -- start 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- start start 2024-04-25T23:57:51.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: init 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient: _add_conns ranks=[1,8,3,5,4,6,2,7,0] 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): picked mon.noname-f con 0x7fc9bc09cd90 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): picked mon.noname-e con 0x7fc9bc137de0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): picked mon.noname-g con 0x7fc9bc13e360 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc138cd0 con 0x7fc9bc09cd90 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc09b6a0 con 0x7fc9bc13e360 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9bc071e30 con 0x7fc9bc137de0 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c3390640 10 monclient(hunting): authenticate will time out at 1122.691066s 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c112c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fc9bc09cd90 legacy=0x7fc9bc13c9c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c092b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fc9bc137de0 legacy=0x7fc9bc1d1920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:51.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c192d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc9bc13e360 0x7fc9bc1d5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60544/0 (socket says 172.21.15.171:60544) 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9c192d640 1 -- 172.21.15.171:0/1603580950 learned_addr learned my addr 172.21.15.171:0/1603580950 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105145693 0 0) 0x7fc9bc09b6a0 con 0x7fc9bc13e360 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): my global_id is 5358 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9a0003530 con 0x7fc9bc13e360 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3440136162 0 0) 0x7fc9a0003530 con 0x7fc9bc13e360 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc9bc09b6a0 con 0x7fc9bc13e360 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9b80053b0 con 0x7fc9bc13e360 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:51.979 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:51.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 889267945 0 0) 0x7fc9bc09b6a0 con 0x7fc9bc13e360 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 >> v1:172.21.15.106:6793/0 conn(0x7fc9bc137de0 legacy=0x7fc9bc1d1920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 >> v1:172.21.15.171:6789/0 conn(0x7fc9bc09cd90 legacy=0x7fc9bc13c9c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.980+0000 7fc9b1ffb640 1 monclient: found mon.g 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9bc138960 con 0x7fc9bc13e360 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 5 monclient: authenticate success, global_id 5358 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 10 monclient: _renew_subs 2024-04-25T23:57:51.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc9bc132010 con 0x7fc9bc13e360 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 10 monclient: _renew_subs 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc9bc13d2a0 con 0x7fc9bc13e360 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc9b8003f70 con 0x7fc9bc13e360 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9b80044e0 con 0x7fc9bc13e360 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b37fe640 4 set_mon_vals no callback set 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 10 monclient: dump: 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:51.982 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:51.983 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc99c005090 con 0x7fc9bc13e360 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc9b8004680 con 0x7fc9bc13e360 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(58..58 src has 1..58) ==== 4322+0+0 (unknown 2507312121 0 0) 0x7fc9b80447e0 con 0x7fc9bc13e360 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.984+0000 7fc9c112c640 10 monclient: get_auth_request con 0x7fc9a00377f0 auth_method 0 2024-04-25T23:57:51.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.988+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc9b80157d0 con 0x7fc9bc13e360 2024-04-25T23:57:51.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.988+0000 7fc9b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:51.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:51.988+0000 7fc9b1ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:52.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.148+0000 7fc9c3390640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:52.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.148+0000 7fc9c3390640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:52.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.148+0000 7fc9c3390640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:52.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.148+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rm", "name": "foo"} v 0) -- 0x7fc99c005380 con 0x7fc9bc13e360 2024-04-25T23:57:52.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.152+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo"}]=0 rule foo does not exist v58) ==== 103+0+0 (unknown 77879010 0 0) 0x7fc9b80150d0 con 0x7fc9bc13e360 2024-04-25T23:57:52.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.152+0000 7fc9b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:52.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.152+0000 7fc9b1ffb640 10 monclient: _finish_command 2 = system:0 rule foo does not exist 2024-04-25T23:57:52.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.240+0000 7fc9c3390640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:52.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.240+0000 7fc9c3390640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:52.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.240+0000 7fc9c3390640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:52.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.240+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rm", "name": "foo"} v 0) -- 0x7fc99c002220 con 0x7fc9bc13e360 2024-04-25T23:57:52.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9b1ffb640 1 -- 172.21.15.171:0/1603580950 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo"}]=0 rule foo does not exist v58) ==== 103+0+0 (unknown 77879010 0 0) 0x7fc9b801dc80 con 0x7fc9bc13e360 2024-04-25T23:57:52.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9b1ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rm", "name": "foo"}] 2024-04-25T23:57:52.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9b1ffb640 10 monclient: _finish_command 3 = system:0 rule foo does not exist 2024-04-25T23:57:52.227 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo does not exist 2024-04-25T23:57:52.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 >> v1:172.21.15.171:6812/722422047 conn(0x7fc9a00377f0 legacy=0x7fc9a0039cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 10 monclient: shutdown 2024-04-25T23:57:52.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:52.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 >> v1:172.21.15.171:6790/0 conn(0x7fc9bc13e360 legacy=0x7fc9bc1d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 shutdown_connections 2024-04-25T23:57:52.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 >> 172.21.15.171:0/1603580950 conn(0x7fc9bc0a2de0 msgr2=0x7fc9bc1361b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:52.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 shutdown_connections 2024-04-25T23:57:52.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.244+0000 7fc9c3390640 1 -- 172.21.15.171:0/1603580950 wait complete. 2024-04-25T23:57:52.242 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rm bar 2024-04-25T23:57:52.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: get_monmap_and_config 2024-04-25T23:57:52.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: build_initial_monmap 2024-04-25T23:57:52.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: monmap: 2024-04-25T23:57:52.359 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:52.359 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:52.378667+0000 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:52.378667+0000 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:52.360 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 Processor -- start 2024-04-25T23:57:52.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- start start 2024-04-25T23:57:52.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: init 2024-04-25T23:57:52.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:52.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: _add_conns ranks=[8,3,5,1,6,4,7,2,0] 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient(hunting): picked mon.noname-e con 0x7f5358072050 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient(hunting): picked mon.noname-g con 0x7f5358137d00 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient(hunting): picked mon.noname-h con 0x7f535813e230 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5358072e30 con 0x7f5358137d00 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535806ecc0 con 0x7f535813e230 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535806efa0 con 0x7f5358072050 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient(hunting): authenticate will time out at 1123.085578s 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f53567fc640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5358137d00 0x7f535813cb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60554/0 (socket says 172.21.15.171:60554) 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f53567fc640 1 -- 172.21.15.171:0/1717600160 learned_addr learned my addr 172.21.15.171:0/1717600160 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5356ffd640 1 -- 172.21.15.171:0/1717600160 >> v1:172.21.15.106:6793/0 conn(0x7f5358072050 legacy=0x7f5358072430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3910635193 0 0) 0x7f5358072e30 con 0x7f5358137d00 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:52.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): my global_id is 5367 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5340003530 con 0x7f5358137d00 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108545540 0 0) 0x7f535806ecc0 con 0x7f535813e230 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient(hunting): my global_id is 5216 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5358072e30 con 0x7f535813e230 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2309551005 0 0) 0x7f5340003530 con 0x7f5358137d00 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 >> v1:172.21.15.106:6793/0 conn(0x7f5358072050 legacy=0x7f5358072430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 >> v1:172.21.15.171:6791/0 conn(0x7f535813e230 legacy=0x7f5358140620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 monclient: found mon.noname-g 2024-04-25T23:57:52.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5358070910 con 0x7f5358137d00 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 5 monclient: authenticate success, global_id 5367 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f534c0017c0 con 0x7f5358137d00 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: dump: 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.369 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f534c0019f0 con 0x7f5358137d00 2024-04-25T23:57:52.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 4 set_mon_vals no callback set 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 1 -- 172.21.15.171:0/1717600160 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f534c004bf0 con 0x7f5358137d00 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f5355ffb640 10 monclient: dump: 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.371 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: shutdown 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- 172.21.15.171:0/1717600160 >> v1:172.21.15.171:6790/0 conn(0x7f5358137d00 legacy=0x7f535813cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- 172.21.15.171:0/1717600160 shutdown_connections 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- 172.21.15.171:0/1717600160 >> 172.21.15.171:0/1717600160 conn(0x7f53580a84b0 msgr2=0x7f53580a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- 172.21.15.171:0/1717600160 shutdown_connections 2024-04-25T23:57:52.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 1 -- 172.21.15.171:0/1717600160 wait complete. 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: build_initial_monmap 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.376+0000 7f535d7ef640 10 monclient: monmap: 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:52.373 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 1 Processor -- start 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 1 -- start start 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient: init 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient: _add_conns ranks=[1,7,2,5,8,0,4,3,6] 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient(hunting): picked mon.noname-f con 0x7f5358072050 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient(hunting): picked mon.noname-i con 0x7f5358137d00 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient(hunting): picked mon.noname-b con 0x7f535813e230 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f5356ffd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5358072050 legacy=0x7f5358134360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:52.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5358134a70 con 0x7f5358072050 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f53567fc640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5358137d00 legacy=0x7f53581d15f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5358071e40 con 0x7f535813e230 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f535811fa20 con 0x7f5358137d00 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient(hunting): authenticate will time out at 1123.089162s 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f53577fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f535813e230 0x7f53581d4d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:53002/0 (socket says 172.21.15.171:53002) 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f53577fe640 1 -- 172.21.15.171:0/3743036943 learned_addr learned my addr 172.21.15.171:0/3743036943 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897146792 0 0) 0x7f53480011e0 con 0x7f535813e230 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): my global_id is 5222 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5344003530 con 0x7f535813e230 2024-04-25T23:57:52.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 183994113 0 0) 0x7f5344003530 con 0x7f535813e230 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f53480011e0 con 0x7f535813e230 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5348001bd0 con 0x7f535813e230 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): dump: 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.376 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 439114363 0 0) 0x7f53480011e0 con 0x7f535813e230 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 >> v1:172.21.15.171:6792/0 conn(0x7f5358137d00 legacy=0x7f53581d15f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 >> v1:172.21.15.171:6789/0 conn(0x7f5358072050 legacy=0x7f5358134360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 monclient: found mon.b 2024-04-25T23:57:52.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f535811fd00 con 0x7f535813e230 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 5 monclient: authenticate success, global_id 5222 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient: _renew_subs 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f53581c3320 con 0x7f535813e230 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient: _renew_subs 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f535806def0 con 0x7f535813e230 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f53480038b0 con 0x7f535813e230 2024-04-25T23:57:52.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5348003e20 con 0x7f535813e230 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f53557fa640 4 set_mon_vals no callback set 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f533f7fe640 10 monclient: dump: 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.379 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.380 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.380 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.380 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.380 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.380 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.380 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.380 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.380+0000 7f535d7ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:52.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.384+0000 7f535d7ef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:52.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.384+0000 7f535d7ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:52.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.384+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5338005090 con 0x7f535813e230 2024-04-25T23:57:52.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.384+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5348003fc0 con 0x7f535813e230 2024-04-25T23:57:52.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.384+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(58..58 src has 1..58) ==== 4322+0+0 (unknown 2507312121 0 0) 0x7f5348044950 con 0x7f535813e230 2024-04-25T23:57:52.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.384+0000 7f5356ffd640 10 monclient: get_auth_request con 0x7f53440377e0 auth_method 0 2024-04-25T23:57:52.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.396+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5358071e40 con 0x7f535813e230 2024-04-25T23:57:52.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.396+0000 7f533f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:52.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.396+0000 7f533f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:52.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.556+0000 7f535d7ef640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "bar"}] 2024-04-25T23:57:52.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.556+0000 7f535d7ef640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rm", "name": "bar"}] 2024-04-25T23:57:52.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.556+0000 7f535d7ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:52.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.556+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rule rm", "name": "bar"} v 0) -- 0x7f5338005380 con 0x7f535813e230 2024-04-25T23:57:52.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.740+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "bar"}]=0 v59) ==== 80+0+0 (unknown 2932986998 0 0) 0x7f5348015940 con 0x7f535813e230 2024-04-25T23:57:52.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.740+0000 7f533f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rm", "name": "bar"}] 2024-04-25T23:57:52.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.740+0000 7f533f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:57:52.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.836+0000 7f535d7ef640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "bar"}] 2024-04-25T23:57:52.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.836+0000 7f535d7ef640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rm", "name": "bar"}] 2024-04-25T23:57:52.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.836+0000 7f535d7ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:57:52.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.836+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rule rm", "name": "bar"} v 0) -- 0x7f5338002220 con 0x7f535813e230 2024-04-25T23:57:52.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.836+0000 7f533f7fe640 1 -- 172.21.15.171:0/3743036943 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "bar"}]=0 rule bar does not exist v59) ==== 103+0+0 (unknown 3643766223 0 0) 0x7f5348015240 con 0x7f535813e230 2024-04-25T23:57:52.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.836+0000 7f533f7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rm", "name": "bar"}] 2024-04-25T23:57:52.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.836+0000 7f533f7fe640 10 monclient: _finish_command 3 = system:0 rule bar does not exist 2024-04-25T23:57:52.822 INFO:tasks.workunit.client.0.smithi171.stderr:rule bar does not exist 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 >> v1:172.21.15.171:6812/722422047 conn(0x7f53440377e0 legacy=0x7f5344039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 10 monclient: shutdown 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 >> v1:172.21.15.106:6790/0 conn(0x7f535813e230 legacy=0x7f53581d4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 shutdown_connections 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 >> 172.21.15.171:0/3743036943 conn(0x7f53580a84b0 msgr2=0x7f53580a10b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 shutdown_connections 2024-04-25T23:57:52.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.840+0000 7f535d7ef640 1 -- 172.21.15.171:0/3743036943 wait complete. 2024-04-25T23:57:52.837 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create pinning_pool 1 2024-04-25T23:57:52.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient: get_monmap_and_config 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient: build_initial_monmap 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient: monmap: 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:52.969057+0000 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:52.969057+0000 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:52.950 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:52.951 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:52.951 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:52.951 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:52.951 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:52.951 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:52.951 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:52.951 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 1 Processor -- start 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 1 -- start start 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient: init 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient: _add_conns ranks=[8,3,6,7,1,4,0,2,5] 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient(hunting): picked mon.noname-e con 0x7fbc0c1347b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.964+0000 7fbc13b2e640 10 monclient(hunting): picked mon.noname-g con 0x7fbc0c134b90 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): picked mon.noname-d con 0x7fbc0c134ff0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c0a3200 con 0x7fbc0c134b90 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c09fee0 con 0x7fbc0c134ff0 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c0a01c0 con 0x7fbc0c1347b0 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): authenticate will time out at 1123.676101s 2024-04-25T23:57:52.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc110c9640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbc0c134b90 0x7fbc0c13cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60558/0 (socket says 172.21.15.171:60558) 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc110c9640 1 -- 172.21.15.171:0/2605376663 learned_addr learned my addr 172.21.15.171:0/2605376663 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc118ca640 1 -- 172.21.15.171:0/2605376663 >> v1:172.21.15.106:6793/0 conn(0x7fbc0c1347b0 legacy=0x7fbc0c09f0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3086001271 0 0) 0x7fbc0c0a3200 con 0x7fbc0c134b90 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient(hunting): _negotiate 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient(hunting): my global_id is 5376 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbf8003530 con 0x7fbc0c134b90 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 481682103 0 0) 0x7fbbf8003530 con 0x7fbc0c134b90 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 >> v1:172.21.15.106:6793/0 conn(0x7fbc0c1347b0 legacy=0x7fbc0c09f0c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 >> v1:172.21.15.106:6792/0 conn(0x7fbc0c134ff0 legacy=0x7fbc0c1402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: _finish_hunting 0 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 monclient: found mon.noname-g 2024-04-25T23:57:52.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c0a04a0 con 0x7fbc0c134b90 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: _finish_auth 0 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: _check_auth_tickets 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbc080017c0 con 0x7fbc0c134b90 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: dump: 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.960 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 5 monclient: authenticate success, global_id 5376 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc08001ab0 con 0x7fbc0c134b90 2024-04-25T23:57:52.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 1 -- 172.21.15.171:0/2605376663 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbc08004bf0 con 0x7fbc0c134b90 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 4 set_mon_vals no callback set 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc108c8640 10 monclient: dump: 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.962 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient: shutdown 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- 172.21.15.171:0/2605376663 >> v1:172.21.15.171:6790/0 conn(0x7fbc0c134b90 legacy=0x7fbc0c13cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- 172.21.15.171:0/2605376663 shutdown_connections 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- 172.21.15.171:0/2605376663 >> 172.21.15.171:0/2605376663 conn(0x7fbc0c0a7680 msgr2=0x7fbc0c0a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- 172.21.15.171:0/2605376663 shutdown_connections 2024-04-25T23:57:52.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- 172.21.15.171:0/2605376663 wait complete. 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient: build_initial_monmap 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient: monmap: 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:52.964 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 Processor -- start 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- start start 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient: init 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient: _add_conns ranks=[4,6,7,0,1,3,5,2,8] 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): picked mon.noname-c con 0x7fbc0c1347b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): picked mon.noname-d con 0x7fbc0c134b90 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): picked mon.noname-i con 0x7fbc0c134ff0 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c072830 con 0x7fbc0c1347b0 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c12d6a0 con 0x7fbc0c134b90 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0c12f570 con 0x7fbc0c134ff0 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc120cb640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fbc0c134ff0 legacy=0x7fbc0c1d4910 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:52.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc13b2e640 10 monclient(hunting): authenticate will time out at 1123.679061s 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc118ca640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fbc0c1347b0 legacy=0x7fbc0c12c880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc110c9640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fbc0c134b90 0x7fbc0c12cf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:50558/0 (socket says 172.21.15.171:50558) 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbc110c9640 1 -- 172.21.15.171:0/3476173747 learned_addr learned my addr 172.21.15.171:0/3476173747 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1550705346 0 0) 0x7fbc0c12d6a0 con 0x7fbc0c134b90 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbbfe7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbbfe7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbbfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbbfe7fc640 10 monclient(hunting): my global_id is 5271 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.968+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbf0003530 con 0x7fbc0c134b90 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 203934150 0 0) 0x7fbbf0003530 con 0x7fbc0c134b90 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc0c12d6a0 con 0x7fbc0c134b90 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbc08001780 con 0x7fbc0c134b90 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:52.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient(hunting): dump: 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.967 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2841187786 0 0) 0x7fbc0c12d6a0 con 0x7fbc0c134b90 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 >> v1:172.21.15.171:6792/0 conn(0x7fbc0c134ff0 legacy=0x7fbc0c1d4910 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 >> v1:172.21.15.106:6791/0 conn(0x7fbc0c1347b0 legacy=0x7fbc0c12c880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 monclient: found mon.d 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0c12f850 con 0x7fbc0c134b90 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 5 monclient: authenticate success, global_id 5271 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 10 monclient: _renew_subs 2024-04-25T23:57:52.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbc0c12fb30 con 0x7fbc0c134b90 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 10 monclient: _renew_subs 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbc0c138140 con 0x7fbc0c134b90 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbc08001ab0 con 0x7fbc0c134b90 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfffff640 4 set_mon_vals no callback set 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbc08001ce0 con 0x7fbc0c134b90 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:52.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 10 monclient: dump: 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:52.970 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbf4005090 con 0x7fbc0c134b90 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbc080100f0 con 0x7fbc0c134b90 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(59..59 src has 1..59) ==== 4267+0+0 (unknown 2042444130 0 0) 0x7fbc080448f0 con 0x7fbc0c134b90 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.972+0000 7fbc118ca640 10 monclient: get_auth_request con 0x7fbbf0037780 auth_method 0 2024-04-25T23:57:52.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.984+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbc08015920 con 0x7fbc0c134b90 2024-04-25T23:57:52.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.984+0000 7fbbfe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:52.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:52.984+0000 7fbbfe7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:53.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.148+0000 7fbc13b2e640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}] 2024-04-25T23:57:53.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.148+0000 7fbc13b2e640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}] 2024-04-25T23:57:53.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.148+0000 7fbc13b2e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:53.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.148+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1} v 0) -- 0x7fbbf4005b90 con 0x7fbc0c134b90 2024-04-25T23:57:53.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.760+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}]=0 pool 'pinning_pool' created v60) ==== 127+0+0 (unknown 935038851 0 0) 0x7fbc0801ddd0 con 0x7fbc0c134b90 2024-04-25T23:57:53.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.764+0000 7fbbfe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}] 2024-04-25T23:57:53.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.764+0000 7fbbfe7fc640 10 monclient: _finish_command 2 = system:0 pool 'pinning_pool' created 2024-04-25T23:57:53.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.860+0000 7fbc13b2e640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}] 2024-04-25T23:57:53.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.860+0000 7fbc13b2e640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}] 2024-04-25T23:57:53.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.860+0000 7fbc13b2e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:53.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.860+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1} v 0) -- 0x7fbbf4005610 con 0x7fbc0c134b90 2024-04-25T23:57:53.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbbfe7fc640 1 -- 172.21.15.171:0/3476173747 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}]=0 pool 'pinning_pool' already exists v60) ==== 134+0+0 (unknown 443850777 0 0) 0x7fbc08040950 con 0x7fbc0c134b90 2024-04-25T23:57:53.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbbfe7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "pinning_pool", "pg_num": 1}] 2024-04-25T23:57:53.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbbfe7fc640 10 monclient: _finish_command 3 = system:0 pool 'pinning_pool' already exists 2024-04-25T23:57:53.848 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'pinning_pool' already exists 2024-04-25T23:57:53.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 >> v1:172.21.15.171:6812/722422047 conn(0x7fbbf0037780 legacy=0x7fbbf0039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:53.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 10 monclient: shutdown 2024-04-25T23:57:53.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:53.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 >> v1:172.21.15.106:6792/0 conn(0x7fbc0c134b90 legacy=0x7fbc0c12cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:53.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 shutdown_connections 2024-04-25T23:57:53.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 >> 172.21.15.171:0/3476173747 conn(0x7fbc0c0a7680 msgr2=0x7fbc0c1296e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:53.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 shutdown_connections 2024-04-25T23:57:53.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.864+0000 7fbc13b2e640 1 -- 172.21.15.171:0/3476173747 wait complete. 2024-04-25T23:57:53.865 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush rule rm replicated_rule 2024-04-25T23:57:53.865 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:57:53.865 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rm replicated_rule 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.996+0000 7f1144cd4640 10 monclient: get_monmap_and_config 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.996+0000 7f1144cd4640 10 monclient: build_initial_monmap 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:53.996+0000 7f1144cd4640 10 monclient: monmap: 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:54.002421+0000 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:54.002421+0000 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:53.984 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:53.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 Processor -- start 2024-04-25T23:57:53.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- start start 2024-04-25T23:57:53.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: init 2024-04-25T23:57:53.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:53.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: _add_conns ranks=[1,3,0,6,8,2,7,5,4] 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient(hunting): picked mon.noname-f con 0x7f11400a2da0 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient(hunting): picked mon.noname-g con 0x7f11400a3180 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient(hunting): picked mon.noname-a con 0x7f114013b4b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114006f230 con 0x7f114013b4b0 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1140070cd0 con 0x7f11400a2da0 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114006f690 con 0x7f11400a3180 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:53.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient(hunting): authenticate will time out at 1124.709343s 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113e59c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f11400a2da0 legacy=0x7f114006e410 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113dd9b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f11400a3180 0x7f114006eb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60572/0 (socket says 172.21.15.171:60572) 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113dd9b640 1 -- 172.21.15.171:0/3392196340 learned_addr learned my addr 172.21.15.171:0/3392196340 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148398196 0 0) 0x7f114006f690 con 0x7f11400a3180 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient(hunting): my global_id is 5385 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1128003530 con 0x7f11400a3180 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1438912446 0 0) 0x7f1128003530 con 0x7f11400a3180 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 >> v1:172.21.15.171:6789/0 conn(0x7f11400a2da0 legacy=0x7f114006e410 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 >> v1:172.21.15.106:6789/0 conn(0x7f114013b4b0 legacy=0x7f114013d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: _finish_hunting 0 2024-04-25T23:57:53.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 monclient: found mon.noname-g 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11400a1790 con 0x7f11400a3180 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: _finish_auth 0 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: _check_auth_tickets 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1134001800 con 0x7f11400a3180 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 5 monclient: authenticate success, global_id 5385 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: dump: 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:53.995 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:53.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1134001b10 con 0x7f11400a3180 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 1 -- 172.21.15.171:0/3392196340 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1134004bf0 con 0x7f11400a3180 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 4 set_mon_vals no callback set 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f113d59a640 10 monclient: dump: 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:53.997 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: shutdown 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- 172.21.15.171:0/3392196340 >> v1:172.21.15.171:6790/0 conn(0x7f11400a3180 legacy=0x7f114006eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:53.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- 172.21.15.171:0/3392196340 shutdown_connections 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- 172.21.15.171:0/3392196340 >> 172.21.15.171:0/3392196340 conn(0x7f11400a62d0 msgr2=0x7f11400a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- 172.21.15.171:0/3392196340 shutdown_connections 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- 172.21.15.171:0/3392196340 wait complete. 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: build_initial_monmap 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: monmap: 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:53.999 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 Processor -- start 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 1 -- start start 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.000+0000 7f1144cd4640 10 monclient: init 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _add_conns ranks=[2,6,8,5,4,0,1,3,7] 2024-04-25T23:57:54.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient(hunting): picked mon.noname-b con 0x7f11400a2da0 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient(hunting): picked mon.noname-d con 0x7f11400a3180 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient(hunting): picked mon.noname-e con 0x7f114013b4b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1140139980 con 0x7f11400a2da0 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114013ac10 con 0x7f11400a3180 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f114011e8e0 con 0x7f114013b4b0 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient(hunting): authenticate will time out at 1124.712302s 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f113ed9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f114013b4b0 legacy=0x7f11401d2900 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f113e59c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f11400a2da0 0x7f1140139270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:53012/0 (socket says 172.21.15.171:53012) 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f113e59c640 1 -- 172.21.15.171:0/788660397 learned_addr learned my addr 172.21.15.171:0/788660397 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540397810 0 0) 0x7f114013ac10 con 0x7f11400a3180 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:54.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): my global_id is 5280 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1120003530 con 0x7f11400a3180 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458977104 0 0) 0x7f1140139980 con 0x7f11400a2da0 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): my global_id is 5231 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f114013ac10 con 0x7f11400a2da0 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3704119224 0 0) 0x7f1120003530 con 0x7f11400a3180 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1140139980 con 0x7f11400a3180 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11340017c0 con 0x7f11400a3180 2024-04-25T23:57:54.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): dump: 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.003 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 273274718 0 0) 0x7f114013ac10 con 0x7f11400a2da0 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1120003530 con 0x7f11400a2da0 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1130004300 con 0x7f11400a2da0 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient(hunting): dump: 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.004 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2287360213 0 0) 0x7f1140139980 con 0x7f11400a3180 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 >> v1:172.21.15.106:6793/0 conn(0x7f114013b4b0 legacy=0x7f11401d2900 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 >> v1:172.21.15.106:6790/0 conn(0x7f11400a2da0 legacy=0x7f1140139270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 monclient: found mon.d 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1140120bd0 con 0x7f11400a3180 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: _finish_auth 0 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 5 monclient: authenticate success, global_id 5280 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _renew_subs 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1140120330 con 0x7f11400a3180 2024-04-25T23:57:54.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _renew_subs 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1140139f30 con 0x7f11400a3180 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1134001b10 con 0x7f11400a3180 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1134001d00 con 0x7f11400a3180 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f113cd99640 4 set_mon_vals no callback set 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 10 monclient: dump: 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.007 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:54.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f1144cd4640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1124005090 con 0x7f11400a3180 2024-04-25T23:57:54.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f113400fdb0 con 0x7f11400a3180 2024-04-25T23:57:54.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(60..60 src has 1..60) ==== 4618+0+0 (unknown 1056747071 0 0) 0x7f1134044720 con 0x7f11400a3180 2024-04-25T23:57:54.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.004+0000 7f113e59c640 10 monclient: get_auth_request con 0x7f1120037cb0 auth_method 0 2024-04-25T23:57:54.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.020+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1134015650 con 0x7f11400a3180 2024-04-25T23:57:54.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.020+0000 7f112effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:54.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.020+0000 7f112effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.184+0000 7f1144cd4640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "replicated_rule"}] 2024-04-25T23:57:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.184+0000 7f1144cd4640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rm", "name": "replicated_rule"}] 2024-04-25T23:57:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.184+0000 7f1144cd4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.184+0000 7f1144cd4640 1 -- 172.21.15.171:0/788660397 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule rm", "name": "replicated_rule"} v 0) -- 0x7f1124005b90 con 0x7f11400a3180 2024-04-25T23:57:54.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.184+0000 7f112effd640 1 -- 172.21.15.171:0/788660397 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "replicated_rule"}]=-16 crush rule replicated_rule (0) is in use v60) ==== 132+0+0 (unknown 2085096728 0 0) 0x7f1134014f50 con 0x7f11400a3180 2024-04-25T23:57:54.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.184+0000 7f112effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rm", "name": "replicated_rule"}] 2024-04-25T23:57:54.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.184+0000 7f112effd640 10 monclient: _finish_command 2 = mon:16 crush rule replicated_rule (0) is in use 2024-04-25T23:57:54.170 INFO:tasks.workunit.client.0.smithi171.stderr:Error EBUSY: crush rule replicated_rule (0) is in use 2024-04-25T23:57:54.176 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:57:54.177 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool rm pinning_pool pinning_pool --yes-i-really-really-mean-it 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.304+0000 7f679448b640 10 monclient: get_monmap_and_config 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.304+0000 7f679448b640 10 monclient: build_initial_monmap 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.304+0000 7f679448b640 10 monclient: monmap: 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:54.310388+0000 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:54.310388+0000 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.291 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:54.292 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 Processor -- start 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- start start 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient: init 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient: _add_conns ranks=[3,0,7,1,8,4,5,6,2] 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient(hunting): picked mon.noname-g con 0x7f678c137960 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient(hunting): picked mon.noname-a con 0x7f678c0a4220 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient(hunting): picked mon.noname-i con 0x7f678c138450 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c0a48c0 con 0x7f678c0a4220 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c0a2f70 con 0x7f678c137960 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c0a0d00 con 0x7f678c138450 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient(hunting): authenticate will time out at 1125.017666s 2024-04-25T23:57:54.301 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6792a28640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f678c138450 legacy=0x7f678c1405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6792227640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f678c137960 0x7f678c137d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60580/0 (socket says 172.21.15.171:60580) 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6792227640 1 -- 172.21.15.171:0/3712694669 learned_addr learned my addr 172.21.15.171:0/3712694669 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2806257097 0 0) 0x7f678c0a2f70 con 0x7f678c137960 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient(hunting): _negotiate 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient(hunting): my global_id is 5394 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6778003530 con 0x7f678c137960 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2302092213 0 0) 0x7f6778003530 con 0x7f678c137960 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 >> v1:172.21.15.171:6792/0 conn(0x7f678c138450 legacy=0x7f678c1405c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 >> v1:172.21.15.106:6789/0 conn(0x7f678c0a4220 legacy=0x7f678c13ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: _finish_hunting 0 2024-04-25T23:57:54.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 monclient: found mon.noname-g 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c0a29b0 con 0x7f678c137960 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: _finish_auth 0 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: _check_auth_tickets 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67880017c0 con 0x7f678c137960 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: dump: 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.303 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 5 monclient: authenticate success, global_id 5394 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:54.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6788001ab0 con 0x7f678c137960 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 1 -- 172.21.15.171:0/3712694669 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6788004bf0 con 0x7f678c137960 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f6791225640 10 monclient: dump: 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.305 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 4 set_mon_vals no callback set 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient: shutdown 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- 172.21.15.171:0/3712694669 >> v1:172.21.15.171:6790/0 conn(0x7f678c137960 legacy=0x7f678c137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- 172.21.15.171:0/3712694669 shutdown_connections 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- 172.21.15.171:0/3712694669 >> 172.21.15.171:0/3712694669 conn(0x7f678c0a9fc0 msgr2=0x7f678c0aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- 172.21.15.171:0/3712694669 shutdown_connections 2024-04-25T23:57:54.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 1 -- 172.21.15.171:0/3712694669 wait complete. 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient: build_initial_monmap 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.308+0000 7f679448b640 10 monclient: monmap: 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:54.307 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 Processor -- start 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 -- start start 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: init 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _add_conns ranks=[2,6,4,8,5,1,0,7,3] 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient(hunting): picked mon.noname-b con 0x7f678c0a4220 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient(hunting): picked mon.noname-d con 0x7f678c137960 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient(hunting): picked mon.noname-c con 0x7f678c138450 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c124240 con 0x7f678c0a4220 2024-04-25T23:57:54.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c122d90 con 0x7f678c138450 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f678c0a1f50 con 0x7f678c137960 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient(hunting): authenticate will time out at 1125.020729s 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6792a28640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f678c138450 legacy=0x7f678c1d4c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6792227640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f678c0a4220 0x7f678c136b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:53026/0 (socket says 172.21.15.171:53026) 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6792227640 1 -- 172.21.15.171:0/531389267 learned_addr learned my addr 172.21.15.171:0/531389267 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4238981537 0 0) 0x7f678c124240 con 0x7f678c0a4220 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): my global_id is 5240 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6770003530 con 0x7f678c0a4220 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233209748 0 0) 0x7f678c0a1f50 con 0x7f678c137960 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:57:54.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): my global_id is 5289 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f678c124240 con 0x7f678c137960 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3120391336 0 0) 0x7f678c124240 con 0x7f678c137960 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f678c0a1f50 con 0x7f678c137960 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f677c001a20 con 0x7f678c137960 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4033060506 0 0) 0x7f6770003530 con 0x7f678c0a4220 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f678c124240 con 0x7f678c0a4220 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6788001780 con 0x7f678c0a4220 2024-04-25T23:57:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient(hunting): dump: 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.312 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3168968232 0 0) 0x7f678c0a1f50 con 0x7f678c137960 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 >> v1:172.21.15.106:6791/0 conn(0x7f678c138450 legacy=0x7f678c1d4c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 >> v1:172.21.15.106:6790/0 conn(0x7f678c0a4220 legacy=0x7f678c136b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 monclient: found mon.d 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f678c122ae0 con 0x7f678c137960 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: _finish_auth 0 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:54.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 5 monclient: authenticate success, global_id 5289 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _renew_subs 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f678c123f60 con 0x7f678c137960 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _renew_subs 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f678c137440 con 0x7f678c137960 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f677c0038d0 con 0x7f678c137960 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6790a24640 4 set_mon_vals no callback set 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f677c003dc0 con 0x7f678c137960 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 10 monclient: dump: 2024-04-25T23:57:54.314 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.315 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:54.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:54.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6774005090 con 0x7f678c137960 2024-04-25T23:57:54.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.312+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f677c00eb60 con 0x7f678c137960 2024-04-25T23:57:54.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.316+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(60..60 src has 1..60) ==== 4618+0+0 (unknown 1056747071 0 0) 0x7f677c043610 con 0x7f678c137960 2024-04-25T23:57:54.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.316+0000 7f6792227640 10 monclient: get_auth_request con 0x7f6770037d90 auth_method 0 2024-04-25T23:57:54.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.328+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f677c0144e0 con 0x7f678c137960 2024-04-25T23:57:54.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.328+0000 7f6782ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:54.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.328+0000 7f6782ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:54.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.488+0000 7f679448b640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:54.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.488+0000 7f679448b640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:54.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.488+0000 7f679448b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.488+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6774005380 con 0x7f678c137960 2024-04-25T23:57:54.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.768+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}]=0 pool 'pinning_pool' removed v61) ==== 172+0+0 (unknown 2129805599 0 0) 0x7f677c013de0 con 0x7f678c137960 2024-04-25T23:57:54.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.768+0000 7f6782ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:54.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.768+0000 7f6782ffd640 10 monclient: _finish_command 2 = system:0 pool 'pinning_pool' removed 2024-04-25T23:57:54.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.868+0000 7f679448b640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:54.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.868+0000 7f679448b640 10 monclient: _send_command 3 [{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:54.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.868+0000 7f679448b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.868+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6774000cb0 con 0x7f678c137960 2024-04-25T23:57:54.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f6782ffd640 1 -- 172.21.15.171:0/531389267 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}]=0 pool 'pinning_pool' does not exist v61) ==== 179+0+0 (unknown 3879824278 0 0) 0x7f677c01c990 con 0x7f678c137960 2024-04-25T23:57:54.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f6782ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool rm", "pool": "pinning_pool", "pool2": "pinning_pool", "yes_i_really_really_mean_it": true}] 2024-04-25T23:57:54.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f6782ffd640 10 monclient: _finish_command 3 = system:0 pool 'pinning_pool' does not exist 2024-04-25T23:57:54.856 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'pinning_pool' does not exist 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 >> v1:172.21.15.171:6812/722422047 conn(0x7f6770037d90 legacy=0x7f677003a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 10 monclient: shutdown 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 >> v1:172.21.15.106:6792/0 conn(0x7f678c137960 legacy=0x7f678c1d14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 shutdown_connections 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 >> 172.21.15.171:0/531389267 conn(0x7f678c0a9fc0 msgr2=0x7f678c0a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 shutdown_connections 2024-04-25T23:57:54.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:54.872+0000 7f679448b640 1 -- 172.21.15.171:0/531389267 wait complete. 2024-04-25T23:57:54.873 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush add-bucket foo osd 2024-04-25T23:57:54.873 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:57:54.873 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket foo osd 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient: get_monmap_and_config 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient: build_initial_monmap 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient: monmap: 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:55.004785+0000 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:55.004785+0000 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.986 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 1 Processor -- start 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 1 -- start start 2024-04-25T23:57:54.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient: init 2024-04-25T23:57:54.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:54.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient: _add_conns ranks=[6,4,7,3,8,5,1,0,2] 2024-04-25T23:57:54.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient(hunting): picked mon.noname-d con 0x7f2b640a1530 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient(hunting): picked mon.noname-c con 0x7f2b64071c00 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient(hunting): picked mon.noname-i con 0x7f2b64071730 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6406ea70 con 0x7f2b64071c00 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b640723d0 con 0x7f2b640a1530 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b64072990 con 0x7f2b64071730 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b6b7ab640 10 monclient(hunting): authenticate will time out at 1125.711497s 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b69d48640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f2b64071730 legacy=0x7f2b6413e2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b68d46640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f2b64071c00 legacy=0x7f2b6413ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:54.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b69547640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f2b640a1530 0x7f2b640a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:50596/0 (socket says 172.21.15.171:50596) 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.000+0000 7f2b69547640 1 -- 172.21.15.171:0/154021667 learned_addr learned my addr 172.21.15.171:0/154021667 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1083453185 0 0) 0x7f2b640723d0 con 0x7f2b640a1530 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient(hunting): my global_id is 5298 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b50003530 con 0x7f2b640a1530 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 948107530 0 0) 0x7f2b50003530 con 0x7f2b640a1530 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 >> v1:172.21.15.171:6792/0 conn(0x7f2b64071730 legacy=0x7f2b6413e2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 >> v1:172.21.15.106:6791/0 conn(0x7f2b64071c00 legacy=0x7f2b6413ab90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 monclient: found mon.noname-d 2024-04-25T23:57:54.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b640a3100 con 0x7f2b640a1530 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: _finish_auth 0 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b600017c0 con 0x7f2b640a1530 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 5 monclient: authenticate success, global_id 5298 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: dump: 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.996 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b60001a20 con 0x7f2b640a1530 2024-04-25T23:57:54.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 4 set_mon_vals no callback set 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 1 -- 172.21.15.171:0/154021667 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b60004bf0 con 0x7f2b640a1530 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5bfff640 10 monclient: dump: 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:54.998 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: shutdown 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/154021667 >> v1:172.21.15.106:6792/0 conn(0x7f2b640a1530 legacy=0x7f2b640a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/154021667 shutdown_connections 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/154021667 >> 172.21.15.171:0/154021667 conn(0x7f2b640a62d0 msgr2=0x7f2b640a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/154021667 shutdown_connections 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/154021667 wait complete. 2024-04-25T23:57:54.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: build_initial_monmap 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: monmap: 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:55.000 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 Processor -- start 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- start start 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: init 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: _add_conns ranks=[3,8,1,0,4,2,6,7,5] 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient(hunting): picked mon.noname-g con 0x7f2b64071730 addr v1:172.21.15.171:6790/0 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient(hunting): picked mon.noname-e con 0x7f2b64071c00 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient(hunting): picked mon.noname-f con 0x7f2b640a1530 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6411e0f0 con 0x7f2b640a1530 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6409fb20 con 0x7f2b64071730 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b6409f660 con 0x7f2b64071c00 2024-04-25T23:57:55.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient(hunting): authenticate will time out at 1125.714925s 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b69d48640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f2b640a1530 legacy=0x7f2b641d2850 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b69547640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2b64071730 0x7f2b64132a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60594/0 (socket says 172.21.15.171:60594) 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b69547640 1 -- 172.21.15.171:0/3784935410 learned_addr learned my addr 172.21.15.171:0/3784935410 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b68d46640 1 -- 172.21.15.171:0/3784935410 >> v1:172.21.15.106:6793/0 conn(0x7f2b64071c00 legacy=0x7f2b641cf120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2977582268 0 0) 0x7f2b6409fb20 con 0x7f2b64071730 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): my global_id is 5403 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b48003530 con 0x7f2b64071730 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1982404827 0 0) 0x7f2b48003530 con 0x7f2b64071730 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b6409fb20 con 0x7f2b64071730 2024-04-25T23:57:55.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b60004b30 con 0x7f2b64071730 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): dump: 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:55.003 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1290238409 0 0) 0x7f2b6409fb20 con 0x7f2b64071730 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 >> v1:172.21.15.106:6793/0 conn(0x7f2b64071c00 legacy=0x7f2b641cf120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 >> v1:172.21.15.171:6789/0 conn(0x7f2b640a1530 legacy=0x7f2b641d2850 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 monclient: found mon.g 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:55.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b64120450 con 0x7f2b64071730 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: _finish_auth 0 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 5 monclient: authenticate success, global_id 5403 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: _renew_subs 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/3784935410 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b6411fbb0 con 0x7f2b64071730 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: _renew_subs 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/3784935410 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b64133180 con 0x7f2b64071730 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b60001a20 con 0x7f2b64071730 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b600051a0 con 0x7f2b64071730 2024-04-25T23:57:55.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b5affd640 4 set_mon_vals no callback set 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.004+0000 7f2b59ffb640 10 monclient: dump: 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:55.006 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.008+0000 7f2b6b7ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.008+0000 7f2b6b7ab640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.008+0000 7f2b6b7ab640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.008+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/3784935410 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b44005090 con 0x7f2b64071730 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.008+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2b6000ff40 con 0x7f2b64071730 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.008+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(61..61 src has 1..61) ==== 4267+0+0 (unknown 1947468731 0 0) 0x7f2b600449a0 con 0x7f2b64071730 2024-04-25T23:57:55.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.008+0000 7f2b68d46640 10 monclient: get_auth_request con 0x7f2b48037780 auth_method 0 2024-04-25T23:57:55.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.012+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2b600159d0 con 0x7f2b64071730 2024-04-25T23:57:55.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.012+0000 7f2b59ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:55.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.012+0000 7f2b59ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:55.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.160+0000 7f2b6b7ab640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "foo", "type": "osd"}] 2024-04-25T23:57:55.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.160+0000 7f2b6b7ab640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "osd"}] 2024-04-25T23:57:55.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.160+0000 7f2b6b7ab640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:57:55.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.160+0000 7f2b6b7ab640 1 -- 172.21.15.171:0/3784935410 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "foo", "type": "osd"} v 0) -- 0x7f2b44005b90 con 0x7f2b64071730 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.160+0000 7f2b59ffb640 1 -- 172.21.15.171:0/3784935410 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "foo", "type": "osd"}]=-22 type 'osd' is for devices, not buckets v61) ==== 136+0+0 (unknown 434897630 0 0) 0x7f2b6001de80 con 0x7f2b64071730 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.160+0000 7f2b59ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "osd"}] 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.160+0000 7f2b59ffb640 10 monclient: _finish_command 2 = mon:22 type 'osd' is for devices, not buckets 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: type 'osd' is for devices, not buckets 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket foo root 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient: get_monmap_and_config 2024-04-25T23:57:55.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient: build_initial_monmap 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient: monmap: 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:55.286643+0000 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:55.286643+0000 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:55.329 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 1 Processor -- start 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 1 -- start start 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient: init 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient: _add_conns ranks=[7,8,1,0,2,5,4,6,3] 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient(hunting): picked mon.noname-i con 0x7f6694099c80 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient(hunting): picked mon.noname-e con 0x7f669409c020 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient(hunting): picked mon.noname-f con 0x7f669413e540 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66940a28d0 con 0x7f669413e540 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66940a1dc0 con 0x7f6694099c80 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669409cb00 con 0x7f669409c020 2024-04-25T23:57:55.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:55.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669be64640 10 monclient(hunting): authenticate will time out at 1125.993861s 2024-04-25T23:57:55.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f6699c00640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6694099c80 legacy=0x7f66940a0fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:55.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f669a401640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f669413e540 legacy=0x7f6694140930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:55.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.284+0000 7f66993ff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f669409c020 legacy=0x7f66940a16b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:55.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.488+0000 7f6699c00640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6694099c80 legacy=0x7f66940a0fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:55.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.488+0000 7f669a401640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f669413e540 legacy=0x7f6694140930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:55.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.488+0000 7f66993ff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f669409c020 legacy=0x7f66940a16b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:55.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.892+0000 7f669a401640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f669413e540 legacy=0x7f6694140930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:55.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.892+0000 7f6699c00640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6694099c80 legacy=0x7f66940a0fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:55.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:55.892+0000 7f66993ff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f669409c020 legacy=0x7f66940a16b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:56.696+0000 7f6699c00640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6694099c80 legacy=0x7f66940a0fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:56.696+0000 7f669a401640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f669413e540 legacy=0x7f6694140930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:56.696+0000 7f66993ff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f669409c020 legacy=0x7f66940a16b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:58.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient(hunting): tick 2024-04-25T23:57:58.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:57:58.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 1 monclient(hunting): continuing hunt 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f669409c020 legacy=0x7f66940a16b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6694099c80 legacy=0x7f66940a0fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f669413e540 legacy=0x7f6694140930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient: _add_conns ranks=[5,2,6,4,3,0] 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient(hunting): picked mon.noname-h con 0x7f6678003790 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient(hunting): picked mon.noname-b con 0x7f6678007420 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient(hunting): picked mon.noname-d con 0x7f667800b1b0 addr v1:172.21.15.106:6792/0 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669409bc00 con 0x7f6678007420 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66940a28d0 con 0x7f6678003790 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66940a1dc0 con 0x7f667800b1b0 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f668b7fe640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:58.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6699c00640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6678003790 0x7f6678005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39336/0 (socket says 172.21.15.171:39336) 2024-04-25T23:57:58.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6699c00640 1 -- 172.21.15.171:0/2452754980 learned_addr learned my addr 172.21.15.171:0/2452754980 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4138012930 0 0) 0x7f66940a28d0 con 0x7f6678003790 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): my global_id is 5225 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6680003530 con 0x7f6678003790 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 987233521 0 0) 0x7f669409bc00 con 0x7f6678007420 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): my global_id is 5249 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66940a28d0 con 0x7f6678007420 2024-04-25T23:57:58.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 467391818 0 0) 0x7f66940a1dc0 con 0x7f667800b1b0 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient(hunting): my global_id is 5307 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f669409bc00 con 0x7f667800b1b0 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 366564920 0 0) 0x7f6680003530 con 0x7f6678003790 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 >> v1:172.21.15.106:6792/0 conn(0x7f667800b1b0 legacy=0x7f667800d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 >> v1:172.21.15.106:6790/0 conn(0x7f6678007420 legacy=0x7f66780098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 monclient: found mon.noname-h 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:57:58.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669409cb00 con 0x7f6678003790 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient: _finish_auth 0 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f669a401640 1 -- 172.21.15.171:0/2452754980 reap_dead start 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66900041f0 con 0x7f6678003790 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f669be64640 5 monclient: authenticate success, global_id 5225 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f669be64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 10 monclient: dump: 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:58.275 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:58.276 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f669be64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.284+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6690004460 con 0x7f6678003790 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f6698bfe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 4 set_mon_vals no callback set 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f6698bfe640 1 -- 172.21.15.171:0/2452754980 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6690004a50 con 0x7f6678003790 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f6698bfe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f6698bfe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f6698bfe640 10 monclient: dump: 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.277 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 10 monclient: shutdown 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 1 -- 172.21.15.171:0/2452754980 >> v1:172.21.15.171:6791/0 conn(0x7f6678003790 legacy=0x7f6678005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:58.278 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 1 -- 172.21.15.171:0/2452754980 shutdown_connections 2024-04-25T23:57:58.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 1 -- 172.21.15.171:0/2452754980 >> 172.21.15.171:0/2452754980 conn(0x7f66940a6540 msgr2=0x7f66940a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:58.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 1 -- 172.21.15.171:0/2452754980 shutdown_connections 2024-04-25T23:57:58.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 1 -- 172.21.15.171:0/2452754980 wait complete. 2024-04-25T23:57:58.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 10 monclient: build_initial_monmap 2024-04-25T23:57:58.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 10 monclient: monmap: 2024-04-25T23:57:58.282 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:58.283 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 1 Processor -- start 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 1 -- start start 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.288+0000 7f669be64640 10 monclient: init 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _add_conns ranks=[1,5,2,6,3,8,4,7,0] 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient(hunting): picked mon.noname-f con 0x7f6678003790 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient(hunting): picked mon.noname-h con 0x7f669413cf30 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient(hunting): picked mon.noname-b con 0x7f66941cd060 addr v1:172.21.15.106:6790/0 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669413e180 con 0x7f6678003790 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f669409aea0 con 0x7f66941cd060 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f6699c00640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6678003790 legacy=0x7f66941cc950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6694099a50 con 0x7f669413cf30 2024-04-25T23:57:58.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient(hunting): authenticate will time out at 1129.000868s 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f66993ff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f669413cf30 0x7f66941d1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39340/0 (socket says 172.21.15.171:39340) 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f66993ff640 1 -- 172.21.15.171:0/799549100 learned_addr learned my addr 172.21.15.171:0/799549100 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723101408 0 0) 0x7f6694099a50 con 0x7f669413cf30 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): my global_id is 5234 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66780106d0 con 0x7f669413cf30 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3240954132 0 0) 0x7f669409aea0 con 0x7f66941cd060 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): my global_id is 5258 2024-04-25T23:57:58.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6694099a50 con 0x7f66941cd060 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2614787460 0 0) 0x7f66780106d0 con 0x7f669413cf30 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f669409aea0 con 0x7f669413cf30 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6684004450 con 0x7f669413cf30 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): dump: 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:58.286 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2735850191 0 0) 0x7f669409aea0 con 0x7f669413cf30 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 >> v1:172.21.15.106:6790/0 conn(0x7f66941cd060 legacy=0x7f66941d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 >> v1:172.21.15.171:6789/0 conn(0x7f6678003790 legacy=0x7f66941cc950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 monclient: found mon.h 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:58.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f669413da30 con 0x7f669413cf30 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 5 monclient: authenticate success, global_id 5234 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _renew_subs 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6694070dd0 con 0x7f669413cf30 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _renew_subs 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6684004990 con 0x7f669413cf30 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f66941d6960 con 0x7f669413cf30 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6684004f00 con 0x7f669413cf30 2024-04-25T23:57:58.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 10 monclient: dump: 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:58.289 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668bfff640 4 set_mon_vals no callback set 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6684006110 con 0x7f669413cf30 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6694068570 con 0x7f669413cf30 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(61..61 src has 1..61) ==== 4267+0+0 (unknown 1947468731 0 0) 0x7f6684044860 con 0x7f669413cf30 2024-04-25T23:57:58.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.292+0000 7f6699c00640 10 monclient: get_auth_request con 0x7f6678038950 auth_method 0 2024-04-25T23:57:58.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.300+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6684015890 con 0x7f669413cf30 2024-04-25T23:57:58.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.300+0000 7f668a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:57:58.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.300+0000 7f668a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:57:58.442 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.456+0000 7f669be64640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}] 2024-04-25T23:57:58.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.456+0000 7f669be64640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}] 2024-04-25T23:57:58.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.456+0000 7f669be64640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:58.443 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.456+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "foo", "type": "root"} v 0) -- 0x7f66940689c0 con 0x7f669413cf30 2024-04-25T23:57:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.796+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}]=0 added bucket foo type root to crush map v62) ==== 138+0+0 (unknown 1792802139 0 0) 0x7f6684015190 con 0x7f669413cf30 2024-04-25T23:57:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.796+0000 7f668a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}] 2024-04-25T23:57:58.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.796+0000 7f668a7fc640 10 monclient: _finish_command 2 = system:0 added bucket foo type root to crush map 2024-04-25T23:57:58.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.892+0000 7f669be64640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}] 2024-04-25T23:57:58.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.892+0000 7f669be64640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}] 2024-04-25T23:57:58.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.892+0000 7f669be64640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:57:58.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.892+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "foo", "type": "root"} v 0) -- 0x7f66941cd490 con 0x7f669413cf30 2024-04-25T23:57:58.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.892+0000 7f668a7fc640 1 -- 172.21.15.171:0/799549100 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}]=0 bucket 'foo' already exists v62) ==== 126+0+0 (unknown 787900033 0 0) 0x7f668401dd40 con 0x7f669413cf30 2024-04-25T23:57:58.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.892+0000 7f668a7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "root"}] 2024-04-25T23:57:58.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.892+0000 7f668a7fc640 10 monclient: _finish_command 3 = system:0 bucket 'foo' already exists 2024-04-25T23:57:58.878 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'foo' already exists 2024-04-25T23:57:58.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 >> v1:172.21.15.171:6812/722422047 conn(0x7f6678038950 legacy=0x7f667803ae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:58.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 10 monclient: shutdown 2024-04-25T23:57:58.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:58.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 >> v1:172.21.15.171:6791/0 conn(0x7f669413cf30 legacy=0x7f66941d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:58.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 shutdown_connections 2024-04-25T23:57:58.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 >> 172.21.15.171:0/799549100 conn(0x7f66940a6540 msgr2=0x7f66940a41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:58.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 shutdown_connections 2024-04-25T23:57:58.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:58.896+0000 7f669be64640 1 -- 172.21.15.171:0/799549100 wait complete. 2024-04-25T23:57:58.894 INFO:tasks.workunit.client.0.smithi171.stderr:++ ceph osd create 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient: get_monmap_and_config 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient: build_initial_monmap 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient: monmap: 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:57:59.028599+0000 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:57:59.028599+0000 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:59.009 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:59.010 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 1 Processor -- start 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 1 -- start start 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient: init 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient: _add_conns ranks=[0,7,5,6,8,1,4,2,3] 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient(hunting): picked mon.noname-a con 0x7f5ec809bb70 addr v1:172.21.15.106:6789/0 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient(hunting): picked mon.noname-i con 0x7f5ec80a1a40 addr v1:172.21.15.171:6792/0 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient(hunting): picked mon.noname-h con 0x7f5ec809c660 addr v1:172.21.15.171:6791/0 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec80a2000 con 0x7f5ec809bb70 2024-04-25T23:57:59.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec809e220 con 0x7f5ec809c660 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ec7fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5ec80a1a40 legacy=0x7f5ec8139b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec809f580 con 0x7f5ec80a1a40 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecebfc640 10 monclient(hunting): authenticate will time out at 1129.735556s 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecd199640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5ec809c660 0x7f5ec813d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39352/0 (socket says 172.21.15.171:39352) 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ecd199640 1 -- 172.21.15.171:0/2494403956 learned_addr learned my addr 172.21.15.171:0/2494403956 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2828746138 0 0) 0x7f5ec809e220 con 0x7f5ec809c660 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ec77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ec77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ec77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ec77fe640 10 monclient(hunting): my global_id is 5243 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.024+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb0003530 con 0x7f5ec809c660 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 913995328 0 0) 0x7f5eb0003530 con 0x7f5ec809c660 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 >> v1:172.21.15.171:6792/0 conn(0x7f5ec80a1a40 legacy=0x7f5ec8139b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 >> v1:172.21.15.106:6789/0 conn(0x7f5ec809bb70 legacy=0x7f5ec809bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:59.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: _finish_hunting 0 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 monclient: found mon.noname-h 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec809d310 con 0x7f5ec809c660 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: _finish_auth 0 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: _check_auth_tickets 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ec0001b40 con 0x7f5ec809c660 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: dump: 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:59.016 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 5 monclient: authenticate success, global_id 5243 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ec0001ea0 con 0x7f5ec809c660 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:57:59.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 1 -- 172.21.15.171:0/2494403956 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ec0004f70 con 0x7f5ec809c660 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec77fe640 10 monclient: dump: 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:57:59.018 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient: get_monmap_and_config success 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 4 set_mon_vals no callback set 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient: shutdown 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2494403956 >> v1:172.21.15.171:6791/0 conn(0x7f5ec809c660 legacy=0x7f5ec813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2494403956 shutdown_connections 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2494403956 >> 172.21.15.171:0/2494403956 conn(0x7f5ec80a28a0 msgr2=0x7f5ec80a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2494403956 shutdown_connections 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2494403956 wait complete. 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient: build_initial_monmap 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient: monmap: 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:57:59.019 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 Processor -- start 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- start start 2024-04-25T23:57:59.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient: init 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient: _reopen_session rank -1 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient: _add_conns ranks=[4,8,1,5,0,6,2,3,7] 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient(hunting): picked mon.noname-c con 0x7f5ec809bb70 addr v1:172.21.15.106:6791/0 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient(hunting): picked mon.noname-e con 0x7f5ec809c660 addr v1:172.21.15.106:6793/0 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient(hunting): picked mon.noname-f con 0x7f5ec80a1a40 addr v1:172.21.15.171:6789/0 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec81aa260 con 0x7f5ec80a1a40 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec809dd30 con 0x7f5ec809bb70 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec81ac550 con 0x7f5ec809c660 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient(hunting): _renew_subs 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecebfc640 10 monclient(hunting): authenticate will time out at 1129.738405s 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecd199640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5ec80a1a40 legacy=0x7f5ec81d5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ecc998640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5ec809bb70 legacy=0x7f5ec81cc9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:59.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.028+0000 7f5ec7fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5ec809c660 legacy=0x7f5ec81d1950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:59.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.232+0000 7f5ecd199640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5ec80a1a40 legacy=0x7f5ec81d5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:59.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.232+0000 7f5ecc998640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5ec809bb70 legacy=0x7f5ec81cc9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:59.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.232+0000 7f5ec7fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5ec809c660 legacy=0x7f5ec81d1950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:57:59.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.636+0000 7f5ecd199640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5ec80a1a40 legacy=0x7f5ec81d5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:57:59.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.636+0000 7f5ecc998640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5ec809bb70 legacy=0x7f5ec81cc9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:57:59.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:57:59.636+0000 7f5ec7fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5ec809c660 legacy=0x7f5ec81d1950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:00.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:00.440+0000 7f5ecd199640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5ec80a1a40 legacy=0x7f5ec81d5080 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:00.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:00.440+0000 7f5ecc998640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5ec809bb70 legacy=0x7f5ec81cc9a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:00.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:00.440+0000 7f5ec7fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5ec809c660 legacy=0x7f5ec81d1950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:02.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient(hunting): tick 2024-04-25T23:58:02.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:58:02.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 1 monclient(hunting): continuing hunt 2024-04-25T23:58:02.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:58:02.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5ec809c660 legacy=0x7f5ec81d1950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:02.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5ec809bb70 legacy=0x7f5ec81cc9a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:02.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5ec80a1a40 legacy=0x7f5ec81d5080 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:02.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient: _add_conns ranks=[3,2,0,6,5,7] 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient(hunting): picked mon.noname-g con 0x7f5ea8003790 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient(hunting): picked mon.noname-b con 0x7f5ea8007420 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient(hunting): picked mon.noname-a con 0x7f5ea800b1b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec81abcb0 con 0x7f5ea800b1b0 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec81aa260 con 0x7f5ea8007420 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ec809dd30 con 0x7f5ea8003790 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5eaffff640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ecc998640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5ea8003790 0x7f5ea8005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51556/0 (socket says 172.21.15.171:51556) 2024-04-25T23:58:02.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ecc998640 1 -- 172.21.15.171:0/2795792352 learned_addr learned my addr 172.21.15.171:0/2795792352 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2367129126 0 0) 0x7f5ec809dd30 con 0x7f5ea8003790 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): my global_id is 5412 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eb4003530 con 0x7f5ea8003790 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089731075 0 0) 0x7f5ec81abcb0 con 0x7f5ea800b1b0 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:02.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): my global_id is 5265 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec809dd30 con 0x7f5ea800b1b0 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 994631375 0 0) 0x7f5ec81aa260 con 0x7f5ea8007420 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.028+0000 7f5ec57fa640 10 monclient(hunting): my global_id is 5267 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ec81abcb0 con 0x7f5ea8007420 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3000311675 0 0) 0x7f5eb4003530 con 0x7f5ea8003790 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ec81aa260 con 0x7f5ea8003790 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5eb8001b70 con 0x7f5ea8003790 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): dump: 2024-04-25T23:58:02.021 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:02.022 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2687521608 0 0) 0x7f5ec81abcb0 con 0x7f5ea8007420 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5eb4003530 con 0x7f5ea8007420 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ebc004380 con 0x7f5ea8007420 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): dump: 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.023 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1359434287 0 0) 0x7f5ec809dd30 con 0x7f5ea800b1b0 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ec81abcb0 con 0x7f5ea800b1b0 2024-04-25T23:58:02.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ec0004f70 con 0x7f5ea800b1b0 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient(hunting): dump: 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:02.025 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 211127282 0 0) 0x7f5ec81aa260 con 0x7f5ea8003790 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 >> v1:172.21.15.106:6790/0 conn(0x7f5ea8007420 legacy=0x7f5ea80098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 >> v1:172.21.15.106:6789/0 conn(0x7f5ea800b1b0 legacy=0x7f5ea800d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 monclient: found mon.g 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecd199640 1 -- 172.21.15.171:0/2795792352 reap_dead start 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:02.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ec81ac550 con 0x7f5ea8003790 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 5 monclient: authenticate success, global_id 5412 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 10 monclient: _renew_subs 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5ec81bb060 con 0x7f5ea8003790 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 10 monclient: _renew_subs 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5ec81cc9a0 con 0x7f5ea8003790 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5eb80038d0 con 0x7f5ea8003790 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5eb8003e40 con 0x7f5ea8003790 2024-04-25T23:58:02.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec6ffd640 4 set_mon_vals no callback set 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 10 monclient: dump: 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:02.028 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5eb8003fe0 con 0x7f5ea8003790 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea0005090 con 0x7f5ea8003790 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(63..63 src has 1..63) ==== 4294+0+0 (unknown 2685662369 0 0) 0x7f5eb8044840 con 0x7f5ea8003790 2024-04-25T23:58:02.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.032+0000 7f5ec7fff640 10 monclient: get_auth_request con 0x7f5eb40380e0 auth_method 0 2024-04-25T23:58:02.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.040+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5eb8015850 con 0x7f5ea8003790 2024-04-25T23:58:02.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.040+0000 7f5ec57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:02.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.040+0000 7f5ec57fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:02.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.232+0000 7f5ecebfc640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:58:02.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.232+0000 7f5ecebfc640 10 monclient: _send_command 2 [{"prefix": "osd create"}] 2024-04-25T23:58:02.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.232+0000 7f5ecebfc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:02.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.232+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f5ea0005380 con 0x7f5ea8003790 2024-04-25T23:58:02.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.496+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd create"}]=0 v64) ==== 58+0+2 (unknown 3957871082 0 1113811849) 0x7f5eb8001d10 con 0x7f5ea8003790 2024-04-25T23:58:02.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.496+0000 7f5ec57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create"}] 2024-04-25T23:58:02.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.496+0000 7f5ec57fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:02.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.604+0000 7f5ecebfc640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:58:02.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.604+0000 7f5ecebfc640 10 monclient: _send_command 3 [{"prefix": "osd create"}] 2024-04-25T23:58:02.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.604+0000 7f5ecebfc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:02.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:02.604+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f5ea0000bd0 con 0x7f5ea8003790 2024-04-25T23:58:03.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.508+0000 7f5ec57fa640 1 -- 172.21.15.171:0/2795792352 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd create"}]=0 v65) ==== 58+0+2 (unknown 1587384094 0 1371665406) 0x7f5eb8015150 con 0x7f5ea8003790 2024-04-25T23:58:03.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.508+0000 7f5ec57fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create"}] 2024-04-25T23:58:03.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.508+0000 7f5ec57fa640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:03.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 >> v1:172.21.15.171:6812/722422047 conn(0x7f5eb40380e0 legacy=0x7f5eb403a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:03.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 10 monclient: shutdown 2024-04-25T23:58:03.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:03.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 >> v1:172.21.15.171:6790/0 conn(0x7f5ea8003790 legacy=0x7f5ea8005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:03.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 shutdown_connections 2024-04-25T23:58:03.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 >> 172.21.15.171:0/2795792352 conn(0x7f5ec80a28a0 msgr2=0x7f5ec81bb310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:03.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 shutdown_connections 2024-04-25T23:58:03.497 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.512+0000 7f5ecebfc640 1 -- 172.21.15.171:0/2795792352 wait complete. 2024-04-25T23:58:03.519 INFO:tasks.workunit.client.0.smithi171.stderr:+ o1=7 2024-04-25T23:58:03.519 INFO:tasks.workunit.client.0.smithi171.stderr:++ ceph osd create 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.648+0000 7f6252355640 10 monclient: get_monmap_and_config 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.648+0000 7f6252355640 10 monclient: build_initial_monmap 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient: monmap: 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:03.654514+0000 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:03.654514+0000 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:03.635 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:03.636 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 Processor -- start 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- start start 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient: init 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient: _add_conns ranks=[1,8,2,6,7,4,3,0,5] 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient(hunting): picked mon.noname-f con 0x7f624c09bb70 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient(hunting): picked mon.noname-e con 0x7f624c0a1a40 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient(hunting): picked mon.noname-b con 0x7f624c09c660 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c0a2000 con 0x7f624c09bb70 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c09e220 con 0x7f624c09c660 2024-04-25T23:58:03.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c09f580 con 0x7f624c0a1a40 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient(hunting): authenticate will time out at 1134.361525s 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624bfff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f624c09bb70 legacy=0x7f624c09bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624b7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f624c0a1a40 legacy=0x7f624c139b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f62508f2640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f624c09c660 0x7f624c13d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:42988/0 (socket says 172.21.15.171:42988) 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f62508f2640 1 -- 172.21.15.171:0/886771113 learned_addr learned my addr 172.21.15.171:0/886771113 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873783749 0 0) 0x7f624c09e220 con 0x7f624c09c660 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient(hunting): my global_id is 5276 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6238003530 con 0x7f624c09c660 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 842760158 0 0) 0x7f6238003530 con 0x7f624c09c660 2024-04-25T23:58:03.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 >> v1:172.21.15.106:6793/0 conn(0x7f624c0a1a40 legacy=0x7f624c139b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 >> v1:172.21.15.171:6789/0 conn(0x7f624c09bb70 legacy=0x7f624c09bf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 monclient: found mon.noname-b 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c09d310 con 0x7f624c09c660 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: _finish_auth 0 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62440017c0 con 0x7f624c09c660 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 5 monclient: authenticate success, global_id 5276 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:03.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: dump: 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:03.644 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6244001a20 con 0x7f624c09c660 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 1 -- 172.21.15.171:0/886771113 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6244004bf0 con 0x7f624c09c660 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f624affd640 10 monclient: dump: 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.645 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 4 set_mon_vals no callback set 2024-04-25T23:58:03.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 10 monclient: shutdown 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- 172.21.15.171:0/886771113 >> v1:172.21.15.106:6790/0 conn(0x7f624c09c660 legacy=0x7f624c13d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- 172.21.15.171:0/886771113 shutdown_connections 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- 172.21.15.171:0/886771113 >> 172.21.15.171:0/886771113 conn(0x7f624c0a28a0 msgr2=0x7f624c0a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- 172.21.15.171:0/886771113 shutdown_connections 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.652+0000 7f6252355640 1 -- 172.21.15.171:0/886771113 wait complete. 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: build_initial_monmap 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: monmap: 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:03.647 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 1 Processor -- start 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 1 -- start start 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: init 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:03.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: _add_conns ranks=[8,0,7,6,3,1,2,5,4] 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient(hunting): picked mon.noname-e con 0x7f624c09bb70 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient(hunting): picked mon.noname-a con 0x7f624c09c660 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient(hunting): picked mon.noname-i con 0x7f624c0a1a40 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c134100 con 0x7f624c09c660 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c09fbe0 con 0x7f624c0a1a40 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f624c09dd30 con 0x7f624c09bb70 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient(hunting): authenticate will time out at 1134.365432s 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f62508f2640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f624c0a1a40 legacy=0x7f624c1d2790 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f624bfff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f624c09bb70 legacy=0x7f624c1339f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f624b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f624c09c660 0x7f624c1cf060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42444/0 (socket says 172.21.15.171:42444) 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f624b7fe640 1 -- 172.21.15.171:0/3856897590 learned_addr learned my addr 172.21.15.171:0/3856897590 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70450838 0 0) 0x7f624c134100 con 0x7f624c09c660 2024-04-25T23:58:03.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:58:03.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:03.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:03.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): my global_id is 5274 2024-04-25T23:58:03.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f622c003530 con 0x7f624c09c660 2024-04-25T23:58:03.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2000717537 0 0) 0x7f622c003530 con 0x7f624c09c660 2024-04-25T23:58:03.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f624c134100 con 0x7f624c09c660 2024-04-25T23:58:03.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f623c0046b0 con 0x7f624c09c660 2024-04-25T23:58:03.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:03.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:03.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): dump: 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:03.653 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 957265589 0 0) 0x7f624c134100 con 0x7f624c09c660 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 >> v1:172.21.15.106:6793/0 conn(0x7f624c09bb70 legacy=0x7f624c1339f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 >> v1:172.21.15.171:6792/0 conn(0x7f624c0a1a40 legacy=0x7f624c1d2790 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 monclient: found mon.a 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f624c13bb90 con 0x7f624c09c660 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: _finish_auth 0 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:58:03.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 5 monclient: authenticate success, global_id 5274 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: _renew_subs 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f624c13dba0 con 0x7f624c09c660 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: _renew_subs 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f624c1c9ef0 con 0x7f624c09c660 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f623c004910 con 0x7f624c09c660 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f623c004e00 con 0x7f624c09c660 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6249ffb640 4 set_mon_vals no callback set 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.656+0000 7f6248ff9640 10 monclient: dump: 2024-04-25T23:58:03.655 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:03.656 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.660+0000 7f6252355640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.660+0000 7f6252355640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.660+0000 7f6252355640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.660+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6230005090 con 0x7f624c09c660 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.660+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f623c005020 con 0x7f624c09c660 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.660+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(65..65 src has 1..65) ==== 4524+0+0 (unknown 1613628481 0 0) 0x7f623c044bc0 con 0x7f624c09c660 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.660+0000 7f624bfff640 10 monclient: get_auth_request con 0x7f622c037830 auth_method 0 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.672+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f623c015a90 con 0x7f624c09c660 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.672+0000 7f6248ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:03.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.672+0000 7f6248ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:03.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.832+0000 7f6252355640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:58:03.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.832+0000 7f6252355640 10 monclient: _send_command 2 [{"prefix": "osd create"}] 2024-04-25T23:58:03.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.832+0000 7f6252355640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:03.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:03.832+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f6230005380 con 0x7f624c09c660 2024-04-25T23:58:04.507 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:04.520+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd create"}]=0 v66) ==== 58+0+2 (unknown 2230295283 0 3065575683) 0x7f623c015390 con 0x7f624c09c660 2024-04-25T23:58:04.507 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:04.520+0000 7f6248ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create"}] 2024-04-25T23:58:04.507 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:04.520+0000 7f6248ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:04.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:04.636+0000 7f6252355640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:58:04.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:04.636+0000 7f6252355640 10 monclient: _send_command 3 [{"prefix": "osd create"}] 2024-04-25T23:58:04.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:04.636+0000 7f6252355640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:04.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:04.636+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f6230005ac0 con 0x7f624c09c660 2024-04-25T23:58:05.512 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.528+0000 7f6248ff9640 1 -- 172.21.15.171:0/3856897590 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd create"}]=0 v67) ==== 58+0+2 (unknown 832193543 0 2769969524) 0x7f623c0196e0 con 0x7f624c09c660 2024-04-25T23:58:05.512 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.528+0000 7f6248ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create"}] 2024-04-25T23:58:05.512 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.528+0000 7f6248ff9640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 >> v1:172.21.15.171:6812/722422047 conn(0x7f622c037830 legacy=0x7f622c039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 10 monclient: shutdown 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 >> v1:172.21.15.106:6789/0 conn(0x7f624c09c660 legacy=0x7f624c1cf060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 shutdown_connections 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 >> 172.21.15.171:0/3856897590 conn(0x7f624c0a28a0 msgr2=0x7f624c0a54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 shutdown_connections 2024-04-25T23:58:05.515 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.532+0000 7f6252355640 1 -- 172.21.15.171:0/3856897590 wait complete. 2024-04-25T23:58:05.536 INFO:tasks.workunit.client.0.smithi171.stderr:+ o2=9 2024-04-25T23:58:05.537 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add 7 1 host=host1 root=foo 2024-04-25T23:58:05.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 10 monclient: get_monmap_and_config 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 10 monclient: build_initial_monmap 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 10 monclient: monmap: 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:05.681092+0000 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:05.681092+0000 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:05.662 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:05.663 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:05.663 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:05.663 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:05.663 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:05.663 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 1 Processor -- start 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 1 -- start start 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 10 monclient: init 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 10 monclient: _add_conns ranks=[0,6,5,2,4,1,8,3,7] 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.676+0000 7fe4c0a14640 10 monclient(hunting): picked mon.noname-a con 0x7fe4bc135a00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): picked mon.noname-d con 0x7fe4bc0a1790 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): picked mon.noname-h con 0x7fe4bc13c130 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc0a1d80 con 0x7fe4bc135a00 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc072f70 con 0x7fe4bc13c130 2024-04-25T23:58:05.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc072640 con 0x7fe4bc0a1790 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): authenticate will time out at 1136.388075s 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4bad9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe4bc13c130 0x7fe4bc13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42986/0 (socket says 172.21.15.171:42986) 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4bad9d640 1 -- 172.21.15.171:0/493176312 learned_addr learned my addr 172.21.15.171:0/493176312 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939701429 0 0) 0x7fe4bc072f70 con 0x7fe4bc13c130 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient(hunting): my global_id is 5252 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4a4003530 con 0x7fe4bc13c130 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1862011313 0 0) 0x7fe4a4003530 con 0x7fe4bc13c130 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 >> v1:172.21.15.106:6792/0 conn(0x7fe4bc0a1790 legacy=0x7fe4bc13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 >> v1:172.21.15.106:6789/0 conn(0x7fe4bc135a00 legacy=0x7fe4bc135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:58:05.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 monclient: found mon.noname-h 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc072920 con 0x7fe4bc13c130 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: _finish_auth 0 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe4b4001b40 con 0x7fe4bc13c130 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 5 monclient: authenticate success, global_id 5252 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:05.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: dump: 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:05.670 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4b4001e70 con 0x7fe4bc13c130 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 4 set_mon_vals no callback set 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 1 -- 172.21.15.171:0/493176312 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe4b4004f70 con 0x7fe4bc13c130 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b959a640 10 monclient: dump: 2024-04-25T23:58:05.671 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:05.672 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient: shutdown 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- 172.21.15.171:0/493176312 >> v1:172.21.15.171:6791/0 conn(0x7fe4bc13c130 legacy=0x7fe4bc13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- 172.21.15.171:0/493176312 shutdown_connections 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- 172.21.15.171:0/493176312 >> 172.21.15.171:0/493176312 conn(0x7fe4bc0a2690 msgr2=0x7fe4bc0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- 172.21.15.171:0/493176312 shutdown_connections 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- 172.21.15.171:0/493176312 wait complete. 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient: build_initial_monmap 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient: monmap: 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:05.673 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 Processor -- start 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- start start 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient: init 2024-04-25T23:58:05.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient: _add_conns ranks=[8,4,6,0,7,3,5,1,2] 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): picked mon.noname-e con 0x7fe4bc0a1790 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): picked mon.noname-c con 0x7fe4bc135a00 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): picked mon.noname-d con 0x7fe4bc13c130 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc136ea0 con 0x7fe4bc135a00 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc09fc40 con 0x7fe4bc13c130 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4bc134cb0 con 0x7fe4bc0a1790 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4c0a14640 10 monclient(hunting): authenticate will time out at 1136.391310s 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4b9d9b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fe4bc135a00 legacy=0x7fe4bc131ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:05.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.680+0000 7fe4ba59c640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fe4bc0a1790 legacy=0x7fe4bc1315d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:05.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4bad9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe4bc13c130 0x7fe4bc1d2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:35472/0 (socket says 172.21.15.171:35472) 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4bad9d640 1 -- 172.21.15.171:0/3423274262 learned_addr learned my addr 172.21.15.171:0/3423274262 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905204055 0 0) 0x7fe4bc09fc40 con 0x7fe4bc13c130 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4aaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4aaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4aaffd640 10 monclient(hunting): my global_id is 5316 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.684+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe49c003530 con 0x7fe4bc13c130 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1096441849 0 0) 0x7fe49c003530 con 0x7fe4bc13c130 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4bc09fc40 con 0x7fe4bc13c130 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe4b4001b00 con 0x7fe4bc13c130 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:05.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient(hunting): dump: 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:05.679 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 994199398 0 0) 0x7fe4bc09fc40 con 0x7fe4bc13c130 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 >> v1:172.21.15.106:6793/0 conn(0x7fe4bc0a1790 legacy=0x7fe4bc1315d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 >> v1:172.21.15.106:6791/0 conn(0x7fe4bc135a00 legacy=0x7fe4bc131ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 monclient: found mon.d 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4bc09f6f0 con 0x7fe4bc13c130 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:05.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 5 monclient: authenticate success, global_id 5316 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 10 monclient: _renew_subs 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4bc1367a0 con 0x7fe4bc13c130 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 10 monclient: _renew_subs 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4bc133830 con 0x7fe4bc13c130 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4b4004fd0 con 0x7fe4bc13c130 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe4b40054d0 con 0x7fe4bc13c130 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4b8d99640 4 set_mon_vals no callback set 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 10 monclient: dump: 2024-04-25T23:58:05.681 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:05.682 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:05.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:05.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:05.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:05.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4a0005090 con 0x7fe4bc13c130 2024-04-25T23:58:05.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe4b4010270 con 0x7fe4bc13c130 2024-04-25T23:58:05.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(67..67 src has 1..67) ==== 4754+0+0 (unknown 3263217127 0 0) 0x7fe4b4044d30 con 0x7fe4bc13c130 2024-04-25T23:58:05.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.688+0000 7fe4ba59c640 10 monclient: get_auth_request con 0x7fe49c037880 auth_method 0 2024-04-25T23:58:05.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.704+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe4b4015bd0 con 0x7fe4bc13c130 2024-04-25T23:58:05.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.704+0000 7fe4aaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:05.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.704+0000 7fe4aaffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:05.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.868+0000 7fe4c0a14640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:05.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.868+0000 7fe4c0a14640 10 monclient: _send_command 2 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:05.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.868+0000 7fe4c0a14640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:05.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:05.868+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]} v 0) -- 0x7fe4a0005380 con 0x7fe4bc13c130 2024-04-25T23:58:06.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.548+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}]=0 add item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo} to crush map v68) ==== 203+0+0 (unknown 35005042 0 0) 0x7fe4b40154d0 con 0x7fe4bc13c130 2024-04-25T23:58:06.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.552+0000 7fe4aaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:06.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.552+0000 7fe4aaffd640 10 monclient: _finish_command 2 = system:0 add item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo} to crush map 2024-04-25T23:58:06.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.648+0000 7fe4c0a14640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:06.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.648+0000 7fe4c0a14640 10 monclient: _send_command 3 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:06.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.648+0000 7fe4c0a14640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:06.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.648+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]} v 0) -- 0x7fe4a0005be0 con 0x7fe4bc13c130 2024-04-25T23:58:06.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4aaffd640 1 -- 172.21.15.171:0/3423274262 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}]=0 set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change v68) ==== 201+0+0 (unknown 890737415 0 0) 0x7fe4b401e020 con 0x7fe4bc13c130 2024-04-25T23:58:06.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4aaffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:06.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4aaffd640 10 monclient: _finish_command 3 = system:0 set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change 2024-04-25T23:58:06.637 INFO:tasks.workunit.client.0.smithi171.stderr:set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 >> v1:172.21.15.171:6812/722422047 conn(0x7fe49c037880 legacy=0x7fe49c039d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 10 monclient: shutdown 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 >> v1:172.21.15.106:6792/0 conn(0x7fe4bc13c130 legacy=0x7fe4bc1d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 shutdown_connections 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 >> 172.21.15.171:0/3423274262 conn(0x7fe4bc0a2690 msgr2=0x7fe4bc0a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 shutdown_connections 2024-04-25T23:58:06.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.652+0000 7fe4c0a14640 1 -- 172.21.15.171:0/3423274262 wait complete. 2024-04-25T23:58:06.653 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add 7 1 host=host1 root=foo 2024-04-25T23:58:06.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient: get_monmap_and_config 2024-04-25T23:58:06.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient: build_initial_monmap 2024-04-25T23:58:06.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient: monmap: 2024-04-25T23:58:06.776 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:06.795996+0000 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:06.795996+0000 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:06.777 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:06.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 1 Processor -- start 2024-04-25T23:58:06.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 1 -- start start 2024-04-25T23:58:06.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient: init 2024-04-25T23:58:06.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:06.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient: _add_conns ranks=[6,8,0,7,1,4,3,2,5] 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient(hunting): picked mon.noname-d con 0x7fb208137960 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient(hunting): picked mon.noname-e con 0x7fb2080a4220 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient(hunting): picked mon.noname-a con 0x7fb208138450 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080a48c0 con 0x7fb208138450 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080a2f70 con 0x7fb208137960 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080a0d00 con 0x7fb2080a4220 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb21025f640 10 monclient(hunting): authenticate will time out at 1137.502855s 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20d7fa640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb2080a4220 legacy=0x7fb20813ce90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20dffb640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb208137960 0x7fb208137d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:35488/0 (socket says 172.21.15.171:35488) 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20e7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb208138450 0x7fb2081405c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42468/0 (socket says 172.21.15.171:42468) 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20dffb640 1 -- 172.21.15.171:0/1592212794 learned_addr learned my addr 172.21.15.171:0/1592212794 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880504538 0 0) 0x7fb2080a2f70 con 0x7fb208137960 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:58:06.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): my global_id is 5325 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1f4003530 con 0x7fb208137960 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3345632072 0 0) 0x7fb2080a48c0 con 0x7fb208138450 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 10 monclient(hunting): my global_id is 5283 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.792+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2080a2f70 con 0x7fb208138450 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3084835577 0 0) 0x7fb1f4003530 con 0x7fb208137960 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 >> v1:172.21.15.106:6793/0 conn(0x7fb2080a4220 legacy=0x7fb20813ce90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 >> v1:172.21.15.106:6789/0 conn(0x7fb208138450 legacy=0x7fb2081405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: _finish_hunting 0 2024-04-25T23:58:06.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 monclient: found mon.noname-d 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080a29b0 con 0x7fb208137960 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: _finish_auth 0 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: _check_auth_tickets 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2040016f0 con 0x7fb208137960 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 5 monclient: authenticate success, global_id 5325 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: dump: 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:06.787 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:06.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2040019a0 con 0x7fb208137960 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 4 set_mon_vals no callback set 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 1 -- 172.21.15.171:0/1592212794 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb204004bf0 con 0x7fb208137960 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20cff9640 10 monclient: dump: 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:06.789 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient: shutdown 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- 172.21.15.171:0/1592212794 >> v1:172.21.15.106:6792/0 conn(0x7fb208137960 legacy=0x7fb208137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- 172.21.15.171:0/1592212794 shutdown_connections 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- 172.21.15.171:0/1592212794 >> 172.21.15.171:0/1592212794 conn(0x7fb2080a9fc0 msgr2=0x7fb2080aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- 172.21.15.171:0/1592212794 shutdown_connections 2024-04-25T23:58:06.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- 172.21.15.171:0/1592212794 wait complete. 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient: build_initial_monmap 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient: monmap: 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:06.791 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 Processor -- start 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- start start 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient: init 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient: _add_conns ranks=[6,1,0,5,8,7,3,2,4] 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient(hunting): picked mon.noname-d con 0x7fb2080a4220 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient(hunting): picked mon.noname-f con 0x7fb208137960 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient(hunting): picked mon.noname-a con 0x7fb208138450 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb208122200 con 0x7fb208138450 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080a1f50 con 0x7fb208137960 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2080a0fa0 con 0x7fb2080a4220 2024-04-25T23:58:06.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb21025f640 10 monclient(hunting): authenticate will time out at 1137.506495s 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20d7fa640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fb208137960 legacy=0x7fb2081d1060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20e7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb208138450 0x7fb2081d4790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42482/0 (socket says 172.21.15.171:42482) 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb20e7fc640 1 -- 172.21.15.171:0/1459842507 learned_addr learned my addr 172.21.15.171:0/1459842507 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2970266419 0 0) 0x7fb2080a0fa0 con 0x7fb2080a4220 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): my global_id is 5334 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1ec003530 con 0x7fb2080a4220 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499634606 0 0) 0x7fb208122200 con 0x7fb208138450 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:06.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): my global_id is 5292 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2080a0fa0 con 0x7fb208138450 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1614247613 0 0) 0x7fb1ec003530 con 0x7fb2080a4220 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb208122200 con 0x7fb2080a4220 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb204001770 con 0x7fb2080a4220 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): dump: 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:06.794 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3679210625 0 0) 0x7fb2080a0fa0 con 0x7fb208138450 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1ec003530 con 0x7fb208138450 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb200001d40 con 0x7fb208138450 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:06.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.796+0000 7fb1fe7fc640 10 monclient(hunting): dump: 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:06.796 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 828698449 0 0) 0x7fb208122200 con 0x7fb2080a4220 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 >> v1:172.21.15.171:6789/0 conn(0x7fb208137960 legacy=0x7fb2081d1060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 >> v1:172.21.15.106:6789/0 conn(0x7fb208138450 legacy=0x7fb2081d4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 monclient: found mon.d 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2080a0450 con 0x7fb2080a4220 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 5 monclient: authenticate success, global_id 5334 2024-04-25T23:58:06.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 10 monclient: _renew_subs 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb208121f20 con 0x7fb2080a4220 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 10 monclient: _renew_subs 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb208135180 con 0x7fb2080a4220 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb204004c60 con 0x7fb2080a4220 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fffff640 4 set_mon_vals no callback set 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2040019a0 con 0x7fb2080a4220 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 10 monclient: dump: 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:06.798 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:06.799 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1f0005090 con 0x7fb2080a4220 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb20400fe40 con 0x7fb2080a4220 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(68..68 src has 1..68) ==== 5036+0+0 (unknown 4137277587 0 0) 0x7fb204044950 con 0x7fb2080a4220 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.800+0000 7fb20d7fa640 10 monclient: get_auth_request con 0x7fb1ec037e40 auth_method 0 2024-04-25T23:58:06.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.812+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb2040157c0 con 0x7fb2080a4220 2024-04-25T23:58:06.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.812+0000 7fb1fe7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:06.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.812+0000 7fb1fe7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:06.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.964+0000 7fb21025f640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:06.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.964+0000 7fb21025f640 10 monclient: _send_command 2 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:06.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.964+0000 7fb21025f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:06.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.964+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]} v 0) -- 0x7fb1f0005380 con 0x7fb2080a4220 2024-04-25T23:58:06.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.968+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}]=0 set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change v68) ==== 201+0+0 (unknown 890737415 0 0) 0x7fb2040150c0 con 0x7fb2080a4220 2024-04-25T23:58:06.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.968+0000 7fb1fe7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:06.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:06.968+0000 7fb1fe7fc640 10 monclient: _finish_command 2 = system:0 set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change 2024-04-25T23:58:07.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.056+0000 7fb21025f640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:07.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.056+0000 7fb21025f640 10 monclient: _send_command 3 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:07.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.056+0000 7fb21025f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:07.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.056+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]} v 0) -- 0x7fb1f0005ac0 con 0x7fb2080a4220 2024-04-25T23:58:07.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb1fe7fc640 1 -- 172.21.15.171:0/1459842507 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}]=0 set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change v68) ==== 201+0+0 (unknown 890737415 0 0) 0x7fb20401dc70 con 0x7fb2080a4220 2024-04-25T23:58:07.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb1fe7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add", "id": 7, "weight": 1.0, "args": ["host=host1", "root=foo"]}] 2024-04-25T23:58:07.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb1fe7fc640 10 monclient: _finish_command 3 = system:0 set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change 2024-04-25T23:58:07.044 INFO:tasks.workunit.client.0.smithi171.stderr:set item id 7 name 'osd.7' weight 1 at location {host=host1,root=foo}: no change 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 >> v1:172.21.15.171:6812/722422047 conn(0x7fb1ec037e40 legacy=0x7fb1ec03a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 10 monclient: shutdown 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 >> v1:172.21.15.106:6792/0 conn(0x7fb2080a4220 legacy=0x7fb208134a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 shutdown_connections 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 >> 172.21.15.171:0/1459842507 conn(0x7fb2080a9fc0 msgr2=0x7fb208135990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 shutdown_connections 2024-04-25T23:58:07.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.060+0000 7fb21025f640 1 -- 172.21.15.171:0/1459842507 wait complete. 2024-04-25T23:58:07.059 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add 9 1 host=host2 root=foo 2024-04-25T23:58:07.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient: get_monmap_and_config 2024-04-25T23:58:07.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient: build_initial_monmap 2024-04-25T23:58:07.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient: monmap: 2024-04-25T23:58:07.180 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:07.180 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.180 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:07.199482+0000 2024-04-25T23:58:07.180 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:07.199482+0000 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:07.181 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 1 Processor -- start 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 1 -- start start 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient: init 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient: _add_conns ranks=[6,0,7,8,3,2,4,5,1] 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient(hunting): picked mon.noname-d con 0x7f1c500a3200 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient(hunting): picked mon.noname-a con 0x7f1c500a01c0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient(hunting): picked mon.noname-i con 0x7f1c5013a2f0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5009b090 con 0x7f1c500a01c0 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c501340d0 con 0x7f1c500a3200 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5009b4d0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:07.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c5852b640 10 monclient(hunting): authenticate will time out at 1137.906483s 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c56ac8640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f1c5013a2f0 legacy=0x7f1c5013c6e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c55ac6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1c500a01c0 0x7f1c50138bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42492/0 (socket says 172.21.15.171:42492) 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c562c7640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f1c500a3200 0x7f1c5009fab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:35496/0 (socket says 172.21.15.171:35496) 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c55ac6640 1 -- 172.21.15.171:0/2470482595 learned_addr learned my addr 172.21.15.171:0/2470482595 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620867015 0 0) 0x7f1c501340d0 con 0x7f1c500a3200 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): my global_id is 5343 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c38003530 con 0x7f1c500a3200 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272271939 0 0) 0x7f1c5009b090 con 0x7f1c500a01c0 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 10 monclient(hunting): my global_id is 5301 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.196+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c501340d0 con 0x7f1c500a01c0 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 573301844 0 0) 0x7f1c501340d0 con 0x7f1c500a01c0 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 >> v1:172.21.15.171:6792/0 conn(0x7f1c5013a2f0 legacy=0x7f1c5013c6e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 >> v1:172.21.15.106:6792/0 conn(0x7f1c500a3200 legacy=0x7f1c5009fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: _finish_hunting 0 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 monclient: found mon.noname-a 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c5009c780 con 0x7f1c500a01c0 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: _finish_auth 0 2024-04-25T23:58:07.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: _check_auth_tickets 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c440016d0 con 0x7f1c500a01c0 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: dump: 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.188 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 5 monclient: authenticate success, global_id 5301 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c440019c0 con 0x7f1c500a01c0 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 1 -- 172.21.15.171:0/2470482595 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c44004bf0 con 0x7f1c500a01c0 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:07.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c552c5640 10 monclient: dump: 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.190 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 4 set_mon_vals no callback set 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: shutdown 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- 172.21.15.171:0/2470482595 >> v1:172.21.15.106:6789/0 conn(0x7f1c500a01c0 legacy=0x7f1c50138bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- 172.21.15.171:0/2470482595 shutdown_connections 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- 172.21.15.171:0/2470482595 >> 172.21.15.171:0/2470482595 conn(0x7f1c500a6610 msgr2=0x7f1c500a2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- 172.21.15.171:0/2470482595 shutdown_connections 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- 172.21.15.171:0/2470482595 wait complete. 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: build_initial_monmap 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: monmap: 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:07.192 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 Processor -- start 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- start start 2024-04-25T23:58:07.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: init 2024-04-25T23:58:07.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:07.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: _add_conns ranks=[4,2,3,8,5,0,7,6,1] 2024-04-25T23:58:07.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient(hunting): picked mon.noname-c con 0x7f1c500a01c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:07.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient(hunting): picked mon.noname-b con 0x7f1c500a3200 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:07.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient(hunting): picked mon.noname-g con 0x7f1c5013a2f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:07.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5012eff0 con 0x7f1c500a3200 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5012ec30 con 0x7f1c5013a2f0 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c5009f0e0 con 0x7f1c500a01c0 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient(hunting): authenticate will time out at 1137.910765s 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c562c7640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f1c500a01c0 legacy=0x7f1c50132de0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c56ac8640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f1c5013a2f0 0x7f1c501d4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51570/0 (socket says 172.21.15.171:51570) 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c56ac8640 1 -- 172.21.15.171:0/1419456938 learned_addr learned my addr 172.21.15.171:0/1419456938 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 905540880 0 0) 0x7f1c5012ec30 con 0x7f1c5013a2f0 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): my global_id is 5421 2024-04-25T23:58:07.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c3c003530 con 0x7f1c5013a2f0 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 178169474 0 0) 0x7f1c3c003530 con 0x7f1c5013a2f0 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c5012ec30 con 0x7f1c5013a2f0 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c400041b0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): dump: 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.199 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 783764683 0 0) 0x7f1c5012ec30 con 0x7f1c5013a2f0 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 >> v1:172.21.15.106:6791/0 conn(0x7f1c500a01c0 legacy=0x7f1c50132de0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 >> v1:172.21.15.106:6790/0 conn(0x7f1c500a3200 legacy=0x7f1c501d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 monclient: found mon.g 2024-04-25T23:58:07.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c50139040 con 0x7f1c5013a2f0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: _finish_auth 0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 5 monclient: authenticate success, global_id 5421 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: _renew_subs 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c501cc550 con 0x7f1c5013a2f0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: _renew_subs 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c501336c0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c400044e0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:07.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4ffff640 4 set_mon_vals no callback set 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c40004a50 con 0x7f1c5013a2f0 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.200+0000 7f1c4effd640 10 monclient: dump: 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.202 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.204+0000 7f1c5852b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.204+0000 7f1c5852b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.204+0000 7f1c5852b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.204+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c30005090 con 0x7f1c5013a2f0 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.204+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1c40004cb0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.204+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(68..68 src has 1..68) ==== 5036+0+0 (unknown 4137277587 0 0) 0x7f1c40044ac0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.204+0000 7f1c562c7640 10 monclient: get_auth_request con 0x7f1c3c037780 auth_method 0 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.208+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1c40015830 con 0x7f1c5013a2f0 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.208+0000 7f1c4effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:07.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.208+0000 7f1c4effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:07.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.372+0000 7f1c5852b640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.372+0000 7f1c5852b640 10 monclient: _send_command 2 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.372+0000 7f1c5852b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:07.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.372+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]} v 0) -- 0x7f1c30005380 con 0x7f1c5013a2f0 2024-04-25T23:58:07.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.560+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}]=0 add item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo} to crush map v69) ==== 203+0+0 (unknown 2004568183 0 0) 0x7f1c40015130 con 0x7f1c5013a2f0 2024-04-25T23:58:07.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.560+0000 7f1c4effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.560+0000 7f1c4effd640 10 monclient: _finish_command 2 = system:0 add item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo} to crush map 2024-04-25T23:58:07.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.660+0000 7f1c5852b640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.660+0000 7f1c5852b640 10 monclient: _send_command 3 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.660+0000 7f1c5852b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:07.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.660+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]} v 0) -- 0x7f1c30005be0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c4effd640 1 -- 172.21.15.171:0/1419456938 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}]=0 set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change v69) ==== 201+0+0 (unknown 3554574866 0 0) 0x7f1c4001dce0 con 0x7f1c5013a2f0 2024-04-25T23:58:07.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c4effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c4effd640 10 monclient: _finish_command 3 = system:0 set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change 2024-04-25T23:58:07.648 INFO:tasks.workunit.client.0.smithi171.stderr:set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 >> v1:172.21.15.171:6812/722422047 conn(0x7f1c3c037780 legacy=0x7f1c3c039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 10 monclient: shutdown 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 >> v1:172.21.15.171:6790/0 conn(0x7f1c5013a2f0 legacy=0x7f1c501d4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 shutdown_connections 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 >> 172.21.15.171:0/1419456938 conn(0x7f1c500a6610 msgr2=0x7f1c5013e1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 shutdown_connections 2024-04-25T23:58:07.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.664+0000 7f1c5852b640 1 -- 172.21.15.171:0/1419456938 wait complete. 2024-04-25T23:58:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add 9 1 host=host2 root=foo 2024-04-25T23:58:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient: get_monmap_and_config 2024-04-25T23:58:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient: build_initial_monmap 2024-04-25T23:58:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient: monmap: 2024-04-25T23:58:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:07.807702+0000 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:07.807702+0000 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:07.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 1 Processor -- start 2024-04-25T23:58:07.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 1 -- start start 2024-04-25T23:58:07.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient: init 2024-04-25T23:58:07.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:07.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient: _add_conns ranks=[6,5,3,0,1,2,8,7,4] 2024-04-25T23:58:07.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient(hunting): picked mon.noname-d con 0x7f0598135a00 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient(hunting): picked mon.noname-h con 0x7f05980a1790 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient(hunting): picked mon.noname-g con 0x7f059813c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05980a1d80 con 0x7f059813c130 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0598072f70 con 0x7f05980a1790 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0598072640 con 0x7f0598135a00 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient(hunting): authenticate will time out at 1138.514649s 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f0596d9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f059813c130 0x7f059813e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51578/0 (socket says 172.21.15.171:51578) 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f0595d9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f05980a1790 0x7f059813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42990/0 (socket says 172.21.15.171:42990) 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f0596d9d640 1 -- 172.21.15.171:0/3741816761 learned_addr learned my addr 172.21.15.171:0/3741816761 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1254464132 0 0) 0x7f05980a1d80 con 0x7f059813c130 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): my global_id is 5430 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0580003530 con 0x7f059813c130 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578409862 0 0) 0x7f0598072f70 con 0x7f05980a1790 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): my global_id is 5261 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05980a1d80 con 0x7f05980a1790 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4062476793 0 0) 0x7f0598072640 con 0x7f0598135a00 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient(hunting): my global_id is 5352 2024-04-25T23:58:07.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0598072f70 con 0x7f0598135a00 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3533172895 0 0) 0x7f05980a1d80 con 0x7f05980a1790 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 >> v1:172.21.15.106:6792/0 conn(0x7f0598135a00 legacy=0x7f0598135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 >> v1:172.21.15.171:6790/0 conn(0x7f059813c130 legacy=0x7f059813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 monclient: found mon.noname-h 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0598072920 con 0x7f05980a1790 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: _finish_auth 0 2024-04-25T23:58:07.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f058c0016d0 con 0x7f05980a1790 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 5 monclient: authenticate success, global_id 5261 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: dump: 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.801 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f058c0019c0 con 0x7f05980a1790 2024-04-25T23:58:07.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059cbce640 4 set_mon_vals no callback set 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 1 -- 172.21.15.171:0/3741816761 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f058c004b30 con 0x7f05980a1790 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.804+0000 7f059559a640 10 monclient: dump: 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.803 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: shutdown 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- 172.21.15.171:0/3741816761 >> v1:172.21.15.171:6791/0 conn(0x7f05980a1790 legacy=0x7f059813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- 172.21.15.171:0/3741816761 shutdown_connections 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- 172.21.15.171:0/3741816761 >> 172.21.15.171:0/3741816761 conn(0x7f05980a2690 msgr2=0x7f05980a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- 172.21.15.171:0/3741816761 shutdown_connections 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- 172.21.15.171:0/3741816761 wait complete. 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: build_initial_monmap 2024-04-25T23:58:07.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: monmap: 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:07.805 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 Processor -- start 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- start start 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: init 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: _add_conns ranks=[0,8,2,5,6,7,3,4,1] 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient(hunting): picked mon.noname-a con 0x7f05980a1790 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient(hunting): picked mon.noname-e con 0x7f0598135a00 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:07.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient(hunting): picked mon.noname-b con 0x7f059813c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f059812d100 con 0x7f05980a1790 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0598070f10 con 0x7f059813c130 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05980705a0 con 0x7f0598135a00 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient(hunting): authenticate will time out at 1138.517780s 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0595d9b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f0598135a00 legacy=0x7f059812c9f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0596d9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f059813c130 0x7f05981d4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:43000/0 (socket says 172.21.15.171:43000) 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0596d9d640 1 -- 172.21.15.171:0/133615027 learned_addr learned my addr 172.21.15.171:0/133615027 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343336102 0 0) 0x7f0598070f10 con 0x7f059813c130 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): my global_id is 5285 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0578003530 con 0x7f059813c130 2024-04-25T23:58:07.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974707009 0 0) 0x7f059812d100 con 0x7f05980a1790 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): my global_id is 5310 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0598070f10 con 0x7f05980a1790 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3801393423 0 0) 0x7f0598070f10 con 0x7f05980a1790 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f059812d100 con 0x7f05980a1790 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0588001a20 con 0x7f05980a1790 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.808 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.809 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2802425639 0 0) 0x7f0578003530 con 0x7f059813c130 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0598070f10 con 0x7f059813c130 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0590001d10 con 0x7f059813c130 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.810 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 366661372 0 0) 0x7f059812d100 con 0x7f05980a1790 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 >> v1:172.21.15.106:6793/0 conn(0x7f0598135a00 legacy=0x7f059812c9f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:07.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 >> v1:172.21.15.106:6790/0 conn(0x7f059813c130 legacy=0x7f05981d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 monclient: found mon.a 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f059809c4d0 con 0x7f05980a1790 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 5 monclient: authenticate success, global_id 5310 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: _renew_subs 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f059809c1f0 con 0x7f05980a1790 2024-04-25T23:58:07.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: _renew_subs 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0598070c60 con 0x7f05980a1790 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f05880038d0 con 0x7f05980a1790 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0588003e40 con 0x7f05980a1790 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0594d99640 4 set_mon_vals no callback set 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.808+0000 7f0586ffd640 10 monclient: dump: 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:07.813 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.812+0000 7f059cbce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.812+0000 7f059cbce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:07.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.812+0000 7f059cbce640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:07.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.812+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c005090 con 0x7f05980a1790 2024-04-25T23:58:07.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.812+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0588003fe0 con 0x7f05980a1790 2024-04-25T23:58:07.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.812+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(69..69 src has 1..69) ==== 5280+0+0 (unknown 2728161049 0 0) 0x7f0588043820 con 0x7f05980a1790 2024-04-25T23:58:07.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.812+0000 7f0595d9b640 10 monclient: get_auth_request con 0x7f0578037d10 auth_method 0 2024-04-25T23:58:07.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.824+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0588014460 con 0x7f05980a1790 2024-04-25T23:58:07.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.824+0000 7f0586ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:07.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.824+0000 7f0586ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:07.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.988+0000 7f059cbce640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.988+0000 7f059cbce640 10 monclient: _send_command 2 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.988+0000 7f059cbce640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:07.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.988+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]} v 0) -- 0x7f057c005380 con 0x7f05980a1790 2024-04-25T23:58:07.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.988+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}]=0 set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change v69) ==== 201+0+0 (unknown 3554574866 0 0) 0x7f0588013d60 con 0x7f05980a1790 2024-04-25T23:58:07.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.988+0000 7f0586ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:07.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:07.988+0000 7f0586ffd640 10 monclient: _finish_command 2 = system:0 set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change 2024-04-25T23:58:08.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.088+0000 7f059cbce640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:08.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.088+0000 7f059cbce640 10 monclient: _send_command 3 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:08.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.088+0000 7f059cbce640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:08.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.088+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]} v 0) -- 0x7f057c005ac0 con 0x7f05980a1790 2024-04-25T23:58:08.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.088+0000 7f0586ffd640 1 -- 172.21.15.171:0/133615027 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}]=0 set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change v69) ==== 201+0+0 (unknown 3554574866 0 0) 0x7f058801c910 con 0x7f05980a1790 2024-04-25T23:58:08.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.088+0000 7f0586ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add", "id": 9, "weight": 1.0, "args": ["host=host2", "root=foo"]}] 2024-04-25T23:58:08.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.088+0000 7f0586ffd640 10 monclient: _finish_command 3 = system:0 set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change 2024-04-25T23:58:08.073 INFO:tasks.workunit.client.0.smithi171.stderr:set item id 9 name 'osd.9' weight 1 at location {host=host2,root=foo}: no change 2024-04-25T23:58:08.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 >> v1:172.21.15.171:6812/722422047 conn(0x7f0578037d10 legacy=0x7f057803a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 10 monclient: shutdown 2024-04-25T23:58:08.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:08.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 >> v1:172.21.15.106:6789/0 conn(0x7f05980a1790 legacy=0x7f059812c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 shutdown_connections 2024-04-25T23:58:08.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 >> 172.21.15.171:0/133615027 conn(0x7f05980a2690 msgr2=0x7f059812f820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:08.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 shutdown_connections 2024-04-25T23:58:08.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.092+0000 7f059cbce640 1 -- 172.21.15.171:0/133615027 wait complete. 2024-04-25T23:58:08.090 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket bar root 2024-04-25T23:58:08.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.212+0000 7f8d9886b640 10 monclient: get_monmap_and_config 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.212+0000 7f8d9886b640 10 monclient: build_initial_monmap 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.212+0000 7f8d9886b640 10 monclient: monmap: 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:08.218181+0000 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:08.218181+0000 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:08.199 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:08.200 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:08.200 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:08.200 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:08.200 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 Processor -- start 2024-04-25T23:58:08.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- start start 2024-04-25T23:58:08.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient: init 2024-04-25T23:58:08.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:08.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient: _add_conns ranks=[1,0,8,2,4,5,6,7,3] 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient(hunting): picked mon.noname-f con 0x7f8d940a1530 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient(hunting): picked mon.noname-a con 0x7f8d94071c00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient(hunting): picked mon.noname-e con 0x7f8d94071730 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9406ea70 con 0x7f8d94071c00 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d940723d0 con 0x7f8d940a1530 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d94072990 con 0x7f8d94071730 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9259c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f8d940a1530 legacy=0x7f8d940a1910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient(hunting): authenticate will time out at 1138.925217s 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d92d9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8d94071730 legacy=0x7f8d9413e2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d91d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8d94071c00 0x7f8d9413ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42506/0 (socket says 172.21.15.171:42506) 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d91d9b640 1 -- 172.21.15.171:0/815369205 learned_addr learned my addr 172.21.15.171:0/815369205 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:08.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1091671295 0 0) 0x7f8d9406ea70 con 0x7f8d94071c00 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient(hunting): my global_id is 5319 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d7c003530 con 0x7f8d94071c00 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 879003905 0 0) 0x7f8d7c003530 con 0x7f8d94071c00 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 >> v1:172.21.15.106:6793/0 conn(0x7f8d94071730 legacy=0x7f8d9413e2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 >> v1:172.21.15.171:6789/0 conn(0x7f8d940a1530 legacy=0x7f8d940a1910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 monclient: found mon.noname-a 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:08.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d940a3100 con 0x7f8d94071c00 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: _finish_auth 0 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8d840017c0 con 0x7f8d94071c00 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: dump: 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.211 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 5 monclient: authenticate success, global_id 5319 2024-04-25T23:58:08.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d84001a20 con 0x7f8d94071c00 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 4 set_mon_vals no callback set 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 1 -- 172.21.15.171:0/815369205 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8d84004bf0 con 0x7f8d94071c00 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9159a640 10 monclient: dump: 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.213 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 10 monclient: shutdown 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- 172.21.15.171:0/815369205 >> v1:172.21.15.106:6789/0 conn(0x7f8d94071c00 legacy=0x7f8d9413ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- 172.21.15.171:0/815369205 shutdown_connections 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- 172.21.15.171:0/815369205 >> 172.21.15.171:0/815369205 conn(0x7f8d940a62d0 msgr2=0x7f8d940a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- 172.21.15.171:0/815369205 shutdown_connections 2024-04-25T23:58:08.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.216+0000 7f8d9886b640 1 -- 172.21.15.171:0/815369205 wait complete. 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: build_initial_monmap 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: monmap: 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:08.215 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 Processor -- start 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 -- start start 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: init 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _add_conns ranks=[1,5,4,6,0,2,8,3,7] 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient(hunting): picked mon.noname-f con 0x7f8d94071730 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient(hunting): picked mon.noname-h con 0x7f8d94071c00 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient(hunting): picked mon.noname-c con 0x7f8d940a1530 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9409fb20 con 0x7f8d94071730 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9411e160 con 0x7f8d940a1530 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9259c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f8d94071730 legacy=0x7f8d94132a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d9411ef80 con 0x7f8d94071c00 2024-04-25T23:58:08.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient(hunting): authenticate will time out at 1138.929515s 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d91d9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f8d94071c00 0x7f8d941cf150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43004/0 (socket says 172.21.15.171:43004) 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d91d9b640 1 -- 172.21.15.171:0/591183029 learned_addr learned my addr 172.21.15.171:0/591183029 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d92d9d640 1 -- 172.21.15.171:0/591183029 >> v1:172.21.15.106:6791/0 conn(0x7f8d940a1530 legacy=0x7f8d941d2880 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364304023 0 0) 0x7f8d9411ef80 con 0x7f8d94071c00 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): my global_id is 5270 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d74003530 con 0x7f8d94071c00 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3591878342 0 0) 0x7f8d74003530 con 0x7f8d94071c00 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8d9411ef80 con 0x7f8d94071c00 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8d84004b30 con 0x7f8d94071c00 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:08.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.218 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1248462369 0 0) 0x7f8d9411ef80 con 0x7f8d94071c00 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 >> v1:172.21.15.106:6791/0 conn(0x7f8d940a1530 legacy=0x7f8d941d2880 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 >> v1:172.21.15.171:6789/0 conn(0x7f8d94071730 legacy=0x7f8d94132a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 monclient: found mon.h 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d94120450 con 0x7f8d94071c00 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 5 monclient: authenticate success, global_id 5270 2024-04-25T23:58:08.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _renew_subs 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8d9411fbb0 con 0x7f8d94071c00 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _renew_subs 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f8d941331a0 con 0x7f8d94071c00 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8d84001a20 con 0x7f8d94071c00 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8d84005240 con 0x7f8d94071c00 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d90d99640 4 set_mon_vals no callback set 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 10 monclient: dump: 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.220 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d78005090 con 0x7f8d94071c00 2024-04-25T23:58:08.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8d8400ffe0 con 0x7f8d94071c00 2024-04-25T23:58:08.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(69..69 src has 1..69) ==== 5280+0+0 (unknown 2728161049 0 0) 0x7f8d84044d70 con 0x7f8d94071c00 2024-04-25T23:58:08.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.220+0000 7f8d9259c640 10 monclient: get_auth_request con 0x7f8d740377e0 auth_method 0 2024-04-25T23:58:08.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.224+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8d84015a10 con 0x7f8d94071c00 2024-04-25T23:58:08.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.224+0000 7f8d82ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:08.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.224+0000 7f8d82ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:08.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.380+0000 7f8d9886b640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.380+0000 7f8d9886b640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.384+0000 7f8d9886b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.384+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "bar", "type": "root"} v 0) -- 0x7f8d78005b90 con 0x7f8d94071c00 2024-04-25T23:58:08.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.584+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}]=0 added bucket bar type root to crush map v70) ==== 138+0+0 (unknown 767277127 0 0) 0x7f8d84015310 con 0x7f8d94071c00 2024-04-25T23:58:08.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.584+0000 7f8d82ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.584+0000 7f8d82ffd640 10 monclient: _finish_command 2 = system:0 added bucket bar type root to crush map 2024-04-25T23:58:08.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.680+0000 7f8d9886b640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.680+0000 7f8d9886b640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.680+0000 7f8d9886b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.680+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "bar", "type": "root"} v 0) -- 0x7f8d780010a0 con 0x7f8d94071c00 2024-04-25T23:58:08.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.684+0000 7f8d82ffd640 1 -- 172.21.15.171:0/591183029 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}]=0 bucket 'bar' already exists v70) ==== 126+0+0 (unknown 1038733393 0 0) 0x7f8d8401de60 con 0x7f8d94071c00 2024-04-25T23:58:08.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.684+0000 7f8d82ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.684+0000 7f8d82ffd640 10 monclient: _finish_command 3 = system:0 bucket 'bar' already exists 2024-04-25T23:58:08.669 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'bar' already exists 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.684+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 >> v1:172.21.15.171:6812/722422047 conn(0x7f8d740377e0 legacy=0x7f8d74039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.684+0000 7f8d9886b640 10 monclient: shutdown 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.684+0000 7f8d9886b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.684+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 >> v1:172.21.15.171:6791/0 conn(0x7f8d94071c00 legacy=0x7f8d941cf150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.688+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 shutdown_connections 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.688+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 >> 172.21.15.171:0/591183029 conn(0x7f8d940a62d0 msgr2=0x7f8d940a42d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.688+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 shutdown_connections 2024-04-25T23:58:08.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.688+0000 7f8d9886b640 1 -- 172.21.15.171:0/591183029 wait complete. 2024-04-25T23:58:08.685 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket bar root 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.816+0000 7f29b6de8640 10 monclient: get_monmap_and_config 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.816+0000 7f29b6de8640 10 monclient: build_initial_monmap 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: monmap: 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:08.822528+0000 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:08.822528+0000 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:08.803 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:08.804 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 Processor -- start 2024-04-25T23:58:08.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- start start 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: init 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: _add_conns ranks=[2,0,5,8,3,6,7,4,1] 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient(hunting): picked mon.noname-b con 0x7f29b00a1530 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient(hunting): picked mon.noname-a con 0x7f29b0071c00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient(hunting): picked mon.noname-h con 0x7f29b0071730 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b006ea70 con 0x7f29b0071c00 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b00723d0 con 0x7f29b00a1530 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b0072990 con 0x7f29b0071730 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient(hunting): authenticate will time out at 1139.529470s 2024-04-25T23:58:08.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b5385640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f29b0071730 0x7f29b013e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43020/0 (socket says 172.21.15.171:43020) 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b5385640 1 -- 172.21.15.171:0/2375732352 learned_addr learned my addr 172.21.15.171:0/2375732352 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24492439 0 0) 0x7f29b0072990 con 0x7f29b0071730 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient(hunting): my global_id is 5279 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2998003530 con 0x7f29b0071730 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 838851148 0 0) 0x7f2998003530 con 0x7f29b0071730 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 >> v1:172.21.15.106:6790/0 conn(0x7f29b00a1530 legacy=0x7f29b00a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 >> v1:172.21.15.106:6789/0 conn(0x7f29b0071c00 legacy=0x7f29b013ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 monclient: found mon.noname-h 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b00a3100 con 0x7f29b0071730 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f29a8001b40 con 0x7f29b0071730 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: dump: 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.813 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 5 monclient: authenticate success, global_id 5279 2024-04-25T23:58:08.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29a8001ea0 con 0x7f29b0071730 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 1 -- 172.21.15.171:0/2375732352 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f29a80020d0 con 0x7f29b0071730 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 4 set_mon_vals no callback set 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29af7fe640 10 monclient: dump: 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.815 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.816 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.816 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.816 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.816 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.816 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.816 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.816 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.817 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.817 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.817 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.817 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.817 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: shutdown 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- 172.21.15.171:0/2375732352 >> v1:172.21.15.171:6791/0 conn(0x7f29b0071730 legacy=0x7f29b013e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- 172.21.15.171:0/2375732352 shutdown_connections 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- 172.21.15.171:0/2375732352 >> 172.21.15.171:0/2375732352 conn(0x7f29b00a62d0 msgr2=0x7f29b00a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- 172.21.15.171:0/2375732352 shutdown_connections 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 -- 172.21.15.171:0/2375732352 wait complete. 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: build_initial_monmap 2024-04-25T23:58:08.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 10 monclient: monmap: 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:08.819 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.820+0000 7f29b6de8640 1 Processor -- start 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 1 -- start start 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: init 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _add_conns ranks=[4,5,7,1,8,0,3,2,6] 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient(hunting): picked mon.noname-c con 0x7f29b0071730 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient(hunting): picked mon.noname-h con 0x7f29b0071c00 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient(hunting): picked mon.noname-i con 0x7f29b00a1530 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b0121e80 con 0x7f29b0071730 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b0122160 con 0x7f29b0071c00 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29b0121450 con 0x7f29b00a1530 2024-04-25T23:58:08.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient(hunting): authenticate will time out at 1139.532541s 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b5385640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f29b00a1530 legacy=0x7f29b01d4bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29affff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f29b0071c00 0x7f29b006fe90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:43034/0 (socket says 172.21.15.171:43034) 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29affff640 1 -- 172.21.15.171:0/2035909545 learned_addr learned my addr 172.21.15.171:0/2035909545 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2754487429 0 0) 0x7f29b0122160 con 0x7f29b0071c00 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): my global_id is 5288 2024-04-25T23:58:08.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f299c003530 con 0x7f29b0071c00 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b4b84640 1 -- 172.21.15.171:0/2035909545 >> v1:172.21.15.106:6791/0 conn(0x7f29b0071730 legacy=0x7f29b006f780 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3506072866 0 0) 0x7f299c003530 con 0x7f29b0071c00 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29b0122160 con 0x7f29b0071c00 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f29a4001a60 con 0x7f29b0071c00 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): dump: 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.822 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3253268128 0 0) 0x7f29b0122160 con 0x7f29b0071c00 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 >> v1:172.21.15.171:6792/0 conn(0x7f29b00a1530 legacy=0x7f29b01d4bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 >> v1:172.21.15.106:6791/0 conn(0x7f29b0071730 legacy=0x7f29b006f780 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:08.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 monclient: found mon.h 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29b01209c0 con 0x7f29b0071c00 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 5 monclient: authenticate success, global_id 5288 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _renew_subs 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f29b01331c0 con 0x7f29b0071c00 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _renew_subs 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f29b0070770 con 0x7f29b0071c00 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29a40038d0 con 0x7f29b0071c00 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f29a4003e40 con 0x7f29b0071c00 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29aeffd640 4 set_mon_vals no callback set 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:08.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 10 monclient: dump: 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:08.826 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f29a4003fe0 con 0x7f29b0071c00 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2990005090 con 0x7f29b0071c00 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(70..70 src has 1..70) ==== 5307+0+0 (unknown 3338873152 0 0) 0x7f29a4044be0 con 0x7f29b0071c00 2024-04-25T23:58:08.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.824+0000 7f29b4b84640 10 monclient: get_auth_request con 0x7f299c0377e0 auth_method 0 2024-04-25T23:58:08.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.828+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f29a4015840 con 0x7f29b0071c00 2024-04-25T23:58:08.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.828+0000 7f29ad7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:08.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.828+0000 7f29ad7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:08.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.980+0000 7f29b6de8640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.980+0000 7f29b6de8640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.980+0000 7f29b6de8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:08.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.980+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "bar", "type": "root"} v 0) -- 0x7f2990005b90 con 0x7f29b0071c00 2024-04-25T23:58:08.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.980+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}]=0 bucket 'bar' already exists v70) ==== 126+0+0 (unknown 1038733393 0 0) 0x7f29a4015140 con 0x7f29b0071c00 2024-04-25T23:58:08.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.980+0000 7f29ad7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:08.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:08.980+0000 7f29ad7fa640 10 monclient: _finish_command 2 = system:0 bucket 'bar' already exists 2024-04-25T23:58:09.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.072+0000 7f29b6de8640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:09.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.072+0000 7f29b6de8640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:09.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.072+0000 7f29b6de8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:09.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.072+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "bar", "type": "root"} v 0) -- 0x7f29900010a0 con 0x7f29b0071c00 2024-04-25T23:58:09.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.072+0000 7f29ad7fa640 1 -- 172.21.15.171:0/2035909545 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}]=0 bucket 'bar' already exists v70) ==== 126+0+0 (unknown 1038733393 0 0) 0x7f29a401dcf0 con 0x7f29b0071c00 2024-04-25T23:58:09.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.072+0000 7f29ad7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "bar", "type": "root"}] 2024-04-25T23:58:09.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.072+0000 7f29ad7fa640 10 monclient: _finish_command 3 = system:0 bucket 'bar' already exists 2024-04-25T23:58:09.058 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'bar' already exists 2024-04-25T23:58:09.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 >> v1:172.21.15.171:6812/722422047 conn(0x7f299c0377e0 legacy=0x7f299c039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 10 monclient: shutdown 2024-04-25T23:58:09.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:09.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 >> v1:172.21.15.171:6791/0 conn(0x7f29b0071c00 legacy=0x7f29b006fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 shutdown_connections 2024-04-25T23:58:09.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 >> 172.21.15.171:0/2035909545 conn(0x7f29b00a62d0 msgr2=0x7f29b00a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:09.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 shutdown_connections 2024-04-25T23:58:09.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.076+0000 7f29b6de8640 1 -- 172.21.15.171:0/2035909545 wait complete. 2024-04-25T23:58:09.074 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush link host1 root=bar 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: get_monmap_and_config 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: build_initial_monmap 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: monmap: 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:09.210624+0000 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:09.210624+0000 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.191 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:09.192 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 Processor -- start 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- start start 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: init 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: _add_conns ranks=[6,3,1,8,0,5,2,7,4] 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient(hunting): picked mon.noname-d con 0x7fbe5c135a10 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient(hunting): picked mon.noname-g con 0x7fbe5c1355c0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient(hunting): picked mon.noname-f con 0x7fbe5c13c000 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c0a0900 con 0x7fbe5c13c000 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c072300 con 0x7fbe5c1355c0 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c0725e0 con 0x7fbe5c135a10 2024-04-25T23:58:09.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient(hunting): authenticate will time out at 1139.917699s 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe6134c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fbe5c13c000 legacy=0x7fbe5c13e3f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5bfff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbe5c1355c0 0x7fbe5c13a8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:51580/0 (socket says 172.21.15.171:51580) 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5bfff640 1 -- 172.21.15.171:0/482514484 learned_addr learned my addr 172.21.15.171:0/482514484 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114256256 0 0) 0x7fbe5c072300 con 0x7fbe5c1355c0 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient(hunting): my global_id is 5439 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe48003530 con 0x7fbe5c1355c0 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3303709678 0 0) 0x7fbe48003530 con 0x7fbe5c1355c0 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 >> v1:172.21.15.106:6792/0 conn(0x7fbe5c135a10 legacy=0x7fbe5c135df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 >> v1:172.21.15.171:6789/0 conn(0x7fbe5c13c000 legacy=0x7fbe5c13e3f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:09.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 monclient: found mon.noname-g 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c0a4080 con 0x7fbe5c1355c0 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe440017c0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 5 monclient: authenticate success, global_id 5439 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: dump: 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.201 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe44001a20 con 0x7fbe5c1355c0 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 4 set_mon_vals no callback set 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 1 -- 172.21.15.171:0/482514484 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe44004bf0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe5b7fe640 10 monclient: dump: 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.203 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: shutdown 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- 172.21.15.171:0/482514484 >> v1:172.21.15.171:6790/0 conn(0x7fbe5c1355c0 legacy=0x7fbe5c13a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- 172.21.15.171:0/482514484 shutdown_connections 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- 172.21.15.171:0/482514484 >> 172.21.15.171:0/482514484 conn(0x7fbe5c0a7210 msgr2=0x7fbe5c0a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- 172.21.15.171:0/482514484 shutdown_connections 2024-04-25T23:58:09.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 1 -- 172.21.15.171:0/482514484 wait complete. 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: build_initial_monmap 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.208+0000 7fbe62daf640 10 monclient: monmap: 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:09.205 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 Processor -- start 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 -- start start 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: init 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _add_conns ranks=[2,8,1,0,4,3,6,7,5] 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient(hunting): picked mon.noname-b con 0x7fbe5c1355c0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient(hunting): picked mon.noname-e con 0x7fbe5c135a10 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient(hunting): picked mon.noname-f con 0x7fbe5c13c000 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c0a05d0 con 0x7fbe5c13c000 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c09bac0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe5c09e5a0 con 0x7fbe5c135a10 2024-04-25T23:58:09.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient(hunting): authenticate will time out at 1139.920730s 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe6134c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fbe5c13c000 legacy=0x7fbe5c1d25f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe5bfff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fbe5c135a10 legacy=0x7fbe5c09b3b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe60b4b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fbe5c1355c0 0x7fbe5c09aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:43012/0 (socket says 172.21.15.171:43012) 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe60b4b640 1 -- 172.21.15.171:0/3415652165 learned_addr learned my addr 172.21.15.171:0/3415652165 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630982733 0 0) 0x7fbe5c09bac0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): my global_id is 5303 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe3c003530 con 0x7fbe5c1355c0 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1855647124 0 0) 0x7fbe3c003530 con 0x7fbe5c1355c0 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe5c09bac0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe54001ea0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): dump: 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.208 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1768167579 0 0) 0x7fbe5c09bac0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 >> v1:172.21.15.106:6793/0 conn(0x7fbe5c135a10 legacy=0x7fbe5c09b3b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 >> v1:172.21.15.171:6789/0 conn(0x7fbe5c13c000 legacy=0x7fbe5c1d25f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 monclient: found mon.b 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe5c09dfe0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:09.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 5 monclient: authenticate success, global_id 5303 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _renew_subs 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe5c09e2c0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _renew_subs 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe5c12f380 con 0x7fbe5c1355c0 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe54003c50 con 0x7fbe5c1355c0 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe540041c0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:09.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe5affd640 4 set_mon_vals no callback set 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 10 monclient: dump: 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.211 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe40005090 con 0x7fbe5c1355c0 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.212+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbe540043e0 con 0x7fbe5c1355c0 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.216+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(70..70 src has 1..70) ==== 5307+0+0 (unknown 3338873152 0 0) 0x7fbe54045060 con 0x7fbe5c1355c0 2024-04-25T23:58:09.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.216+0000 7fbe5bfff640 10 monclient: get_auth_request con 0x7fbe3c0377e0 auth_method 0 2024-04-25T23:58:09.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.228+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbe54015c20 con 0x7fbe5c1355c0 2024-04-25T23:58:09.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.228+0000 7fbe597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:09.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.228+0000 7fbe597fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.380+0000 7fbe62daf640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.380+0000 7fbe62daf640 10 monclient: _send_command 2 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.380+0000 7fbe62daf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.380+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]} v 0) -- 0x7fbe40005b90 con 0x7fbe5c1355c0 2024-04-25T23:58:09.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.584+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}]=0 linked item id -11 name 'host1' to location {root=bar} in crush map v71) ==== 168+0+0 (unknown 38660676 0 0) 0x7fbe54004780 con 0x7fbe5c1355c0 2024-04-25T23:58:09.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.584+0000 7fbe597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.584+0000 7fbe597fa640 10 monclient: _finish_command 2 = system:0 linked item id -11 name 'host1' to location {root=bar} in crush map 2024-04-25T23:58:09.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.676+0000 7fbe62daf640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.676+0000 7fbe62daf640 10 monclient: _send_command 3 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.676+0000 7fbe62daf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.676+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]} v 0) -- 0x7fbe40005610 con 0x7fbe5c1355c0 2024-04-25T23:58:09.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe597fa640 1 -- 172.21.15.171:0/3415652165 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}]=0 no need to move item id -11 name 'host1' to location {root=bar} in crush map v71) ==== 177+0+0 (unknown 62233915 0 0) 0x7fbe54015520 con 0x7fbe5c1355c0 2024-04-25T23:58:09.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe597fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe597fa640 10 monclient: _finish_command 3 = system:0 no need to move item id -11 name 'host1' to location {root=bar} in crush map 2024-04-25T23:58:09.665 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -11 name 'host1' to location {root=bar} in crush map 2024-04-25T23:58:09.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 >> v1:172.21.15.171:6812/722422047 conn(0x7fbe3c0377e0 legacy=0x7fbe3c039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 10 monclient: shutdown 2024-04-25T23:58:09.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:09.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 >> v1:172.21.15.106:6790/0 conn(0x7fbe5c1355c0 legacy=0x7fbe5c09aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 shutdown_connections 2024-04-25T23:58:09.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 >> 172.21.15.171:0/3415652165 conn(0x7fbe5c0a7210 msgr2=0x7fbe5c131b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:09.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 shutdown_connections 2024-04-25T23:58:09.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.680+0000 7fbe62daf640 1 -- 172.21.15.171:0/3415652165 wait complete. 2024-04-25T23:58:09.680 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush link host1 root=bar 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient: get_monmap_and_config 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient: build_initial_monmap 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient: monmap: 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:09.819477+0000 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:09.819477+0000 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:09.800 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:09.801 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:09.801 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:09.801 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:09.801 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:09.801 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:09.801 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 1 Processor -- start 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 1 -- start start 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient: init 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient: _add_conns ranks=[6,4,0,3,5,1,8,2,7] 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient(hunting): picked mon.noname-d con 0x7f7f3c06e410 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient(hunting): picked mon.noname-c con 0x7f7f3c06ef00 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient(hunting): picked mon.noname-a con 0x7f7f3c13aab0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c070cd0 con 0x7f7f3c13aab0 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c06f690 con 0x7f7f3c06ef00 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c0a1790 con 0x7f7f3c06e410 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f42185640 10 monclient(hunting): authenticate will time out at 1140.526957s 2024-04-25T23:58:09.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3affd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f7f3c06ef00 legacy=0x7f7f3c139390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3bfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7f3c13aab0 0x7f7f3c13cea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:42514/0 (socket says 172.21.15.171:42514) 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3bfff640 1 -- 172.21.15.171:0/114881308 learned_addr learned my addr 172.21.15.171:0/114881308 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646728532 0 0) 0x7f7f3c070cd0 con 0x7f7f3c13aab0 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3a7fc640 10 monclient(hunting): my global_id is 5337 2024-04-25T23:58:09.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.816+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f24003530 con 0x7f7f3c13aab0 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2977931145 0 0) 0x7f7f24003530 con 0x7f7f3c13aab0 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 >> v1:172.21.15.106:6792/0 conn(0x7f7f3c06e410 legacy=0x7f7f3c06e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 >> v1:172.21.15.106:6791/0 conn(0x7f7f3c06ef00 legacy=0x7f7f3c139390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 monclient: found mon.noname-a 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c06fbd0 con 0x7f7f3c13aab0 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:09.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f34001b40 con 0x7f7f3c13aab0 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: dump: 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.808 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 5 monclient: authenticate success, global_id 5337 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f34001da0 con 0x7f7f3c13aab0 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 1 -- 172.21.15.171:0/114881308 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f34004f70 con 0x7f7f3c13aab0 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3a7fc640 10 monclient: dump: 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.809 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.810 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 4 set_mon_vals no callback set 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient: shutdown 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- 172.21.15.171:0/114881308 >> v1:172.21.15.106:6789/0 conn(0x7f7f3c13aab0 legacy=0x7f7f3c13cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- 172.21.15.171:0/114881308 shutdown_connections 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- 172.21.15.171:0/114881308 >> 172.21.15.171:0/114881308 conn(0x7f7f3c0a62d0 msgr2=0x7f7f3c0a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- 172.21.15.171:0/114881308 shutdown_connections 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- 172.21.15.171:0/114881308 wait complete. 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient: build_initial_monmap 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient: monmap: 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:09.811 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 Processor -- start 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- start start 2024-04-25T23:58:09.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient: init 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient: _add_conns ranks=[2,0,4,5,1,8,7,6,3] 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient(hunting): picked mon.noname-b con 0x7f7f3c06e410 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient(hunting): picked mon.noname-a con 0x7f7f3c06ef00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient(hunting): picked mon.noname-c con 0x7f7f3c13aab0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c06ffc0 con 0x7f7f3c06ef00 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c11caa0 con 0x7f7f3c06e410 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f3c13a010 con 0x7f7f3c13aab0 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f42185640 10 monclient(hunting): authenticate will time out at 1140.530939s 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3b7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7f3c06e410 0x7f7f3c1c84c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:43016/0 (socket says 172.21.15.171:43016) 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3b7fe640 1 -- 172.21.15.171:0/2650673874 learned_addr learned my addr 172.21.15.171:0/2650673874 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:09.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.820+0000 7f7f3bfff640 1 -- 172.21.15.171:0/2650673874 >> v1:172.21.15.106:6791/0 conn(0x7f7f3c13aab0 legacy=0x7f7f3c1d07e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:09.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899799369 0 0) 0x7f7f3c11caa0 con 0x7f7f3c06e410 2024-04-25T23:58:09.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): my global_id is 5312 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f28003530 con 0x7f7f3c06e410 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364979708 0 0) 0x7f7f2c003a00 con 0x7f7f3c06ef00 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): my global_id is 5346 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f3c11caa0 con 0x7f7f3c06ef00 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4199901576 0 0) 0x7f7f28003530 con 0x7f7f3c06e410 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f2c003a00 con 0x7f7f3c06e410 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f300041b0 con 0x7f7f3c06e410 2024-04-25T23:58:09.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): dump: 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.818 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2906943148 0 0) 0x7f7f3c11caa0 con 0x7f7f3c06ef00 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f28003530 con 0x7f7f3c06ef00 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f2c004470 con 0x7f7f3c06ef00 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient(hunting): dump: 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.819 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 876044358 0 0) 0x7f7f2c003a00 con 0x7f7f3c06e410 2024-04-25T23:58:09.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 >> v1:172.21.15.106:6791/0 conn(0x7f7f3c13aab0 legacy=0x7f7f3c1d07e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 >> v1:172.21.15.106:6789/0 conn(0x7f7f3c06ef00 legacy=0x7f7f3c1cd0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 monclient: found mon.b 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f3c070510 con 0x7f7f3c06e410 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 5 monclient: authenticate success, global_id 5312 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 10 monclient: _renew_subs 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f3c11c1e0 con 0x7f7f3c06e410 2024-04-25T23:58:09.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 10 monclient: _renew_subs 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f3c132a40 con 0x7f7f3c06e410 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f30001190 con 0x7f7f3c06e410 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f30001700 con 0x7f7f3c06e410 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f39ffb640 4 set_mon_vals no callback set 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 10 monclient: dump: 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:09.822 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:09.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f1c005090 con 0x7f7f3c06e410 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7f300018a0 con 0x7f7f3c06e410 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(71..71 src has 1..71) ==== 5433+0+0 (unknown 124074004 0 0) 0x7f7f30044ad0 con 0x7f7f3c06e410 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.824+0000 7f7f3affd640 10 monclient: get_auth_request con 0x7f7f28037e20 auth_method 0 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.836+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7f30015670 con 0x7f7f3c06e410 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.836+0000 7f7f23fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:09.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:09.836+0000 7f7f23fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:09.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.004+0000 7f7f42185640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.004+0000 7f7f42185640 10 monclient: _send_command 2 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.004+0000 7f7f42185640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:09.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.004+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]} v 0) -- 0x7f7f1c005b90 con 0x7f7f3c06e410 2024-04-25T23:58:09.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.004+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}]=0 no need to move item id -11 name 'host1' to location {root=bar} in crush map v71) ==== 177+0+0 (unknown 62233915 0 0) 0x7f7f30014f70 con 0x7f7f3c06e410 2024-04-25T23:58:09.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.004+0000 7f7f23fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:09.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.004+0000 7f7f23fff640 10 monclient: _finish_command 2 = system:0 no need to move item id -11 name 'host1' to location {root=bar} in crush map 2024-04-25T23:58:10.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.104+0000 7f7f42185640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:10.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.104+0000 7f7f42185640 10 monclient: _send_command 3 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:10.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.104+0000 7f7f42185640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:10.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.104+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]} v 0) -- 0x7f7f1c005610 con 0x7f7f3c06e410 2024-04-25T23:58:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.104+0000 7f7f23fff640 1 -- 172.21.15.171:0/2650673874 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}]=0 no need to move item id -11 name 'host1' to location {root=bar} in crush map v71) ==== 177+0+0 (unknown 62233915 0 0) 0x7f7f3001db20 con 0x7f7f3c06e410 2024-04-25T23:58:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.104+0000 7f7f23fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush link", "name": "host1", "args": ["root=bar"]}] 2024-04-25T23:58:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.104+0000 7f7f23fff640 10 monclient: _finish_command 3 = system:0 no need to move item id -11 name 'host1' to location {root=bar} in crush map 2024-04-25T23:58:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -11 name 'host1' to location {root=bar} in crush map 2024-04-25T23:58:10.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 >> v1:172.21.15.171:6812/722422047 conn(0x7f7f28037e20 legacy=0x7f7f2803a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 10 monclient: shutdown 2024-04-25T23:58:10.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:10.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 >> v1:172.21.15.106:6790/0 conn(0x7f7f3c06e410 legacy=0x7f7f3c1c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 shutdown_connections 2024-04-25T23:58:10.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 >> 172.21.15.171:0/2650673874 conn(0x7f7f3c0a62d0 msgr2=0x7f7f3c0a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:10.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 shutdown_connections 2024-04-25T23:58:10.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.108+0000 7f7f42185640 1 -- 172.21.15.171:0/2650673874 wait complete. 2024-04-25T23:58:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush link host2 root=bar 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.236+0000 7fc91dcc0640 10 monclient: get_monmap_and_config 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.236+0000 7fc91dcc0640 10 monclient: build_initial_monmap 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient: monmap: 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:10.242599+0000 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:10.242599+0000 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:10.223 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:10.224 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 1 Processor -- start 2024-04-25T23:58:10.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 1 -- start start 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient: init 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient: _add_conns ranks=[8,6,7,2,0,3,4,5,1] 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient(hunting): picked mon.noname-e con 0x7fc918133710 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient(hunting): picked mon.noname-d con 0x7fc918133af0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient(hunting): picked mon.noname-i con 0x7fc918133f10 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9180703e0 con 0x7fc918133af0 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc918071200 con 0x7fc918133f10 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9180714e0 con 0x7fc918133710 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient(hunting): authenticate will time out at 1140.949821s 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc917fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fc918133f10 legacy=0x7fc91813cf00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9177fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fc918133710 legacy=0x7fc918072680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:10.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc916ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc918133af0 0x7fc9181397d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:35528/0 (socket says 172.21.15.171:35528) 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc916ffd640 1 -- 172.21.15.171:0/3177100412 learned_addr learned my addr 172.21.15.171:0/3177100412 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176419715 0 0) 0x7fc9180703e0 con 0x7fc918133af0 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient(hunting): my global_id is 5370 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc904003530 con 0x7fc918133af0 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2436480039 0 0) 0x7fc904003530 con 0x7fc918133af0 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 >> v1:172.21.15.106:6793/0 conn(0x7fc918133710 legacy=0x7fc918072680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 >> v1:172.21.15.171:6792/0 conn(0x7fc918133f10 legacy=0x7fc91813cf00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 monclient: found mon.noname-d 2024-04-25T23:58:10.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9180717c0 con 0x7fc918133af0 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9000017c0 con 0x7fc918133af0 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: dump: 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.231 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 5 monclient: authenticate success, global_id 5370 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:10.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc900001a20 con 0x7fc918133af0 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 1 -- 172.21.15.171:0/3177100412 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc900004bf0 con 0x7fc918133af0 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc91dcc0640 4 set_mon_vals no callback set 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.240+0000 7fc9167fc640 10 monclient: dump: 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.233 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: shutdown 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- 172.21.15.171:0/3177100412 >> v1:172.21.15.106:6792/0 conn(0x7fc918133af0 legacy=0x7fc9181397d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- 172.21.15.171:0/3177100412 shutdown_connections 2024-04-25T23:58:10.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- 172.21.15.171:0/3177100412 >> 172.21.15.171:0/3177100412 conn(0x7fc9180a7210 msgr2=0x7fc9180a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- 172.21.15.171:0/3177100412 shutdown_connections 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- 172.21.15.171:0/3177100412 wait complete. 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: build_initial_monmap 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: monmap: 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:10.235 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 Processor -- start 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- start start 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: init 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: _add_conns ranks=[7,6,0,1,8,3,5,4,2] 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient(hunting): picked mon.noname-i con 0x7fc918133710 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient(hunting): picked mon.noname-d con 0x7fc918133af0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:10.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient(hunting): picked mon.noname-a con 0x7fc918133f10 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc91811e4c0 con 0x7fc918133f10 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9180a0fa0 con 0x7fc918133af0 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9181334e0 con 0x7fc918133710 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient(hunting): authenticate will time out at 1140.953688s 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc9177fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fc918133710 legacy=0x7fc9181326c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc916ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc918133af0 0x7fc9181d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:35534/0 (socket says 172.21.15.171:35534) 2024-04-25T23:58:10.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc916ffd640 1 -- 172.21.15.171:0/785007613 learned_addr learned my addr 172.21.15.171:0/785007613 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:10.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472080598 0 0) 0x7fc9180a0fa0 con 0x7fc918133af0 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): my global_id is 5379 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f8003530 con 0x7fc918133af0 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132118458 0 0) 0x7fc91811e4c0 con 0x7fc918133f10 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): my global_id is 5355 2024-04-25T23:58:10.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc9180a0fa0 con 0x7fc918133f10 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1969693506 0 0) 0x7fc8f8003530 con 0x7fc918133af0 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc91811e4c0 con 0x7fc918133af0 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9000016c0 con 0x7fc918133af0 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): dump: 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.242 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2220845723 0 0) 0x7fc9180a0fa0 con 0x7fc918133f10 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8f8003530 con 0x7fc918133f10 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc9100044e0 con 0x7fc918133f10 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:10.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient(hunting): dump: 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.244 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 535299624 0 0) 0x7fc91811e4c0 con 0x7fc918133af0 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 >> v1:172.21.15.171:6792/0 conn(0x7fc918133710 legacy=0x7fc9181326c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 >> v1:172.21.15.106:6789/0 conn(0x7fc918133f10 legacy=0x7fc9181d49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 monclient: found mon.d 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9181bbce0 con 0x7fc918133af0 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: _finish_auth 0 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 5 monclient: authenticate success, global_id 5379 2024-04-25T23:58:10.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: _renew_subs 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc918132dd0 con 0x7fc918133af0 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: _renew_subs 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc918133030 con 0x7fc918133af0 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc900001a20 con 0x7fc918133af0 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc915ffb640 4 set_mon_vals no callback set 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc900001c50 con 0x7fc918133af0 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.244+0000 7fc90ffff640 10 monclient: dump: 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.246 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.248+0000 7fc91dcc0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:10.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.248+0000 7fc91dcc0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.248+0000 7fc91dcc0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.248+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8fc005090 con 0x7fc918133af0 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.248+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc9000100f0 con 0x7fc918133af0 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.248+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(71..71 src has 1..71) ==== 5433+0+0 (unknown 124074004 0 0) 0x7fc900044d50 con 0x7fc918133af0 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.248+0000 7fc9177fe640 10 monclient: get_auth_request con 0x7fc8f8037d70 auth_method 0 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.260+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc900015890 con 0x7fc918133af0 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.260+0000 7fc90ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:10.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.260+0000 7fc90ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:10.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.428+0000 7fc91dcc0640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:10.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.428+0000 7fc91dcc0640 10 monclient: _send_command 2 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:10.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.428+0000 7fc91dcc0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.428+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]} v 0) -- 0x7fc8fc005b90 con 0x7fc918133af0 2024-04-25T23:58:10.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.608+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}]=0 linked item id -16 name 'host2' to location {root=bar} in crush map v72) ==== 168+0+0 (unknown 3916106731 0 0) 0x7fc9000194e0 con 0x7fc918133af0 2024-04-25T23:58:10.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.608+0000 7fc90ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:10.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.608+0000 7fc90ffff640 10 monclient: _finish_command 2 = system:0 linked item id -16 name 'host2' to location {root=bar} in crush map 2024-04-25T23:58:10.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.712+0000 7fc91dcc0640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:10.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.712+0000 7fc91dcc0640 10 monclient: _send_command 3 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:10.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.712+0000 7fc91dcc0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.712+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]} v 0) -- 0x7fc8fc005610 con 0x7fc918133af0 2024-04-25T23:58:10.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.712+0000 7fc90ffff640 1 -- 172.21.15.171:0/785007613 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}]=0 no need to move item id -16 name 'host2' to location {root=bar} in crush map v72) ==== 177+0+0 (unknown 599532832 0 0) 0x7fc90001dda0 con 0x7fc918133af0 2024-04-25T23:58:10.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.712+0000 7fc90ffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:10.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.712+0000 7fc90ffff640 10 monclient: _finish_command 3 = system:0 no need to move item id -16 name 'host2' to location {root=bar} in crush map 2024-04-25T23:58:10.698 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -16 name 'host2' to location {root=bar} in crush map 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 >> v1:172.21.15.171:6812/722422047 conn(0x7fc8f8037d70 legacy=0x7fc8f803a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 10 monclient: shutdown 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 >> v1:172.21.15.106:6792/0 conn(0x7fc918133af0 legacy=0x7fc9181d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 shutdown_connections 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 >> 172.21.15.171:0/785007613 conn(0x7fc9180a7210 msgr2=0x7fc9181b9050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 shutdown_connections 2024-04-25T23:58:10.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.716+0000 7fc91dcc0640 1 -- 172.21.15.171:0/785007613 wait complete. 2024-04-25T23:58:10.715 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush link host2 root=bar 2024-04-25T23:58:10.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: get_monmap_and_config 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: build_initial_monmap 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: monmap: 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:10.850620+0000 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:10.850620+0000 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:10.832 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:10.833 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:10.833 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:10.833 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:10.833 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:10.833 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 Processor -- start 2024-04-25T23:58:10.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- start start 2024-04-25T23:58:10.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: init 2024-04-25T23:58:10.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:10.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: _add_conns ranks=[6,0,4,2,5,8,7,3,1] 2024-04-25T23:58:10.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient(hunting): picked mon.noname-d con 0x7fb2380a3fc0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:10.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient(hunting): picked mon.noname-a con 0x7fb2380a1060 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient(hunting): picked mon.noname-c con 0x7fb23813e0c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb238075740 con 0x7fb2380a1060 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb238076120 con 0x7fb23813e0c0 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23809e800 con 0x7fb2380a3fc0 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient(hunting): authenticate will time out at 1141.557767s 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23d6f4640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fb23813e0c0 legacy=0x7fb2381404b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23cef3640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb2380a3fc0 0x7fb2380a0950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:46294/0 (socket says 172.21.15.171:46294) 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23cef3640 1 -- 172.21.15.171:0/1510272983 learned_addr learned my addr 172.21.15.171:0/1510272983 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1681444550 0 0) 0x7fb23809e800 con 0x7fb2380a3fc0 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:10.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient(hunting): my global_id is 5388 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb220003530 con 0x7fb2380a3fc0 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 866309254 0 0) 0x7fb220003530 con 0x7fb2380a3fc0 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 >> v1:172.21.15.106:6791/0 conn(0x7fb23813e0c0 legacy=0x7fb2381404b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 >> v1:172.21.15.106:6789/0 conn(0x7fb2380a1060 legacy=0x7fb23813c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 monclient: found mon.noname-d 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2380a43a0 con 0x7fb2380a3fc0 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb2280017c0 con 0x7fb2380a3fc0 2024-04-25T23:58:10.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: dump: 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.842 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 5 monclient: authenticate success, global_id 5388 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb228001a20 con 0x7fb2380a3fc0 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 1 -- 172.21.15.171:0/1510272983 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb228004bf0 con 0x7fb2380a3fc0 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 4 set_mon_vals no callback set 2024-04-25T23:58:10.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb2377fe640 10 monclient: dump: 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.844 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 10 monclient: shutdown 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- 172.21.15.171:0/1510272983 >> v1:172.21.15.106:6792/0 conn(0x7fb2380a3fc0 legacy=0x7fb2380a0950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- 172.21.15.171:0/1510272983 shutdown_connections 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- 172.21.15.171:0/1510272983 >> 172.21.15.171:0/1510272983 conn(0x7fb2380a73b0 msgr2=0x7fb2380a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- 172.21.15.171:0/1510272983 shutdown_connections 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.848+0000 7fb23f157640 1 -- 172.21.15.171:0/1510272983 wait complete. 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: build_initial_monmap 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: monmap: 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:10.845 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 Processor -- start 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 -- start start 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: init 2024-04-25T23:58:10.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _add_conns ranks=[8,0,3,1,6,2,5,4,7] 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient(hunting): picked mon.noname-e con 0x7fb2380a1060 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient(hunting): picked mon.noname-a con 0x7fb2380a3fc0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient(hunting): picked mon.noname-g con 0x7fb23813e0c0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb23813a600 con 0x7fb2380a3fc0 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb238072200 con 0x7fb23813e0c0 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb238070220 con 0x7fb2380a1060 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient(hunting): authenticate will time out at 1141.561243s 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23d6f4640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fb23813e0c0 0x7fb2381d4720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53608/0 (socket says 172.21.15.171:53608) 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23d6f4640 1 -- 172.21.15.171:0/3506694093 learned_addr learned my addr 172.21.15.171:0/3506694093 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23cef3640 1 -- 172.21.15.171:0/3506694093 >> v1:172.21.15.106:6793/0 conn(0x7fb2380a1060 legacy=0x7fb23806f400 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775543678 0 0) 0x7fb238072200 con 0x7fb23813e0c0 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:10.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): my global_id is 5448 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb224003530 con 0x7fb23813e0c0 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1947634444 0 0) 0x7fb224003530 con 0x7fb23813e0c0 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb238072200 con 0x7fb23813e0c0 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb230004560 con 0x7fb23813e0c0 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): dump: 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.848 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2554117311 0 0) 0x7fb238072200 con 0x7fb23813e0c0 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 >> v1:172.21.15.106:6793/0 conn(0x7fb2380a1060 legacy=0x7fb23806f400 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 >> v1:172.21.15.106:6789/0 conn(0x7fb2380a3fc0 legacy=0x7fb23806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:10.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 monclient: found mon.g 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb238070d50 con 0x7fb23813e0c0 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 5 monclient: authenticate success, global_id 5448 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _renew_subs 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb23809da50 con 0x7fb23813e0c0 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _renew_subs 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2380724e0 con 0x7fb23813e0c0 2024-04-25T23:58:10.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb230004890 con 0x7fb23813e0c0 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb230004d80 con 0x7fb23813e0c0 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb236ffd640 4 set_mon_vals no callback set 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 10 monclient: dump: 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:10.851 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb230004fe0 con 0x7fb23813e0c0 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb218005090 con 0x7fb23813e0c0 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(72..72 src has 1..72) ==== 5457+0+0 (unknown 3058390850 0 0) 0x7fb230044ff0 con 0x7fb23813e0c0 2024-04-25T23:58:10.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.852+0000 7fb23cef3640 10 monclient: get_auth_request con 0x7fb2240376f0 auth_method 0 2024-04-25T23:58:10.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.856+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb230015b30 con 0x7fb23813e0c0 2024-04-25T23:58:10.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.856+0000 7fb2357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:10.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:10.856+0000 7fb2357fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:11.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.024+0000 7fb23f157640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:11.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.024+0000 7fb23f157640 10 monclient: _send_command 2 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:11.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.024+0000 7fb23f157640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.024+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]} v 0) -- 0x7fb218005b90 con 0x7fb23813e0c0 2024-04-25T23:58:11.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.024+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}]=0 no need to move item id -16 name 'host2' to location {root=bar} in crush map v72) ==== 177+0+0 (unknown 599532832 0 0) 0x7fb230015430 con 0x7fb23813e0c0 2024-04-25T23:58:11.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.024+0000 7fb2357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:11.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.024+0000 7fb2357fa640 10 monclient: _finish_command 2 = system:0 no need to move item id -16 name 'host2' to location {root=bar} in crush map 2024-04-25T23:58:11.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.116+0000 7fb23f157640 10 start_mon_command cmd=[{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:11.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.116+0000 7fb23f157640 10 monclient: _send_command 3 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:11.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.116+0000 7fb23f157640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.116+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]} v 0) -- 0x7fb2180010a0 con 0x7fb23813e0c0 2024-04-25T23:58:11.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb2357fa640 1 -- 172.21.15.171:0/3506694093 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}]=0 no need to move item id -16 name 'host2' to location {root=bar} in crush map v72) ==== 177+0+0 (unknown 599532832 0 0) 0x7fb230019780 con 0x7fb23813e0c0 2024-04-25T23:58:11.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb2357fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush link", "name": "host2", "args": ["root=bar"]}] 2024-04-25T23:58:11.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb2357fa640 10 monclient: _finish_command 3 = system:0 no need to move item id -16 name 'host2' to location {root=bar} in crush map 2024-04-25T23:58:11.103 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -16 name 'host2' to location {root=bar} in crush map 2024-04-25T23:58:11.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 >> v1:172.21.15.171:6812/722422047 conn(0x7fb2240376f0 legacy=0x7fb224039bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 10 monclient: shutdown 2024-04-25T23:58:11.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:11.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 >> v1:172.21.15.171:6790/0 conn(0x7fb23813e0c0 legacy=0x7fb2381d4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 shutdown_connections 2024-04-25T23:58:11.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 >> 172.21.15.171:0/3506694093 conn(0x7fb2380a73b0 msgr2=0x7fb238133000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:11.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 shutdown_connections 2024-04-25T23:58:11.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.120+0000 7fb23f157640 1 -- 172.21.15.171:0/3506694093 wait complete. 2024-04-25T23:58:11.119 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:11.119 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c osd.7 2024-04-25T23:58:11.119 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 2 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient: get_monmap_and_config 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient: build_initial_monmap 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient: monmap: 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:11.252621+0000 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:11.252621+0000 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:11.233 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:11.234 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:11.234 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:11.234 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:11.234 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:11.234 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:11.234 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:11.234 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 1 Processor -- start 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 1 -- start start 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient: init 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient: _add_conns ranks=[1,3,0,7,2,8,6,4,5] 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient(hunting): picked mon.noname-f con 0x7fe33809bb70 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient(hunting): picked mon.noname-g con 0x7fe3380a1a40 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient(hunting): picked mon.noname-a con 0x7fe33809c660 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3380a2000 con 0x7fe33809c660 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33809e220 con 0x7fe33809bb70 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe33809f580 con 0x7fe3380a1a40 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:11.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33ebda640 10 monclient(hunting): authenticate will time out at 1141.959660s 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe33c976640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fe33809bb70 legacy=0x7fe33809bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe337fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fe3380a1a40 0x7fe338139b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53616/0 (socket says 172.21.15.171:53616) 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.248+0000 7fe337fff640 1 -- 172.21.15.171:0/98526408 learned_addr learned my addr 172.21.15.171:0/98526408 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455624567 0 0) 0x7fe33809f580 con 0x7fe3380a1a40 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient(hunting): my global_id is 5457 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe320005740 con 0x7fe3380a1a40 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1302623519 0 0) 0x7fe320005740 con 0x7fe3380a1a40 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 >> v1:172.21.15.171:6789/0 conn(0x7fe33809bb70 legacy=0x7fe33809bf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 >> v1:172.21.15.106:6789/0 conn(0x7fe33809c660 legacy=0x7fe33813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 monclient: found mon.noname-g 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe33809d310 con 0x7fe3380a1a40 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 5 monclient: authenticate success, global_id 5457 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe32c0017c0 con 0x7fe3380a1a40 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: dump: 2024-04-25T23:58:11.243 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.244 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe32c001b20 con 0x7fe3380a1a40 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 1 -- 172.21.15.171:0/98526408 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe32c001d50 con 0x7fe3380a1a40 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 4 set_mon_vals no callback set 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3377fe640 10 monclient: dump: 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.245 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: shutdown 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- 172.21.15.171:0/98526408 >> v1:172.21.15.171:6790/0 conn(0x7fe3380a1a40 legacy=0x7fe338139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- 172.21.15.171:0/98526408 shutdown_connections 2024-04-25T23:58:11.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- 172.21.15.171:0/98526408 >> 172.21.15.171:0/98526408 conn(0x7fe3380a28a0 msgr2=0x7fe3380a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- 172.21.15.171:0/98526408 shutdown_connections 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- 172.21.15.171:0/98526408 wait complete. 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: build_initial_monmap 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: monmap: 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:11.247 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 Processor -- start 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- start start 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: init 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: _add_conns ranks=[4,5,8,6,2,0,1,3,7] 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient(hunting): picked mon.noname-c con 0x7fe33809bb70 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient(hunting): picked mon.noname-h con 0x7fe33809c660 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient(hunting): picked mon.noname-e con 0x7fe3380a1a40 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3381aa4d0 con 0x7fe33809bb70 2024-04-25T23:58:11.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3381abf20 con 0x7fe33809c660 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3381ac200 con 0x7fe3380a1a40 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient(hunting): authenticate will time out at 1141.962589s 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe337fff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe33809c660 0x7fe3381d1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56220/0 (socket says 172.21.15.171:56220) 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe337fff640 1 -- 172.21.15.171:0/1038378547 learned_addr learned my addr 172.21.15.171:0/1038378547 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33c976640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fe33809bb70 legacy=0x7fe3381cc9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33d177640 1 -- 172.21.15.171:0/1038378547 >> v1:172.21.15.106:6793/0 conn(0x7fe3380a1a40 legacy=0x7fe3381d5290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1241546544 0 0) 0x7fe3381abf20 con 0x7fe33809c660 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): my global_id is 5297 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe324003530 con 0x7fe33809c660 2024-04-25T23:58:11.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2830796459 0 0) 0x7fe324003530 con 0x7fe33809c660 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3381abf20 con 0x7fe33809c660 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe32c001780 con 0x7fe33809c660 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): dump: 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.250 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1807823786 0 0) 0x7fe3381abf20 con 0x7fe33809c660 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 >> v1:172.21.15.106:6793/0 conn(0x7fe3380a1a40 legacy=0x7fe3381d5290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 >> v1:172.21.15.106:6791/0 conn(0x7fe33809bb70 legacy=0x7fe3381cc9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 monclient: found mon.h 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:11.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3381abbf0 con 0x7fe33809c660 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 5 monclient: authenticate success, global_id 5297 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: _renew_subs 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3381ab540 con 0x7fe33809c660 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: _renew_subs 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3381acdb0 con 0x7fe33809c660 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe32c001b20 con 0x7fe33809c660 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe32c001130 con 0x7fe33809c660 2024-04-25T23:58:11.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3367fc640 4 set_mon_vals no callback set 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.252+0000 7fe3357fa640 10 monclient: dump: 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.253 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.256+0000 7fe33ebda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.256+0000 7fe33ebda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.256+0000 7fe33ebda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.256+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe318005090 con 0x7fe33809c660 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.256+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe32c00feb0 con 0x7fe33809c660 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.256+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(72..72 src has 1..72) ==== 5457+0+0 (unknown 3058390850 0 0) 0x7fe32c044d80 con 0x7fe33809c660 2024-04-25T23:58:11.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.256+0000 7fe33c976640 10 monclient: get_auth_request con 0x7fe324037780 auth_method 0 2024-04-25T23:58:11.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.260+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe32c015a20 con 0x7fe33809c660 2024-04-25T23:58:11.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.260+0000 7fe3357fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:11.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.260+0000 7fe3357fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:11.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.416+0000 7fe33ebda640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:11.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.416+0000 7fe33ebda640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.416+0000 7fe33ebda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:11.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.416+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fe318005b90 con 0x7fe33809c660 2024-04-25T23:58:11.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.416+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v72) ==== 56+0+1474 (unknown 1744850983 0 1770165666) 0x7fe32c015320 con 0x7fe33809c660 2024-04-25T23:58:11.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.416+0000 7fe3357fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.416+0000 7fe3357fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:11.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.508+0000 7fe33ebda640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:11.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.508+0000 7fe33ebda640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.508+0000 7fe33ebda640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:11.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.508+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fe318005d60 con 0x7fe33809c660 2024-04-25T23:58:11.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe3357fa640 1 -- 172.21.15.171:0/1038378547 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v73) ==== 56+0+1474 (unknown 4132081119 0 1770165666) 0x7fe32c042470 con 0x7fe33809c660 2024-04-25T23:58:11.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe3357fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.496 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe3357fa640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:11.498 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 >> v1:172.21.15.171:6812/722422047 conn(0x7fe324037780 legacy=0x7fe324039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.498 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 10 monclient: shutdown 2024-04-25T23:58:11.498 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:11.498 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 >> v1:172.21.15.171:6791/0 conn(0x7fe33809c660 legacy=0x7fe3381d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.498 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 shutdown_connections 2024-04-25T23:58:11.499 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 >> 172.21.15.171:0/1038378547 conn(0x7fe3380a28a0 msgr2=0x7fe3380a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:11.499 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 shutdown_connections 2024-04-25T23:58:11.499 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.512+0000 7fe33ebda640 1 -- 172.21.15.171:0/1038378547 wait complete. 2024-04-25T23:58:11.515 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c host1 2024-04-25T23:58:11.515 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:11.515 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 2 2024-04-25T23:58:11.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient: get_monmap_and_config 2024-04-25T23:58:11.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient: build_initial_monmap 2024-04-25T23:58:11.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient: monmap: 2024-04-25T23:58:11.625 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:11.625 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.625 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:11.644780+0000 2024-04-25T23:58:11.625 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:11.644780+0000 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:11.626 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 1 Processor -- start 2024-04-25T23:58:11.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 1 -- start start 2024-04-25T23:58:11.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient: init 2024-04-25T23:58:11.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:11.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient: _add_conns ranks=[2,5,4,1,6,3,0,7,8] 2024-04-25T23:58:11.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient(hunting): picked mon.noname-b con 0x7fcb6c1328a0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:11.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient(hunting): picked mon.noname-h con 0x7fcb6c09b840 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient(hunting): picked mon.noname-c con 0x7fcb6c09b3e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c133390 con 0x7fcb6c1328a0 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c09cc80 con 0x7fcb6c09b3e0 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c09c2a0 con 0x7fcb6c09b840 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb71ccf640 10 monclient(hunting): authenticate will time out at 1142.351586s 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb6bfff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fcb6c09b3e0 legacy=0x7fcb6c13e1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb6affd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fcb6c09b840 0x7fcb6c13aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56234/0 (socket says 172.21.15.171:56234) 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.640+0000 7fcb6affd640 1 -- 172.21.15.171:0/457529982 learned_addr learned my addr 172.21.15.171:0/457529982 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3727622457 0 0) 0x7fcb6c09c2a0 con 0x7fcb6c09b840 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:11.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient(hunting): my global_id is 5306 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb58003530 con 0x7fcb6c09b840 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2179890313 0 0) 0x7fcb58003530 con 0x7fcb6c09b840 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 >> v1:172.21.15.106:6791/0 conn(0x7fcb6c09b3e0 legacy=0x7fcb6c13e1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 >> v1:172.21.15.106:6790/0 conn(0x7fcb6c1328a0 legacy=0x7fcb6c132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 monclient: found mon.noname-h 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c09f7b0 con 0x7fcb6c09b840 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 5 monclient: authenticate success, global_id 5306 2024-04-25T23:58:11.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcb540017c0 con 0x7fcb6c09b840 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: dump: 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.636 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb54001b20 con 0x7fcb6c09b840 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 1 -- 172.21.15.171:0/457529982 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcb54001d50 con 0x7fcb6c09b840 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 4 set_mon_vals no callback set 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:11.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6a7fc640 10 monclient: dump: 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.638 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: shutdown 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- 172.21.15.171:0/457529982 >> v1:172.21.15.171:6791/0 conn(0x7fcb6c09b840 legacy=0x7fcb6c13aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- 172.21.15.171:0/457529982 shutdown_connections 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- 172.21.15.171:0/457529982 >> 172.21.15.171:0/457529982 conn(0x7fcb6c0a28a0 msgr2=0x7fcb6c0a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- 172.21.15.171:0/457529982 shutdown_connections 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- 172.21.15.171:0/457529982 wait complete. 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: build_initial_monmap 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: monmap: 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:11.639 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:11.640 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 Processor -- start 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- start start 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: init 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: _add_conns ranks=[6,7,3,1,5,8,2,4,0] 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient(hunting): picked mon.noname-d con 0x7fcb6c09b3e0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient(hunting): picked mon.noname-i con 0x7fcb6c09b840 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient(hunting): picked mon.noname-g con 0x7fcb6c1328a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c130880 con 0x7fcb6c1328a0 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c12d8e0 con 0x7fcb6c09b3e0 2024-04-25T23:58:11.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb6c072c20 con 0x7fcb6c09b840 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6affd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fcb6c09b840 legacy=0x7fcb6c12d1d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient(hunting): authenticate will time out at 1142.354664s 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6bfff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fcb6c1328a0 0x7fcb6c1d2990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53626/0 (socket says 172.21.15.171:53626) 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb6bfff640 1 -- 172.21.15.171:0/181759130 learned_addr learned my addr 172.21.15.171:0/181759130 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077482596 0 0) 0x7fcb6c130880 con 0x7fcb6c1328a0 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): my global_id is 5466 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb4c003560 con 0x7fcb6c1328a0 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1416850593 0 0) 0x7fcb4c003560 con 0x7fcb6c1328a0 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb6c130880 con 0x7fcb6c1328a0 2024-04-25T23:58:11.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcb640044d0 con 0x7fcb6c1328a0 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): dump: 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.643 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 135154982 0 0) 0x7fcb6c130880 con 0x7fcb6c1328a0 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 >> v1:172.21.15.171:6792/0 conn(0x7fcb6c09b840 legacy=0x7fcb6c12d1d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 >> v1:172.21.15.106:6792/0 conn(0x7fcb6c09b3e0 legacy=0x7fcb6c12cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 monclient: found mon.g 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb6c073100 con 0x7fcb6c1328a0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 5 monclient: authenticate success, global_id 5466 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: _renew_subs 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcb6c1305a0 con 0x7fcb6c1328a0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: _renew_subs 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.644+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcb6c12f0f0 con 0x7fcb6c1328a0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb64004830 con 0x7fcb6c1328a0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcb64004da0 con 0x7fcb6c1328a0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:11.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb69ffb640 4 set_mon_vals no callback set 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 10 monclient: dump: 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:11.646 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb71ccf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcb64004fc0 con 0x7fcb6c1328a0 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(73..73 src has 1..73) ==== 5457+0+0 (unknown 744408293 0 0) 0x7fcb64044e20 con 0x7fcb6c1328a0 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb71ccf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb71ccf640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb50005090 con 0x7fcb6c1328a0 2024-04-25T23:58:11.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.648+0000 7fcb6b7fe640 10 monclient: get_auth_request con 0x7fcb4c037820 auth_method 0 2024-04-25T23:58:11.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.652+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fcb64015b00 con 0x7fcb6c1328a0 2024-04-25T23:58:11.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.652+0000 7fcb63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:11.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.652+0000 7fcb63fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:11.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.812+0000 7fcb71ccf640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:11.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.812+0000 7fcb71ccf640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.812+0000 7fcb71ccf640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.812+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fcb50005b90 con 0x7fcb6c1328a0 2024-04-25T23:58:11.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.812+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v73) ==== 56+0+1474 (unknown 4132081119 0 1770165666) 0x7fcb64015400 con 0x7fcb6c1328a0 2024-04-25T23:58:11.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.812+0000 7fcb63fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.812+0000 7fcb63fff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:11.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.900+0000 7fcb71ccf640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:11.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.900+0000 7fcb71ccf640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.900+0000 7fcb71ccf640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:11.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.900+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fcb50006740 con 0x7fcb6c1328a0 2024-04-25T23:58:11.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb63fff640 1 -- 172.21.15.171:0/181759130 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v73) ==== 56+0+1474 (unknown 4132081119 0 1770165666) 0x7fcb6401dfb0 con 0x7fcb6c1328a0 2024-04-25T23:58:11.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb63fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:11.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb63fff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:11.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 >> v1:172.21.15.171:6812/722422047 conn(0x7fcb4c037820 legacy=0x7fcb4c039ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 10 monclient: shutdown 2024-04-25T23:58:11.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:11.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 >> v1:172.21.15.171:6790/0 conn(0x7fcb6c1328a0 legacy=0x7fcb6c1d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:11.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 shutdown_connections 2024-04-25T23:58:11.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 >> 172.21.15.171:0/181759130 conn(0x7fcb6c0a28a0 msgr2=0x7fcb6c12b780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:11.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 shutdown_connections 2024-04-25T23:58:11.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:11.904+0000 7fcb71ccf640 1 -- 172.21.15.171:0/181759130 wait complete. 2024-04-25T23:58:11.903 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:11.903 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c osd.9 2024-04-25T23:58:11.903 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 2 2024-04-25T23:58:12.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.028+0000 7f4c74b62640 10 monclient: get_monmap_and_config 2024-04-25T23:58:12.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.028+0000 7f4c74b62640 10 monclient: build_initial_monmap 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.028+0000 7f4c74b62640 10 monclient: monmap: 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:12.034092+0000 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:12.034092+0000 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:12.015 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:12.016 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:12.016 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:12.016 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 Processor -- start 2024-04-25T23:58:12.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- start start 2024-04-25T23:58:12.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: init 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: _add_conns ranks=[3,5,4,1,7,6,2,0,8] 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient(hunting): picked mon.noname-g con 0x7f4c701328a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient(hunting): picked mon.noname-h con 0x7f4c7009b840 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient(hunting): picked mon.noname-c con 0x7f4c7009b3e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c70133390 con 0x7f4c701328a0 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7009cc80 con 0x7f4c7009b3e0 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7009c2a0 con 0x7f4c7009b840 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient(hunting): authenticate will time out at 1142.741500s 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6e59c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f4c701328a0 0x7f4c70132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53636/0 (socket says 172.21.15.171:53636) 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6e59c640 1 -- 172.21.15.171:0/3916360772 learned_addr learned my addr 172.21.15.171:0/3916360772 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6ed9d640 1 -- 172.21.15.171:0/3916360772 >> v1:172.21.15.106:6791/0 conn(0x7f4c7009b3e0 legacy=0x7f4c7013e1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 694269884 0 0) 0x7f4c70133390 con 0x7f4c701328a0 2024-04-25T23:58:12.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): my global_id is 5475 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c58003530 con 0x7f4c701328a0 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147757906 0 0) 0x7f4c7009c2a0 con 0x7f4c7009b840 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient(hunting): my global_id is 5315 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c70133390 con 0x7f4c7009b840 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1354784654 0 0) 0x7f4c58003530 con 0x7f4c701328a0 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 >> v1:172.21.15.171:6791/0 conn(0x7f4c7009b840 legacy=0x7f4c7013aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 >> v1:172.21.15.106:6791/0 conn(0x7f4c7009b3e0 legacy=0x7f4c7013e1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:12.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 monclient: found mon.noname-g 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7009f7b0 con 0x7f4c701328a0 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: _finish_auth 0 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 5 monclient: authenticate success, global_id 5475 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c600017c0 con 0x7f4c701328a0 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: dump: 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.025 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c60001ae0 con 0x7f4c701328a0 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 1 -- 172.21.15.171:0/3916360772 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c60004bf0 con 0x7f4c701328a0 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 4 set_mon_vals no callback set 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c6d59a640 10 monclient: dump: 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.027 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: shutdown 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- 172.21.15.171:0/3916360772 >> v1:172.21.15.171:6790/0 conn(0x7f4c701328a0 legacy=0x7f4c70132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- 172.21.15.171:0/3916360772 shutdown_connections 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- 172.21.15.171:0/3916360772 >> 172.21.15.171:0/3916360772 conn(0x7f4c700a28a0 msgr2=0x7f4c700a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:12.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- 172.21.15.171:0/3916360772 shutdown_connections 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- 172.21.15.171:0/3916360772 wait complete. 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: build_initial_monmap 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: monmap: 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:12.029 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 Processor -- start 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 1 -- start start 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.032+0000 7f4c74b62640 10 monclient: init 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _add_conns ranks=[4,5,6,0,3,8,7,2,1] 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient(hunting): picked mon.noname-c con 0x7f4c7009b3e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient(hunting): picked mon.noname-h con 0x7f4c7009b840 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient(hunting): picked mon.noname-d con 0x7f4c701328a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7013bcb0 con 0x7f4c7009b3e0 2024-04-25T23:58:12.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c70073100 con 0x7f4c7009b840 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c70072c20 con 0x7f4c701328a0 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient(hunting): authenticate will time out at 1142.744485s 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c6dd9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4c7009b840 0x7f4c701387a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56240/0 (socket says 172.21.15.171:56240) 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c6dd9b640 1 -- 172.21.15.171:0/4062577784 learned_addr learned my addr 172.21.15.171:0/4062577784 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c6e59c640 1 -- 172.21.15.171:0/4062577784 >> v1:172.21.15.106:6791/0 conn(0x7f4c7009b3e0 legacy=0x7f4c70138090 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275132377 0 0) 0x7f4c70073100 con 0x7f4c7009b840 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): my global_id is 5324 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c50003530 con 0x7f4c7009b840 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2186422223 0 0) 0x7f4c50003530 con 0x7f4c7009b840 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c70073100 con 0x7f4c7009b840 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c64001ac0 con 0x7f4c7009b840 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): dump: 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.032 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2780792312 0 0) 0x7f4c70073100 con 0x7f4c7009b840 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 >> v1:172.21.15.106:6792/0 conn(0x7f4c701328a0 legacy=0x7f4c701d2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 >> v1:172.21.15.106:6791/0 conn(0x7f4c7009b3e0 legacy=0x7f4c70138090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 monclient: found mon.h 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7013b9d0 con 0x7f4c7009b840 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: _finish_auth 0 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 5 monclient: authenticate success, global_id 5324 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _renew_subs 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7013e570 con 0x7f4c7009b840 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _renew_subs 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c70139080 con 0x7f4c7009b840 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c640038d0 con 0x7f4c7009b840 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c64003dc0 con 0x7f4c7009b840 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c6cd99640 4 set_mon_vals no callback set 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 10 monclient: dump: 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.035 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4c64003f60 con 0x7f4c7009b840 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c54005090 con 0x7f4c7009b840 2024-04-25T23:58:12.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(73..73 src has 1..73) ==== 5457+0+0 (unknown 744408293 0 0) 0x7f4c64044d20 con 0x7f4c7009b840 2024-04-25T23:58:12.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.036+0000 7f4c6e59c640 10 monclient: get_auth_request con 0x7f4c50037780 auth_method 0 2024-04-25T23:58:12.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.040+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f4c640157e0 con 0x7f4c7009b840 2024-04-25T23:58:12.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.040+0000 7f4c5effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.040+0000 7f4c5effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:12.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.192+0000 7f4c74b62640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:12.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.192+0000 7f4c74b62640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.192+0000 7f4c74b62640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.192+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f4c54005b90 con 0x7f4c7009b840 2024-04-25T23:58:12.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.192+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v73) ==== 56+0+1474 (unknown 4132081119 0 1770165666) 0x7f4c64019490 con 0x7f4c7009b840 2024-04-25T23:58:12.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.192+0000 7f4c5effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.192+0000 7f4c5effd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:12.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.280+0000 7f4c74b62640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:12.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.280+0000 7f4c74b62640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.280+0000 7f4c74b62640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.280+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f4c54006740 con 0x7f4c7009b840 2024-04-25T23:58:12.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.280+0000 7f4c5effd640 1 -- 172.21.15.171:0/4062577784 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v73) ==== 56+0+1474 (unknown 4132081119 0 1770165666) 0x7f4c6401dd50 con 0x7f4c7009b840 2024-04-25T23:58:12.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.280+0000 7f4c5effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.280+0000 7f4c5effd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 >> v1:172.21.15.171:6812/722422047 conn(0x7f4c50037780 legacy=0x7f4c50039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 10 monclient: shutdown 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 >> v1:172.21.15.171:6791/0 conn(0x7f4c7009b840 legacy=0x7f4c701387a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 shutdown_connections 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 >> 172.21.15.171:0/4062577784 conn(0x7f4c700a28a0 msgr2=0x7f4c70133df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 shutdown_connections 2024-04-25T23:58:12.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.284+0000 7f4c74b62640 1 -- 172.21.15.171:0/4062577784 wait complete. 2024-04-25T23:58:12.281 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:12.282 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c host2 2024-04-25T23:58:12.282 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 2 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient: get_monmap_and_config 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient: build_initial_monmap 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient: monmap: 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:12.408481+0000 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:12.408481+0000 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:12.389 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:12.390 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:12.390 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:12.390 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:12.390 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:12.390 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:12.390 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 1 Processor -- start 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 1 -- start start 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient: init 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient: _add_conns ranks=[7,0,5,2,3,6,8,1,4] 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient(hunting): picked mon.noname-i con 0x7f87801328a0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient(hunting): picked mon.noname-a con 0x7f878009b840 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient(hunting): picked mon.noname-h con 0x7f878009b3e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8780133390 con 0x7f878009b840 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878009cc80 con 0x7f878009b3e0 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878009c2a0 con 0x7f87801328a0 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8787fc6640 10 monclient(hunting): authenticate will time out at 1143.115408s 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8785d62640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f87801328a0 legacy=0x7f8780132c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:12.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8786563640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f878009b3e0 0x7f878013e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56254/0 (socket says 172.21.15.171:56254) 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8786563640 1 -- 172.21.15.171:0/1120529384 learned_addr learned my addr 172.21.15.171:0/1120529384 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822703501 0 0) 0x7f878009cc80 con 0x7f878009b3e0 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8784d60640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8784d60640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8784d60640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8784d60640 10 monclient(hunting): my global_id is 5333 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.404+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f876c003530 con 0x7f878009b3e0 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 448745810 0 0) 0x7f876c003530 con 0x7f878009b3e0 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 >> v1:172.21.15.171:6792/0 conn(0x7f87801328a0 legacy=0x7f8780132c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 >> v1:172.21.15.106:6789/0 conn(0x7f878009b840 legacy=0x7f878013aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: _finish_hunting 0 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 monclient: found mon.noname-h 2024-04-25T23:58:12.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878009f7b0 con 0x7f878009b3e0 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: _finish_auth 0 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: _check_auth_tickets 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8778001b40 con 0x7f878009b3e0 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 5 monclient: authenticate success, global_id 5333 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: dump: 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.399 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8778001ea0 con 0x7f878009b3e0 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:12.400 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 1 -- 172.21.15.171:0/1120529384 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8778004f70 con 0x7f878009b3e0 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8784d60640 10 monclient: dump: 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.401 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 4 set_mon_vals no callback set 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: shutdown 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/1120529384 >> v1:172.21.15.171:6791/0 conn(0x7f878009b3e0 legacy=0x7f878013e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/1120529384 shutdown_connections 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/1120529384 >> 172.21.15.171:0/1120529384 conn(0x7f87800a28a0 msgr2=0x7f87800a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/1120529384 shutdown_connections 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/1120529384 wait complete. 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: build_initial_monmap 2024-04-25T23:58:12.402 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: monmap: 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:12.403 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 Processor -- start 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- start start 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: init 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _add_conns ranks=[4,3,8,5,0,7,6,1,2] 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient(hunting): picked mon.noname-c con 0x7f878009b3e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient(hunting): picked mon.noname-g con 0x7f878009b840 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient(hunting): picked mon.noname-e con 0x7f87801328a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f878009e130 con 0x7f878009b840 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87801322c0 con 0x7f878009b3e0 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8780073100 con 0x7f87801328a0 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:12.404 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient(hunting): authenticate will time out at 1143.118409s 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8785d62640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f878009b3e0 legacy=0x7f878009d310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8786563640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f87801328a0 legacy=0x7f87801d4c30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8785561640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f878009b840 0x7f878009da20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53650/0 (socket says 172.21.15.171:53650) 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8785561640 1 -- 172.21.15.171:0/4111708701 learned_addr learned my addr 172.21.15.171:0/4111708701 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114991265 0 0) 0x7f878009e130 con 0x7f878009b840 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): my global_id is 5484 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8764003530 con 0x7f878009b840 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4239326189 0 0) 0x7f8764003530 con 0x7f878009b840 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f878009e130 con 0x7f878009b840 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f877c001ae0 con 0x7f878009b840 2024-04-25T23:58:12.405 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): dump: 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.406 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1827957234 0 0) 0x7f878009e130 con 0x7f878009b840 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 >> v1:172.21.15.106:6793/0 conn(0x7f87801328a0 legacy=0x7f87801d4c30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 >> v1:172.21.15.106:6791/0 conn(0x7f878009b3e0 legacy=0x7f878009d310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 monclient: found mon.g 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8780072c20 con 0x7f878009b840 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:12.407 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 5 monclient: authenticate success, global_id 5484 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _renew_subs 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8780135e70 con 0x7f878009b840 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _renew_subs 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f87801316a0 con 0x7f878009b840 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f877c0038d0 con 0x7f878009b840 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8777fff640 4 set_mon_vals no callback set 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f877c003e40 con 0x7f878009b840 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f87767fc640 10 monclient: dump: 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.408 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.409 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.408+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8768005090 con 0x7f878009b840 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.412+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f877c004060 con 0x7f878009b840 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.412+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(73..73 src has 1..73) ==== 5457+0+0 (unknown 744408293 0 0) 0x7f877c044d70 con 0x7f878009b840 2024-04-25T23:58:12.411 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.412+0000 7f8785d62640 10 monclient: get_auth_request con 0x7f8764037790 auth_method 0 2024-04-25T23:58:12.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.416+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f877c015930 con 0x7f878009b840 2024-04-25T23:58:12.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.416+0000 7f87767fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.416+0000 7f87767fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:12.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.560+0000 7f8787fc6640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:12.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.560+0000 7f8787fc6640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.560+0000 7f8787fc6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.560+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f8768005b90 con 0x7f878009b840 2024-04-25T23:58:12.547 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.564+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v73) ==== 56+0+1474 (unknown 4132081119 0 1770165666) 0x7f877c015230 con 0x7f878009b840 2024-04-25T23:58:12.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.564+0000 7f87767fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.564+0000 7f87767fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:12.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.652+0000 7f8787fc6640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:12.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.652+0000 7f8787fc6640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.652+0000 7f8787fc6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.652+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f8768005d60 con 0x7f878009b840 2024-04-25T23:58:12.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.652+0000 7f87767fc640 1 -- 172.21.15.171:0/4111708701 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v73) ==== 56+0+1474 (unknown 4132081119 0 1770165666) 0x7f877c01dde0 con 0x7f878009b840 2024-04-25T23:58:12.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.652+0000 7f87767fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:12.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.652+0000 7f87767fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:12.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 >> v1:172.21.15.171:6812/722422047 conn(0x7f8764037790 legacy=0x7f8764039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 10 monclient: shutdown 2024-04-25T23:58:12.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:12.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 >> v1:172.21.15.171:6790/0 conn(0x7f878009b840 legacy=0x7f878009da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 shutdown_connections 2024-04-25T23:58:12.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 >> 172.21.15.171:0/4111708701 conn(0x7f87800a28a0 msgr2=0x7f8780133560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:12.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 shutdown_connections 2024-04-25T23:58:12.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.656+0000 7f8787fc6640 1 -- 172.21.15.171:0/4111708701 wait complete. 2024-04-25T23:58:12.654 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush rm host1 foo 2024-04-25T23:58:12.654 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:12.654 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm host1 foo 2024-04-25T23:58:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient: get_monmap_and_config 2024-04-25T23:58:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient: build_initial_monmap 2024-04-25T23:58:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient: monmap: 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:12.788186+0000 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:12.788186+0000 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:12.770 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 1 Processor -- start 2024-04-25T23:58:12.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 1 -- start start 2024-04-25T23:58:12.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient: init 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient: _add_conns ranks=[3,5,6,1,8,0,2,4,7] 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient(hunting): picked mon.noname-g con 0x7fe490135b00 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient(hunting): picked mon.noname-h con 0x7fe49009ca00 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient(hunting): picked mon.noname-d con 0x7fe49013c080 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe49009c5f0 con 0x7fe490135b00 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4900a0020 con 0x7fe49009ca00 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe49009ce20 con 0x7fe49013c080 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe4960f2640 10 monclient(hunting): authenticate will time out at 1143.495893s 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe48effd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe49009ca00 0x7fe49013a960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56262/0 (socket says 172.21.15.171:56262) 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe48effd640 1 -- 172.21.15.171:0/2413767237 learned_addr learned my addr 172.21.15.171:0/2413767237 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:12.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.784+0000 7fe48f7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fe490135b00 0x7fe490135ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53666/0 (socket says 172.21.15.171:53666) 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885560174 0 0) 0x7fe49009c5f0 con 0x7fe490135b00 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): my global_id is 5493 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe478003530 con 0x7fe490135b00 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1818739921 0 0) 0x7fe4900a0020 con 0x7fe49009ca00 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient(hunting): my global_id is 5342 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe49009c5f0 con 0x7fe49009ca00 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4256677704 0 0) 0x7fe478003530 con 0x7fe490135b00 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 >> v1:172.21.15.106:6792/0 conn(0x7fe49013c080 legacy=0x7fe49013e470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 >> v1:172.21.15.171:6791/0 conn(0x7fe49009ca00 legacy=0x7fe49013a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 monclient: found mon.noname-g 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4900a28b0 con 0x7fe490135b00 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe4800017c0 con 0x7fe490135b00 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 5 monclient: authenticate success, global_id 5493 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: dump: 2024-04-25T23:58:12.780 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.781 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4800019b0 con 0x7fe490135b00 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 1 -- 172.21.15.171:0/2413767237 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe480004b30 con 0x7fe490135b00 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48e7fc640 10 monclient: dump: 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.782 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 4 set_mon_vals no callback set 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: shutdown 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- 172.21.15.171:0/2413767237 >> v1:172.21.15.171:6790/0 conn(0x7fe490135b00 legacy=0x7fe490135ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- 172.21.15.171:0/2413767237 shutdown_connections 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- 172.21.15.171:0/2413767237 >> 172.21.15.171:0/2413767237 conn(0x7fe4900a6540 msgr2=0x7fe4900a6950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- 172.21.15.171:0/2413767237 shutdown_connections 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- 172.21.15.171:0/2413767237 wait complete. 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: build_initial_monmap 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: monmap: 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:12.784 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 Processor -- start 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- start start 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: init 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: _add_conns ranks=[5,0,3,1,4,6,7,2,8] 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient(hunting): picked mon.noname-h con 0x7fe49009ca00 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:12.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient(hunting): picked mon.noname-a con 0x7fe490135b00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient(hunting): picked mon.noname-g con 0x7fe49013c080 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4900a38e0 con 0x7fe490135b00 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe490072670 con 0x7fe49013c080 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe490072be0 con 0x7fe49009ca00 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient(hunting): authenticate will time out at 1143.498740s 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48f7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe49009ca00 0x7fe490071850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56274/0 (socket says 172.21.15.171:56274) 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48f7fe640 1 -- 172.21.15.171:0/3281275293 learned_addr learned my addr 172.21.15.171:0/3281275293 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4267205955 0 0) 0x7fe490072be0 con 0x7fe49009ca00 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): my global_id is 5351 2024-04-25T23:58:12.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe47c003530 con 0x7fe49009ca00 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 842687939 0 0) 0x7fe490072670 con 0x7fe49013c080 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): my global_id is 5502 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe490072be0 con 0x7fe49013c080 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 404267633 0 0) 0x7fe47c003530 con 0x7fe49009ca00 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe490072670 con 0x7fe49009ca00 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 836306097 0 0) 0x7fe490072be0 con 0x7fe49013c080 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe47c003530 con 0x7fe49013c080 2024-04-25T23:58:12.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe480001440 con 0x7fe49009ca00 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): dump: 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe488001c80 con 0x7fe49013c080 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): dump: 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.789 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 930848736 0 0) 0x7fe4900a38e0 con 0x7fe490135b00 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient(hunting): my global_id is 5382 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe490072be0 con 0x7fe490135b00 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2082945531 0 0) 0x7fe490072670 con 0x7fe49009ca00 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 >> v1:172.21.15.171:6790/0 conn(0x7fe49013c080 legacy=0x7fe4901d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 >> v1:172.21.15.106:6789/0 conn(0x7fe490135b00 legacy=0x7fe490071f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 monclient: found mon.h 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe49009d090 con 0x7fe49009ca00 2024-04-25T23:58:12.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 5 monclient: authenticate success, global_id 5351 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: _renew_subs 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4901358d0 con 0x7fe49009ca00 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: _renew_subs 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe4960f2640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4900732a0 con 0x7fe49009ca00 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4800019b0 con 0x7fe49009ca00 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe4800011c0 con 0x7fe49009ca00 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:12.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe48dffb640 4 set_mon_vals no callback set 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.788+0000 7fe477fff640 10 monclient: dump: 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:12.793 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.792+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe48000fff0 con 0x7fe49009ca00 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.792+0000 7fe4960f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.792+0000 7fe4960f2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.792+0000 7fe4960f2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.792+0000 7fe4960f2640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe470005090 con 0x7fe49009ca00 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.792+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(73..73 src has 1..73) ==== 5457+0+0 (unknown 744408293 0 0) 0x7fe480044d20 con 0x7fe49009ca00 2024-04-25T23:58:12.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.792+0000 7fe48effd640 10 monclient: get_auth_request con 0x7fe47c037e60 auth_method 0 2024-04-25T23:58:12.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.796+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe4800158e0 con 0x7fe49009ca00 2024-04-25T23:58:12.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.796+0000 7fe477fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:12.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.796+0000 7fe477fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:12.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.960+0000 7fe4960f2640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:12.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.960+0000 7fe4960f2640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:12.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.960+0000 7fe4960f2640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:12.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.960+0000 7fe4960f2640 1 -- 172.21.15.171:0/3281275293 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "host1", "ancestor": "foo"} v 0) -- 0x7fe470005b90 con 0x7fe49009ca00 2024-04-25T23:58:12.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.964+0000 7fe477fff640 1 -- 172.21.15.171:0/3281275293 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "host1", "ancestor": "foo"}]=-39 (39) Directory not empty v73) ==== 120+0+0 (unknown 2381247391 0 0) 0x7fe480001780 con 0x7fe49009ca00 2024-04-25T23:58:12.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.964+0000 7fe477fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:12.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:12.964+0000 7fe477fff640 10 monclient: _finish_command 2 = mon:39 (39) Directory not empty 2024-04-25T23:58:12.949 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOTEMPTY: (39) Directory not empty 2024-04-25T23:58:12.953 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:12.953 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush unlink host1 foo 2024-04-25T23:58:13.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 10 monclient: get_monmap_and_config 2024-04-25T23:58:13.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 10 monclient: build_initial_monmap 2024-04-25T23:58:13.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 10 monclient: monmap: 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:13.085139+0000 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:13.085139+0000 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:13.066 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:13.067 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:13.067 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:13.067 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 1 Processor -- start 2024-04-25T23:58:13.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 1 -- start start 2024-04-25T23:58:13.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 10 monclient: init 2024-04-25T23:58:13.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:13.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.080+0000 7fbf89bff640 10 monclient: _add_conns ranks=[2,1,3,8,4,7,6,0,5] 2024-04-25T23:58:13.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): picked mon.noname-b con 0x7fbf840a1530 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): picked mon.noname-f con 0x7fbf84071c00 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): picked mon.noname-g con 0x7fbf84071730 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf8406ea70 con 0x7fbf84071c00 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf840723d0 con 0x7fbf840a1530 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf84072990 con 0x7fbf84071730 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): authenticate will time out at 1143.792093s 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf82ffd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fbf84071c00 legacy=0x7fbf8413ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf83fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbf84071730 0x7fbf8413e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53688/0 (socket says 172.21.15.171:53688) 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf83fff640 1 -- 172.21.15.171:0/570503627 learned_addr learned my addr 172.21.15.171:0/570503627 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1660478832 0 0) 0x7fbf84072990 con 0x7fbf84071730 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:13.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient(hunting): my global_id is 5511 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf6c003530 con 0x7fbf84071730 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 922421765 0 0) 0x7fbf6c003530 con 0x7fbf84071730 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 >> v1:172.21.15.106:6790/0 conn(0x7fbf840a1530 legacy=0x7fbf840a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 >> v1:172.21.15.171:6789/0 conn(0x7fbf84071c00 legacy=0x7fbf8413ab90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 monclient: found mon.noname-g 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf840a3100 con 0x7fbf84071730 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf740017c0 con 0x7fbf84071730 2024-04-25T23:58:13.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 5 monclient: authenticate success, global_id 5511 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: dump: 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.076 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf74001b20 con 0x7fbf84071730 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 4 set_mon_vals no callback set 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 1 -- 172.21.15.171:0/570503627 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf74004bf0 con 0x7fbf84071730 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf827fc640 10 monclient: dump: 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.077 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient: shutdown 2024-04-25T23:58:13.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- 172.21.15.171:0/570503627 >> v1:172.21.15.171:6790/0 conn(0x7fbf84071730 legacy=0x7fbf8413e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- 172.21.15.171:0/570503627 shutdown_connections 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- 172.21.15.171:0/570503627 >> 172.21.15.171:0/570503627 conn(0x7fbf840a62d0 msgr2=0x7fbf840a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- 172.21.15.171:0/570503627 shutdown_connections 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- 172.21.15.171:0/570503627 wait complete. 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient: build_initial_monmap 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient: monmap: 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:13.079 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 Processor -- start 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- start start 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient: init 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient: _add_conns ranks=[1,0,2,5,3,4,7,8,6] 2024-04-25T23:58:13.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): picked mon.noname-f con 0x7fbf84071730 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): picked mon.noname-a con 0x7fbf84071c00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): picked mon.noname-b con 0x7fbf840a1530 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf84127c70 con 0x7fbf84071c00 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf8409fb20 con 0x7fbf84071730 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf84125980 con 0x7fbf840a1530 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf89bff640 10 monclient(hunting): authenticate will time out at 1143.795058s 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf837fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fbf84071730 legacy=0x7fbf841cc610 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf82ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbf84071c00 0x7fbf841d1660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:40840/0 (socket says 172.21.15.171:40840) 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf82ffd640 1 -- 172.21.15.171:0/771243262 learned_addr learned my addr 172.21.15.171:0/771243262 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf83fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fbf840a1530 0x7fbf841d4d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51156/0 (socket says 172.21.15.171:51156) 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220360698 0 0) 0x7fbf84127c70 con 0x7fbf84071c00 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:13.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): my global_id is 5391 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf70003530 con 0x7fbf84071c00 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2372042239 0 0) 0x7fbf84125980 con 0x7fbf840a1530 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 10 monclient(hunting): my global_id is 5339 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.084+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf84127c70 con 0x7fbf840a1530 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3374140879 0 0) 0x7fbf70003530 con 0x7fbf84071c00 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf84125980 con 0x7fbf84071c00 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf7c004680 con 0x7fbf84071c00 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:13.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient(hunting): dump: 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.083 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1370221531 0 0) 0x7fbf84127c70 con 0x7fbf840a1530 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf70003530 con 0x7fbf840a1530 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf74001780 con 0x7fbf840a1530 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient(hunting): dump: 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.084 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3586931297 0 0) 0x7fbf84125980 con 0x7fbf84071c00 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 >> v1:172.21.15.106:6790/0 conn(0x7fbf840a1530 legacy=0x7fbf841d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 >> v1:172.21.15.171:6789/0 conn(0x7fbf84071730 legacy=0x7fbf841cc610 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:13.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 monclient: found mon.a 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf84127990 con 0x7fbf84071c00 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: _finish_auth 0 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 5 monclient: authenticate success, global_id 5391 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 10 monclient: _renew_subs 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf841264e0 con 0x7fbf84071c00 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 10 monclient: _renew_subs 2024-04-25T23:58:13.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf84124e90 con 0x7fbf84071c00 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbf7c004930 con 0x7fbf84071c00 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbf7c004ea0 con 0x7fbf84071c00 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf81ffb640 4 set_mon_vals no callback set 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 10 monclient: dump: 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.087 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf64005090 con 0x7fbf84071c00 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbf7c005040 con 0x7fbf84071c00 2024-04-25T23:58:13.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(73..73 src has 1..73) ==== 5457+0+0 (unknown 744408293 0 0) 0x7fbf7c044e60 con 0x7fbf84071c00 2024-04-25T23:58:13.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.088+0000 7fbf837fe640 10 monclient: get_auth_request con 0x7fbf70037e00 auth_method 0 2024-04-25T23:58:13.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.100+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbf7c0159e0 con 0x7fbf84071c00 2024-04-25T23:58:13.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.100+0000 7fbf6bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:13.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.100+0000 7fbf6bfff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:13.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.252+0000 7fbf89bff640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:13.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.252+0000 7fbf89bff640 10 monclient: _send_command 2 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:13.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.252+0000 7fbf89bff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:13.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.252+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"} v 0) -- 0x7fbf64005b90 con 0x7fbf84071c00 2024-04-25T23:58:13.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.620+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}]=0 removed item id -11 name 'host1' from crush map v74) ==== 147+0+0 (unknown 2678557947 0 0) 0x7fbf7c0152e0 con 0x7fbf84071c00 2024-04-25T23:58:13.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.620+0000 7fbf6bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:13.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.620+0000 7fbf6bfff640 10 monclient: _finish_command 2 = system:0 removed item id -11 name 'host1' from crush map 2024-04-25T23:58:13.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.720+0000 7fbf89bff640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:13.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.720+0000 7fbf89bff640 10 monclient: _send_command 3 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:13.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.720+0000 7fbf89bff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:13.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.720+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"} v 0) -- 0x7fbf640010a0 con 0x7fbf84071c00 2024-04-25T23:58:13.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.720+0000 7fbf6bfff640 1 -- 172.21.15.171:0/771243262 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}]=0 item -11 does not appear in that position v74) ==== 141+0+0 (unknown 3819635062 0 0) 0x7fbf7c014ca0 con 0x7fbf84071c00 2024-04-25T23:58:13.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.720+0000 7fbf6bfff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:13.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.720+0000 7fbf6bfff640 10 monclient: _finish_command 3 = system:0 item -11 does not appear in that position 2024-04-25T23:58:13.706 INFO:tasks.workunit.client.0.smithi171.stderr:item -11 does not appear in that position 2024-04-25T23:58:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 >> v1:172.21.15.171:6812/722422047 conn(0x7fbf70037e00 legacy=0x7fbf7003a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 10 monclient: shutdown 2024-04-25T23:58:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 >> v1:172.21.15.106:6789/0 conn(0x7fbf84071c00 legacy=0x7fbf841d1660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 shutdown_connections 2024-04-25T23:58:13.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 >> 172.21.15.171:0/771243262 conn(0x7fbf840a62d0 msgr2=0x7fbf840a44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:13.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 shutdown_connections 2024-04-25T23:58:13.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.724+0000 7fbf89bff640 1 -- 172.21.15.171:0/771243262 wait complete. 2024-04-25T23:58:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush unlink host1 foo 2024-04-25T23:58:13.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient: get_monmap_and_config 2024-04-25T23:58:13.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient: build_initial_monmap 2024-04-25T23:58:13.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient: monmap: 2024-04-25T23:58:13.841 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:13.841 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:13.860987+0000 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:13.860987+0000 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:13.842 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:13.843 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:13.843 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:13.843 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 1 Processor -- start 2024-04-25T23:58:13.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 1 -- start start 2024-04-25T23:58:13.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient: init 2024-04-25T23:58:13.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:13.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient: _add_conns ranks=[8,4,3,1,7,5,0,6,2] 2024-04-25T23:58:13.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient(hunting): picked mon.noname-e con 0x7f2e9c0a1530 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient(hunting): picked mon.noname-c con 0x7f2e9c071c00 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient(hunting): picked mon.noname-g con 0x7f2e9c071730 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c06ea70 con 0x7f2e9c071730 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c0723d0 con 0x7f2e9c071c00 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c072990 con 0x7f2e9c0a1530 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.856+0000 7f2ea322d640 10 monclient(hunting): authenticate will time out at 1144.567985s 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9bfff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f2e9c071c00 legacy=0x7f2e9c13ab90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea0fc9640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f2e9c0a1530 legacy=0x7f2e9c0a1910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea17ca640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2e9c071730 0x7f2e9c13e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53702/0 (socket says 172.21.15.171:53702) 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea17ca640 1 -- 172.21.15.171:0/4122786879 learned_addr learned my addr 172.21.15.171:0/4122786879 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:13.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214968801 0 0) 0x7f2e9c06ea70 con 0x7f2e9c071730 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient(hunting): my global_id is 5520 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e88003530 con 0x7f2e9c071730 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 809358984 0 0) 0x7f2e88003530 con 0x7f2e9c071730 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 >> v1:172.21.15.106:6793/0 conn(0x7f2e9c0a1530 legacy=0x7f2e9c0a1910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 >> v1:172.21.15.106:6791/0 conn(0x7f2e9c071c00 legacy=0x7f2e9c13ab90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 monclient: found mon.noname-g 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c0a3100 con 0x7f2e9c071730 2024-04-25T23:58:13.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e94001b40 con 0x7f2e9c071730 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 5 monclient: authenticate success, global_id 5520 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: dump: 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.853 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e94001ea0 con 0x7f2e9c071730 2024-04-25T23:58:13.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 1 -- 172.21.15.171:0/4122786879 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e940020d0 con 0x7f2e9c071730 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 4 set_mon_vals no callback set 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9b7fe640 10 monclient: dump: 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.855 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: shutdown 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- 172.21.15.171:0/4122786879 >> v1:172.21.15.171:6790/0 conn(0x7f2e9c071730 legacy=0x7f2e9c13e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- 172.21.15.171:0/4122786879 shutdown_connections 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- 172.21.15.171:0/4122786879 >> 172.21.15.171:0/4122786879 conn(0x7f2e9c0a62d0 msgr2=0x7f2e9c0a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- 172.21.15.171:0/4122786879 shutdown_connections 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- 172.21.15.171:0/4122786879 wait complete. 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: build_initial_monmap 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: monmap: 2024-04-25T23:58:13.856 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 Processor -- start 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- start start 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: init 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: _add_conns ranks=[8,3,4,5,0,1,2,7,6] 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient(hunting): picked mon.noname-e con 0x7f2e9c071730 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient(hunting): picked mon.noname-g con 0x7f2e9c071c00 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient(hunting): picked mon.noname-c con 0x7f2e9c0a1530 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c122030 con 0x7f2e9c071c00 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c09fb20 con 0x7f2e9c0a1530 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9c09f660 con 0x7f2e9c071730 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient(hunting): authenticate will time out at 1144.570932s 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9bfff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2e9c071c00 0x7f2e9c1ceeb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53712/0 (socket says 172.21.15.171:53712) 2024-04-25T23:58:13.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9bfff640 1 -- 172.21.15.171:0/3091717999 learned_addr learned my addr 172.21.15.171:0/3091717999 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea0fc9640 1 -- 172.21.15.171:0/3091717999 >> v1:172.21.15.106:6793/0 conn(0x7f2e9c071730 legacy=0x7f2e9c132860 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea17ca640 1 -- 172.21.15.171:0/3091717999 >> v1:172.21.15.106:6791/0 conn(0x7f2e9c0a1530 legacy=0x7f2e9c1d25e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2307269737 0 0) 0x7f2e9c122030 con 0x7f2e9c071c00 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): my global_id is 5529 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e7c003530 con 0x7f2e9c071c00 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3215244502 0 0) 0x7f2e7c003530 con 0x7f2e9c071c00 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e9c122030 con 0x7f2e9c071c00 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e8c004380 con 0x7f2e9c071c00 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:13.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): dump: 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.860 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2438159665 0 0) 0x7f2e9c122030 con 0x7f2e9c071c00 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 >> v1:172.21.15.106:6793/0 conn(0x7f2e9c071730 legacy=0x7f2e9c132860 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 >> v1:172.21.15.106:6791/0 conn(0x7f2e9c0a1530 legacy=0x7f2e9c1d25e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 monclient: found mon.g 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e9c11fd40 con 0x7f2e9c071c00 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 5 monclient: authenticate success, global_id 5529 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: _renew_subs 2024-04-25T23:58:13.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e9c121d50 con 0x7f2e9c071c00 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: _renew_subs 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e9c132f70 con 0x7f2e9c071c00 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e8c004670 con 0x7f2e9c071c00 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e8c004be0 con 0x7f2e9c071c00 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e997fa640 10 monclient: dump: 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.862 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.860+0000 7f2e9affd640 4 set_mon_vals no callback set 2024-04-25T23:58:13.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.864+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2e8c004e40 con 0x7f2e9c071c00 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.864+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 5449+0+0 (unknown 2194390100 0 0) 0x7f2e8c044dc0 con 0x7f2e9c071c00 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.864+0000 7f2ea322d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.864+0000 7f2ea322d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.864+0000 7f2ea322d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.864+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e9c04f510 con 0x7f2e9c071c00 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.864+0000 7f2ea0fc9640 10 monclient: get_auth_request con 0x7f2e7c037760 auth_method 0 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.868+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2e8c0158f0 con 0x7f2e9c071c00 2024-04-25T23:58:13.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.868+0000 7f2e997fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:13.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:13.868+0000 7f2e997fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:14.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.020+0000 7f2ea322d640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:14.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.020+0000 7f2ea322d640 10 monclient: _send_command 2 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:14.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.020+0000 7f2ea322d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:14.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.020+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"} v 0) -- 0x7f2e9c09cc20 con 0x7f2e9c071c00 2024-04-25T23:58:14.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.020+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}]=0 item -11 does not appear in that position v74) ==== 141+0+0 (unknown 3819635062 0 0) 0x7f2e8c0151f0 con 0x7f2e9c071c00 2024-04-25T23:58:14.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.020+0000 7f2e997fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:14.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.020+0000 7f2e997fa640 10 monclient: _finish_command 2 = system:0 item -11 does not appear in that position 2024-04-25T23:58:14.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.112+0000 7f2ea322d640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:14.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.112+0000 7f2ea322d640 10 monclient: _send_command 3 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:14.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.112+0000 7f2ea322d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:14.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.112+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"} v 0) -- 0x7f2e9c0008e0 con 0x7f2e9c071c00 2024-04-25T23:58:14.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.112+0000 7f2e997fa640 1 -- 172.21.15.171:0/3091717999 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}]=0 item -11 does not appear in that position v74) ==== 141+0+0 (unknown 3819635062 0 0) 0x7f2e8c019540 con 0x7f2e9c071c00 2024-04-25T23:58:14.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2e997fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "foo"}] 2024-04-25T23:58:14.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2e997fa640 10 monclient: _finish_command 3 = system:0 item -11 does not appear in that position 2024-04-25T23:58:14.099 INFO:tasks.workunit.client.0.smithi171.stderr:item -11 does not appear in that position 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 >> v1:172.21.15.171:6812/722422047 conn(0x7f2e7c037760 legacy=0x7f2e7c039c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 10 monclient: shutdown 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 >> v1:172.21.15.171:6790/0 conn(0x7f2e9c071c00 legacy=0x7f2e9c1ceeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 shutdown_connections 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 >> 172.21.15.171:0/3091717999 conn(0x7f2e9c0a62d0 msgr2=0x7f2e9c1bb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 shutdown_connections 2024-04-25T23:58:14.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.116+0000 7f2ea322d640 1 -- 172.21.15.171:0/3091717999 wait complete. 2024-04-25T23:58:14.114 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:14.114 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c host1 2024-04-25T23:58:14.115 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 1 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient: get_monmap_and_config 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient: build_initial_monmap 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient: monmap: 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:14.236907+0000 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:14.236907+0000 2024-04-25T23:58:14.217 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:14.218 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 1 Processor -- start 2024-04-25T23:58:14.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 1 -- start start 2024-04-25T23:58:14.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient: init 2024-04-25T23:58:14.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient: _add_conns ranks=[5,6,4,1,7,3,8,0,2] 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient(hunting): picked mon.noname-h con 0x7f91941328a0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient(hunting): picked mon.noname-d con 0x7f919409b840 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient(hunting): picked mon.noname-c con 0x7f919409b3e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9194133390 con 0x7f919409b3e0 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919409cc80 con 0x7f91941328a0 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919409c2a0 con 0x7f919409b840 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919ab01640 10 monclient(hunting): authenticate will time out at 1144.943768s 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919889d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f91941328a0 0x7f9194132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56288/0 (socket says 172.21.15.171:56288) 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919889d640 1 -- 172.21.15.171:0/1979714848 learned_addr learned my addr 172.21.15.171:0/1979714848 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.232+0000 7f919909e640 1 -- 172.21.15.171:0/1979714848 >> v1:172.21.15.106:6791/0 conn(0x7f919409b3e0 legacy=0x7f919413e1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:14.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3155518227 0 0) 0x7f919409cc80 con 0x7f91941328a0 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient(hunting): my global_id is 5360 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f917c003530 con 0x7f91941328a0 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930739283 0 0) 0x7f917c003530 con 0x7f91941328a0 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 >> v1:172.21.15.106:6792/0 conn(0x7f919409b840 legacy=0x7f919413aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 >> v1:172.21.15.106:6791/0 conn(0x7f919409b3e0 legacy=0x7f919413e1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 monclient: found mon.noname-h 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919409f7b0 con 0x7f91941328a0 2024-04-25T23:58:14.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f91880017c0 con 0x7f91941328a0 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: dump: 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.227 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 5 monclient: authenticate success, global_id 5360 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9188001b20 con 0x7f91941328a0 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:14.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 1 -- 172.21.15.171:0/1979714848 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9188001d50 con 0x7f91941328a0 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91937fe640 10 monclient: dump: 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.229 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 4 set_mon_vals no callback set 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: shutdown 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- 172.21.15.171:0/1979714848 >> v1:172.21.15.171:6791/0 conn(0x7f91941328a0 legacy=0x7f9194132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- 172.21.15.171:0/1979714848 shutdown_connections 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- 172.21.15.171:0/1979714848 >> 172.21.15.171:0/1979714848 conn(0x7f91940a28a0 msgr2=0x7f91940a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- 172.21.15.171:0/1979714848 shutdown_connections 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- 172.21.15.171:0/1979714848 wait complete. 2024-04-25T23:58:14.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: build_initial_monmap 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: monmap: 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:14.231 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 Processor -- start 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- start start 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: init 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: _add_conns ranks=[4,5,6,1,0,2,3,8,7] 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient(hunting): picked mon.noname-c con 0x7f919409b3e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient(hunting): picked mon.noname-h con 0x7f919409b840 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient(hunting): picked mon.noname-d con 0x7f91941328a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9194073100 con 0x7f919409b3e0 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9194072c20 con 0x7f919409b840 2024-04-25T23:58:14.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f919413b8c0 con 0x7f91941328a0 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient(hunting): authenticate will time out at 1144.946520s 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919889d640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f919409b3e0 legacy=0x7f91941caba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f9193fff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f919409b840 0x7f91941cfb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56296/0 (socket says 172.21.15.171:56296) 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f9193fff640 1 -- 172.21.15.171:0/788723571 learned_addr learned my addr 172.21.15.171:0/788723571 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 747689055 0 0) 0x7f9194072c20 con 0x7f919409b840 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): my global_id is 5369 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9180003530 con 0x7f919409b840 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3675568439 0 0) 0x7f9180003530 con 0x7f919409b840 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9194072c20 con 0x7f919409b840 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9184001e60 con 0x7f919409b840 2024-04-25T23:58:14.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): dump: 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.234 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1958895790 0 0) 0x7f919413b8c0 con 0x7f91941328a0 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient(hunting): my global_id is 5415 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9180003530 con 0x7f91941328a0 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3195645371 0 0) 0x7f9194072c20 con 0x7f919409b840 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 >> v1:172.21.15.106:6792/0 conn(0x7f91941328a0 legacy=0x7f91941d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 >> v1:172.21.15.106:6791/0 conn(0x7f919409b3e0 legacy=0x7f91941caba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:14.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 monclient: found mon.h 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f919413bba0 con 0x7f919409b840 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 5 monclient: authenticate success, global_id 5369 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: _renew_subs 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f919413be80 con 0x7f919409b840 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: _renew_subs 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f919413a290 con 0x7f919409b840 2024-04-25T23:58:14.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9184003cd0 con 0x7f919409b840 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f91840041c0 con 0x7f919409b840 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91927fc640 4 set_mon_vals no callback set 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.236+0000 7f91917fa640 10 monclient: dump: 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.237 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.240+0000 7f919ab01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.240+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f91840043e0 con 0x7f919409b840 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.240+0000 7f919ab01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.240+0000 7f919ab01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.240+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9174005090 con 0x7f919409b840 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.240+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(74..74 src has 1..74) ==== 5449+0+0 (unknown 2194390100 0 0) 0x7f91840451d0 con 0x7f919409b840 2024-04-25T23:58:14.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.240+0000 7f919889d640 10 monclient: get_auth_request con 0x7f91800377b0 auth_method 0 2024-04-25T23:58:14.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.244+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9184015ca0 con 0x7f919409b840 2024-04-25T23:58:14.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.244+0000 7f91917fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.244+0000 7f91917fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:14.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.400+0000 7f919ab01640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:14.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.400+0000 7f919ab01640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:14.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.400+0000 7f919ab01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:14.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.400+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f9174005b90 con 0x7f919409b840 2024-04-25T23:58:14.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.400+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v74) ==== 56+0+1340 (unknown 1366924582 0 1215442627) 0x7f9184019950 con 0x7f919409b840 2024-04-25T23:58:14.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.400+0000 7f91917fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:14.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.400+0000 7f91917fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:14.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.488+0000 7f919ab01640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:14.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.488+0000 7f919ab01640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:14.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.488+0000 7f919ab01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:14.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.488+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f9174005d60 con 0x7f919409b840 2024-04-25T23:58:14.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.488+0000 7f91917fa640 1 -- 172.21.15.171:0/788723571 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v74) ==== 56+0+1340 (unknown 1366924582 0 1215442627) 0x7f918401e210 con 0x7f919409b840 2024-04-25T23:58:14.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.488+0000 7f91917fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:14.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.488+0000 7f91917fa640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:14.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 >> v1:172.21.15.171:6812/722422047 conn(0x7f91800377b0 legacy=0x7f9180039c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 10 monclient: shutdown 2024-04-25T23:58:14.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:14.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 >> v1:172.21.15.171:6791/0 conn(0x7f919409b840 legacy=0x7f91941cfb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 shutdown_connections 2024-04-25T23:58:14.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 >> 172.21.15.171:0/788723571 conn(0x7f91940a28a0 msgr2=0x7f919413f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:14.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 shutdown_connections 2024-04-25T23:58:14.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.492+0000 7f919ab01640 1 -- 172.21.15.171:0/788723571 wait complete. 2024-04-25T23:58:14.489 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush rm foo 2024-04-25T23:58:14.490 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:14.490 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm foo 2024-04-25T23:58:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient: get_monmap_and_config 2024-04-25T23:58:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient: build_initial_monmap 2024-04-25T23:58:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient: monmap: 2024-04-25T23:58:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:14.623876+0000 2024-04-25T23:58:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:14.623876+0000 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:14.605 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:14.606 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:14.606 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:14.606 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 1 Processor -- start 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 1 -- start start 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient: init 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient: _add_conns ranks=[2,3,6,7,0,8,4,1,5] 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient(hunting): picked mon.noname-b con 0x7f37200a1750 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient(hunting): picked mon.noname-g con 0x7f37200a1b30 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient(hunting): picked mon.noname-d con 0x7f37200a1f10 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3720072870 con 0x7f37200a1750 2024-04-25T23:58:14.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3720072b50 con 0x7f37200a1b30 2024-04-25T23:58:14.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37200a5300 con 0x7f37200a1f10 2024-04-25T23:58:14.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:14.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f3724d07640 10 monclient(hunting): authenticate will time out at 1145.331738s 2024-04-25T23:58:14.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f371dd9b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f37200a1b30 0x7f372013a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53724/0 (socket says 172.21.15.171:53724) 2024-04-25T23:58:14.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.620+0000 7f371dd9b640 1 -- 172.21.15.171:0/3497519745 learned_addr learned my addr 172.21.15.171:0/3497519745 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839790942 0 0) 0x7f3720072b50 con 0x7f37200a1b30 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): my global_id is 5538 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3708003530 con 0x7f37200a1b30 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2822386620 0 0) 0x7f37200a5300 con 0x7f37200a1f10 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient(hunting): my global_id is 5424 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3720072b50 con 0x7f37200a1f10 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1341736512 0 0) 0x7f3708003530 con 0x7f37200a1b30 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 >> v1:172.21.15.106:6792/0 conn(0x7f37200a1f10 legacy=0x7f372013e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 >> v1:172.21.15.106:6790/0 conn(0x7f37200a1750 legacy=0x7f3720135bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 monclient: found mon.noname-g 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37201427f0 con 0x7f37200a1b30 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: _finish_auth 0 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37140017c0 con 0x7f37200a1b30 2024-04-25T23:58:14.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: dump: 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.616 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 5 monclient: authenticate success, global_id 5538 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3714001a20 con 0x7f37200a1b30 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 1 -- 172.21.15.171:0/3497519745 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3714004bf0 con 0x7f37200a1b30 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f371d59a640 10 monclient: dump: 2024-04-25T23:58:14.617 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.618 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 4 set_mon_vals no callback set 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 10 monclient: shutdown 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 1 -- 172.21.15.171:0/3497519745 >> v1:172.21.15.171:6790/0 conn(0x7f37200a1b30 legacy=0x7f372013a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 1 -- 172.21.15.171:0/3497519745 shutdown_connections 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 1 -- 172.21.15.171:0/3497519745 >> 172.21.15.171:0/3497519745 conn(0x7f37200a85a0 msgr2=0x7f37200a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 1 -- 172.21.15.171:0/3497519745 shutdown_connections 2024-04-25T23:58:14.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 1 -- 172.21.15.171:0/3497519745 wait complete. 2024-04-25T23:58:14.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 10 monclient: build_initial_monmap 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.628+0000 7f3724d07640 10 monclient: monmap: 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:14.621 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 1 Processor -- start 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 1 -- start start 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient: init 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient: _add_conns ranks=[0,2,8,5,6,1,7,4,3] 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient(hunting): picked mon.noname-a con 0x7f37200a1750 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient(hunting): picked mon.noname-b con 0x7f37200a1b30 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:14.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient(hunting): picked mon.noname-e con 0x7f37200a1f10 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f372013af10 con 0x7f37200a1750 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37200717a0 con 0x7f37200a1b30 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3720071af0 con 0x7f37200a1f10 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f3724d07640 10 monclient(hunting): authenticate will time out at 1145.341234s 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f371ed9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f37200a1f10 legacy=0x7f37201d3070 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f371dd9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f37200a1b30 0x7f37201cf940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51182/0 (socket says 172.21.15.171:51182) 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f371e59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f37200a1750 0x7f37201ca960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:40852/0 (socket says 172.21.15.171:40852) 2024-04-25T23:58:14.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.632+0000 7f371dd9b640 1 -- 172.21.15.171:0/3157092219 learned_addr learned my addr 172.21.15.171:0/3157092219 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:14.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4233924551 0 0) 0x7f37200717a0 con 0x7f37200a1b30 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): my global_id is 5348 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3700003530 con 0x7f37200a1b30 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2296060392 0 0) 0x7f372013af10 con 0x7f37200a1750 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): my global_id is 5400 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37200717a0 con 0x7f37200a1750 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 812111369 0 0) 0x7f3700003530 con 0x7f37200a1b30 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f372013af10 con 0x7f37200a1b30 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3714004b30 con 0x7f37200a1b30 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:14.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:14.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): dump: 2024-04-25T23:58:14.629 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.629 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.629 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.629 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.629 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.629 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.630 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.630 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.630 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.630 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.630 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.630 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.631 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.631 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.631 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.631 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:14.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2585393667 0 0) 0x7f37200717a0 con 0x7f37200a1750 2024-04-25T23:58:14.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3700003530 con 0x7f37200a1750 2024-04-25T23:58:14.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3710001a10 con 0x7f37200a1750 2024-04-25T23:58:14.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:14.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:14.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient(hunting): dump: 2024-04-25T23:58:14.632 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.632 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.632 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.633 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.634 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.634 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.634 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.634 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3109219654 0 0) 0x7f372013af10 con 0x7f37200a1b30 2024-04-25T23:58:14.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 >> v1:172.21.15.106:6793/0 conn(0x7f37200a1f10 legacy=0x7f37201d3070 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:14.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 >> v1:172.21.15.106:6789/0 conn(0x7f37200a1750 legacy=0x7f37201ca960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:14.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 monclient: found mon.b 2024-04-25T23:58:14.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:14.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:14.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3720138c20 con 0x7f37200a1b30 2024-04-25T23:58:14.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient: _finish_auth 0 2024-04-25T23:58:14.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:14.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f370effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:14.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f3724d07640 5 monclient: authenticate success, global_id 5348 2024-04-25T23:58:14.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f3724d07640 10 monclient: _renew_subs 2024-04-25T23:58:14.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f3724d07640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:14.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.636+0000 7f3724d07640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f372013ac30 con 0x7f37200a1b30 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f3724d07640 10 monclient: _renew_subs 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f3724d07640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f3724d07640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f372013a330 con 0x7f37200a1b30 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3714001a20 con 0x7f37200a1b30 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3714005240 con 0x7f37200a1b30 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f371cd99640 4 set_mon_vals no callback set 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:14.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 10 monclient: dump: 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.638 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f3724d07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f3724d07640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f3724d07640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f3724d07640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3704005090 con 0x7f37200a1b30 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f371400ffe0 con 0x7f37200a1b30 2024-04-25T23:58:14.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(74..74 src has 1..74) ==== 5449+0+0 (unknown 2194390100 0 0) 0x7f3714044cd0 con 0x7f37200a1b30 2024-04-25T23:58:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.640+0000 7f371e59c640 10 monclient: get_auth_request con 0x7f3700037d60 auth_method 0 2024-04-25T23:58:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.652+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3714015920 con 0x7f37200a1b30 2024-04-25T23:58:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.652+0000 7f370effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.652+0000 7f370effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.816+0000 7f3724d07640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.816+0000 7f3724d07640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.816+0000 7f3724d07640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.816+0000 7f3724d07640 1 -- 172.21.15.171:0/3157092219 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "foo"} v 0) -- 0x7f3704005380 con 0x7f37200a1b30 2024-04-25T23:58:14.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.820+0000 7f370effd640 1 -- 172.21.15.171:0/3157092219 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "foo"}]=-39 (39) Directory not empty v74) ==== 99+0+0 (unknown 3192285291 0 0) 0x7f3714015220 con 0x7f37200a1b30 2024-04-25T23:58:14.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.820+0000 7f370effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:14.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.820+0000 7f370effd640 10 monclient: _finish_command 2 = mon:39 (39) Directory not empty 2024-04-25T23:58:14.804 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOTEMPTY: (39) Directory not empty 2024-04-25T23:58:14.808 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:14.808 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush rm bar 2024-04-25T23:58:14.808 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:14.808 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm bar 2024-04-25T23:58:14.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient: get_monmap_and_config 2024-04-25T23:58:14.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient: build_initial_monmap 2024-04-25T23:58:14.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient: monmap: 2024-04-25T23:58:14.921 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:14.921 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.921 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:14.939828+0000 2024-04-25T23:58:14.921 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:14.939828+0000 2024-04-25T23:58:14.921 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:14.921 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.922 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:14.922 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:14.922 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:14.922 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:14.922 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:14.922 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:14.923 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:14.923 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:14.923 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:14.923 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 1 Processor -- start 2024-04-25T23:58:14.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 1 -- start start 2024-04-25T23:58:14.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient: init 2024-04-25T23:58:14.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:14.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient: _add_conns ranks=[2,4,3,6,7,5,8,0,1] 2024-04-25T23:58:14.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient(hunting): picked mon.noname-b con 0x7f69bc099960 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:14.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient(hunting): picked mon.noname-c con 0x7f69bc099d40 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:14.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient(hunting): picked mon.noname-g con 0x7f69bc09f5e0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:14.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc0a27e0 con 0x7f69bc099960 2024-04-25T23:58:14.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc09e920 con 0x7f69bc09f5e0 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc0a1f60 con 0x7f69bc099d40 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c4321640 10 monclient(hunting): authenticate will time out at 1145.647490s 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c28be640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f69bc09f5e0 0x7f69bc140630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53738/0 (socket says 172.21.15.171:53738) 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c28be640 1 -- 172.21.15.171:0/3624172185 learned_addr learned my addr 172.21.15.171:0/3624172185 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c18bc640 1 -- 172.21.15.171:0/3624172185 >> v1:172.21.15.106:6791/0 conn(0x7f69bc099d40 legacy=0x7f69bc0a1850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011515738 0 0) 0x7f69b40014a0 con 0x7f69bc09f5e0 2024-04-25T23:58:14.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c10bb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c10bb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c10bb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c10bb640 10 monclient(hunting): my global_id is 5547 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.936+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a8003530 con 0x7f69bc09f5e0 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 938216298 0 0) 0x7f69a8003530 con 0x7f69bc09f5e0 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 >> v1:172.21.15.106:6791/0 conn(0x7f69bc099d40 legacy=0x7f69bc0a1850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 >> v1:172.21.15.106:6790/0 conn(0x7f69bc099960 legacy=0x7f69bc0a1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 monclient: found mon.noname-g 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc09fa70 con 0x7f69bc09f5e0 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: _finish_auth 0 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69b4001d10 con 0x7f69bc09f5e0 2024-04-25T23:58:14.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: dump: 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.943 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.944 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 5 monclient: authenticate success, global_id 5547 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69b4002000 con 0x7f69bc09f5e0 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 4 set_mon_vals no callback set 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 1 -- 172.21.15.171:0/3624172185 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69b4004f70 con 0x7f69bc09f5e0 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c10bb640 10 monclient: dump: 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.945 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient: shutdown 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:14.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- 172.21.15.171:0/3624172185 >> v1:172.21.15.171:6790/0 conn(0x7f69bc09f5e0 legacy=0x7f69bc140630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- 172.21.15.171:0/3624172185 shutdown_connections 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- 172.21.15.171:0/3624172185 >> 172.21.15.171:0/3624172185 conn(0x7f69bc0a6850 msgr2=0x7f69bc0a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- 172.21.15.171:0/3624172185 shutdown_connections 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- 172.21.15.171:0/3624172185 wait complete. 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient: build_initial_monmap 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient: monmap: 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:14.947 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 Processor -- start 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- start start 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient: init 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:14.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient: _add_conns ranks=[0,6,8,2,3,1,5,7,4] 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient(hunting): picked mon.noname-a con 0x7f69bc099960 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient(hunting): picked mon.noname-d con 0x7f69bc099d40 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient(hunting): picked mon.noname-e con 0x7f69bc09f5e0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc096e30 con 0x7f69bc099960 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc09e230 con 0x7f69bc099d40 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69bc094e20 con 0x7f69bc09f5e0 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c4321640 10 monclient(hunting): authenticate will time out at 1145.650315s 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c28be640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f69bc09f5e0 legacy=0x7f69bc1d51b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c18bc640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f69bc099d40 0x7f69bc1d1a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:46368/0 (socket says 172.21.15.171:46368) 2024-04-25T23:58:14.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69c18bc640 1 -- 172.21.15.171:0/2203300879 learned_addr learned my addr 172.21.15.171:0/2203300879 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4095356323 0 0) 0x7f69bc09e230 con 0x7f69bc099d40 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): my global_id is 5433 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69a0003530 con 0x7f69bc099d40 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600529332 0 0) 0x7f69bc096e30 con 0x7f69bc099960 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): my global_id is 5409 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69bc09e230 con 0x7f69bc099960 2024-04-25T23:58:14.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 431297763 0 0) 0x7f69bc09e230 con 0x7f69bc099960 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69bc096e30 con 0x7f69bc099960 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2774126448 0 0) 0x7f69a0003530 con 0x7f69bc099d40 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69bc09e230 con 0x7f69bc099d40 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69ac004330 con 0x7f69bc099d40 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.951 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.952 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69b8001ac0 con 0x7f69bc099960 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.940+0000 7f69b2ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2857374917 0 0) 0x7f69bc096e30 con 0x7f69bc099960 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 >> v1:172.21.15.106:6793/0 conn(0x7f69bc09f5e0 legacy=0x7f69bc1d51b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:14.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 >> v1:172.21.15.106:6792/0 conn(0x7f69bc099d40 legacy=0x7f69bc1d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 monclient: found mon.a 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69bc096b50 con 0x7f69bc099960 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 5 monclient: authenticate success, global_id 5409 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 10 monclient: _renew_subs 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f69bc097110 con 0x7f69bc099960 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 10 monclient: _renew_subs 2024-04-25T23:58:14.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f69bc098f80 con 0x7f69bc099960 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69b8001c60 con 0x7f69bc099960 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69b8003c60 con 0x7f69bc099960 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c08ba640 4 set_mon_vals no callback set 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:14.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 10 monclient: dump: 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:14.957 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c4321640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69a4005090 con 0x7f69bc099960 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f69b8003e80 con 0x7f69bc099960 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(74..74 src has 1..74) ==== 5449+0+0 (unknown 2194390100 0 0) 0x7f69b8043950 con 0x7f69bc099960 2024-04-25T23:58:14.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.944+0000 7f69c18bc640 10 monclient: get_auth_request con 0x7f69a0037da0 auth_method 0 2024-04-25T23:58:14.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.956+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f69bc0a27e0 con 0x7f69bc099960 2024-04-25T23:58:14.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.956+0000 7f69b2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:14.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:14.956+0000 7f69b2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:15.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.124+0000 7f69c4321640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:15.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.124+0000 7f69c4321640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:15.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.124+0000 7f69c4321640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:15.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.124+0000 7f69c4321640 1 -- 172.21.15.171:0/2203300879 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "bar"} v 0) -- 0x7f69a4005380 con 0x7f69bc099960 2024-04-25T23:58:15.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.124+0000 7f69b2ffd640 1 -- 172.21.15.171:0/2203300879 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "bar"}]=-39 (39) Directory not empty v74) ==== 99+0+0 (unknown 527356516 0 0) 0x7f69b8014480 con 0x7f69bc099960 2024-04-25T23:58:15.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.124+0000 7f69b2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:15.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.124+0000 7f69b2ffd640 10 monclient: _finish_command 2 = mon:39 (39) Directory not empty 2024-04-25T23:58:15.111 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOTEMPTY: (39) Directory not empty 2024-04-25T23:58:15.115 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:15.115 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush unlink host1 bar 2024-04-25T23:58:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.236+0000 7fed00fa7640 10 monclient: get_monmap_and_config 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.236+0000 7fed00fa7640 10 monclient: build_initial_monmap 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.236+0000 7fed00fa7640 10 monclient: monmap: 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:15.242264+0000 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:15.242264+0000 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:15.224 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 Processor -- start 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- start start 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient: init 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient: _add_conns ranks=[7,4,6,8,1,2,0,5,3] 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient(hunting): picked mon.noname-i con 0x7fecfc099bf0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient(hunting): picked mon.noname-c con 0x7fecfc09f710 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient(hunting): picked mon.noname-d con 0x7fecfc13e690 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc099fd0 con 0x7fecfc09f710 2024-04-25T23:58:15.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc0a1ff0 con 0x7fecfc13e690 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc0a27a0 con 0x7fecfc099bf0 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient(hunting): authenticate will time out at 1145.949468s 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecfa59c640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fecfc099bf0 legacy=0x7fecfc0a11d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf3fff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fecfc09f710 legacy=0x7fecfc0a18e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecfad9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fecfc13e690 0x7fecfc140a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:46384/0 (socket says 172.21.15.171:46384) 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecfad9d640 1 -- 172.21.15.171:0/1603901102 learned_addr learned my addr 172.21.15.171:0/1603901102 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258756930 0 0) 0x7fecfc0a1ff0 con 0x7fecfc13e690 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient(hunting): my global_id is 5442 2024-04-25T23:58:15.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fece8003530 con 0x7fecfc13e690 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 976050533 0 0) 0x7fece8003530 con 0x7fecfc13e690 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 >> v1:172.21.15.171:6792/0 conn(0x7fecfc099bf0 legacy=0x7fecfc0a11d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 >> v1:172.21.15.106:6791/0 conn(0x7fecfc09f710 legacy=0x7fecfc0a18e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 monclient: found mon.noname-d 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc0a29e0 con 0x7fecfc13e690 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: _finish_auth 0 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fecf4001b40 con 0x7fecfc13e690 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:15.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: dump: 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:15.234 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 5 monclient: authenticate success, global_id 5442 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fecf4001da0 con 0x7fecfc13e690 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 4 set_mon_vals no callback set 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 1 -- 172.21.15.171:0/1603901102 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fecf4004f70 con 0x7fecfc13e690 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fecf9d9b640 10 monclient: dump: 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:15.235 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 10 monclient: shutdown 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- 172.21.15.171:0/1603901102 >> v1:172.21.15.106:6792/0 conn(0x7fecfc13e690 legacy=0x7fecfc140a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- 172.21.15.171:0/1603901102 shutdown_connections 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- 172.21.15.171:0/1603901102 >> 172.21.15.171:0/1603901102 conn(0x7fecfc0a66c0 msgr2=0x7fecfc0a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- 172.21.15.171:0/1603901102 shutdown_connections 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.240+0000 7fed00fa7640 1 -- 172.21.15.171:0/1603901102 wait complete. 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: build_initial_monmap 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: monmap: 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:15.237 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 Processor -- start 2024-04-25T23:58:15.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 -- start start 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: init 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _add_conns ranks=[1,3,5,4,8,2,6,7,0] 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient(hunting): picked mon.noname-f con 0x7fecfc099bf0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient(hunting): picked mon.noname-g con 0x7fecfc09f710 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient(hunting): picked mon.noname-h con 0x7fecfc13e690 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc09e3a0 con 0x7fecfc099bf0 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc092750 con 0x7fecfc09f710 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecfc092a30 con 0x7fecfc13e690 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient(hunting): authenticate will time out at 1145.953618s 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecfa59c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fecfc099bf0 legacy=0x7fecfc1cca70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecfad9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fecfc13e690 0x7fecfc1d51f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56298/0 (socket says 172.21.15.171:56298) 2024-04-25T23:58:15.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecfad9d640 1 -- 172.21.15.171:0/3557181244 learned_addr learned my addr 172.21.15.171:0/3557181244 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1021443762 0 0) 0x7fecfc092a30 con 0x7fecfc13e690 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): my global_id is 5378 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecdc003530 con 0x7fecfc13e690 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3385774146 0 0) 0x7fecfc092750 con 0x7fecfc09f710 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): my global_id is 5556 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecfc092a30 con 0x7fecfc09f710 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2566005825 0 0) 0x7fecdc003530 con 0x7fecfc13e690 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecfc092750 con 0x7fecfc13e690 2024-04-25T23:58:15.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fecf4001a40 con 0x7fecfc13e690 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:15.241 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 113833443 0 0) 0x7fecfc092a30 con 0x7fecfc09f710 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecdc003530 con 0x7fecfc09f710 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fece4004270 con 0x7fecfc09f710 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:15.242 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2857657668 0 0) 0x7fecfc092750 con 0x7fecfc13e690 2024-04-25T23:58:15.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 >> v1:172.21.15.171:6790/0 conn(0x7fecfc09f710 legacy=0x7fecfc1d1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 >> v1:172.21.15.171:6789/0 conn(0x7fecfc099bf0 legacy=0x7fecfc1cca70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 monclient: found mon.h 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecfc0999c0 con 0x7fecfc13e690 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 5 monclient: authenticate success, global_id 5378 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _renew_subs 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fecfc090740 con 0x7fecfc13e690 2024-04-25T23:58:15.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _renew_subs 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fecfc0912a0 con 0x7fecfc13e690 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fecf4001da0 con 0x7fecfc13e690 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fecf4005520 con 0x7fecfc13e690 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf959a640 4 set_mon_vals no callback set 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 10 monclient: dump: 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.245 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fecf40102c0 con 0x7fecfc13e690 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fece0005090 con 0x7fecfc13e690 2024-04-25T23:58:15.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(74..74 src has 1..74) ==== 5449+0+0 (unknown 2194390100 0 0) 0x7fecf4044f30 con 0x7fecfc13e690 2024-04-25T23:58:15.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.244+0000 7fecfa59c640 10 monclient: get_auth_request con 0x7fecdc037e60 auth_method 0 2024-04-25T23:58:15.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.248+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fecf4015b20 con 0x7fecfc13e690 2024-04-25T23:58:15.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.248+0000 7fecf2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:15.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.248+0000 7fecf2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:15.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.400+0000 7fed00fa7640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}] 2024-04-25T23:58:15.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.400+0000 7fed00fa7640 10 monclient: _send_command 2 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}] 2024-04-25T23:58:15.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.400+0000 7fed00fa7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:15.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.400+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"} v 0) -- 0x7fece0005b90 con 0x7fecfc13e690 2024-04-25T23:58:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.644+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}]=0 removed item id -11 name 'host1' from crush map v75) ==== 147+0+0 (unknown 2832240248 0 0) 0x7fecf4015420 con 0x7fecfc13e690 2024-04-25T23:58:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.644+0000 7fecf2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}] 2024-04-25T23:58:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.644+0000 7fecf2ffd640 10 monclient: _finish_command 2 = system:0 removed item id -11 name 'host1' from crush map 2024-04-25T23:58:15.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.740+0000 7fed00fa7640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}] 2024-04-25T23:58:15.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.740+0000 7fed00fa7640 10 monclient: _send_command 3 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}] 2024-04-25T23:58:15.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.740+0000 7fed00fa7640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:15.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.740+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"} v 0) -- 0x7fece00010a0 con 0x7fecfc13e690 2024-04-25T23:58:15.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fecf2ffd640 1 -- 172.21.15.171:0/3557181244 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}]=0 item -11 does not appear in that position v75) ==== 141+0+0 (unknown 2262321512 0 0) 0x7fecf401df70 con 0x7fecfc13e690 2024-04-25T23:58:15.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fecf2ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush unlink", "name": "host1", "ancestor": "bar"}] 2024-04-25T23:58:15.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fecf2ffd640 10 monclient: _finish_command 3 = system:0 item -11 does not appear in that position 2024-04-25T23:58:15.727 INFO:tasks.workunit.client.0.smithi171.stderr:item -11 does not appear in that position 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 >> v1:172.21.15.171:6812/722422047 conn(0x7fecdc037e60 legacy=0x7fecdc03a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 10 monclient: shutdown 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 >> v1:172.21.15.171:6791/0 conn(0x7fecfc13e690 legacy=0x7fecfc1d51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 shutdown_connections 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 >> 172.21.15.171:0/3557181244 conn(0x7fecfc0a66c0 msgr2=0x7fecfc13dac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 shutdown_connections 2024-04-25T23:58:15.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.744+0000 7fed00fa7640 1 -- 172.21.15.171:0/3557181244 wait complete. 2024-04-25T23:58:15.743 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:15.743 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c host1 2024-04-25T23:58:15.743 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 1 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient: get_monmap_and_config 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient: build_initial_monmap 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient: monmap: 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:15.876667+0000 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:15.876667+0000 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:15.857 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:15.858 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:15.858 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:15.858 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:15.858 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:15.858 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:15.858 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:15.858 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 1 Processor -- start 2024-04-25T23:58:15.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 1 -- start start 2024-04-25T23:58:15.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient: init 2024-04-25T23:58:15.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:15.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient: _add_conns ranks=[3,5,6,2,0,1,4,8,7] 2024-04-25T23:58:15.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient(hunting): picked mon.noname-g con 0x7f80181328a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:15.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient(hunting): picked mon.noname-h con 0x7f801809b840 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient(hunting): picked mon.noname-d con 0x7f801809b3e0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018133390 con 0x7f80181328a0 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801809cc80 con 0x7f801809b840 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801809c2a0 con 0x7f801809b3e0 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801f4dc640 10 monclient(hunting): authenticate will time out at 1146.583793s 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801ca77640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f801809b840 0x7f801813aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56310/0 (socket says 172.21.15.171:56310) 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801ca77640 1 -- 172.21.15.171:0/168454286 learned_addr learned my addr 172.21.15.171:0/168454286 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.872+0000 7f801d278640 1 --1- 172.21.15.171:0/168454286 >> v1:172.21.15.171:6790/0 conn(0x7f80181328a0 0x7f8018132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53762/0 (socket says 172.21.15.171:53762) 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442730138 0 0) 0x7f801809cc80 con 0x7f801809b840 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:15.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): my global_id is 5387 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8000003530 con 0x7f801809b840 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364101238 0 0) 0x7f8018133390 con 0x7f80181328a0 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient(hunting): my global_id is 5565 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f801809cc80 con 0x7f80181328a0 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1326213826 0 0) 0x7f801809cc80 con 0x7f80181328a0 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 >> v1:172.21.15.106:6792/0 conn(0x7f801809b3e0 legacy=0x7f801813e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 >> v1:172.21.15.171:6791/0 conn(0x7f801809b840 legacy=0x7f801813aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 monclient: found mon.noname-g 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:15.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801809f7b0 con 0x7f80181328a0 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 5 monclient: authenticate success, global_id 5565 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8008001b40 con 0x7f80181328a0 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: dump: 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.866 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8008001d30 con 0x7f80181328a0 2024-04-25T23:58:15.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 4 set_mon_vals no callback set 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 1 -- 172.21.15.171:0/168454286 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8008004eb0 con 0x7f80181328a0 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f8017fff640 10 monclient: dump: 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:15.868 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient: shutdown 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- 172.21.15.171:0/168454286 >> v1:172.21.15.171:6790/0 conn(0x7f80181328a0 legacy=0x7f8018132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:15.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- 172.21.15.171:0/168454286 shutdown_connections 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- 172.21.15.171:0/168454286 >> 172.21.15.171:0/168454286 conn(0x7f80180a28a0 msgr2=0x7f80180a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- 172.21.15.171:0/168454286 shutdown_connections 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- 172.21.15.171:0/168454286 wait complete. 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient: build_initial_monmap 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient: monmap: 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:15.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 Processor -- start 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- start start 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient: init 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient: _add_conns ranks=[8,1,4,6,7,0,2,3,5] 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient(hunting): picked mon.noname-e con 0x7f801809b3e0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:15.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient(hunting): picked mon.noname-f con 0x7f801809b840 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient(hunting): picked mon.noname-c con 0x7f80181328a0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018073100 con 0x7f801809b840 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80181309a0 con 0x7f80181328a0 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018072c20 con 0x7f801809b3e0 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801f4dc640 10 monclient(hunting): authenticate will time out at 1146.586727s 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801ca77640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f801809b840 legacy=0x7f801812d330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801d278640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f801809b3e0 legacy=0x7f801812cc20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:15.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:15.876+0000 7f801da79640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f80181328a0 legacy=0x7f80181d2a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:16.080+0000 7f801ca77640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f801809b840 legacy=0x7f801812d330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:16.080+0000 7f801d278640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f801809b3e0 legacy=0x7f801812cc20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:16.080+0000 7f801da79640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f80181328a0 legacy=0x7f80181d2a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:16.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:16.484+0000 7f801ca77640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f801809b840 legacy=0x7f801812d330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:16.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:16.484+0000 7f801da79640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f80181328a0 legacy=0x7f80181d2a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:16.467 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:16.484+0000 7f801d278640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f801809b3e0 legacy=0x7f801812cc20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:17.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:17.288+0000 7f801ca77640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f801809b840 legacy=0x7f801812d330 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:17.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:17.288+0000 7f801da79640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f80181328a0 legacy=0x7f80181d2a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:17.271 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:17.288+0000 7f801d278640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f801809b3e0 legacy=0x7f801812cc20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient(hunting): tick 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 1 monclient(hunting): continuing hunt 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f801809b3e0 legacy=0x7f801812cc20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f80181328a0 legacy=0x7f80181d2a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f801809b840 legacy=0x7f801812d330 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient: _add_conns ranks=[5,0,6,7,3,2] 2024-04-25T23:58:18.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient(hunting): picked mon.noname-h con 0x7f7ff8003790 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient(hunting): picked mon.noname-a con 0x7f7ff8007420 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient(hunting): picked mon.noname-d con 0x7f7ff800b1b0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801812e6b0 con 0x7f7ff8007420 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80181309a0 con 0x7f7ff8003790 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018072c20 con 0x7f7ff800b1b0 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8014ff9640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801d278640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7ff8003790 0x7f7ff8005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:56326/0 (socket says 172.21.15.171:56326) 2024-04-25T23:58:18.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801d278640 1 -- 172.21.15.171:0/1104949804 learned_addr learned my addr 172.21.15.171:0/1104949804 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:18.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1069782023 0 0) 0x7f801812e6b0 con 0x7f7ff8007420 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): my global_id is 5418 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8004003530 con 0x7f7ff8007420 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2551186872 0 0) 0x7f80181309a0 con 0x7f7ff8003790 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): my global_id is 5396 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f801812e6b0 con 0x7f7ff8003790 2024-04-25T23:58:18.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2532127295 0 0) 0x7f8018072c20 con 0x7f7ff800b1b0 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): my global_id is 5460 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80181309a0 con 0x7f7ff800b1b0 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2080916097 0 0) 0x7f801812e6b0 con 0x7f7ff8003790 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8018072c20 con 0x7f7ff8003790 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80080020d0 con 0x7f7ff8003790 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:18.868 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:18.869 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2867347187 0 0) 0x7f8004003530 con 0x7f7ff8007420 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f801812e6b0 con 0x7f7ff8007420 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f800c001740 con 0x7f7ff8007420 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:18.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1621767863 0 0) 0x7f80181309a0 con 0x7f7ff800b1b0 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8004003530 con 0x7f7ff800b1b0 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8010001a60 con 0x7f7ff800b1b0 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:18.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:18.872 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3229642465 0 0) 0x7f8018072c20 con 0x7f7ff8003790 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 >> v1:172.21.15.106:6792/0 conn(0x7f7ff800b1b0 legacy=0x7f7ff800d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 >> v1:172.21.15.106:6789/0 conn(0x7f7ff8007420 legacy=0x7f7ff80098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 monclient: found mon.h 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ff8011fb0 con 0x7f7ff8003790 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801da79640 1 -- 172.21.15.171:0/1104949804 reap_dead start 2024-04-25T23:58:18.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 5 monclient: authenticate success, global_id 5396 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 10 monclient: _renew_subs 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f801812da40 con 0x7f7ff8003790 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 10 monclient: _renew_subs 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f8018130100 con 0x7f7ff8003790 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8008001d30 con 0x7f7ff8003790 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8008005750 con 0x7f7ff8003790 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f80177fe640 4 set_mon_vals no callback set 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 10 monclient: dump: 2024-04-25T23:58:18.874 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:18.875 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:18.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:18.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:18.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:18.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ff4005090 con 0x7f7ff8003790 2024-04-25T23:58:18.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.880+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f80080104f0 con 0x7f7ff8003790 2024-04-25T23:58:18.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.884+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(75..75 src has 1..75) ==== 5409+0+0 (unknown 212789636 0 0) 0x7f8008045120 con 0x7f7ff8003790 2024-04-25T23:58:18.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.884+0000 7f801ca77640 10 monclient: get_auth_request con 0x7f8004037f70 auth_method 0 2024-04-25T23:58:18.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.896+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8008015df0 con 0x7f7ff8003790 2024-04-25T23:58:18.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.896+0000 7f8015ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:18.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:18.896+0000 7f8015ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:19.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.076+0000 7f801f4dc640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:19.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.076+0000 7f801f4dc640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:19.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.076+0000 7f801f4dc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:19.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.076+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f7ff4005b90 con 0x7f7ff8003790 2024-04-25T23:58:19.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.076+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v75) ==== 56+0+1340 (unknown 3476242654 0 1826287514) 0x7f80080156f0 con 0x7f7ff8003790 2024-04-25T23:58:19.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.076+0000 7f8015ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:19.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.076+0000 7f8015ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:19.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.172+0000 7f801f4dc640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:19.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.172+0000 7f801f4dc640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:19.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.172+0000 7f801f4dc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:19.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.172+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f7ff4005d60 con 0x7f7ff8003790 2024-04-25T23:58:19.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.172+0000 7f8015ffb640 1 -- 172.21.15.171:0/1104949804 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v75) ==== 56+0+1340 (unknown 3476242654 0 1826287514) 0x7f8008013a50 con 0x7f7ff8003790 2024-04-25T23:58:19.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.172+0000 7f8015ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:19.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.172+0000 7f8015ffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 >> v1:172.21.15.171:6812/722422047 conn(0x7f8004037f70 legacy=0x7f800403a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 10 monclient: shutdown 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 >> v1:172.21.15.171:6791/0 conn(0x7f7ff8003790 legacy=0x7f7ff8005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 shutdown_connections 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 >> 172.21.15.171:0/1104949804 conn(0x7f80180a28a0 msgr2=0x7f801812b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 shutdown_connections 2024-04-25T23:58:19.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.176+0000 7f801f4dc640 1 -- 172.21.15.171:0/1104949804 wait complete. 2024-04-25T23:58:19.175 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm osd.7 host1 2024-04-25T23:58:19.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: get_monmap_and_config 2024-04-25T23:58:19.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: build_initial_monmap 2024-04-25T23:58:19.304 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: monmap: 2024-04-25T23:58:19.304 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:19.304 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.305 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:19.310811+0000 2024-04-25T23:58:19.305 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:19.310811+0000 2024-04-25T23:58:19.305 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:19.305 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.305 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:19.305 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:19.306 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:19.306 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:19.306 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:19.306 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:19.306 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:19.306 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:19.307 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:19.307 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 Processor -- start 2024-04-25T23:58:19.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 -- start start 2024-04-25T23:58:19.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: init 2024-04-25T23:58:19.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:19.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: _add_conns ranks=[8,2,4,0,6,3,7,5,1] 2024-04-25T23:58:19.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient(hunting): picked mon.noname-e con 0x7ff29c0a52a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:19.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient(hunting): picked mon.noname-b con 0x7ff29c0a49c0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:19.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient(hunting): picked mon.noname-c con 0x7ff29c13e2a0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:19.308 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29c0a5d90 con 0x7ff29c0a49c0 2024-04-25T23:58:19.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29c0a18e0 con 0x7ff29c13e2a0 2024-04-25T23:58:19.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29c0a28f0 con 0x7ff29c0a52a0 2024-04-25T23:58:19.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:19.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient(hunting): authenticate will time out at 1150.017696s 2024-04-25T23:58:19.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a11d4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff29c0a52a0 legacy=0x7ff29c0a5680 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:19.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a19d5640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff29c13e2a0 legacy=0x7ff29c140690 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:19.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a09d3640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7ff29c0a49c0 0x7ff29c13cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51210/0 (socket says 172.21.15.171:51210) 2024-04-25T23:58:19.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a09d3640 1 -- 172.21.15.171:0/1013342173 learned_addr learned my addr 172.21.15.171:0/1013342173 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:19.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499901160 0 0) 0x7ff28c001120 con 0x7ff29c0a49c0 2024-04-25T23:58:19.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:19.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:19.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:19.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient(hunting): my global_id is 5366 2024-04-25T23:58:19.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff288003530 con 0x7ff29c0a49c0 2024-04-25T23:58:19.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2265441941 0 0) 0x7ff288003530 con 0x7ff29c0a49c0 2024-04-25T23:58:19.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 >> v1:172.21.15.106:6793/0 conn(0x7ff29c0a52a0 legacy=0x7ff29c0a5680 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:19.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 >> v1:172.21.15.106:6791/0 conn(0x7ff29c13e2a0 legacy=0x7ff29c140690 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:19.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:19.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 monclient: found mon.noname-b 2024-04-25T23:58:19.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:19.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:58:19.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c0a2bd0 con 0x7ff29c0a49c0 2024-04-25T23:58:19.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:19.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:19.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:19.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff28c001990 con 0x7ff29c0a49c0 2024-04-25T23:58:19.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:19.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:19.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: dump: 2024-04-25T23:58:19.314 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.314 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.314 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.314 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.314 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.314 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.315 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.315 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.315 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.315 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.315 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.316 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.316 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.316 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.316 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.316 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 5 monclient: authenticate success, global_id 5366 2024-04-25T23:58:19.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:19.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff28c001bf0 con 0x7ff29c0a49c0 2024-04-25T23:58:19.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:19.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 1 -- 172.21.15.171:0/1013342173 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff28c004bf0 con 0x7ff29c0a49c0 2024-04-25T23:58:19.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:19.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:19.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff293fff640 10 monclient: dump: 2024-04-25T23:58:19.318 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.318 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.318 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.318 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.318 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.318 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.319 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.319 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.319 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.319 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.319 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.319 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.320 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.320 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.320 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.320 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:19.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 4 set_mon_vals no callback set 2024-04-25T23:58:19.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 10 monclient: shutdown 2024-04-25T23:58:19.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:19.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 -- 172.21.15.171:0/1013342173 >> v1:172.21.15.106:6790/0 conn(0x7ff29c0a49c0 legacy=0x7ff29c13cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 -- 172.21.15.171:0/1013342173 shutdown_connections 2024-04-25T23:58:19.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.308+0000 7ff2a3438640 1 -- 172.21.15.171:0/1013342173 >> 172.21.15.171:0/1013342173 conn(0x7ff29c0a6c90 msgr2=0x7ff29c0a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:19.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- 172.21.15.171:0/1013342173 shutdown_connections 2024-04-25T23:58:19.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- 172.21.15.171:0/1013342173 wait complete. 2024-04-25T23:58:19.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: build_initial_monmap 2024-04-25T23:58:19.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: monmap: 2024-04-25T23:58:19.322 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:19.322 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:19.322 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:19.323 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:19.323 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:19.323 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.323 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:19.323 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:19.323 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:19.324 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:19.324 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:19.324 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:19.324 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:19.324 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:19.324 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:19.325 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 Processor -- start 2024-04-25T23:58:19.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- start start 2024-04-25T23:58:19.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: init 2024-04-25T23:58:19.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:19.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: _add_conns ranks=[4,7,6,1,8,3,2,0,5] 2024-04-25T23:58:19.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient(hunting): picked mon.noname-c con 0x7ff29c0a49c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:19.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient(hunting): picked mon.noname-i con 0x7ff29c0a52a0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:19.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient(hunting): picked mon.noname-d con 0x7ff29c13e2a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:19.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29c09ade0 con 0x7ff29c0a49c0 2024-04-25T23:58:19.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29c09ba90 con 0x7ff29c13e2a0 2024-04-25T23:58:19.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff29c09b0c0 con 0x7ff29c0a52a0 2024-04-25T23:58:19.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:19.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient(hunting): authenticate will time out at 1150.021550s 2024-04-25T23:58:19.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a09d3640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7ff29c0a52a0 legacy=0x7ff29c1d19c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:19.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a11d4640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff29c0a49c0 legacy=0x7ff29c1cc970 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:19.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a19d5640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff29c13e2a0 0x7ff29c1d50f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:46404/0 (socket says 172.21.15.171:46404) 2024-04-25T23:58:19.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a19d5640 1 -- 172.21.15.171:0/1839672221 learned_addr learned my addr 172.21.15.171:0/1839672221 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:19.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2358631801 0 0) 0x7ff29c09ba90 con 0x7ff29c13e2a0 2024-04-25T23:58:19.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:19.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:19.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:19.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): my global_id is 5469 2024-04-25T23:58:19.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff280003530 con 0x7ff29c13e2a0 2024-04-25T23:58:19.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1335185995 0 0) 0x7ff280003530 con 0x7ff29c13e2a0 2024-04-25T23:58:19.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff29c09ba90 con 0x7ff29c13e2a0 2024-04-25T23:58:19.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff298004270 con 0x7ff29c13e2a0 2024-04-25T23:58:19.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:19.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:19.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:19.331 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.331 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.332 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.332 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.332 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.332 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.332 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.333 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.333 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.333 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.333 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.333 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.334 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.334 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.334 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.335 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:19.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 842468544 0 0) 0x7ff29c09ba90 con 0x7ff29c13e2a0 2024-04-25T23:58:19.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 >> v1:172.21.15.171:6792/0 conn(0x7ff29c0a52a0 legacy=0x7ff29c1d19c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:19.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 >> v1:172.21.15.106:6791/0 conn(0x7ff29c0a49c0 legacy=0x7ff29c1cc970 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:19.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:19.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 monclient: found mon.d 2024-04-25T23:58:19.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:19.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:19.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff29c0a43c0 con 0x7ff29c13e2a0 2024-04-25T23:58:19.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:19.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:19.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:19.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 5 monclient: authenticate success, global_id 5469 2024-04-25T23:58:19.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: _renew_subs 2024-04-25T23:58:19.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:19.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff29c0a5070 con 0x7ff29c13e2a0 2024-04-25T23:58:19.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: _renew_subs 2024-04-25T23:58:19.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:19.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff29c13bf90 con 0x7ff29c13e2a0 2024-04-25T23:58:19.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff2980044d0 con 0x7ff29c13e2a0 2024-04-25T23:58:19.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:19.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff298004a40 con 0x7ff29c13e2a0 2024-04-25T23:58:19.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:19.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:19.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff2937fe640 4 set_mon_vals no callback set 2024-04-25T23:58:19.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.312+0000 7ff291ffb640 10 monclient: dump: 2024-04-25T23:58:19.341 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.341 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.342 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.342 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.342 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.342 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.343 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.343 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.343 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.343 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.343 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.345 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.316+0000 7ff2a3438640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.316+0000 7ff2a3438640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.316+0000 7ff2a3438640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.316+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff27c005090 con 0x7ff29c13e2a0 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.316+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff298004be0 con 0x7ff29c13e2a0 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.316+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(75..75 src has 1..75) ==== 5409+0+0 (unknown 212789636 0 0) 0x7ff298044a70 con 0x7ff29c13e2a0 2024-04-25T23:58:19.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.316+0000 7ff2a11d4640 10 monclient: get_auth_request con 0x7ff280037830 auth_method 0 2024-04-25T23:58:19.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.328+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff298015620 con 0x7ff29c13e2a0 2024-04-25T23:58:19.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.328+0000 7ff291ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:19.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.328+0000 7ff291ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:19.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.488+0000 7ff2a3438640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}] 2024-04-25T23:58:19.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.488+0000 7ff2a3438640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}] 2024-04-25T23:58:19.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.488+0000 7ff2a3438640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:19.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.488+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"} v 0) -- 0x7ff27c005b90 con 0x7ff29c13e2a0 2024-04-25T23:58:19.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.668+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}]=0 removed item id 7 name 'osd.7' from crush map v76) ==== 143+0+0 (unknown 1772838655 0 0) 0x7ff298014f20 con 0x7ff29c13e2a0 2024-04-25T23:58:19.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.668+0000 7ff291ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}] 2024-04-25T23:58:19.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.668+0000 7ff291ffb640 10 monclient: _finish_command 2 = system:0 removed item id 7 name 'osd.7' from crush map 2024-04-25T23:58:19.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.772+0000 7ff2a3438640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}] 2024-04-25T23:58:19.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.772+0000 7ff2a3438640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}] 2024-04-25T23:58:19.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.772+0000 7ff2a3438640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:19.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.772+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"} v 0) -- 0x7ff27c0010a0 con 0x7ff29c13e2a0 2024-04-25T23:58:19.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.772+0000 7ff291ffb640 1 -- 172.21.15.171:0/1839672221 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}]=0 device 'osd.7' does not appear in the crush map v76) ==== 145+0+0 (unknown 3881301127 0 0) 0x7ff29801dad0 con 0x7ff29c13e2a0 2024-04-25T23:58:19.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.772+0000 7ff291ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "osd.7", "ancestor": "host1"}] 2024-04-25T23:58:19.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.772+0000 7ff291ffb640 10 monclient: _finish_command 3 = system:0 device 'osd.7' does not appear in the crush map 2024-04-25T23:58:19.758 INFO:tasks.workunit.client.0.smithi171.stderr:device 'osd.7' does not appear in the crush map 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 >> v1:172.21.15.171:6812/722422047 conn(0x7ff280037830 legacy=0x7ff280039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 10 monclient: shutdown 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 >> v1:172.21.15.106:6792/0 conn(0x7ff29c13e2a0 legacy=0x7ff29c1d50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 shutdown_connections 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 >> 172.21.15.171:0/1839672221 conn(0x7ff29c0a6c90 msgr2=0x7ff29c133d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 shutdown_connections 2024-04-25T23:58:19.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.776+0000 7ff2a3438640 1 -- 172.21.15.171:0/1839672221 wait complete. 2024-04-25T23:58:19.776 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm host1 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient: get_monmap_and_config 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient: build_initial_monmap 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient: monmap: 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:19.912706+0000 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:19.912706+0000 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:19.893 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:19.894 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:19.894 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:19.894 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:19.894 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:19.894 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:19.894 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:19.894 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 1 Processor -- start 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 1 -- start start 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient: init 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient: _add_conns ranks=[4,2,3,8,6,1,7,5,0] 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient(hunting): picked mon.noname-c con 0x7ff25c06fe00 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient(hunting): picked mon.noname-b con 0x7ff25c06f600 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient(hunting): picked mon.noname-g con 0x7ff25c0701e0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c06fa00 con 0x7ff25c06f600 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c135400 con 0x7ff25c0701e0 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c071670 con 0x7ff25c06fe00 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:19.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff262bda640 10 monclient(hunting): authenticate will time out at 1150.619702s 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff260976640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff25c06fe00 legacy=0x7ff25c1345e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff261177640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff25c0701e0 0x7ff25c13d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53772/0 (socket says 172.21.15.171:53772) 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.908+0000 7ff261177640 1 -- 172.21.15.171:0/3886559302 learned_addr learned my addr 172.21.15.171:0/3886559302 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203683544 0 0) 0x7ff25c135400 con 0x7ff25c0701e0 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient(hunting): my global_id is 5574 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff244003530 con 0x7ff25c0701e0 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4208965986 0 0) 0x7ff244003530 con 0x7ff25c0701e0 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 >> v1:172.21.15.106:6791/0 conn(0x7ff25c06fe00 legacy=0x7ff25c1345e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:19.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 >> v1:172.21.15.106:6790/0 conn(0x7ff25c06f600 legacy=0x7ff25c134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 monclient: found mon.noname-g 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c070630 con 0x7ff25c0701e0 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 5 monclient: authenticate success, global_id 5574 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff254001b40 con 0x7ff25c0701e0 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: dump: 2024-04-25T23:58:19.903 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.904 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff254001e30 con 0x7ff25c0701e0 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 1 -- 172.21.15.171:0/3886559302 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff254004f70 con 0x7ff25c0701e0 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25b7fe640 10 monclient: dump: 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.905 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 4 set_mon_vals no callback set 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: shutdown 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:19.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- 172.21.15.171:0/3886559302 >> v1:172.21.15.171:6790/0 conn(0x7ff25c0701e0 legacy=0x7ff25c13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- 172.21.15.171:0/3886559302 shutdown_connections 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- 172.21.15.171:0/3886559302 >> 172.21.15.171:0/3886559302 conn(0x7ff25c0a2620 msgr2=0x7ff25c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- 172.21.15.171:0/3886559302 shutdown_connections 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- 172.21.15.171:0/3886559302 wait complete. 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: build_initial_monmap 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: monmap: 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:19.907 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 Processor -- start 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- start start 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: init 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: _add_conns ranks=[3,0,2,7,1,4,8,6,5] 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient(hunting): picked mon.noname-g con 0x7ff25c06f600 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient(hunting): picked mon.noname-a con 0x7ff25c06fe00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:19.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient(hunting): picked mon.noname-b con 0x7ff25c0701e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c11f110 con 0x7ff25c06fe00 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c11f3f0 con 0x7ff25c0701e0 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff25c11cf90 con 0x7ff25c06f600 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff260976640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff25c06f600 0x7ff25c11c170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53780/0 (socket says 172.21.15.171:53780) 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient(hunting): authenticate will time out at 1150.622752s 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff260976640 1 -- 172.21.15.171:0/2280112732 learned_addr learned my addr 172.21.15.171:0/2280112732 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351601796 0 0) 0x7ff25c11cf90 con 0x7ff25c06f600 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): my global_id is 5583 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff248003530 con 0x7ff25c06f600 2024-04-25T23:58:19.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4123970552 0 0) 0x7ff248003530 con 0x7ff25c06f600 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff25c11cf90 con 0x7ff25c06f600 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff24c0043c0 con 0x7ff25c06f600 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): dump: 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.910 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2648982610 0 0) 0x7ff25c11cf90 con 0x7ff25c06f600 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 >> v1:172.21.15.106:6790/0 conn(0x7ff25c0701e0 legacy=0x7ff25c1d0720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 >> v1:172.21.15.106:6789/0 conn(0x7ff25c06fe00 legacy=0x7ff25c11c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 monclient: found mon.g 2024-04-25T23:58:19.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff25c070d60 con 0x7ff25c06f600 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 5 monclient: authenticate success, global_id 5583 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: _renew_subs 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff25c11d830 con 0x7ff25c06f600 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: _renew_subs 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff25c09f330 con 0x7ff25c06f600 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff24c004660 con 0x7ff25c06f600 2024-04-25T23:58:19.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff24c004bd0 con 0x7ff25c06f600 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff25affd640 4 set_mon_vals no callback set 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.912+0000 7ff2597fa640 10 monclient: dump: 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.913 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:19.914 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.916+0000 7ff262bda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.916+0000 7ff262bda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.916+0000 7ff262bda640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.916+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff23c005090 con 0x7ff25c06f600 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.916+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff24c004e30 con 0x7ff25c06f600 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.916+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(76..76 src has 1..76) ==== 5388+0+0 (unknown 3118518592 0 0) 0x7ff24c044db0 con 0x7ff25c06f600 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.916+0000 7ff25bfff640 10 monclient: get_auth_request con 0x7ff2480377e0 auth_method 0 2024-04-25T23:58:19.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.920+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff24c015980 con 0x7ff25c06f600 2024-04-25T23:58:19.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.920+0000 7ff2597fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:19.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:19.920+0000 7ff2597fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:20.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.084+0000 7ff262bda640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "host1"}] 2024-04-25T23:58:20.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.084+0000 7ff262bda640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "host1"}] 2024-04-25T23:58:20.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.084+0000 7ff262bda640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:20.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.084+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "host1"} v 0) -- 0x7ff23c005380 con 0x7ff25c06f600 2024-04-25T23:58:20.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.668+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "host1"}]=0 removed item id -11 name 'host1' from crush map v77) ==== 124+0+0 (unknown 3515914486 0 0) 0x7ff24c015280 con 0x7ff25c06f600 2024-04-25T23:58:20.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.668+0000 7ff2597fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "host1"}] 2024-04-25T23:58:20.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.668+0000 7ff2597fa640 10 monclient: _finish_command 2 = system:0 removed item id -11 name 'host1' from crush map 2024-04-25T23:58:20.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.772+0000 7ff262bda640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "host1"}] 2024-04-25T23:58:20.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.772+0000 7ff262bda640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "host1"}] 2024-04-25T23:58:20.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.772+0000 7ff262bda640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:20.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.772+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "host1"} v 0) -- 0x7ff23c002220 con 0x7ff25c06f600 2024-04-25T23:58:20.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff2597fa640 1 -- 172.21.15.171:0/2280112732 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "host1"}]=0 device 'host1' does not appear in the crush map v77) ==== 124+0+0 (unknown 1240852503 0 0) 0x7ff24c01de30 con 0x7ff25c06f600 2024-04-25T23:58:20.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff2597fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "host1"}] 2024-04-25T23:58:20.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff2597fa640 10 monclient: _finish_command 3 = system:0 device 'host1' does not appear in the crush map 2024-04-25T23:58:20.759 INFO:tasks.workunit.client.0.smithi171.stderr:device 'host1' does not appear in the crush map 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 >> v1:172.21.15.171:6812/722422047 conn(0x7ff2480377e0 legacy=0x7ff248039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 10 monclient: shutdown 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 >> v1:172.21.15.171:6790/0 conn(0x7ff25c06f600 legacy=0x7ff25c11c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 shutdown_connections 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 >> 172.21.15.171:0/2280112732 conn(0x7ff25c0a2620 msgr2=0x7ff25c0a4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 shutdown_connections 2024-04-25T23:58:20.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.776+0000 7ff262bda640 1 -- 172.21.15.171:0/2280112732 wait complete. 2024-04-25T23:58:20.776 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:20.776 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 0 2024-04-25T23:58:20.776 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c host1 2024-04-25T23:58:20.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.904+0000 7f6d5dbcd640 10 monclient: get_monmap_and_config 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.904+0000 7f6d5dbcd640 10 monclient: build_initial_monmap 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: monmap: 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:20.910520+0000 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:20.910520+0000 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:20.891 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:20.892 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 Processor -- start 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- start start 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: init 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: _add_conns ranks=[1,3,7,4,6,0,2,5,8] 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient(hunting): picked mon.noname-f con 0x7f6d58136e10 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient(hunting): picked mon.noname-g con 0x7f6d580a4c10 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:20.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient(hunting): picked mon.noname-i con 0x7f6d5813e510 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d580a3230 con 0x7f6d58136e10 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d580a2c70 con 0x7f6d580a4c10 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d580a4490 con 0x7f6d5813e510 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient(hunting): authenticate will time out at 1151.617569s 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d577fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6d58136e10 legacy=0x7f6d581371f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d57fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6d5813e510 legacy=0x7f6d58140900 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d56ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6d580a4c10 0x7f6d5813cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53248/0 (socket says 172.21.15.171:53248) 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d56ffd640 1 -- 172.21.15.171:0/3190257398 learned_addr learned my addr 172.21.15.171:0/3190257398 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4183876078 0 0) 0x7f6d580a2c70 con 0x7f6d580a4c10 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:20.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient(hunting): my global_id is 5592 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d40003530 con 0x7f6d580a4c10 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3306977560 0 0) 0x7f6d40003530 con 0x7f6d580a4c10 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 >> v1:172.21.15.171:6792/0 conn(0x7f6d5813e510 legacy=0x7f6d58140900 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 >> v1:172.21.15.171:6789/0 conn(0x7f6d58136e10 legacy=0x7f6d581371f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 monclient: found mon.noname-g 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d580a3c90 con 0x7f6d580a4c10 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:20.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d4c0017c0 con 0x7f6d580a4c10 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: dump: 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:20.899 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 5 monclient: authenticate success, global_id 5592 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d4c001b20 con 0x7f6d580a4c10 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:20.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 1 -- 172.21.15.171:0/3190257398 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d4c001d50 con 0x7f6d580a4c10 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 4 set_mon_vals no callback set 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d567fc640 10 monclient: dump: 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:20.901 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:20.902 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:20.902 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:20.902 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:20.902 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: shutdown 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3190257398 >> v1:172.21.15.171:6790/0 conn(0x7f6d580a4c10 legacy=0x7f6d5813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3190257398 shutdown_connections 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3190257398 >> 172.21.15.171:0/3190257398 conn(0x7f6d580a7110 msgr2=0x7f6d580a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:20.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3190257398 shutdown_connections 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3190257398 wait complete. 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: build_initial_monmap 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 10 monclient: monmap: 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:20.904 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 Processor -- start 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.908+0000 7f6d5dbcd640 1 -- start start 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient: init 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient: _add_conns ranks=[7,4,1,3,5,8,0,2,6] 2024-04-25T23:58:20.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient(hunting): picked mon.noname-i con 0x7f6d580a4c10 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient(hunting): picked mon.noname-c con 0x7f6d58136e10 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient(hunting): picked mon.noname-f con 0x7f6d5813e510 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d58136790 con 0x7f6d5813e510 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5809bed0 con 0x7f6d58136e10 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d581cd620 con 0x7f6d580a4c10 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d5dbcd640 10 monclient(hunting): authenticate will time out at 1151.620454s 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d577fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6d580a4c10 legacy=0x7f6d581cc800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d57fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6d5813e510 legacy=0x7f6d581d4d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:20.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:20.912+0000 7f6d56ffd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f6d58136e10 legacy=0x7f6d581ccf10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:21.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:21.116+0000 7f6d57fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6d5813e510 legacy=0x7f6d581d4d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:21.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:21.116+0000 7f6d577fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6d580a4c10 legacy=0x7f6d581cc800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:21.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:21.116+0000 7f6d56ffd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f6d58136e10 legacy=0x7f6d581ccf10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:21.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:21.520+0000 7f6d577fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6d580a4c10 legacy=0x7f6d581cc800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:21.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:21.520+0000 7f6d57fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6d5813e510 legacy=0x7f6d581d4d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:21.503 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:21.520+0000 7f6d56ffd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f6d58136e10 legacy=0x7f6d581ccf10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:22.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:22.324+0000 7f6d577fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6d580a4c10 legacy=0x7f6d581cc800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:22.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:22.324+0000 7f6d57fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6d5813e510 legacy=0x7f6d581d4d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:22.307 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:22.324+0000 7f6d56ffd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f6d58136e10 legacy=0x7f6d581ccf10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:23.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient(hunting): tick 2024-04-25T23:58:23.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:58:23.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 1 monclient(hunting): continuing hunt 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6d580a4c10 legacy=0x7f6d581cc800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f6d58136e10 legacy=0x7f6d581ccf10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6d5813e510 legacy=0x7f6d581d4d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient: _add_conns ranks=[6,3,8,5,2,0] 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient(hunting): picked mon.noname-d con 0x7f6d38003790 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient(hunting): picked mon.noname-g con 0x7f6d38007420 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient(hunting): picked mon.noname-e con 0x7f6d3800b1b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5809ddc0 con 0x7f6d38007420 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d5809bed0 con 0x7f6d38003790 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d581cd620 con 0x7f6d3800b1b0 2024-04-25T23:58:23.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3effd640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d57fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f6d3800b1b0 legacy=0x7f6d3800d670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d56ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6d38007420 0x7f6d380098e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53256/0 (socket says 172.21.15.171:53256) 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d56ffd640 1 -- 172.21.15.171:0/3938618988 learned_addr learned my addr 172.21.15.171:0/3938618988 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 557958980 0 0) 0x7f6d5809ddc0 con 0x7f6d38007420 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): my global_id is 5601 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d44003530 con 0x7f6d38007420 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986943638 0 0) 0x7f6d5809bed0 con 0x7f6d38003790 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): my global_id is 5478 2024-04-25T23:58:23.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d5809ddc0 con 0x7f6d38003790 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 506683990 0 0) 0x7f6d44003530 con 0x7f6d38007420 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d5809bed0 con 0x7f6d38007420 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d4c001780 con 0x7f6d38007420 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): dump: 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:23.901 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1784642734 0 0) 0x7f6d5809ddc0 con 0x7f6d38003790 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d44003530 con 0x7f6d38003790 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d480043c0 con 0x7f6d38003790 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient(hunting): dump: 2024-04-25T23:58:23.902 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:23.903 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1268795158 0 0) 0x7f6d5809bed0 con 0x7f6d38007420 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 >> v1:172.21.15.106:6793/0 conn(0x7f6d3800b1b0 legacy=0x7f6d3800d670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 >> v1:172.21.15.106:6792/0 conn(0x7f6d38003790 legacy=0x7f6d38005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 monclient: found mon.g 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d57fff640 1 -- 172.21.15.171:0/3938618988 reap_dead start 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d38011fb0 con 0x7f6d38007420 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: _finish_auth 0 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d5dbcd640 5 monclient: authenticate success, global_id 5601 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d5dbcd640 10 monclient: _renew_subs 2024-04-25T23:58:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d5dbcd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6d58136be0 con 0x7f6d38007420 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d5dbcd640 10 monclient: _renew_subs 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d5dbcd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6d58135c10 con 0x7f6d38007420 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d4c001d30 con 0x7f6d38007420 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d4c001b20 con 0x7f6d38007420 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d55ffb640 4 set_mon_vals no callback set 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.912+0000 7f6d3ffff640 10 monclient: dump: 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:23.905 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:23.906 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:23.907 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.916+0000 7f6d5dbcd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.916+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6d4c00ff50 con 0x7f6d38007420 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.916+0000 7f6d5dbcd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.916+0000 7f6d5dbcd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.916+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d30005090 con 0x7f6d38007420 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.916+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(77..77 src has 1..77) ==== 5253+0+0 (unknown 2844861607 0 0) 0x7f6d4c044d70 con 0x7f6d38007420 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.916+0000 7f6d577fe640 10 monclient: get_auth_request con 0x7f6d44037c40 auth_method 0 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.924+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6d4c015a80 con 0x7f6d38007420 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.924+0000 7f6d3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:23.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:23.924+0000 7f6d3ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:24.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.104+0000 7f6d5dbcd640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:24.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.104+0000 7f6d5dbcd640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:24.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.104+0000 7f6d5dbcd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.104+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f6d30005b90 con 0x7f6d38007420 2024-04-25T23:58:24.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.104+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v77) ==== 56+0+1273 (unknown 2226722781 0 1253104279) 0x7f6d4c015380 con 0x7f6d38007420 2024-04-25T23:58:24.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.104+0000 7f6d3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:24.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.104+0000 7f6d3ffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:24.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:24.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:24.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f6d300057c0 con 0x7f6d38007420 2024-04-25T23:58:24.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d3ffff640 1 -- 172.21.15.171:0/3938618988 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v77) ==== 56+0+1273 (unknown 2226722781 0 1253104279) 0x7f6d4c0424d0 con 0x7f6d38007420 2024-04-25T23:58:24.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d3ffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:24.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d3ffff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:24.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 >> v1:172.21.15.171:6812/722422047 conn(0x7f6d44037c40 legacy=0x7f6d4403a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 10 monclient: shutdown 2024-04-25T23:58:24.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:24.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 >> v1:172.21.15.171:6790/0 conn(0x7f6d38007420 legacy=0x7f6d380098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 shutdown_connections 2024-04-25T23:58:24.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.200+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 >> 172.21.15.171:0/3938618988 conn(0x7f6d580a7110 msgr2=0x7f6d58133200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:24.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.204+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 shutdown_connections 2024-04-25T23:58:24.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.204+0000 7f6d5dbcd640 1 -- 172.21.15.171:0/3938618988 wait complete. 2024-04-25T23:58:24.202 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd tree-from host1 2024-04-25T23:58:24.202 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:24.202 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree-from host1 2024-04-25T23:58:24.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient: get_monmap_and_config 2024-04-25T23:58:24.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient: build_initial_monmap 2024-04-25T23:58:24.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient: monmap: 2024-04-25T23:58:24.316 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:24.316 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.316 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:24.335864+0000 2024-04-25T23:58:24.316 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:24.335864+0000 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:24.317 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 1 Processor -- start 2024-04-25T23:58:24.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 1 -- start start 2024-04-25T23:58:24.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient: init 2024-04-25T23:58:24.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:24.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient: _add_conns ranks=[8,2,7,6,4,3,5,1,0] 2024-04-25T23:58:24.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient(hunting): picked mon.noname-e con 0x7ff54c131880 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:24.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient(hunting): picked mon.noname-b con 0x7ff54c09e7b0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient(hunting): picked mon.noname-i con 0x7ff54c09ebf0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c09c660 con 0x7ff54c09e7b0 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c09da10 con 0x7ff54c09ebf0 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c09dcf0 con 0x7ff54c131880 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff552af6640 10 monclient(hunting): authenticate will time out at 1155.042807s 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff551093640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7ff54c09ebf0 legacy=0x7ff54c13cfb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff550892640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff54c131880 legacy=0x7ff54c131c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54bfff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7ff54c09e7b0 0x7ff54c139880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:55130/0 (socket says 172.21.15.171:55130) 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54bfff640 1 -- 172.21.15.171:0/490464922 learned_addr learned my addr 172.21.15.171:0/490464922 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1403040429 0 0) 0x7ff54c09c660 con 0x7ff54c09e7b0 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54b7fe640 10 monclient(hunting): my global_id is 5393 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.332+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff538003530 con 0x7ff54c09e7b0 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 960507953 0 0) 0x7ff538003530 con 0x7ff54c09e7b0 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 >> v1:172.21.15.106:6793/0 conn(0x7ff54c131880 legacy=0x7ff54c131c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 >> v1:172.21.15.171:6792/0 conn(0x7ff54c09ebf0 legacy=0x7ff54c13cfb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 monclient: found mon.noname-b 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c09dfd0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 5 monclient: authenticate success, global_id 5393 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff5340017c0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: dump: 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.327 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff534001ab0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:24.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 4 set_mon_vals no callback set 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 1 -- 172.21.15.171:0/490464922 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff534004bf0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54b7fe640 10 monclient: dump: 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.329 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: shutdown 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- 172.21.15.171:0/490464922 >> v1:172.21.15.106:6790/0 conn(0x7ff54c09e7b0 legacy=0x7ff54c139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.330 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- 172.21.15.171:0/490464922 shutdown_connections 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- 172.21.15.171:0/490464922 >> 172.21.15.171:0/490464922 conn(0x7ff54c0a67e0 msgr2=0x7ff54c0a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- 172.21.15.171:0/490464922 shutdown_connections 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- 172.21.15.171:0/490464922 wait complete. 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: build_initial_monmap 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: monmap: 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:24.331 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.332 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 Processor -- start 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- start start 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: init 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: _add_conns ranks=[5,4,0,7,8,2,6,1,3] 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient(hunting): picked mon.noname-h con 0x7ff54c09e7b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient(hunting): picked mon.noname-c con 0x7ff54c09ebf0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient(hunting): picked mon.noname-a con 0x7ff54c131880 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c132c10 con 0x7ff54c131880 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c132ef0 con 0x7ff54c09ebf0 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c1331d0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:24.333 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient(hunting): authenticate will time out at 1155.046405s 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54bfff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff54c09ebf0 legacy=0x7ff54c1cf060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff550892640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7ff54c09e7b0 0x7ff54c13da50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:53166/0 (socket says 172.21.15.171:53166) 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff550892640 1 -- 172.21.15.171:0/3559597004 learned_addr learned my addr 172.21.15.171:0/3559597004 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 488085499 0 0) 0x7ff54c1331d0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): my global_id is 5405 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff52c003560 con 0x7ff54c09e7b0 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 618006742 0 0) 0x7ff52c003560 con 0x7ff54c09e7b0 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff54c1331d0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff5440046b0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): dump: 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.335 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690007918 0 0) 0x7ff54c132c10 con 0x7ff54c131880 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient(hunting): my global_id is 5436 2024-04-25T23:58:24.336 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff52c003560 con 0x7ff54c131880 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3833411376 0 0) 0x7ff54c1331d0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 >> v1:172.21.15.106:6791/0 conn(0x7ff54c09ebf0 legacy=0x7ff54c1cf060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 >> v1:172.21.15.106:6789/0 conn(0x7ff54c131880 legacy=0x7ff54c1d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 monclient: found mon.h 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c1c7e30 con 0x7ff54c09e7b0 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 5 monclient: authenticate success, global_id 5405 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: _renew_subs 2024-04-25T23:58:24.337 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff54c130370 con 0x7ff54c09e7b0 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: _renew_subs 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff552af6640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff54c1c87a0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff544004910 con 0x7ff54c09e7b0 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff544004e80 con 0x7ff54c09e7b0 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff54affd640 4 set_mon_vals no callback set 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.336+0000 7ff5497fa640 10 monclient: dump: 2024-04-25T23:58:24.338 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.339 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.340+0000 7ff552af6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.340+0000 7ff552af6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.340+0000 7ff552af6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.340+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff544005020 con 0x7ff54c09e7b0 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.340+0000 7ff552af6640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff530005090 con 0x7ff54c09e7b0 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.340+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(77..77 src has 1..77) ==== 5253+0+0 (unknown 2844861607 0 0) 0x7ff544044eb0 con 0x7ff54c09e7b0 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.340+0000 7ff54bfff640 10 monclient: get_auth_request con 0x7ff52c037880 auth_method 0 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.344+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff544015b60 con 0x7ff54c09e7b0 2024-04-25T23:58:24.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.344+0000 7ff5497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:24.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.344+0000 7ff5497fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:24.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.492+0000 7ff552af6640 10 start_mon_command cmd=[{"prefix": "osd tree-from", "bucket": "host1"}] 2024-04-25T23:58:24.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.492+0000 7ff552af6640 10 monclient: _send_command 2 [{"prefix": "osd tree-from", "bucket": "host1"}] 2024-04-25T23:58:24.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.492+0000 7ff552af6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:24.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.492+0000 7ff552af6640 1 -- 172.21.15.171:0/3559597004 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree-from", "bucket": "host1"} v 0) -- 0x7ff530005380 con 0x7ff54c09e7b0 2024-04-25T23:58:24.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.492+0000 7ff5497fa640 1 -- 172.21.15.171:0/3559597004 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree-from", "bucket": "host1"}]=-2 bucket 'host1' does not exist v77) ==== 109+0+0 (unknown 1570759592 0 0) 0x7ff544015460 con 0x7ff54c09e7b0 2024-04-25T23:58:24.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.492+0000 7ff5497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree-from", "bucket": "host1"}] 2024-04-25T23:58:24.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.492+0000 7ff5497fa640 10 monclient: _finish_command 2 = mon:2 bucket 'host1' does not exist 2024-04-25T23:58:24.477 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOENT: bucket 'host1' does not exist 2024-04-25T23:58:24.481 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:24.481 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree-from host2 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient: get_monmap_and_config 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient: build_initial_monmap 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient: monmap: 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:24.615827+0000 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:24.615827+0000 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:24.596 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:24.597 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 1 Processor -- start 2024-04-25T23:58:24.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 1 -- start start 2024-04-25T23:58:24.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient: init 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient: _add_conns ranks=[4,0,2,8,3,5,1,6,7] 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient(hunting): picked mon.noname-c con 0x7f11e8136ca0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient(hunting): picked mon.noname-a con 0x7f11e80a4ba0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient(hunting): picked mon.noname-b con 0x7f11e813e480 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e809f680 con 0x7f11e80a4ba0 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e809f960 con 0x7f11e813e480 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e809fc40 con 0x7f11e8136ca0 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11f074a640 10 monclient(hunting): authenticate will time out at 1155.323476s 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11ee4e6640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f11e8136ca0 legacy=0x7f11e8137080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11eece7640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f11e813e480 0x7f11e8140870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:55132/0 (socket says 172.21.15.171:55132) 2024-04-25T23:58:24.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.612+0000 7f11eece7640 1 -- 172.21.15.171:0/1079585213 learned_addr learned my addr 172.21.15.171:0/1079585213 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4120445412 0 0) 0x7f11d8001120 con 0x7f11e80a4ba0 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): my global_id is 5445 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d4003530 con 0x7f11e80a4ba0 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128587527 0 0) 0x7f11e809f960 con 0x7f11e813e480 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient(hunting): my global_id is 5402 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11d8001120 con 0x7f11e813e480 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3951843032 0 0) 0x7f11d4003530 con 0x7f11e80a4ba0 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 >> v1:172.21.15.106:6791/0 conn(0x7f11e8136ca0 legacy=0x7f11e8137080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:24.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 >> v1:172.21.15.106:6790/0 conn(0x7f11e813e480 legacy=0x7f11e8140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: _finish_hunting 0 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 monclient: found mon.noname-a 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e8137790 con 0x7f11e80a4ba0 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: _finish_auth 0 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: _check_auth_tickets 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11d8001990 con 0x7f11e80a4ba0 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: dump: 2024-04-25T23:58:24.608 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.609 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 5 monclient: authenticate success, global_id 5445 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11d8001c40 con 0x7f11e80a4ba0 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 4 set_mon_vals no callback set 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 1 -- 172.21.15.171:0/1079585213 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11d8003960 con 0x7f11e80a4ba0 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ed4e4640 10 monclient: dump: 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.611 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.612 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.612 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.612 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.612 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.612 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.612 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: shutdown 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- 172.21.15.171:0/1079585213 >> v1:172.21.15.106:6789/0 conn(0x7f11e80a4ba0 legacy=0x7f11e813cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- 172.21.15.171:0/1079585213 shutdown_connections 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- 172.21.15.171:0/1079585213 >> 172.21.15.171:0/1079585213 conn(0x7f11e80a70a0 msgr2=0x7f11e80a74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- 172.21.15.171:0/1079585213 shutdown_connections 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- 172.21.15.171:0/1079585213 wait complete. 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: build_initial_monmap 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: monmap: 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:24.613 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 Processor -- start 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- start start 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: init 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: _add_conns ranks=[3,6,8,1,4,7,0,5,2] 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient(hunting): picked mon.noname-g con 0x7f11e80a4ba0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient(hunting): picked mon.noname-d con 0x7f11e8136ca0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient(hunting): picked mon.noname-e con 0x7f11e813e480 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e809bc70 con 0x7f11e80a4ba0 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e809de50 con 0x7f11e8136ca0 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11e8136520 con 0x7f11e813e480 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient(hunting): authenticate will time out at 1155.326939s 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11eece7640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f11e813e480 legacy=0x7f11e81d5170 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ee4e6640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f11e80a4ba0 0x7f11e809afc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53268/0 (socket says 172.21.15.171:53268) 2024-04-25T23:58:24.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11ee4e6640 1 -- 172.21.15.171:0/4091838279 learned_addr learned my addr 172.21.15.171:0/4091838279 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3601942169 0 0) 0x7f11e809bc70 con 0x7f11e80a4ba0 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): my global_id is 5610 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11cc003530 con 0x7f11e80a4ba0 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2246771914 0 0) 0x7f11cc003530 con 0x7f11e80a4ba0 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11e809bc70 con 0x7f11e80a4ba0 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11e4004330 con 0x7f11e80a4ba0 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): dump: 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.616 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:24.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883723859 0 0) 0x7f11e809de50 con 0x7f11e8136ca0 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient(hunting): my global_id is 5487 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11cc003530 con 0x7f11e8136ca0 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1090270915 0 0) 0x7f11e809bc70 con 0x7f11e80a4ba0 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 >> v1:172.21.15.106:6793/0 conn(0x7f11e813e480 legacy=0x7f11e81d5170 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 >> v1:172.21.15.106:6792/0 conn(0x7f11e8136ca0 legacy=0x7f11e81d1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 monclient: found mon.g 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11e809d810 con 0x7f11e80a4ba0 2024-04-25T23:58:24.618 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 5 monclient: authenticate success, global_id 5610 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: _renew_subs 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f11e81369c0 con 0x7f11e80a4ba0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: _renew_subs 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.616+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f11e80a1a40 con 0x7f11e80a4ba0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11e4004620 con 0x7f11e80a4ba0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11e4004b90 con 0x7f11e80a4ba0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.619 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11ecce3640 4 set_mon_vals no callback set 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 10 monclient: dump: 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.620 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f11e4004db0 con 0x7f11e80a4ba0 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11f074a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11f074a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11f074a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11d0005090 con 0x7f11e80a4ba0 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(77..77 src has 1..77) ==== 5253+0+0 (unknown 2844861607 0 0) 0x7f11e4044ce0 con 0x7f11e80a4ba0 2024-04-25T23:58:24.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.620+0000 7f11edce5640 10 monclient: get_auth_request con 0x7f11cc037850 auth_method 0 2024-04-25T23:58:24.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.624+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f11e4015910 con 0x7f11e80a4ba0 2024-04-25T23:58:24.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.624+0000 7f11deffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:24.622 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.624+0000 7f11deffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:24.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.780+0000 7f11f074a640 10 start_mon_command cmd=[{"prefix": "osd tree-from", "bucket": "host2"}] 2024-04-25T23:58:24.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.780+0000 7f11f074a640 10 monclient: _send_command 2 [{"prefix": "osd tree-from", "bucket": "host2"}] 2024-04-25T23:58:24.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.780+0000 7f11f074a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.780+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree-from", "bucket": "host2"} v 0) -- 0x7f11d0005380 con 0x7f11e80a4ba0 2024-04-25T23:58:24.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.780+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree-from", "bucket": "host2"}]=0 v77) ==== 80+0+177 (unknown 3405347542 0 2845383371) 0x7f11e4019560 con 0x7f11e80a4ba0 2024-04-25T23:58:24.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.780+0000 7f11deffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree-from", "bucket": "host2"}] 2024-04-25T23:58:24.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.780+0000 7f11deffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:24.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 10 start_mon_command cmd=[{"prefix": "osd tree-from", "bucket": "host2"}] 2024-04-25T23:58:24.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 10 monclient: _send_command 3 [{"prefix": "osd tree-from", "bucket": "host2"}] 2024-04-25T23:58:24.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:24.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree-from", "bucket": "host2"} v 0) -- 0x7f11d0002220 con 0x7f11e80a4ba0 2024-04-25T23:58:24.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11deffd640 1 -- 172.21.15.171:0/4091838279 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree-from", "bucket": "host2"}]=0 v77) ==== 80+0+177 (unknown 3405347542 0 2845383371) 0x7f11e401aa70 con 0x7f11e80a4ba0 2024-04-25T23:58:24.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11deffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree-from", "bucket": "host2"}] 2024-04-25T23:58:24.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11deffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:24.857 INFO:tasks.workunit.client.0.smithi171.stdout:ID CLASS WEIGHT TYPE NAME STATUS REWEIGHT PRI-AFF 2024-04-25T23:58:24.857 INFO:tasks.workunit.client.0.smithi171.stdout:-16 1.00000 host host2 2024-04-25T23:58:24.857 INFO:tasks.workunit.client.0.smithi171.stdout: 9 1.00000 osd.9 down 1.00000 1.00000 2024-04-25T23:58:24.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 >> v1:172.21.15.171:6812/722422047 conn(0x7f11cc037850 legacy=0x7f11cc039d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 10 monclient: shutdown 2024-04-25T23:58:24.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:24.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 >> v1:172.21.15.171:6790/0 conn(0x7f11e80a4ba0 legacy=0x7f11e809afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 shutdown_connections 2024-04-25T23:58:24.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.872+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 >> 172.21.15.171:0/4091838279 conn(0x7f11e80a70a0 msgr2=0x7f11e8132f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:24.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.876+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 shutdown_connections 2024-04-25T23:58:24.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:24.876+0000 7f11f074a640 1 -- 172.21.15.171:0/4091838279 wait complete. 2024-04-25T23:58:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd tree-from osd.9 2024-04-25T23:58:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:24.872 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree-from osd.9 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.000+0000 7f35d4547640 10 monclient: get_monmap_and_config 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.000+0000 7f35d4547640 10 monclient: build_initial_monmap 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.000+0000 7f35d4547640 10 monclient: monmap: 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:25.005905+0000 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:25.005905+0000 2024-04-25T23:58:24.986 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:24.987 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 Processor -- start 2024-04-25T23:58:24.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- start start 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient: init 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient: _add_conns ranks=[0,7,2,5,4,6,1,8,3] 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient(hunting): picked mon.noname-a con 0x7f35cc131880 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient(hunting): picked mon.noname-i con 0x7f35cc09e7b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient(hunting): picked mon.noname-b con 0x7f35cc09ebf0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc09c660 con 0x7f35cc131880 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc09da10 con 0x7f35cc09ebf0 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc09dcf0 con 0x7f35cc09e7b0 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient(hunting): authenticate will time out at 1155.712960s 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d1ae2640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f35cc09e7b0 legacy=0x7f35cc139880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d2ae4640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f35cc09ebf0 0x7f35cc13cfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:55144/0 (socket says 172.21.15.171:55144) 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d2ae4640 1 -- 172.21.15.171:0/1179945365 learned_addr learned my addr 172.21.15.171:0/1179945365 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:24.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983642983 0 0) 0x7f35cc09da10 con 0x7f35cc09ebf0 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): my global_id is 5411 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b8003530 con 0x7f35cc09ebf0 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104306381 0 0) 0x7f35cc09c660 con 0x7f35cc131880 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): _negotiate 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient(hunting): my global_id is 5454 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35cc09da10 con 0x7f35cc131880 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2841875947 0 0) 0x7f35b8003530 con 0x7f35cc09ebf0 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 >> v1:172.21.15.171:6792/0 conn(0x7f35cc09e7b0 legacy=0x7f35cc139880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 >> v1:172.21.15.106:6789/0 conn(0x7f35cc131880 legacy=0x7f35cc131c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:24.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: _finish_hunting 0 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 monclient: found mon.noname-b 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc09dfd0 con 0x7f35cc09ebf0 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: _finish_auth 0 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: _check_auth_tickets 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35c4001b40 con 0x7f35cc09ebf0 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: dump: 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.997 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:24.998 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 5 monclient: authenticate success, global_id 5411 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35c4001df0 con 0x7f35cc09ebf0 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 4 set_mon_vals no callback set 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 1 -- 172.21.15.171:0/1179945365 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35c4004f70 con 0x7f35cc09ebf0 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d12e1640 10 monclient: dump: 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:24.999 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient: shutdown 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- 172.21.15.171:0/1179945365 >> v1:172.21.15.106:6790/0 conn(0x7f35cc09ebf0 legacy=0x7f35cc13cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- 172.21.15.171:0/1179945365 shutdown_connections 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- 172.21.15.171:0/1179945365 >> 172.21.15.171:0/1179945365 conn(0x7f35cc0a67e0 msgr2=0x7f35cc0a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- 172.21.15.171:0/1179945365 shutdown_connections 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 -- 172.21.15.171:0/1179945365 wait complete. 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient: build_initial_monmap 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 10 monclient: monmap: 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:25.001 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.004+0000 7f35d4547640 1 Processor -- start 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 1 -- start start 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: init 2024-04-25T23:58:25.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _add_conns ranks=[6,0,5,4,8,3,7,2,1] 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient(hunting): picked mon.noname-d con 0x7f35cc09e7b0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient(hunting): picked mon.noname-a con 0x7f35cc09ebf0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient(hunting): picked mon.noname-h con 0x7f35cc131880 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc0721a0 con 0x7f35cc09ebf0 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc09d4c0 con 0x7f35cc131880 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35cc072810 con 0x7f35cc09e7b0 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient(hunting): authenticate will time out at 1155.716570s 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d2ae4640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f35cc131880 0x7f35cc1d4510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:53174/0 (socket says 172.21.15.171:53174) 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d2ae4640 1 -- 172.21.15.171:0/3183364435 learned_addr learned my addr 172.21.15.171:0/3183364435 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 898289107 0 0) 0x7f35cc09d4c0 con 0x7f35cc131880 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): my global_id is 5414 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b0003530 con 0x7f35cc131880 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 64142425 0 0) 0x7f35b0003530 con 0x7f35cc131880 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35cc09d4c0 con 0x7f35cc131880 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35c4004eb0 con 0x7f35cc131880 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.004 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 19664964 0 0) 0x7f35cc072810 con 0x7f35cc09e7b0 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): my global_id is 5496 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35b0003530 con 0x7f35cc09e7b0 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624955779 0 0) 0x7f35cc0721a0 con 0x7f35cc09ebf0 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient(hunting): my global_id is 5463 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35cc072810 con 0x7f35cc09ebf0 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3453519923 0 0) 0x7f35cc09d4c0 con 0x7f35cc131880 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 >> v1:172.21.15.106:6792/0 conn(0x7f35cc09e7b0 legacy=0x7f35cc130b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 >> v1:172.21.15.106:6789/0 conn(0x7f35cc09ebf0 legacy=0x7f35cc1c8c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 monclient: found mon.h 2024-04-25T23:58:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35cc122550 con 0x7f35cc131880 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 5 monclient: authenticate success, global_id 5414 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _renew_subs 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f35cc131260 con 0x7f35cc131880 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _renew_subs 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f35cc1c9510 con 0x7f35cc131880 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35c4001df0 con 0x7f35cc131880 2024-04-25T23:58:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35c40055c0 con 0x7f35cc131880 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d0ae0640 4 set_mon_vals no callback set 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 10 monclient: dump: 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.008 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f35c4010360 con 0x7f35cc131880 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d4547640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35b4005090 con 0x7f35cc131880 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(77..77 src has 1..77) ==== 5253+0+0 (unknown 2844861607 0 0) 0x7f35c4044f70 con 0x7f35cc131880 2024-04-25T23:58:25.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.008+0000 7f35d22e3640 10 monclient: get_auth_request con 0x7f35b0037a50 auth_method 0 2024-04-25T23:58:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.012+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f35c4019830 con 0x7f35cc131880 2024-04-25T23:58:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.012+0000 7f35c2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.012+0000 7f35c2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.172+0000 7f35d4547640 10 start_mon_command cmd=[{"prefix": "osd tree-from", "bucket": "osd.9"}] 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.172+0000 7f35d4547640 10 monclient: _send_command 2 [{"prefix": "osd tree-from", "bucket": "osd.9"}] 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.172+0000 7f35d4547640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.172+0000 7f35d4547640 1 -- 172.21.15.171:0/3183364435 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree-from", "bucket": "osd.9"} v 0) -- 0x7f35b4005380 con 0x7f35cc131880 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.172+0000 7f35c2ffd640 1 -- 172.21.15.171:0/3183364435 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree-from", "bucket": "osd.9"}]=-22 "osd.9" is not a bucket v77) ==== 103+0+0 (unknown 1856690693 0 0) 0x7f35c401e0f0 con 0x7f35cc131880 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.172+0000 7f35c2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree-from", "bucket": "osd.9"}] 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.172+0000 7f35c2ffd640 10 monclient: _finish_command 2 = mon:22 "osd.9" is not a bucket 2024-04-25T23:58:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: "osd.9" is not a bucket 2024-04-25T23:58:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush rm bar 2024-04-25T23:58:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm bar 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 10 monclient: get_monmap_and_config 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 10 monclient: build_initial_monmap 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 10 monclient: monmap: 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:25.292920+0000 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:25.292920+0000 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:25.273 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:25.274 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 1 Processor -- start 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 1 -- start start 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 10 monclient: init 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.288+0000 7fe321871640 10 monclient: _add_conns ranks=[6,0,7,2,1,5,3,8,4] 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): picked mon.noname-d con 0x7fe31c06fe00 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): picked mon.noname-a con 0x7fe31c06f600 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): picked mon.noname-i con 0x7fe31c0701e0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c06fa00 con 0x7fe31c06f600 2024-04-25T23:58:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c135400 con 0x7fe31c06fe00 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c071670 con 0x7fe31c0701e0 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): authenticate will time out at 1156.000112s 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe31b7fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fe31c0701e0 legacy=0x7fe31c13d930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe31a7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe31c06f600 0x7fe31c134cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:50400/0 (socket says 172.21.15.171:50400) 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe31a7fc640 1 -- 172.21.15.171:0/346070055 learned_addr learned my addr 172.21.15.171:0/346070055 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709668665 0 0) 0x7fe31c06fa00 con 0x7fe31c06f600 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): my global_id is 5472 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe304003530 con 0x7fe31c06f600 2024-04-25T23:58:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507062594 0 0) 0x7fe31c135400 con 0x7fe31c06fe00 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient(hunting): my global_id is 5505 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe31c06fa00 con 0x7fe31c06fe00 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3093790214 0 0) 0x7fe31c06fa00 con 0x7fe31c06fe00 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 >> v1:172.21.15.171:6792/0 conn(0x7fe31c0701e0 legacy=0x7fe31c13d930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 >> v1:172.21.15.106:6789/0 conn(0x7fe31c06f600 legacy=0x7fe31c134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 monclient: found mon.noname-d 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c070630 con 0x7fe31c06fe00 2024-04-25T23:58:25.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe314001b20 con 0x7fe31c06fe00 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: dump: 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 5 monclient: authenticate success, global_id 5505 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe314001d80 con 0x7fe31c06fe00 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:25.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 4 set_mon_vals no callback set 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 1 -- 172.21.15.171:0/346070055 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe314003ce0 con 0x7fe31c06fe00 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe319ffb640 10 monclient: dump: 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.290 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient: shutdown 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- 172.21.15.171:0/346070055 >> v1:172.21.15.106:6792/0 conn(0x7fe31c06fe00 legacy=0x7fe31c1345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- 172.21.15.171:0/346070055 shutdown_connections 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- 172.21.15.171:0/346070055 >> 172.21.15.171:0/346070055 conn(0x7fe31c0a2620 msgr2=0x7fe31c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- 172.21.15.171:0/346070055 shutdown_connections 2024-04-25T23:58:25.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- 172.21.15.171:0/346070055 wait complete. 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient: build_initial_monmap 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient: monmap: 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:25.292 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 Processor -- start 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- start start 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient: init 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient: _add_conns ranks=[1,2,3,0,5,4,7,8,6] 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): picked mon.noname-f con 0x7fe31c06f600 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): picked mon.noname-b con 0x7fe31c06fe00 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): picked mon.noname-g con 0x7fe31c0701e0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c1247f0 con 0x7fe31c06f600 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c123340 con 0x7fe31c06fe00 2024-04-25T23:58:25.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe31c070d60 con 0x7fe31c0701e0 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe31affd640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fe31c06f600 legacy=0x7fe31c1ccb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe321871640 10 monclient(hunting): authenticate will time out at 1156.003650s 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe31b7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fe31c0701e0 0x7fe31c1d4ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53284/0 (socket says 172.21.15.171:53284) 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.292+0000 7fe31b7fe640 1 -- 172.21.15.171:0/1882690190 learned_addr learned my addr 172.21.15.171:0/1882690190 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2772812280 0 0) 0x7fe31c070d60 con 0x7fe31c0701e0 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): my global_id is 5619 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe308003530 con 0x7fe31c0701e0 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 312184168 0 0) 0x7fe308003530 con 0x7fe31c0701e0 2024-04-25T23:58:25.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe31c070d60 con 0x7fe31c0701e0 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe30c0041e0 con 0x7fe31c0701e0 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): dump: 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.295 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1086304695 0 0) 0x7fe31c123340 con 0x7fe31c06fe00 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient(hunting): my global_id is 5420 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe308003530 con 0x7fe31c06fe00 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 794792547 0 0) 0x7fe31c070d60 con 0x7fe31c0701e0 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 >> v1:172.21.15.106:6790/0 conn(0x7fe31c06fe00 legacy=0x7fe31c1d17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 >> v1:172.21.15.171:6789/0 conn(0x7fe31c06f600 legacy=0x7fe31c1ccb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:25.296 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 monclient: found mon.g 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe31c070880 con 0x7fe31c0701e0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 5 monclient: authenticate success, global_id 5619 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 10 monclient: _renew_subs 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe31c124510 con 0x7fe31c0701e0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 10 monclient: _renew_subs 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe31c1cd290 con 0x7fe31c0701e0 2024-04-25T23:58:25.297 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe30c0044d0 con 0x7fe31c0701e0 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe30c004a40 con 0x7fe31c0701e0 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe318ff9640 4 set_mon_vals no callback set 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 10 monclient: dump: 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.298 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe321871640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2fc005090 con 0x7fe31c0701e0 2024-04-25T23:58:25.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe30c004c20 con 0x7fe31c0701e0 2024-04-25T23:58:25.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(77..77 src has 1..77) ==== 5253+0+0 (unknown 2844861607 0 0) 0x7fe30c044af0 con 0x7fe31c0701e0 2024-04-25T23:58:25.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.296+0000 7fe31affd640 10 monclient: get_auth_request con 0x7fe308037770 auth_method 0 2024-04-25T23:58:25.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.300+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe30c0156e0 con 0x7fe31c0701e0 2024-04-25T23:58:25.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.300+0000 7fe303fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:25.300 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.300+0000 7fe303fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:25.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.452+0000 7fe321871640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:25.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.452+0000 7fe321871640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:25.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.452+0000 7fe321871640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:25.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.452+0000 7fe321871640 1 -- 172.21.15.171:0/1882690190 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "bar"} v 0) -- 0x7fe2fc005380 con 0x7fe31c0701e0 2024-04-25T23:58:25.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.456+0000 7fe303fff640 1 -- 172.21.15.171:0/1882690190 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "bar"}]=-39 (39) Directory not empty v77) ==== 99+0+0 (unknown 2202415905 0 0) 0x7fe30c014fe0 con 0x7fe31c0701e0 2024-04-25T23:58:25.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.456+0000 7fe303fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:25.440 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.456+0000 7fe303fff640 10 monclient: _finish_command 2 = mon:39 (39) Directory not empty 2024-04-25T23:58:25.440 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOTEMPTY: (39) Directory not empty 2024-04-25T23:58:25.443 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:25.444 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush unlink host2 2024-04-25T23:58:25.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient: get_monmap_and_config 2024-04-25T23:58:25.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient: build_initial_monmap 2024-04-25T23:58:25.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient: monmap: 2024-04-25T23:58:25.560 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:25.561 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.561 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:25.579668+0000 2024-04-25T23:58:25.561 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:25.579668+0000 2024-04-25T23:58:25.561 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:25.561 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.561 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:25.561 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:25.562 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 1 Processor -- start 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 1 -- start start 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient: init 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient: _add_conns ranks=[3,0,8,5,7,6,1,4,2] 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient(hunting): picked mon.noname-g con 0x7fb4a806fe00 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient(hunting): picked mon.noname-a con 0x7fb4a806f600 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:25.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient(hunting): picked mon.noname-e con 0x7fb4a80701e0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a806fa00 con 0x7fb4a806f600 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a8135400 con 0x7fb4a806fe00 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a8071670 con 0x7fb4a80701e0 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient(hunting): authenticate will time out at 1156.286707s 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ae4dd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fb4a806fe00 0x7fb4a81345e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53286/0 (socket says 172.21.15.171:53286) 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ae4dd640 1 -- 172.21.15.171:0/5396019 learned_addr learned my addr 172.21.15.171:0/5396019 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4aecde640 1 -- 172.21.15.171:0/5396019 >> v1:172.21.15.106:6793/0 conn(0x7fb4a80701e0 legacy=0x7fb4a813d930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:25.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052077870 0 0) 0x7fb4a8135400 con 0x7fb4a806fe00 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient(hunting): _negotiate 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient(hunting): my global_id is 5628 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb494003530 con 0x7fb4a806fe00 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2584023804 0 0) 0x7fb494003530 con 0x7fb4a806fe00 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 >> v1:172.21.15.106:6793/0 conn(0x7fb4a80701e0 legacy=0x7fb4a813d930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 >> v1:172.21.15.106:6789/0 conn(0x7fb4a806f600 legacy=0x7fb4a8134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: _finish_hunting 0 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 monclient: found mon.noname-g 2024-04-25T23:58:25.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a8070630 con 0x7fb4a806fe00 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: _finish_auth 0 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: _check_auth_tickets 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4a40017c0 con 0x7fb4a806fe00 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 5 monclient: authenticate success, global_id 5628 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:25.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: dump: 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.572 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4a4001ab0 con 0x7fb4a806fe00 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4b0741640 4 set_mon_vals no callback set 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 1 -- 172.21.15.171:0/5396019 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4a4004bf0 con 0x7fb4a806fe00 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.576+0000 7fb4ad4db640 10 monclient: dump: 2024-04-25T23:58:25.573 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:25.574 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient: shutdown 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- 172.21.15.171:0/5396019 >> v1:172.21.15.171:6790/0 conn(0x7fb4a806fe00 legacy=0x7fb4a81345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- 172.21.15.171:0/5396019 shutdown_connections 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- 172.21.15.171:0/5396019 >> 172.21.15.171:0/5396019 conn(0x7fb4a80a2620 msgr2=0x7fb4a80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- 172.21.15.171:0/5396019 shutdown_connections 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- 172.21.15.171:0/5396019 wait complete. 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient: build_initial_monmap 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient: monmap: 2024-04-25T23:58:25.575 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:25.576 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 Processor -- start 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- start start 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient: init 2024-04-25T23:58:25.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient: _add_conns ranks=[8,4,7,2,3,0,5,1,6] 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient(hunting): picked mon.noname-e con 0x7fb4a806f600 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient(hunting): picked mon.noname-c con 0x7fb4a806fe00 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient(hunting): picked mon.noname-i con 0x7fb4a80701e0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a8070d60 con 0x7fb4a806fe00 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a8070880 con 0x7fb4a80701e0 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a81341b0 con 0x7fb4a806f600 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4b0741640 10 monclient(hunting): authenticate will time out at 1156.289717s 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4aecde640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fb4a80701e0 legacy=0x7fb4a81d51d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4adcdc640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fb4a806fe00 legacy=0x7fb4a81d1aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:25.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.580+0000 7fb4ae4dd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb4a806f600 legacy=0x7fb4a81cc820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:25.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.784+0000 7fb4aecde640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fb4a80701e0 legacy=0x7fb4a81d51d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:25.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.784+0000 7fb4adcdc640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fb4a806fe00 legacy=0x7fb4a81d1aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:25.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:25.784+0000 7fb4ae4dd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb4a806f600 legacy=0x7fb4a81cc820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:26.188+0000 7fb4aecde640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fb4a80701e0 legacy=0x7fb4a81d51d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:26.188+0000 7fb4adcdc640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fb4a806fe00 legacy=0x7fb4a81d1aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:26.188+0000 7fb4ae4dd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb4a806f600 legacy=0x7fb4a81cc820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:26.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:26.992+0000 7fb4aecde640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fb4a80701e0 legacy=0x7fb4a81d51d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:26.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:26.992+0000 7fb4ae4dd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb4a806f600 legacy=0x7fb4a81cc820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:26.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:26.992+0000 7fb4adcdc640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fb4a806fe00 legacy=0x7fb4a81d1aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:28.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient(hunting): tick 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 1 monclient(hunting): continuing hunt 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb4a806f600 legacy=0x7fb4a81cc820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fb4a80701e0 legacy=0x7fb4a81d51d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fb4a806fe00 legacy=0x7fb4a81d1aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient: _add_conns ranks=[3,2,5,0,6,1] 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient(hunting): picked mon.noname-g con 0x7fb490003790 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient(hunting): picked mon.noname-b con 0x7fb490007420 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient(hunting): picked mon.noname-h con 0x7fb49000b1b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a81238a0 con 0x7fb490007420 2024-04-25T23:58:28.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a8070d60 con 0x7fb490003790 2024-04-25T23:58:28.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4a8070880 con 0x7fb49000b1b0 2024-04-25T23:58:28.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49dffb640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:28.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb4ae4dd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fb490003790 0x7fb490005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:53302/0 (socket says 172.21.15.171:53302) 2024-04-25T23:58:28.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb4ae4dd640 1 -- 172.21.15.171:0/255576972 learned_addr learned my addr 172.21.15.171:0/255576972 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:28.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246745471 0 0) 0x7fb4a8070d60 con 0x7fb490003790 2024-04-25T23:58:28.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): my global_id is 5637 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb48c003530 con 0x7fb490003790 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835327541 0 0) 0x7fb4a8070880 con 0x7fb49000b1b0 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): my global_id is 5423 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4a8070d60 con 0x7fb49000b1b0 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 298214946 0 0) 0x7fb4a81238a0 con 0x7fb490007420 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:28.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): my global_id is 5429 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4a8070880 con 0x7fb490007420 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1634784783 0 0) 0x7fb48c003530 con 0x7fb490003790 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4a81238a0 con 0x7fb490003790 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4a4001780 con 0x7fb490003790 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): dump: 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:28.571 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2504634519 0 0) 0x7fb4a8070d60 con 0x7fb49000b1b0 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb48c003530 con 0x7fb49000b1b0 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.580+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 963337097 0 0) 0x7fb4a8070880 con 0x7fb490007420 2024-04-25T23:58:28.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4a8070d60 con 0x7fb490007420 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4a0004600 con 0x7fb49000b1b0 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient(hunting): dump: 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:28.573 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb498001bd0 con 0x7fb490007420 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient(hunting): dump: 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:28.574 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:28.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2456359263 0 0) 0x7fb4a81238a0 con 0x7fb490003790 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 >> v1:172.21.15.171:6791/0 conn(0x7fb49000b1b0 legacy=0x7fb49000d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 >> v1:172.21.15.106:6790/0 conn(0x7fb490007420 legacy=0x7fb4900098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 monclient: found mon.g 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4a81341b0 con 0x7fb490003790 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: _finish_auth 0 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4aecde640 1 -- 172.21.15.171:0/255576972 reap_dead start 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 5 monclient: authenticate success, global_id 5637 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 10 monclient: _renew_subs 2024-04-25T23:58:28.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb4a8124560 con 0x7fb490003790 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 10 monclient: _renew_subs 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb4a81cc820 con 0x7fb490003790 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4a4001ab0 con 0x7fb490003790 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4accda640 4 set_mon_vals no callback set 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4a4001ce0 con 0x7fb490003790 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 10 monclient: dump: 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.577 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:28.578 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:28.578 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:28.578 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:28.578 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:28.578 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:28.578 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb4a40100e0 con 0x7fb490003790 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb484005090 con 0x7fb490003790 2024-04-25T23:58:28.582 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(77..77 src has 1..77) ==== 5253+0+0 (unknown 2844861607 0 0) 0x7fb4a4044c00 con 0x7fb490003790 2024-04-25T23:58:28.583 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.584+0000 7fb4adcdc640 10 monclient: get_auth_request con 0x7fb48c037f80 auth_method 0 2024-04-25T23:58:28.583 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.596+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb4a40158b0 con 0x7fb490003790 2024-04-25T23:58:28.583 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.596+0000 7fb49effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:28.583 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.596+0000 7fb49effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:28.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.780+0000 7fb4b0741640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host2"}] 2024-04-25T23:58:28.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.780+0000 7fb4b0741640 10 monclient: _send_command 2 [{"prefix": "osd crush unlink", "name": "host2"}] 2024-04-25T23:58:28.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.780+0000 7fb4b0741640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:28.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:28.780+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush unlink", "name": "host2"} v 0) -- 0x7fb484005380 con 0x7fb490003790 2024-04-25T23:58:29.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:29.708+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host2"}]=0 removed item id -16 name 'host2' from crush map v78) ==== 128+0+0 (unknown 2690968142 0 0) 0x7fb4a40151b0 con 0x7fb490003790 2024-04-25T23:58:29.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:29.708+0000 7fb49effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush unlink", "name": "host2"}] 2024-04-25T23:58:29.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:29.708+0000 7fb49effd640 10 monclient: _finish_command 2 = system:0 removed item id -16 name 'host2' from crush map 2024-04-25T23:58:29.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:29.816+0000 7fb4b0741640 10 start_mon_command cmd=[{"prefix": "osd crush unlink", "name": "host2"}] 2024-04-25T23:58:29.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:29.816+0000 7fb4b0741640 10 monclient: _send_command 3 [{"prefix": "osd crush unlink", "name": "host2"}] 2024-04-25T23:58:29.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:29.816+0000 7fb4b0741640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:29.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:29.816+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush unlink", "name": "host2"} v 0) -- 0x7fb484002220 con 0x7fb490003790 2024-04-25T23:58:30.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.720+0000 7fb49effd640 1 -- 172.21.15.171:0/255576972 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush unlink", "name": "host2"}]=0 removed item id -16 name 'host2' from crush map v79) ==== 128+0+0 (unknown 3388351724 0 0) 0x7fb4a401dd00 con 0x7fb490003790 2024-04-25T23:58:30.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.720+0000 7fb49effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush unlink", "name": "host2"}] 2024-04-25T23:58:30.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.720+0000 7fb49effd640 10 monclient: _finish_command 3 = system:0 removed item id -16 name 'host2' from crush map 2024-04-25T23:58:30.704 INFO:tasks.workunit.client.0.smithi171.stderr:removed item id -16 name 'host2' from crush map 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 >> v1:172.21.15.171:6812/722422047 conn(0x7fb48c037f80 legacy=0x7fb48c03a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 10 monclient: shutdown 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 >> v1:172.21.15.171:6790/0 conn(0x7fb490003790 legacy=0x7fb490005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 shutdown_connections 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 >> 172.21.15.171:0/255576972 conn(0x7fb4a80a2620 msgr2=0x7fb4a8131c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 shutdown_connections 2024-04-25T23:58:30.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.724+0000 7fb4b0741640 1 -- 172.21.15.171:0/255576972 wait complete. 2024-04-25T23:58:30.724 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket host-for-test host root=root-for-test rack=rack-for-test 2024-04-25T23:58:30.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.864+0000 7fdb93276640 10 monclient: get_monmap_and_config 2024-04-25T23:58:30.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.864+0000 7fdb93276640 10 monclient: build_initial_monmap 2024-04-25T23:58:30.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.864+0000 7fdb93276640 10 monclient: monmap: 2024-04-25T23:58:30.849 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:30.849 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:30.869205+0000 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:30.869205+0000 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:30.850 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:30.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.864+0000 7fdb93276640 1 Processor -- start 2024-04-25T23:58:30.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.864+0000 7fdb93276640 1 -- start start 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.864+0000 7fdb93276640 10 monclient: init 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.864+0000 7fdb93276640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: _add_conns ranks=[0,3,7,5,6,1,2,4,8] 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): picked mon.noname-a con 0x7fdb8c135a00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): picked mon.noname-g con 0x7fdb8c0a1790 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): picked mon.noname-i con 0x7fdb8c13c130 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c0a1d80 con 0x7fdb8c135a00 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c072f70 con 0x7fdb8c0a1790 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c072640 con 0x7fdb8c13c130 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): authenticate will time out at 1161.576118s 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb91813640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fdb8c13c130 legacy=0x7fdb8c13e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:30.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb90811640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fdb8c0a1790 0x7fdb8c13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60136/0 (socket says 172.21.15.171:60136) 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb90811640 1 -- 172.21.15.171:0/3794066254 learned_addr learned my addr 172.21.15.171:0/3794066254 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2153095007 0 0) 0x7fdb8c072f70 con 0x7fdb8c0a1790 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient(hunting): my global_id is 5646 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb78003530 con 0x7fdb8c0a1790 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3023701029 0 0) 0x7fdb78003530 con 0x7fdb8c0a1790 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 >> v1:172.21.15.171:6792/0 conn(0x7fdb8c13c130 legacy=0x7fdb8c13e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 >> v1:172.21.15.106:6789/0 conn(0x7fdb8c135a00 legacy=0x7fdb8c135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 monclient: found mon.noname-g 2024-04-25T23:58:30.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c072920 con 0x7fdb8c0a1790 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb880017c0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: dump: 2024-04-25T23:58:30.860 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:30.861 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 5 monclient: authenticate success, global_id 5646 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb88001af0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 1 -- 172.21.15.171:0/3794066254 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb88004bf0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 4 set_mon_vals no callback set 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb83fff640 10 monclient: dump: 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:30.862 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: shutdown 2024-04-25T23:58:30.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- 172.21.15.171:0/3794066254 >> v1:172.21.15.171:6790/0 conn(0x7fdb8c0a1790 legacy=0x7fdb8c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- 172.21.15.171:0/3794066254 shutdown_connections 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- 172.21.15.171:0/3794066254 >> 172.21.15.171:0/3794066254 conn(0x7fdb8c0a2690 msgr2=0x7fdb8c0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- 172.21.15.171:0/3794066254 shutdown_connections 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- 172.21.15.171:0/3794066254 wait complete. 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: build_initial_monmap 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: monmap: 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:30.864 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 Processor -- start 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- start start 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: init 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient: _add_conns ranks=[5,8,3,0,6,7,4,1,2] 2024-04-25T23:58:30.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): picked mon.noname-h con 0x7fdb8c0a1790 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): picked mon.noname-e con 0x7fdb8c135a00 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): picked mon.noname-g con 0x7fdb8c13c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c09c4b0 con 0x7fdb8c13c130 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c09c790 con 0x7fdb8c0a1790 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb8c0705a0 con 0x7fdb8c135a00 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb93276640 10 monclient(hunting): authenticate will time out at 1161.579360s 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb91813640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fdb8c13c130 0x7fdb8c1d4820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60140/0 (socket says 172.21.15.171:60140) 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb91813640 1 -- 172.21.15.171:0/463231364 learned_addr learned my addr 172.21.15.171:0/463231364 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb90811640 1 -- 172.21.15.171:0/463231364 >> v1:172.21.15.106:6793/0 conn(0x7fdb8c135a00 legacy=0x7fdb8c12ca80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764072257 0 0) 0x7fdb8c09c790 con 0x7fdb8c0a1790 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:30.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): my global_id is 5432 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb70003530 con 0x7fdb8c0a1790 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903780521 0 0) 0x7fdb8c09c4b0 con 0x7fdb8c13c130 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 10 monclient(hunting): my global_id is 5655 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.868+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb8c09c790 con 0x7fdb8c13c130 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2307475237 0 0) 0x7fdb70003530 con 0x7fdb8c0a1790 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb8c09c4b0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb7c001990 con 0x7fdb8c0a1790 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:30.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:30.868 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2745811239 0 0) 0x7fdb8c09c790 con 0x7fdb8c13c130 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb70003530 con 0x7fdb8c13c130 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb84004560 con 0x7fdb8c13c130 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:30.869 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3936033630 0 0) 0x7fdb8c09c4b0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 >> v1:172.21.15.106:6793/0 conn(0x7fdb8c135a00 legacy=0x7fdb8c12ca80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 >> v1:172.21.15.171:6790/0 conn(0x7fdb8c13c130 legacy=0x7fdb8c1d4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:30.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 monclient: found mon.h 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb8c09f6f0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 5 monclient: authenticate success, global_id 5432 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 10 monclient: _renew_subs 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb8c12d190 con 0x7fdb8c0a1790 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 10 monclient: _renew_subs 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:30.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb8c071300 con 0x7fdb8c0a1790 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb7c0038d0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb7c001d50 con 0x7fdb8c0a1790 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb837fe640 4 set_mon_vals no callback set 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 10 monclient: dump: 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:30.872 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdb7c003ec0 con 0x7fdb8c0a1790 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb6c005090 con 0x7fdb8c0a1790 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(79..79 src has 1..79) ==== 5205+0+0 (unknown 3741792460 0 0) 0x7fdb7c043980 con 0x7fdb8c0a1790 2024-04-25T23:58:30.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.872+0000 7fdb90811640 10 monclient: get_auth_request con 0x7fdb70037cf0 auth_method 0 2024-04-25T23:58:30.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.876+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdb7c014600 con 0x7fdb8c0a1790 2024-04-25T23:58:30.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.876+0000 7fdb81ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:30.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:30.876+0000 7fdb81ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:31.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.040+0000 7fdb93276640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}] 2024-04-25T23:58:31.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.040+0000 7fdb93276640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}] 2024-04-25T23:58:31.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.040+0000 7fdb93276640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:31.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.040+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]} v 0) -- 0x7fdb6c005380 con 0x7fdb8c0a1790 2024-04-25T23:58:31.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.732+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}]=0 added bucket host-for-test type host to location {rack=rack-for-test,root=root-for-test} v80) ==== 251+0+0 (unknown 3118541439 0 0) 0x7fdb7c013f00 con 0x7fdb8c0a1790 2024-04-25T23:58:31.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.732+0000 7fdb81ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}] 2024-04-25T23:58:31.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.732+0000 7fdb81ffb640 10 monclient: _finish_command 2 = system:0 added bucket host-for-test type host to location {rack=rack-for-test,root=root-for-test} 2024-04-25T23:58:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.836+0000 7fdb93276640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}] 2024-04-25T23:58:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.836+0000 7fdb93276640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}] 2024-04-25T23:58:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.836+0000 7fdb93276640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.836+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]} v 0) -- 0x7fdb6c005d80 con 0x7fdb8c0a1790 2024-04-25T23:58:31.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.836+0000 7fdb81ffb640 1 -- 172.21.15.171:0/463231364 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}]=0 bucket 'host-for-test' already exists v80) ==== 200+0+0 (unknown 1413236190 0 0) 0x7fdb7c01cab0 con 0x7fdb8c0a1790 2024-04-25T23:58:31.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.836+0000 7fdb81ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "host-for-test", "type": "host", "args": ["root=root-for-test", "rack=rack-for-test"]}] 2024-04-25T23:58:31.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.836+0000 7fdb81ffb640 10 monclient: _finish_command 3 = system:0 bucket 'host-for-test' already exists 2024-04-25T23:58:31.821 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'host-for-test' already exists 2024-04-25T23:58:31.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 >> v1:172.21.15.171:6812/722422047 conn(0x7fdb70037cf0 legacy=0x7fdb7003a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:31.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 10 monclient: shutdown 2024-04-25T23:58:31.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:31.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 >> v1:172.21.15.171:6791/0 conn(0x7fdb8c0a1790 legacy=0x7fdb8c12c370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:31.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 shutdown_connections 2024-04-25T23:58:31.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 >> 172.21.15.171:0/463231364 conn(0x7fdb8c0a2690 msgr2=0x7fdb8c0a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:31.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 shutdown_connections 2024-04-25T23:58:31.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.840+0000 7fdb93276640 1 -- 172.21.15.171:0/463231364 wait complete. 2024-04-25T23:58:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:31.839 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep host-for-test 2024-04-25T23:58:31.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.968+0000 7f9ba9452640 10 monclient: get_monmap_and_config 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.968+0000 7f9ba9452640 10 monclient: build_initial_monmap 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient: monmap: 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:31.974514+0000 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:31.974514+0000 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:31.955 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:31.956 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:31.956 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:31.956 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:31.956 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:31.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 Processor -- start 2024-04-25T23:58:31.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- start start 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient: init 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient: _add_conns ranks=[0,7,2,5,8,1,6,4,3] 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient(hunting): picked mon.noname-a con 0x7f9ba41328a0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient(hunting): picked mon.noname-i con 0x7f9ba409b840 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient(hunting): picked mon.noname-b con 0x7f9ba409b3e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba4133390 con 0x7f9ba41328a0 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba409cc80 con 0x7f9ba409b3e0 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba409c2a0 con 0x7f9ba409b840 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba27fc640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f9ba409b840 legacy=0x7f9ba413aa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient(hunting): authenticate will time out at 1162.681618s 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba2ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9ba41328a0 0x7f9ba4132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:45194/0 (socket says 172.21.15.171:45194) 2024-04-25T23:58:31.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba2ffd640 1 -- 172.21.15.171:0/3602161536 learned_addr learned my addr 172.21.15.171:0/3602161536 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 990041391 0 0) 0x7f9ba4133390 con 0x7f9ba41328a0 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): my global_id is 5499 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b90003530 con 0x7f9ba41328a0 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4246360156 0 0) 0x7f9ba409cc80 con 0x7f9ba409b3e0 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient(hunting): my global_id is 5438 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ba4133390 con 0x7f9ba409b3e0 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 142804238 0 0) 0x7f9b90003530 con 0x7f9ba41328a0 2024-04-25T23:58:31.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 >> v1:172.21.15.171:6792/0 conn(0x7f9ba409b840 legacy=0x7f9ba413aa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 >> v1:172.21.15.106:6790/0 conn(0x7f9ba409b3e0 legacy=0x7f9ba413e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 monclient: found mon.noname-a 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba409f7b0 con 0x7f9ba41328a0 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b8c0017c0 con 0x7f9ba41328a0 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: dump: 2024-04-25T23:58:31.962 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:31.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 5 monclient: authenticate success, global_id 5499 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b8c001ae0 con 0x7f9ba41328a0 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 1 -- 172.21.15.171:0/3602161536 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b8c004bf0 con 0x7f9ba41328a0 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 4 set_mon_vals no callback set 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba1ffb640 10 monclient: dump: 2024-04-25T23:58:31.964 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:31.965 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 10 monclient: shutdown 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- 172.21.15.171:0/3602161536 >> v1:172.21.15.106:6789/0 conn(0x7f9ba41328a0 legacy=0x7f9ba4132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- 172.21.15.171:0/3602161536 shutdown_connections 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- 172.21.15.171:0/3602161536 >> 172.21.15.171:0/3602161536 conn(0x7f9ba40a28a0 msgr2=0x7f9ba40a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- 172.21.15.171:0/3602161536 shutdown_connections 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.972+0000 7f9ba9452640 1 -- 172.21.15.171:0/3602161536 wait complete. 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: build_initial_monmap 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: monmap: 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:31.966 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 1 Processor -- start 2024-04-25T23:58:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 1 -- start start 2024-04-25T23:58:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: init 2024-04-25T23:58:31.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:31.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: _add_conns ranks=[2,8,0,3,1,4,6,7,5] 2024-04-25T23:58:31.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient(hunting): picked mon.noname-b con 0x7f9ba409b3e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:31.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient(hunting): picked mon.noname-e con 0x7f9ba409b840 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:31.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient(hunting): picked mon.noname-a con 0x7f9ba41328a0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:31.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba413b840 con 0x7f9ba41328a0 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba413bb20 con 0x7f9ba409b3e0 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ba413e6c0 con 0x7f9ba409b840 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient(hunting): authenticate will time out at 1162.685770s 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba27fc640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9ba409b840 legacy=0x7f9ba41cfb80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba2ffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f9ba409b3e0 0x7f9ba41caba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51512/0 (socket says 172.21.15.171:51512) 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba2ffd640 1 -- 172.21.15.171:0/4167346469 learned_addr learned my addr 172.21.15.171:0/4167346469 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 610863002 0 0) 0x7f9ba413bb20 con 0x7f9ba409b3e0 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): my global_id is 5447 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b84003530 con 0x7f9ba409b3e0 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2268831876 0 0) 0x7f9ba413b840 con 0x7f9ba41328a0 2024-04-25T23:58:31.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): my global_id is 5508 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ba413bb20 con 0x7f9ba41328a0 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2128391835 0 0) 0x7f9b84003530 con 0x7f9ba409b3e0 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ba413b840 con 0x7f9ba409b3e0 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b8c004b30 con 0x7f9ba409b3e0 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): dump: 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.973 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:31.974 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4121423339 0 0) 0x7f9ba413b840 con 0x7f9ba409b3e0 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 >> v1:172.21.15.106:6793/0 conn(0x7f9ba409b840 legacy=0x7f9ba41cfb80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 >> v1:172.21.15.106:6789/0 conn(0x7f9ba41328a0 legacy=0x7f9ba41d32b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 monclient: found mon.b 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ba4073100 con 0x7f9ba409b3e0 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:31.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 5 monclient: authenticate success, global_id 5447 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: _renew_subs 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9ba413c220 con 0x7f9ba409b3e0 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: _renew_subs 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9ba4139180 con 0x7f9ba409b3e0 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b8c001860 con 0x7f9ba409b3e0 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b8c005110 con 0x7f9ba409b3e0 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9ba17fa640 4 set_mon_vals no callback set 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.976+0000 7f9b9b7fe640 10 monclient: dump: 2024-04-25T23:58:31.976 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:31.977 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.980+0000 7f9ba9452640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.980+0000 7f9ba9452640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.980+0000 7f9ba9452640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.980+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b88005090 con 0x7f9ba409b3e0 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.980+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9b8c00feb0 con 0x7f9ba409b3e0 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.980+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(80..80 src has 1..80) ==== 5730+0+0 (unknown 1472831362 0 0) 0x7f9b8c044d50 con 0x7f9ba409b3e0 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.980+0000 7f9ba27fc640 10 monclient: get_auth_request con 0x7f9b84037690 auth_method 0 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.992+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9b8c015880 con 0x7f9ba409b3e0 2024-04-25T23:58:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.992+0000 7f9b9b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:31.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:31.992+0000 7f9b9b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.152+0000 7f9ba9452640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.152+0000 7f9ba9452640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.152+0000 7f9ba9452640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:32.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.152+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f9b88005b90 con 0x7f9ba409b3e0 2024-04-25T23:58:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.152+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v80) ==== 56+0+1500 (unknown 1137015514 0 2047691385) 0x7f9b8c015180 con 0x7f9ba409b3e0 2024-04-25T23:58:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.152+0000 7f9b9b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.152+0000 7f9b9b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.244+0000 7f9ba9452640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.244+0000 7f9ba9452640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.244+0000 7f9ba9452640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:32.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.244+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f9b88006700 con 0x7f9ba409b3e0 2024-04-25T23:58:32.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.244+0000 7f9b9b7fe640 1 -- 172.21.15.171:0/4167346469 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v80) ==== 56+0+1500 (unknown 1137015514 0 2047691385) 0x7f9b88006700 con 0x7f9ba409b3e0 2024-04-25T23:58:32.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.244+0000 7f9b9b7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.244+0000 7f9b9b7fe640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 >> v1:172.21.15.171:6812/722422047 conn(0x7f9b84037690 legacy=0x7f9b84039b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 10 monclient: shutdown 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 >> v1:172.21.15.106:6790/0 conn(0x7f9ba409b3e0 legacy=0x7f9ba41caba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 shutdown_connections 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 >> 172.21.15.171:0/4167346469 conn(0x7f9ba40a28a0 msgr2=0x7f9ba40a17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 shutdown_connections 2024-04-25T23:58:32.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.248+0000 7f9ba9452640 1 -- 172.21.15.171:0/4167346469 wait complete. 2024-04-25T23:58:32.262 INFO:tasks.workunit.client.0.smithi171.stdout:-11 0 host host-for-test 2024-04-25T23:58:32.262 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:32.262 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep rack-for-test 2024-04-25T23:58:32.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.388+0000 7ff653339640 10 monclient: get_monmap_and_config 2024-04-25T23:58:32.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.388+0000 7ff653339640 10 monclient: build_initial_monmap 2024-04-25T23:58:32.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.388+0000 7ff653339640 10 monclient: monmap: 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:32.394436+0000 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:32.394436+0000 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:32.375 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:32.376 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:32.376 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:32.376 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:32.376 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:32.376 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 Processor -- start 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 -- start start 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient: init 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient: _add_conns ranks=[2,8,0,5,7,4,1,6,3] 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient(hunting): picked mon.noname-b con 0x7ff64c1328a0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient(hunting): picked mon.noname-e con 0x7ff64c09b840 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient(hunting): picked mon.noname-a con 0x7ff64c09b3e0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c133390 con 0x7ff64c09b3e0 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c09cc80 con 0x7ff64c1328a0 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c09c2a0 con 0x7ff64c09b840 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:32.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient(hunting): authenticate will time out at 1163.101260s 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff6508d4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff64c09b840 legacy=0x7ff64c13aa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff6510d5640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7ff64c1328a0 0x7ff64c132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51520/0 (socket says 172.21.15.171:51520) 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff6518d6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff64c09b3e0 0x7ff64c13e1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:45220/0 (socket says 172.21.15.171:45220) 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff6510d5640 1 -- 172.21.15.171:0/3508431956 learned_addr learned my addr 172.21.15.171:0/3508431956 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857831420 0 0) 0x7ff64c133390 con 0x7ff64c09b3e0 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): my global_id is 5517 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff638003530 con 0x7ff64c09b3e0 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 879991791 0 0) 0x7ff64c09cc80 con 0x7ff64c1328a0 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:32.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient(hunting): my global_id is 5456 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff64c133390 con 0x7ff64c1328a0 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 255432782 0 0) 0x7ff638003530 con 0x7ff64c09b3e0 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 >> v1:172.21.15.106:6793/0 conn(0x7ff64c09b840 legacy=0x7ff64c13aa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 >> v1:172.21.15.106:6790/0 conn(0x7ff64c1328a0 legacy=0x7ff64c132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 monclient: found mon.noname-a 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c09f7b0 con 0x7ff64c09b3e0 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff648001b40 con 0x7ff64c09b3e0 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 5 monclient: authenticate success, global_id 5517 2024-04-25T23:58:32.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: dump: 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.386 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff648001e60 con 0x7ff64c09b3e0 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 1 -- 172.21.15.171:0/3508431956 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff648004eb0 con 0x7ff64c09b3e0 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 4 set_mon_vals no callback set 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff643fff640 10 monclient: dump: 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.387 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 10 monclient: shutdown 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 -- 172.21.15.171:0/3508431956 >> v1:172.21.15.106:6789/0 conn(0x7ff64c09b3e0 legacy=0x7ff64c13e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 -- 172.21.15.171:0/3508431956 shutdown_connections 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.392+0000 7ff653339640 1 -- 172.21.15.171:0/3508431956 >> 172.21.15.171:0/3508431956 conn(0x7ff64c0a28a0 msgr2=0x7ff64c0a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- 172.21.15.171:0/3508431956 shutdown_connections 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- 172.21.15.171:0/3508431956 wait complete. 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: build_initial_monmap 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: monmap: 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:32.389 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 Processor -- start 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- start start 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: init 2024-04-25T23:58:32.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: _add_conns ranks=[6,8,4,5,7,3,0,2,1] 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient(hunting): picked mon.noname-d con 0x7ff64c09b3e0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient(hunting): picked mon.noname-e con 0x7ff64c09b840 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient(hunting): picked mon.noname-c con 0x7ff64c1328a0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c072c20 con 0x7ff64c1328a0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c139780 con 0x7ff64c09b3e0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64c13b1d0 con 0x7ff64c09b840 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient(hunting): authenticate will time out at 1163.105577s 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff6508d4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff64c09b840 legacy=0x7ff64c13dfb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff6518d6640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff64c1328a0 legacy=0x7ff64c1d2370 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff6510d5640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff64c09b3e0 0x7ff64c1380c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:37534/0 (socket says 172.21.15.171:37534) 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff6510d5640 1 -- 172.21.15.171:0/431799040 learned_addr learned my addr 172.21.15.171:0/431799040 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511538990 0 0) 0x7ff64c139780 con 0x7ff64c09b3e0 2024-04-25T23:58:32.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): my global_id is 5514 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff630003530 con 0x7ff64c09b3e0 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 632874542 0 0) 0x7ff630003530 con 0x7ff64c09b3e0 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff64c139780 con 0x7ff64c09b3e0 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff644001aa0 con 0x7ff64c09b3e0 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.392 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2270510670 0 0) 0x7ff64c139780 con 0x7ff64c09b3e0 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 >> v1:172.21.15.106:6793/0 conn(0x7ff64c09b840 legacy=0x7ff64c13dfb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:32.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 >> v1:172.21.15.106:6791/0 conn(0x7ff64c1328a0 legacy=0x7ff64c1d2370 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 monclient: found mon.d 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff64c13e6c0 con 0x7ff64c09b3e0 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 5 monclient: authenticate success, global_id 5514 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: _renew_subs 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff64c13a2e0 con 0x7ff64c09b3e0 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: _renew_subs 2024-04-25T23:58:32.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff64c1d3a90 con 0x7ff64c09b3e0 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff644001cc0 con 0x7ff64c09b3e0 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff6437fe640 4 set_mon_vals no callback set 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff644004ef0 con 0x7ff64c09b3e0 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.396+0000 7ff641ffb640 10 monclient: dump: 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.400+0000 7ff653339640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.400+0000 7ff653339640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.400+0000 7ff653339640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.400+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff62c005090 con 0x7ff64c09b3e0 2024-04-25T23:58:32.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.400+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff644005110 con 0x7ff64c09b3e0 2024-04-25T23:58:32.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.400+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(80..80 src has 1..80) ==== 5730+0+0 (unknown 1472831362 0 0) 0x7ff644044e00 con 0x7ff64c09b3e0 2024-04-25T23:58:32.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.400+0000 7ff6508d4640 10 monclient: get_auth_request con 0x7ff630037790 auth_method 0 2024-04-25T23:58:32.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.412+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff644015870 con 0x7ff64c09b3e0 2024-04-25T23:58:32.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.412+0000 7ff641ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:32.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.412+0000 7ff641ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.560+0000 7ff653339640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.560+0000 7ff653339640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.560+0000 7ff653339640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:32.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.560+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7ff62c005b90 con 0x7ff64c09b3e0 2024-04-25T23:58:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.560+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v80) ==== 56+0+1500 (unknown 1137015514 0 2047691385) 0x7ff644015170 con 0x7ff64c09b3e0 2024-04-25T23:58:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.564+0000 7ff641ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.564+0000 7ff641ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:32.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:32.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:32.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7ff62c006700 con 0x7ff64c09b3e0 2024-04-25T23:58:32.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff641ffb640 1 -- 172.21.15.171:0/431799040 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v80) ==== 56+0+1500 (unknown 1137015514 0 2047691385) 0x7ff62c006700 con 0x7ff64c09b3e0 2024-04-25T23:58:32.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff641ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff641ffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 >> v1:172.21.15.171:6812/722422047 conn(0x7ff630037790 legacy=0x7ff630039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 10 monclient: shutdown 2024-04-25T23:58:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 >> v1:172.21.15.106:6792/0 conn(0x7ff64c09b3e0 legacy=0x7ff64c1380c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 shutdown_connections 2024-04-25T23:58:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 >> 172.21.15.171:0/431799040 conn(0x7ff64c0a28a0 msgr2=0x7ff64c133900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 shutdown_connections 2024-04-25T23:58:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.660+0000 7ff653339640 1 -- 172.21.15.171:0/431799040 wait complete. 2024-04-25T23:58:32.661 INFO:tasks.workunit.client.0.smithi171.stdout:-12 0 rack rack-for-test 2024-04-25T23:58:32.661 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:32.662 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep root-for-test 2024-04-25T23:58:32.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient: get_monmap_and_config 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient: build_initial_monmap 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient: monmap: 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:32.796564+0000 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:32.796564+0000 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:32.777 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:32.778 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:32.778 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:32.778 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:32.778 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:32.778 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 1 Processor -- start 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 1 -- start start 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient: init 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient: _add_conns ranks=[0,4,1,7,5,6,8,3,2] 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient(hunting): picked mon.noname-a con 0x7f13e4072780 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient(hunting): picked mon.noname-c con 0x7f13e4137f70 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient(hunting): picked mon.noname-f con 0x7f13e413e4d0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40a4630 con 0x7f13e4072780 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e4138370 con 0x7f13e413e4d0 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e40a4340 con 0x7f13e4137f70 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:32.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e940b640 10 monclient(hunting): authenticate will time out at 1163.503514s 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e37fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f13e413e4d0 legacy=0x7f13e41408c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e27fc640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f13e4137f70 legacy=0x7f13e413cdb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e2ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f13e4072780 0x7f13e4072b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:45226/0 (socket says 172.21.15.171:45226) 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.792+0000 7f13e2ffd640 1 -- 172.21.15.171:0/3733965481 learned_addr learned my addr 172.21.15.171:0/3733965481 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4229410707 0 0) 0x7f13e40a4630 con 0x7f13e4072780 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient(hunting): my global_id is 5526 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13cc003530 con 0x7f13e4072780 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1519606776 0 0) 0x7f13cc003530 con 0x7f13e4072780 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 >> v1:172.21.15.106:6791/0 conn(0x7f13e4137f70 legacy=0x7f13e413cdb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:32.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 >> v1:172.21.15.171:6789/0 conn(0x7f13e413e4d0 legacy=0x7f13e41408c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 monclient: found mon.noname-a 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e4070a60 con 0x7f13e4072780 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13dc001b40 con 0x7f13e4072780 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: dump: 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.787 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 5 monclient: authenticate success, global_id 5526 2024-04-25T23:58:32.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13dc001da0 con 0x7f13e4072780 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 1 -- 172.21.15.171:0/3733965481 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13dc004f70 con 0x7f13e4072780 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e1ffb640 10 monclient: dump: 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.789 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 4 set_mon_vals no callback set 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient: shutdown 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- 172.21.15.171:0/3733965481 >> v1:172.21.15.106:6789/0 conn(0x7f13e4072780 legacy=0x7f13e4072b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- 172.21.15.171:0/3733965481 shutdown_connections 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- 172.21.15.171:0/3733965481 >> 172.21.15.171:0/3733965481 conn(0x7f13e40a4b90 msgr2=0x7f13e40a4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- 172.21.15.171:0/3733965481 shutdown_connections 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- 172.21.15.171:0/3733965481 wait complete. 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient: build_initial_monmap 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient: monmap: 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:32.791 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 Processor -- start 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- start start 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient: init 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient: _add_conns ranks=[3,7,5,1,2,6,4,8,0] 2024-04-25T23:58:32.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient(hunting): picked mon.noname-g con 0x7f13e4072780 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient(hunting): picked mon.noname-i con 0x7f13e4137f70 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient(hunting): picked mon.noname-h con 0x7f13e413e4d0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e41cd470 con 0x7f13e4072780 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e413d870 con 0x7f13e413e4d0 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13e4136310 con 0x7f13e4137f70 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e940b640 10 monclient(hunting): authenticate will time out at 1163.507113s 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e27fc640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f13e4137f70 legacy=0x7f13e41ccd60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e2ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f13e4072780 0x7f13e41cc650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60142/0 (socket says 172.21.15.171:60142) 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13e2ffd640 1 -- 172.21.15.171:0/2200051217 learned_addr learned my addr 172.21.15.171:0/2200051217 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2674934470 0 0) 0x7f13e41cd470 con 0x7f13e4072780 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:32.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): my global_id is 5664 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13d0003530 con 0x7f13e4072780 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174877412 0 0) 0x7f13e413d870 con 0x7f13e413e4d0 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): my global_id is 5441 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13e41cd470 con 0x7f13e413e4d0 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 968598140 0 0) 0x7f13e41cd470 con 0x7f13e413e4d0 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e413d870 con 0x7f13e413e4d0 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4246038036 0 0) 0x7f13d0003530 con 0x7f13e4072780 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13e41cd470 con 0x7f13e4072780 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13d40040e0 con 0x7f13e413e4d0 2024-04-25T23:58:32.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): dump: 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.795 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13dc001a40 con 0x7f13e4072780 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 10 monclient(hunting): dump: 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.796 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3241518516 0 0) 0x7f13e413d870 con 0x7f13e413e4d0 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.796+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 >> v1:172.21.15.171:6792/0 conn(0x7f13e4137f70 legacy=0x7f13e41ccd60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:32.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 >> v1:172.21.15.171:6790/0 conn(0x7f13e4072780 legacy=0x7f13e41cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 1 monclient: found mon.h 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13e406ea70 con 0x7f13e413e4d0 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 5 monclient: authenticate success, global_id 5441 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 10 monclient: _renew_subs 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13e41374e0 con 0x7f13e413e4d0 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 10 monclient: _renew_subs 2024-04-25T23:58:32.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f13e4136060 con 0x7f13e413e4d0 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13d4004310 con 0x7f13e413e4d0 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13d4004800 con 0x7f13e413e4d0 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e17fa640 4 set_mon_vals no callback set 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 10 monclient: dump: 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:32.799 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f13d40049a0 con 0x7f13e413e4d0 2024-04-25T23:58:32.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13c4005090 con 0x7f13e413e4d0 2024-04-25T23:58:32.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(80..80 src has 1..80) ==== 5730+0+0 (unknown 1472831362 0 0) 0x7f13d4044aa0 con 0x7f13e413e4d0 2024-04-25T23:58:32.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.800+0000 7f13e2ffd640 10 monclient: get_auth_request con 0x7f13d0037c90 auth_method 0 2024-04-25T23:58:32.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.804+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f13d40154b0 con 0x7f13e413e4d0 2024-04-25T23:58:32.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.804+0000 7f13cb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:32.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.804+0000 7f13cb7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.964+0000 7f13e940b640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.964+0000 7f13e940b640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.964+0000 7f13e940b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.964+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f13c4005b90 con 0x7f13e413e4d0 2024-04-25T23:58:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.964+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v80) ==== 56+0+1500 (unknown 1137015514 0 2047691385) 0x7f13d4014db0 con 0x7f13e413e4d0 2024-04-25T23:58:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.964+0000 7f13cb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:32.964+0000 7f13cb7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:33.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.060+0000 7f13e940b640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:33.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.060+0000 7f13e940b640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:33.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.060+0000 7f13e940b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.060+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f13c4005d60 con 0x7f13e413e4d0 2024-04-25T23:58:33.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.060+0000 7f13cb7fe640 1 -- 172.21.15.171:0/2200051217 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v80) ==== 56+0+1500 (unknown 1137015514 0 2047691385) 0x7f13d4019100 con 0x7f13e413e4d0 2024-04-25T23:58:33.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.060+0000 7f13cb7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:33.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.060+0000 7f13cb7fe640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:33.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 >> v1:172.21.15.171:6812/722422047 conn(0x7f13d0037c90 legacy=0x7f13d003a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 10 monclient: shutdown 2024-04-25T23:58:33.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:33.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 >> v1:172.21.15.171:6791/0 conn(0x7f13e413e4d0 legacy=0x7f13e41d48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 shutdown_connections 2024-04-25T23:58:33.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 >> 172.21.15.171:0/2200051217 conn(0x7f13e40a4b90 msgr2=0x7f13e40a6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:33.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 shutdown_connections 2024-04-25T23:58:33.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.064+0000 7f13e940b640 1 -- 172.21.15.171:0/2200051217 wait complete. 2024-04-25T23:58:33.062 INFO:tasks.workunit.client.0.smithi171.stdout:-14 0 root root-for-test 2024-04-25T23:58:33.063 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm host-for-test 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.196+0000 7fc6fff78640 10 monclient: get_monmap_and_config 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.196+0000 7fc6fff78640 10 monclient: build_initial_monmap 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.196+0000 7fc6fff78640 10 monclient: monmap: 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:33.200877+0000 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:33.200877+0000 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:33.181 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:33.182 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:33.182 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:33.182 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:33.182 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:33.182 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:33.182 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:33.182 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.196+0000 7fc6fff78640 1 Processor -- start 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.196+0000 7fc6fff78640 1 -- start start 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.196+0000 7fc6fff78640 10 monclient: init 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: _add_conns ranks=[1,5,8,3,6,4,0,7,2] 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): picked mon.noname-f con 0x7fc6f8135bb0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): picked mon.noname-h con 0x7fc6f81356f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): picked mon.noname-e con 0x7fc6f813c130 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f80a1da0 con 0x7fc6f8135bb0 2024-04-25T23:58:33.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f80a1fe0 con 0x7fc6f81356f0 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f8072720 con 0x7fc6f813c130 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): authenticate will time out at 1163.908359s 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fdd14640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fc6f8135bb0 legacy=0x7fc6f8135f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fd513640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc6f81356f0 0x7fc6f813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:55140/0 (socket says 172.21.15.171:55140) 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fd513640 1 -- 172.21.15.171:0/3964681230 learned_addr learned my addr 172.21.15.171:0/3964681230 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fe515640 1 -- 172.21.15.171:0/3964681230 >> v1:172.21.15.106:6793/0 conn(0x7fc6f813c130 legacy=0x7fc6f813e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2142918797 0 0) 0x7fc6f80a1fe0 con 0x7fc6f81356f0 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient(hunting): _negotiate 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient(hunting): my global_id is 5450 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6e4003530 con 0x7fc6f81356f0 2024-04-25T23:58:33.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1342662987 0 0) 0x7fc6e4003530 con 0x7fc6f81356f0 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 >> v1:172.21.15.106:6793/0 conn(0x7fc6f813c130 legacy=0x7fc6f813e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 >> v1:172.21.15.171:6789/0 conn(0x7fc6f8135bb0 legacy=0x7fc6f8135f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: _finish_hunting 0 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 monclient: found mon.noname-h 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f80a17f0 con 0x7fc6f81356f0 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: _finish_auth 0 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: _check_auth_tickets 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc6e80017c0 con 0x7fc6f81356f0 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:33.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: dump: 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.191 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 5 monclient: authenticate success, global_id 5450 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6e8001b20 con 0x7fc6f81356f0 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 1 -- 172.21.15.171:0/3964681230 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc6e8001d50 con 0x7fc6f81356f0 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 4 set_mon_vals no callback set 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fcd12640 10 monclient: dump: 2024-04-25T23:58:33.192 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.193 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: shutdown 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- 172.21.15.171:0/3964681230 >> v1:172.21.15.171:6791/0 conn(0x7fc6f81356f0 legacy=0x7fc6f813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- 172.21.15.171:0/3964681230 shutdown_connections 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- 172.21.15.171:0/3964681230 >> 172.21.15.171:0/3964681230 conn(0x7fc6f80a2620 msgr2=0x7fc6f80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- 172.21.15.171:0/3964681230 shutdown_connections 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- 172.21.15.171:0/3964681230 wait complete. 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: build_initial_monmap 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: monmap: 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:33.194 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 Processor -- start 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- start start 2024-04-25T23:58:33.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: init 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient: _add_conns ranks=[5,1,2,6,7,4,3,8,0] 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): picked mon.noname-h con 0x7fc6f81356f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): picked mon.noname-f con 0x7fc6f8135bb0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): picked mon.noname-b con 0x7fc6f813c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f80719a0 con 0x7fc6f8135bb0 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f812dc80 con 0x7fc6f813c130 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc6f812df60 con 0x7fc6f81356f0 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fff78640 10 monclient(hunting): authenticate will time out at 1163.911343s 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fd513640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fc6f8135bb0 legacy=0x7fc6f8070220 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fdd14640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc6f81356f0 0x7fc6f806fb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:55156/0 (socket says 172.21.15.171:55156) 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6fdd14640 1 -- 172.21.15.171:0/4140208177 learned_addr learned my addr 172.21.15.171:0/4140208177 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:33.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3432274786 0 0) 0x7fc6f812df60 con 0x7fc6f81356f0 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): my global_id is 5459 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc6dc003530 con 0x7fc6f81356f0 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3290972723 0 0) 0x7fc6dc003530 con 0x7fc6f81356f0 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc6f812df60 con 0x7fc6f81356f0 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc6f4004300 con 0x7fc6f81356f0 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): dump: 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.197 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.200+0000 7fc6ee7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1348737673 0 0) 0x7fc6f812df60 con 0x7fc6f81356f0 2024-04-25T23:58:33.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 >> v1:172.21.15.106:6790/0 conn(0x7fc6f813c130 legacy=0x7fc6f81d42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 >> v1:172.21.15.171:6789/0 conn(0x7fc6f8135bb0 legacy=0x7fc6f8070220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 monclient: found mon.h 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6f8071110 con 0x7fc6f81356f0 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 5 monclient: authenticate success, global_id 5459 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 10 monclient: _renew_subs 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc6f813b650 con 0x7fc6f81356f0 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 10 monclient: _renew_subs 2024-04-25T23:58:33.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc6f8071620 con 0x7fc6f81356f0 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc6f4004630 con 0x7fc6f81356f0 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc6f4004ba0 con 0x7fc6f81356f0 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6effff640 4 set_mon_vals no callback set 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 10 monclient: dump: 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.200 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc6f4004e00 con 0x7fc6f81356f0 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6e0005090 con 0x7fc6f81356f0 2024-04-25T23:58:33.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(80..80 src has 1..80) ==== 5730+0+0 (unknown 1472831362 0 0) 0x7fc6f4044f10 con 0x7fc6f81356f0 2024-04-25T23:58:33.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.204+0000 7fc6fd513640 10 monclient: get_auth_request con 0x7fc6dc0377a0 auth_method 0 2024-04-25T23:58:33.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.208+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc6f4015980 con 0x7fc6f81356f0 2024-04-25T23:58:33.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.208+0000 7fc6ee7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:33.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.208+0000 7fc6ee7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:33.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.360+0000 7fc6fff78640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "host-for-test"}] 2024-04-25T23:58:33.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.360+0000 7fc6fff78640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "host-for-test"}] 2024-04-25T23:58:33.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.360+0000 7fc6fff78640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.360+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "host-for-test"} v 0) -- 0x7fc6e0005380 con 0x7fc6f81356f0 2024-04-25T23:58:33.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.744+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "host-for-test"}]=0 removed item id -11 name 'host-for-test' from crush map v81) ==== 140+0+0 (unknown 919050709 0 0) 0x7fc6f4015280 con 0x7fc6f81356f0 2024-04-25T23:58:33.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.744+0000 7fc6ee7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "host-for-test"}] 2024-04-25T23:58:33.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.744+0000 7fc6ee7fc640 10 monclient: _finish_command 2 = system:0 removed item id -11 name 'host-for-test' from crush map 2024-04-25T23:58:33.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.844+0000 7fc6fff78640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "host-for-test"}] 2024-04-25T23:58:33.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.844+0000 7fc6fff78640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "host-for-test"}] 2024-04-25T23:58:33.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.844+0000 7fc6fff78640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.844+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "host-for-test"} v 0) -- 0x7fc6e0002220 con 0x7fc6f81356f0 2024-04-25T23:58:33.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.844+0000 7fc6ee7fc640 1 -- 172.21.15.171:0/4140208177 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "host-for-test"}]=0 device 'host-for-test' does not appear in the crush map v81) ==== 140+0+0 (unknown 3651242899 0 0) 0x7fc6f401de30 con 0x7fc6f81356f0 2024-04-25T23:58:33.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.844+0000 7fc6ee7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "host-for-test"}] 2024-04-25T23:58:33.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.844+0000 7fc6ee7fc640 10 monclient: _finish_command 3 = system:0 device 'host-for-test' does not appear in the crush map 2024-04-25T23:58:33.830 INFO:tasks.workunit.client.0.smithi171.stderr:device 'host-for-test' does not appear in the crush map 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 >> v1:172.21.15.171:6812/722422047 conn(0x7fc6dc0377a0 legacy=0x7fc6dc039c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 10 monclient: shutdown 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 >> v1:172.21.15.171:6791/0 conn(0x7fc6f81356f0 legacy=0x7fc6f806fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 shutdown_connections 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 >> 172.21.15.171:0/4140208177 conn(0x7fc6f80a2620 msgr2=0x7fc6f813e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 shutdown_connections 2024-04-25T23:58:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.848+0000 7fc6fff78640 1 -- 172.21.15.171:0/4140208177 wait complete. 2024-04-25T23:58:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm rack-for-test 2024-04-25T23:58:33.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: get_monmap_and_config 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: build_initial_monmap 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: monmap: 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:33.979554+0000 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:33.979554+0000 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:33.960 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:33.961 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:33.961 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:33.961 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:33.961 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:33.961 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:33.961 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:33.961 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 Processor -- start 2024-04-25T23:58:33.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- start start 2024-04-25T23:58:33.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: init 2024-04-25T23:58:33.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:33.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: _add_conns ranks=[2,5,8,4,0,7,1,6,3] 2024-04-25T23:58:33.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient(hunting): picked mon.noname-b con 0x7fb5fc0a1750 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:33.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient(hunting): picked mon.noname-h con 0x7fb5fc0a1b30 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient(hunting): picked mon.noname-e con 0x7fb5fc0a1f10 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc072870 con 0x7fb5fc0a1750 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc072b50 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc0a5300 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient(hunting): authenticate will time out at 1164.686461s 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fbfff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb5fc0a1b30 0x7fb5fc13a970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:55170/0 (socket says 172.21.15.171:55170) 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fbfff640 1 -- 172.21.15.171:0/3011522464 learned_addr learned my addr 172.21.15.171:0/3011522464 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb60132c640 1 -- 172.21.15.171:0/3011522464 >> v1:172.21.15.106:6793/0 conn(0x7fb5fc0a1f10 legacy=0x7fb5fc13e0a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923688951 0 0) 0x7fb5fc072b50 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:33.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient(hunting): my global_id is 5468 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e4003530 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2380204577 0 0) 0x7fb5e4003530 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 >> v1:172.21.15.106:6793/0 conn(0x7fb5fc0a1f10 legacy=0x7fb5fc13e0a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 >> v1:172.21.15.106:6790/0 conn(0x7fb5fc0a1750 legacy=0x7fb5fc135bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 monclient: found mon.noname-h 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc1427f0 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb5ec0017c0 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: dump: 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.972 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 5 monclient: authenticate success, global_id 5468 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5ec001b20 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 4 set_mon_vals no callback set 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 1 -- 172.21.15.171:0/3011522464 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb5ec004bf0 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb5fb7fe640 10 monclient: dump: 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.974 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 10 monclient: shutdown 2024-04-25T23:58:33.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- 172.21.15.171:0/3011522464 >> v1:172.21.15.171:6791/0 conn(0x7fb5fc0a1b30 legacy=0x7fb5fc13a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- 172.21.15.171:0/3011522464 shutdown_connections 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- 172.21.15.171:0/3011522464 >> 172.21.15.171:0/3011522464 conn(0x7fb5fc0a85a0 msgr2=0x7fb5fc0a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- 172.21.15.171:0/3011522464 shutdown_connections 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.976+0000 7fb602d8f640 1 -- 172.21.15.171:0/3011522464 wait complete. 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: build_initial_monmap 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: monmap: 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:33.976 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 1 Processor -- start 2024-04-25T23:58:33.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 1 -- start start 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: init 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: _add_conns ranks=[4,8,0,7,3,2,6,1,5] 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient(hunting): picked mon.noname-c con 0x7fb5fc0a1750 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient(hunting): picked mon.noname-e con 0x7fb5fc0a1b30 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient(hunting): picked mon.noname-a con 0x7fb5fc0a1f10 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc06ee30 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc13c510 con 0x7fb5fc0a1750 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5fc13c7f0 con 0x7fb5fc0a1b30 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient(hunting): authenticate will time out at 1164.689393s 2024-04-25T23:58:33.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5fbfff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb5fc0a1b30 legacy=0x7fb5fc06db60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb600b2b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fb5fc0a1750 legacy=0x7fb5fc06d450 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb60132c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb5fc0a1f10 0x7fb5fc1d4770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:45238/0 (socket says 172.21.15.171:45238) 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb60132c640 1 -- 172.21.15.171:0/803632448 learned_addr learned my addr 172.21.15.171:0/803632448 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2823939659 0 0) 0x7fb5fc06ee30 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): my global_id is 5535 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5e8003530 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 740910841 0 0) 0x7fb5e8003530 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5fc06ee30 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb5f40045f0 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): dump: 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.980 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2412807885 0 0) 0x7fb5fc06ee30 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 >> v1:172.21.15.106:6793/0 conn(0x7fb5fc0a1b30 legacy=0x7fb5fc06db60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 >> v1:172.21.15.106:6791/0 conn(0x7fb5fc0a1750 legacy=0x7fb5fc06d450 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 monclient: found mon.a 2024-04-25T23:58:33.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5fc13c150 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 5 monclient: authenticate success, global_id 5535 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: _renew_subs 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb5fc13b620 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: _renew_subs 2024-04-25T23:58:33.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb5fc06e440 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb5f4004950 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5faffd640 4 set_mon_vals no callback set 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb5f4004ec0 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.980+0000 7fb5f97fa640 10 monclient: dump: 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:33.983 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.984+0000 7fb602d8f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:33.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.984+0000 7fb602d8f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.984+0000 7fb602d8f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.984+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5dc005090 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.984+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb5f40050e0 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.984+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(81..81 src has 1..81) ==== 5547+0+0 (unknown 2587187054 0 0) 0x7fb5f4044fc0 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.984+0000 7fb600b2b640 10 monclient: get_auth_request con 0x7fb5e80377e0 auth_method 0 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.996+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb5f4015b50 con 0x7fb5fc0a1f10 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.996+0000 7fb5f97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:33.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:33.996+0000 7fb5f97fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:34.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.152+0000 7fb602d8f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "rack-for-test"}] 2024-04-25T23:58:34.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.152+0000 7fb602d8f640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "rack-for-test"}] 2024-04-25T23:58:34.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.152+0000 7fb602d8f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:34.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.152+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "rack-for-test"} v 0) -- 0x7fb5dc005380 con 0x7fb5fc0a1f10 2024-04-25T23:58:34.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.744+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "rack-for-test"}]=0 removed item id -12 name 'rack-for-test' from crush map v82) ==== 140+0+0 (unknown 3738549591 0 0) 0x7fb5f4015450 con 0x7fb5fc0a1f10 2024-04-25T23:58:34.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.744+0000 7fb5f97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "rack-for-test"}] 2024-04-25T23:58:34.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.744+0000 7fb5f97fa640 10 monclient: _finish_command 2 = system:0 removed item id -12 name 'rack-for-test' from crush map 2024-04-25T23:58:34.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "rack-for-test"}] 2024-04-25T23:58:34.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "rack-for-test"}] 2024-04-25T23:58:34.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:34.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "rack-for-test"} v 0) -- 0x7fb5dc0010a0 con 0x7fb5fc0a1f10 2024-04-25T23:58:34.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb5f97fa640 1 -- 172.21.15.171:0/803632448 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "rack-for-test"}]=0 device 'rack-for-test' does not appear in the crush map v82) ==== 140+0+0 (unknown 3468572947 0 0) 0x7fb5f401e000 con 0x7fb5fc0a1f10 2024-04-25T23:58:34.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb5f97fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "rack-for-test"}] 2024-04-25T23:58:34.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb5f97fa640 10 monclient: _finish_command 3 = system:0 device 'rack-for-test' does not appear in the crush map 2024-04-25T23:58:34.836 INFO:tasks.workunit.client.0.smithi171.stderr:device 'rack-for-test' does not appear in the crush map 2024-04-25T23:58:34.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 >> v1:172.21.15.171:6812/722422047 conn(0x7fb5e80377e0 legacy=0x7fb5e8039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:34.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 10 monclient: shutdown 2024-04-25T23:58:34.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:34.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 >> v1:172.21.15.106:6789/0 conn(0x7fb5fc0a1f10 legacy=0x7fb5fc1d4770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:34.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 shutdown_connections 2024-04-25T23:58:34.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 >> 172.21.15.171:0/803632448 conn(0x7fb5fc0a85a0 msgr2=0x7fb5fc09fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:34.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 shutdown_connections 2024-04-25T23:58:34.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.852+0000 7fb602d8f640 1 -- 172.21.15.171:0/803632448 wait complete. 2024-04-25T23:58:34.853 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm root-for-test 2024-04-25T23:58:34.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.984+0000 7fc895199640 10 monclient: get_monmap_and_config 2024-04-25T23:58:34.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.984+0000 7fc895199640 10 monclient: build_initial_monmap 2024-04-25T23:58:34.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.984+0000 7fc895199640 10 monclient: monmap: 2024-04-25T23:58:34.969 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:34.969 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:34.989294+0000 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:34.989294+0000 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:34.970 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 Processor -- start 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- start start 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient: init 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient: _add_conns ranks=[4,6,7,2,5,0,3,8,1] 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient(hunting): picked mon.noname-c con 0x7fc890135bb0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient(hunting): picked mon.noname-d con 0x7fc8901356f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient(hunting): picked mon.noname-i con 0x7fc89013c130 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:34.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8900a1da0 con 0x7fc890135bb0 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8900a1fe0 con 0x7fc8901356f0 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc890072720 con 0x7fc89013c130 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient(hunting): authenticate will time out at 1165.697048s 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88f59e640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fc89013c130 legacy=0x7fc89013e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88ed9d640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fc890135bb0 legacy=0x7fc890135f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88e59c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc8901356f0 0x7fc89013aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:37548/0 (socket says 172.21.15.171:37548) 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88e59c640 1 -- 172.21.15.171:0/3272768775 learned_addr learned my addr 172.21.15.171:0/3272768775 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2849253297 0 0) 0x7fc8900a1fe0 con 0x7fc8901356f0 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient(hunting): _negotiate 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient(hunting): my global_id is 5523 2024-04-25T23:58:34.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc878003530 con 0x7fc8901356f0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 446121473 0 0) 0x7fc878003530 con 0x7fc8901356f0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 >> v1:172.21.15.171:6792/0 conn(0x7fc89013c130 legacy=0x7fc89013e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 >> v1:172.21.15.106:6791/0 conn(0x7fc890135bb0 legacy=0x7fc890135f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: _finish_hunting 0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 monclient: found mon.noname-d 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8900a17f0 con 0x7fc8901356f0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: _finish_auth 0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: _check_auth_tickets 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 5 monclient: authenticate success, global_id 5523 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc8840017c0 con 0x7fc8901356f0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:34.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: dump: 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:34.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc884001b20 con 0x7fc8901356f0 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 1 -- 172.21.15.171:0/3272768775 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc884001d50 con 0x7fc8901356f0 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 4 set_mon_vals no callback set 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc88dd9b640 10 monclient: dump: 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:34.978 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient: shutdown 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:34.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- 172.21.15.171:0/3272768775 >> v1:172.21.15.106:6792/0 conn(0x7fc8901356f0 legacy=0x7fc89013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- 172.21.15.171:0/3272768775 shutdown_connections 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- 172.21.15.171:0/3272768775 >> 172.21.15.171:0/3272768775 conn(0x7fc8900a2620 msgr2=0x7fc8900a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- 172.21.15.171:0/3272768775 shutdown_connections 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 1 -- 172.21.15.171:0/3272768775 wait complete. 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient: build_initial_monmap 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.988+0000 7fc895199640 10 monclient: monmap: 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:34.980 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:34.981 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:34.981 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 Processor -- start 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 -- start start 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: init 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _add_conns ranks=[6,0,2,8,4,5,3,7,1] 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient(hunting): picked mon.noname-d con 0x7fc8901356f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient(hunting): picked mon.noname-a con 0x7fc890135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient(hunting): picked mon.noname-b con 0x7fc89013c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:34.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8900719a0 con 0x7fc890135bb0 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc89013ab90 con 0x7fc89013c130 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8901cabc0 con 0x7fc8901356f0 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient(hunting): authenticate will time out at 1165.700880s 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc88ed9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc8901356f0 0x7fc8901c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:37560/0 (socket says 172.21.15.171:37560) 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc88ed9d640 1 -- 172.21.15.171:0/3085726212 learned_addr learned my addr 172.21.15.171:0/3085726212 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476442974 0 0) 0x7fc89013ab90 con 0x7fc89013c130 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): my global_id is 5483 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc87c003530 con 0x7fc89013c130 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627722893 0 0) 0x7fc8900a17f0 con 0x7fc890135bb0 2024-04-25T23:58:34.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): my global_id is 5544 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc89013ab90 con 0x7fc890135bb0 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 732382374 0 0) 0x7fc8901cabc0 con 0x7fc8901356f0 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): my global_id is 5532 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8900a17f0 con 0x7fc8901356f0 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 81309174 0 0) 0x7fc89013ab90 con 0x7fc890135bb0 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8901cabc0 con 0x7fc890135bb0 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc884001780 con 0x7fc890135bb0 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:34.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): dump: 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:34.988 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1856569055 0 0) 0x7fc87c003530 con 0x7fc89013c130 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc89013ab90 con 0x7fc89013c130 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3217055339 0 0) 0x7fc8900a17f0 con 0x7fc8901356f0 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc87c003530 con 0x7fc8901356f0 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc888004460 con 0x7fc89013c130 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): dump: 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:34.989 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc880004300 con 0x7fc8901356f0 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient(hunting): dump: 2024-04-25T23:58:34.990 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:34.991 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2823314575 0 0) 0x7fc8901cabc0 con 0x7fc890135bb0 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 >> v1:172.21.15.106:6792/0 conn(0x7fc8901356f0 legacy=0x7fc8901c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 >> v1:172.21.15.106:6790/0 conn(0x7fc89013c130 legacy=0x7fc8901d2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 monclient: found mon.a 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc890136fe0 con 0x7fc890135bb0 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 5 monclient: authenticate success, global_id 5544 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _renew_subs 2024-04-25T23:58:34.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc89013a8b0 con 0x7fc890135bb0 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _renew_subs 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc89013b5f0 con 0x7fc890135bb0 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc884001b20 con 0x7fc890135bb0 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc884001cd0 con 0x7fc890135bb0 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc88d59a640 4 set_mon_vals no callback set 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc8777fe640 10 monclient: dump: 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:34.993 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:34.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:34.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.992+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc870005090 con 0x7fc890135bb0 2024-04-25T23:58:34.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.996+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc88400ff50 con 0x7fc890135bb0 2024-04-25T23:58:34.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.996+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(82..82 src has 1..82) ==== 5364+0+0 (unknown 3435108830 0 0) 0x7fc884044bc0 con 0x7fc890135bb0 2024-04-25T23:58:34.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:34.996+0000 7fc88ed9d640 10 monclient: get_auth_request con 0x7fc87c038190 auth_method 0 2024-04-25T23:58:34.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.008+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc8900719a0 con 0x7fc890135bb0 2024-04-25T23:58:34.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.008+0000 7fc8777fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:34.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.008+0000 7fc8777fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:35.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.172+0000 7fc895199640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "root-for-test"}] 2024-04-25T23:58:35.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.172+0000 7fc895199640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "root-for-test"}] 2024-04-25T23:58:35.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.172+0000 7fc895199640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:35.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.172+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "root-for-test"} v 0) -- 0x7fc870005380 con 0x7fc890135bb0 2024-04-25T23:58:35.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.764+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "root-for-test"}]=0 removed item id -14 name 'root-for-test' from crush map v83) ==== 140+0+0 (unknown 2536517480 0 0) 0x7fc8840158c0 con 0x7fc890135bb0 2024-04-25T23:58:35.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.764+0000 7fc8777fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "root-for-test"}] 2024-04-25T23:58:35.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.764+0000 7fc8777fe640 10 monclient: _finish_command 2 = system:0 removed item id -14 name 'root-for-test' from crush map 2024-04-25T23:58:35.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.868+0000 7fc895199640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "root-for-test"}] 2024-04-25T23:58:35.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.868+0000 7fc895199640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "root-for-test"}] 2024-04-25T23:58:35.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.868+0000 7fc895199640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:35.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.868+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "root-for-test"} v 0) -- 0x7fc8700010a0 con 0x7fc890135bb0 2024-04-25T23:58:35.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc8777fe640 1 -- 172.21.15.171:0/3085726212 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "root-for-test"}]=0 device 'root-for-test' does not appear in the crush map v83) ==== 140+0+0 (unknown 2980275402 0 0) 0x7fc8840151c0 con 0x7fc890135bb0 2024-04-25T23:58:35.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc8777fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "root-for-test"}] 2024-04-25T23:58:35.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc8777fe640 10 monclient: _finish_command 3 = system:0 device 'root-for-test' does not appear in the crush map 2024-04-25T23:58:35.854 INFO:tasks.workunit.client.0.smithi171.stderr:device 'root-for-test' does not appear in the crush map 2024-04-25T23:58:35.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 >> v1:172.21.15.171:6812/722422047 conn(0x7fc87c038190 legacy=0x7fc87c03a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:35.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 10 monclient: shutdown 2024-04-25T23:58:35.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:35.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 >> v1:172.21.15.106:6789/0 conn(0x7fc890135bb0 legacy=0x7fc8901ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:35.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 shutdown_connections 2024-04-25T23:58:35.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 >> 172.21.15.171:0/3085726212 conn(0x7fc8900a2620 msgr2=0x7fc89013e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:35.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 shutdown_connections 2024-04-25T23:58:35.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:35.872+0000 7fc895199640 1 -- 172.21.15.171:0/3085726212 wait complete. 2024-04-25T23:58:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule create-simple foo-rule foo host firstn 2024-04-25T23:58:35.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.008+0000 7f8358868640 10 monclient: get_monmap_and_config 2024-04-25T23:58:35.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.008+0000 7f8358868640 10 monclient: build_initial_monmap 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.008+0000 7f8358868640 10 monclient: monmap: 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:36.013492+0000 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:36.013492+0000 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:35.994 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:35.995 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:35.995 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:35.995 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:35.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 Processor -- start 2024-04-25T23:58:35.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- start start 2024-04-25T23:58:35.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: init 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: _add_conns ranks=[7,0,3,2,4,5,8,1,6] 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): picked mon.noname-i con 0x7f8354132790 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): picked mon.noname-a con 0x7f83540717a0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): picked mon.noname-g con 0x7f835413c000 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f835406ea40 con 0x7f83540717a0 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8354072340 con 0x7f835413c000 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8354072620 con 0x7f8354132790 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): authenticate will time out at 1166.721016s 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8352d9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f835413c000 0x7f835413e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60148/0 (socket says 172.21.15.171:60148) 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8352d9d640 1 -- 172.21.15.171:0/367476541 learned_addr learned my addr 172.21.15.171:0/367476541 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:35.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835259c640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f8354132790 legacy=0x7f8354132b70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 750278309 0 0) 0x7f8354072340 con 0x7f835413c000 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient(hunting): my global_id is 5673 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f833c003530 con 0x7f835413c000 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3225939477 0 0) 0x7f833c003530 con 0x7f835413c000 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 >> v1:172.21.15.171:6792/0 conn(0x7f8354132790 legacy=0x7f8354132b70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 >> v1:172.21.15.106:6789/0 conn(0x7f83540717a0 legacy=0x7f835413a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 monclient: found mon.noname-g 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8354071c70 con 0x7f835413c000 2024-04-25T23:58:35.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: _finish_auth 0 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f834c001b40 con 0x7f835413c000 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: dump: 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:36.000 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 5 monclient: authenticate success, global_id 5673 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f834c001ea0 con 0x7f835413c000 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 1 -- 172.21.15.171:0/367476541 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f834c0020d0 con 0x7f835413c000 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:36.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 4 set_mon_vals no callback set 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f835159a640 10 monclient: dump: 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:36.002 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: shutdown 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- 172.21.15.171:0/367476541 >> v1:172.21.15.171:6790/0 conn(0x7f835413c000 legacy=0x7f835413e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- 172.21.15.171:0/367476541 shutdown_connections 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- 172.21.15.171:0/367476541 >> 172.21.15.171:0/367476541 conn(0x7f83540a6180 msgr2=0x7f83540a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- 172.21.15.171:0/367476541 shutdown_connections 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- 172.21.15.171:0/367476541 wait complete. 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: build_initial_monmap 2024-04-25T23:58:36.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: monmap: 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:36.004 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:36.005 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:36.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 Processor -- start 2024-04-25T23:58:36.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- start start 2024-04-25T23:58:36.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: init 2024-04-25T23:58:36.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:36.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient: _add_conns ranks=[1,7,6,8,2,3,0,5,4] 2024-04-25T23:58:36.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): picked mon.noname-f con 0x7f83540717a0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:36.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): picked mon.noname-i con 0x7f8354132790 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:36.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 10 monclient(hunting): picked mon.noname-d con 0x7f835413c000 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:36.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83541cd340 con 0x7f83540717a0 2024-04-25T23:58:36.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.012+0000 7f8358868640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f835409f5c0 con 0x7f835413c000 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f835406f690 con 0x7f8354132790 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient(hunting): authenticate will time out at 1166.724016s 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f835259c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f83540717a0 legacy=0x7f83541cc520 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8351d9b640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f8354132790 legacy=0x7f83541ccc30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8352d9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f835413c000 0x7f83541d4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:37570/0 (socket says 172.21.15.171:37570) 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8352d9d640 1 -- 172.21.15.171:0/1873001059 learned_addr learned my addr 172.21.15.171:0/1873001059 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1019299930 0 0) 0x7f835409f5c0 con 0x7f835413c000 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): my global_id is 5541 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8334003530 con 0x7f835413c000 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4062617687 0 0) 0x7f8334003530 con 0x7f835413c000 2024-04-25T23:58:36.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f835409f5c0 con 0x7f835413c000 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f834c001b00 con 0x7f835413c000 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:36.010 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 106804480 0 0) 0x7f835409f5c0 con 0x7f835413c000 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 >> v1:172.21.15.171:6792/0 conn(0x7f8354132790 legacy=0x7f83541ccc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 >> v1:172.21.15.171:6789/0 conn(0x7f83540717a0 legacy=0x7f83541cc520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 monclient: found mon.d 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:36.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8354070010 con 0x7f835413c000 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 5 monclient: authenticate success, global_id 5541 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient: _renew_subs 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8354070350 con 0x7f835413c000 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient: _renew_subs 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f835413ad10 con 0x7f835413c000 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f834c001ea0 con 0x7f835413c000 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:36.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f834c0052f0 con 0x7f835413c000 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8350d99640 4 set_mon_vals no callback set 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 10 monclient: dump: 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:36.013 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8338005090 con 0x7f835413c000 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f834c010090 con 0x7f835413c000 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(83..83 src has 1..83) ==== 5205+0+0 (unknown 1955115311 0 0) 0x7f834c044dc0 con 0x7f835413c000 2024-04-25T23:58:36.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.016+0000 7f835259c640 10 monclient: get_auth_request con 0x7f8334037780 auth_method 0 2024-04-25T23:58:36.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.028+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8354070350 con 0x7f835413c000 2024-04-25T23:58:36.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.028+0000 7f8342ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:36.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.028+0000 7f8342ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:36.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.192+0000 7f8358868640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}] 2024-04-25T23:58:36.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.192+0000 7f8358868640 10 monclient: _send_command 2 [{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}] 2024-04-25T23:58:36.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.192+0000 7f8358868640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:36.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.192+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"} v 0) -- 0x7f8338005380 con 0x7f835413c000 2024-04-25T23:58:36.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.776+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}]=0 v84) ==== 145+0+0 (unknown 280499305 0 0) 0x7f834c015aa0 con 0x7f835413c000 2024-04-25T23:58:36.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.776+0000 7f8342ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}] 2024-04-25T23:58:36.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.776+0000 7f8342ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:36.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.880+0000 7f8358868640 10 start_mon_command cmd=[{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}] 2024-04-25T23:58:36.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.880+0000 7f8358868640 10 monclient: _send_command 3 [{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}] 2024-04-25T23:58:36.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.880+0000 7f8358868640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:36.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.880+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"} v 0) -- 0x7f8338000cb0 con 0x7f835413c000 2024-04-25T23:58:36.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.880+0000 7f8342ffd640 1 -- 172.21.15.171:0/1873001059 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}]=0 rule foo-rule already exists v84) ==== 173+0+0 (unknown 136796738 0 0) 0x7f834c0153a0 con 0x7f835413c000 2024-04-25T23:58:36.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.880+0000 7f8342ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule create-simple", "name": "foo-rule", "root": "foo", "type": "host", "mode": "firstn"}] 2024-04-25T23:58:36.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.880+0000 7f8342ffd640 10 monclient: _finish_command 3 = system:0 rule foo-rule already exists 2024-04-25T23:58:36.866 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo-rule already exists 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 >> v1:172.21.15.171:6812/722422047 conn(0x7f8334037780 legacy=0x7f8334039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 10 monclient: shutdown 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 >> v1:172.21.15.106:6792/0 conn(0x7f835413c000 legacy=0x7f83541d4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 shutdown_connections 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 >> 172.21.15.171:0/1873001059 conn(0x7f83540a6180 msgr2=0x7f835412cc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 shutdown_connections 2024-04-25T23:58:36.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:36.884+0000 7f8358868640 1 -- 172.21.15.171:0/1873001059 wait complete. 2024-04-25T23:58:36.882 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush rm foo 2024-04-25T23:58:36.882 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:36.882 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm foo 2024-04-25T23:58:36.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient: get_monmap_and_config 2024-04-25T23:58:36.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient: build_initial_monmap 2024-04-25T23:58:36.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient: monmap: 2024-04-25T23:58:36.997 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:36.997 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:36.997 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:37.017082+0000 2024-04-25T23:58:36.997 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:37.017082+0000 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:36.998 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 1 Processor -- start 2024-04-25T23:58:37.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 1 -- start start 2024-04-25T23:58:37.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient: init 2024-04-25T23:58:37.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:37.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient: _add_conns ranks=[4,2,8,5,3,0,1,6,7] 2024-04-25T23:58:37.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient(hunting): picked mon.noname-c con 0x7f17a8072210 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient(hunting): picked mon.noname-b con 0x7f17a8137e20 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient(hunting): picked mon.noname-e con 0x7f17a813e3a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a8072d00 con 0x7f17a8137e20 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a806faa0 con 0x7f17a8072210 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a8072f20 con 0x7f17a813e3a0 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.012+0000 7f17ae6a8640 10 monclient(hunting): authenticate will time out at 1167.723969s 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17acc45640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f17a813e3a0 legacy=0x7f17a8140790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a7fff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f17a8072210 legacy=0x7f17a80725f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:37.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a77fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f17a8137e20 0x7f17a813cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51566/0 (socket says 172.21.15.171:51566) 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a77fe640 1 -- 172.21.15.171:0/552725195 learned_addr learned my addr 172.21.15.171:0/552725195 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149111830 0 0) 0x7f17a8072d00 con 0x7f17a8137e20 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient(hunting): my global_id is 5492 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1790003530 con 0x7f17a8137e20 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2472687684 0 0) 0x7f1790003530 con 0x7f17a8137e20 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 >> v1:172.21.15.106:6793/0 conn(0x7f17a813e3a0 legacy=0x7f17a8140790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 >> v1:172.21.15.106:6791/0 conn(0x7f17a8072210 legacy=0x7f17a80725f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 monclient: found mon.noname-b 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:37.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a806f200 con 0x7f17a8137e20 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f179c0017e0 con 0x7f17a8137e20 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: dump: 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.009 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.010 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 5 monclient: authenticate success, global_id 5492 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f179c001ad0 con 0x7f17a8137e20 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 4 set_mon_vals no callback set 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 1 -- 172.21.15.171:0/552725195 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f179c004bf0 con 0x7f17a8137e20 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a6ffd640 10 monclient: dump: 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.011 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.012 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient: shutdown 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- 172.21.15.171:0/552725195 >> v1:172.21.15.106:6790/0 conn(0x7f17a8137e20 legacy=0x7f17a813cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- 172.21.15.171:0/552725195 shutdown_connections 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- 172.21.15.171:0/552725195 >> 172.21.15.171:0/552725195 conn(0x7f17a80a2620 msgr2=0x7f17a80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- 172.21.15.171:0/552725195 shutdown_connections 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- 172.21.15.171:0/552725195 wait complete. 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient: build_initial_monmap 2024-04-25T23:58:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient: monmap: 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 Processor -- start 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- start start 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient: init 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient: _add_conns ranks=[6,4,0,7,1,5,2,3,8] 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient(hunting): picked mon.noname-d con 0x7f17a8072210 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient(hunting): picked mon.noname-c con 0x7f17a8137e20 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient(hunting): picked mon.noname-a con 0x7f17a813e3a0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a8134860 con 0x7f17a813e3a0 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a81cd340 con 0x7f17a8137e20 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17a806ec60 con 0x7f17a8072210 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17ae6a8640 10 monclient(hunting): authenticate will time out at 1167.727388s 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17a77fe640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f17a8137e20 legacy=0x7f17a81ccc30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17acc45640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f17a813e3a0 0x7f17a81d4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:45256/0 (socket says 172.21.15.171:45256) 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.016+0000 7f17acc45640 1 -- 172.21.15.171:0/3836418554 learned_addr learned my addr 172.21.15.171:0/3836418554 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1913682718 0 0) 0x7f17a8134860 con 0x7f17a813e3a0 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:37.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): my global_id is 5553 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1794003530 con 0x7f17a813e3a0 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482769237 0 0) 0x7f17a806ec60 con 0x7f17a8072210 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): my global_id is 5550 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17a8134860 con 0x7f17a8072210 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4044129378 0 0) 0x7f1794003530 con 0x7f17a813e3a0 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f17a806ec60 con 0x7f17a813e3a0 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17a00045f0 con 0x7f17a813e3a0 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:37.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): dump: 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.018 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4227622839 0 0) 0x7f17a8134860 con 0x7f17a8072210 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1794003530 con 0x7f17a8072210 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1798004170 con 0x7f17a8072210 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient(hunting): dump: 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.019 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 38936077 0 0) 0x7f17a806ec60 con 0x7f17a813e3a0 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 >> v1:172.21.15.106:6792/0 conn(0x7f17a8072210 legacy=0x7f17a81cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 >> v1:172.21.15.106:6791/0 conn(0x7f17a8137e20 legacy=0x7f17a81ccc30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 monclient: found mon.a 2024-04-25T23:58:37.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17a806e710 con 0x7f17a813e3a0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: _finish_auth 0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 5 monclient: authenticate success, global_id 5553 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 10 monclient: _renew_subs 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f17a8134580 con 0x7f17a813e3a0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 10 monclient: _renew_subs 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f17a8134c80 con 0x7f17a813e3a0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f17a0004790 con 0x7f17a813e3a0 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f17a0004d00 con 0x7f17a813e3a0 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a67fc640 4 set_mon_vals no callback set 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 10 monclient: dump: 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.022 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17ae6a8640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1788005090 con 0x7f17a813e3a0 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f17a0004f20 con 0x7f17a813e3a0 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(84..84 src has 1..84) ==== 5265+0+0 (unknown 2439625043 0 0) 0x7f17a0044e80 con 0x7f17a813e3a0 2024-04-25T23:58:37.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.020+0000 7f17a7fff640 10 monclient: get_auth_request con 0x7f1794037da0 auth_method 0 2024-04-25T23:58:37.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.032+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f17a0015a60 con 0x7f17a813e3a0 2024-04-25T23:58:37.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.032+0000 7f17a4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:37.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.032+0000 7f17a4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:37.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.200+0000 7f17ae6a8640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:37.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.200+0000 7f17ae6a8640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:37.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.200+0000 7f17ae6a8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:37.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.200+0000 7f17ae6a8640 1 -- 172.21.15.171:0/3836418554 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "foo"} v 0) -- 0x7f1788005380 con 0x7f17a813e3a0 2024-04-25T23:58:37.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.200+0000 7f17a4ff9640 1 -- 172.21.15.171:0/3836418554 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "foo"}]=-16 (16) Device or resource busy v84) ==== 103+0+0 (unknown 3854671792 0 0) 0x7f17a0015360 con 0x7f17a813e3a0 2024-04-25T23:58:37.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.200+0000 7f17a4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:37.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.200+0000 7f17a4ff9640 10 monclient: _finish_command 2 = mon:16 (16) Device or resource busy 2024-04-25T23:58:37.184 INFO:tasks.workunit.client.0.smithi171.stderr:Error EBUSY: (16) Device or resource busy 2024-04-25T23:58:37.190 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:37.190 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rule rm foo-rule 2024-04-25T23:58:37.302 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: get_monmap_and_config 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: build_initial_monmap 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: monmap: 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:37.322694+0000 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:37.322694+0000 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:37.303 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:37.304 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:37.304 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:37.304 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:37.304 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 Processor -- start 2024-04-25T23:58:37.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- start start 2024-04-25T23:58:37.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: init 2024-04-25T23:58:37.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:37.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: _add_conns ranks=[4,7,6,1,3,0,8,5,2] 2024-04-25T23:58:37.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient(hunting): picked mon.noname-c con 0x7f6a00137880 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:37.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient(hunting): picked mon.noname-i con 0x7f6a00138370 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:37.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient(hunting): picked mon.noname-d con 0x7f6a000a47e0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:37.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a000a2ea0 con 0x7f6a00137880 2024-04-25T23:58:37.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a000a2bc0 con 0x7f6a000a47e0 2024-04-25T23:58:37.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a000a28e0 con 0x7f6a00138370 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient(hunting): authenticate will time out at 1168.029678s 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69f7fff640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f6a00138370 legacy=0x7f6a0013cdf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fe59c640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f6a00137880 legacy=0x7f6a00137c60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fed9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6a000a47e0 0x7f6a00140520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:37592/0 (socket says 172.21.15.171:37592) 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fed9d640 1 -- 172.21.15.171:0/2070130017 learned_addr learned my addr 172.21.15.171:0/2070130017 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389567667 0 0) 0x7f6a000a2bc0 con 0x7f6a000a47e0 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient(hunting): _negotiate 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient(hunting): my global_id is 5559 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69ec003530 con 0x7f6a000a47e0 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2938244608 0 0) 0x7f69ec003530 con 0x7f6a000a47e0 2024-04-25T23:58:37.312 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 >> v1:172.21.15.171:6792/0 conn(0x7f6a00138370 legacy=0x7f6a0013cdf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 >> v1:172.21.15.106:6791/0 conn(0x7f6a00137880 legacy=0x7f6a00137c60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: _finish_hunting 0 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 monclient: found mon.noname-d 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a000a4230 con 0x7f6a000a47e0 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: _finish_auth 0 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: _check_auth_tickets 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 5 monclient: authenticate success, global_id 5559 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69f8001b40 con 0x7f6a000a47e0 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:37.313 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: dump: 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.314 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.315 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.315 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.315 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.315 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.315 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:37.315 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69f8001e30 con 0x7f6a000a47e0 2024-04-25T23:58:37.315 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 1 -- 172.21.15.171:0/2070130017 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69f8004f70 con 0x7f6a000a47e0 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 4 set_mon_vals no callback set 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f69fdd9b640 10 monclient: dump: 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.316 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 10 monclient: shutdown 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- 172.21.15.171:0/2070130017 >> v1:172.21.15.106:6792/0 conn(0x7f6a000a47e0 legacy=0x7f6a00140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- 172.21.15.171:0/2070130017 shutdown_connections 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- 172.21.15.171:0/2070130017 >> 172.21.15.171:0/2070130017 conn(0x7f6a000a9ee0 msgr2=0x7f6a000aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- 172.21.15.171:0/2070130017 shutdown_connections 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.320+0000 7f6a04ba9640 1 -- 172.21.15.171:0/2070130017 wait complete. 2024-04-25T23:58:37.317 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: build_initial_monmap 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: monmap: 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:37.318 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 Processor -- start 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 -- start start 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: init 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _add_conns ranks=[1,3,0,6,7,4,8,2,5] 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient(hunting): picked mon.noname-f con 0x7f6a000a47e0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient(hunting): picked mon.noname-g con 0x7f6a00137880 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient(hunting): picked mon.noname-a con 0x7f6a00138370 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a00134e80 con 0x7f6a00138370 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a000a1e80 con 0x7f6a000a47e0 2024-04-25T23:58:37.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a00132b90 con 0x7f6a00137880 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient(hunting): authenticate will time out at 1168.033277s 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69fe59c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f6a000a47e0 legacy=0x7f6a001352a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f7fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6a00137880 0x7f6a001d0cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60156/0 (socket says 172.21.15.171:60156) 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f7fff640 1 -- 172.21.15.171:0/315282347 learned_addr learned my addr 172.21.15.171:0/315282347 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 473280867 0 0) 0x7f6a00132b90 con 0x7f6a00137880 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): my global_id is 5682 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e0003530 con 0x7f6a00137880 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3620787216 0 0) 0x7f69e0003530 con 0x7f6a00137880 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a00132b90 con 0x7f6a00137880 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69f0004340 con 0x7f6a00137880 2024-04-25T23:58:37.320 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.321 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441162567 0 0) 0x7f6a00134e80 con 0x7f6a00138370 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient(hunting): my global_id is 5562 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69e0003530 con 0x7f6a00138370 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 224284242 0 0) 0x7f6a00132b90 con 0x7f6a00137880 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 >> v1:172.21.15.171:6789/0 conn(0x7f6a000a47e0 legacy=0x7f6a001352a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 >> v1:172.21.15.106:6789/0 conn(0x7f6a00138370 legacy=0x7f6a001d4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:37.322 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 monclient: found mon.g 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a00134ba0 con 0x7f6a00137880 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 5 monclient: authenticate success, global_id 5682 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _renew_subs 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a001d5b20 con 0x7f6a00137880 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _renew_subs 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a001d5ec0 con 0x7f6a00137880 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f69f00045e0 con 0x7f6a00137880 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f69f0004b50 con 0x7f6a00137880 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69fd59a640 4 set_mon_vals no callback set 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 10 monclient: dump: 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:37.324 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f69f0004cf0 con 0x7f6a00137880 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69e4005090 con 0x7f6a00137880 2024-04-25T23:58:37.325 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(84..84 src has 1..84) ==== 5265+0+0 (unknown 2439625043 0 0) 0x7f69f0044c60 con 0x7f6a00137880 2024-04-25T23:58:37.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.324+0000 7f69fe59c640 10 monclient: get_auth_request con 0x7f69e0037780 auth_method 0 2024-04-25T23:58:37.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.328+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f69f0015840 con 0x7f6a00137880 2024-04-25T23:58:37.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.328+0000 7f69f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:37.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.328+0000 7f69f6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:37.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.480+0000 7f6a04ba9640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "foo-rule"}] 2024-04-25T23:58:37.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.480+0000 7f6a04ba9640 10 monclient: _send_command 2 [{"prefix": "osd crush rule rm", "name": "foo-rule"}] 2024-04-25T23:58:37.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.480+0000 7f6a04ba9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:37.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.480+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rm", "name": "foo-rule"} v 0) -- 0x7f69e4005380 con 0x7f6a00137880 2024-04-25T23:58:37.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.792+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo-rule"}]=0 v85) ==== 85+0+0 (unknown 819870340 0 0) 0x7f69f0015140 con 0x7f6a00137880 2024-04-25T23:58:37.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.792+0000 7f69f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rule rm", "name": "foo-rule"}] 2024-04-25T23:58:37.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.792+0000 7f69f6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:37.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.892+0000 7f6a04ba9640 10 start_mon_command cmd=[{"prefix": "osd crush rule rm", "name": "foo-rule"}] 2024-04-25T23:58:37.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.892+0000 7f6a04ba9640 10 monclient: _send_command 3 [{"prefix": "osd crush rule rm", "name": "foo-rule"}] 2024-04-25T23:58:37.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.892+0000 7f6a04ba9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:37.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.892+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rule rm", "name": "foo-rule"} v 0) -- 0x7f69e4002220 con 0x7f6a00137880 2024-04-25T23:58:37.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.892+0000 7f69f6ffd640 1 -- 172.21.15.171:0/315282347 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rule rm", "name": "foo-rule"}]=0 rule foo-rule does not exist v85) ==== 113+0+0 (unknown 2965057711 0 0) 0x7f69f0019490 con 0x7f6a00137880 2024-04-25T23:58:37.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.892+0000 7f69f6ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rule rm", "name": "foo-rule"}] 2024-04-25T23:58:37.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.892+0000 7f69f6ffd640 10 monclient: _finish_command 3 = system:0 rule foo-rule does not exist 2024-04-25T23:58:37.878 INFO:tasks.workunit.client.0.smithi171.stderr:rule foo-rule does not exist 2024-04-25T23:58:37.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 >> v1:172.21.15.171:6812/722422047 conn(0x7f69e0037780 legacy=0x7f69e0039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:37.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 10 monclient: shutdown 2024-04-25T23:58:37.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:37.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 >> v1:172.21.15.171:6790/0 conn(0x7f6a00137880 legacy=0x7f6a001d0cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:37.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 shutdown_connections 2024-04-25T23:58:37.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 >> 172.21.15.171:0/315282347 conn(0x7f6a000a9ee0 msgr2=0x7f6a000a7ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:37.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 shutdown_connections 2024-04-25T23:58:37.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:37.896+0000 7f6a04ba9640 1 -- 172.21.15.171:0/315282347 wait complete. 2024-04-25T23:58:37.895 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm bar 2024-04-25T23:58:38.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.028+0000 7f76ec495640 10 monclient: get_monmap_and_config 2024-04-25T23:58:38.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.028+0000 7f76ec495640 10 monclient: build_initial_monmap 2024-04-25T23:58:38.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.028+0000 7f76ec495640 10 monclient: monmap: 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:38.033320+0000 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:38.033320+0000 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:38.015 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:38.015 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:38.015 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:38.015 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:38.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.028+0000 7f76ec495640 1 Processor -- start 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.028+0000 7f76ec495640 1 -- start start 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.028+0000 7f76ec495640 10 monclient: init 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient: _add_conns ranks=[6,3,4,0,8,2,7,5,1] 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient(hunting): picked mon.noname-d con 0x7f76e40a3930 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient(hunting): picked mon.noname-g con 0x7f76e4138150 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient(hunting): picked mon.noname-c con 0x7f76e4138570 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e40a2b70 con 0x7f76e4138150 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e40a2e50 con 0x7f76e4138570 2024-04-25T23:58:38.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e40a4460 con 0x7f76e40a3930 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient(hunting): authenticate will time out at 1168.740573s 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76eaa32640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f76e4138570 legacy=0x7f76e41406a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e9a30640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f76e4138150 0x7f76e413cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60162/0 (socket says 172.21.15.171:60162) 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e9a30640 1 -- 172.21.15.171:0/339078993 learned_addr learned my addr 172.21.15.171:0/339078993 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 462399457 0 0) 0x7f76e40a2b70 con 0x7f76e4138150 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): _negotiate 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): my global_id is 5691 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76d0003530 con 0x7f76e4138150 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2516083090 0 0) 0x7f76e40a4460 con 0x7f76e40a3930 2024-04-25T23:58:38.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): _negotiate 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient(hunting): my global_id is 5568 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76e40a2b70 con 0x7f76e40a3930 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1592200929 0 0) 0x7f76d0003530 con 0x7f76e4138150 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 >> v1:172.21.15.106:6792/0 conn(0x7f76e40a3930 legacy=0x7f76e4137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 >> v1:172.21.15.106:6791/0 conn(0x7f76e4138570 legacy=0x7f76e41406a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: _finish_hunting 0 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 monclient: found mon.noname-g 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:38.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e40a1810 con 0x7f76e4138150 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: _finish_auth 0 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: _check_auth_tickets 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76e00017c0 con 0x7f76e4138150 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: dump: 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:38.026 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76e0001ae0 con 0x7f76e4138150 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 5 monclient: authenticate success, global_id 5691 2024-04-25T23:58:38.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 1 -- 172.21.15.171:0/339078993 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76e0004bf0 con 0x7f76e4138150 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76e922f640 10 monclient: dump: 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:38.028 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 4 set_mon_vals no callback set 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient: shutdown 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- 172.21.15.171:0/339078993 >> v1:172.21.15.171:6790/0 conn(0x7f76e4138150 legacy=0x7f76e413cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- 172.21.15.171:0/339078993 shutdown_connections 2024-04-25T23:58:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- 172.21.15.171:0/339078993 >> 172.21.15.171:0/339078993 conn(0x7f76e40a6d70 msgr2=0x7f76e40a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- 172.21.15.171:0/339078993 shutdown_connections 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- 172.21.15.171:0/339078993 wait complete. 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient: build_initial_monmap 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient: monmap: 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:38.030 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 Processor -- start 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 1 -- start start 2024-04-25T23:58:38.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.032+0000 7f76ec495640 10 monclient: init 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _add_conns ranks=[7,5,0,6,1,3,8,4,2] 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient(hunting): picked mon.noname-i con 0x7f76e40a3930 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient(hunting): picked mon.noname-h con 0x7f76e4138150 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient(hunting): picked mon.noname-a con 0x7f76e4138570 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e4124400 con 0x7f76e4138570 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e40a1030 con 0x7f76e4138150 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e4138d40 con 0x7f76e40a3930 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ea231640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f76e40a3930 legacy=0x7f76e4136a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient(hunting): authenticate will time out at 1168.744539s 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76e9a30640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f76e4138150 0x7f76e4137130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:55172/0 (socket says 172.21.15.171:55172) 2024-04-25T23:58:38.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76e9a30640 1 -- 172.21.15.171:0/2790817773 learned_addr learned my addr 172.21.15.171:0/2790817773 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814330361 0 0) 0x7f76e40a1030 con 0x7f76e4138150 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): my global_id is 5477 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76c8003530 con 0x7f76e4138150 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3626174840 0 0) 0x7f76c8003530 con 0x7f76e4138150 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76e40a1030 con 0x7f76e4138150 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76e0004b30 con 0x7f76e4138150 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:38.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): dump: 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:38.034 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 882223074 0 0) 0x7f76e40a1030 con 0x7f76e4138150 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 >> v1:172.21.15.171:6792/0 conn(0x7f76e40a3930 legacy=0x7f76e4136a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 >> v1:172.21.15.106:6789/0 conn(0x7f76e4138570 legacy=0x7f76e41d4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 monclient: found mon.h 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e4124120 con 0x7f76e4138150 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:38.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 5 monclient: authenticate success, global_id 5477 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _renew_subs 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f76e4122980 con 0x7f76e4138150 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _renew_subs 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f76e41cc8f0 con 0x7f76e4138150 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76e0001ae0 con 0x7f76e4138150 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76e0001d10 con 0x7f76e4138150 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:38.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76e8a2e640 4 set_mon_vals no callback set 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 10 monclient: dump: 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:38.037 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f76e0010050 con 0x7f76e4138150 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76cc005090 con 0x7f76e4138150 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(85..85 src has 1..85) ==== 5205+0+0 (unknown 3535666748 0 0) 0x7f76e0044c30 con 0x7f76e4138150 2024-04-25T23:58:38.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.036+0000 7f76ea231640 10 monclient: get_auth_request con 0x7f76c80377d0 auth_method 0 2024-04-25T23:58:38.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.040+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f76e00158b0 con 0x7f76e4138150 2024-04-25T23:58:38.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.040+0000 7f76daffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:38.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.040+0000 7f76daffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:38.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.196+0000 7f76ec495640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:38.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.196+0000 7f76ec495640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:38.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.196+0000 7f76ec495640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:38.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.196+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "bar"} v 0) -- 0x7f76cc005380 con 0x7f76e4138150 2024-04-25T23:58:38.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.800+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "bar"}]=0 removed item id -19 name 'bar' from crush map v86) ==== 120+0+0 (unknown 727865575 0 0) 0x7f76e001dd60 con 0x7f76e4138150 2024-04-25T23:58:38.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.800+0000 7f76daffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:38.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.800+0000 7f76daffd640 10 monclient: _finish_command 2 = system:0 removed item id -19 name 'bar' from crush map 2024-04-25T23:58:38.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.900+0000 7f76ec495640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:38.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.900+0000 7f76ec495640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:38.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.900+0000 7f76ec495640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:38.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.900+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "bar"} v 0) -- 0x7f76cc002220 con 0x7f76e4138150 2024-04-25T23:58:38.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.900+0000 7f76daffd640 1 -- 172.21.15.171:0/2790817773 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "bar"}]=0 device 'bar' does not appear in the crush map v86) ==== 120+0+0 (unknown 3256645968 0 0) 0x7f76e00408e0 con 0x7f76e4138150 2024-04-25T23:58:38.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.900+0000 7f76daffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "bar"}] 2024-04-25T23:58:38.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.900+0000 7f76daffd640 10 monclient: _finish_command 3 = system:0 device 'bar' does not appear in the crush map 2024-04-25T23:58:38.886 INFO:tasks.workunit.client.0.smithi171.stderr:device 'bar' does not appear in the crush map 2024-04-25T23:58:38.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 >> v1:172.21.15.171:6812/722422047 conn(0x7f76c80377d0 legacy=0x7f76c8039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:38.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 10 monclient: shutdown 2024-04-25T23:58:38.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:38.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 >> v1:172.21.15.171:6791/0 conn(0x7f76e4138150 legacy=0x7f76e4137130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:38.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 shutdown_connections 2024-04-25T23:58:38.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 >> 172.21.15.171:0/2790817773 conn(0x7f76e40a6d70 msgr2=0x7f76e40a8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:38.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 shutdown_connections 2024-04-25T23:58:38.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:38.904+0000 7f76ec495640 1 -- 172.21.15.171:0/2790817773 wait complete. 2024-04-25T23:58:38.901 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm foo 2024-04-25T23:58:39.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient: get_monmap_and_config 2024-04-25T23:58:39.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient: build_initial_monmap 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient: monmap: 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:39.039591+0000 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:39.039591+0000 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:39.029 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 1 Processor -- start 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 1 -- start start 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient: init 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient: _add_conns ranks=[8,2,5,1,6,3,0,4,7] 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient(hunting): picked mon.noname-e con 0x7ff4580a0a60 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient(hunting): picked mon.noname-b con 0x7ff45809ffe0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient(hunting): picked mon.noname-h con 0x7ff4580a0e40 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4580a3540 con 0x7ff45809ffe0 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45809e800 con 0x7ff4580a0e40 2024-04-25T23:58:39.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff45809ed60 con 0x7ff4580a0a60 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45c92f640 10 monclient(hunting): authenticate will time out at 1169.747264s 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff456d9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7ff4580a0e40 0x7ff458140930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:55174/0 (socket says 172.21.15.171:55174) 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff456d9d640 1 -- 172.21.15.171:0/1609212923 learned_addr learned my addr 172.21.15.171:0/1609212923 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff45659c640 1 -- 172.21.15.171:0/1609212923 >> v1:172.21.15.106:6793/0 conn(0x7ff4580a0a60 legacy=0x7ff4580a2720 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1601437791 0 0) 0x7ff45809e800 con 0x7ff4580a0e40 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient(hunting): my global_id is 5486 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff444003530 con 0x7ff4580a0e40 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4272002698 0 0) 0x7ff444003530 con 0x7ff4580a0e40 2024-04-25T23:58:39.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 >> v1:172.21.15.106:6793/0 conn(0x7ff4580a0a60 legacy=0x7ff4580a2720 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 >> v1:172.21.15.106:6790/0 conn(0x7ff45809ffe0 legacy=0x7ff4580a2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 monclient: found mon.noname-h 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff45809f040 con 0x7ff4580a0e40 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient: _finish_auth 0 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff450001b40 con 0x7ff4580a0e40 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.036+0000 7ff455d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 10 monclient: dump: 2024-04-25T23:58:39.032 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:39.033 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 5 monclient: authenticate success, global_id 5486 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff450001e30 con 0x7ff4580a0e40 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 1 -- 172.21.15.171:0/1609212923 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff450004f70 con 0x7ff4580a0e40 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 4 set_mon_vals no callback set 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff455d9b640 10 monclient: dump: 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.034 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: shutdown 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:39.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- 172.21.15.171:0/1609212923 >> v1:172.21.15.171:6791/0 conn(0x7ff4580a0e40 legacy=0x7ff458140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- 172.21.15.171:0/1609212923 shutdown_connections 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- 172.21.15.171:0/1609212923 >> 172.21.15.171:0/1609212923 conn(0x7ff4580a7310 msgr2=0x7ff4580a3810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- 172.21.15.171:0/1609212923 shutdown_connections 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- 172.21.15.171:0/1609212923 wait complete. 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: build_initial_monmap 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: monmap: 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:39.036 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 Processor -- start 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- start start 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: init 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: _add_conns ranks=[1,2,3,0,5,6,8,4,7] 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient(hunting): picked mon.noname-f con 0x7ff4580a0a60 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:39.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient(hunting): picked mon.noname-b con 0x7ff4580a0e40 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient(hunting): picked mon.noname-g con 0x7ff4581bd170 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4580a0830 con 0x7ff4580a0a60 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4581a8130 con 0x7ff4580a0e40 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4581aa420 con 0x7ff4581bd170 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45659c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7ff4580a0a60 legacy=0x7ff4581bca60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient(hunting): authenticate will time out at 1169.750282s 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff456d9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff4581bd170 0x7ff4581d4e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60166/0 (socket says 172.21.15.171:60166) 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff456d9d640 1 -- 172.21.15.171:0/1257033177 learned_addr learned my addr 172.21.15.171:0/1257033177 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4058649064 0 0) 0x7ff4581aa420 con 0x7ff4581bd170 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:39.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): my global_id is 5700 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff438003530 con 0x7ff4581bd170 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735752274 0 0) 0x7ff4581a8130 con 0x7ff4580a0e40 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): my global_id is 5510 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4581aa420 con 0x7ff4580a0e40 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1141841235 0 0) 0x7ff438003530 con 0x7ff4581bd170 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4581a8130 con 0x7ff4581bd170 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff450001c20 con 0x7ff4581bd170 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): dump: 2024-04-25T23:58:39.039 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:39.040 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2524874689 0 0) 0x7ff4581a8130 con 0x7ff4581bd170 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 >> v1:172.21.15.106:6790/0 conn(0x7ff4580a0e40 legacy=0x7ff4581d16f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 >> v1:172.21.15.171:6789/0 conn(0x7ff4580a0a60 legacy=0x7ff4581bca60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 monclient: found mon.g 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4581a9b80 con 0x7ff4581bd170 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: _finish_auth 0 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 5 monclient: authenticate success, global_id 5700 2024-04-25T23:58:39.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: _renew_subs 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff4581a8eb0 con 0x7ff4581bd170 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: _renew_subs 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff4500020b0 con 0x7ff4581bd170 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff4581cc370 con 0x7ff4581bd170 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff4500054a0 con 0x7ff4581bd170 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff44effd640 10 monclient: dump: 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:39.042 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:39.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.040+0000 7ff454d99640 4 set_mon_vals no callback set 2024-04-25T23:58:39.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.044+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff4500102c0 con 0x7ff4581bd170 2024-04-25T23:58:39.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.044+0000 7ff45c92f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:39.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.044+0000 7ff45c92f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:39.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.044+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(86..86 src has 1..86) ==== 5076+0+0 (unknown 541912078 0 0) 0x7ff450044dd0 con 0x7ff4581bd170 2024-04-25T23:58:39.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.044+0000 7ff45c92f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:39.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.044+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff43c005090 con 0x7ff4581bd170 2024-04-25T23:58:39.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.044+0000 7ff45659c640 10 monclient: get_auth_request con 0x7ff438037910 auth_method 0 2024-04-25T23:58:39.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.048+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff4500196c0 con 0x7ff4581bd170 2024-04-25T23:58:39.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.048+0000 7ff44effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:39.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.048+0000 7ff44effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:39.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.208+0000 7ff45c92f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:39.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.208+0000 7ff45c92f640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:39.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.208+0000 7ff45c92f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:39.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.208+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "foo"} v 0) -- 0x7ff43c005380 con 0x7ff4581bd170 2024-04-25T23:58:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.808+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "foo"}]=0 removed item id -10 name 'foo' from crush map v87) ==== 120+0+0 (unknown 3093239646 0 0) 0x7ff45001df80 con 0x7ff4581bd170 2024-04-25T23:58:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.812+0000 7ff44effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.812+0000 7ff44effd640 10 monclient: _finish_command 2 = system:0 removed item id -10 name 'foo' from crush map 2024-04-25T23:58:39.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.912+0000 7ff45c92f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:39.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.912+0000 7ff45c92f640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:39.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.912+0000 7ff45c92f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:39.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.912+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "foo"} v 0) -- 0x7ff43c002220 con 0x7ff4581bd170 2024-04-25T23:58:39.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.912+0000 7ff44effd640 1 -- 172.21.15.171:0/1257033177 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "foo"}]=0 device 'foo' does not appear in the crush map v87) ==== 120+0+0 (unknown 2571345781 0 0) 0x7ff450043620 con 0x7ff4581bd170 2024-04-25T23:58:39.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.912+0000 7ff44effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:39.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.912+0000 7ff44effd640 10 monclient: _finish_command 3 = system:0 device 'foo' does not appear in the crush map 2024-04-25T23:58:39.897 INFO:tasks.workunit.client.0.smithi171.stderr:device 'foo' does not appear in the crush map 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 >> v1:172.21.15.171:6812/722422047 conn(0x7ff438037910 legacy=0x7ff438039dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 10 monclient: shutdown 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 >> v1:172.21.15.171:6790/0 conn(0x7ff4581bd170 legacy=0x7ff4581d4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 shutdown_connections 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 >> 172.21.15.171:0/1257033177 conn(0x7ff4580a7310 msgr2=0x7ff4581bfa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 shutdown_connections 2024-04-25T23:58:39.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:39.916+0000 7ff45c92f640 1 -- 172.21.15.171:0/1257033177 wait complete. 2024-04-25T23:58:39.914 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm osd.9 host2 2024-04-25T23:58:40.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.048+0000 7fb46faca640 10 monclient: get_monmap_and_config 2024-04-25T23:58:40.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.048+0000 7fb46faca640 10 monclient: build_initial_monmap 2024-04-25T23:58:40.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.048+0000 7fb46faca640 10 monclient: monmap: 2024-04-25T23:58:40.034 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:40.034 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:40.053836+0000 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:40.053836+0000 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:40.035 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:40.036 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:40.036 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:40.036 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:40.036 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:40.036 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:40.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 Processor -- start 2024-04-25T23:58:40.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- start start 2024-04-25T23:58:40.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: init 2024-04-25T23:58:40.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:40.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: _add_conns ranks=[3,6,1,2,4,0,8,7,5] 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): picked mon.noname-g con 0x7fb4680a2e70 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): picked mon.noname-d con 0x7fb46809fda0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): picked mon.noname-f con 0x7fb468138480 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46806ee40 con 0x7fb468138480 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46806f0b0 con 0x7fb4680a2e70 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46806f390 con 0x7fb46809fda0 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:40.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): authenticate will time out at 1170.760818s 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46e067640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fb468138480 legacy=0x7fb4681402b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46d866640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fb4680a2e70 0x7fb468137d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60176/0 (socket says 172.21.15.171:60176) 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46d866640 1 -- 172.21.15.171:0/1157261941 learned_addr learned my addr 172.21.15.171:0/1157261941 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203917093 0 0) 0x7fb46806f0b0 con 0x7fb4680a2e70 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient(hunting): _negotiate 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:40.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient(hunting): my global_id is 5709 2024-04-25T23:58:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb454003530 con 0x7fb4680a2e70 2024-04-25T23:58:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3302251447 0 0) 0x7fb454003530 con 0x7fb4680a2e70 2024-04-25T23:58:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 >> v1:172.21.15.106:6792/0 conn(0x7fb46809fda0 legacy=0x7fb46813cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 >> v1:172.21.15.171:6789/0 conn(0x7fb468138480 legacy=0x7fb4681402b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: _finish_hunting 0 2024-04-25T23:58:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 monclient: found mon.noname-g 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46806f670 con 0x7fb4680a2e70 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: _finish_auth 0 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: _check_auth_tickets 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4640017c0 con 0x7fb4680a2e70 2024-04-25T23:58:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 5 monclient: authenticate success, global_id 5709 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: dump: 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.054 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.055 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:40.055 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:40.055 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:40.055 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:40.055 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:40.055 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:40.055 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb464001ab0 con 0x7fb4680a2e70 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 1 -- 172.21.15.171:0/1157261941 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb464004bf0 con 0x7fb4680a2e70 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 4 set_mon_vals no callback set 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:40.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46c864640 10 monclient: dump: 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:40.057 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: shutdown 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- 172.21.15.171:0/1157261941 >> v1:172.21.15.171:6790/0 conn(0x7fb4680a2e70 legacy=0x7fb468137d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- 172.21.15.171:0/1157261941 shutdown_connections 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- 172.21.15.171:0/1157261941 >> 172.21.15.171:0/1157261941 conn(0x7fb4680a62d0 msgr2=0x7fb4680a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- 172.21.15.171:0/1157261941 shutdown_connections 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- 172.21.15.171:0/1157261941 wait complete. 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: build_initial_monmap 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: monmap: 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:40.058 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 Processor -- start 2024-04-25T23:58:40.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- start start 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: init 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient: _add_conns ranks=[7,1,0,4,6,8,3,5,2] 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): picked mon.noname-i con 0x7fb4680a2e70 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): picked mon.noname-f con 0x7fb468138480 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): picked mon.noname-a con 0x7fb4681c8b10 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4681221b0 con 0x7fb4681c8b10 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4680725b0 con 0x7fb468138480 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4681c9740 con 0x7fb4680a2e70 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46d866640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fb4680a2e70 legacy=0x7fb468134a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46faca640 10 monclient(hunting): authenticate will time out at 1170.763734s 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.052+0000 7fb46d065640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fb468138480 legacy=0x7fb4681d13b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:40.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46e067640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb4681c8b10 0x7fb4681d4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:45290/0 (socket says 172.21.15.171:45290) 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46e067640 1 -- 172.21.15.171:0/557750038 learned_addr learned my addr 172.21.15.171:0/557750038 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786324229 0 0) 0x7fb4681221b0 con 0x7fb4681c8b10 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): my global_id is 5580 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb44c003530 con 0x7fb4681c8b10 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4196177053 0 0) 0x7fb44c003530 con 0x7fb4681c8b10 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4681221b0 con 0x7fb4681c8b10 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb460004560 con 0x7fb4681c8b10 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): dump: 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:40.061 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:40.062 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 333363913 0 0) 0x7fb4681221b0 con 0x7fb4681c8b10 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 >> v1:172.21.15.171:6792/0 conn(0x7fb4680a2e70 legacy=0x7fb468134a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 >> v1:172.21.15.171:6789/0 conn(0x7fb468138480 legacy=0x7fb4681d13b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 monclient: found mon.a 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb468120c40 con 0x7fb4681c8b10 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 5 monclient: authenticate success, global_id 5580 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 10 monclient: _renew_subs 2024-04-25T23:58:40.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb46811fec0 con 0x7fb4681c8b10 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 10 monclient: _renew_subs 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb468135130 con 0x7fb4681c8b10 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb460004850 con 0x7fb4681c8b10 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45ffff640 4 set_mon_vals no callback set 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb460004dc0 con 0x7fb4681c8b10 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 10 monclient: dump: 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.064 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:40.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb450005090 con 0x7fb4681c8b10 2024-04-25T23:58:40.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb460004fe0 con 0x7fb4681c8b10 2024-04-25T23:58:40.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(87..87 src has 1..87) ==== 4947+0+0 (unknown 2601799393 0 0) 0x7fb460044d30 con 0x7fb4681c8b10 2024-04-25T23:58:40.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.056+0000 7fb46d866640 10 monclient: get_auth_request con 0x7fb44c0376a0 auth_method 0 2024-04-25T23:58:40.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.068+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb4600159f0 con 0x7fb4681c8b10 2024-04-25T23:58:40.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.068+0000 7fb45e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:40.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.068+0000 7fb45e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:40.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.232+0000 7fb46faca640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}] 2024-04-25T23:58:40.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.232+0000 7fb46faca640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}] 2024-04-25T23:58:40.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.232+0000 7fb46faca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:40.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.232+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"} v 0) -- 0x7fb450005b90 con 0x7fb4681c8b10 2024-04-25T23:58:40.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.808+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}]=0 removed item id 9 name 'osd.9' from crush map v88) ==== 143+0+0 (unknown 910938945 0 0) 0x7fb4600196a0 con 0x7fb4681c8b10 2024-04-25T23:58:40.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.808+0000 7fb45e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}] 2024-04-25T23:58:40.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.808+0000 7fb45e7fc640 10 monclient: _finish_command 2 = system:0 removed item id 9 name 'osd.9' from crush map 2024-04-25T23:58:40.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.916+0000 7fb46faca640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}] 2024-04-25T23:58:40.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.916+0000 7fb46faca640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}] 2024-04-25T23:58:40.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.916+0000 7fb46faca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:40.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.916+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"} v 0) -- 0x7fb4500010a0 con 0x7fb4681c8b10 2024-04-25T23:58:40.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.916+0000 7fb45e7fc640 1 -- 172.21.15.171:0/557750038 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}]=0 device 'osd.9' does not appear in the crush map v88) ==== 145+0+0 (unknown 3969592234 0 0) 0x7fb46001df60 con 0x7fb4681c8b10 2024-04-25T23:58:40.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.916+0000 7fb45e7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "osd.9", "ancestor": "host2"}] 2024-04-25T23:58:40.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.916+0000 7fb45e7fc640 10 monclient: _finish_command 3 = system:0 device 'osd.9' does not appear in the crush map 2024-04-25T23:58:40.900 INFO:tasks.workunit.client.0.smithi171.stderr:device 'osd.9' does not appear in the crush map 2024-04-25T23:58:40.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 >> v1:172.21.15.171:6812/722422047 conn(0x7fb44c0376a0 legacy=0x7fb44c039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:40.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 10 monclient: shutdown 2024-04-25T23:58:40.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:40.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 >> v1:172.21.15.106:6789/0 conn(0x7fb4681c8b10 legacy=0x7fb4681d4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:40.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 shutdown_connections 2024-04-25T23:58:40.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 >> 172.21.15.171:0/557750038 conn(0x7fb4680a62d0 msgr2=0x7fb468135450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:40.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 shutdown_connections 2024-04-25T23:58:40.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:40.920+0000 7fb46faca640 1 -- 172.21.15.171:0/557750038 wait complete. 2024-04-25T23:58:40.918 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm host2 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient: get_monmap_and_config 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient: build_initial_monmap 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient: monmap: 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:41.056049+0000 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:41.056049+0000 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.036 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:41.037 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 1 Processor -- start 2024-04-25T23:58:41.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 1 -- start start 2024-04-25T23:58:41.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient: init 2024-04-25T23:58:41.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:41.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient: _add_conns ranks=[2,3,0,5,1,4,7,8,6] 2024-04-25T23:58:41.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient(hunting): picked mon.noname-b con 0x7f9d74135bb0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient(hunting): picked mon.noname-g con 0x7f9d741356f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient(hunting): picked mon.noname-a con 0x7f9d7413c130 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d740a1da0 con 0x7f9d7413c130 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d740a1fe0 con 0x7f9d74135bb0 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d74072720 con 0x7f9d741356f0 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient(hunting): authenticate will time out at 1171.762986s 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d78eb3640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f9d741356f0 0x7f9d7413aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38370/0 (socket says 172.21.15.171:38370) 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d78eb3640 1 -- 172.21.15.171:0/2895945133 learned_addr learned my addr 172.21.15.171:0/2895945133 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 690285761 0 0) 0x7f9d74072720 con 0x7f9d741356f0 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:41.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient(hunting): my global_id is 5718 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d60003530 con 0x7f9d741356f0 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 430112423 0 0) 0x7f9d60003530 con 0x7f9d741356f0 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 >> v1:172.21.15.106:6790/0 conn(0x7f9d74135bb0 legacy=0x7f9d74135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 >> v1:172.21.15.106:6789/0 conn(0x7f9d7413c130 legacy=0x7f9d7413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 monclient: found mon.noname-g 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d740a17f0 con 0x7f9d741356f0 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d680017c0 con 0x7f9d741356f0 2024-04-25T23:58:41.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: dump: 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.046 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 5 monclient: authenticate success, global_id 5718 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d680019d0 con 0x7f9d741356f0 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 1 -- 172.21.15.171:0/2895945133 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d68004bf0 con 0x7f9d741356f0 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d7b918640 4 set_mon_vals no callback set 2024-04-25T23:58:41.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.052+0000 7f9d67fff640 10 monclient: dump: 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.048 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: shutdown 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/2895945133 >> v1:172.21.15.171:6790/0 conn(0x7f9d741356f0 legacy=0x7f9d7413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/2895945133 shutdown_connections 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/2895945133 >> 172.21.15.171:0/2895945133 conn(0x7f9d740a2620 msgr2=0x7f9d740a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/2895945133 shutdown_connections 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/2895945133 wait complete. 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: build_initial_monmap 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: monmap: 2024-04-25T23:58:41.049 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:41.050 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 Processor -- start 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- start start 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: init 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _add_conns ranks=[3,6,7,8,2,1,5,4,0] 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient(hunting): picked mon.noname-g con 0x7f9d741356f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient(hunting): picked mon.noname-d con 0x7f9d74135bb0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient(hunting): picked mon.noname-i con 0x7f9d7413c130 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d741cb950 con 0x7f9d741356f0 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d7412f050 con 0x7f9d74135bb0 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d740719a0 con 0x7f9d7413c130 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient(hunting): authenticate will time out at 1171.766145s 2024-04-25T23:58:41.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d79eb5640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f9d7413c130 legacy=0x7f9d741d2d90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d796b4640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f9d741356f0 0x7f9d741cab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38378/0 (socket says 172.21.15.171:38378) 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d796b4640 1 -- 172.21.15.171:0/1505662730 learned_addr learned my addr 172.21.15.171:0/1505662730 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658805770 0 0) 0x7f9d741cb950 con 0x7f9d741356f0 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): my global_id is 5727 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d58003530 con 0x7f9d741356f0 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 961506121 0 0) 0x7f9d58003530 con 0x7f9d741356f0 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d741cb950 con 0x7f9d741356f0 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d70001b20 con 0x7f9d741356f0 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:41.052 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.053 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316026236 0 0) 0x7f9d7412f050 con 0x7f9d74135bb0 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient(hunting): my global_id is 5586 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d58003530 con 0x7f9d74135bb0 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4227018626 0 0) 0x7f9d741cb950 con 0x7f9d741356f0 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 >> v1:172.21.15.171:6792/0 conn(0x7f9d7413c130 legacy=0x7f9d741d2d90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 >> v1:172.21.15.106:6792/0 conn(0x7f9d74135bb0 legacy=0x7f9d741cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 monclient: found mon.g 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:41.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d74071ef0 con 0x7f9d741356f0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 5 monclient: authenticate success, global_id 5727 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _renew_subs 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d7412dc70 con 0x7f9d741356f0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _renew_subs 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d7412e740 con 0x7f9d741356f0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d70003950 con 0x7f9d741356f0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d70003ec0 con 0x7f9d741356f0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:41.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d677fe640 4 set_mon_vals no callback set 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 10 monclient: dump: 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.056 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d54005090 con 0x7f9d741356f0 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.056+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9d70004060 con 0x7f9d741356f0 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.060+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(88..88 src has 1..88) ==== 4926+0+0 (unknown 836353673 0 0) 0x7f9d70044b60 con 0x7f9d741356f0 2024-04-25T23:58:41.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.060+0000 7f9d78eb3640 10 monclient: get_auth_request con 0x7f9d58037860 auth_method 0 2024-04-25T23:58:41.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.064+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9d70015940 con 0x7f9d741356f0 2024-04-25T23:58:41.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.064+0000 7f9d65ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:41.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.064+0000 7f9d65ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:41.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.232+0000 7f9d7b918640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "host2"}] 2024-04-25T23:58:41.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.232+0000 7f9d7b918640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "host2"}] 2024-04-25T23:58:41.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.232+0000 7f9d7b918640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.232+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "host2"} v 0) -- 0x7f9d54005380 con 0x7f9d741356f0 2024-04-25T23:58:41.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.504+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "host2"}]=0 removed item id -16 name 'host2' from crush map v89) ==== 124+0+0 (unknown 2859863398 0 0) 0x7f9d70004430 con 0x7f9d741356f0 2024-04-25T23:58:41.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.504+0000 7f9d65ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "host2"}] 2024-04-25T23:58:41.489 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.504+0000 7f9d65ffb640 10 monclient: _finish_command 2 = system:0 removed item id -16 name 'host2' from crush map 2024-04-25T23:58:41.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.608+0000 7f9d7b918640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "host2"}] 2024-04-25T23:58:41.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.608+0000 7f9d7b918640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "host2"}] 2024-04-25T23:58:41.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.608+0000 7f9d7b918640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.593 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.608+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "host2"} v 0) -- 0x7f9d540010a0 con 0x7f9d741356f0 2024-04-25T23:58:41.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d65ffb640 1 -- 172.21.15.171:0/1505662730 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "host2"}]=0 device 'host2' does not appear in the crush map v89) ==== 124+0+0 (unknown 3135100058 0 0) 0x7f9d7001ddf0 con 0x7f9d741356f0 2024-04-25T23:58:41.594 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d65ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "host2"}] 2024-04-25T23:58:41.595 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d65ffb640 10 monclient: _finish_command 3 = system:0 device 'host2' does not appear in the crush map 2024-04-25T23:58:41.595 INFO:tasks.workunit.client.0.smithi171.stderr:device 'host2' does not appear in the crush map 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 >> v1:172.21.15.171:6812/722422047 conn(0x7f9d58037860 legacy=0x7f9d58039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 10 monclient: shutdown 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 >> v1:172.21.15.171:6790/0 conn(0x7f9d741356f0 legacy=0x7f9d741cab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 shutdown_connections 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 >> 172.21.15.171:0/1505662730 conn(0x7f9d740a2620 msgr2=0x7f9d7412c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 shutdown_connections 2024-04-25T23:58:41.597 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.612+0000 7f9d7b918640 1 -- 172.21.15.171:0/1505662730 wait complete. 2024-04-25T23:58:41.611 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket foo host 2024-04-25T23:58:41.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 10 monclient: get_monmap_and_config 2024-04-25T23:58:41.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 10 monclient: build_initial_monmap 2024-04-25T23:58:41.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 10 monclient: monmap: 2024-04-25T23:58:41.729 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:41.729 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.729 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:41.749078+0000 2024-04-25T23:58:41.729 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:41.749078+0000 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:41.730 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 1 Processor -- start 2024-04-25T23:58:41.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 1 -- start start 2024-04-25T23:58:41.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 10 monclient: init 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 10 monclient: _add_conns ranks=[1,3,2,7,8,5,0,4,6] 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.744+0000 7fae80ed9640 10 monclient(hunting): picked mon.noname-f con 0x7fae7c0a1530 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): picked mon.noname-g con 0x7fae7c0a2020 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): picked mon.noname-b con 0x7fae7c072540 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7c06ff90 con 0x7fae7c0a1530 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7c071270 con 0x7fae7c072540 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7a59c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fae7c0a1530 legacy=0x7fae7c0a1910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7c06fb20 con 0x7fae7c0a2020 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): authenticate will time out at 1172.456097s 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae79d9b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fae7c0a2020 0x7fae7c139b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38382/0 (socket says 172.21.15.171:38382) 2024-04-25T23:58:41.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae79d9b640 1 -- 172.21.15.171:0/2353273623 learned_addr learned my addr 172.21.15.171:0/2353273623 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 380207864 0 0) 0x7fae7c06fb20 con 0x7fae7c0a2020 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient(hunting): my global_id is 5736 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae64003530 con 0x7fae7c0a2020 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 869879768 0 0) 0x7fae64003530 con 0x7fae7c0a2020 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 >> v1:172.21.15.106:6790/0 conn(0x7fae7c072540 legacy=0x7fae7c13d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 >> v1:172.21.15.171:6789/0 conn(0x7fae7c0a1530 legacy=0x7fae7c0a1910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 monclient: found mon.noname-g 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:41.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c0a3100 con 0x7fae7c0a2020 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: _finish_auth 0 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae700017c0 con 0x7fae7c0a2020 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: dump: 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.740 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 5 monclient: authenticate success, global_id 5736 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae70001b20 con 0x7fae7c0a2020 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 1 -- 172.21.15.171:0/2353273623 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae70001d50 con 0x7fae7c0a2020 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 4 set_mon_vals no callback set 2024-04-25T23:58:41.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7959a640 10 monclient: dump: 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.742 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: shutdown 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- 172.21.15.171:0/2353273623 >> v1:172.21.15.171:6790/0 conn(0x7fae7c0a2020 legacy=0x7fae7c139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- 172.21.15.171:0/2353273623 shutdown_connections 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- 172.21.15.171:0/2353273623 >> 172.21.15.171:0/2353273623 conn(0x7fae7c0a62d0 msgr2=0x7fae7c0a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- 172.21.15.171:0/2353273623 shutdown_connections 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- 172.21.15.171:0/2353273623 wait complete. 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: build_initial_monmap 2024-04-25T23:58:41.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: monmap: 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:41.744 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 Processor -- start 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- start start 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: init 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: _add_conns ranks=[4,0,5,6,2,3,8,7,1] 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): picked mon.noname-c con 0x7fae7c072540 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): picked mon.noname-a con 0x7fae7c0a1530 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): picked mon.noname-h con 0x7fae7c0a2020 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7c0704f0 con 0x7fae7c0a1530 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7c132330 con 0x7fae7c072540 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7c137750 con 0x7fae7c0a2020 2024-04-25T23:58:41.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient(hunting): authenticate will time out at 1172.459065s 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7ad9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fae7c0a2020 0x7fae7c1d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42508/0 (socket says 172.21.15.171:42508) 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7ad9d640 1 -- 172.21.15.171:0/3883358280 learned_addr learned my addr 172.21.15.171:0/3883358280 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae7a59c640 1 -- 172.21.15.171:0/3883358280 >> v1:172.21.15.106:6791/0 conn(0x7fae7c072540 legacy=0x7fae7c13dcd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3615840234 0 0) 0x7fae7c137750 con 0x7fae7c0a2020 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): my global_id is 5495 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae5c003530 con 0x7fae7c0a2020 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 572695321 0 0) 0x7fae5c003530 con 0x7fae7c0a2020 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae7c137750 con 0x7fae7c0a2020 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae74001e20 con 0x7fae7c0a2020 2024-04-25T23:58:41.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): dump: 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.747 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880134959 0 0) 0x7fae7c0704f0 con 0x7fae7c0a1530 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient(hunting): my global_id is 5589 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae5c003530 con 0x7fae7c0a1530 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1641157392 0 0) 0x7fae7c137750 con 0x7fae7c0a2020 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 >> v1:172.21.15.106:6791/0 conn(0x7fae7c072540 legacy=0x7fae7c13dcd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 >> v1:172.21.15.106:6789/0 conn(0x7fae7c0a1530 legacy=0x7fae7c1cf180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:41.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 monclient: found mon.h 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7c1361e0 con 0x7fae7c0a2020 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient: _finish_auth 0 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 5 monclient: authenticate success, global_id 5495 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: _renew_subs 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.748+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae7c1c73b0 con 0x7fae7c0a2020 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae80ed9640 10 monclient: _renew_subs 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae80ed9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:41.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fae7c13e5b0 con 0x7fae7c0a2020 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae74003c90 con 0x7fae7c0a2020 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae74004200 con 0x7fae7c0a2020 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae78d99640 4 set_mon_vals no callback set 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 10 monclient: dump: 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:41.750 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae80ed9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae80ed9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae80ed9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae60005090 con 0x7fae7c0a2020 2024-04-25T23:58:41.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fae740043a0 con 0x7fae7c0a2020 2024-04-25T23:58:41.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(89..89 src has 1..89) ==== 4791+0+0 (unknown 1278772197 0 0) 0x7fae74044dd0 con 0x7fae7c0a2020 2024-04-25T23:58:41.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.752+0000 7fae7a59c640 10 monclient: get_auth_request con 0x7fae5c037850 auth_method 0 2024-04-25T23:58:41.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.756+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fae74015bf0 con 0x7fae7c0a2020 2024-04-25T23:58:41.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.756+0000 7fae6affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:41.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.756+0000 7fae6affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:41.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.920+0000 7fae80ed9640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}] 2024-04-25T23:58:41.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.920+0000 7fae80ed9640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}] 2024-04-25T23:58:41.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.920+0000 7fae80ed9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:41.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:41.920+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "foo", "type": "host"} v 0) -- 0x7fae60005b90 con 0x7fae7c0a2020 2024-04-25T23:58:42.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.832+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}]=0 added bucket foo type host to crush map v90) ==== 138+0+0 (unknown 594567323 0 0) 0x7fae740154f0 con 0x7fae7c0a2020 2024-04-25T23:58:42.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.832+0000 7fae6affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}] 2024-04-25T23:58:42.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.832+0000 7fae6affd640 10 monclient: _finish_command 2 = system:0 added bucket foo type host to crush map 2024-04-25T23:58:42.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.932+0000 7fae80ed9640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}] 2024-04-25T23:58:42.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.932+0000 7fae80ed9640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}] 2024-04-25T23:58:42.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.932+0000 7fae80ed9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:42.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.932+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "foo", "type": "host"} v 0) -- 0x7fae600010a0 con 0x7fae7c0a2020 2024-04-25T23:58:42.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae6affd640 1 -- 172.21.15.171:0/3883358280 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}]=0 bucket 'foo' already exists v90) ==== 126+0+0 (unknown 649693233 0 0) 0x7fae7401e0a0 con 0x7fae7c0a2020 2024-04-25T23:58:42.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae6affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "foo", "type": "host"}] 2024-04-25T23:58:42.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae6affd640 10 monclient: _finish_command 3 = system:0 bucket 'foo' already exists 2024-04-25T23:58:42.919 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'foo' already exists 2024-04-25T23:58:42.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 >> v1:172.21.15.171:6812/722422047 conn(0x7fae5c037850 legacy=0x7fae5c039d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:42.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 10 monclient: shutdown 2024-04-25T23:58:42.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:42.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 >> v1:172.21.15.171:6791/0 conn(0x7fae7c0a2020 legacy=0x7fae7c1d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:42.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 shutdown_connections 2024-04-25T23:58:42.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 >> 172.21.15.171:0/3883358280 conn(0x7fae7c0a62d0 msgr2=0x7fae7c06e410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:42.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 shutdown_connections 2024-04-25T23:58:42.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:42.936+0000 7fae80ed9640 1 -- 172.21.15.171:0/3883358280 wait complete. 2024-04-25T23:58:42.935 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush move foo root=default rack=localrack 2024-04-25T23:58:43.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient: get_monmap_and_config 2024-04-25T23:58:43.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient: build_initial_monmap 2024-04-25T23:58:43.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient: monmap: 2024-04-25T23:58:43.056 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:43.056 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:43.056 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:43.076316+0000 2024-04-25T23:58:43.056 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:43.076316+0000 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:43.057 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 1 Processor -- start 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 1 -- start start 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient: init 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient: _add_conns ranks=[7,0,3,4,1,8,6,5,2] 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient(hunting): picked mon.noname-i con 0x7f854c09d3b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient(hunting): picked mon.noname-a con 0x7f854c09d790 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:43.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient(hunting): picked mon.noname-g con 0x7f854c09dbf0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c06bdf0 con 0x7f854c09d790 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c0a1140 con 0x7f854c09dbf0 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c0a0810 con 0x7f854c09d3b0 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f855456c640 10 monclient(hunting): authenticate will time out at 1173.783980s 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.072+0000 7f8552308640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f854c09d3b0 legacy=0x7f854c135a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8552b09640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f854c09dbf0 0x7f854c13e030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38390/0 (socket says 172.21.15.171:38390) 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8552b09640 1 -- 172.21.15.171:0/3607013833 learned_addr learned my addr 172.21.15.171:0/3607013833 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4121895435 0 0) 0x7f854c0a1140 con 0x7f854c09dbf0 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient(hunting): _negotiate 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:43.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient(hunting): my global_id is 5745 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8538003530 con 0x7f854c09dbf0 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1722041604 0 0) 0x7f8538003530 con 0x7f854c09dbf0 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 >> v1:172.21.15.171:6792/0 conn(0x7f854c09d3b0 legacy=0x7f854c135a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 >> v1:172.21.15.106:6789/0 conn(0x7f854c09d790 legacy=0x7f854c13a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: _finish_hunting 0 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 monclient: found mon.noname-g 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c0a4110 con 0x7f854c09dbf0 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: _finish_auth 0 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: _check_auth_tickets 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8544001b40 con 0x7f854c09dbf0 2024-04-25T23:58:43.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: dump: 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:43.068 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 5 monclient: authenticate success, global_id 5745 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8544001ea0 con 0x7f854c09dbf0 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 1 -- 172.21.15.171:0/3607013833 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f85440020d0 con 0x7f854c09dbf0 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8551306640 10 monclient: dump: 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.069 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 4 set_mon_vals no callback set 2024-04-25T23:58:43.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient: shutdown 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- 172.21.15.171:0/3607013833 >> v1:172.21.15.171:6790/0 conn(0x7f854c09dbf0 legacy=0x7f854c13e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- 172.21.15.171:0/3607013833 shutdown_connections 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- 172.21.15.171:0/3607013833 >> 172.21.15.171:0/3607013833 conn(0x7f854c0a72a0 msgr2=0x7f854c0a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- 172.21.15.171:0/3607013833 shutdown_connections 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- 172.21.15.171:0/3607013833 wait complete. 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient: build_initial_monmap 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient: monmap: 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:43.071 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 Processor -- start 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- start start 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient: init 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:43.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient: _add_conns ranks=[0,6,4,3,1,5,2,7,8] 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient(hunting): picked mon.noname-a con 0x7f854c09d3b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient(hunting): picked mon.noname-d con 0x7f854c09d790 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient(hunting): picked mon.noname-c con 0x7f854c09dbf0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c13dfb0 con 0x7f854c09d3b0 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c11eb30 con 0x7f854c09dbf0 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f854c1cd780 con 0x7f854c09d790 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f855456c640 10 monclient(hunting): authenticate will time out at 1173.786984s 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8552b09640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f854c09dbf0 legacy=0x7f854c1d4bc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8552308640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f854c09d3b0 0x7f854c1cc960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:49562/0 (socket says 172.21.15.171:49562) 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8552308640 1 -- 172.21.15.171:0/2483928888 learned_addr learned my addr 172.21.15.171:0/2483928888 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197208358 0 0) 0x7f854c13dfb0 con 0x7f854c09d3b0 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:43.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): my global_id is 5607 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8530003530 con 0x7f854c09d3b0 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302355549 0 0) 0x7f854c1cd780 con 0x7f854c09d790 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 10 monclient(hunting): my global_id is 5595 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.076+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f854c13dfb0 con 0x7f854c09d790 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1790309945 0 0) 0x7f8530003530 con 0x7f854c09d3b0 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f854c1cd780 con 0x7f854c09d3b0 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8548004300 con 0x7f854c09d3b0 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:43.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:43.075 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 745083257 0 0) 0x7f854c13dfb0 con 0x7f854c09d790 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8530003530 con 0x7f854c09d790 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f853c0019e0 con 0x7f854c09d790 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:43.076 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1416513321 0 0) 0x7f854c1cd780 con 0x7f854c09d3b0 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 >> v1:172.21.15.106:6792/0 conn(0x7f854c09d790 legacy=0x7f854c1cd070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 >> v1:172.21.15.106:6791/0 conn(0x7f854c09dbf0 legacy=0x7f854c1d4bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:43.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 monclient: found mon.a 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854c13e450 con 0x7f854c09d3b0 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 5 monclient: authenticate success, global_id 5607 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 10 monclient: _renew_subs 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f854c135800 con 0x7f854c09d3b0 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 10 monclient: _renew_subs 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:43.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f854c11e850 con 0x7f854c09d3b0 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8548004620 con 0x7f854c09d3b0 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8548004b90 con 0x7f854c09d3b0 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8550b05640 4 set_mon_vals no callback set 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 10 monclient: dump: 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:43.079 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8534005090 con 0x7f854c09d3b0 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8548004db0 con 0x7f854c09d3b0 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(90..90 src has 1..90) ==== 4818+0+0 (unknown 3225470568 0 0) 0x7f85480449b0 con 0x7f854c09d3b0 2024-04-25T23:58:43.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.080+0000 7f8551b07640 10 monclient: get_auth_request con 0x7f8530037e00 auth_method 0 2024-04-25T23:58:43.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.092+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f85480157b0 con 0x7f854c09d3b0 2024-04-25T23:58:43.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.092+0000 7f8542ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:43.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.092+0000 7f8542ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:43.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.260+0000 7f855456c640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}] 2024-04-25T23:58:43.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.260+0000 7f855456c640 10 monclient: _send_command 2 [{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}] 2024-04-25T23:58:43.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.260+0000 7f855456c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:43.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.260+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]} v 0) -- 0x7f8534005380 con 0x7f854c09d3b0 2024-04-25T23:58:43.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.852+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}]=0 moved item id -10 name 'foo' to location {rack=localrack,root=default} in crush map v91) ==== 204+0+0 (unknown 4155545540 0 0) 0x7f85480150b0 con 0x7f854c09d3b0 2024-04-25T23:58:43.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.852+0000 7f8542ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}] 2024-04-25T23:58:43.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.852+0000 7f8542ffd640 10 monclient: _finish_command 2 = system:0 moved item id -10 name 'foo' to location {rack=localrack,root=default} in crush map 2024-04-25T23:58:43.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.956+0000 7f855456c640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}] 2024-04-25T23:58:43.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.956+0000 7f855456c640 10 monclient: _send_command 3 [{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}] 2024-04-25T23:58:43.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.956+0000 7f855456c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:43.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.956+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]} v 0) -- 0x7f8534005ac0 con 0x7f854c09d3b0 2024-04-25T23:58:43.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f8542ffd640 1 -- 172.21.15.171:0/2483928888 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}]=0 no need to move item id -10 name 'foo' to location {rack=localrack,root=default} in crush map v91) ==== 214+0+0 (unknown 2937457940 0 0) 0x7f8548040a20 con 0x7f854c09d3b0 2024-04-25T23:58:43.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f8542ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush move", "name": "foo", "args": ["root=default", "rack=localrack"]}] 2024-04-25T23:58:43.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f8542ffd640 10 monclient: _finish_command 3 = system:0 no need to move item id -10 name 'foo' to location {rack=localrack,root=default} in crush map 2024-04-25T23:58:43.942 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -10 name 'foo' to location {rack=localrack,root=default} in crush map 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 >> v1:172.21.15.171:6812/722422047 conn(0x7f8530037e00 legacy=0x7f853003a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 10 monclient: shutdown 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 >> v1:172.21.15.106:6789/0 conn(0x7f854c09d3b0 legacy=0x7f854c1cc960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 shutdown_connections 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 >> 172.21.15.171:0/2483928888 conn(0x7f854c0a72a0 msgr2=0x7f854c13efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 shutdown_connections 2024-04-25T23:58:43.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:43.960+0000 7f855456c640 1 -- 172.21.15.171:0/2483928888 wait complete. 2024-04-25T23:58:43.959 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush create-or-move osd.7 1.0 root=default 2024-04-25T23:58:44.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.092+0000 7f3f55eef640 10 monclient: get_monmap_and_config 2024-04-25T23:58:44.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.092+0000 7f3f55eef640 10 monclient: build_initial_monmap 2024-04-25T23:58:44.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.092+0000 7f3f55eef640 10 monclient: monmap: 2024-04-25T23:58:44.078 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:44.098385+0000 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:44.098385+0000 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:44.079 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:44.080 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:44.080 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:44.080 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:44.080 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 Processor -- start 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- start start 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: init 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: _add_conns ranks=[3,2,6,7,0,1,8,4,5] 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient(hunting): picked mon.noname-g con 0x7f3f5006bae0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient(hunting): picked mon.noname-b con 0x7f3f50070f20 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient(hunting): picked mon.noname-d con 0x7f3f500a1b70 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f500723d0 con 0x7f3f50070f20 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f500a0000 con 0x7f3f5006bae0 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f500726b0 con 0x7f3f500a1b70 2024-04-25T23:58:44.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient(hunting): authenticate will time out at 1174.805479s 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4f7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f3f5006bae0 0x7f3f500a1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38392/0 (socket says 172.21.15.171:38392) 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4f7fe640 1 -- 172.21.15.171:0/3084351019 learned_addr learned my addr 172.21.15.171:0/3084351019 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674359161 0 0) 0x7f3f500a0000 con 0x7f3f5006bae0 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient(hunting): my global_id is 5754 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f38003530 con 0x7f3f5006bae0 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3680355013 0 0) 0x7f3f38003530 con 0x7f3f5006bae0 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 >> v1:172.21.15.106:6792/0 conn(0x7f3f500a1b70 legacy=0x7f3f5013dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 >> v1:172.21.15.106:6790/0 conn(0x7f3f50070f20 legacy=0x7f3f5013a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:44.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 monclient: found mon.noname-g 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5009f940 con 0x7f3f5006bae0 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3f400017c0 con 0x7f3f5006bae0 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: dump: 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.088 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 5 monclient: authenticate success, global_id 5754 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f40001ab0 con 0x7f3f5006bae0 2024-04-25T23:58:44.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 4 set_mon_vals no callback set 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 1 -- 172.21.15.171:0/3084351019 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3f40004bf0 con 0x7f3f5006bae0 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f4e7fc640 10 monclient: dump: 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:44.090 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: shutdown 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- 172.21.15.171:0/3084351019 >> v1:172.21.15.171:6790/0 conn(0x7f3f5006bae0 legacy=0x7f3f500a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- 172.21.15.171:0/3084351019 shutdown_connections 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- 172.21.15.171:0/3084351019 >> 172.21.15.171:0/3084351019 conn(0x7f3f500a5140 msgr2=0x7f3f5006b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- 172.21.15.171:0/3084351019 shutdown_connections 2024-04-25T23:58:44.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- 172.21.15.171:0/3084351019 wait complete. 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: build_initial_monmap 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: monmap: 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:44.092 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 Processor -- start 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 1 -- start start 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.096+0000 7f3f55eef640 10 monclient: init 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _add_conns ranks=[6,3,0,2,8,1,5,4,7] 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient(hunting): picked mon.noname-d con 0x7f3f5006bae0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient(hunting): picked mon.noname-g con 0x7f3f50070f20 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient(hunting): picked mon.noname-a con 0x7f3f500a1b70 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f50128000 con 0x7f3f500a1b70 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f500a1230 con 0x7f3f50070f20 2024-04-25T23:58:44.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f5006ee30 con 0x7f3f5006bae0 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient(hunting): authenticate will time out at 1174.808435s 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f4effd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f3f50070f20 0x7f3f5006d870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38404/0 (socket says 172.21.15.171:38404) 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f4effd640 1 -- 172.21.15.171:0/2067733423 learned_addr learned my addr 172.21.15.171:0/2067733423 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4041281033 0 0) 0x7f3f500a1230 con 0x7f3f50070f20 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): my global_id is 5763 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f3c003530 con 0x7f3f50070f20 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 975249665 0 0) 0x7f3f3c003530 con 0x7f3f50070f20 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f500a1230 con 0x7f3f50070f20 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3f44001a60 con 0x7f3f50070f20 2024-04-25T23:58:44.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): dump: 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:44.095 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1703493704 0 0) 0x7f3f5006ee30 con 0x7f3f5006bae0 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient(hunting): my global_id is 5613 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f3c003530 con 0x7f3f5006bae0 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 417232562 0 0) 0x7f3f500a1230 con 0x7f3f50070f20 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 >> v1:172.21.15.106:6792/0 conn(0x7f3f5006bae0 legacy=0x7f3f5006d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 >> v1:172.21.15.106:6789/0 conn(0x7f3f500a1b70 legacy=0x7f3f501d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:44.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 monclient: found mon.g 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f5006df80 con 0x7f3f50070f20 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: _finish_auth 0 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 5 monclient: authenticate success, global_id 5763 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _renew_subs 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3f50127760 con 0x7f3f50070f20 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _renew_subs 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3f50126870 con 0x7f3f50070f20 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3f44003950 con 0x7f3f50070f20 2024-04-25T23:58:44.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3f44003e40 con 0x7f3f50070f20 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f4dffb640 4 set_mon_vals no callback set 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 10 monclient: dump: 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:44.098 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f30005090 con 0x7f3f50070f20 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3f44004060 con 0x7f3f50070f20 2024-04-25T23:58:44.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(91..91 src has 1..91) ==== 5115+0+0 (unknown 2993070471 0 0) 0x7f3f44044ba0 con 0x7f3f50070f20 2024-04-25T23:58:44.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.100+0000 7f3f4f7fe640 10 monclient: get_auth_request con 0x7f3f3c0377f0 auth_method 0 2024-04-25T23:58:44.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.104+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3f500723d0 con 0x7f3f50070f20 2024-04-25T23:58:44.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.104+0000 7f3f37fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:44.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.104+0000 7f3f37fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:44.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.272+0000 7f3f55eef640 10 start_mon_command cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}] 2024-04-25T23:58:44.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.272+0000 7f3f55eef640 10 monclient: _send_command 2 [{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}] 2024-04-25T23:58:44.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.272+0000 7f3f55eef640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:44.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.272+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]} v 0) -- 0x7f3f30005380 con 0x7f3f50070f20 2024-04-25T23:58:44.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.864+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}]=0 create-or-move updating item name 'osd.7' weight 1 at location {root=default} to crush map v92) ==== 212+0+0 (unknown 1664048716 0 0) 0x7f3f440158e0 con 0x7f3f50070f20 2024-04-25T23:58:44.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.864+0000 7f3f37fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}] 2024-04-25T23:58:44.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.864+0000 7f3f37fff640 10 monclient: _finish_command 2 = system:0 create-or-move updating item name 'osd.7' weight 1 at location {root=default} to crush map 2024-04-25T23:58:44.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.968+0000 7f3f55eef640 10 start_mon_command cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}] 2024-04-25T23:58:44.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.968+0000 7f3f55eef640 10 monclient: _send_command 3 [{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}] 2024-04-25T23:58:44.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.968+0000 7f3f55eef640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:44.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.968+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]} v 0) -- 0x7f3f30005c50 con 0x7f3f50070f20 2024-04-25T23:58:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.968+0000 7f3f37fff640 1 -- 172.21.15.171:0/2067733423 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}]=0 create-or-move updated item name 'osd.7' weight 1 at location {root=default} to crush map v92) ==== 211+0+0 (unknown 1804632995 0 0) 0x7f3f440151e0 con 0x7f3f50070f20 2024-04-25T23:58:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.968+0000 7f3f37fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush create-or-move", "id": 7, "weight": 1.0, "args": ["root=default"]}] 2024-04-25T23:58:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.968+0000 7f3f37fff640 10 monclient: _finish_command 3 = system:0 create-or-move updated item name 'osd.7' weight 1 at location {root=default} to crush map 2024-04-25T23:58:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:create-or-move updated item name 'osd.7' weight 1 at location {root=default} to crush map 2024-04-25T23:58:44.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 >> v1:172.21.15.171:6812/722422047 conn(0x7f3f3c0377f0 legacy=0x7f3f3c039cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:44.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 10 monclient: shutdown 2024-04-25T23:58:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 >> v1:172.21.15.171:6790/0 conn(0x7f3f50070f20 legacy=0x7f3f5006d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 shutdown_connections 2024-04-25T23:58:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 >> 172.21.15.171:0/2067733423 conn(0x7f3f500a5140 msgr2=0x7f3f500a6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 shutdown_connections 2024-04-25T23:58:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:44.972+0000 7f3f55eef640 1 -- 172.21.15.171:0/2067733423 wait complete. 2024-04-25T23:58:44.970 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush move osd.7 host=foo 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient: get_monmap_and_config 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient: build_initial_monmap 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient: monmap: 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:45.109018+0000 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:45.109018+0000 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:45.090 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:45.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 1 Processor -- start 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 1 -- start start 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient: init 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient: _add_conns ranks=[0,5,1,2,8,7,3,6,4] 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient(hunting): picked mon.noname-a con 0x7f3c180a1530 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient(hunting): picked mon.noname-h con 0x7f3c18071c00 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient(hunting): picked mon.noname-f con 0x7f3c18071730 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1806ea70 con 0x7f3c180a1530 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c180723d0 con 0x7f3c18071730 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c18072990 con 0x7f3c18071c00 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c1c85e640 10 monclient(hunting): authenticate will time out at 1175.815929s 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.104+0000 7f3c16d9d640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f3c18071730 legacy=0x7f3c1813e2c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0ffff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f3c18071c00 0x7f3c1813ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42514/0 (socket says 172.21.15.171:42514) 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0ffff640 1 -- 172.21.15.171:0/3117827271 learned_addr learned my addr 172.21.15.171:0/3117827271 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487624668 0 0) 0x7f3c18072990 con 0x7f3c18071c00 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient(hunting): my global_id is 5504 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c04003530 con 0x7f3c18071c00 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1870679682 0 0) 0x7f3c04003530 con 0x7f3c18071c00 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 >> v1:172.21.15.171:6789/0 conn(0x7f3c18071730 legacy=0x7f3c1813e2c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 >> v1:172.21.15.106:6789/0 conn(0x7f3c180a1530 legacy=0x7f3c180a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 monclient: found mon.noname-h 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c180a3100 con 0x7f3c18071c00 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: _finish_auth 0 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 5 monclient: authenticate success, global_id 5504 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3c000017c0 con 0x7f3c18071c00 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: dump: 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:45.100 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c00001b20 con 0x7f3c18071c00 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 1 -- 172.21.15.171:0/3117827271 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3c00001d50 con 0x7f3c18071c00 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c15d9b640 10 monclient: dump: 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 4 set_mon_vals no callback set 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient: shutdown 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- 172.21.15.171:0/3117827271 >> v1:172.21.15.171:6791/0 conn(0x7f3c18071c00 legacy=0x7f3c1813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- 172.21.15.171:0/3117827271 shutdown_connections 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- 172.21.15.171:0/3117827271 >> 172.21.15.171:0/3117827271 conn(0x7f3c180a62d0 msgr2=0x7f3c180a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- 172.21.15.171:0/3117827271 shutdown_connections 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- 172.21.15.171:0/3117827271 wait complete. 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient: build_initial_monmap 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient: monmap: 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:45.104 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 Processor -- start 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- start start 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient: init 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient: _add_conns ranks=[2,0,8,5,7,6,3,1,4] 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient(hunting): picked mon.noname-b con 0x7f3c18071730 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient(hunting): picked mon.noname-a con 0x7f3c18071c00 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient(hunting): picked mon.noname-e con 0x7f3c180a1530 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1809f660 con 0x7f3c18071c00 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c1809fb20 con 0x7f3c18071730 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c181bb8e0 con 0x7f3c180a1530 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c1c85e640 10 monclient(hunting): authenticate will time out at 1175.819082s 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c16d9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f3c180a1530 legacy=0x7f3c181d4640 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3c18071c00 0x7f3c181311e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:49584/0 (socket says 172.21.15.171:49584) 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0ffff640 1 -- 172.21.15.171:0/2927404456 learned_addr learned my addr 172.21.15.171:0/2927404456 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873438589 0 0) 0x7f3c1809f660 con 0x7f3c18071c00 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 10 monclient(hunting): my global_id is 5634 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf8003530 con 0x7f3c18071c00 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3527380841 0 0) 0x7f3c1809fb20 con 0x7f3c18071730 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.108+0000 7f3c0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): my global_id is 5546 2024-04-25T23:58:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c1809f660 con 0x7f3c18071730 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1261887933 0 0) 0x7f3bf8003530 con 0x7f3c18071c00 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c1809fb20 con 0x7f3c18071c00 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3c00001780 con 0x7f3c18071c00 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): dump: 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3472414182 0 0) 0x7f3c1809f660 con 0x7f3c18071730 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3bf8003530 con 0x7f3c18071730 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3c080019e0 con 0x7f3c18071730 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient(hunting): dump: 2024-04-25T23:58:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4019509546 0 0) 0x7f3c1809fb20 con 0x7f3c18071c00 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 >> v1:172.21.15.106:6793/0 conn(0x7f3c180a1530 legacy=0x7f3c181d4640 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 >> v1:172.21.15.106:6790/0 conn(0x7f3c18071730 legacy=0x7f3c181cc2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 monclient: found mon.a 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c1811e300 con 0x7f3c18071c00 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: _finish_auth 0 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 5 monclient: authenticate success, global_id 5634 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 10 monclient: _renew_subs 2024-04-25T23:58:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c181318f0 con 0x7f3c18071c00 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 10 monclient: _renew_subs 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c1811d5e0 con 0x7f3c18071c00 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3c00001b20 con 0x7f3c18071c00 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1559a640 4 set_mon_vals no callback set 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3c00001090 con 0x7f3c18071c00 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 10 monclient: dump: 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bfc005090 con 0x7f3c18071c00 2024-04-25T23:58:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3c0000ff50 con 0x7f3c18071c00 2024-04-25T23:58:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(92..92 src has 1..92) ==== 5136+0+0 (unknown 3527973260 0 0) 0x7f3c00044a20 con 0x7f3c18071c00 2024-04-25T23:58:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.112+0000 7f3c1659c640 10 monclient: get_auth_request con 0x7f3bf8037d80 auth_method 0 2024-04-25T23:58:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.124+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3c00015910 con 0x7f3c18071c00 2024-04-25T23:58:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.124+0000 7f3c0effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.124+0000 7f3c0effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:45.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.288+0000 7f3c1c85e640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}] 2024-04-25T23:58:45.273 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.288+0000 7f3c1c85e640 10 monclient: _send_command 2 [{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}] 2024-04-25T23:58:45.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.288+0000 7f3c1c85e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:45.274 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.288+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]} v 0) -- 0x7f3bfc005b90 con 0x7f3c18071c00 2024-04-25T23:58:45.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.856+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}]=0 moved item id 7 name 'osd.7' to location {host=foo} in crush map v93) ==== 165+0+0 (unknown 3659678019 0 0) 0x7f3c00015210 con 0x7f3c18071c00 2024-04-25T23:58:45.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.856+0000 7f3c0effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}] 2024-04-25T23:58:45.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.856+0000 7f3c0effd640 10 monclient: _finish_command 2 = system:0 moved item id 7 name 'osd.7' to location {host=foo} in crush map 2024-04-25T23:58:45.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.964+0000 7f3c1c85e640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}] 2024-04-25T23:58:45.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.964+0000 7f3c1c85e640 10 monclient: _send_command 3 [{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}] 2024-04-25T23:58:45.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.964+0000 7f3c1c85e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:58:45.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.964+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]} v 0) -- 0x7f3bfc005610 con 0x7f3c18071c00 2024-04-25T23:58:45.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c0effd640 1 -- 172.21.15.171:0/2927404456 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}]=0 no need to move item id 7 name 'osd.7' to location {host=foo} in crush map v93) ==== 175+0+0 (unknown 1215489785 0 0) 0x7f3c00040ac0 con 0x7f3c18071c00 2024-04-25T23:58:45.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c0effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush move", "name": "osd.7", "args": ["host=foo"]}] 2024-04-25T23:58:45.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c0effd640 10 monclient: _finish_command 3 = system:0 no need to move item id 7 name 'osd.7' to location {host=foo} in crush map 2024-04-25T23:58:45.951 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id 7 name 'osd.7' to location {host=foo} in crush map 2024-04-25T23:58:45.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 >> v1:172.21.15.171:6812/722422047 conn(0x7f3bf8037d80 legacy=0x7f3bf803a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:45.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 10 monclient: shutdown 2024-04-25T23:58:45.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:45.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 >> v1:172.21.15.106:6789/0 conn(0x7f3c18071c00 legacy=0x7f3c181311e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:45.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 shutdown_connections 2024-04-25T23:58:45.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 >> 172.21.15.171:0/2927404456 conn(0x7f3c180a62d0 msgr2=0x7f3c180a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:45.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 shutdown_connections 2024-04-25T23:58:45.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:45.968+0000 7f3c1c85e640 1 -- 172.21.15.171:0/2927404456 wait complete. 2024-04-25T23:58:45.968 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd find osd.7 2024-04-25T23:58:45.968 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep host 2024-04-25T23:58:45.968 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep foo 2024-04-25T23:58:46.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.096+0000 7f59a91fa640 10 monclient: get_monmap_and_config 2024-04-25T23:58:46.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.096+0000 7f59a91fa640 10 monclient: build_initial_monmap 2024-04-25T23:58:46.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.096+0000 7f59a91fa640 10 monclient: monmap: 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:46.101544+0000 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:46.101544+0000 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:46.082 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:46.083 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:46.083 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:46.083 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.096+0000 7f59a91fa640 1 Processor -- start 2024-04-25T23:58:46.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.096+0000 7f59a91fa640 1 -- start start 2024-04-25T23:58:46.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.096+0000 7f59a91fa640 10 monclient: init 2024-04-25T23:58:46.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:46.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: _add_conns ranks=[3,8,0,4,6,2,1,5,7] 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): picked mon.noname-g con 0x7f59a4136ca0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): picked mon.noname-e con 0x7f59a40a4ba0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): picked mon.noname-a con 0x7f59a413e480 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a409f680 con 0x7f59a413e480 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a409f960 con 0x7f59a4136ca0 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a409fc40 con 0x7f59a40a4ba0 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): authenticate will time out at 1176.808527s 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a2d9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f59a4136ca0 0x7f59a4137080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38412/0 (socket says 172.21.15.171:38412) 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a2d9d640 1 -- 172.21.15.171:0/379081093 learned_addr learned my addr 172.21.15.171:0/379081093 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a259c640 1 -- 172.21.15.171:0/379081093 >> v1:172.21.15.106:6793/0 conn(0x7f59a40a4ba0 legacy=0x7f59a413cd60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144735307 0 0) 0x7f59a409f960 con 0x7f59a4136ca0 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:58:46.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient(hunting): my global_id is 5772 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f598c003530 con 0x7f59a4136ca0 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 699310050 0 0) 0x7f598c003530 con 0x7f59a4136ca0 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 >> v1:172.21.15.106:6793/0 conn(0x7f59a40a4ba0 legacy=0x7f59a413cd60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 >> v1:172.21.15.106:6789/0 conn(0x7f59a413e480 legacy=0x7f59a4140870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 monclient: found mon.noname-g 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a4137790 con 0x7f59a4136ca0 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: _finish_auth 0 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:58:46.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59940017c0 con 0x7f59a4136ca0 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: dump: 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.093 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 5 monclient: authenticate success, global_id 5772 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5994001ab0 con 0x7f59a4136ca0 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 1 -- 172.21.15.171:0/379081093 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5994004bf0 con 0x7f59a4136ca0 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a1d9b640 10 monclient: dump: 2024-04-25T23:58:46.094 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 4 set_mon_vals no callback set 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: shutdown 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- 172.21.15.171:0/379081093 >> v1:172.21.15.171:6790/0 conn(0x7f59a4136ca0 legacy=0x7f59a4137080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- 172.21.15.171:0/379081093 shutdown_connections 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- 172.21.15.171:0/379081093 >> 172.21.15.171:0/379081093 conn(0x7f59a40a70a0 msgr2=0x7f59a40a74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- 172.21.15.171:0/379081093 shutdown_connections 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- 172.21.15.171:0/379081093 wait complete. 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: build_initial_monmap 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: monmap: 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:46.096 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 Processor -- start 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- start start 2024-04-25T23:58:46.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: init 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient: _add_conns ranks=[3,4,5,6,2,0,8,7,1] 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): picked mon.noname-g con 0x7f59a40a4ba0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): picked mon.noname-c con 0x7f59a4136ca0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): picked mon.noname-h con 0x7f59a413e480 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a40a23c0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a409de50 con 0x7f59a4136ca0 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59a40a3770 con 0x7f59a413e480 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a91fa640 10 monclient(hunting): authenticate will time out at 1176.811625s 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a2d9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f59a40a4ba0 0x7f59a40a15a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38422/0 (socket says 172.21.15.171:38422) 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a259c640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f59a4136ca0 legacy=0x7f59a40a1cb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f59a2d9d640 1 -- 172.21.15.171:0/945459083 learned_addr learned my addr 172.21.15.171:0/945459083 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:46.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455495826 0 0) 0x7f59a40a23c0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): my global_id is 5781 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5990003530 con 0x7f59a40a4ba0 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193051233 0 0) 0x7f59a40a3770 con 0x7f59a413e480 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 10 monclient(hunting): my global_id is 5513 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.100+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59a40a23c0 con 0x7f59a413e480 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2190013102 0 0) 0x7f5990003530 con 0x7f59a40a4ba0 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59a40a3770 con 0x7f59a40a4ba0 2024-04-25T23:58:46.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5994004b30 con 0x7f59a40a4ba0 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient(hunting): dump: 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.100 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 333201751 0 0) 0x7f59a40a23c0 con 0x7f59a413e480 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5990003530 con 0x7f59a413e480 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f599c001c80 con 0x7f59a413e480 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient(hunting): dump: 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.101 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3683463220 0 0) 0x7f59a40a3770 con 0x7f59a40a4ba0 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 >> v1:172.21.15.171:6791/0 conn(0x7f59a413e480 legacy=0x7f59a41d4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 >> v1:172.21.15.106:6791/0 conn(0x7f59a4136ca0 legacy=0x7f59a40a1cb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 monclient: found mon.g 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a40a2930 con 0x7f59a40a4ba0 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 5 monclient: authenticate success, global_id 5781 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 10 monclient: _renew_subs 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59a4135a00 con 0x7f59a40a4ba0 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 10 monclient: _renew_subs 2024-04-25T23:58:46.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f59a41d62b0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5994001ab0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5994001ce0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a159a640 4 set_mon_vals no callback set 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 10 monclient: dump: 2024-04-25T23:58:46.104 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.105 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5984005090 con 0x7f59a40a4ba0 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f59940100e0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(93..93 src has 1..93) ==== 5310+0+0 (unknown 1778834146 0 0) 0x7f5994044d70 con 0x7f59a40a4ba0 2024-04-25T23:58:46.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.104+0000 7f59a259c640 10 monclient: get_auth_request con 0x7f5990037dc0 auth_method 0 2024-04-25T23:58:46.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.108+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5994015a50 con 0x7f59a40a4ba0 2024-04-25T23:58:46.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.108+0000 7f598b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:46.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.108+0000 7f598b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:46.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.256+0000 7f59a91fa640 10 start_mon_command cmd=[{"prefix": "osd find", "id": 7}] 2024-04-25T23:58:46.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.256+0000 7f59a91fa640 10 monclient: _send_command 2 [{"prefix": "osd find", "id": 7}] 2024-04-25T23:58:46.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.256+0000 7f59a91fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:46.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.256+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd find", "id": 7} v 0) -- 0x7f5984005380 con 0x7f59a40a4ba0 2024-04-25T23:58:46.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.256+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd find", "id": 7}]=0 v93) ==== 65+0+226 (unknown 755703350 0 2157906930) 0x7f5994015350 con 0x7f59a40a4ba0 2024-04-25T23:58:46.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.256+0000 7f598b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd find", "id": 7}] 2024-04-25T23:58:46.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.256+0000 7f598b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:46.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.344+0000 7f59a91fa640 10 start_mon_command cmd=[{"prefix": "osd find", "id": 7}] 2024-04-25T23:58:46.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.344+0000 7f59a91fa640 10 monclient: _send_command 3 [{"prefix": "osd find", "id": 7}] 2024-04-25T23:58:46.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.344+0000 7f59a91fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:46.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.344+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd find", "id": 7} v 0) -- 0x7f5984000bd0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.344+0000 7f598b7fe640 1 -- 172.21.15.171:0/945459083 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd find", "id": 7}]=0 v93) ==== 65+0+226 (unknown 755703350 0 2157906930) 0x7f59940136b0 con 0x7f59a40a4ba0 2024-04-25T23:58:46.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.344+0000 7f598b7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd find", "id": 7}] 2024-04-25T23:58:46.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.344+0000 7f598b7fe640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:46.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 >> v1:172.21.15.171:6812/722422047 conn(0x7f5990037dc0 legacy=0x7f599003a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 10 monclient: shutdown 2024-04-25T23:58:46.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:46.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 >> v1:172.21.15.171:6790/0 conn(0x7f59a40a4ba0 legacy=0x7f59a40a15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 shutdown_connections 2024-04-25T23:58:46.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 >> 172.21.15.171:0/945459083 conn(0x7f59a40a70a0 msgr2=0x7f59a40a8be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:46.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 shutdown_connections 2024-04-25T23:58:46.332 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.348+0000 7f59a91fa640 1 -- 172.21.15.171:0/945459083 wait complete. 2024-04-25T23:58:46.345 INFO:tasks.workunit.client.0.smithi171.stdout: "host": "foo", 2024-04-25T23:58:46.345 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm osd.7 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.476+0000 7fedc6df0640 10 monclient: get_monmap_and_config 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.476+0000 7fedc6df0640 10 monclient: build_initial_monmap 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.476+0000 7fedc6df0640 10 monclient: monmap: 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:46.481094+0000 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:46.481094+0000 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:46.461 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:46.462 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.470 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.476+0000 7fedc6df0640 1 Processor -- start 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.476+0000 7fedc6df0640 1 -- start start 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.476+0000 7fedc6df0640 10 monclient: init 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient: _add_conns ranks=[2,8,0,5,6,7,4,3,1] 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient(hunting): picked mon.noname-b con 0x7fedc00a1610 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient(hunting): picked mon.noname-e con 0x7fedc0135c00 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient(hunting): picked mon.noname-a con 0x7fedc0136070 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc0072740 con 0x7fedc0136070 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc0072a20 con 0x7fedc00a1610 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc0072d00 con 0x7fedc0135c00 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient(hunting): authenticate will time out at 1177.188468s 2024-04-25T23:58:46.471 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbffff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fedc0135c00 legacy=0x7fedc013a980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc538d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fedc0136070 0x7fedc013e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:49612/0 (socket says 172.21.15.171:49612) 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc538d640 1 -- 172.21.15.171:0/1078566965 learned_addr learned my addr 172.21.15.171:0/1078566965 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc4b8c640 1 --1- 172.21.15.171:0/1078566965 >> v1:172.21.15.106:6790/0 conn(0x7fedc00a1610 0x7fedc00a19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51072/0 (socket says 172.21.15.171:51072) 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088130747 0 0) 0x7fedc0072740 con 0x7fedc0136070 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): my global_id is 5652 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feda8003530 con 0x7fedc0136070 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413554217 0 0) 0x7fedc0072a20 con 0x7fedc00a1610 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:46.472 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient(hunting): my global_id is 5555 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc0072740 con 0x7fedc00a1610 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 745605630 0 0) 0x7feda8003530 con 0x7fedc0136070 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 >> v1:172.21.15.106:6793/0 conn(0x7fedc0135c00 legacy=0x7fedc013a980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 >> v1:172.21.15.106:6790/0 conn(0x7fedc00a1610 legacy=0x7fedc00a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 monclient: found mon.noname-a 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc00a4610 con 0x7fedc0136070 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:46.473 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedb8001b40 con 0x7fedc0136070 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: dump: 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.474 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 5 monclient: authenticate success, global_id 5652 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedb8001df0 con 0x7fedc0136070 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 1 -- 172.21.15.171:0/1078566965 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedb8004f70 con 0x7fedc0136070 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:46.475 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedbf7fe640 10 monclient: dump: 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.476 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 4 set_mon_vals no callback set 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient: shutdown 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- 172.21.15.171:0/1078566965 >> v1:172.21.15.106:6789/0 conn(0x7fedc0136070 legacy=0x7fedc013e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- 172.21.15.171:0/1078566965 shutdown_connections 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- 172.21.15.171:0/1078566965 >> 172.21.15.171:0/1078566965 conn(0x7fedc00a88b0 msgr2=0x7fedc00a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- 172.21.15.171:0/1078566965 shutdown_connections 2024-04-25T23:58:46.477 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- 172.21.15.171:0/1078566965 wait complete. 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient: build_initial_monmap 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient: monmap: 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:46.478 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 Processor -- start 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 1 -- start start 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.480+0000 7fedc6df0640 10 monclient: init 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _add_conns ranks=[8,6,0,1,2,5,7,3,4] 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient(hunting): picked mon.noname-e con 0x7fedc00a1610 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient(hunting): picked mon.noname-d con 0x7fedc0135c00 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient(hunting): picked mon.noname-a con 0x7fedc0136070 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc00a13e0 con 0x7fedc0136070 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc0121740 con 0x7fedc0135c00 2024-04-25T23:58:46.479 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedc011f2a0 con 0x7fedc00a1610 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient(hunting): authenticate will time out at 1177.192128s 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc4b8c640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fedc00a1610 legacy=0x7fedc011e480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc538d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fedc0136070 0x7fedc01d0530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:49628/0 (socket says 172.21.15.171:49628) 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fedc0135c00 0x7fedc011eb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:40158/0 (socket says 172.21.15.171:40158) 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc538d640 1 -- 172.21.15.171:0/3931888289 learned_addr learned my addr 172.21.15.171:0/3931888289 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271687165 0 0) 0x7fedc0121740 con 0x7fedc0135c00 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): my global_id is 5622 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedac003530 con 0x7fedc0135c00 2024-04-25T23:58:46.480 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2657451379 0 0) 0x7fedc00a4610 con 0x7fedc0136070 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): my global_id is 5661 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedc0121740 con 0x7fedc0136070 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2582767897 0 0) 0x7fedac003530 con 0x7fedc0135c00 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedc00a4610 con 0x7fedc0135c00 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedb00041f0 con 0x7fedc0135c00 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): dump: 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.481 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.482 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4174631149 0 0) 0x7fedc0121740 con 0x7fedc0136070 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedac003530 con 0x7fedc0136070 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedb8001fa0 con 0x7fedc0136070 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient(hunting): dump: 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.483 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2600512680 0 0) 0x7fedc00a4610 con 0x7fedc0135c00 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 >> v1:172.21.15.106:6793/0 conn(0x7fedc00a1610 legacy=0x7fedc011e480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 >> v1:172.21.15.106:6789/0 conn(0x7fedc0136070 legacy=0x7fedc01d0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:58:46.484 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 monclient: found mon.d 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedc00a2160 con 0x7fedc0135c00 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: _finish_auth 0 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 5 monclient: authenticate success, global_id 5622 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _renew_subs 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fedc0121460 con 0x7fedc0135c00 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _renew_subs 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fedc009e1a0 con 0x7fedc0135c00 2024-04-25T23:58:46.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedb00044a0 con 0x7fedc0135c00 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbeffd640 4 set_mon_vals no callback set 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedb0004a10 con 0x7fedc0135c00 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 10 monclient: dump: 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:46.486 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda0005090 con 0x7fedc0135c00 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fedb0004bb0 con 0x7fedc0135c00 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(93..93 src has 1..93) ==== 5310+0+0 (unknown 1778834146 0 0) 0x7fedb00448c0 con 0x7fedc0135c00 2024-04-25T23:58:46.487 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.484+0000 7fedc4b8c640 10 monclient: get_auth_request con 0x7fedac037c60 auth_method 0 2024-04-25T23:58:46.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.500+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fedb00155c0 con 0x7fedc0135c00 2024-04-25T23:58:46.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.500+0000 7fedbd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:46.488 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.500+0000 7fedbd7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:46.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.672+0000 7fedc6df0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.7"}] 2024-04-25T23:58:46.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.672+0000 7fedc6df0640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "osd.7"}] 2024-04-25T23:58:46.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.672+0000 7fedc6df0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:46.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:46.672+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.7"} v 0) -- 0x7feda0005380 con 0x7fedc0135c00 2024-04-25T23:58:47.499 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.516+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.7"}]=0 removed item id 7 name 'osd.7' from crush map v95) ==== 122+0+0 (unknown 3479235143 0 0) 0x7fedb0014ec0 con 0x7fedc0135c00 2024-04-25T23:58:47.499 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.516+0000 7fedbd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "osd.7"}] 2024-04-25T23:58:47.499 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.516+0000 7fedbd7fa640 10 monclient: _finish_command 2 = system:0 removed item id 7 name 'osd.7' from crush map 2024-04-25T23:58:47.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.624+0000 7fedc6df0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.7"}] 2024-04-25T23:58:47.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.624+0000 7fedc6df0640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "osd.7"}] 2024-04-25T23:58:47.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.624+0000 7fedc6df0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:47.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.624+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.7"} v 0) -- 0x7feda00010a0 con 0x7fedc0135c00 2024-04-25T23:58:47.609 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.624+0000 7fedbd7fa640 1 -- 172.21.15.171:0/3931888289 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.7"}]=0 device 'osd.7' does not appear in the crush map v95) ==== 124+0+0 (unknown 157926631 0 0) 0x7fedb0019210 con 0x7fedc0135c00 2024-04-25T23:58:47.609 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.624+0000 7fedbd7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "osd.7"}] 2024-04-25T23:58:47.609 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.624+0000 7fedbd7fa640 10 monclient: _finish_command 3 = system:0 device 'osd.7' does not appear in the crush map 2024-04-25T23:58:47.609 INFO:tasks.workunit.client.0.smithi171.stderr:device 'osd.7' does not appear in the crush map 2024-04-25T23:58:47.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 >> v1:172.21.15.171:6812/722422047 conn(0x7fedac037c60 legacy=0x7fedac03a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:47.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 10 monclient: shutdown 2024-04-25T23:58:47.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:47.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 >> v1:172.21.15.106:6792/0 conn(0x7fedc0135c00 legacy=0x7fedc011eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:47.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 shutdown_connections 2024-04-25T23:58:47.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 >> 172.21.15.171:0/3931888289 conn(0x7fedc00a88b0 msgr2=0x7fedc00a6260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:47.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 shutdown_connections 2024-04-25T23:58:47.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.628+0000 7fedc6df0640 1 -- 172.21.15.171:0/3931888289 wait complete. 2024-04-25T23:58:47.626 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm osd.9 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.752+0000 7facf4cf0640 10 monclient: get_monmap_and_config 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.752+0000 7facf4cf0640 10 monclient: build_initial_monmap 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.752+0000 7facf4cf0640 10 monclient: monmap: 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:47.757390+0000 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:47.757390+0000 2024-04-25T23:58:47.737 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:47.738 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:47.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 Processor -- start 2024-04-25T23:58:47.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- start start 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: init 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: _add_conns ranks=[1,5,4,2,8,7,0,6,3] 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient(hunting): picked mon.noname-f con 0x7facf009ff90 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient(hunting): picked mon.noname-h con 0x7facf01343f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient(hunting): picked mon.noname-c con 0x7facf0134850 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf009f240 con 0x7facf009ff90 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facee59c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7facf009ff90 legacy=0x7facf0133ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf009f4b0 con 0x7facf0134850 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf009f790 con 0x7facf01343f0 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient(hunting): authenticate will time out at 1178.465208s 2024-04-25T23:58:47.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faceed9d640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7facf0134850 legacy=0x7facf013c730 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facedd9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7facf01343f0 0x7facf0139000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42524/0 (socket says 172.21.15.171:42524) 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facedd9b640 1 -- 172.21.15.171:0/2443255430 learned_addr learned my addr 172.21.15.171:0/2443255430 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2462695566 0 0) 0x7facf009f790 con 0x7facf01343f0 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient(hunting): my global_id is 5522 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facd8004640 con 0x7facf01343f0 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 427939029 0 0) 0x7facd8004640 con 0x7facf01343f0 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 >> v1:172.21.15.106:6791/0 conn(0x7facf0134850 legacy=0x7facf013c730 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:47.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 >> v1:172.21.15.171:6789/0 conn(0x7facf009ff90 legacy=0x7facf0133ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 monclient: found mon.noname-h 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf009fa70 con 0x7facf01343f0 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: _finish_auth 0 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7face4001800 con 0x7facf01343f0 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 5 monclient: authenticate success, global_id 5522 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:47.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: dump: 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:47.748 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7face4001aa0 con 0x7facf01343f0 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 4 set_mon_vals no callback set 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 1 -- 172.21.15.171:0/2443255430 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7face4004bf0 con 0x7facf01343f0 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:47.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7faced59a640 10 monclient: dump: 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:47.750 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: shutdown 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- 172.21.15.171:0/2443255430 >> v1:172.21.15.171:6791/0 conn(0x7facf01343f0 legacy=0x7facf0139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- 172.21.15.171:0/2443255430 shutdown_connections 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- 172.21.15.171:0/2443255430 >> 172.21.15.171:0/2443255430 conn(0x7facf00a6850 msgr2=0x7facf00a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- 172.21.15.171:0/2443255430 shutdown_connections 2024-04-25T23:58:47.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- 172.21.15.171:0/2443255430 wait complete. 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: build_initial_monmap 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: monmap: 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:47.752 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 Processor -- start 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 1 -- start start 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.756+0000 7facf4cf0640 10 monclient: init 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _add_conns ranks=[2,0,5,8,7,4,1,6,3] 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient(hunting): picked mon.noname-b con 0x7facf009ff90 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient(hunting): picked mon.noname-a con 0x7facf01343f0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient(hunting): picked mon.noname-h con 0x7facf0134850 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf00703c0 con 0x7facf01343f0 2024-04-25T23:58:47.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf0071010 con 0x7facf009ff90 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7facf01312b0 con 0x7facf0134850 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient(hunting): authenticate will time out at 1178.468284s 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7faceed9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7facf0134850 0x7facf01d2490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42526/0 (socket says 172.21.15.171:42526) 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7faceed9d640 1 -- 172.21.15.171:0/1742554006 learned_addr learned my addr 172.21.15.171:0/1742554006 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266498444 0 0) 0x7facf01312b0 con 0x7facf0134850 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): my global_id is 5531 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7facd0003530 con 0x7facf0134850 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 822605282 0 0) 0x7facd0003530 con 0x7facf0134850 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7facf01312b0 con 0x7facf0134850 2024-04-25T23:58:47.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7face80045f0 con 0x7facf0134850 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): dump: 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:47.755 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2614584723 0 0) 0x7facf01312b0 con 0x7facf0134850 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 >> v1:172.21.15.106:6790/0 conn(0x7facf009ff90 legacy=0x7facf006f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 >> v1:172.21.15.106:6789/0 conn(0x7facf01343f0 legacy=0x7facf006fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 monclient: found mon.h 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facf0071a40 con 0x7facf0134850 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:47.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 5 monclient: authenticate success, global_id 5531 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _renew_subs 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7facf0070b50 con 0x7facf0134850 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _renew_subs 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7facf0072c30 con 0x7facf0134850 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7face8004920 con 0x7facf0134850 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7face8004e10 con 0x7facf0134850 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facecd99640 4 set_mon_vals no callback set 2024-04-25T23:58:47.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 10 monclient: dump: 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:47.758 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7face8004fb0 con 0x7facf0134850 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7facd4005090 con 0x7facf0134850 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(95..95 src has 1..95) ==== 5202+0+0 (unknown 4279539783 0 0) 0x7face8044eb0 con 0x7facf0134850 2024-04-25T23:58:47.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.760+0000 7facee59c640 10 monclient: get_auth_request con 0x7facd00378b0 auth_method 0 2024-04-25T23:58:47.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.764+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7face8015ad0 con 0x7facf0134850 2024-04-25T23:58:47.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.764+0000 7facdeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:47.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.764+0000 7facdeffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:47.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.924+0000 7facf4cf0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.9"}] 2024-04-25T23:58:47.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.924+0000 7facf4cf0640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "osd.9"}] 2024-04-25T23:58:47.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.924+0000 7facf4cf0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:47.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.924+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.9"} v 0) -- 0x7facd4005380 con 0x7facf0134850 2024-04-25T23:58:47.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.928+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.9"}]=0 device 'osd.9' does not appear in the crush map v95) ==== 124+0+0 (unknown 1574543391 0 0) 0x7face80153d0 con 0x7facf0134850 2024-04-25T23:58:47.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.928+0000 7facdeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "osd.9"}] 2024-04-25T23:58:47.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:47.928+0000 7facdeffd640 10 monclient: _finish_command 2 = system:0 device 'osd.9' does not appear in the crush map 2024-04-25T23:58:48.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.016+0000 7facf4cf0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.9"}] 2024-04-25T23:58:48.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.016+0000 7facf4cf0640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "osd.9"}] 2024-04-25T23:58:48.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.016+0000 7facf4cf0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:48.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.016+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.9"} v 0) -- 0x7facd4002220 con 0x7facf0134850 2024-04-25T23:58:48.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facdeffd640 1 -- 172.21.15.171:0/1742554006 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.9"}]=0 device 'osd.9' does not appear in the crush map v95) ==== 124+0+0 (unknown 1574543391 0 0) 0x7face8019720 con 0x7facf0134850 2024-04-25T23:58:48.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facdeffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "osd.9"}] 2024-04-25T23:58:48.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facdeffd640 10 monclient: _finish_command 3 = system:0 device 'osd.9' does not appear in the crush map 2024-04-25T23:58:48.003 INFO:tasks.workunit.client.0.smithi171.stderr:device 'osd.9' does not appear in the crush map 2024-04-25T23:58:48.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 >> v1:172.21.15.171:6812/722422047 conn(0x7facd00378b0 legacy=0x7facd0039d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 10 monclient: shutdown 2024-04-25T23:58:48.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:48.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 >> v1:172.21.15.171:6791/0 conn(0x7facf0134850 legacy=0x7facf01d2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 shutdown_connections 2024-04-25T23:58:48.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 >> 172.21.15.171:0/1742554006 conn(0x7facf00a6850 msgr2=0x7facf00a4ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:48.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 shutdown_connections 2024-04-25T23:58:48.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.020+0000 7facf4cf0640 1 -- 172.21.15.171:0/1742554006 wait complete. 2024-04-25T23:58:48.018 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm foo 2024-04-25T23:58:48.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient: get_monmap_and_config 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient: build_initial_monmap 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient: monmap: 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:48.147822+0000 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:48.147822+0000 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:48.128 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:48.129 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:48.129 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:48.129 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:48.129 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:48.129 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 1 Processor -- start 2024-04-25T23:58:48.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 1 -- start start 2024-04-25T23:58:48.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient: init 2024-04-25T23:58:48.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient: _add_conns ranks=[2,4,6,3,0,1,5,7,8] 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient(hunting): picked mon.noname-b con 0x7f1334135bb0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient(hunting): picked mon.noname-c con 0x7f13341356f0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient(hunting): picked mon.noname-d con 0x7f133413c130 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13340a1da0 con 0x7f1334135bb0 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13340a1fe0 con 0x7f13341356f0 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1334072720 con 0x7f133413c130 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133c334640 10 monclient(hunting): authenticate will time out at 1178.854978s 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13398cf640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f13341356f0 legacy=0x7f133413aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133a8d1640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f133413c130 0x7f133413e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:40174/0 (socket says 172.21.15.171:40174) 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133a8d1640 1 -- 172.21.15.171:0/1177600586 learned_addr learned my addr 172.21.15.171:0/1177600586 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:48.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f133a0d0640 1 --1- 172.21.15.171:0/1177600586 >> v1:172.21.15.106:6790/0 conn(0x7f1334135bb0 0x7f1334135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:51088/0 (socket says 172.21.15.171:51088) 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2432385546 0 0) 0x7f13340a1da0 con 0x7f1334135bb0 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): _negotiate 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): my global_id is 5573 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1320003530 con 0x7f1334135bb0 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021064069 0 0) 0x7f1334072720 con 0x7f133413c130 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): _negotiate 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 10 monclient(hunting): my global_id is 5631 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.144+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13340a1da0 con 0x7f133413c130 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 452966448 0 0) 0x7f1320003530 con 0x7f1334135bb0 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 >> v1:172.21.15.106:6792/0 conn(0x7f133413c130 legacy=0x7f133413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 >> v1:172.21.15.106:6791/0 conn(0x7f13341356f0 legacy=0x7f133413aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: _finish_hunting 0 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 monclient: found mon.noname-b 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13340a17f0 con 0x7f1334135bb0 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: _finish_auth 0 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: _check_auth_tickets 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13300017c0 con 0x7f1334135bb0 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 5 monclient: authenticate success, global_id 5573 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:48.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: dump: 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.139 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1330001ae0 con 0x7f1334135bb0 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 4 set_mon_vals no callback set 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 1 -- 172.21.15.171:0/1177600586 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1330004b30 con 0x7f1334135bb0 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13390ce640 10 monclient: dump: 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.140 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: shutdown 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:48.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- 172.21.15.171:0/1177600586 >> v1:172.21.15.106:6790/0 conn(0x7f1334135bb0 legacy=0x7f1334135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- 172.21.15.171:0/1177600586 shutdown_connections 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- 172.21.15.171:0/1177600586 >> 172.21.15.171:0/1177600586 conn(0x7f13340a2620 msgr2=0x7f13340a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- 172.21.15.171:0/1177600586 shutdown_connections 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- 172.21.15.171:0/1177600586 wait complete. 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: build_initial_monmap 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: monmap: 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:48.142 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 Processor -- start 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- start start 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: init 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: _add_conns ranks=[1,3,2,6,5,7,4,0,8] 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient(hunting): picked mon.noname-f con 0x7f13341356f0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:48.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient(hunting): picked mon.noname-g con 0x7f1334135bb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient(hunting): picked mon.noname-b con 0x7f133413c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1334131920 con 0x7f13341356f0 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1334130190 con 0x7f133413c130 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133a0d0640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f13341356f0 legacy=0x7f133409d500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13340719a0 con 0x7f1334135bb0 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient(hunting): authenticate will time out at 1178.858487s 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13398cf640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f1334135bb0 0x7f133409dc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38438/0 (socket says 172.21.15.171:38438) 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13398cf640 1 -- 172.21.15.171:0/1959262474 learned_addr learned my addr 172.21.15.171:0/1959262474 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108865639 0 0) 0x7f13340719a0 con 0x7f1334135bb0 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:48.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): my global_id is 5790 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1318003530 con 0x7f1334135bb0 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3264373208 0 0) 0x7f1318003530 con 0x7f1334135bb0 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13340719a0 con 0x7f1334135bb0 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2642640625 0 0) 0x7f1334130190 con 0x7f133413c130 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): my global_id is 5582 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1318003530 con 0x7f133413c130 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1324004330 con 0x7f1334135bb0 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): dump: 2024-04-25T23:58:48.145 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.146 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 965560931 0 0) 0x7f13340719a0 con 0x7f1334135bb0 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 >> v1:172.21.15.106:6790/0 conn(0x7f133413c130 legacy=0x7f133409e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 >> v1:172.21.15.171:6789/0 conn(0x7f13341356f0 legacy=0x7f133409d500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 monclient: found mon.g 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1334131640 con 0x7f1334135bb0 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: _finish_auth 0 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 5 monclient: authenticate success, global_id 5790 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: _renew_subs 2024-04-25T23:58:48.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f133412fee0 con 0x7f1334135bb0 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: _renew_subs 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13341d5bb0 con 0x7f1334135bb0 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1324004a10 con 0x7f1334135bb0 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1324004f00 con 0x7f1334135bb0 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f13388cd640 4 set_mon_vals no callback set 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.148+0000 7f132affd640 10 monclient: dump: 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.148 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.152+0000 7f133c334640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.152+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f132400fca0 con 0x7f1334135bb0 2024-04-25T23:58:48.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.152+0000 7f133c334640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:48.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.152+0000 7f133c334640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.152+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f131c005090 con 0x7f1334135bb0 2024-04-25T23:58:48.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.152+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(95..95 src has 1..95) ==== 5202+0+0 (unknown 4279539783 0 0) 0x7f1324044b20 con 0x7f1334135bb0 2024-04-25T23:58:48.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.152+0000 7f133a0d0640 10 monclient: get_auth_request con 0x7f1318037920 auth_method 0 2024-04-25T23:58:48.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.156+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1324015740 con 0x7f1334135bb0 2024-04-25T23:58:48.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.156+0000 7f132affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:48.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.156+0000 7f132affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:48.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.312+0000 7f133c334640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:48.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.312+0000 7f133c334640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:48.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.312+0000 7f133c334640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.295 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.312+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "foo"} v 0) -- 0x7f131c005380 con 0x7f1334135bb0 2024-04-25T23:58:48.506 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.520+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "foo"}]=0 removed item id -10 name 'foo' from crush map v96) ==== 120+0+0 (unknown 3939064113 0 0) 0x7f1324015040 con 0x7f1334135bb0 2024-04-25T23:58:48.506 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.520+0000 7f132affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:48.506 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.520+0000 7f132affd640 10 monclient: _finish_command 2 = system:0 removed item id -10 name 'foo' from crush map 2024-04-25T23:58:48.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.620+0000 7f133c334640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:48.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.620+0000 7f133c334640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:48.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.620+0000 7f133c334640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.620+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "foo"} v 0) -- 0x7f131c002220 con 0x7f1334135bb0 2024-04-25T23:58:48.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.620+0000 7f132affd640 1 -- 172.21.15.171:0/1959262474 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "foo"}]=0 device 'foo' does not appear in the crush map v96) ==== 120+0+0 (unknown 3419787546 0 0) 0x7f1324019390 con 0x7f1334135bb0 2024-04-25T23:58:48.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.620+0000 7f132affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "foo"}] 2024-04-25T23:58:48.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.620+0000 7f132affd640 10 monclient: _finish_command 3 = system:0 device 'foo' does not appear in the crush map 2024-04-25T23:58:48.604 INFO:tasks.workunit.client.0.smithi171.stderr:device 'foo' does not appear in the crush map 2024-04-25T23:58:48.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 >> v1:172.21.15.171:6812/722422047 conn(0x7f1318037920 legacy=0x7f1318039de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 10 monclient: shutdown 2024-04-25T23:58:48.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:48.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 >> v1:172.21.15.171:6790/0 conn(0x7f1334135bb0 legacy=0x7f133409dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 shutdown_connections 2024-04-25T23:58:48.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 >> 172.21.15.171:0/1959262474 conn(0x7f13340a2620 msgr2=0x7f133413b320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:48.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 shutdown_connections 2024-04-25T23:58:48.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.624+0000 7f133c334640 1 -- 172.21.15.171:0/1959262474 wait complete. 2024-04-25T23:58:48.620 INFO:tasks.workunit.client.0.smithi171.stderr:++ ceph osd create 2024-04-25T23:58:48.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: get_monmap_and_config 2024-04-25T23:58:48.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: build_initial_monmap 2024-04-25T23:58:48.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: monmap: 2024-04-25T23:58:48.727 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:48.727 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.727 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:48.747547+0000 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:48.747547+0000 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:48.728 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 Processor -- start 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- start start 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: init 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: _add_conns ranks=[5,7,8,2,0,6,1,4,3] 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient(hunting): picked mon.noname-h con 0x7ff66809f330 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient(hunting): picked mon.noname-i con 0x7ff6680a0060 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:48.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient(hunting): picked mon.noname-e con 0x7ff66813e3a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66809c660 con 0x7ff66809f330 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66809fe20 con 0x7ff6680a0060 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66809c0a0 con 0x7ff66813e3a0 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient(hunting): authenticate will time out at 1179.454348s 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff6677fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7ff6680a0060 legacy=0x7ff66813cc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff667fff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7ff66809f330 0x7ff66809f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42536/0 (socket says 172.21.15.171:42536) 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff667fff640 1 -- 172.21.15.171:0/2231685121 learned_addr learned my addr 172.21.15.171:0/2231685121 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66ce5a640 1 -- 172.21.15.171:0/2231685121 >> v1:172.21.15.106:6793/0 conn(0x7ff66813e3a0 legacy=0x7ff668140790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1699849128 0 0) 0x7ff658001120 con 0x7ff66809f330 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient(hunting): my global_id is 5540 2024-04-25T23:58:48.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff654003530 con 0x7ff66809f330 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3182578676 0 0) 0x7ff654003530 con 0x7ff66809f330 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 >> v1:172.21.15.106:6793/0 conn(0x7ff66813e3a0 legacy=0x7ff668140790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 >> v1:172.21.15.171:6792/0 conn(0x7ff6680a0060 legacy=0x7ff66813cc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 monclient: found mon.noname-h 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66809c380 con 0x7ff66809f330 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff658001990 con 0x7ff66809f330 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 5 monclient: authenticate success, global_id 5540 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:48.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: dump: 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.737 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff658001c80 con 0x7ff66809f330 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 1 -- 172.21.15.171:0/2231685121 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff658004bf0 con 0x7ff66809f330 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 4 set_mon_vals no callback set 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff666ffd640 10 monclient: dump: 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.738 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 10 monclient: shutdown 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- 172.21.15.171:0/2231685121 >> v1:172.21.15.171:6791/0 conn(0x7ff66809f330 legacy=0x7ff66809f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- 172.21.15.171:0/2231685121 shutdown_connections 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- 172.21.15.171:0/2231685121 >> 172.21.15.171:0/2231685121 conn(0x7ff6680a28a0 msgr2=0x7ff6680a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- 172.21.15.171:0/2231685121 shutdown_connections 2024-04-25T23:58:48.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.744+0000 7ff66e8bd640 1 -- 172.21.15.171:0/2231685121 wait complete. 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: build_initial_monmap 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: monmap: 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:48.740 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 Processor -- start 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 -- start start 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: init 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _add_conns ranks=[1,3,6,7,5,0,8,2,4] 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient(hunting): picked mon.noname-f con 0x7ff66809f330 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient(hunting): picked mon.noname-g con 0x7ff6680a0060 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient(hunting): picked mon.noname-d con 0x7ff66813e3a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66809b800 con 0x7ff66809f330 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff66809b2b0 con 0x7ff6680a0060 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff668138b50 con 0x7ff66813e3a0 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient(hunting): authenticate will time out at 1179.456875s 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff667fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7ff66809f330 legacy=0x7ff6681cc7e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:48.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff6677fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff6680a0060 0x7ff6681d1760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:38444/0 (socket says 172.21.15.171:38444) 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff6677fe640 1 -- 172.21.15.171:0/3488051928 learned_addr learned my addr 172.21.15.171:0/3488051928 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2548491590 0 0) 0x7ff66809b2b0 con 0x7ff6680a0060 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): my global_id is 5799 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff648003530 con 0x7ff6680a0060 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2080949948 0 0) 0x7ff648003530 con 0x7ff6680a0060 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff66809b2b0 con 0x7ff6680a0060 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff6500042f0 con 0x7ff6680a0060 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): dump: 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.742 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2581357300 0 0) 0x7ff66809b2b0 con 0x7ff6680a0060 2024-04-25T23:58:48.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 >> v1:172.21.15.106:6792/0 conn(0x7ff66813e3a0 legacy=0x7ff6681d4e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 >> v1:172.21.15.171:6789/0 conn(0x7ff66809f330 legacy=0x7ff6681cc7e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 monclient: found mon.g 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff66813aeb0 con 0x7ff6680a0060 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: _finish_auth 0 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 5 monclient: authenticate success, global_id 5799 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _renew_subs 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff668139430 con 0x7ff6680a0060 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _renew_subs 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff66813b9d0 con 0x7ff6680a0060 2024-04-25T23:58:48.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff650004620 con 0x7ff6680a0060 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff650004b10 con 0x7ff6680a0060 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff6667fc640 4 set_mon_vals no callback set 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 10 monclient: dump: 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:48.745 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff64c005090 con 0x7ff6680a0060 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff650004d70 con 0x7ff6680a0060 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(96..96 src has 1..96) ==== 4962+0+0 (unknown 808397429 0 0) 0x7ff650044b80 con 0x7ff6680a0060 2024-04-25T23:58:48.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.748+0000 7ff667fff640 10 monclient: get_auth_request con 0x7ff648037830 auth_method 0 2024-04-25T23:58:48.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.752+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff66813b9d0 con 0x7ff6680a0060 2024-04-25T23:58:48.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.752+0000 7ff664ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:48.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.752+0000 7ff664ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:48.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.912+0000 7ff66e8bd640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:58:48.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.912+0000 7ff66e8bd640 10 monclient: _send_command 2 [{"prefix": "osd create"}] 2024-04-25T23:58:48.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.912+0000 7ff66e8bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:48.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:48.912+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7ff64c005380 con 0x7ff6680a0060 2024-04-25T23:58:49.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:49.536+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd create"}]=0 v97) ==== 58+0+3 (unknown 2995259560 0 520826459) 0x7ff650015890 con 0x7ff6680a0060 2024-04-25T23:58:49.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:49.536+0000 7ff664ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create"}] 2024-04-25T23:58:49.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:49.536+0000 7ff664ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:49.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:49.640+0000 7ff66e8bd640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:58:49.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:49.640+0000 7ff66e8bd640 10 monclient: _send_command 3 [{"prefix": "osd create"}] 2024-04-25T23:58:49.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:49.640+0000 7ff66e8bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:49.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:49.640+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7ff64c000bd0 con 0x7ff6680a0060 2024-04-25T23:58:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff664ff9640 1 -- 172.21.15.171:0/3488051928 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd create"}]=0 v98) ==== 58+0+3 (unknown 1761221957 0 212448812) 0x7ff650015190 con 0x7ff6680a0060 2024-04-25T23:58:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff664ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create"}] 2024-04-25T23:58:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff664ff9640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 >> v1:172.21.15.171:6812/722422047 conn(0x7ff648037830 legacy=0x7ff648039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff66e8bd640 10 monclient: shutdown 2024-04-25T23:58:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff66e8bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 >> v1:172.21.15.171:6790/0 conn(0x7ff6680a0060 legacy=0x7ff6681d1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 shutdown_connections 2024-04-25T23:58:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.548+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 >> 172.21.15.171:0/3488051928 conn(0x7ff6680a28a0 msgr2=0x7ff668131a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.552+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 shutdown_connections 2024-04-25T23:58:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.552+0000 7ff66e8bd640 1 -- 172.21.15.171:0/3488051928 wait complete. 2024-04-25T23:58:50.551 INFO:tasks.workunit.client.0.smithi171.stderr:+ o3=11 2024-04-25T23:58:50.552 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add 11 123 root=default 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.684+0000 7f2b89eed640 10 monclient: get_monmap_and_config 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.684+0000 7f2b89eed640 10 monclient: build_initial_monmap 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.684+0000 7f2b89eed640 10 monclient: monmap: 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:50.690200+0000 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:50.690200+0000 2024-04-25T23:58:50.670 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:50.671 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:50.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 Processor -- start 2024-04-25T23:58:50.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- start start 2024-04-25T23:58:50.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: init 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: _add_conns ranks=[6,0,3,2,1,8,4,5,7] 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient(hunting): picked mon.noname-d con 0x7f2b840a1530 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient(hunting): picked mon.noname-a con 0x7f2b8409f580 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient(hunting): picked mon.noname-g con 0x7f2b8409f980 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8406f0b0 con 0x7f2b8409f580 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8406f390 con 0x7f2b8409f980 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b8406f670 con 0x7f2b840a1530 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient(hunting): authenticate will time out at 1181.397226s 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b83fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2b8409f980 0x7f2b841402b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48718/0 (socket says 172.21.15.171:48718) 2024-04-25T23:58:50.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b83fff640 1 -- 172.21.15.171:0/590149016 learned_addr learned my addr 172.21.15.171:0/590149016 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330284333 0 0) 0x7f2b8406f390 con 0x7f2b8409f980 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient(hunting): my global_id is 5808 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b70003530 con 0x7f2b8409f980 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3581097534 0 0) 0x7f2b70003530 con 0x7f2b8409f980 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 >> v1:172.21.15.106:6792/0 conn(0x7f2b840a1530 legacy=0x7f2b8409ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 >> v1:172.21.15.106:6789/0 conn(0x7f2b8409f580 legacy=0x7f2b8413cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 monclient: found mon.noname-g 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b840a1f00 con 0x7f2b8409f980 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:50.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 5 monclient: authenticate success, global_id 5808 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b7c001b40 con 0x7f2b8409f980 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: dump: 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:50.680 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b7c001e30 con 0x7f2b8409f980 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 4 set_mon_vals no callback set 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 1 -- 172.21.15.171:0/590149016 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b7c004f70 con 0x7f2b8409f980 2024-04-25T23:58:50.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b82ffd640 10 monclient: dump: 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:50.682 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: shutdown 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- 172.21.15.171:0/590149016 >> v1:172.21.15.171:6790/0 conn(0x7f2b8409f980 legacy=0x7f2b841402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- 172.21.15.171:0/590149016 shutdown_connections 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- 172.21.15.171:0/590149016 >> 172.21.15.171:0/590149016 conn(0x7f2b840a2690 msgr2=0x7f2b840a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- 172.21.15.171:0/590149016 shutdown_connections 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- 172.21.15.171:0/590149016 wait complete. 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: build_initial_monmap 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: monmap: 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:50.683 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 Processor -- start 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 1 -- start start 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.688+0000 7f2b89eed640 10 monclient: init 2024-04-25T23:58:50.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _add_conns ranks=[1,3,0,2,7,4,8,6,5] 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient(hunting): picked mon.noname-f con 0x7f2b8409f580 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient(hunting): picked mon.noname-g con 0x7f2b8409f980 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient(hunting): picked mon.noname-a con 0x7f2b840a1530 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b837fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f2b8409f580 legacy=0x7f2b841ccb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b84138e30 con 0x7f2b840a1530 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b84134170 con 0x7f2b8409f580 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2b84072d30 con 0x7f2b8409f980 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient(hunting): authenticate will time out at 1181.400282s 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b7affd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f2b8409f980 0x7f2b841d1b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48732/0 (socket says 172.21.15.171:48732) 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b7affd640 1 -- 172.21.15.171:0/1287921567 learned_addr learned my addr 172.21.15.171:0/1287921567 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149811987 0 0) 0x7f2b84072d30 con 0x7f2b8409f980 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:58:50.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): my global_id is 5817 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2b64003530 con 0x7f2b8409f980 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2324784817 0 0) 0x7f2b64003530 con 0x7f2b8409f980 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2b84072d30 con 0x7f2b8409f980 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b6c001a80 con 0x7f2b8409f980 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): dump: 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.686 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2015757309 0 0) 0x7f2b84072d30 con 0x7f2b8409f980 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 >> v1:172.21.15.171:6789/0 conn(0x7f2b8409f580 legacy=0x7f2b841ccb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 >> v1:172.21.15.106:6789/0 conn(0x7f2b840a1530 legacy=0x7f2b841d5230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:58:50.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 monclient: found mon.g 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b84072800 con 0x7f2b8409f980 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: _finish_auth 0 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 5 monclient: authenticate success, global_id 5817 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _renew_subs 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2b84133dd0 con 0x7f2b8409f980 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _renew_subs 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2b84139420 con 0x7f2b8409f980 2024-04-25T23:58:50.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2b6c0038d0 con 0x7f2b8409f980 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2b6c003e40 con 0x7f2b8409f980 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b827fc640 4 set_mon_vals no callback set 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 10 monclient: dump: 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:50.689 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b68005090 con 0x7f2b8409f980 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2b6c003fe0 con 0x7f2b8409f980 2024-04-25T23:58:50.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(98..98 src has 1..98) ==== 5192+0+0 (unknown 1986351807 0 0) 0x7f2b6c044b50 con 0x7f2b8409f980 2024-04-25T23:58:50.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.692+0000 7f2b837fe640 10 monclient: get_auth_request con 0x7f2b640376f0 auth_method 0 2024-04-25T23:58:50.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.696+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2b6c015850 con 0x7f2b8409f980 2024-04-25T23:58:50.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.696+0000 7f2b80ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:50.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.696+0000 7f2b80ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:50.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.848+0000 7f2b89eed640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}] 2024-04-25T23:58:50.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.848+0000 7f2b89eed640 10 monclient: _send_command 2 [{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}] 2024-04-25T23:58:50.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.848+0000 7f2b89eed640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:50.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:50.848+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]} v 0) -- 0x7f2b68005380 con 0x7f2b8409f980 2024-04-25T23:58:51.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.512+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}]=0 add item id 11 name 'osd.11' weight 123 at location {root=default} to crush map v99) ==== 193+0+0 (unknown 1204463796 0 0) 0x7f2b6c015150 con 0x7f2b8409f980 2024-04-25T23:58:51.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.512+0000 7f2b80ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}] 2024-04-25T23:58:51.495 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.512+0000 7f2b80ff9640 10 monclient: _finish_command 2 = system:0 add item id 11 name 'osd.11' weight 123 at location {root=default} to crush map 2024-04-25T23:58:51.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.624+0000 7f2b89eed640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}] 2024-04-25T23:58:51.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.624+0000 7f2b89eed640 10 monclient: _send_command 3 [{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}] 2024-04-25T23:58:51.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.624+0000 7f2b89eed640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:51.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.624+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]} v 0) -- 0x7f2b68005be0 con 0x7f2b8409f980 2024-04-25T23:58:51.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.628+0000 7f2b80ff9640 1 -- 172.21.15.171:0/1287921567 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}]=0 set item id 11 name 'osd.11' weight 123 at location {root=default}: no change v99) ==== 191+0+0 (unknown 1675519427 0 0) 0x7f2b6c0422f0 con 0x7f2b8409f980 2024-04-25T23:58:51.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.628+0000 7f2b80ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add", "id": 11, "weight": 123.0, "args": ["root=default"]}] 2024-04-25T23:58:51.612 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.628+0000 7f2b80ff9640 10 monclient: _finish_command 3 = system:0 set item id 11 name 'osd.11' weight 123 at location {root=default}: no change 2024-04-25T23:58:51.612 INFO:tasks.workunit.client.0.smithi171.stderr:set item id 11 name 'osd.11' weight 123 at location {root=default}: no change 2024-04-25T23:58:51.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 >> v1:172.21.15.171:6812/722422047 conn(0x7f2b640376f0 legacy=0x7f2b64039bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:51.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 10 monclient: shutdown 2024-04-25T23:58:51.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:51.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 >> v1:172.21.15.171:6790/0 conn(0x7f2b8409f980 legacy=0x7f2b841d1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:51.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 shutdown_connections 2024-04-25T23:58:51.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 >> 172.21.15.171:0/1287921567 conn(0x7f2b840a2690 msgr2=0x7f2b840a4920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:51.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 shutdown_connections 2024-04-25T23:58:51.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.632+0000 7f2b89eed640 1 -- 172.21.15.171:0/1287921567 wait complete. 2024-04-25T23:58:51.630 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:51.630 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep osd.11 2024-04-25T23:58:51.630 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 123 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.756+0000 7fc15b3f9640 10 monclient: get_monmap_and_config 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.756+0000 7fc15b3f9640 10 monclient: build_initial_monmap 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.756+0000 7fc15b3f9640 10 monclient: monmap: 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:51.761248+0000 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:51.761248+0000 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:51.741 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:51.742 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.756+0000 7fc15b3f9640 1 Processor -- start 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.756+0000 7fc15b3f9640 1 -- start start 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.756+0000 7fc15b3f9640 10 monclient: init 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.756+0000 7fc15b3f9640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: _add_conns ranks=[3,7,4,6,2,0,8,1,5] 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): picked mon.noname-g con 0x7fc1541328a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): picked mon.noname-i con 0x7fc15409b840 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:51.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): picked mon.noname-c con 0x7fc15409b3e0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc154133390 con 0x7fc1541328a0 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15409cc80 con 0x7fc15409b3e0 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15409c2a0 con 0x7fc15409b840 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): authenticate will time out at 1182.468102s 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc158994640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7fc15409b840 legacy=0x7fc15413aa80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc159195640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc1541328a0 0x7fc154132c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48736/0 (socket says 172.21.15.171:48736) 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc159195640 1 -- 172.21.15.171:0/2524724967 learned_addr learned my addr 172.21.15.171:0/2524724967 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc159996640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fc15409b3e0 legacy=0x7fc15413e1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558845444 0 0) 0x7fc154133390 con 0x7fc1541328a0 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:51.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient(hunting): my global_id is 5826 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc140003530 con 0x7fc1541328a0 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 25408229 0 0) 0x7fc140003530 con 0x7fc1541328a0 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 >> v1:172.21.15.171:6792/0 conn(0x7fc15409b840 legacy=0x7fc15413aa80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 >> v1:172.21.15.106:6791/0 conn(0x7fc15409b3e0 legacy=0x7fc15413e1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 monclient: found mon.noname-g 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc15409f7b0 con 0x7fc1541328a0 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: _finish_auth 0 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 5 monclient: authenticate success, global_id 5826 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:51.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc1500017c0 con 0x7fc1541328a0 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: dump: 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:51.751 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc150001a50 con 0x7fc1541328a0 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 1 -- 172.21.15.171:0/2524724967 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc150004bf0 con 0x7fc1541328a0 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 4 set_mon_vals no callback set 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc14bfff640 10 monclient: dump: 2024-04-25T23:58:51.752 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:51.753 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: shutdown 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- 172.21.15.171:0/2524724967 >> v1:172.21.15.171:6790/0 conn(0x7fc1541328a0 legacy=0x7fc154132c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- 172.21.15.171:0/2524724967 shutdown_connections 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- 172.21.15.171:0/2524724967 >> 172.21.15.171:0/2524724967 conn(0x7fc1540a28a0 msgr2=0x7fc1540a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- 172.21.15.171:0/2524724967 shutdown_connections 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- 172.21.15.171:0/2524724967 wait complete. 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: build_initial_monmap 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: monmap: 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:51.754 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 Processor -- start 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- start start 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: init 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:51.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: _add_conns ranks=[3,5,0,8,2,4,7,1,6] 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): picked mon.noname-g con 0x7fc15409b3e0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): picked mon.noname-h con 0x7fc15409b840 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): picked mon.noname-a con 0x7fc1541328a0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15413b800 con 0x7fc1541328a0 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15413bae0 con 0x7fc15409b3e0 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc15413e5d0 con 0x7fc15409b840 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient(hunting): authenticate will time out at 1182.470951s 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc159195640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc15409b3e0 0x7fc154137b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48742/0 (socket says 172.21.15.171:48742) 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc159195640 1 -- 172.21.15.171:0/4030963538 learned_addr learned my addr 172.21.15.171:0/4030963538 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2209047914 0 0) 0x7fc15413bae0 con 0x7fc15409b3e0 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:51.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): my global_id is 5835 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc138003530 con 0x7fc15409b3e0 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966802686 0 0) 0x7fc15413e5d0 con 0x7fc15409b840 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): my global_id is 5549 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc15413bae0 con 0x7fc15409b840 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2653271625 0 0) 0x7fc138003530 con 0x7fc15409b3e0 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc15413e5d0 con 0x7fc15409b3e0 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc150004b30 con 0x7fc15409b3e0 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:51.757 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:51.758 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3097204329 0 0) 0x7fc15413bae0 con 0x7fc15409b840 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc138003530 con 0x7fc15409b840 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc144004270 con 0x7fc15409b840 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient(hunting): dump: 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.759 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4019074920 0 0) 0x7fc15413e5d0 con 0x7fc15409b3e0 2024-04-25T23:58:51.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 >> v1:172.21.15.171:6791/0 conn(0x7fc15409b840 legacy=0x7fc154138280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 >> v1:172.21.15.106:6789/0 conn(0x7fc1541328a0 legacy=0x7fc154138990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 monclient: found mon.g 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc154073100 con 0x7fc15409b3e0 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 5 monclient: authenticate success, global_id 5835 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: _renew_subs 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc154072c20 con 0x7fc15409b3e0 2024-04-25T23:58:51.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: _renew_subs 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1541d39a0 con 0x7fc15409b3e0 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.760+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc150001980 con 0x7fc15409b3e0 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc149ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc150005290 con 0x7fc15409b3e0 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc149ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc14b7fe640 4 set_mon_vals no callback set 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc149ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc149ffb640 10 monclient: dump: 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:51.762 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc15b3f9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc15b3f9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc15b3f9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc134005090 con 0x7fc15409b3e0 2024-04-25T23:58:51.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc1500054b0 con 0x7fc15409b3e0 2024-04-25T23:58:51.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(99..99 src has 1..99) ==== 5214+0+0 (unknown 3785297344 0 0) 0x7fc150044d50 con 0x7fc15409b3e0 2024-04-25T23:58:51.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.764+0000 7fc158994640 10 monclient: get_auth_request con 0x7fc138037d20 auth_method 0 2024-04-25T23:58:51.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.768+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc150015a90 con 0x7fc15409b3e0 2024-04-25T23:58:51.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.768+0000 7fc149ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:51.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.768+0000 7fc149ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:51.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.932+0000 7fc15b3f9640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:51.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.932+0000 7fc15b3f9640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:51.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.932+0000 7fc15b3f9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:51.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.932+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fc134005b90 con 0x7fc15409b3e0 2024-04-25T23:58:51.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.932+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v99) ==== 56+0+1173 (unknown 3011264473 0 205542079) 0x7fc150015390 con 0x7fc15409b3e0 2024-04-25T23:58:51.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.932+0000 7fc149ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:51.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:51.932+0000 7fc149ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:52.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.020+0000 7fc15b3f9640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:52.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.020+0000 7fc15b3f9640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:52.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.020+0000 7fc15b3f9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:52.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.020+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fc134005d60 con 0x7fc15409b3e0 2024-04-25T23:58:52.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.020+0000 7fc149ffb640 1 -- 172.21.15.171:0/4030963538 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v99) ==== 56+0+1173 (unknown 3011264473 0 205542079) 0x7fc1500136f0 con 0x7fc15409b3e0 2024-04-25T23:58:52.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.020+0000 7fc149ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:52.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.020+0000 7fc149ffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 >> v1:172.21.15.171:6812/722422047 conn(0x7fc138037d20 legacy=0x7fc13803a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 10 monclient: shutdown 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 >> v1:172.21.15.171:6790/0 conn(0x7fc15409b3e0 legacy=0x7fc154137b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 shutdown_connections 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 >> 172.21.15.171:0/4030963538 conn(0x7fc1540a28a0 msgr2=0x7fc154134360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 shutdown_connections 2024-04-25T23:58:52.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.024+0000 7fc15b3f9640 1 -- 172.21.15.171:0/4030963538 wait complete. 2024-04-25T23:58:52.021 INFO:tasks.workunit.client.0.smithi171.stdout: 11 123.00000 osd.11 down 1.00000 1.00000 2024-04-25T23:58:52.021 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush reweight osd.11 113 2024-04-25T23:58:52.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.152+0000 7ff7bce62640 10 monclient: get_monmap_and_config 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.152+0000 7ff7bce62640 10 monclient: build_initial_monmap 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.152+0000 7ff7bce62640 10 monclient: monmap: 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:52.157042+0000 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:52.157042+0000 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:52.137 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:52.138 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:52.138 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:52.138 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:52.138 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:52.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.152+0000 7ff7bce62640 1 Processor -- start 2024-04-25T23:58:52.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.152+0000 7ff7bce62640 1 -- start start 2024-04-25T23:58:52.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.152+0000 7ff7bce62640 10 monclient: init 2024-04-25T23:58:52.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: _add_conns ranks=[3,7,2,6,8,1,0,5,4] 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): picked mon.noname-g con 0x7ff7b80a52a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): picked mon.noname-i con 0x7ff7b80a49c0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): picked mon.noname-b con 0x7ff7b813e2a0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b80a5d90 con 0x7ff7b813e2a0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b80a18e0 con 0x7ff7b80a52a0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b80a28f0 con 0x7ff7b80a49c0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): authenticate will time out at 1182.864353s 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b5d9b640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7ff7b80a49c0 legacy=0x7ff7b813cb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b659c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff7b80a52a0 0x7ff7b80a5680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48754/0 (socket says 172.21.15.171:48754) 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b659c640 1 -- 172.21.15.171:0/2615787564 learned_addr learned my addr 172.21.15.171:0/2615787564 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 995529515 0 0) 0x7ff7b80a18e0 con 0x7ff7b80a52a0 2024-04-25T23:58:52.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient(hunting): my global_id is 5844 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7a4003530 con 0x7ff7b80a52a0 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3583829897 0 0) 0x7ff7a4003530 con 0x7ff7b80a52a0 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 >> v1:172.21.15.171:6792/0 conn(0x7ff7b80a49c0 legacy=0x7ff7b813cb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 >> v1:172.21.15.106:6790/0 conn(0x7ff7b813e2a0 legacy=0x7ff7b8140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 monclient: found mon.noname-g 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b80a2bd0 con 0x7ff7b80a52a0 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: _finish_auth 0 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:52.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff7b0001b40 con 0x7ff7b80a52a0 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: dump: 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:52.147 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 5 monclient: authenticate success, global_id 5844 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7b0001e30 con 0x7ff7b80a52a0 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 1 -- 172.21.15.171:0/2615787564 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff7b0004f70 con 0x7ff7b80a52a0 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 4 set_mon_vals no callback set 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:52.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b559a640 10 monclient: dump: 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:52.149 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: shutdown 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- 172.21.15.171:0/2615787564 >> v1:172.21.15.171:6790/0 conn(0x7ff7b80a52a0 legacy=0x7ff7b80a5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- 172.21.15.171:0/2615787564 shutdown_connections 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- 172.21.15.171:0/2615787564 >> 172.21.15.171:0/2615787564 conn(0x7ff7b80a6c90 msgr2=0x7ff7b80a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- 172.21.15.171:0/2615787564 shutdown_connections 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- 172.21.15.171:0/2615787564 wait complete. 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: build_initial_monmap 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: monmap: 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:52.150 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 Processor -- start 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- start start 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: init 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:52.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient: _add_conns ranks=[1,2,8,5,7,3,4,6,0] 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): picked mon.noname-f con 0x7ff7b80a49c0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): picked mon.noname-b con 0x7ff7b80a52a0 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): picked mon.noname-e con 0x7ff7b813e2a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b80a43c0 con 0x7ff7b80a49c0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b809b150 con 0x7ff7b80a52a0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b659c640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7ff7b80a49c0 legacy=0x7ff7b812f960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7b813bc20 con 0x7ff7b813e2a0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7bce62640 10 monclient(hunting): authenticate will time out at 1182.867451s 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b6d9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff7b813e2a0 legacy=0x7ff7b81d4fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b5d9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7ff7b80a52a0 0x7ff7b81d1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:60704/0 (socket says 172.21.15.171:60704) 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.156+0000 7ff7b5d9b640 1 -- 172.21.15.171:0/3818918619 learned_addr learned my addr 172.21.15.171:0/3818918619 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874353992 0 0) 0x7ff7b809b150 con 0x7ff7b80a52a0 2024-04-25T23:58:52.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): my global_id is 5600 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff798003530 con 0x7ff7b80a52a0 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1984193562 0 0) 0x7ff798003530 con 0x7ff7b80a52a0 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff7b809b150 con 0x7ff7b80a52a0 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff7a0004300 con 0x7ff7b80a52a0 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): dump: 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.153 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4229743534 0 0) 0x7ff7b809b150 con 0x7ff7b80a52a0 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 >> v1:172.21.15.106:6793/0 conn(0x7ff7b813e2a0 legacy=0x7ff7b81d4fa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:52.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 >> v1:172.21.15.171:6789/0 conn(0x7ff7b80a49c0 legacy=0x7ff7b812f960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 monclient: found mon.b 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7b809ae70 con 0x7ff7b80a52a0 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 5 monclient: authenticate success, global_id 5600 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 10 monclient: _renew_subs 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff7b813c780 con 0x7ff7b80a52a0 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 10 monclient: _renew_subs 2024-04-25T23:58:52.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:52.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff7b813afa0 con 0x7ff7b80a52a0 2024-04-25T23:58:52.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7a00045f0 con 0x7ff7b80a52a0 2024-04-25T23:58:52.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:52.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7b4d99640 4 set_mon_vals no callback set 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff7a0004b60 con 0x7ff7b80a52a0 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 10 monclient: dump: 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:52.157 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff79c005090 con 0x7ff7b80a52a0 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff7a0004d80 con 0x7ff7b80a52a0 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(99..99 src has 1..99) ==== 5214+0+0 (unknown 3785297344 0 0) 0x7ff7a0044be0 con 0x7ff7b80a52a0 2024-04-25T23:58:52.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.160+0000 7ff7b659c640 10 monclient: get_auth_request con 0x7ff798037790 auth_method 0 2024-04-25T23:58:52.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.172+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff7a0015800 con 0x7ff7b80a52a0 2024-04-25T23:58:52.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.172+0000 7ff7aeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:52.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.172+0000 7ff7aeffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:52.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.324+0000 7ff7bce62640 10 start_mon_command cmd=[{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}] 2024-04-25T23:58:52.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.324+0000 7ff7bce62640 10 monclient: _send_command 2 [{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}] 2024-04-25T23:58:52.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.324+0000 7ff7bce62640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:52.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.324+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0} v 0) -- 0x7ff79c005b90 con 0x7ff7b80a52a0 2024-04-25T23:58:52.511 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.528+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}]=0 reweighted item id 11 name 'osd.11' to 113 in crush map v100) ==== 156+0+0 (unknown 1860376160 0 0) 0x7ff7a0015100 con 0x7ff7b80a52a0 2024-04-25T23:58:52.511 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.528+0000 7ff7aeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}] 2024-04-25T23:58:52.511 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.528+0000 7ff7aeffd640 10 monclient: _finish_command 2 = system:0 reweighted item id 11 name 'osd.11' to 113 in crush map 2024-04-25T23:58:52.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.632+0000 7ff7bce62640 10 start_mon_command cmd=[{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}] 2024-04-25T23:58:52.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.632+0000 7ff7bce62640 10 monclient: _send_command 3 [{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}] 2024-04-25T23:58:52.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.632+0000 7ff7bce62640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:58:52.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:52.632+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0} v 0) -- 0x7ff79c0010a0 con 0x7ff7b80a52a0 2024-04-25T23:58:53.516 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.532+0000 7ff7aeffd640 1 -- 172.21.15.171:0/3818918619 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}]=0 reweighted item id 11 name 'osd.11' to 113 in crush map v101) ==== 156+0+0 (unknown 1361214950 0 0) 0x7ff7a0019450 con 0x7ff7b80a52a0 2024-04-25T23:58:53.516 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.532+0000 7ff7aeffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush reweight", "name": "osd.11", "weight": 113.0}] 2024-04-25T23:58:53.516 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.532+0000 7ff7aeffd640 10 monclient: _finish_command 3 = system:0 reweighted item id 11 name 'osd.11' to 113 in crush map 2024-04-25T23:58:53.516 INFO:tasks.workunit.client.0.smithi171.stderr:reweighted item id 11 name 'osd.11' to 113 in crush map 2024-04-25T23:58:53.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 >> v1:172.21.15.171:6812/722422047 conn(0x7ff798037790 legacy=0x7ff798039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:53.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 10 monclient: shutdown 2024-04-25T23:58:53.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:53.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 >> v1:172.21.15.106:6790/0 conn(0x7ff7b80a52a0 legacy=0x7ff7b81d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:53.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 shutdown_connections 2024-04-25T23:58:53.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 >> 172.21.15.171:0/3818918619 conn(0x7ff7b80a6c90 msgr2=0x7ff7b8133d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:53.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 shutdown_connections 2024-04-25T23:58:53.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.536+0000 7ff7bce62640 1 -- 172.21.15.171:0/3818918619 wait complete. 2024-04-25T23:58:53.537 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush reweight osd.11 123456 2024-04-25T23:58:53.537 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:58:53.537 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush reweight osd.11 123456 2024-04-25T23:58:53.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: get_monmap_and_config 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: build_initial_monmap 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: monmap: 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:53.678671+0000 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:53.678671+0000 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:53.659 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:53.660 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:53.660 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:53.660 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:53.660 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:53.660 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:53.660 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:53.660 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 Processor -- start 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- start start 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: init 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: _add_conns ranks=[7,8,0,5,2,3,4,6,1] 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient(hunting): picked mon.noname-i con 0x7f5a380a1350 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient(hunting): picked mon.noname-e con 0x7f5a380a1730 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient(hunting): picked mon.noname-a con 0x7f5a380a1b10 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a38136210 con 0x7f5a380a1b10 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a38071580 con 0x7f5a380a1350 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a380723a0 con 0x7f5a380a1730 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient(hunting): authenticate will time out at 1184.385512s 2024-04-25T23:58:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a377fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f5a380a1350 legacy=0x7f5a38135b00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a36ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5a380a1730 legacy=0x7f5a3813a8a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a37fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5a380a1b10 0x7f5a3813dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:38996/0 (socket says 172.21.15.171:38996) 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a37fff640 1 -- 172.21.15.171:0/4280532499 learned_addr learned my addr 172.21.15.171:0/4280532499 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260255570 0 0) 0x7f5a38136210 con 0x7f5a380a1b10 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient(hunting): my global_id is 5706 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a20003530 con 0x7f5a380a1b10 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 984490689 0 0) 0x7f5a20003530 con 0x7f5a380a1b10 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 >> v1:172.21.15.106:6793/0 conn(0x7f5a380a1730 legacy=0x7f5a3813a8a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 >> v1:172.21.15.171:6792/0 conn(0x7f5a380a1350 legacy=0x7f5a38135b00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 monclient: found mon.noname-a 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:53.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a38072680 con 0x7f5a380a1b10 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 5 monclient: authenticate success, global_id 5706 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5a30001b40 con 0x7f5a380a1b10 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: dump: 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.669 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a30001e30 con 0x7f5a380a1b10 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:53.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 4 set_mon_vals no callback set 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 1 -- 172.21.15.171:0/4280532499 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5a30004f70 con 0x7f5a380a1b10 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a367fc640 10 monclient: dump: 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.671 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 10 monclient: shutdown 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- 172.21.15.171:0/4280532499 >> v1:172.21.15.106:6789/0 conn(0x7f5a380a1b10 legacy=0x7f5a3813dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- 172.21.15.171:0/4280532499 shutdown_connections 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- 172.21.15.171:0/4280532499 >> 172.21.15.171:0/4280532499 conn(0x7f5a380a50d0 msgr2=0x7f5a3806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- 172.21.15.171:0/4280532499 shutdown_connections 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.676+0000 7f5a3db5a640 1 -- 172.21.15.171:0/4280532499 wait complete. 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: build_initial_monmap 2024-04-25T23:58:53.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: monmap: 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:53.673 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 Processor -- start 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 -- start start 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: init 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _add_conns ranks=[3,8,6,4,0,5,1,2,7] 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient(hunting): picked mon.noname-g con 0x7f5a380a1350 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient(hunting): picked mon.noname-e con 0x7f5a380a1730 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient(hunting): picked mon.noname-d con 0x7f5a380a1b10 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:53.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a38120360 con 0x7f5a380a1350 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3809e870 con 0x7f5a380a1b10 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a3811fac0 con 0x7f5a380a1730 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient(hunting): authenticate will time out at 1184.389131s 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a377fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5a380a1350 0x7f5a3809cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48764/0 (socket says 172.21.15.171:48764) 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a377fe640 1 -- 172.21.15.171:0/2160243750 learned_addr learned my addr 172.21.15.171:0/2160243750 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a36ffd640 1 -- 172.21.15.171:0/2160243750 >> v1:172.21.15.106:6793/0 conn(0x7f5a380a1730 legacy=0x7f5a3809d2b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:53.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4072295110 0 0) 0x7f5a38120360 con 0x7f5a380a1350 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): my global_id is 5853 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a24003530 con 0x7f5a380a1350 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3991232949 0 0) 0x7f5a24003530 con 0x7f5a380a1350 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5a38120360 con 0x7f5a380a1350 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5a28004300 con 0x7f5a380a1350 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): dump: 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.676 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.677 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776211212 0 0) 0x7f5a3809e870 con 0x7f5a380a1b10 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient(hunting): my global_id is 5658 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a24003530 con 0x7f5a380a1b10 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3325483487 0 0) 0x7f5a38120360 con 0x7f5a380a1350 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 >> v1:172.21.15.106:6793/0 conn(0x7f5a380a1730 legacy=0x7f5a3809d2b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 >> v1:172.21.15.106:6792/0 conn(0x7f5a380a1b10 legacy=0x7f5a3809d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 monclient: found mon.g 2024-04-25T23:58:53.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a3811fda0 con 0x7f5a380a1350 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: _finish_auth 0 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 5 monclient: authenticate success, global_id 5853 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _renew_subs 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5a381231a0 con 0x7f5a380a1350 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _renew_subs 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5a381d3990 con 0x7f5a380a1350 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5a280045f0 con 0x7f5a380a1350 2024-04-25T23:58:53.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5a28004b60 con 0x7f5a380a1350 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a35ffb640 4 set_mon_vals no callback set 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 10 monclient: dump: 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.680 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5a28004d80 con 0x7f5a380a1350 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a3db5a640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a18005090 con 0x7f5a380a1350 2024-04-25T23:58:53.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(101..101 src has 1..101) ==== 5272+0+0 (unknown 2519442 0 0) 0x7f5a28044be0 con 0x7f5a380a1350 2024-04-25T23:58:53.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.680+0000 7f5a36ffd640 10 monclient: get_auth_request con 0x7f5a24037800 auth_method 0 2024-04-25T23:58:53.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.684+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5a280158a0 con 0x7f5a380a1350 2024-04-25T23:58:53.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.684+0000 7f5a1ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:53.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.684+0000 7f5a1ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:53.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.852+0000 7f5a3db5a640 10 start_mon_command cmd=[{"prefix": "osd crush reweight", "name": "osd.11", "weight": 123456.0}] 2024-04-25T23:58:53.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.852+0000 7f5a3db5a640 10 monclient: _send_command 2 [{"prefix": "osd crush reweight", "name": "osd.11", "weight": 123456.0}] 2024-04-25T23:58:53.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.852+0000 7f5a3db5a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.852+0000 7f5a3db5a640 1 -- 172.21.15.171:0/2160243750 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush reweight", "name": "osd.11", "weight": 123456.0} v 0) -- 0x7f5a18005b90 con 0x7f5a380a1350 2024-04-25T23:58:53.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.856+0000 7f5a1ffff640 1 -- 172.21.15.171:0/2160243750 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush reweight", "name": "osd.11", "weight": 123456.0}]=-75 (75) Value too large for defined data type v101) ==== 146+0+0 (unknown 1716379202 0 0) 0x7f5a28019550 con 0x7f5a380a1350 2024-04-25T23:58:53.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.856+0000 7f5a1ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush reweight", "name": "osd.11", "weight": 123456.0}] 2024-04-25T23:58:53.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.856+0000 7f5a1ffff640 10 monclient: _finish_command 2 = mon:75 (75) Value too large for defined data type 2024-04-25T23:58:53.839 INFO:tasks.workunit.client.0.smithi171.stderr:Error EOVERFLOW: (75) Value too large for defined data type 2024-04-25T23:58:53.844 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:58:53.844 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:58:53.844 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep osd.11 2024-04-25T23:58:53.844 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 113 2024-04-25T23:58:53.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.972+0000 7f4d3d45d640 10 monclient: get_monmap_and_config 2024-04-25T23:58:53.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.972+0000 7f4d3d45d640 10 monclient: build_initial_monmap 2024-04-25T23:58:53.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.972+0000 7f4d3d45d640 10 monclient: monmap: 2024-04-25T23:58:53.958 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:53.958 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.958 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:53.978196+0000 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:53.978196+0000 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:53.959 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 Processor -- start 2024-04-25T23:58:53.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- start start 2024-04-25T23:58:53.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: init 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: _add_conns ranks=[8,1,5,2,6,3,7,4,0] 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient(hunting): picked mon.noname-e con 0x7f4d3809bb70 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient(hunting): picked mon.noname-f con 0x7f4d380a1a40 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient(hunting): picked mon.noname-h con 0x7f4d3809c660 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d380a2000 con 0x7f4d380a1a40 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3809e220 con 0x7f4d3809c660 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3809f580 con 0x7f4d3809bb70 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient(hunting): authenticate will time out at 1184.685255s 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d367fc640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f4d380a1a40 legacy=0x7f4d38139b80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d36ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4d3809bb70 legacy=0x7f4d3809bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d377fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4d3809c660 0x7f4d3813d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:57034/0 (socket says 172.21.15.171:57034) 2024-04-25T23:58:53.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d377fe640 1 -- 172.21.15.171:0/2091566140 learned_addr learned my addr 172.21.15.171:0/2091566140 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 849978338 0 0) 0x7f4d3809e220 con 0x7f4d3809c660 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient(hunting): my global_id is 5558 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d20003530 con 0x7f4d3809c660 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2618320908 0 0) 0x7f4d20003530 con 0x7f4d3809c660 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 >> v1:172.21.15.106:6793/0 conn(0x7f4d3809bb70 legacy=0x7f4d3809bf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 >> v1:172.21.15.171:6789/0 conn(0x7f4d380a1a40 legacy=0x7f4d38139b80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 monclient: found mon.noname-h 2024-04-25T23:58:53.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3809d310 con 0x7f4d3809c660 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d30001b40 con 0x7f4d3809c660 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: dump: 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.969 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 5 monclient: authenticate success, global_id 5558 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d30001ea0 con 0x7f4d3809c660 2024-04-25T23:58:53.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 1 -- 172.21.15.171:0/2091566140 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d300020d0 con 0x7f4d3809c660 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 4 set_mon_vals no callback set 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d35ffb640 10 monclient: dump: 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.971 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: shutdown 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- 172.21.15.171:0/2091566140 >> v1:172.21.15.171:6791/0 conn(0x7f4d3809c660 legacy=0x7f4d3813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:53.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- 172.21.15.171:0/2091566140 shutdown_connections 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- 172.21.15.171:0/2091566140 >> 172.21.15.171:0/2091566140 conn(0x7f4d380a28a0 msgr2=0x7f4d380a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- 172.21.15.171:0/2091566140 shutdown_connections 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- 172.21.15.171:0/2091566140 wait complete. 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: build_initial_monmap 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: monmap: 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:53.973 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:53.974 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 Processor -- start 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 1 -- start start 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.976+0000 7f4d3d45d640 10 monclient: init 2024-04-25T23:58:53.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _add_conns ranks=[3,4,7,0,5,2,6,1,8] 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient(hunting): picked mon.noname-g con 0x7f4d3809bb70 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient(hunting): picked mon.noname-c con 0x7f4d3809c660 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient(hunting): picked mon.noname-i con 0x7f4d380a1a40 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3809fbe0 con 0x7f4d3809bb70 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3809dd30 con 0x7f4d3809c660 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d38121790 con 0x7f4d380a1a40 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:53.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient(hunting): authenticate will time out at 1184.688275s 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d377fe640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f4d380a1a40 legacy=0x7f4d381d48f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d36ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f4d3809bb70 0x7f4d381370c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48772/0 (socket says 172.21.15.171:48772) 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d36ffd640 1 -- 172.21.15.171:0/3951597568 learned_addr learned my addr 172.21.15.171:0/3951597568 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d367fc640 1 -- 172.21.15.171:0/3951597568 >> v1:172.21.15.106:6791/0 conn(0x7f4d3809c660 legacy=0x7f4d381d11c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 417343553 0 0) 0x7f4d28003ae0 con 0x7f4d3809bb70 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:53.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): my global_id is 5862 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d24003530 con 0x7f4d3809bb70 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3980891213 0 0) 0x7f4d24003530 con 0x7f4d3809bb70 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d28003ae0 con 0x7f4d3809bb70 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d28004550 con 0x7f4d3809bb70 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): dump: 2024-04-25T23:58:53.978 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.979 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2163254747 0 0) 0x7f4d28003ae0 con 0x7f4d3809bb70 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 >> v1:172.21.15.171:6792/0 conn(0x7f4d380a1a40 legacy=0x7f4d381d48f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 >> v1:172.21.15.106:6791/0 conn(0x7f4d3809c660 legacy=0x7f4d381d11c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 monclient: found mon.g 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d38121a70 con 0x7f4d3809bb70 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 5 monclient: authenticate success, global_id 5862 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _renew_subs 2024-04-25T23:58:53.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d38072640 con 0x7f4d3809bb70 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _renew_subs 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d381377d0 con 0x7f4d3809bb70 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d280048b0 con 0x7f4d3809bb70 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d28004e20 con 0x7f4d3809bb70 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d357fa640 4 set_mon_vals no callback set 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 10 monclient: dump: 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.981 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:53.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d18005090 con 0x7f4d3809bb70 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4d28004fc0 con 0x7f4d3809bb70 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(101..101 src has 1..101) ==== 5272+0+0 (unknown 2519442 0 0) 0x7f4d28044dd0 con 0x7f4d3809bb70 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.980+0000 7f4d367fc640 10 monclient: get_auth_request con 0x7f4d240377e0 auth_method 0 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.984+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f4d3809fbe0 con 0x7f4d3809bb70 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.984+0000 7f4d1f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:53.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:53.984+0000 7f4d1f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:54.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.144+0000 7f4d3d45d640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:54.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.144+0000 7f4d3d45d640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:54.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.144+0000 7f4d3d45d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:54.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.144+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f4d18005b90 con 0x7f4d3809bb70 2024-04-25T23:58:54.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.144+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v101) ==== 56+0+1173 (unknown 4176898266 0 1268944078) 0x7f4d28015a80 con 0x7f4d3809bb70 2024-04-25T23:58:54.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.144+0000 7f4d1f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:58:54.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.144+0000 7f4d1f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:58:54.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.232+0000 7f4d3d45d640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:58:54.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.232+0000 7f4d3d45d640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:54.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.232+0000 7f4d3d45d640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:58:54.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.232+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f4d18005d60 con 0x7f4d3809bb70 2024-04-25T23:58:54.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d1f7fe640 1 -- 172.21.15.171:0/3951597568 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v101) ==== 56+0+1173 (unknown 4176898266 0 1268944078) 0x7f4d28015380 con 0x7f4d3809bb70 2024-04-25T23:58:54.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d1f7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:58:54.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d1f7fe640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:58:54.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 >> v1:172.21.15.171:6812/722422047 conn(0x7f4d240377e0 legacy=0x7f4d24039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 10 monclient: shutdown 2024-04-25T23:58:54.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:54.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 >> v1:172.21.15.171:6790/0 conn(0x7f4d3809bb70 legacy=0x7f4d381370c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 shutdown_connections 2024-04-25T23:58:54.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 >> 172.21.15.171:0/3951597568 conn(0x7f4d380a28a0 msgr2=0x7f4d38139480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:54.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 shutdown_connections 2024-04-25T23:58:54.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.236+0000 7f4d3d45d640 1 -- 172.21.15.171:0/3951597568 wait complete. 2024-04-25T23:58:54.234 INFO:tasks.workunit.client.0.smithi171.stdout: 11 113.00000 osd.11 down 1.00000 1.00000 2024-04-25T23:58:54.235 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm osd.11 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient: get_monmap_and_config 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient: build_initial_monmap 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient: monmap: 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:54.369035+0000 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:54.369035+0000 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.349 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:54.350 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 1 Processor -- start 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 1 -- start start 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient: init 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient: _add_conns ranks=[0,3,2,6,1,8,5,4,7] 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient(hunting): picked mon.noname-a con 0x7f28d8135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient(hunting): picked mon.noname-g con 0x7f28d81356f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient(hunting): picked mon.noname-b con 0x7f28d813c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d80a1da0 con 0x7f28d8135bb0 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d80a1fe0 con 0x7f28d813c130 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d8072720 con 0x7f28d81356f0 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:54.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.364+0000 7f28dfca2640 10 monclient(hunting): authenticate will time out at 1185.075891s 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dd23d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f28d81356f0 0x7f28d813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48786/0 (socket says 172.21.15.171:48786) 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dd23d640 1 -- 172.21.15.171:0/4205163976 learned_addr learned my addr 172.21.15.171:0/4205163976 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1126852583 0 0) 0x7f28d8072720 con 0x7f28d81356f0 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _negotiate 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): my global_id is 5871 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28c4003530 con 0x7f28d81356f0 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1720096798 0 0) 0x7f28d80a1fe0 con 0x7f28d813c130 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _negotiate 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:54.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): my global_id is 5609 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d8072720 con 0x7f28d813c130 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162803389 0 0) 0x7f28d80a1da0 con 0x7f28d8135bb0 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _negotiate 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient(hunting): my global_id is 5715 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d80a1fe0 con 0x7f28d8135bb0 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 495358593 0 0) 0x7f28c4003530 con 0x7f28d81356f0 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 >> v1:172.21.15.106:6790/0 conn(0x7f28d813c130 legacy=0x7f28d813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 >> v1:172.21.15.106:6789/0 conn(0x7f28d8135bb0 legacy=0x7f28d8135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: _finish_hunting 0 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 monclient: found mon.noname-g 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:54.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d80a17f0 con 0x7f28d81356f0 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: _finish_auth 0 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: _check_auth_tickets 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 5 monclient: authenticate success, global_id 5871 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f28c80017c0 con 0x7f28d81356f0 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: dump: 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.362 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.363 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28c8001ae0 con 0x7f28d81356f0 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 4 set_mon_vals no callback set 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 1 -- 172.21.15.171:0/4205163976 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f28c8004bf0 con 0x7f28d81356f0 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dca3c640 10 monclient: dump: 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.364 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient: shutdown 2024-04-25T23:58:54.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- 172.21.15.171:0/4205163976 >> v1:172.21.15.171:6790/0 conn(0x7f28d81356f0 legacy=0x7f28d813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- 172.21.15.171:0/4205163976 shutdown_connections 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- 172.21.15.171:0/4205163976 >> 172.21.15.171:0/4205163976 conn(0x7f28d80a2620 msgr2=0x7f28d80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- 172.21.15.171:0/4205163976 shutdown_connections 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- 172.21.15.171:0/4205163976 wait complete. 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient: build_initial_monmap 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient: monmap: 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:54.366 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 Processor -- start 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- start start 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient: init 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:54.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient: _add_conns ranks=[6,0,7,4,3,5,1,8,2] 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient(hunting): picked mon.noname-d con 0x7f28d81356f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient(hunting): picked mon.noname-a con 0x7f28d8135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient(hunting): picked mon.noname-i con 0x7f28d813c130 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d8071ef0 con 0x7f28d8135bb0 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d8070960 con 0x7f28d81356f0 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f28d8070c40 con 0x7f28d813c130 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dfca2640 10 monclient(hunting): authenticate will time out at 1185.079226s 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28de23f640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f28d813c130 legacy=0x7f28d81d4db0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dd23d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f28d8135bb0 0x7f28d81321d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:39022/0 (socket says 172.21.15.171:39022) 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dd23d640 1 -- 172.21.15.171:0/3217475677 learned_addr learned my addr 172.21.15.171:0/3217475677 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:54.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28dda3e640 1 --1- 172.21.15.171:0/3217475677 >> v1:172.21.15.106:6792/0 conn(0x7f28d81356f0 0x7f28d8131ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:60178/0 (socket says 172.21.15.171:60178) 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2627246 0 0) 0x7f28d8070960 con 0x7f28d81356f0 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28ce7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28ce7fc640 10 monclient(hunting): my global_id is 5667 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.368+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28bc003530 con 0x7f28d81356f0 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020294472 0 0) 0x7f28d80a17f0 con 0x7f28d8135bb0 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): my global_id is 5724 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f28d8070960 con 0x7f28d8135bb0 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2582529585 0 0) 0x7f28bc003530 con 0x7f28d81356f0 2024-04-25T23:58:54.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28d80a17f0 con 0x7f28d81356f0 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f28d4001a60 con 0x7f28d81356f0 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): dump: 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.370 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1347605356 0 0) 0x7f28d8070960 con 0x7f28d8135bb0 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f28bc003530 con 0x7f28d8135bb0 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f28c8001780 con 0x7f28d8135bb0 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient(hunting): dump: 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.371 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.373 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2874718970 0 0) 0x7f28d80a17f0 con 0x7f28d81356f0 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 >> v1:172.21.15.171:6792/0 conn(0x7f28d813c130 legacy=0x7f28d81d4db0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 >> v1:172.21.15.106:6789/0 conn(0x7f28d8135bb0 legacy=0x7f28d81321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 monclient: found mon.d 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:54.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28d81328e0 con 0x7f28d81356f0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: _finish_auth 0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 5 monclient: authenticate success, global_id 5667 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 10 monclient: _renew_subs 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f28d8133000 con 0x7f28d81356f0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 10 monclient: _renew_subs 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f28d8070f20 con 0x7f28d81356f0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f28d4001d40 con 0x7f28d81356f0 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:54.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f28d4003c10 con 0x7f28d81356f0 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28cffff640 4 set_mon_vals no callback set 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 10 monclient: dump: 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.376 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28c0005090 con 0x7f28d81356f0 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f28d4003e30 con 0x7f28d81356f0 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(101..101 src has 1..101) ==== 5272+0+0 (unknown 2519442 0 0) 0x7f28d4044930 con 0x7f28d81356f0 2024-04-25T23:58:54.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.372+0000 7f28dd23d640 10 monclient: get_auth_request con 0x7f28bc037cb0 auth_method 0 2024-04-25T23:58:54.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.384+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f28d40156b0 con 0x7f28d81356f0 2024-04-25T23:58:54.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.384+0000 7f28ce7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:54.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.384+0000 7f28ce7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:54.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.552+0000 7f28dfca2640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.11"}] 2024-04-25T23:58:54.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.552+0000 7f28dfca2640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "osd.11"}] 2024-04-25T23:58:54.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.552+0000 7f28dfca2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.552+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.11"} v 0) -- 0x7f28c0005380 con 0x7f28d81356f0 2024-04-25T23:58:54.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.580+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.11"}]=0 removed item id 11 name 'osd.11' from crush map v102) ==== 125+0+0 (unknown 1807744277 0 0) 0x7f28d4014fb0 con 0x7f28d81356f0 2024-04-25T23:58:54.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.580+0000 7f28ce7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "osd.11"}] 2024-04-25T23:58:54.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.580+0000 7f28ce7fc640 10 monclient: _finish_command 2 = system:0 removed item id 11 name 'osd.11' from crush map 2024-04-25T23:58:54.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.680+0000 7f28dfca2640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.11"}] 2024-04-25T23:58:54.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.680+0000 7f28dfca2640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "osd.11"}] 2024-04-25T23:58:54.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.680+0000 7f28dfca2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.680+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.11"} v 0) -- 0x7f28c00010a0 con 0x7f28d81356f0 2024-04-25T23:58:54.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28ce7fc640 1 -- 172.21.15.171:0/3217475677 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.11"}]=0 device 'osd.11' does not appear in the crush map v102) ==== 126+0+0 (unknown 4119740108 0 0) 0x7f28d401db60 con 0x7f28d81356f0 2024-04-25T23:58:54.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28ce7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "osd.11"}] 2024-04-25T23:58:54.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28ce7fc640 10 monclient: _finish_command 3 = system:0 device 'osd.11' does not appear in the crush map 2024-04-25T23:58:54.668 INFO:tasks.workunit.client.0.smithi171.stderr:device 'osd.11' does not appear in the crush map 2024-04-25T23:58:54.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 >> v1:172.21.15.171:6812/722422047 conn(0x7f28bc037cb0 legacy=0x7f28bc03a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 10 monclient: shutdown 2024-04-25T23:58:54.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:54.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 >> v1:172.21.15.106:6792/0 conn(0x7f28d81356f0 legacy=0x7f28d8131ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 shutdown_connections 2024-04-25T23:58:54.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 >> 172.21.15.171:0/3217475677 conn(0x7f28d80a2620 msgr2=0x7f28d813e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:54.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 shutdown_connections 2024-04-25T23:58:54.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.684+0000 7f28dfca2640 1 -- 172.21.15.171:0/3217475677 wait complete. 2024-04-25T23:58:54.684 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd rm osd.11 2024-04-25T23:58:54.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient: get_monmap_and_config 2024-04-25T23:58:54.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient: build_initial_monmap 2024-04-25T23:58:54.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient: monmap: 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:54.819803+0000 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:54.819803+0000 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:54.800 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:54.801 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:54.801 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:54.801 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:54.801 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 1 Processor -- start 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 1 -- start start 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient: init 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient: _add_conns ranks=[1,5,7,8,0,4,2,6,3] 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient(hunting): picked mon.noname-f con 0x7f0e580a39b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient(hunting): picked mon.noname-h con 0x7f0e580a1e90 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient(hunting): picked mon.noname-i con 0x7f0e58135d70 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e581361c0 con 0x7f0e580a39b0 2024-04-25T23:58:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e58136430 con 0x7f0e580a1e90 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e58072b50 con 0x7f0e58135d70 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5d474640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f0e580a39b0 legacy=0x7f0e580a1780 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5f6d8640 10 monclient(hunting): authenticate will time out at 1185.527512s 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5dc75640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f0e58135d70 legacy=0x7f0e5813e220 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5cc73640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f0e580a1e90 0x7f0e5813aaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:57036/0 (socket says 172.21.15.171:57036) 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.816+0000 7f0e5cc73640 1 -- 172.21.15.171:0/2484783417 learned_addr learned my addr 172.21.15.171:0/2484783417 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 619347663 0 0) 0x7f0e58136430 con 0x7f0e580a1e90 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient(hunting): my global_id is 5567 2024-04-25T23:58:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e44003530 con 0x7f0e580a1e90 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3540841298 0 0) 0x7f0e44003530 con 0x7f0e580a1e90 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 >> v1:172.21.15.171:6792/0 conn(0x7f0e58135d70 legacy=0x7f0e5813e220 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 >> v1:172.21.15.171:6789/0 conn(0x7f0e580a39b0 legacy=0x7f0e580a1780 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 monclient: found mon.noname-h 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e58072e30 con 0x7f0e580a1e90 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: _finish_auth 0 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0e480017c0 con 0x7f0e580a1e90 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 5 monclient: authenticate success, global_id 5567 2024-04-25T23:58:54.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: dump: 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.809 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e48001b20 con 0x7f0e580a1e90 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 4 set_mon_vals no callback set 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 1 -- 172.21.15.171:0/2484783417 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0e48001d50 con 0x7f0e580a1e90 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:54.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4ffff640 10 monclient: dump: 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.811 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient: shutdown 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/2484783417 >> v1:172.21.15.171:6791/0 conn(0x7f0e580a1e90 legacy=0x7f0e5813aaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/2484783417 shutdown_connections 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/2484783417 >> 172.21.15.171:0/2484783417 conn(0x7f0e5806b1c0 msgr2=0x7f0e5806b5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/2484783417 shutdown_connections 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/2484783417 wait complete. 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient: build_initial_monmap 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient: monmap: 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.812 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 Processor -- start 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- start start 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient: init 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:54.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient: _add_conns ranks=[6,7,4,3,2,0,1,8,5] 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient(hunting): picked mon.noname-d con 0x7f0e580a39b0 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient(hunting): picked mon.noname-i con 0x7f0e58135d70 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient(hunting): picked mon.noname-c con 0x7f0e58120f40 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e581203e0 con 0x7f0e58120f40 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e581226d0 con 0x7f0e580a39b0 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e58121e30 con 0x7f0e58135d70 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5f6d8640 10 monclient(hunting): authenticate will time out at 1185.530555s 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5cc73640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f0e58135d70 legacy=0x7f0e581cd2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5dc75640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f0e58120f40 legacy=0x7f0e581d09d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5d474640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f0e580a39b0 0x7f0e58134d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:60198/0 (socket says 172.21.15.171:60198) 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e5d474640 1 -- 172.21.15.171:0/210288797 learned_addr learned my addr 172.21.15.171:0/210288797 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:54.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3949080256 0 0) 0x7f0e581226d0 con 0x7f0e580a39b0 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): my global_id is 5676 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e3c003530 con 0x7f0e580a39b0 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3248687443 0 0) 0x7f0e3c003530 con 0x7f0e580a39b0 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e581226d0 con 0x7f0e580a39b0 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0e54004300 con 0x7f0e580a39b0 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): dump: 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.815 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.816 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.817 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.817 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.817 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.820+0000 7f0e4dffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:54.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3123824966 0 0) 0x7f0e581226d0 con 0x7f0e580a39b0 2024-04-25T23:58:54.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 >> v1:172.21.15.171:6792/0 conn(0x7f0e58135d70 legacy=0x7f0e581cd2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:54.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 >> v1:172.21.15.106:6791/0 conn(0x7f0e58120f40 legacy=0x7f0e581d09d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:54.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:58:54.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 monclient: found mon.d 2024-04-25T23:58:54.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e58135420 con 0x7f0e580a39b0 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: _finish_auth 0 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 5 monclient: authenticate success, global_id 5676 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 10 monclient: _renew_subs 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e581c83e0 con 0x7f0e580a39b0 2024-04-25T23:58:54.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 10 monclient: _renew_subs 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e581c88a0 con 0x7f0e580a39b0 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e54004560 con 0x7f0e580a39b0 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0e54004a50 con 0x7f0e580a39b0 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4f7fe640 4 set_mon_vals no callback set 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 10 monclient: dump: 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:54.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e38005090 con 0x7f0e580a39b0 2024-04-25T23:58:54.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0e54004c70 con 0x7f0e580a39b0 2024-04-25T23:58:54.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(102..102 src has 1..102) ==== 5250+0+0 (unknown 1407218054 0 0) 0x7f0e54044b20 con 0x7f0e580a39b0 2024-04-25T23:58:54.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.824+0000 7f0e5cc73640 10 monclient: get_auth_request con 0x7f0e3c037830 auth_method 0 2024-04-25T23:58:54.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.836+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0e54015710 con 0x7f0e580a39b0 2024-04-25T23:58:54.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.836+0000 7f0e4dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:54.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:54.836+0000 7f0e4dffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:54.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.004+0000 7f0e5f6d8640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["osd.11"]}] 2024-04-25T23:58:54.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.004+0000 7f0e5f6d8640 10 monclient: _send_command 2 [{"prefix": "osd rm", "ids": ["osd.11"]}] 2024-04-25T23:58:54.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.004+0000 7f0e5f6d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:54.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.004+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd rm", "ids": ["osd.11"]} v 0) -- 0x7f0e38005380 con 0x7f0e580a39b0 2024-04-25T23:58:54.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:58:55.009+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e102 definitely_dead 0 2024-04-25T23:58:55.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.580+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["osd.11"]}]=0 removed osd.11 v103) ==== 87+0+0 (unknown 1647965412 0 0) 0x7f0e54015010 con 0x7f0e580a39b0 2024-04-25T23:58:55.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.580+0000 7f0e4dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd rm", "ids": ["osd.11"]}] 2024-04-25T23:58:55.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.580+0000 7f0e4dffb640 10 monclient: _finish_command 2 = system:0 removed osd.11 2024-04-25T23:58:55.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.688+0000 7f0e5f6d8640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["osd.11"]}] 2024-04-25T23:58:55.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.688+0000 7f0e5f6d8640 10 monclient: _send_command 3 [{"prefix": "osd rm", "ids": ["osd.11"]}] 2024-04-25T23:58:55.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.688+0000 7f0e5f6d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:58:55.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.688+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd rm", "ids": ["osd.11"]} v 0) -- 0x7f0e38005ac0 con 0x7f0e580a39b0 2024-04-25T23:58:55.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:58:55.693+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e103 definitely_dead 0 2024-04-25T23:58:55.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e4dffb640 1 -- 172.21.15.171:0/210288797 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["osd.11"]}]=0 osd.11 does not exist. v103) ==== 96+0+0 (unknown 131915146 0 0) 0x7f0e54019360 con 0x7f0e580a39b0 2024-04-25T23:58:55.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e4dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd rm", "ids": ["osd.11"]}] 2024-04-25T23:58:55.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e4dffb640 10 monclient: _finish_command 3 = system:0 osd.11 does not exist. 2024-04-25T23:58:55.675 INFO:tasks.workunit.client.0.smithi171.stderr:osd.11 does not exist. 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 >> v1:172.21.15.171:6812/722422047 conn(0x7f0e3c037830 legacy=0x7f0e3c039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 10 monclient: shutdown 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 >> v1:172.21.15.106:6792/0 conn(0x7f0e580a39b0 legacy=0x7f0e58134d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 shutdown_connections 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 >> 172.21.15.171:0/210288797 conn(0x7f0e5806b1c0 msgr2=0x7f0e580a67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 shutdown_connections 2024-04-25T23:58:55.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.692+0000 7f0e5f6d8640 1 -- 172.21.15.171:0/210288797 wait complete. 2024-04-25T23:58:55.691 INFO:tasks.workunit.client.0.smithi171.stderr:++ ceph osd create 2024-04-25T23:58:55.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.820+0000 7f52ecd2d640 10 monclient: get_monmap_and_config 2024-04-25T23:58:55.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.820+0000 7f52ecd2d640 10 monclient: build_initial_monmap 2024-04-25T23:58:55.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.820+0000 7f52ecd2d640 10 monclient: monmap: 2024-04-25T23:58:55.806 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:55.806 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:55.806 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:58:55.826356+0000 2024-04-25T23:58:55.806 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:58:55.826356+0000 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:55.807 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 Processor -- start 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- start start 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient: init 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient: _add_conns ranks=[7,2,1,0,4,5,8,6,3] 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient(hunting): picked mon.noname-i con 0x7f52e81328a0 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient(hunting): picked mon.noname-b con 0x7f52e809b840 addr v1:172.21.15.106:6790/0 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient(hunting): picked mon.noname-f con 0x7f52e809b3e0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e8133390 con 0x7f52e809b3e0 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e809cc80 con 0x7f52e809b840 2024-04-25T23:58:55.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e809c2a0 con 0x7f52e81328a0 2024-04-25T23:58:55.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e659c640 1 -- >> v1:172.21.15.171:6792/0 conn(0x7f52e81328a0 legacy=0x7f52e8132c80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6792/0 2024-04-25T23:58:55.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:55.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient(hunting): authenticate will time out at 1186.533695s 2024-04-25T23:58:55.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e6d9d640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f52e809b3e0 legacy=0x7f52e813e1b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:55.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e5d9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f52e809b840 0x7f52e813aa80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:60726/0 (socket says 172.21.15.171:60726) 2024-04-25T23:58:55.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e5d9b640 1 -- 172.21.15.171:0/1237774323 learned_addr learned my addr 172.21.15.171:0/1237774323 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2597644338 0 0) 0x7f52e809cc80 con 0x7f52e809b840 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient(hunting): _negotiate 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient(hunting): my global_id is 5618 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52d0003530 con 0x7f52e809b840 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2982913667 0 0) 0x7f52d0003530 con 0x7f52e809b840 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 >> v1:172.21.15.171:6792/0 conn(0x7f52e81328a0 legacy=0x7f52e8132c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:55.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 >> v1:172.21.15.171:6789/0 conn(0x7f52e809b3e0 legacy=0x7f52e813e1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: _finish_hunting 0 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 monclient: found mon.noname-b 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e809f7b0 con 0x7f52e809b840 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: _finish_auth 0 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: _check_auth_tickets 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f52d80017c0 con 0x7f52e809b840 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: dump: 2024-04-25T23:58:55.814 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:55.815 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 5 monclient: authenticate success, global_id 5618 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52d8001b20 con 0x7f52e809b840 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient: get_monmap_and_config success 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 4 set_mon_vals no callback set 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 1 -- 172.21.15.171:0/1237774323 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f52d8001d50 con 0x7f52e809b840 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52e559a640 10 monclient: dump: 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:55.816 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 10 monclient: shutdown 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- 172.21.15.171:0/1237774323 >> v1:172.21.15.106:6790/0 conn(0x7f52e809b840 legacy=0x7f52e813aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- 172.21.15.171:0/1237774323 shutdown_connections 2024-04-25T23:58:55.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- 172.21.15.171:0/1237774323 >> 172.21.15.171:0/1237774323 conn(0x7f52e80a28a0 msgr2=0x7f52e80a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- 172.21.15.171:0/1237774323 shutdown_connections 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.824+0000 7f52ecd2d640 1 -- 172.21.15.171:0/1237774323 wait complete. 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: build_initial_monmap 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: monmap: 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:55.818 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 Processor -- start 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 -- start start 2024-04-25T23:58:55.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: init 2024-04-25T23:58:55.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:55.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _add_conns ranks=[5,6,1,3,8,2,0,4,7] 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient(hunting): picked mon.noname-h con 0x7f52e809b3e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient(hunting): picked mon.noname-d con 0x7f52e809b840 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient(hunting): picked mon.noname-f con 0x7f52e81328a0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e813b9a0 con 0x7f52e81328a0 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e813bc80 con 0x7f52e809b3e0 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52e6d9d640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f52e81328a0 legacy=0x7f52e81d2990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52e8072c20 con 0x7f52e809b840 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52e659c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f52e809b3e0 0x7f52e8137cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:57046/0 (socket says 172.21.15.171:57046) 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient(hunting): authenticate will time out at 1186.537812s 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52e659c640 1 -- 172.21.15.171:0/3439242728 learned_addr learned my addr 172.21.15.171:0/3439242728 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3206669022 0 0) 0x7f52e813bc80 con 0x7f52e809b3e0 2024-04-25T23:58:55.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): my global_id is 5576 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c8003530 con 0x7f52e809b3e0 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 114107896 0 0) 0x7f52c8003530 con 0x7f52e809b3e0 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52e813bc80 con 0x7f52e809b3e0 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f52dc004680 con 0x7f52e809b3e0 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): dump: 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:55.824 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:58:55.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237055600 0 0) 0x7f52e8072c20 con 0x7f52e809b840 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient(hunting): my global_id is 5685 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f52c8003530 con 0x7f52e809b840 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1010520136 0 0) 0x7f52e813bc80 con 0x7f52e809b3e0 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 >> v1:172.21.15.106:6792/0 conn(0x7f52e809b840 legacy=0x7f52e81383d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 >> v1:172.21.15.171:6789/0 conn(0x7f52e81328a0 legacy=0x7f52e81d2990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 monclient: found mon.h 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52e8073100 con 0x7f52e809b3e0 2024-04-25T23:58:55.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 5 monclient: authenticate success, global_id 5576 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _renew_subs 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f52e8139990 con 0x7f52e809b3e0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _renew_subs 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52dc004970 con 0x7f52e809b3e0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f52e813e550 con 0x7f52e809b3e0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f52dc004ee0 con 0x7f52e809b3e0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:58:55.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d7fff640 4 set_mon_vals no callback set 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 10 monclient: dump: 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:58:55.828 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f52dc005140 con 0x7f52e809b3e0 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52e8068fb0 con 0x7f52e809b3e0 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(103..103 src has 1..103) ==== 5240+0+0 (unknown 101349498 0 0) 0x7f52dc045050 con 0x7f52e809b3e0 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.828+0000 7f52e5d9b640 10 monclient: get_auth_request con 0x7f52c8037820 auth_method 0 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.836+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f52dc015c50 con 0x7f52e809b3e0 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.836+0000 7f52d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:58:55.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:55.836+0000 7f52d6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:58:55.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:56.004+0000 7f52ecd2d640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:58:55.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:56.004+0000 7f52ecd2d640 10 monclient: _send_command 2 [{"prefix": "osd create"}] 2024-04-25T23:58:55.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:56.004+0000 7f52ecd2d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:58:55.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:56.004+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f52e8075940 con 0x7f52e809b3e0 2024-04-25T23:58:56.363 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-25T23:58:56.364 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-04-25T23:58:56.364 INFO:tasks.ceph.mon.f:Restarting daemon 2024-04-25T23:58:56.364 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-04-25T23:58:56.367 INFO:tasks.ceph.mon.f:Started 2024-04-25T23:58:56.367 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-25T23:58:56.367 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-04-25T23:58:56.367 INFO:tasks.ceph.mon.e:Restarting daemon 2024-04-25T23:58:56.367 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-04-25T23:58:56.370 INFO:tasks.ceph.mon.e:Started 2024-04-25T23:58:56.370 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-04-25T23:58:56.370 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-04-25T23:58:56.370 INFO:tasks.ceph.mon.i:Restarting daemon 2024-04-25T23:58:56.370 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-04-25T23:58:56.372 INFO:tasks.ceph.mon.i:Started 2024-04-25T23:58:56.372 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-25T23:58:56.372 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-25T23:58:56.372 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T23:58:56.373 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T23:58:56.375 INFO:tasks.ceph.mon.c:Started 2024-04-25T23:58:56.375 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-25T23:58:56.375 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:58:56.459 INFO:tasks.ceph.mon.i.smithi171.stderr:2024-04-25T23:58:56.476+0000 7f438a336c80 -1 mon.i@-1(???).log v0 log_external_backlog rewinding external_log_to from 89 -> 0 (sync_force? mon rebuild?) 2024-04-25T23:58:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient: get_monmap_and_config 2024-04-25T23:58:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient: build_initial_monmap 2024-04-25T23:58:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient: monmap: 2024-04-25T23:58:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:58:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:58:56.504 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:58:56.524801+0000 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:58:56.524801+0000 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:58:56.505 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:58:56.506 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:58:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 1 Processor -- start 2024-04-25T23:58:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 1 -- start start 2024-04-25T23:58:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient: init 2024-04-25T23:58:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient: _reopen_session rank -1 2024-04-25T23:58:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient: _add_conns ranks=[7,6,3,1,2,5,4,8,0] 2024-04-25T23:58:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient(hunting): picked mon.noname-i con 0x7fdc74137730 addr v1:172.21.15.171:6792/0 2024-04-25T23:58:56.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient(hunting): picked mon.noname-d con 0x7fdc740a0b20 addr v1:172.21.15.106:6792/0 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient(hunting): picked mon.noname-g con 0x7fdc74138220 addr v1:172.21.15.171:6790/0 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740a2750 con 0x7fdc74138220 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740a2a30 con 0x7fdc740a0b20 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740a2d10 con 0x7fdc74137730 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc7a5dd640 10 monclient(hunting): authenticate will time out at 1192.051612s 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc6bfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fdc740a0b20 0x7fdc7413ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53092/0 (socket says 172.21.15.106:53092) 2024-04-25T23:58:56.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:56.521+0000 7fdc6bfff640 1 -- 172.21.15.106:0/1608901426 learned_addr learned my addr 172.21.15.106:0/1608901426 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:58:58.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:58.828+0000 7f52d5ffb640 10 monclient: tick 2024-04-25T23:58:58.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:58.828+0000 7f52d5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:58.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:58.828+0000 7f52d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:58:58.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:58.828+0000 7f52d5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 10 monclient(hunting): tick 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 1 monclient(hunting): continuing hunt 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 1 -- 172.21.15.106:0/1608901426 >> v1:172.21.15.171:6792/0 conn(0x7fdc74137730 legacy=0x7fdc74137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 1 -- 172.21.15.106:0/1608901426 >> v1:172.21.15.106:6792/0 conn(0x7fdc740a0b20 legacy=0x7fdc7413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 1 -- 172.21.15.106:0/1608901426 >> v1:172.21.15.171:6790/0 conn(0x7fdc74138220 legacy=0x7fdc74140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 10 monclient: _add_conns ranks=[1,8,4,5,0,2] 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 10 monclient(hunting): picked mon.noname-f con 0x7fdc540037f0 addr v1:172.21.15.171:6789/0 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 10 monclient(hunting): picked mon.noname-e con 0x7fdc54007460 addr v1:172.21.15.106:6793/0 2024-04-25T23:58:59.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.521+0000 7fdc727fc640 10 monclient(hunting): picked mon.noname-c con 0x7fdc5400b1b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:58:59.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.525+0000 7fdc727fc640 1 -- 172.21.15.106:0/1608901426 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740a4680 con 0x7fdc540037f0 2024-04-25T23:58:59.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.525+0000 7fdc727fc640 1 -- 172.21.15.106:0/1608901426 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc5400ffe0 con 0x7fdc5400b1b0 2024-04-25T23:58:59.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.525+0000 7fdc727fc640 1 -- 172.21.15.106:0/1608901426 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc54011270 con 0x7fdc54007460 2024-04-25T23:58:59.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:58:59.525+0000 7fdc727fc640 10 monclient(hunting): _renew_subs 2024-04-25T23:58:59.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:59.828+0000 7f52d5ffb640 10 monclient: tick 2024-04-25T23:58:59.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:59.828+0000 7f52d5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:58:59.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:58:59.828+0000 7f52d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:00.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:00.828+0000 7f52d5ffb640 10 monclient: tick 2024-04-25T23:59:00.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:00.828+0000 7f52d5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:00.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:00.828+0000 7f52d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:01.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.577+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504959171 0 0) 0x7fdc740a4680 con 0x7fdc540037f0 2024-04-25T23:59:01.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.577+0000 7fdc737fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.577+0000 7fdc737fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.577+0000 7fdc737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.577+0000 7fdc737fe640 10 monclient(hunting): my global_id is 144100 2024-04-25T23:59:01.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.577+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc60003530 con 0x7fdc540037f0 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2404287752 0 0) 0x7fdc60003530 con 0x7fdc540037f0 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 >> v1:172.21.15.106:6793/0 conn(0x7fdc54007460 legacy=0x7fdc54009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 >> v1:172.21.15.106:6791/0 conn(0x7fdc5400b1b0 legacy=0x7fdc5400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 monclient: found mon.noname-f 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc54012500 con 0x7fdc540037f0 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:01.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 5 monclient: authenticate success, global_id 144100 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc64001800 con 0x7fdc540037f0 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc78b7a640 1 -- 172.21.15.106:0/1608901426 reap_dead start 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: dump: 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.564 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc64001ac0 con 0x7fdc540037f0 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 1 -- 172.21.15.106:0/1608901426 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc64003940 con 0x7fdc540037f0 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:01.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc737fe640 10 monclient: dump: 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.566 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.567 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:01.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 4 set_mon_vals no callback set 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 10 monclient: shutdown 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/1608901426 >> v1:172.21.15.171:6789/0 conn(0x7fdc540037f0 legacy=0x7fdc54005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/1608901426 shutdown_connections 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/1608901426 >> 172.21.15.106:0/1608901426 conn(0x7fdc740a6b80 msgr2=0x7fdc740a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/1608901426 shutdown_connections 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.581+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/1608901426 wait complete. 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.585+0000 7fdc7a5dd640 10 monclient: build_initial_monmap 2024-04-25T23:59:01.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.585+0000 7fdc7a5dd640 10 monclient: monmap: 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:01.569 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:01.570 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.585+0000 7fdc7a5dd640 1 Processor -- start 2024-04-25T23:59:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.585+0000 7fdc7a5dd640 1 -- start start 2024-04-25T23:59:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.585+0000 7fdc7a5dd640 10 monclient: init 2024-04-25T23:59:01.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 10 monclient: _add_conns ranks=[2,8,3,5,6,1,0,4,7] 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 10 monclient(hunting): picked mon.noname-b con 0x7fdc540037f0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc73fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fdc540037f0 0x7fdc741cc540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39318/0 (socket says 172.21.15.106:39318) 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 10 monclient(hunting): picked mon.noname-e con 0x7fdc741212e0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 10 monclient(hunting): picked mon.noname-g con 0x7fdc741d2a10 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc741cd360 con 0x7fdc540037f0 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc740a0110 con 0x7fdc741d2a10 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc741228e0 con 0x7fdc741212e0 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:01.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc7a5dd640 10 monclient(hunting): authenticate will time out at 1197.116915s 2024-04-25T23:59:01.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc6bfff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fdc741212e0 0x7fdc741ccc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40402/0 (socket says 172.21.15.106:40402) 2024-04-25T23:59:01.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc6bfff640 1 -- 172.21.15.106:0/2375036263 learned_addr learned my addr 172.21.15.106:0/2375036263 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:01.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 81486492 0 0) 0x7fdc741cd360 con 0x7fdc540037f0 2024-04-25T23:59:01.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc717fa640 10 monclient(hunting): my global_id is 5627 2024-04-25T23:59:01.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.589+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc54005400 con 0x7fdc540037f0 2024-04-25T23:59:01.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665231929 0 0) 0x7fdc741228e0 con 0x7fdc741212e0 2024-04-25T23:59:01.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): my global_id is 144107 2024-04-25T23:59:01.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc741cd360 con 0x7fdc741212e0 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1843901271 0 0) 0x7fdc741cd360 con 0x7fdc741212e0 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc741228e0 con 0x7fdc741212e0 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc5c001a30 con 0x7fdc741212e0 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): dump: 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.582 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.597+0000 7fdc717fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1661091145 0 0) 0x7fdc54005400 con 0x7fdc540037f0 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc741cd360 con 0x7fdc540037f0 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc64003940 con 0x7fdc540037f0 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:01.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 10 monclient(hunting): dump: 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.584 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924358542 0 0) 0x7fdc740a0110 con 0x7fdc741d2a10 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 10 monclient(hunting): my global_id is 5880 2024-04-25T23:59:01.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.601+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc54005400 con 0x7fdc741d2a10 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2330485496 0 0) 0x7fdc741cd360 con 0x7fdc540037f0 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 >> v1:172.21.15.106:6793/0 conn(0x7fdc741212e0 legacy=0x7fdc741ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 >> v1:172.21.15.171:6790/0 conn(0x7fdc741d2a10 legacy=0x7fdc741d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 monclient: found mon.b 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc741235c0 con 0x7fdc540037f0 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc7a5dd640 5 monclient: authenticate success, global_id 5627 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc7a5dd640 10 monclient: _renew_subs 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc7a5dd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7409f730 con 0x7fdc540037f0 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc7a5dd640 10 monclient: _renew_subs 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc7a5dd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdc741d66f0 con 0x7fdc540037f0 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc64001ac0 con 0x7fdc540037f0 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:01.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc64001840 con 0x7fdc540037f0 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc727fc640 4 set_mon_vals no callback set 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 10 monclient: dump: 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.590 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.591 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.591 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.591 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.605+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdc64004190 con 0x7fdc540037f0 2024-04-25T23:59:01.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.609+0000 7fdc7a5dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:01.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.609+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(103..103 src has 1..103) ==== 5240+0+0 (unknown 101349498 0 0) 0x7fdc64044a00 con 0x7fdc540037f0 2024-04-25T23:59:01.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.609+0000 7fdc7a5dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:01.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.609+0000 7fdc7a5dd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.609+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc58005090 con 0x7fdc540037f0 2024-04-25T23:59:01.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.609+0000 7fdc6bfff640 10 monclient: get_auth_request con 0x7fdc540395d0 auth_method 0 2024-04-25T23:59:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.613+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdc64015720 con 0x7fdc540037f0 2024-04-25T23:59:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.613+0000 7fdc717fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:01.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.613+0000 7fdc717fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:01.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.632+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd create"}]=0 v104) ==== 58+0+3 (unknown 3188624585 0 212448812) 0x7f52dc015550 con 0x7f52e809b3e0 2024-04-25T23:59:01.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.632+0000 7f52d6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create"}] 2024-04-25T23:59:01.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.632+0000 7f52d6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:01.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.740+0000 7f52ecd2d640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:59:01.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.740+0000 7f52ecd2d640 10 monclient: _send_command 3 [{"prefix": "osd create"}] 2024-04-25T23:59:01.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.740+0000 7f52ecd2d640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:01.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.740+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f52e813f8d0 con 0x7f52e809b3e0 2024-04-25T23:59:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.828+0000 7f52d5ffb640 10 monclient: tick 2024-04-25T23:59:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.828+0000 7f52d5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:01.828+0000 7f52d5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.841+0000 7fdc7a5dd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:59:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.841+0000 7fdc7a5dd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.841+0000 7fdc7a5dd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.841+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdc58005380 con 0x7fdc540037f0 2024-04-25T23:59:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc717fa640 1 -- 172.21.15.106:0/2375036263 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2475632066) 0x7fdc64015020 con 0x7fdc540037f0 2024-04-25T23:59:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc717fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc717fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:01.826 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":34,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:59:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 >> v1:172.21.15.171:6812/722422047 conn(0x7fdc540395d0 legacy=0x7fdc5403ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 10 monclient: shutdown 2024-04-25T23:59:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 >> v1:172.21.15.106:6790/0 conn(0x7fdc540037f0 legacy=0x7fdc741cc540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 shutdown_connections 2024-04-25T23:59:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 >> 172.21.15.106:0/2375036263 conn(0x7fdc740a6b80 msgr2=0x7fdc74135ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 shutdown_connections 2024-04-25T23:59:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.845+0000 7fdc7a5dd640 1 -- 172.21.15.106:0/2375036263 wait complete. 2024-04-25T23:59:01.844 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-25T23:59:01.844 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-25T23:59:01.844 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient: get_monmap_and_config 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient: build_initial_monmap 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient: monmap: 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:01.988717+0000 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:01.988717+0000 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.968 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:01.969 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 1 Processor -- start 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 1 -- start start 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient: init 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient: _add_conns ranks=[0,8,4,7,1,2,5,3,6] 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient(hunting): picked mon.noname-a con 0x7fd798134970 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient(hunting): picked mon.noname-e con 0x7fd7980a4820 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient(hunting): picked mon.noname-c con 0x7fd79813e200 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79806dd40 con 0x7fd798134970 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7980a2b10 con 0x7fd79813e200 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7980a2df0 con 0x7fd7980a4820 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.985+0000 7fd79dedc640 10 monclient(hunting): authenticate will time out at 1197.515959s 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7977fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd798134970 0x7fd798134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41264/0 (socket says 172.21.15.106:41264) 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7977fe640 1 -- 172.21.15.106:0/4244552388 learned_addr learned my addr 172.21.15.106:0/4244552388 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:01.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1290835244 0 0) 0x7fd79806dd40 con 0x7fd798134970 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): my global_id is 5733 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd784003530 con 0x7fd798134970 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1104542030 0 0) 0x7fd7980a2b10 con 0x7fd79813e200 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): my global_id is 144112 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd79806dd40 con 0x7fd79813e200 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116340260 0 0) 0x7fd7980a2df0 con 0x7fd7980a4820 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient(hunting): my global_id is 144116 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7980a2b10 con 0x7fd7980a4820 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 264542907 0 0) 0x7fd784003530 con 0x7fd798134970 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 >> v1:172.21.15.106:6793/0 conn(0x7fd7980a4820 legacy=0x7fd79813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 >> v1:172.21.15.106:6791/0 conn(0x7fd79813e200 legacy=0x7fd7981405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 monclient: found mon.noname-a 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7980a30d0 con 0x7fd798134970 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd788001b40 con 0x7fd798134970 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 5 monclient: authenticate success, global_id 5733 2024-04-25T23:59:01.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: dump: 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.980 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd788001df0 con 0x7fd798134970 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 4 set_mon_vals no callback set 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 1 -- 172.21.15.106:0/4244552388 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd788002060 con 0x7fd798134970 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7967fc640 10 monclient: dump: 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.981 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.982 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient: shutdown 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- 172.21.15.106:0/4244552388 >> v1:172.21.15.106:6789/0 conn(0x7fd798134970 legacy=0x7fd798134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- 172.21.15.106:0/4244552388 shutdown_connections 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- 172.21.15.106:0/4244552388 >> 172.21.15.106:0/4244552388 conn(0x7fd7980a9e20 msgr2=0x7fd7980aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- 172.21.15.106:0/4244552388 shutdown_connections 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- 172.21.15.106:0/4244552388 wait complete. 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient: build_initial_monmap 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient: monmap: 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:01.983 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 Processor -- start 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- start start 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient: init 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient: _add_conns ranks=[2,1,7,3,0,5,4,6,8] 2024-04-25T23:59:01.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient(hunting): picked mon.noname-b con 0x7fd7980a4820 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient(hunting): picked mon.noname-f con 0x7fd798134970 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient(hunting): picked mon.noname-i con 0x7fd79813e200 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd79812b330 con 0x7fd798134970 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7980a1e00 con 0x7fd7980a4820 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd798138150 con 0x7fd79813e200 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd79dedc640 10 monclient(hunting): authenticate will time out at 1197.519270s 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7977fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd7980a4820 0x7fd79812a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39328/0 (socket says 172.21.15.106:39328) 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd7977fe640 1 -- 172.21.15.106:0/948375431 learned_addr learned my addr 172.21.15.106:0/948375431 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 615752755 0 0) 0x7fd7980a1e00 con 0x7fd7980a4820 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): my global_id is 5636 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd778003530 con 0x7fd7980a4820 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2507720042 0 0) 0x7fd778003530 con 0x7fd7980a4820 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd7980a1e00 con 0x7fd7980a4820 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd788001b00 con 0x7fd7980a4820 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): dump: 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.989+0000 7fd78ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271886338 0 0) 0x7fd798138150 con 0x7fd79813e200 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): my global_id is 144106 2024-04-25T23:59:01.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd778003530 con 0x7fd79813e200 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1459956338 0 0) 0x7fd79812b330 con 0x7fd798134970 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): my global_id is 144109 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd798138150 con 0x7fd798134970 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 653426492 0 0) 0x7fd7980a1e00 con 0x7fd7980a4820 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.171:6792/0 conn(0x7fd79813e200 legacy=0x7fd7981d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.171:6789/0 conn(0x7fd798134970 legacy=0x7fd79812ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 monclient: found mon.b 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7981390c0 con 0x7fd7980a4820 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: _finish_auth 0 2024-04-25T23:59:01.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 5 monclient: authenticate success, global_id 5636 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 10 monclient: _renew_subs 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd798138b00 con 0x7fd7980a4820 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 10 monclient: _renew_subs 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd7981379e0 con 0x7fd7980a4820 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd788001df0 con 0x7fd7980a4820 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd788005680 con 0x7fd7980a4820 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd795ffb640 4 set_mon_vals no callback set 2024-04-25T23:59:01.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: dump: 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.990 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd77c0065d0 con 0x7fd77c002870 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd788010420 con 0x7fd7980a4820 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(104..104 src has 1..104) ==== 5240+0+0 (unknown 1377127453 0 0) 0x7fd788045080 con 0x7fd7980a4820 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4122437905 0 0) 0x7fd77c0065d0 con 0x7fd77c002870 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient(hunting): my global_id is 5742 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7980a1e00 con 0x7fd77c002870 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd797fff640 10 monclient: get_auth_request con 0x7fd778037a30 auth_method 0 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4022248287 0 0) 0x7fd7980a1e00 con 0x7fd77c002870 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd77c0065d0 con 0x7fd77c002870 2024-04-25T23:59:01.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd7800018b0 con 0x7fd77c002870 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: dump: 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.992 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3233439517 0 0) 0x7fd77c0065d0 con 0x7fd77c002870 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd77c00a160 con 0x7fd77c002870 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd780001d40 con 0x7fd77c002870 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.106:6789/0 conn(0x7fd77c002870 legacy=0x7fd77c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:01.993+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.106:6789/0 conn(0x7fd77c002870 legacy=0x7fd77c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd77c009e30 con 0x7fd77c0090f0 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1302433757 0 0) 0x7fd77c009e30 con 0x7fd77c0090f0 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient(hunting): my global_id is 5751 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd77c0065d0 con 0x7fd77c0090f0 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3842196117 0 0) 0x7fd77c0065d0 con 0x7fd77c0090f0 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd77c009e30 con 0x7fd77c0090f0 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd780003bb0 con 0x7fd77c0090f0 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:01.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient: dump: 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:01.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2664640678 0 0) 0x7fd77c009e30 con 0x7fd77c0090f0 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd77c00c3a0 con 0x7fd77c0090f0 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 800787197) 0x7fd780003f30 con 0x7fd77c0090f0 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.106:6789/0 conn(0x7fd77c0090f0 legacy=0x7fd77c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd78ffff640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.106:6789/0 conn(0x7fd77c0090f0 legacy=0x7fd77c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:01.997 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 260560, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:01.998 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:01.999 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:02.000 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.001 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:02.002 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.004 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:02.006 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:02.008 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.010 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:02.012 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.013 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:02.014 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.171:6812/722422047 conn(0x7fd778037a30 legacy=0x7fd778039ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 10 monclient: shutdown 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 >> v1:172.21.15.106:6790/0 conn(0x7fd7980a4820 legacy=0x7fd79812a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd797fff640 1 -- 172.21.15.106:0/948375431 reap_dead start 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd797fff640 1 -- 172.21.15.106:0/948375431 reap_dead start 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 shutdown_connections 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 >> 172.21.15.106:0/948375431 conn(0x7fd7980a9e20 msgr2=0x7fd798130df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 shutdown_connections 2024-04-25T23:59:02.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.001+0000 7fd79dedc640 1 -- 172.21.15.106:0/948375431 wait complete. 2024-04-25T23:59:02.017 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:02.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-25T23:59:02.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: get_monmap_and_config 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: monmap: 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:02.150813+0000 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:02.150813+0000 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.131 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 Processor -- start 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- start start 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: init 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: _add_conns ranks=[5,2,0,6,7,3,4,1,8] 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient(hunting): picked mon.noname-h con 0x7f347c134970 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient(hunting): picked mon.noname-b con 0x7f347c0a4820 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient(hunting): picked mon.noname-a con 0x7f347c13e200 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c06dd40 con 0x7f347c13e200 2024-04-25T23:59:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c0a2b10 con 0x7f347c0a4820 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c0a2df0 con 0x7f347c134970 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient(hunting): authenticate will time out at 1197.677999s 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3482262640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f347c13e200 0x7f347c1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41280/0 (socket says 172.21.15.106:41280) 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3482262640 1 -- 172.21.15.106:0/100259597 learned_addr learned my addr 172.21.15.106:0/100259597 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289727315 0 0) 0x7f347c06dd40 con 0x7f347c13e200 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): my global_id is 5760 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3464003530 con 0x7f347c13e200 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3237237509 0 0) 0x7f347c0a2b10 con 0x7f347c0a4820 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient(hunting): my global_id is 5645 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f347c06dd40 con 0x7f347c0a4820 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1723808061 0 0) 0x7f3464003530 con 0x7f347c13e200 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 >> v1:172.21.15.171:6791/0 conn(0x7f347c134970 legacy=0x7f347c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 >> v1:172.21.15.106:6790/0 conn(0x7f347c0a4820 legacy=0x7f347c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 monclient: found mon.noname-a 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c0a30d0 con 0x7f347c13e200 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f346c0017c0 con 0x7f347c13e200 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 5 monclient: authenticate success, global_id 5760 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: dump: 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f346c001a70 con 0x7f347c13e200 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 1 -- 172.21.15.106:0/100259597 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f346c004bf0 con 0x7f347c13e200 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3480a5f640 10 monclient: dump: 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 4 set_mon_vals no callback set 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 10 monclient: shutdown 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- 172.21.15.106:0/100259597 >> v1:172.21.15.106:6789/0 conn(0x7f347c13e200 legacy=0x7f347c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- 172.21.15.106:0/100259597 shutdown_connections 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- 172.21.15.106:0/100259597 >> 172.21.15.106:0/100259597 conn(0x7f347c0a9e20 msgr2=0x7f347c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- 172.21.15.106:0/100259597 shutdown_connections 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.149+0000 7f3483cc5640 1 -- 172.21.15.106:0/100259597 wait complete. 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: monmap: 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 Processor -- start 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 -- start start 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: init 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: _add_conns ranks=[1,6,3,2,0,4,5,8,7] 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient(hunting): picked mon.noname-f con 0x7f347c0a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient(hunting): picked mon.noname-d con 0x7f347c134970 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient(hunting): picked mon.noname-g con 0x7f347c13e200 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c138fc0 con 0x7f347c0a4820 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c137980 con 0x7f347c13e200 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347c136e20 con 0x7f347c134970 2024-04-25T23:59:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient(hunting): authenticate will time out at 1197.681004s 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3481260640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f347c134970 0x7f347c1d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53096/0 (socket says 172.21.15.106:53096) 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3481260640 1 -- 172.21.15.106:0/631105263 learned_addr learned my addr 172.21.15.106:0/631105263 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610513225 0 0) 0x7f347c136e20 con 0x7f347c134970 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): my global_id is 5694 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3468003530 con 0x7f347c134970 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 995466762 0 0) 0x7f3468003530 con 0x7f347c134970 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f347c136e20 con 0x7f347c134970 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3470001b20 con 0x7f347c134970 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891747683 0 0) 0x7f347c138fc0 con 0x7f347c0a4820 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): my global_id is 144118 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3468003530 con 0x7f347c0a4820 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616821723 0 0) 0x7f347c137980 con 0x7f347c13e200 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): my global_id is 5889 2024-04-25T23:59:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f347c138fc0 con 0x7f347c13e200 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2307948999 0 0) 0x7f347c136e20 con 0x7f347c134970 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.171:6790/0 conn(0x7f347c13e200 legacy=0x7f347c1d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.171:6789/0 conn(0x7f347c0a4820 legacy=0x7f347c12aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 monclient: found mon.d 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c138ce0 con 0x7f347c134970 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 5 monclient: authenticate success, global_id 5694 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: _renew_subs 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f347c1392a0 con 0x7f347c134970 2024-04-25T23:59:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: _renew_subs 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f347c12b1d0 con 0x7f347c134970 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3470003950 con 0x7f347c134970 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3470003e40 con 0x7f347c134970 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347bfff640 4 set_mon_vals no callback set 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: dump: 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f345c0065d0 con 0x7f345c002870 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3470003fe0 con 0x7f347c134970 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(104..104 src has 1..104) ==== 5240+0+0 (unknown 1377127453 0 0) 0x7f3470044b70 con 0x7f347c134970 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454195618 0 0) 0x7f345c0065d0 con 0x7f345c002870 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient(hunting): my global_id is 5654 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f347c136e20 con 0x7f345c002870 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f3482262640 10 monclient: get_auth_request con 0x7f3468037a10 auth_method 0 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2456141221 0 0) 0x7f347c136e20 con 0x7f345c002870 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f345c0065d0 con 0x7f345c002870 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3474001bf0 con 0x7f345c002870 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 10 monclient: dump: 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1030112554 0 0) 0x7f345c0065d0 con 0x7f345c002870 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.153+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f345c00a160 con 0x7f345c002870 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.157+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f34740049b0 con 0x7f345c002870 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.157+0000 7f347a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.157+0000 7f347a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.157+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.106:6790/0 conn(0x7f345c002870 legacy=0x7f345c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.157+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.106:6790/0 conn(0x7f345c002870 legacy=0x7f345c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f345c009e50 con 0x7f345c009110 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 983140801 0 0) 0x7f345c009e50 con 0x7f345c009110 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient(hunting): my global_id is 5663 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345c0065d0 con 0x7f345c009110 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2408368751 0 0) 0x7f345c0065d0 con 0x7f345c009110 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f345c009e50 con 0x7f345c009110 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3474003f70 con 0x7f345c009110 2024-04-25T23:59:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient: dump: 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3860471192 0 0) 0x7f345c009e50 con 0x7f345c009110 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f345c00c3e0 con 0x7f345c009110 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 3966787459) 0x7f3474004b60 con 0x7f345c009110 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.106:6790/0 conn(0x7f345c009110 legacy=0x7f345c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f347a7fc640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.106:6790/0 conn(0x7f345c009110 legacy=0x7f345c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:02.157 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 260724, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.158 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.159 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.160 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:02.161 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.162 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.163 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:59:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:02.176 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.171:6812/722422047 conn(0x7f3468037a10 legacy=0x7f3468039ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 10 monclient: shutdown 2024-04-25T23:59:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 >> v1:172.21.15.106:6792/0 conn(0x7f347c134970 legacy=0x7f347c1d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3482262640 1 -- 172.21.15.106:0/631105263 reap_dead start 2024-04-25T23:59:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3482262640 1 -- 172.21.15.106:0/631105263 reap_dead start 2024-04-25T23:59:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 shutdown_connections 2024-04-25T23:59:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 >> 172.21.15.106:0/631105263 conn(0x7f347c0a9e20 msgr2=0x7f347c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 shutdown_connections 2024-04-25T23:59:02.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.161+0000 7f3483cc5640 1 -- 172.21.15.106:0/631105263 wait complete. 2024-04-25T23:59:02.178 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:02.178 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-25T23:59:02.178 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-25T23:59:02.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: get_monmap_and_config 2024-04-25T23:59:02.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: monmap: 2024-04-25T23:59:02.291 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:02.311491+0000 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:02.311491+0000 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.292 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.293 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 Processor -- start 2024-04-25T23:59:02.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- start start 2024-04-25T23:59:02.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: init 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: _add_conns ranks=[3,4,5,2,1,0,8,6,7] 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient(hunting): picked mon.noname-g con 0x7fe168134970 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient(hunting): picked mon.noname-c con 0x7fe1680a4820 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient(hunting): picked mon.noname-h con 0x7fe16813e200 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16806dd40 con 0x7fe168134970 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1680a2b10 con 0x7fe1680a4820 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1680a2df0 con 0x7fe16813e200 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient(hunting): authenticate will time out at 1197.838600s 2024-04-25T23:59:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe167fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fe1680a4820 0x7fe16813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:59450/0 (socket says 172.21.15.106:59450) 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe167fff640 1 -- 172.21.15.106:0/2605482379 learned_addr learned my addr 172.21.15.106:0/2605482379 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801060319 0 0) 0x7fe1680a2b10 con 0x7fe1680a4820 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient(hunting): my global_id is 144121 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe150003530 con 0x7fe1680a4820 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2487376232 0 0) 0x7fe150003530 con 0x7fe1680a4820 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 >> v1:172.21.15.171:6791/0 conn(0x7fe16813e200 legacy=0x7fe1681405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 >> v1:172.21.15.171:6790/0 conn(0x7fe168134970 legacy=0x7fe168134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 monclient: found mon.noname-c 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1680a30d0 con 0x7fe1680a4820 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe15c0017c0 con 0x7fe1680a4820 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 5 monclient: authenticate success, global_id 144121 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: dump: 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe15c001ab0 con 0x7fe1680a4820 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 1 -- 172.21.15.106:0/2605482379 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe15c004bf0 con 0x7fe1680a4820 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 4 set_mon_vals no callback set 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe1677fe640 10 monclient: dump: 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 10 monclient: shutdown 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- 172.21.15.106:0/2605482379 >> v1:172.21.15.106:6791/0 conn(0x7fe1680a4820 legacy=0x7fe16813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- 172.21.15.106:0/2605482379 shutdown_connections 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- 172.21.15.106:0/2605482379 >> 172.21.15.106:0/2605482379 conn(0x7fe1680a9e20 msgr2=0x7fe1680aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- 172.21.15.106:0/2605482379 shutdown_connections 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.309+0000 7fe16ee27640 1 -- 172.21.15.106:0/2605482379 wait complete. 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: monmap: 2024-04-25T23:59:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 Processor -- start 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 -- start start 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: init 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: _add_conns ranks=[0,1,2,5,7,8,3,6,4] 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient(hunting): picked mon.noname-a con 0x7fe1680a4820 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient(hunting): picked mon.noname-f con 0x7fe168134970 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient(hunting): picked mon.noname-b con 0x7fe16813e200 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16809e3e0 con 0x7fe1680a4820 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe16809c870 con 0x7fe168134970 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1680a1e00 con 0x7fe16813e200 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient(hunting): authenticate will time out at 1197.841365s 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16cbc3640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe1680a4820 0x7fe16809fe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41292/0 (socket says 172.21.15.106:41292) 2024-04-25T23:59:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16cbc3640 1 -- 172.21.15.106:0/1888287020 learned_addr learned my addr 172.21.15.106:0/1888287020 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956746352 0 0) 0x7fe1680a1e00 con 0x7fe16813e200 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): my global_id is 5672 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe154003530 con 0x7fe16813e200 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3197713453 0 0) 0x7fe16809e3e0 con 0x7fe1680a4820 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): my global_id is 5769 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1680a1e00 con 0x7fe1680a4820 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1606031266 0 0) 0x7fe1680a1e00 con 0x7fe1680a4820 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe16809e3e0 con 0x7fe1680a4820 2024-04-25T23:59:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1178393790 0 0) 0x7fe154003530 con 0x7fe16813e200 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1680a1e00 con 0x7fe16813e200 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe158001b20 con 0x7fe1680a4820 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): dump: 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe160001b30 con 0x7fe16813e200 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): dump: 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1551851395 0 0) 0x7fe16809e3e0 con 0x7fe1680a4820 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.106:6790/0 conn(0x7fe16813e200 legacy=0x7fe1681d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.171:6789/0 conn(0x7fe168134970 legacy=0x7fe1681d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 monclient: found mon.a 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1680a1a40 con 0x7fe1680a4820 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 5 monclient: authenticate success, global_id 5769 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: _renew_subs 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1681ccb10 con 0x7fe1680a4820 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: _renew_subs 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe1680a0530 con 0x7fe1680a4820 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe1580038d0 con 0x7fe1680a4820 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe158003e40 con 0x7fe1680a4820 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe166ffd640 4 set_mon_vals no callback set 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: dump: 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe1480065d0 con 0x7fe148002870 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe158004060 con 0x7fe1680a4820 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(104..104 src has 1..104) ==== 5240+0+0 (unknown 1377127453 0 0) 0x7fe158044c70 con 0x7fe1680a4820 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1726880148 0 0) 0x7fe1480065d0 con 0x7fe148002870 2024-04-25T23:59:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient(hunting): my global_id is 144130 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe16809e3e0 con 0x7fe148002870 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 828161097 0 0) 0x7fe16809e3e0 con 0x7fe148002870 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1480065d0 con 0x7fe148002870 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe15c001440 con 0x7fe148002870 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe1657fa640 10 monclient: dump: 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.313+0000 7fe16d3c4640 10 monclient: get_auth_request con 0x7fe154037d10 auth_method 0 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.317+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3324270807 0 0) 0x7fe1480065d0 con 0x7fe148002870 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.317+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe14800a160 con 0x7fe148002870 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.317+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe15c0017b0 con 0x7fe148002870 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.317+0000 7fe1657fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.317+0000 7fe1657fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.317+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.106:6791/0 conn(0x7fe148002870 legacy=0x7fe148004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.317+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.106:6791/0 conn(0x7fe148002870 legacy=0x7fe148004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe148009e50 con 0x7fe148009110 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277429678 0 0) 0x7fe148009e50 con 0x7fe148009110 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient(hunting): my global_id is 144139 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1480065d0 con 0x7fe148009110 2024-04-25T23:59:02.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2721205507 0 0) 0x7fe1480065d0 con 0x7fe148009110 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe148009e50 con 0x7fe148009110 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe15c005000 con 0x7fe148009110 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient: dump: 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.319 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4195256985 0 0) 0x7fe148009e50 con 0x7fe148009110 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe14800c3e0 con 0x7fe148009110 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2366583320) 0x7fe15c0071e0 con 0x7fe148009110 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.106:6791/0 conn(0x7fe148009110 legacy=0x7fe1480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe1657fa640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.106:6791/0 conn(0x7fe148009110 legacy=0x7fe1480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 5851, 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.336 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.337 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:02.338 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:02.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.171:6812/722422047 conn(0x7fe154037d10 legacy=0x7fe15403a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 10 monclient: shutdown 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 >> v1:172.21.15.106:6789/0 conn(0x7fe1680a4820 legacy=0x7fe16809fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16d3c4640 1 -- 172.21.15.106:0/1888287020 reap_dead start 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16d3c4640 1 -- 172.21.15.106:0/1888287020 reap_dead start 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 shutdown_connections 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 >> 172.21.15.106:0/1888287020 conn(0x7fe1680a9e20 msgr2=0x7fe168067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 shutdown_connections 2024-04-25T23:59:02.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.321+0000 7fe16ee27640 1 -- 172.21.15.106:0/1888287020 wait complete. 2024-04-25T23:59:02.340 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:02.341 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-25T23:59:02.341 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:59:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.473+0000 7faf8c7b1640 10 monclient: get_monmap_and_config 2024-04-25T23:59:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.473+0000 7faf8c7b1640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.473+0000 7faf8c7b1640 10 monclient: monmap: 2024-04-25T23:59:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:02.476821+0000 2024-04-25T23:59:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:02.476821+0000 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.473+0000 7faf8c7b1640 1 Processor -- start 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.473+0000 7faf8c7b1640 1 -- start start 2024-04-25T23:59:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.473+0000 7faf8c7b1640 10 monclient: init 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: _add_conns ranks=[4,8,3,6,5,2,7,0,1] 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): picked mon.noname-c con 0x7faf840a2560 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): picked mon.noname-e con 0x7faf840a3050 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): picked mon.noname-g con 0x7faf8413e380 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8406bb60 con 0x7faf8413e380 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8406c020 con 0x7faf840a2560 2024-04-25T23:59:02.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8409f900 con 0x7faf840a3050 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): authenticate will time out at 1198.004535s 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf89d4c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7faf840a3050 0x7faf8413cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40430/0 (socket says 172.21.15.106:40430) 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf89d4c640 1 -- 172.21.15.106:0/3692637293 learned_addr learned my addr 172.21.15.106:0/3692637293 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 398274902 0 0) 0x7faf8406c020 con 0x7faf840a2560 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): my global_id is 144148 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf70003530 con 0x7faf840a2560 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896697658 0 0) 0x7faf8409f900 con 0x7faf840a3050 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient(hunting): my global_id is 144125 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf8406c020 con 0x7faf840a3050 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 380857604 0 0) 0x7faf70003530 con 0x7faf840a2560 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 >> v1:172.21.15.106:6793/0 conn(0x7faf840a3050 legacy=0x7faf8413cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 >> v1:172.21.15.171:6790/0 conn(0x7faf8413e380 legacy=0x7faf84140770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 monclient: found mon.noname-c 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf8409fbe0 con 0x7faf840a2560 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf800017c0 con 0x7faf840a2560 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: dump: 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 5 monclient: authenticate success, global_id 144148 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf800019f0 con 0x7faf840a2560 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 4 set_mon_vals no callback set 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 1 -- 172.21.15.106:0/3692637293 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf80003960 con 0x7faf840a2560 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8954b640 10 monclient: dump: 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.470 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: shutdown 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- 172.21.15.106:0/3692637293 >> v1:172.21.15.106:6791/0 conn(0x7faf840a2560 legacy=0x7faf840a2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- 172.21.15.106:0/3692637293 shutdown_connections 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- 172.21.15.106:0/3692637293 >> 172.21.15.106:0/3692637293 conn(0x7faf840a3650 msgr2=0x7faf840a3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- 172.21.15.106:0/3692637293 shutdown_connections 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- 172.21.15.106:0/3692637293 wait complete. 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: monmap: 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 Processor -- start 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- start start 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: init 2024-04-25T23:59:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient: _add_conns ranks=[5,1,4,3,8,7,0,6,2] 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): picked mon.noname-h con 0x7faf840a2560 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): picked mon.noname-f con 0x7faf840a3050 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): picked mon.noname-c con 0x7faf8413e380 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf84139020 con 0x7faf840a3050 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840728b0 con 0x7faf8413e380 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf8409f420 con 0x7faf840a2560 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8c7b1640 10 monclient(hunting): authenticate will time out at 1198.007881s 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8ad4e640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7faf8413e380 0x7faf841d5160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:59486/0 (socket says 172.21.15.106:59486) 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.477+0000 7faf8ad4e640 1 -- 172.21.15.106:0/784373384 learned_addr learned my addr 172.21.15.106:0/784373384 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3413432255 0 0) 0x7faf840728b0 con 0x7faf8413e380 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): my global_id is 144157 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf68003530 con 0x7faf8413e380 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1230235058 0 0) 0x7faf68003530 con 0x7faf8413e380 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf840728b0 con 0x7faf8413e380 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf7c001d90 con 0x7faf8413e380 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): dump: 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59773216 0 0) 0x7faf84139020 con 0x7faf840a3050 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): my global_id is 144136 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf68003530 con 0x7faf840a3050 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300434142 0 0) 0x7faf8409f420 con 0x7faf840a2560 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): my global_id is 5603 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf84139020 con 0x7faf840a2560 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 281101405 0 0) 0x7faf840728b0 con 0x7faf8413e380 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.171:6791/0 conn(0x7faf840a2560 legacy=0x7faf8412d530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.171:6789/0 conn(0x7faf840a3050 legacy=0x7faf841d1a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 monclient: found mon.c 2024-04-25T23:59:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf84136d30 con 0x7faf8413e380 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 5 monclient: authenticate success, global_id 144157 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 10 monclient: _renew_subs 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faf84138d40 con 0x7faf8413e380 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 10 monclient: _renew_subs 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7faf84139bd0 con 0x7faf8413e380 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faf7c003cd0 con 0x7faf8413e380 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf7c0041c0 con 0x7faf8413e380 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf88d4a640 4 set_mon_vals no callback set 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: dump: 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf6c0065d0 con 0x7faf6c002870 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7faf7c004360 con 0x7faf8413e380 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(104..104 src has 1..104) ==== 5240+0+0 (unknown 1377127453 0 0) 0x7faf7c044ee0 con 0x7faf8413e380 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12727696 0 0) 0x7faf6c0065d0 con 0x7faf6c002870 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient(hunting): my global_id is 5703 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf840728b0 con 0x7faf6c002870 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3980271251 0 0) 0x7faf840728b0 con 0x7faf6c002870 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf6c0065d0 con 0x7faf6c002870 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf80003940 con 0x7faf6c002870 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf89d4c640 10 monclient: get_auth_request con 0x7faf680379f0 auth_method 0 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: dump: 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1817198978 0 0) 0x7faf6c0065d0 con 0x7faf6c002870 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf6c00a160 con 0x7faf6c002870 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7faf80001200 con 0x7faf6c002870 2024-04-25T23:59:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.106:6792/0 conn(0x7faf6c002870 legacy=0x7faf6c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.481+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.106:6792/0 conn(0x7faf6c002870 legacy=0x7faf6c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf6c009e50 con 0x7faf6c009110 2024-04-25T23:59:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010970630 0 0) 0x7faf6c009e50 con 0x7faf6c009110 2024-04-25T23:59:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient(hunting): my global_id is 5712 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf6c0065d0 con 0x7faf6c009110 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1757879690 0 0) 0x7faf6c0065d0 con 0x7faf6c009110 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf6c009e50 con 0x7faf6c009110 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf80004000 con 0x7faf6c009110 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient: dump: 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.484 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4199207651 0 0) 0x7faf6c009e50 con 0x7faf6c009110 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faf6c00c3e0 con 0x7faf6c009110 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1154442533) 0x7faf800062c0 con 0x7faf6c009110 2024-04-25T23:59:02.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.106:6792/0 conn(0x7faf6c009110 legacy=0x7faf6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf7affd640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.106:6792/0 conn(0x7faf6c009110 legacy=0x7faf6c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 261028, 2024-04-25T23:59:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:02.504 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.171:6812/722422047 conn(0x7faf680379f0 legacy=0x7faf68039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 10 monclient: shutdown 2024-04-25T23:59:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 >> v1:172.21.15.106:6791/0 conn(0x7faf8413e380 legacy=0x7faf841d5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8ad4e640 1 -- 172.21.15.106:0/784373384 reap_dead start 2024-04-25T23:59:02.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8ad4e640 1 -- 172.21.15.106:0/784373384 reap_dead start 2024-04-25T23:59:02.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 shutdown_connections 2024-04-25T23:59:02.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 >> 172.21.15.106:0/784373384 conn(0x7faf840a3650 msgr2=0x7faf84131930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 shutdown_connections 2024-04-25T23:59:02.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.489+0000 7faf8c7b1640 1 -- 172.21.15.106:0/784373384 wait complete. 2024-04-25T23:59:02.506 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:02.506 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-25T23:59:02.507 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-25T23:59:02.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.640+0000 7f52d6ffd640 1 -- 172.21.15.171:0/3439242728 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd create"}]=0 v105) ==== 58+0+3 (unknown 192631357 0 944643765) 0x7f52dc0198a0 con 0x7f52e809b3e0 2024-04-25T23:59:02.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.640+0000 7f52d6ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create"}] 2024-04-25T23:59:02.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.640+0000 7f52d6ffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.641+0000 7fd484704640 10 monclient: get_monmap_and_config 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.641+0000 7fd484704640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.641+0000 7fd484704640 10 monclient: monmap: 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:02.645587+0000 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:02.645587+0000 2024-04-25T23:59:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.626 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 >> v1:172.21.15.171:6812/722422047 conn(0x7f52c8037820 legacy=0x7f52c8039ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 10 monclient: shutdown 2024-04-25T23:59:02.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 >> v1:172.21.15.171:6791/0 conn(0x7f52e809b3e0 legacy=0x7f52e8137cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 shutdown_connections 2024-04-25T23:59:02.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 >> 172.21.15.171:0/3439242728 conn(0x7f52e80a28a0 msgr2=0x7f52e813f030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 shutdown_connections 2024-04-25T23:59:02.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.644+0000 7f52ecd2d640 1 -- 172.21.15.171:0/3439242728 wait complete. 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 Processor -- start 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- start start 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient: init 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient: _add_conns ranks=[8,4,1,2,5,6,7,0,3] 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient(hunting): picked mon.noname-e con 0x7fd47c0993e0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient(hunting): picked mon.noname-c con 0x7fd47c09c890 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient(hunting): picked mon.noname-f con 0x7fd47c09ccf0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47c09c4e0 con 0x7fd47c09ccf0 2024-04-25T23:59:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47c09bbd0 con 0x7fd47c09c890 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47c09beb0 con 0x7fd47c0993e0 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient(hunting): authenticate will time out at 1198.173464s 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd4824a0640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fd47c0993e0 0x7fd47c0997c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40434/0 (socket says 172.21.15.106:40434) 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd4824a0640 1 -- 172.21.15.106:0/3593181826 learned_addr learned my addr 172.21.15.106:0/3593181826 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 980644776 0 0) 0x7fd47c09bbd0 con 0x7fd47c09c890 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): my global_id is 144166 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd468003450 con 0x7fd47c09c890 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2927206292 0 0) 0x7fd47c09beb0 con 0x7fd47c0993e0 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient(hunting): my global_id is 144134 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c09bbd0 con 0x7fd47c0993e0 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2522714206 0 0) 0x7fd47c09bbd0 con 0x7fd47c0993e0 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 >> v1:172.21.15.106:6791/0 conn(0x7fd47c09c890 legacy=0x7fd47c138f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 >> v1:172.21.15.171:6789/0 conn(0x7fd47c09ccf0 legacy=0x7fd47c13c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 monclient: found mon.noname-e 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c0a3b00 con 0x7fd47c0993e0 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4780017c0 con 0x7fd47c0993e0 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 5 monclient: authenticate success, global_id 144134 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: dump: 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd478001a20 con 0x7fd47c0993e0 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 1 -- 172.21.15.106:0/3593181826 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd478004bf0 con 0x7fd47c0993e0 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd48149e640 10 monclient: dump: 2024-04-25T23:59:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 4 set_mon_vals no callback set 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient: shutdown 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- 172.21.15.106:0/3593181826 >> v1:172.21.15.106:6793/0 conn(0x7fd47c0993e0 legacy=0x7fd47c0997c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- 172.21.15.106:0/3593181826 shutdown_connections 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- 172.21.15.106:0/3593181826 >> 172.21.15.106:0/3593181826 conn(0x7fd47c0a2db0 msgr2=0x7fd47c0a3190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- 172.21.15.106:0/3593181826 shutdown_connections 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 -- 172.21.15.106:0/3593181826 wait complete. 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 10 monclient: monmap: 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.645+0000 7fd484704640 1 Processor -- start 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 1 -- start start 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient: init 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient: _add_conns ranks=[0,4,5,6,7,8,1,2,3] 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient(hunting): picked mon.noname-a con 0x7fd47c0993e0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient(hunting): picked mon.noname-c con 0x7fd47c09c890 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient(hunting): picked mon.noname-h con 0x7fd47c09ccf0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47c09a010 con 0x7fd47c0993e0 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47c071f70 con 0x7fd47c09c890 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd47c0718d0 con 0x7fd47c09ccf0 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient(hunting): authenticate will time out at 1198.176513s 2024-04-25T23:59:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd4824a0640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd47c0993e0 0x7fd47c1bbc10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41302/0 (socket says 172.21.15.106:41302) 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd4824a0640 1 -- 172.21.15.106:0/585842034 learned_addr learned my addr 172.21.15.106:0/585842034 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165838274 0 0) 0x7fd47c09a010 con 0x7fd47c0993e0 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): my global_id is 5778 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd460003530 con 0x7fd47c0993e0 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1487929701 0 0) 0x7fd47c071f70 con 0x7fd47c09c890 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): my global_id is 144175 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c09a010 con 0x7fd47c09c890 2024-04-25T23:59:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1717154160 0 0) 0x7fd47c0718d0 con 0x7fd47c09ccf0 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): my global_id is 5612 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c071f70 con 0x7fd47c09ccf0 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3460442323 0 0) 0x7fd460003530 con 0x7fd47c0993e0 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd47c0718d0 con 0x7fd47c0993e0 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd478004b30 con 0x7fd47c0993e0 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2188245276 0 0) 0x7fd47c09a010 con 0x7fd47c09c890 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd460003530 con 0x7fd47c09c890 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd46c001580 con 0x7fd47c09c890 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2205200661 0 0) 0x7fd47c0718d0 con 0x7fd47c0993e0 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.171:6791/0 conn(0x7fd47c09ccf0 legacy=0x7fd47c1d0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.106:6791/0 conn(0x7fd47c09c890 legacy=0x7fd47c1cd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 monclient: found mon.a 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd47c12e440 con 0x7fd47c0993e0 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 5 monclient: authenticate success, global_id 5778 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient: _renew_subs 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd47c1c8a50 con 0x7fd47c0993e0 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient: _renew_subs 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd478004f40 con 0x7fd47c0993e0 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd47c1bc4f0 con 0x7fd47c0993e0 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd478005430 con 0x7fd47c0993e0 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd480c9d640 4 set_mon_vals no callback set 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: dump: 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd47c068750 con 0x7fd47c067e10 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd4780101d0 con 0x7fd47c0993e0 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(105..105 src has 1..105) ==== 5359+0+0 (unknown 1086254605 0 0) 0x7fd478044c60 con 0x7fd47c0993e0 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333237446 0 0) 0x7fd47c068750 con 0x7fd47c067e10 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient(hunting): my global_id is 144143 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c0718d0 con 0x7fd47c067e10 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd482ca1640 10 monclient: get_auth_request con 0x7fd460037fa0 auth_method 0 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 633243905 0 0) 0x7fd47c0718d0 con 0x7fd47c067e10 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd47c068750 con 0x7fd47c067e10 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd46c003940 con 0x7fd47c067e10 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: dump: 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.652 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 592241822 0 0) 0x7fd47c068750 con 0x7fd47c067e10 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd47c072c40 con 0x7fd47c067e10 2024-04-25T23:59:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd46c003d10 con 0x7fd47c067e10 2024-04-25T23:59:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.106:6793/0 conn(0x7fd47c067e10 legacy=0x7fd47c09d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.649+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.106:6793/0 conn(0x7fd47c067e10 legacy=0x7fd47c09d6b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.655 INFO:tasks.workunit.client.0.smithi171.stderr:+ o4=12 2024-04-25T23:59:02.655 INFO:tasks.workunit.client.0.smithi171.stderr:++ ceph osd create 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd47c067160 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3188460562 0 0) 0x7fd47c067160 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient(hunting): my global_id is 144152 2024-04-25T23:59:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c068750 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 816987314 0 0) 0x7fd47c068750 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd47c067160 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd46c004470 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient: dump: 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.657 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1807372711 0 0) 0x7fd47c067160 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd47c1c83d0 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 398558508) 0x7fd46c005950 con 0x7fd47c1c7ff0 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:02.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.106:6793/0 conn(0x7fd47c1c7ff0 legacy=0x7fd47c09ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd472ffd640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.106:6793/0 conn(0x7fd47c1c7ff0 legacy=0x7fd47c09ddc0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 6187, 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.675 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.676 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.677 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.677 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.677 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:02.677 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:02.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.171:6812/722422047 conn(0x7fd460037fa0 legacy=0x7fd46003a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 10 monclient: shutdown 2024-04-25T23:59:02.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 >> v1:172.21.15.106:6789/0 conn(0x7fd47c0993e0 legacy=0x7fd47c1bbc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd482ca1640 1 -- 172.21.15.106:0/585842034 reap_dead start 2024-04-25T23:59:02.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd482ca1640 1 -- 172.21.15.106:0/585842034 reap_dead start 2024-04-25T23:59:02.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 shutdown_connections 2024-04-25T23:59:02.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 >> 172.21.15.106:0/585842034 conn(0x7fd47c0a2db0 msgr2=0x7fd47c0a1850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 shutdown_connections 2024-04-25T23:59:02.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.657+0000 7fd484704640 1 -- 172.21.15.106:0/585842034 wait complete. 2024-04-25T23:59:02.680 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:02.680 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-25T23:59:02.680 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-25T23:59:02.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.780+0000 7f1503562640 10 monclient: get_monmap_and_config 2024-04-25T23:59:02.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.780+0000 7f1503562640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.780+0000 7f1503562640 10 monclient: monmap: 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:02.784864+0000 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:02.784864+0000 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.766 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.767 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.767 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.767 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.767 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:02.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.780+0000 7f1503562640 1 Processor -- start 2024-04-25T23:59:02.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.780+0000 7f1503562640 1 -- start start 2024-04-25T23:59:02.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.780+0000 7f1503562640 10 monclient: init 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: _add_conns ranks=[1,3,0,5,4,7,6,2,8] 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): picked mon.noname-f con 0x7f14fc136e10 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): picked mon.noname-g con 0x7f14fc0a4c10 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): picked mon.noname-a con 0x7f14fc13e510 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc0a3230 con 0x7f14fc13e510 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc0a2c70 con 0x7f14fc136e10 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc0a4490 con 0x7f14fc0a4c10 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): authenticate will time out at 1193.492718s 2024-04-25T23:59:02.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1500afd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f14fc0a4c10 0x7f14fc13cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48564/0 (socket says 172.21.15.171:48564) 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1500afd640 1 -- 172.21.15.171:0/2075187966 learned_addr learned my addr 172.21.15.171:0/2075187966 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f15012fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f14fc136e10 0x7f14fc1371f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49272/0 (socket says 172.21.15.171:49272) 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087815716 0 0) 0x7f14fc0a4490 con 0x7f14fc0a4c10 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): my global_id is 5916 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e4003530 con 0x7f14fc0a4c10 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1361932647 0 0) 0x7f14fc0a2c70 con 0x7f14fc136e10 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): my global_id is 144145 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc0a4490 con 0x7f14fc136e10 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963924083 0 0) 0x7f14fc0a3230 con 0x7f14fc13e510 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient(hunting): my global_id is 5787 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc0a2c70 con 0x7f14fc13e510 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2694808044 0 0) 0x7f14e4003530 con 0x7f14fc0a4c10 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 >> v1:172.21.15.171:6789/0 conn(0x7f14fc136e10 legacy=0x7f14fc1371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 >> v1:172.21.15.106:6789/0 conn(0x7f14fc13e510 legacy=0x7f14fc140900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 monclient: found mon.noname-g 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:02.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc0a3c90 con 0x7f14fc0a4c10 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f14f00017c0 con 0x7f14fc0a4c10 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: dump: 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 5 monclient: authenticate success, global_id 5916 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14f0001a20 con 0x7f14fc0a4c10 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 4 set_mon_vals no callback set 2024-04-25T23:59:02.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 1 -- 172.21.15.171:0/2075187966 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f14f0004bf0 con 0x7f14fc0a4c10 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f14fbfff640 10 monclient: dump: 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.778 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: shutdown 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- 172.21.15.171:0/2075187966 >> v1:172.21.15.171:6790/0 conn(0x7f14fc0a4c10 legacy=0x7f14fc13cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- 172.21.15.171:0/2075187966 shutdown_connections 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- 172.21.15.171:0/2075187966 >> 172.21.15.171:0/2075187966 conn(0x7f14fc0a7110 msgr2=0x7f14fc0a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- 172.21.15.171:0/2075187966 shutdown_connections 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- 172.21.15.171:0/2075187966 wait complete. 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: monmap: 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.780 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 Processor -- start 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- start start 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: init 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient: _add_conns ranks=[4,5,3,8,0,6,2,1,7] 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): picked mon.noname-c con 0x7f14fc0a4c10 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): picked mon.noname-h con 0x7f14fc136e10 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): picked mon.noname-g con 0x7f14fc13e510 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc13c360 con 0x7f14fc13e510 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc13bd40 con 0x7f14fc0a4c10 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14fc09ddc0 con 0x7f14fc136e10 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1503562640 10 monclient(hunting): authenticate will time out at 1193.495836s 2024-04-25T23:59:02.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1500afd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f14fc136e10 0x7f14fc1d1a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45756/0 (socket says 172.21.15.171:45756) 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.784+0000 7f1500afd640 1 -- 172.21.15.171:0/233286390 learned_addr learned my addr 172.21.15.171:0/233286390 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054850547 0 0) 0x7f14fc13c360 con 0x7f14fc13e510 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): my global_id is 5925 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e8003530 con 0x7f14fc13e510 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291053963 0 0) 0x7f14fc09ddc0 con 0x7f14fc136e10 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): my global_id is 5621 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14fc13c360 con 0x7f14fc136e10 2024-04-25T23:59:02.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3342830247 0 0) 0x7f14e8003530 con 0x7f14fc13e510 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14fc09ddc0 con 0x7f14fc13e510 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f14ec0019c0 con 0x7f14fc13e510 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.783 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941293850 0 0) 0x7f14fc13bd40 con 0x7f14fc0a4c10 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): my global_id is 144184 2024-04-25T23:59:02.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14e8003530 con 0x7f14fc0a4c10 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 617585546 0 0) 0x7f14fc13c360 con 0x7f14fc136e10 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14fc13bd40 con 0x7f14fc136e10 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f14f0004b30 con 0x7f14fc136e10 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.785 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2587931616 0 0) 0x7f14fc09ddc0 con 0x7f14fc13e510 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 >> v1:172.21.15.171:6791/0 conn(0x7f14fc136e10 legacy=0x7f14fc1d1a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 >> v1:172.21.15.106:6791/0 conn(0x7f14fc0a4c10 legacy=0x7f14fc13b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 monclient: found mon.g 2024-04-25T23:59:02.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14fc136be0 con 0x7f14fc13e510 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 5 monclient: authenticate success, global_id 5925 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 10 monclient: _renew_subs 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f14fc120a70 con 0x7f14fc13e510 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 10 monclient: _renew_subs 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f14fc13d8d0 con 0x7f14fc13e510 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14ec003620 con 0x7f14fc13e510 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f14ec003b10 con 0x7f14fc13e510 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14fb7fe640 4 set_mon_vals no callback set 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 10 monclient: dump: 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.788 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14dc005090 con 0x7f14fc13e510 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f14ec00e8b0 con 0x7f14fc13e510 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(105..105 src has 1..105) ==== 5359+0+0 (unknown 1086254605 0 0) 0x7f14ec0438f0 con 0x7f14fc13e510 2024-04-25T23:59:02.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.788+0000 7f15012fe640 10 monclient: get_auth_request con 0x7f14e8037e60 auth_method 0 2024-04-25T23:59:02.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.792+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f14ec014440 con 0x7f14fc13e510 2024-04-25T23:59:02.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.792+0000 7f14f9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.792+0000 7f14f9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: get_monmap_and_config 2024-04-25T23:59:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: monmap: 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:02.818507+0000 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:02.818507+0000 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.799 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 Processor -- start 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- start start 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: init 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: _add_conns ranks=[2,1,7,0,6,3,5,4,8] 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient(hunting): picked mon.noname-b con 0x7f4fc80a1290 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient(hunting): picked mon.noname-f con 0x7f4fc809f770 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient(hunting): picked mon.noname-i con 0x7f4fc809fb70 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc80727a0 con 0x7f4fc809f770 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc80724c0 con 0x7f4fc80a1290 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc8072a80 con 0x7f4fc809fb70 2024-04-25T23:59:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient(hunting): authenticate will time out at 1198.345620s 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc77fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f4fc80a1290 0x7f4fc80a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39364/0 (socket says 172.21.15.106:39364) 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc77fe640 1 -- 172.21.15.106:0/1381287565 learned_addr learned my addr 172.21.15.106:0/1381287565 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 733360562 0 0) 0x7f4fc80724c0 con 0x7f4fc80a1290 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): my global_id is 5681 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fb4003530 con 0x7f4fc80a1290 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172253806 0 0) 0x7f4fc8072a80 con 0x7f4fc809fb70 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): my global_id is 144115 2024-04-25T23:59:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc80724c0 con 0x7f4fc809fb70 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756038708 0 0) 0x7f4fc0001050 con 0x7f4fc809f770 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient(hunting): my global_id is 144154 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc8072a80 con 0x7f4fc809f770 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 149371030 0 0) 0x7f4fb4003530 con 0x7f4fc80a1290 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 >> v1:172.21.15.171:6792/0 conn(0x7f4fc809fb70 legacy=0x7f4fc813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 >> v1:172.21.15.171:6789/0 conn(0x7f4fc809f770 legacy=0x7f4fc813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 monclient: found mon.noname-b 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc806bfc0 con 0x7f4fc80a1290 2024-04-25T23:59:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fb8001b40 con 0x7f4fc80a1290 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 5 monclient: authenticate success, global_id 5681 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: dump: 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fb8001e60 con 0x7f4fc80a1290 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 1 -- 172.21.15.106:0/1381287565 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fb8004f70 con 0x7f4fc80a1290 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fc67fc640 10 monclient: dump: 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 4 set_mon_vals no callback set 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: shutdown 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- 172.21.15.106:0/1381287565 >> v1:172.21.15.106:6790/0 conn(0x7f4fc80a1290 legacy=0x7f4fc80a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- 172.21.15.106:0/1381287565 shutdown_connections 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- 172.21.15.106:0/1381287565 >> 172.21.15.106:0/1381287565 conn(0x7f4fc806b210 msgr2=0x7f4fc806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- 172.21.15.106:0/1381287565 shutdown_connections 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 1 -- 172.21.15.106:0/1381287565 wait complete. 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.817+0000 7f4fcde86640 10 monclient: monmap: 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 Processor -- start 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 -- start start 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient: init 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient: _add_conns ranks=[8,0,3,2,6,4,5,1,7] 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient(hunting): picked mon.noname-e con 0x7f4fc809f770 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient(hunting): picked mon.noname-a con 0x7f4fc809fb70 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient(hunting): picked mon.noname-g con 0x7f4fc80a1290 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc8071860 con 0x7f4fc809fb70 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc80a1f00 con 0x7f4fc80a1290 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fc811ea80 con 0x7f4fc809f770 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient(hunting): authenticate will time out at 1198.348602s 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fc77fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f4fc809f770 0x7f4fc8133d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40456/0 (socket says 172.21.15.106:40456) 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fc77fe640 1 -- 172.21.15.106:0/85394000 learned_addr learned my addr 172.21.15.106:0/85394000 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fc6ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4fc809fb70 0x7f4fc81d1700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41312/0 (socket says 172.21.15.106:41312) 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812934464 0 0) 0x7f4fc811ea80 con 0x7f4fc809f770 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): my global_id is 144161 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa8003530 con 0x7f4fc809f770 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384910468 0 0) 0x7f4fc8071860 con 0x7f4fc809fb70 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): my global_id is 5796 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc811ea80 con 0x7f4fc809fb70 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351996554 0 0) 0x7f4fc80a1f00 con 0x7f4fc80a1290 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): my global_id is 5934 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc8071860 con 0x7f4fc80a1290 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 503420161 0 0) 0x7f4fa8003530 con 0x7f4fc809f770 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fc80a1f00 con 0x7f4fc809f770 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3466472774 0 0) 0x7f4fc811ea80 con 0x7f4fc809fb70 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fa8003530 con 0x7f4fc809fb70 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fb8004eb0 con 0x7f4fc809f770 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): dump: 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fc0001ae0 con 0x7f4fc809fb70 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): dump: 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3602849753 0 0) 0x7f4fc8071860 con 0x7f4fc80a1290 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fc811ea80 con 0x7f4fc80a1290 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fb00019e0 con 0x7f4fc80a1290 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): dump: 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3570742616 0 0) 0x7f4fc80a1f00 con 0x7f4fc809f770 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.171:6790/0 conn(0x7f4fc80a1290 legacy=0x7f4fc81d4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.106:6789/0 conn(0x7f4fc809fb70 legacy=0x7f4fc81d1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 monclient: found mon.e 2024-04-25T23:59:02.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fc806d570 con 0x7f4fc809f770 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 5 monclient: authenticate success, global_id 144161 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient: _renew_subs 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fc813e3f0 con 0x7f4fc809f770 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient: _renew_subs 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fc8134410 con 0x7f4fc809f770 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4fb8001e60 con 0x7f4fc809f770 2024-04-25T23:59:02.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fb8002010 con 0x7f4fc809f770 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fc5ffb640 4 set_mon_vals no callback set 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: dump: 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.823 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4fac0065d0 con 0x7f4fac002870 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4fb80103d0 con 0x7f4fc809f770 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(105..105 src has 1..105) ==== 5359+0+0 (unknown 1086254605 0 0) 0x7f4fb8044ed0 con 0x7f4fc809f770 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158003323 0 0) 0x7f4fac0065d0 con 0x7f4fac002870 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient(hunting): my global_id is 144163 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fc80a1f00 con 0x7f4fac002870 2024-04-25T23:59:02.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fc7fff640 10 monclient: get_auth_request con 0x7f4fa8038180 auth_method 0 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2101470298 0 0) 0x7f4fc80a1f00 con 0x7f4fac002870 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fac0065d0 con 0x7f4fac002870 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fc0003c10 con 0x7f4fac002870 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: dump: 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.825 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1115612926 0 0) 0x7f4fac0065d0 con 0x7f4fac002870 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4fac00a160 con 0x7f4fac002870 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4fc0004000 con 0x7f4fac002870 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.821+0000 7f4fbffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:02.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.825+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.171:6789/0 conn(0x7f4fac002870 legacy=0x7f4fac004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.825+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.171:6789/0 conn(0x7f4fac002870 legacy=0x7f4fac004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4fac009e30 con 0x7f4fac0090f0 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528774790 0 0) 0x7f4fac009e30 con 0x7f4fac0090f0 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient(hunting): my global_id is 144172 2024-04-25T23:59:02.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fac0065d0 con 0x7f4fac0090f0 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1440354489 0 0) 0x7f4fac0065d0 con 0x7f4fac0090f0 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fac009e30 con 0x7f4fac0090f0 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fc0004420 con 0x7f4fac0090f0 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient: dump: 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.829 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1667459366 0 0) 0x7f4fac009e30 con 0x7f4fac0090f0 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4fac00c3a0 con 0x7f4fac0090f0 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 1889546473) 0x7f4fc0005c20 con 0x7f4fac0090f0 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.171:6789/0 conn(0x7f4fac0090f0 legacy=0x7f4fac009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fbffff640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.171:6789/0 conn(0x7f4fac0090f0 legacy=0x7f4fac009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 6359, 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.839 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:02.841 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.842 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.843 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.844 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:02.846 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.847 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:02.848 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:02.849 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:02.849 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:02.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.171:6812/722422047 conn(0x7f4fa8038180 legacy=0x7f4fa803a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 10 monclient: shutdown 2024-04-25T23:59:02.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 >> v1:172.21.15.106:6793/0 conn(0x7f4fc809f770 legacy=0x7f4fc8133d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fc7fff640 1 -- 172.21.15.106:0/85394000 reap_dead start 2024-04-25T23:59:02.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fc7fff640 1 -- 172.21.15.106:0/85394000 reap_dead start 2024-04-25T23:59:02.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 shutdown_connections 2024-04-25T23:59:02.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 >> 172.21.15.106:0/85394000 conn(0x7f4fc806b210 msgr2=0x7f4fc8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 shutdown_connections 2024-04-25T23:59:02.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.829+0000 7f4fcde86640 1 -- 172.21.15.106:0/85394000 wait complete. 2024-04-25T23:59:02.851 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:02.851 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-25T23:59:02.851 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:59:02.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.972+0000 7f1503562640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:59:02.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.972+0000 7f1503562640 10 monclient: _send_command 2 [{"prefix": "osd create"}] 2024-04-25T23:59:02.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.972+0000 7f1503562640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:02.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:02.972+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f14dc005380 con 0x7f14fc13e510 2024-04-25T23:59:02.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: get_monmap_and_config 2024-04-25T23:59:02.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: monmap: 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:02.990534+0000 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:02.990534+0000 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.971 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 Processor -- start 2024-04-25T23:59:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- start start 2024-04-25T23:59:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: init 2024-04-25T23:59:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: _add_conns ranks=[4,8,7,1,3,2,6,5,0] 2024-04-25T23:59:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient(hunting): picked mon.noname-c con 0x7f321c134660 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient(hunting): picked mon.noname-e con 0x7f321c09f070 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient(hunting): picked mon.noname-i con 0x7f321c13e100 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c09fbc0 con 0x7f321c134660 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c0a2ed0 con 0x7f321c13e100 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c0a0e90 con 0x7f321c09f070 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient(hunting): authenticate will time out at 1198.517902s 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3220c0a640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f321c134660 0x7f321c134a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:59520/0 (socket says 172.21.15.106:59520) 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3220c0a640 1 -- 172.21.15.106:0/3210752004 learned_addr learned my addr 172.21.15.106:0/3210752004 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408554645 0 0) 0x7f321c0a0e90 con 0x7f321c09f070 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): my global_id is 144170 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3208003530 con 0x7f321c09f070 2024-04-25T23:59:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2731883167 0 0) 0x7f32140014a0 con 0x7f321c134660 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient(hunting): my global_id is 144193 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f321c0a0e90 con 0x7f321c134660 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1899580111 0 0) 0x7f3208003530 con 0x7f321c09f070 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 >> v1:172.21.15.171:6792/0 conn(0x7f321c13e100 legacy=0x7f321c1404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 >> v1:172.21.15.106:6791/0 conn(0x7f321c134660 legacy=0x7f321c134a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 monclient: found mon.noname-e 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c0a2750 con 0x7f321c09f070 2024-04-25T23:59:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32040017c0 con 0x7f321c09f070 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: dump: 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 5 monclient: authenticate success, global_id 144170 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3204001aa0 con 0x7f321c09f070 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 1 -- 172.21.15.106:0/3210752004 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3204003960 con 0x7f321c09f070 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 4 set_mon_vals no callback set 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f321b7fe640 10 monclient: dump: 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 10 monclient: shutdown 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- 172.21.15.106:0/3210752004 >> v1:172.21.15.106:6793/0 conn(0x7f321c09f070 legacy=0x7f321c13c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- 172.21.15.106:0/3210752004 shutdown_connections 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- 172.21.15.106:0/3210752004 >> 172.21.15.106:0/3210752004 conn(0x7f321c0a35e0 msgr2=0x7f321c0a39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- 172.21.15.106:0/3210752004 shutdown_connections 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.989+0000 7f3222e6e640 1 -- 172.21.15.106:0/3210752004 wait complete. 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: build_initial_monmap 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: monmap: 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 Processor -- start 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 -- start start 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: init 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: _add_conns ranks=[5,3,8,4,0,7,6,2,1] 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient(hunting): picked mon.noname-h con 0x7f321c09f070 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient(hunting): picked mon.noname-g con 0x7f321c134660 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient(hunting): picked mon.noname-e con 0x7f321c13e100 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c13d500 con 0x7f321c134660 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c1395d0 con 0x7f321c09f070 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f321c072600 con 0x7f321c13e100 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient(hunting): authenticate will time out at 1198.521001s 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f322140b640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f321c13e100 0x7f321c1d4d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40474/0 (socket says 172.21.15.106:40474) 2024-04-25T23:59:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f322140b640 1 -- 172.21.15.106:0/2585468623 learned_addr learned my addr 172.21.15.106:0/2585468623 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626353850 0 0) 0x7f321c072600 con 0x7f321c13e100 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): my global_id is 144179 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31fc003530 con 0x7f321c13e100 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3096588432 0 0) 0x7f31fc003530 con 0x7f321c13e100 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f321c072600 con 0x7f321c13e100 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f320c001a00 con 0x7f321c13e100 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): dump: 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1998540310 0 0) 0x7f321c1395d0 con 0x7f321c09f070 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): my global_id is 5630 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31fc003530 con 0x7f321c09f070 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 920205584 0 0) 0x7f321c072600 con 0x7f321c13e100 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.171:6791/0 conn(0x7f321c09f070 legacy=0x7f321c1387b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.171:6790/0 conn(0x7f321c134660 legacy=0x7f321c138ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 monclient: found mon.e 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f321c1380d0 con 0x7f321c13e100 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 5 monclient: authenticate success, global_id 144179 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: _renew_subs 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f321c13b560 con 0x7f321c13e100 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: _renew_subs 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f321c13d200 con 0x7f321c13e100 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f320c001d40 con 0x7f321c13e100 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f320c003c90 con 0x7f321c13e100 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f321affd640 4 set_mon_vals no callback set 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:02.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: dump: 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f32000065d0 con 0x7f3200002870 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f320c003eb0 con 0x7f321c13e100 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(105..105 src has 1..105) ==== 5359+0+0 (unknown 1086254605 0 0) 0x7f320c044c40 con 0x7f321c13e100 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750244822 0 0) 0x7f32000065d0 con 0x7f3200002870 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient(hunting): my global_id is 5952 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f321c072600 con 0x7f3200002870 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f321bfff640 10 monclient: get_auth_request con 0x7f31fc037840 auth_method 0 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1884652149 0 0) 0x7f321c072600 con 0x7f3200002870 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32000065d0 con 0x7f3200002870 2024-04-25T23:59:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32140018a0 con 0x7f3200002870 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 10 monclient: dump: 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3117519478 0 0) 0x7f32000065d0 con 0x7f3200002870 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.993+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f320000a160 con 0x7f3200002870 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.997+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3214001cd0 con 0x7f3200002870 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.997+0000 7f32197fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.997+0000 7f32197fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.997+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.171:6790/0 conn(0x7f3200002870 legacy=0x7f3200004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:02.997+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.171:6790/0 conn(0x7f3200002870 legacy=0x7f3200004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f3222e6e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3200009e50 con 0x7f3200009110 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593104959 0 0) 0x7f3200009e50 con 0x7f3200009110 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 10 monclient(hunting): my global_id is 5961 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32000065d0 con 0x7f3200009110 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3665279691 0 0) 0x7f32000065d0 con 0x7f3200009110 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3200009e50 con 0x7f3200009110 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32140050a0 con 0x7f3200009110 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.001+0000 7f32197fa640 10 monclient: dump: 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:02.996 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:02.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2597284555 0 0) 0x7f3200009e50 con 0x7f3200009110 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f320000c3e0 con 0x7f3200009110 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 935344258) 0x7f32140073d0 con 0x7f3200009110 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f32197fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f32197fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.171:6790/0 conn(0x7f3200009110 legacy=0x7f32000095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f32197fa640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.171:6790/0 conn(0x7f3200009110 legacy=0x7f32000095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 261521, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:03.014 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:03.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:03.016 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:03.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.171:6812/722422047 conn(0x7f31fc037840 legacy=0x7f31fc039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 10 monclient: shutdown 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 >> v1:172.21.15.106:6793/0 conn(0x7f321c13e100 legacy=0x7f321c1d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f322140b640 1 -- 172.21.15.106:0/2585468623 reap_dead start 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f322140b640 1 -- 172.21.15.106:0/2585468623 reap_dead start 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 shutdown_connections 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 >> 172.21.15.106:0/2585468623 conn(0x7f321c0a35e0 msgr2=0x7f321c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 shutdown_connections 2024-04-25T23:59:03.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.005+0000 7f3222e6e640 1 -- 172.21.15.106:0/2585468623 wait complete. 2024-04-25T23:59:03.018 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:03.018 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-25T23:59:03.019 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:59:03.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.149+0000 7f59e926e640 10 monclient: get_monmap_and_config 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.149+0000 7f59e926e640 10 monclient: build_initial_monmap 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: monmap: 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:03.154388+0000 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:03.154388+0000 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:03.134 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:03.135 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:03.135 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:03.135 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:03.135 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:03.135 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:03.135 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:03.135 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 Processor -- start 2024-04-25T23:59:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- start start 2024-04-25T23:59:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: init 2024-04-25T23:59:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: _add_conns ranks=[8,6,7,0,1,2,3,4,5] 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient(hunting): picked mon.noname-e con 0x7f59e4070ae0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient(hunting): picked mon.noname-d con 0x7f59e4071910 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient(hunting): picked mon.noname-i con 0x7f59e413bed0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e4072480 con 0x7f59e4071910 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e4072760 con 0x7f59e413bed0 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e40a3790 con 0x7f59e4070ae0 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient(hunting): authenticate will time out at 1198.681495s 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e2ffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f59e4070ae0 0x7f59e4070ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40488/0 (socket says 172.21.15.106:40488) 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e2ffd640 1 -- 172.21.15.106:0/287367404 learned_addr learned my addr 172.21.15.106:0/287367404 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59da7fc640 1 --1- 172.21.15.106:0/287367404 >> v1:172.21.15.106:6792/0 conn(0x7f59e4071910 0x7f59e413a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53124/0 (socket says 172.21.15.106:53124) 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2419612421 0 0) 0x7f59e4072480 con 0x7f59e4071910 2024-04-25T23:59:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): my global_id is 5721 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d0003530 con 0x7f59e4071910 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1576633397 0 0) 0x7f59e40a3790 con 0x7f59e4070ae0 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient(hunting): my global_id is 144188 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e4072480 con 0x7f59e4070ae0 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1014898330 0 0) 0x7f59e4072480 con 0x7f59e4070ae0 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 >> v1:172.21.15.171:6792/0 conn(0x7f59e413bed0 legacy=0x7f59e413e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 >> v1:172.21.15.106:6792/0 conn(0x7f59e4071910 legacy=0x7f59e413a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 monclient: found mon.noname-e 2024-04-25T23:59:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e40a40b0 con 0x7f59e4070ae0 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59d4001740 con 0x7f59e4070ae0 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 5 monclient: authenticate success, global_id 144188 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: dump: 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59d4001930 con 0x7f59e4070ae0 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 4 set_mon_vals no callback set 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 1 -- 172.21.15.106:0/287367404 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59d40048b0 con 0x7f59e4070ae0 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e27fc640 10 monclient: dump: 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: shutdown 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- 172.21.15.106:0/287367404 >> v1:172.21.15.106:6793/0 conn(0x7f59e4070ae0 legacy=0x7f59e4070ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- 172.21.15.106:0/287367404 shutdown_connections 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- 172.21.15.106:0/287367404 >> 172.21.15.106:0/287367404 conn(0x7f59e40a83a0 msgr2=0x7f59e40a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- 172.21.15.106:0/287367404 shutdown_connections 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 1 -- 172.21.15.106:0/287367404 wait complete. 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: build_initial_monmap 2024-04-25T23:59:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.153+0000 7f59e926e640 10 monclient: monmap: 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 Processor -- start 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 -- start start 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient: init 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient: _add_conns ranks=[1,3,2,8,6,7,0,5,4] 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient(hunting): picked mon.noname-f con 0x7f59e4070ae0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient(hunting): picked mon.noname-g con 0x7f59e4071910 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient(hunting): picked mon.noname-b con 0x7f59e413bed0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e41399e0 con 0x7f59e4070ae0 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e4138ba0 con 0x7f59e413bed0 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e41379d0 con 0x7f59e4071910 2024-04-25T23:59:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient(hunting): authenticate will time out at 1198.684586s 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e37fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f59e413bed0 0x7f59e41d28f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39378/0 (socket says 172.21.15.106:39378) 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e37fe640 1 -- 172.21.15.106:0/187523393 learned_addr learned my addr 172.21.15.106:0/187523393 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 873107042 0 0) 0x7f59e4138ba0 con 0x7f59e413bed0 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): my global_id is 5690 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c4003530 con 0x7f59e413bed0 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 471930837 0 0) 0x7f59c4003530 con 0x7f59e413bed0 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59e4138ba0 con 0x7f59e413bed0 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59dc001d50 con 0x7f59e413bed0 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): dump: 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 940122500 0 0) 0x7f59e4138ba0 con 0x7f59e413bed0 2024-04-25T23:59:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.171:6790/0 conn(0x7f59e4071910 legacy=0x7f59e41cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.171:6789/0 conn(0x7f59e4070ae0 legacy=0x7f59e413b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 monclient: found mon.b 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e4138530 con 0x7f59e413bed0 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: _finish_auth 0 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 5 monclient: authenticate success, global_id 5690 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient: _renew_subs 2024-04-25T23:59:03.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59e413b900 con 0x7f59e413bed0 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient: _renew_subs 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f59e41ca100 con 0x7f59e413bed0 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59dc003c50 con 0x7f59e413bed0 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59dc0041c0 con 0x7f59e413bed0 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e1ffb640 4 set_mon_vals no callback set 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: dump: 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f59c80065d0 con 0x7f59c8002870 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f59dc004360 con 0x7f59e413bed0 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(105..105 src has 1..105) ==== 5359+0+0 (unknown 1086254605 0 0) 0x7f59dc044ed0 con 0x7f59e413bed0 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664298676 0 0) 0x7f59c80065d0 con 0x7f59c8002870 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59da7fc640 10 monclient: get_auth_request con 0x7f59c4037710 auth_method 0 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient(hunting): my global_id is 5639 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59e4138ba0 con 0x7f59c8002870 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 491077214 0 0) 0x7f59e4138ba0 con 0x7f59c8002870 2024-04-25T23:59:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59c80065d0 con 0x7f59c8002870 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59d4001700 con 0x7f59c8002870 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 10 monclient: dump: 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.158 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1311760825 0 0) 0x7f59c80065d0 con 0x7f59c8002870 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.157+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f59c800a160 con 0x7f59c8002870 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.161+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f59d4001a10 con 0x7f59c8002870 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.161+0000 7f59dbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.161+0000 7f59dbfff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.161+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.171:6791/0 conn(0x7f59c8002870 legacy=0x7f59c8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.161+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.171:6791/0 conn(0x7f59c8002870 legacy=0x7f59c8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59e926e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f59c8009e30 con 0x7f59c80090f0 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68674340 0 0) 0x7f59c8009e30 con 0x7f59c80090f0 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 10 monclient(hunting): my global_id is 5648 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59c80065d0 con 0x7f59c80090f0 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 273526492 0 0) 0x7f59c80065d0 con 0x7f59c80090f0 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59c8009e30 con 0x7f59c80090f0 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59d4005340 con 0x7f59c80090f0 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:03.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.165+0000 7f59dbfff640 10 monclient: dump: 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.162 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 280289167 0 0) 0x7f59c8009e30 con 0x7f59c80090f0 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f59c800c3a0 con 0x7f59c80090f0 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1450269473) 0x7f59d4005590 con 0x7f59c80090f0 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59dbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59dbfff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.171:6791/0 conn(0x7f59c80090f0 legacy=0x7f59c8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59dbfff640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.171:6791/0 conn(0x7f59c80090f0 legacy=0x7f59c8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 261665, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:03.179 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.180 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.181 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:03.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.183 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.184 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.184 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:03.184 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.171:6812/722422047 conn(0x7f59c4037710 legacy=0x7f59c4039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 10 monclient: shutdown 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 >> v1:172.21.15.106:6790/0 conn(0x7f59e413bed0 legacy=0x7f59e41d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e37fe640 1 -- 172.21.15.106:0/187523393 reap_dead start 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e37fe640 1 -- 172.21.15.106:0/187523393 reap_dead start 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 shutdown_connections 2024-04-25T23:59:03.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 >> 172.21.15.106:0/187523393 conn(0x7f59e40a83a0 msgr2=0x7f59e4134b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:03.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 shutdown_connections 2024-04-25T23:59:03.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.169+0000 7f59e926e640 1 -- 172.21.15.106:0/187523393 wait complete. 2024-04-25T23:59:03.186 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:03.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-25T23:59:03.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-25T23:59:03.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient: get_monmap_and_config 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient: build_initial_monmap 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient: monmap: 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:03.319549+0000 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:03.319549+0000 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:03.299 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:03.300 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 1 Processor -- start 2024-04-25T23:59:03.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 1 -- start start 2024-04-25T23:59:03.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient: init 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient: _add_conns ranks=[3,1,0,6,8,7,2,5,4] 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient(hunting): picked mon.noname-g con 0x7f50500a1c30 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient(hunting): picked mon.noname-f con 0x7f50500a2010 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient(hunting): picked mon.noname-a con 0x7f505013dc40 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505009c5b0 con 0x7f505013dc40 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505009c2d0 con 0x7f50500a2010 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50500a3a70 con 0x7f50500a1c30 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient(hunting): authenticate will time out at 1198.846688s 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f5054eab640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f505013dc40 0x7f5050140030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41326/0 (socket says 172.21.15.106:41326) 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f5054eab640 1 -- 172.21.15.106:0/2255061713 learned_addr learned my addr 172.21.15.106:0/2255061713 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610654885 0 0) 0x7f5040001120 con 0x7f505013dc40 2024-04-25T23:59:03.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient(hunting): my global_id is 5805 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5030003530 con 0x7f505013dc40 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 195783518 0 0) 0x7f5030003530 con 0x7f505013dc40 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 >> v1:172.21.15.171:6790/0 conn(0x7f50500a1c30 legacy=0x7f505009aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 >> v1:172.21.15.171:6789/0 conn(0x7f50500a2010 legacy=0x7f50500a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 monclient: found mon.noname-a 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5050144780 con 0x7f505013dc40 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: _finish_auth 0 2024-04-25T23:59:03.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 5 monclient: authenticate success, global_id 5805 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5040001990 con 0x7f505013dc40 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: dump: 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5040001c70 con 0x7f505013dc40 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f505690e640 4 set_mon_vals no callback set 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 1 -- 172.21.15.106:0/2255061713 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5040004bf0 con 0x7f505013dc40 2024-04-25T23:59:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.317+0000 7f504effd640 10 monclient: dump: 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: shutdown 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/2255061713 >> v1:172.21.15.106:6789/0 conn(0x7f505013dc40 legacy=0x7f5050140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/2255061713 shutdown_connections 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/2255061713 >> 172.21.15.106:0/2255061713 conn(0x7f50500a2d20 msgr2=0x7f50500a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/2255061713 shutdown_connections 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/2255061713 wait complete. 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: build_initial_monmap 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: monmap: 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 Processor -- start 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- start start 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: init 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: _add_conns ranks=[1,2,8,6,0,3,4,7,5] 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient(hunting): picked mon.noname-f con 0x7f50500a1c30 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient(hunting): picked mon.noname-b con 0x7f50500a2010 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient(hunting): picked mon.noname-e con 0x7f505013dc40 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505012e7a0 con 0x7f50500a1c30 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5050140d30 con 0x7f50500a2010 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5050132fd0 con 0x7f505013dc40 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient(hunting): authenticate will time out at 1198.849856s 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f5054eab640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f505013dc40 0x7f50501d48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40492/0 (socket says 172.21.15.106:40492) 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f5054eab640 1 -- 172.21.15.106:0/3372027552 learned_addr learned my addr 172.21.15.106:0/3372027552 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1186967144 0 0) 0x7f5050132fd0 con 0x7f505013dc40 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): my global_id is 144197 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5034003530 con 0x7f505013dc40 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162569096 0 0) 0x7f5050140d30 con 0x7f50500a2010 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): my global_id is 5699 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050132fd0 con 0x7f50500a2010 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1015716182 0 0) 0x7f5050132fd0 con 0x7f50500a2010 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5050140d30 con 0x7f50500a2010 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1511871668 0 0) 0x7f5034003530 con 0x7f505013dc40 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5050132fd0 con 0x7f505013dc40 2024-04-25T23:59:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5048001d30 con 0x7f50500a2010 2024-04-25T23:59:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): dump: 2024-04-25T23:59:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50400047f0 con 0x7f505013dc40 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): dump: 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2878759853 0 0) 0x7f505012e7a0 con 0x7f50500a1c30 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient(hunting): my global_id is 144199 2024-04-25T23:59:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5034003530 con 0x7f50500a1c30 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1233317509 0 0) 0x7f5050132fd0 con 0x7f505013dc40 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.106:6790/0 conn(0x7f50500a2010 legacy=0x7f505012e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.171:6789/0 conn(0x7f50500a1c30 legacy=0x7f505012d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 monclient: found mon.e 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50501332b0 con 0x7f505013dc40 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 5 monclient: authenticate success, global_id 144197 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: _renew_subs 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5050131d20 con 0x7f505013dc40 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: _renew_subs 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f50501341c0 con 0x7f505013dc40 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5050075890 con 0x7f50501419a0 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5040001c70 con 0x7f505013dc40 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50400051e0 con 0x7f505013dc40 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504cff9640 10 monclient: dump: 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.321+0000 7f504e7fc640 4 set_mon_vals no callback set 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f504000ff80 con 0x7f505013dc40 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(105..105 src has 1..105) ==== 5359+0+0 (unknown 1086254605 0 0) 0x7f5040044b50 con 0x7f505013dc40 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45477655 0 0) 0x7f5050075890 con 0x7f50501419a0 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient(hunting): my global_id is 144142 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050132fd0 con 0x7f50501419a0 2024-04-25T23:59:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504f7fe640 10 monclient: get_auth_request con 0x7f5034037e50 auth_method 0 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1086471051 0 0) 0x7f5050132fd0 con 0x7f50501419a0 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5050075890 con 0x7f50501419a0 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5038001930 con 0x7f50501419a0 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient: dump: 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.327 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2153963521 0 0) 0x7f5050075890 con 0x7f50501419a0 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5050140620 con 0x7f50501419a0 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5038003620 con 0x7f50501419a0 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.171:6792/0 conn(0x7f50501419a0 legacy=0x7f505012eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.325+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.171:6792/0 conn(0x7f50501419a0 legacy=0x7f505012eba0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:03.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5050062e50 con 0x7f505002d010 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2246762347 0 0) 0x7f5050062e50 con 0x7f505002d010 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient(hunting): my global_id is 144151 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5050075890 con 0x7f505002d010 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4245073935 0 0) 0x7f5050075890 con 0x7f505002d010 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5050062e50 con 0x7f505002d010 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5038003d00 con 0x7f505002d010 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:03.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient: dump: 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.331 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 423926688 0 0) 0x7f5050062e50 con 0x7f505002d010 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f505006cdf0 con 0x7f505002d010 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2419920597) 0x7f5038006050 con 0x7f505002d010 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.171:6792/0 conn(0x7f505002d010 legacy=0x7f505012f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f504cff9640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.171:6792/0 conn(0x7f505002d010 legacy=0x7f505012f2b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 6863, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.345 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.346 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.347 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.348 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:03.349 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:03.350 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:03.351 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.171:6812/722422047 conn(0x7f5034037e50 legacy=0x7f503403a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 10 monclient: shutdown 2024-04-25T23:59:03.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 >> v1:172.21.15.106:6793/0 conn(0x7f505013dc40 legacy=0x7f50501d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f5054eab640 1 -- 172.21.15.106:0/3372027552 reap_dead start 2024-04-25T23:59:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f5054eab640 1 -- 172.21.15.106:0/3372027552 reap_dead start 2024-04-25T23:59:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 shutdown_connections 2024-04-25T23:59:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 >> 172.21.15.106:0/3372027552 conn(0x7f50500a2d20 msgr2=0x7f5050143f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 shutdown_connections 2024-04-25T23:59:03.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.333+0000 7f505690e640 1 -- 172.21.15.106:0/3372027552 wait complete. 2024-04-25T23:59:03.353 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:03.354 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-25T23:59:03.354 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-25T23:59:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient: get_monmap_and_config 2024-04-25T23:59:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient: build_initial_monmap 2024-04-25T23:59:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient: monmap: 2024-04-25T23:59:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:03.484399+0000 2024-04-25T23:59:03.464 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:03.484399+0000 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:03.465 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 1 Processor -- start 2024-04-25T23:59:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 1 -- start start 2024-04-25T23:59:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient: init 2024-04-25T23:59:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient: _add_conns ranks=[2,8,0,7,6,4,1,5,3] 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient(hunting): picked mon.noname-b con 0x7fe3a8135870 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient(hunting): picked mon.noname-e con 0x7fe3a81353b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient(hunting): picked mon.noname-a con 0x7fe3a813bdf0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a806f2d0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a8072330 con 0x7fe3a8135870 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a8072610 con 0x7fe3a81353b0 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ae2ca640 10 monclient(hunting): authenticate will time out at 1199.011541s 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ac867640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe3a813bdf0 0x7fe3a813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41342/0 (socket says 172.21.15.106:41342) 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.481+0000 7fe3ac867640 1 -- 172.21.15.106:0/2495666978 learned_addr learned my addr 172.21.15.106:0/2495666978 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 763780675 0 0) 0x7fe3a806f2d0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): my global_id is 5814 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe390003530 con 0x7fe3a813bdf0 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698100753 0 0) 0x7fe3a8072610 con 0x7fe3a81353b0 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): my global_id is 144206 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a806f2d0 con 0x7fe3a81353b0 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064666854 0 0) 0x7fe3a8072330 con 0x7fe3a8135870 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient(hunting): my global_id is 5708 2024-04-25T23:59:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a8072610 con 0x7fe3a8135870 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4079601661 0 0) 0x7fe390003530 con 0x7fe3a813bdf0 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 >> v1:172.21.15.106:6793/0 conn(0x7fe3a81353b0 legacy=0x7fe3a813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 >> v1:172.21.15.106:6790/0 conn(0x7fe3a8135870 legacy=0x7fe3a8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 monclient: found mon.noname-a 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80a3260 con 0x7fe3a813bdf0 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a0001b40 con 0x7fe3a813bdf0 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: dump: 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 5 monclient: authenticate success, global_id 5814 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3a0001de0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 1 -- 172.21.15.106:0/2495666978 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a0004f70 con 0x7fe3a813bdf0 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 4 set_mon_vals no callback set 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a6ffd640 10 monclient: dump: 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: shutdown 2024-04-25T23:59:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/2495666978 >> v1:172.21.15.106:6789/0 conn(0x7fe3a813bdf0 legacy=0x7fe3a813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/2495666978 shutdown_connections 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/2495666978 >> 172.21.15.106:0/2495666978 conn(0x7fe3a80a64e0 msgr2=0x7fe3a80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/2495666978 shutdown_connections 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/2495666978 wait complete. 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: build_initial_monmap 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: monmap: 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:03.480 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 Processor -- start 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- start start 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: init 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: _add_conns ranks=[6,1,0,3,5,4,8,2,7] 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient(hunting): picked mon.noname-d con 0x7fe3a81353b0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient(hunting): picked mon.noname-f con 0x7fe3a8135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient(hunting): picked mon.noname-a con 0x7fe3a813bdf0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80a4fa0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a806ffd0 con 0x7fe3a8135870 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a8071480 con 0x7fe3a81353b0 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient(hunting): authenticate will time out at 1199.014837s 2024-04-25T23:59:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ac867640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe3a813bdf0 0x7fe3a81d49b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41350/0 (socket says 172.21.15.106:41350) 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ac867640 1 -- 172.21.15.106:0/1485063023 learned_addr learned my addr 172.21.15.106:0/1485063023 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a7fff640 1 --1- 172.21.15.106:0/1485063023 >> v1:172.21.15.106:6792/0 conn(0x7fe3a81353b0 0x7fe3a81347f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53126/0 (socket says 172.21.15.106:53126) 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879095284 0 0) 0x7fe3a80a4fa0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 5823 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe394003560 con 0x7fe3a813bdf0 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2190783994 0 0) 0x7fe3a8071480 con 0x7fe3a81353b0 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 5730 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a80a4fa0 con 0x7fe3a81353b0 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 795752313 0 0) 0x7fe394003560 con 0x7fe3a813bdf0 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3a8071480 con 0x7fe3a813bdf0 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a0004eb0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1700011752 0 0) 0x7fe3a80a4fa0 con 0x7fe3a81353b0 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe394003560 con 0x7fe3a81353b0 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe398001520 con 0x7fe3a81353b0 2024-04-25T23:59:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090540527 0 0) 0x7fe3a806ffd0 con 0x7fe3a8135870 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient(hunting): my global_id is 144208 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a80a4fa0 con 0x7fe3a8135870 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3983457255 0 0) 0x7fe3a8071480 con 0x7fe3a813bdf0 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 >> v1:172.21.15.106:6792/0 conn(0x7fe3a81353b0 legacy=0x7fe3a81347f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 >> v1:172.21.15.171:6789/0 conn(0x7fe3a8135870 legacy=0x7fe3a81d1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 monclient: found mon.a 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a806fd20 con 0x7fe3a813bdf0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 5 monclient: authenticate success, global_id 5823 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: _renew_subs 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a80701f0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: _renew_subs 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3a81c9410 con 0x7fe3a813bdf0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3a0001de0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a00014e0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a67fc640 4 set_mon_vals no callback set 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.485+0000 7fe3a4ff9640 10 monclient: dump: 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.489+0000 7fe3ae2ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.489+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe3a0010120 con 0x7fe3a813bdf0 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.489+0000 7fe3ae2ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.489+0000 7fe3ae2ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.489+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe388005090 con 0x7fe3a813bdf0 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.489+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(105..105 src has 1..105) ==== 5359+0+0 (unknown 1086254605 0 0) 0x7fe3a0044db0 con 0x7fe3a813bdf0 2024-04-25T23:59:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.489+0000 7fe3a7fff640 10 monclient: get_auth_request con 0x7fe394037f10 auth_method 0 2024-04-25T23:59:03.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.493+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe3a0015b40 con 0x7fe3a813bdf0 2024-04-25T23:59:03.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.493+0000 7fe3a4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:03.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.493+0000 7fe3a4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:03.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:03.644+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd create"}]=0 v106) ==== 58+0+3 (unknown 3507046352 0 736921282) 0x7f14ec0180f0 con 0x7f14fc13e510 2024-04-25T23:59:03.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:03.644+0000 7f14f9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create"}] 2024-04-25T23:59:03.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:03.644+0000 7f14f9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.713+0000 7fe3ae2ca640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-25T23:59:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.713+0000 7fe3ae2ca640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-25T23:59:03.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.713+0000 7fe3ae2ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:03.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.713+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe388005b90 con 0x7fe3a813bdf0 2024-04-25T23:59:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.717+0000 7fe3a4ff9640 1 -- 172.21.15.106:0/1485063023 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fe3a0015440 con 0x7fe3a813bdf0 2024-04-25T23:59:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.717+0000 7fe3a4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-25T23:59:03.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.717+0000 7fe3a4ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:03.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=24,config=2,health=11,kv=10,logm=53} crc {auth=3728020195,config=692619927,health=3198500600,kv=3875002534,logm=2603137932}) 2024-04-25T23:59:03.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=25,config=2,health=10,kv=10,logm=53} crc {auth=643183868,config=692619927,health=3369926971,kv=3875002534,logm=1372572901}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=25,config=2,health=12,kv=10,logm=51} crc {auth=319406358,config=692619927,health=906682742,kv=3875002534,logm=1324751497}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=24,config=2,health=12,kv=9,logm=53} crc {auth=2400367583,config=692619927,health=906682742,kv=1190676538,logm=903141133}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=25,config=2,health=11,kv=9,logm=53} crc {auth=2008092533,config=692619927,health=3172947059,kv=3875002534,logm=543329261}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=443955862,config=692619927,health=906682742,kv=3875002534,logm=3062893946}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=25,config=2,health=12,kv=9,logm=52} crc {auth=2035046799,config=692619927,health=906682742,kv=1190676538,logm=765283460}) 2024-04-25T23:59:03.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=2506302291,config=692619927,health=906682742,kv=3875002534,logm=3571485570}) 2024-04-25T23:59:03.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=25,health=12,kv=10,logm=53} crc {auth=2035046799,health=4223589101,kv=3875002534,logm=289745784}) 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 >> v1:172.21.15.171:6812/722422047 conn(0x7fe394037f10 legacy=0x7fe39403a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 10 monclient: shutdown 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 >> v1:172.21.15.106:6789/0 conn(0x7fe3a813bdf0 legacy=0x7fe3a81d49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 shutdown_connections 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 >> 172.21.15.106:0/1485063023 conn(0x7fe3a80a64e0 msgr2=0x7fe3a80a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 shutdown_connections 2024-04-25T23:59:03.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:03.721+0000 7fe3ae2ca640 1 -- 172.21.15.106:0/1485063023 wait complete. 2024-04-25T23:59:03.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3801296004}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3258017856}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=154673414}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3665088292}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=878167837}) 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3046236363}) 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4234028759}) 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4001995943}) 2024-04-25T23:59:03.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2296775652}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1318598484}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2402752710}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1084039460}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3742334483}) 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2619658977}) 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3853014602}) 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2088389384}) 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1690936153}) 2024-04-25T23:59:03.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3859226974}) 2024-04-25T23:59:03.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2450359112}) 2024-04-25T23:59:03.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1047890834}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2459772925}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2882125815}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=496750973}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2868132325}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=448545198}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4255775619}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1196849185}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3386198899}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3497192732}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=276654553}) 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4013082296}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2793181967}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=90315031}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1406860440}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723041509}) 2024-04-25T23:59:03.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4010211020}) 2024-04-25T23:59:03.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2015584043}) 2024-04-25T23:59:03.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2724629576}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1767768944}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1163149585}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2312679856}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2377590813}) 2024-04-25T23:59:03.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3610393207}) 2024-04-25T23:59:03.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706784213}) 2024-04-25T23:59:03.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3474538347}) 2024-04-25T23:59:03.725 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=512121054}) 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1834114914}) 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2077221648}) 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=296774611}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=121492710}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1740581426}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1272443818}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1646042183}) 2024-04-25T23:59:03.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2218754344}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=940374017}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1020394618}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=203106939}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4048096980}) 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2241936748}) 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2504732858}) 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4187656951}) 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=858945905}) 2024-04-25T23:59:03.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3851060931}) 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1866580150}) 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3534333198}) 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1695191583}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1871683380}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=568005473}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1318514885}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1246498072}) 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2882606932}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2444054851}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3710423545}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=587530844}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2822649412}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=143463170}) 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=416290248}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3941701628}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4265232133}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3050748569}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3212465444}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4088299146}) 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2906895575}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1051079613}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2300208960}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2026860023}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2788353466}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2336396091}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002174047}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=707340656}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2995015517}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1127028836}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2363493620}) 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1227708889}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=173205564}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3296852425}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3825144585}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3522519922}) 2024-04-25T23:59:03.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3335554908}) 2024-04-25T23:59:03.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:03.764+0000 7f1503562640 10 start_mon_command cmd=[{"prefix": "osd create"}] 2024-04-25T23:59:03.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:03.764+0000 7f1503562640 10 monclient: _send_command 3 [{"prefix": "osd create"}] 2024-04-25T23:59:03.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:03.764+0000 7f1503562640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:03.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:03.764+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd create"} v 0) -- 0x7f14dc000bd0 con 0x7f14fc13e510 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3643965705}) 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4223810072}) 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4251096837}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1717959947}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2612657297}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4121321703}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1513385058}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1080418499}) 2024-04-25T23:59:03.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4101184845}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1663214577}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=526147113}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1354991712}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1104275261}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2212456292}) 2024-04-25T23:59:03.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3281326315}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2919588694}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1353188045}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3163921777}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1648322272}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3496999003}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2794114569}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1357836441}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=494799782}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4103333041}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4124241200}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1582340837}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1759016603}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=446281336}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1802680712}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1647713045}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1269140388}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3321418937}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=513627073}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4154778423}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2278580569}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4235135074}) 2024-04-25T23:59:03.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=460484053}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3696072418}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1339743930}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2155938169}) 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2313111149}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2063124071}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3012205156}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=497099178}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3939560487}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2490658405}) 2024-04-25T23:59:03.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3406313439}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4057532586}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3199867558}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1457892763}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1950888665}) 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1568875404}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=142095915}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=169035805}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3038453874}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1446595769}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2475963039}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3879577110}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3146820792}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=73878207}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3612038018}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1859252768}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=199055853}) 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3933737498}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2900978947}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=757126214}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1510124023}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2895290998}) 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4003657572}) 2024-04-25T23:59:03.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3960242347}) 2024-04-25T23:59:03.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4156857250}) 2024-04-25T23:59:03.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2837912430}) 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=30,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=669865667,mdsmap=2840952586,mgr=1247598456,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=997928667,mon_config_key=2848019875,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1262333167}) 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=31,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=1711632205,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=2901941722,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=24229786}) 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=32,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=9,monmap=3,osd_metadata=6,osdmap=27} crc {logm=2154185324,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2217357143,mon_config_key=650686044,monmap=828017138,osd_metadata=857068958,osdmap=1568004049}) 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1168417243,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1640442205,mon_config_key=2961542101,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1533884900}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=27,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=3944912592,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgrstat=997928667,mon_config_key=59400799,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=363670961}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=28,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=2020033418,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3002993767,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=2854560885}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=25} crc {logm=4284896081,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=997928667,mon_config_key=809949667,monmap=828017138,osd_metadata=2918934446,osd_pg_creating=1571405854,osdmap=1532741047}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=30,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=4205575628,mdsmap=2840952586,mgr=232029062,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2090453707,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1568004049}) 2024-04-25T23:59:03.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=31,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=802278007,mdsmap=2840952586,mgr=2375242210,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1301753600,mon_config_key=2083130969,monmap=828017138,osd_metadata=857068958,osd_pg_creating=1571405854,osdmap=1424825341}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3106193640}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1432417968}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=1200663672}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1707267353}) 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3014187597}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=1929450556}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=3394425072}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3597292738}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=458934822}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=43} crc {osdmap=612604628}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=44} crc {osdmap=3709548340}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=40} crc {osdmap=3756008524}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=43} crc {osdmap=219365702}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=41} crc {osdmap=3104208670}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=43} crc {osdmap=2820628545}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=43} crc {osdmap=2224351673}) 2024-04-25T23:59:03.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-25T23:59:03.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=43} crc {osdmap=2355757186}) 2024-04-25T23:59:03.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:03.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=42} crc {osdmap=4213130995}) 2024-04-25T23:59:04.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.715+0000 7f14f9ffb640 1 -- 172.21.15.171:0/233286390 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd create"}]=0 v107) ==== 58+0+3 (unknown 1685887268 0 1367428999) 0x7f14ec01c9b0 con 0x7f14fc13e510 2024-04-25T23:59:04.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.715+0000 7f14f9ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create"}] 2024-04-25T23:59:04.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.715+0000 7f14f9ffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:04.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 >> v1:172.21.15.171:6812/722422047 conn(0x7f14e8037e60 legacy=0x7f14e803a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 10 monclient: shutdown 2024-04-25T23:59:04.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:04.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 >> v1:172.21.15.171:6790/0 conn(0x7f14fc13e510 legacy=0x7f14fc1d5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 shutdown_connections 2024-04-25T23:59:04.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 >> 172.21.15.171:0/233286390 conn(0x7f14fc0a7110 msgr2=0x7f14fc137b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:04.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 shutdown_connections 2024-04-25T23:59:04.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.719+0000 7f1503562640 1 -- 172.21.15.171:0/233286390 wait complete. 2024-04-25T23:59:04.724 INFO:tasks.workunit.client.0.smithi171.stderr:+ o5=14 2024-04-25T23:59:04.724 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add 12 123 root=default host=foobaz 2024-04-25T23:59:04.726 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-25T23:59:04.726 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:59:04.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient: get_monmap_and_config 2024-04-25T23:59:04.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient: build_initial_monmap 2024-04-25T23:59:04.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient: monmap: 2024-04-25T23:59:04.847 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:04.847 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:04.867732+0000 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:04.867732+0000 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:04.848 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 1 Processor -- start 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 1 -- start start 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient: init 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient: _add_conns ranks=[6,4,5,3,8,1,2,7,0] 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient(hunting): picked mon.noname-d con 0x7f0760135a00 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient(hunting): picked mon.noname-c con 0x7f07600a1790 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient(hunting): picked mon.noname-h con 0x7f076013c130 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07600a1d80 con 0x7f07600a1790 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0760072f70 con 0x7f076013c130 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0760072640 con 0x7f0760135a00 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient(hunting): authenticate will time out at 1195.574565s 2024-04-25T23:59:04.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076672a640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f076013c130 0x7f076013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45770/0 (socket says 172.21.15.171:45770) 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076672a640 1 -- 172.21.15.171:0/487747332 learned_addr learned my addr 172.21.15.171:0/487747332 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 921823376 0 0) 0x7f07600a1d80 con 0x7f07600a1790 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): my global_id is 144202 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f074c003530 con 0x7f07600a1790 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1715075278 0 0) 0x7f0760072f70 con 0x7f076013c130 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient(hunting): my global_id is 5657 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07600a1d80 con 0x7f076013c130 2024-04-25T23:59:04.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4263904393 0 0) 0x7f074c003530 con 0x7f07600a1790 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 >> v1:172.21.15.106:6792/0 conn(0x7f0760135a00 legacy=0x7f0760135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 >> v1:172.21.15.171:6791/0 conn(0x7f076013c130 legacy=0x7f076013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: _finish_hunting 0 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 monclient: found mon.noname-c 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0760072920 con 0x7f07600a1790 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: _finish_auth 0 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: _check_auth_tickets 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f07500017c0 con 0x7f07600a1790 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:04.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: dump: 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.860 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 5 monclient: authenticate success, global_id 144202 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0750001a70 con 0x7f07600a1790 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 1 -- 172.21.15.171:0/487747332 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0750003960 con 0x7f07600a1790 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f076818d640 4 set_mon_vals no callback set 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.863+0000 7f0764f27640 10 monclient: dump: 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.861 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: shutdown 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/487747332 >> v1:172.21.15.106:6791/0 conn(0x7f07600a1790 legacy=0x7f076013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/487747332 shutdown_connections 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/487747332 >> 172.21.15.171:0/487747332 conn(0x7f07600a2690 msgr2=0x7f07600a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/487747332 shutdown_connections 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/487747332 wait complete. 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: build_initial_monmap 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: monmap: 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 Processor -- start 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- start start 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: init 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _add_conns ranks=[1,2,6,3,0,7,4,5,8] 2024-04-25T23:59:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient(hunting): picked mon.noname-f con 0x7f07600a1790 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient(hunting): picked mon.noname-b con 0x7f0760135a00 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient(hunting): picked mon.noname-d con 0x7f076013c130 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076009fc40 con 0x7f07600a1790 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07600703b0 con 0x7f0760135a00 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f076009f6f0 con 0x7f076013c130 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient(hunting): authenticate will time out at 1195.577968s 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f0765f29640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f07600a1790 0x7f076006f590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49288/0 (socket says 172.21.15.171:49288) 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f0765f29640 1 -- 172.21.15.171:0/408070259 learned_addr learned my addr 172.21.15.171:0/408070259 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165261058 0 0) 0x7f075c001240 con 0x7f07600a1790 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): my global_id is 144217 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0744003560 con 0x7f07600a1790 2024-04-25T23:59:04.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3316835201 0 0) 0x7f076009f6f0 con 0x7f076013c130 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): my global_id is 5748 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f075c001240 con 0x7f076013c130 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1339904601 0 0) 0x7f07600703b0 con 0x7f0760135a00 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): my global_id is 5717 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f076009f6f0 con 0x7f0760135a00 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2802879772 0 0) 0x7f0744003560 con 0x7f07600a1790 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f07600703b0 con 0x7f07600a1790 2024-04-25T23:59:04.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f075c001cb0 con 0x7f07600a1790 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): dump: 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.867 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3563612588 0 0) 0x7f076009f6f0 con 0x7f0760135a00 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0744003560 con 0x7f0760135a00 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 572215653 0 0) 0x7f07600703b0 con 0x7f07600a1790 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 >> v1:172.21.15.106:6792/0 conn(0x7f076013c130 legacy=0x7f07601d4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 >> v1:172.21.15.106:6790/0 conn(0x7f0760135a00 legacy=0x7f076006fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 monclient: found mon.f 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:04.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07601322b0 con 0x7f07600a1790 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 5 monclient: authenticate success, global_id 144217 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _renew_subs 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0760131a10 con 0x7f07600a1790 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _renew_subs 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0760134c00 con 0x7f07600a1790 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f075c003a90 con 0x7f07600a1790 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f075c003f80 con 0x7f07600a1790 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:04.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f0757fff640 4 set_mon_vals no callback set 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 10 monclient: dump: 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.870 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f075c004120 con 0x7f07600a1790 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.867+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0748005090 con 0x7f07600a1790 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.871+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(107..107 src has 1..107) ==== 5597+0+0 (unknown 1115912382 0 0) 0x7f075c044eb0 con 0x7f07600a1790 2024-04-25T23:59:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.871+0000 7f0765728640 10 monclient: get_auth_request con 0x7f07440379e0 auth_method 0 2024-04-25T23:59:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.875+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f076009fc40 con 0x7f07600a1790 2024-04-25T23:59:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.875+0000 7f07567fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:04.875+0000 7f07567fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:04.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient: get_monmap_and_config 2024-04-25T23:59:04.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient: build_initial_monmap 2024-04-25T23:59:04.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient: monmap: 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:04.872112+0000 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:04.872112+0000 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:04.878 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 1 Processor -- start 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 1 -- start start 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient: init 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient: _add_conns ranks=[8,4,6,3,1,0,7,2,5] 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient(hunting): picked mon.noname-e con 0x7f80e00a5070 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient(hunting): picked mon.noname-c con 0x7f80e0072710 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient(hunting): picked mon.noname-d con 0x7f80e0072b70 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0137d60 con 0x7f80e0072710 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e006cf90 con 0x7f80e0072b70 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e006e240 con 0x7f80e00a5070 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80e65c2640 10 monclient(hunting): authenticate will time out at 1200.399207s 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80dffff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f80e00a5070 0x7f80e0137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40506/0 (socket says 172.21.15.106:40506) 2024-04-25T23:59:04.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80dffff640 1 -- 172.21.15.106:0/4055338333 learned_addr learned my addr 172.21.15.106:0/4055338333 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80df7fe640 1 --1- 172.21.15.106:0/4055338333 >> v1:172.21.15.106:6791/0 conn(0x7f80e0072710 0x7f80e013c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:59534/0 (socket says 172.21.15.106:59534) 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1116168757 0 0) 0x7f80e0137d60 con 0x7f80e0072710 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): my global_id is 144211 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80c8003530 con 0x7f80e0072710 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602048129 0 0) 0x7f80e006cf90 con 0x7f80e0072b70 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): my global_id is 5757 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e0137d60 con 0x7f80e0072b70 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2616291758 0 0) 0x7f80e006e240 con 0x7f80e00a5070 2024-04-25T23:59:04.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 10 monclient(hunting): my global_id is 144215 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.869+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e006cf90 con 0x7f80e00a5070 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2446593973 0 0) 0x7f80c8003530 con 0x7f80e0072710 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 >> v1:172.21.15.106:6793/0 conn(0x7f80e00a5070 legacy=0x7f80e0137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 >> v1:172.21.15.106:6792/0 conn(0x7f80e0072b70 legacy=0x7f80e01400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 monclient: found mon.noname-c 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e0070560 con 0x7f80e0072710 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:04.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80d00017c0 con 0x7f80e0072710 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 5 monclient: authenticate success, global_id 144211 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: dump: 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.882 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80d0001a20 con 0x7f80e0072710 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 1 -- 172.21.15.106:0/4055338333 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80d0001c10 con 0x7f80e0072710 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:04.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80deffd640 10 monclient: dump: 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.884 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 4 set_mon_vals no callback set 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: shutdown 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- 172.21.15.106:0/4055338333 >> v1:172.21.15.106:6791/0 conn(0x7f80e0072710 legacy=0x7f80e013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- 172.21.15.106:0/4055338333 shutdown_connections 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- 172.21.15.106:0/4055338333 >> 172.21.15.106:0/4055338333 conn(0x7f80e00a83a0 msgr2=0x7f80e00a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- 172.21.15.106:0/4055338333 shutdown_connections 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- 172.21.15.106:0/4055338333 wait complete. 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: build_initial_monmap 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: monmap: 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:04.885 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 Processor -- start 2024-04-25T23:59:04.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- start start 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: init 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: _add_conns ranks=[6,0,3,7,8,4,1,2,5] 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient(hunting): picked mon.noname-d con 0x7f80e0072710 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient(hunting): picked mon.noname-a con 0x7f80e0072b70 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient(hunting): picked mon.noname-g con 0x7f80e00a5070 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0135780 con 0x7f80e0072b70 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0138eb0 con 0x7f80e00a5070 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e0139190 con 0x7f80e0072710 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient(hunting): authenticate will time out at 1200.402421s 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f80e0072710 0x7f80e0140ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53146/0 (socket says 172.21.15.106:53146) 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dffff640 1 -- 172.21.15.106:0/3493201699 learned_addr learned my addr 172.21.15.106:0/3493201699 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128877506 0 0) 0x7f80e0139190 con 0x7f80e0072710 2024-04-25T23:59:04.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): my global_id is 5766 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80cc003560 con 0x7f80e0072710 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865002051 0 0) 0x7f80e0135780 con 0x7f80e0072b70 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): my global_id is 5832 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e0139190 con 0x7f80e0072b70 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696793045 0 0) 0x7f80e0138eb0 con 0x7f80e00a5070 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:04.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): my global_id is 5988 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80e0135780 con 0x7f80e00a5070 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1507534816 0 0) 0x7f80cc003560 con 0x7f80e0072710 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80e0138eb0 con 0x7f80e0072710 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80d4001a40 con 0x7f80e0072710 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): dump: 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.889 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4037409957 0 0) 0x7f80e0139190 con 0x7f80e0072b70 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80cc003560 con 0x7f80e0072b70 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80d00017e0 con 0x7f80e0072b70 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:04.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient(hunting): dump: 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.891 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3693424603 0 0) 0x7f80e0135780 con 0x7f80e00a5070 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f80e0139190 con 0x7f80e00a5070 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2988737943 0 0) 0x7f80e0138eb0 con 0x7f80e0072710 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 >> v1:172.21.15.171:6790/0 conn(0x7f80e00a5070 legacy=0x7f80e01d4230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 >> v1:172.21.15.106:6789/0 conn(0x7f80e0072b70 legacy=0x7f80e01cbed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 monclient: found mon.d 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e01413f0 con 0x7f80e0072710 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:04.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 5 monclient: authenticate success, global_id 5766 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: _renew_subs 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80e01cc5e0 con 0x7f80e0072710 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: _renew_subs 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f80e01d5950 con 0x7f80e0072710 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f80d4004aa0 con 0x7f80e0072710 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80d4004f90 con 0x7f80e0072710 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80de7fc640 4 set_mon_vals no callback set 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.873+0000 7f80dcff9640 10 monclient: dump: 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:04.893 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.877+0000 7f80e65c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:04.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.877+0000 7f80e65c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.877+0000 7f80e65c2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.877+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80c0005090 con 0x7f80e0072710 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.877+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f80d400fd30 con 0x7f80e0072710 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.877+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(107..107 src has 1..107) ==== 5597+0+0 (unknown 1115912382 0 0) 0x7f80d4044db0 con 0x7f80e0072710 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.877+0000 7f80df7fe640 10 monclient: get_auth_request con 0x7f80cc037fa0 auth_method 0 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.881+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f80d40158b0 con 0x7f80e0072710 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.881+0000 7f80dcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:04.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:04.881+0000 7f80dcff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:05.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.039+0000 7f076818d640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:05.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.039+0000 7f076818d640 10 monclient: _send_command 2 [{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:05.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.039+0000 7f076818d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:05.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.039+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]} v 0) -- 0x7f0748005380 con 0x7f07600a1790 2024-04-25T23:59:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:59:05.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f80c0005380 con 0x7f80e0072710 2024-04-25T23:59:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80dcff9640 1 -- 172.21.15.106:0/3493201699 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 3409021938) 0x7f80d40151b0 con 0x7f80e0072710 2024-04-25T23:59:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80dcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:05.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80dcff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:05.066 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":34,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 >> v1:172.21.15.171:6812/722422047 conn(0x7f80cc037fa0 legacy=0x7f80cc03a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 10 monclient: shutdown 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 >> v1:172.21.15.106:6792/0 conn(0x7f80e0072710 legacy=0x7f80e0140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 shutdown_connections 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 >> 172.21.15.106:0/3493201699 conn(0x7f80e00a83a0 msgr2=0x7f80e00a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 shutdown_connections 2024-04-25T23:59:05.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.085+0000 7f80e65c2640 1 -- 172.21.15.106:0/3493201699 wait complete. 2024-04-25T23:59:05.084 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-25T23:59:05.084 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-25T23:59:05.084 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-25T23:59:05.084 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:59:05.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.221+0000 7f46e9777640 10 monclient: get_monmap_and_config 2024-04-25T23:59:05.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.221+0000 7f46e9777640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.221+0000 7f46e9777640 10 monclient: monmap: 2024-04-25T23:59:05.205 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:05.226145+0000 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:05.226145+0000 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.206 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.207 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 Processor -- start 2024-04-25T23:59:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- start start 2024-04-25T23:59:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient: init 2024-04-25T23:59:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient: _add_conns ranks=[1,4,8,6,2,5,3,0,7] 2024-04-25T23:59:05.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient(hunting): picked mon.noname-f con 0x7f46e40a5090 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient(hunting): picked mon.noname-c con 0x7f46e4072710 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient(hunting): picked mon.noname-e con 0x7f46e4072b70 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e4137d60 con 0x7f46e40a5090 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e406cf60 con 0x7f46e4072710 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e406e240 con 0x7f46e4072b70 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient(hunting): authenticate will time out at 1200.753328s 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e37fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f46e4072b70 0x7f46e41400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40512/0 (socket says 172.21.15.106:40512) 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e37fe640 1 -- 172.21.15.106:0/3929124468 learned_addr learned my addr 172.21.15.106:0/3929124468 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e27fc640 1 --1- 172.21.15.106:0/3929124468 >> v1:172.21.15.106:6791/0 conn(0x7f46e4072710 0x7f46e413c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:59544/0 (socket says 172.21.15.106:59544) 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1953473892 0 0) 0x7f46e406e240 con 0x7f46e4072b70 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): my global_id is 144224 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46cc003530 con 0x7f46e4072b70 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178887110 0 0) 0x7f46e406cf60 con 0x7f46e4072710 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): my global_id is 144220 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e406e240 con 0x7f46e4072710 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 160538896 0 0) 0x7f46e4137d60 con 0x7f46e40a5090 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient(hunting): my global_id is 144226 2024-04-25T23:59:05.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e406cf60 con 0x7f46e40a5090 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2758765048 0 0) 0x7f46cc003530 con 0x7f46e4072b70 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 >> v1:172.21.15.106:6791/0 conn(0x7f46e4072710 legacy=0x7f46e413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 >> v1:172.21.15.171:6789/0 conn(0x7f46e40a5090 legacy=0x7f46e4137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 monclient: found mon.noname-e 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e4070560 con 0x7f46e4072b70 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46dc001b40 con 0x7f46e4072b70 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 5 monclient: authenticate success, global_id 144224 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: dump: 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.220 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46dc001da0 con 0x7f46e4072b70 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 1 -- 172.21.15.106:0/3929124468 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46dc004f70 con 0x7f46e4072b70 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:05.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 4 set_mon_vals no callback set 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e1ffb640 10 monclient: dump: 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.222 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient: shutdown 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- 172.21.15.106:0/3929124468 >> v1:172.21.15.106:6793/0 conn(0x7f46e4072b70 legacy=0x7f46e41400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- 172.21.15.106:0/3929124468 shutdown_connections 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- 172.21.15.106:0/3929124468 >> 172.21.15.106:0/3929124468 conn(0x7f46e40a83a0 msgr2=0x7f46e40a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- 172.21.15.106:0/3929124468 shutdown_connections 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 1 -- 172.21.15.106:0/3929124468 wait complete. 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.225+0000 7f46e9777640 10 monclient: monmap: 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.223 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 Processor -- start 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 -- start start 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient: init 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient: _add_conns ranks=[6,4,1,0,7,3,5,2,8] 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient(hunting): picked mon.noname-d con 0x7f46e4072710 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient(hunting): picked mon.noname-c con 0x7f46e4072b70 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient(hunting): picked mon.noname-f con 0x7f46e40a5090 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e4133e40 con 0x7f46e40a5090 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e4133740 con 0x7f46e4072b70 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46e406d9a0 con 0x7f46e4072710 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e27fc640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f46e4072b70 0x7f46e4130440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:59560/0 (socket says 172.21.15.106:59560) 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e2ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f46e4072710 0x7f46e412fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53154/0 (socket says 172.21.15.106:53154) 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e27fc640 1 -- 172.21.15.106:0/2263225698 learned_addr learned my addr 172.21.15.106:0/2263225698 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient(hunting): authenticate will time out at 1200.757152s 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553723319 0 0) 0x7f46e4133740 con 0x7f46e4072b70 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): my global_id is 144229 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46d0003530 con 0x7f46e4072b70 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 336447455 0 0) 0x7f46e406d9a0 con 0x7f46e4072710 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): my global_id is 5775 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e4133740 con 0x7f46e4072710 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3774218904 0 0) 0x7f46d0003530 con 0x7f46e4072b70 2024-04-25T23:59:05.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46e406d9a0 con 0x7f46e4072b70 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46d4001510 con 0x7f46e4072b70 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): dump: 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.227 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2312479828 0 0) 0x7f46e4133740 con 0x7f46e4072710 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46d0003530 con 0x7f46e4072710 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46d80019e0 con 0x7f46e4072710 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): dump: 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.228 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.229 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3564095336 0 0) 0x7f46e4070560 con 0x7f46e40a5090 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): my global_id is 144235 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e4133740 con 0x7f46e40a5090 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1119150692 0 0) 0x7f46e406d9a0 con 0x7f46e4072b70 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.106:6792/0 conn(0x7f46e4072710 legacy=0x7f46e412fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.171:6789/0 conn(0x7f46e40a5090 legacy=0x7f46e41d4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 monclient: found mon.c 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46e4132cc0 con 0x7f46e4072b70 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 5 monclient: authenticate success, global_id 144229 2024-04-25T23:59:05.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient: _renew_subs 2024-04-25T23:59:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:05.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46e4130b50 con 0x7f46e4072b70 2024-04-25T23:59:05.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient: _renew_subs 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f46e4131e10 con 0x7f46e4072b70 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46d4004b90 con 0x7f46e4072b70 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46d4005100 con 0x7f46e4072b70 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e17fa640 4 set_mon_vals no callback set 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: dump: 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.234 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46c40065d0 con 0x7f46c4002870 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f46d40052a0 con 0x7f46e4072b70 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(107..107 src has 1..107) ==== 5597+0+0 (unknown 1115912382 0 0) 0x7f46d4044c30 con 0x7f46e4072b70 2024-04-25T23:59:05.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 37094960 0 0) 0x7f46c40065d0 con 0x7f46c4002870 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient(hunting): my global_id is 5841 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e406d9a0 con 0x7f46c4002870 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3038582960 0 0) 0x7f46e406d9a0 con 0x7f46c4002870 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46c40065d0 con 0x7f46c4002870 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46d8003e80 con 0x7f46c4002870 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46e37fe640 10 monclient: get_auth_request con 0x7f46d0037d60 auth_method 0 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 10 monclient: dump: 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.236 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2948294257 0 0) 0x7f46c40065d0 con 0x7f46c4002870 2024-04-25T23:59:05.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.229+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f46c400a160 con 0x7f46c4002870 2024-04-25T23:59:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.233+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f46d8004170 con 0x7f46c4002870 2024-04-25T23:59:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.233+0000 7f46cb7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.233+0000 7f46cb7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.233+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.106:6789/0 conn(0x7f46c4002870 legacy=0x7f46c4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.233+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.106:6789/0 conn(0x7f46c4002870 legacy=0x7f46c4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46c4009e30 con 0x7f46c40090f0 2024-04-25T23:59:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4032632990 0 0) 0x7f46c4009e30 con 0x7f46c40090f0 2024-04-25T23:59:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient(hunting): my global_id is 5850 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46c40065d0 con 0x7f46c40090f0 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1865574167 0 0) 0x7f46c40065d0 con 0x7f46c40090f0 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46c4009e30 con 0x7f46c40090f0 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46d8005b10 con 0x7f46c40090f0 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient: dump: 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.241 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3425451067 0 0) 0x7f46c4009e30 con 0x7f46c40090f0 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f46c400c3a0 con 0x7f46c40090f0 2024-04-25T23:59:05.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 1023683344) 0x7f46d8007000 con 0x7f46c40090f0 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.106:6789/0 conn(0x7f46c40090f0 legacy=0x7f46c4009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46cb7fe640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.106:6789/0 conn(0x7f46c40090f0 legacy=0x7f46c4009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 263796, 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:05.243 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.244 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.245 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:05.246 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:05.247 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:05.248 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:05.248 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:05.248 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.248 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:05.248 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.248 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.248 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.249 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.249 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.249 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.249 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.249 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.249 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.249 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.250 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.251 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:05.252 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.253 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.254 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.255 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:05.256 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.258 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.259 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.263 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:05.264 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.171:6812/722422047 conn(0x7f46d0037d60 legacy=0x7f46d003a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 10 monclient: shutdown 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 >> v1:172.21.15.106:6791/0 conn(0x7f46e4072b70 legacy=0x7f46e4130440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e37fe640 1 -- 172.21.15.106:0/2263225698 reap_dead start 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e37fe640 1 -- 172.21.15.106:0/2263225698 reap_dead start 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 shutdown_connections 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 >> 172.21.15.106:0/2263225698 conn(0x7f46e40a83a0 msgr2=0x7f46e40a6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 shutdown_connections 2024-04-25T23:59:05.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.237+0000 7f46e9777640 1 -- 172.21.15.106:0/2263225698 wait complete. 2024-04-25T23:59:05.267 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:05.267 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-25T23:59:05.267 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:59:05.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient: get_monmap_and_config 2024-04-25T23:59:05.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient: monmap: 2024-04-25T23:59:05.383 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.383 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.383 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:05.403998+0000 2024-04-25T23:59:05.383 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:05.403998+0000 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.384 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 1 Processor -- start 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 1 -- start start 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient: init 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient: _add_conns ranks=[4,5,8,1,0,2,3,6,7] 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient(hunting): picked mon.noname-c con 0x7ff8f0135870 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient(hunting): picked mon.noname-h con 0x7ff8f01353b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient(hunting): picked mon.noname-e con 0x7ff8f013bdf0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f006f2d0 con 0x7ff8f0135870 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f0072330 con 0x7ff8f01353b0 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f0072610 con 0x7ff8f013bdf0 2024-04-25T23:59:05.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8f57aa640 10 monclient(hunting): authenticate will time out at 1200.931134s 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8eeffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7ff8f0135870 0x7ff8f0135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:59564/0 (socket says 172.21.15.106:59564) 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8eeffd640 1 -- 172.21.15.106:0/1572436659 learned_addr learned my addr 172.21.15.106:0/1572436659 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8ef7fe640 1 --1- 172.21.15.106:0/1572436659 >> v1:172.21.15.106:6793/0 conn(0x7ff8f013bdf0 0x7ff8f013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:40520/0 (socket says 172.21.15.106:40520) 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 534311056 0 0) 0x7ff8f006f2d0 con 0x7ff8f0135870 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): my global_id is 144238 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d8003530 con 0x7ff8f0135870 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3364789072 0 0) 0x7ff8f0072610 con 0x7ff8f013bdf0 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient(hunting): my global_id is 144233 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f006f2d0 con 0x7ff8f013bdf0 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1329206477 0 0) 0x7ff8d8003530 con 0x7ff8f0135870 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 >> v1:172.21.15.106:6793/0 conn(0x7ff8f013bdf0 legacy=0x7ff8f013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 >> v1:172.21.15.171:6791/0 conn(0x7ff8f01353b0 legacy=0x7ff8f013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 monclient: found mon.noname-c 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f00a3260 con 0x7ff8f0135870 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8e40017c0 con 0x7ff8f0135870 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.401+0000 7ff8edffb640 10 monclient: dump: 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.395 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 5 monclient: authenticate success, global_id 144238 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8e4001aa0 con 0x7ff8f0135870 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8edffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8edffb640 1 -- 172.21.15.106:0/1572436659 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8e4004bf0 con 0x7ff8f0135870 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 4 set_mon_vals no callback set 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8edffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8edffb640 10 monclient: dump: 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.396 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.397 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: shutdown 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/1572436659 >> v1:172.21.15.106:6791/0 conn(0x7ff8f0135870 legacy=0x7ff8f0135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/1572436659 shutdown_connections 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/1572436659 >> 172.21.15.106:0/1572436659 conn(0x7ff8f00a64e0 msgr2=0x7ff8f00a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/1572436659 shutdown_connections 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/1572436659 wait complete. 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: monmap: 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:05.398 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 Processor -- start 2024-04-25T23:59:05.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- start start 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: init 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: _add_conns ranks=[5,2,1,4,7,8,0,3,6] 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient(hunting): picked mon.noname-h con 0x7ff8f01353b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient(hunting): picked mon.noname-b con 0x7ff8f0135870 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient(hunting): picked mon.noname-f con 0x7ff8f013bdf0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f01324e0 con 0x7ff8f013bdf0 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f009f930 con 0x7ff8f0135870 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8f009f470 con 0x7ff8f01353b0 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient(hunting): authenticate will time out at 1200.934231s 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8ee7fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7ff8f0135870 0x7ff8f0131dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39426/0 (socket says 172.21.15.106:39426) 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8ee7fc640 1 -- 172.21.15.106:0/3338324953 learned_addr learned my addr 172.21.15.106:0/3338324953 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 760589376 0 0) 0x7ff8f009f930 con 0x7ff8f0135870 2024-04-25T23:59:05.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): my global_id is 5726 2024-04-25T23:59:05.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8dc003530 con 0x7ff8f0135870 2024-04-25T23:59:05.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4232413157 0 0) 0x7ff8dc003530 con 0x7ff8f0135870 2024-04-25T23:59:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8f009f930 con 0x7ff8f0135870 2024-04-25T23:59:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8e0001ae0 con 0x7ff8f0135870 2024-04-25T23:59:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): dump: 2024-04-25T23:59:05.402 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.403 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3741381322 0 0) 0x7ff8f009f930 con 0x7ff8f0135870 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.171:6791/0 conn(0x7ff8f01353b0 legacy=0x7ff8f01316c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.171:6789/0 conn(0x7ff8f013bdf0 legacy=0x7ff8f01d4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 monclient: found mon.b 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8f0133db0 con 0x7ff8f0135870 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 5 monclient: authenticate success, global_id 5726 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: _renew_subs 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:05.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8f009ebb0 con 0x7ff8f0135870 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: _renew_subs 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8f01347e0 con 0x7ff8f0135870 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8e00038d0 con 0x7ff8f0135870 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8e0003e40 con 0x7ff8f0135870 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8ed7fa640 4 set_mon_vals no callback set 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 10 monclient: dump: 2024-04-25T23:59:05.405 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.406 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff8d00065d0 con 0x7ff8d0002870 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.405+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff8e0004060 con 0x7ff8f0135870 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161554021 0 0) 0x7ff8d00065d0 con 0x7ff8d0002870 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient(hunting): my global_id is 5735 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8f009f930 con 0x7ff8d0002870 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(107..107 src has 1..107) ==== 5597+0+0 (unknown 1115912382 0 0) 0x7ff8e0044e80 con 0x7ff8f0135870 2024-04-25T23:59:05.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3675648074 0 0) 0x7ff8f009f930 con 0x7ff8d0002870 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8d00065d0 con 0x7ff8d0002870 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8e4001440 con 0x7ff8d0002870 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient: dump: 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.408 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8ef7fe640 10 monclient: get_auth_request con 0x7ff8dc037780 auth_method 0 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2335678960 0 0) 0x7ff8d00065d0 con 0x7ff8d0002870 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8d000a160 con 0x7ff8d0002870 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff8e40016f0 con 0x7ff8d0002870 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.106:6790/0 conn(0x7ff8d0002870 legacy=0x7ff8d0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.409+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.106:6790/0 conn(0x7ff8d0002870 legacy=0x7ff8d0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8f57aa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff8d0009e50 con 0x7ff8d0009110 2024-04-25T23:59:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3664795694 0 0) 0x7ff8d0009e50 con 0x7ff8d0009110 2024-04-25T23:59:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient(hunting): my global_id is 5744 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d00065d0 con 0x7ff8d0009110 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3314521512 0 0) 0x7ff8d00065d0 con 0x7ff8d0009110 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8d0009e50 con 0x7ff8d0009110 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8e4005000 con 0x7ff8d0009110 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient: dump: 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.412 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2823984908 0 0) 0x7ff8d0009e50 con 0x7ff8d0009110 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff8d000c3e0 con 0x7ff8d0009110 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 1958533764) 0x7ff8e4007310 con 0x7ff8d0009110 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.106:6790/0 conn(0x7ff8d0009110 legacy=0x7ff8d00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.413+0000 7ff8d77fe640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.106:6790/0 conn(0x7ff8d0009110 legacy=0x7ff8d00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:05.414 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 263976, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-25T23:59:05.415 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.416 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.417 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:05.418 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.419 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.420 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.421 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:05.422 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.424 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.425 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:05.426 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.431 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.432 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.433 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.434 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:05.434 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.171:6812/722422047 conn(0x7ff8dc037780 legacy=0x7ff8dc039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 10 monclient: shutdown 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 >> v1:172.21.15.106:6790/0 conn(0x7ff8f0135870 legacy=0x7ff8f0131dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8ef7fe640 1 -- 172.21.15.106:0/3338324953 reap_dead start 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8ef7fe640 1 -- 172.21.15.106:0/3338324953 reap_dead start 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 shutdown_connections 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 >> 172.21.15.106:0/3338324953 conn(0x7ff8f00a64e0 msgr2=0x7ff8f00709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 shutdown_connections 2024-04-25T23:59:05.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.417+0000 7ff8f57aa640 1 -- 172.21.15.106:0/3338324953 wait complete. 2024-04-25T23:59:05.437 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:05.437 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-25T23:59:05.437 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-25T23:59:05.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.565+0000 7fb787008640 10 monclient: get_monmap_and_config 2024-04-25T23:59:05.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.565+0000 7fb787008640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.565+0000 7fb787008640 10 monclient: monmap: 2024-04-25T23:59:05.549 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:05.570248+0000 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:05.570248+0000 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.551 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.551 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 Processor -- start 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- start start 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: init 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: _add_conns ranks=[3,5,8,4,2,6,0,1,7] 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient(hunting): picked mon.noname-g con 0x7fb7801346f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient(hunting): picked mon.noname-h con 0x7fb780137d60 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient(hunting): picked mon.noname-e con 0x7fb780138210 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78006e250 con 0x7fb7801346f0 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb780070560 con 0x7fb780137d60 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb780070840 con 0x7fb780138210 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient(hunting): authenticate will time out at 1201.097378s 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb7855a5640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fb780138210 0x7fb7801400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33352/0 (socket says 172.21.15.106:33352) 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb7855a5640 1 -- 172.21.15.106:0/1586770548 learned_addr learned my addr 172.21.15.106:0/1586770548 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757426571 0 0) 0x7fb780070840 con 0x7fb780138210 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient(hunting): my global_id is 144242 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb768003530 con 0x7fb780138210 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1064772657 0 0) 0x7fb768003530 con 0x7fb780138210 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 >> v1:172.21.15.171:6791/0 conn(0x7fb780137d60 legacy=0x7fb78013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 >> v1:172.21.15.171:6790/0 conn(0x7fb7801346f0 legacy=0x7fb780134ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 monclient: found mon.noname-e 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:59:05.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb780070b20 con 0x7fb780138210 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb778001b80 con 0x7fb780138210 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 5 monclient: authenticate success, global_id 144242 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: dump: 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.562 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb778001e20 con 0x7fb780138210 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 1 -- 172.21.15.106:0/1586770548 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb778004f70 con 0x7fb780138210 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 4 set_mon_vals no callback set 2024-04-25T23:59:05.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb77f7fe640 10 monclient: dump: 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.564 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: shutdown 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- 172.21.15.106:0/1586770548 >> v1:172.21.15.106:6793/0 conn(0x7fb780138210 legacy=0x7fb7801400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- 172.21.15.106:0/1586770548 shutdown_connections 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- 172.21.15.106:0/1586770548 >> 172.21.15.106:0/1586770548 conn(0x7fb7800a83a0 msgr2=0x7fb7800a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- 172.21.15.106:0/1586770548 shutdown_connections 2024-04-25T23:59:05.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- 172.21.15.106:0/1586770548 wait complete. 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: monmap: 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.566 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 Processor -- start 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 1 -- start start 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.569+0000 7fb787008640 10 monclient: init 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient: _add_conns ranks=[6,4,2,0,3,7,5,8,1] 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient(hunting): picked mon.noname-d con 0x7fb7801346f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient(hunting): picked mon.noname-c con 0x7fb780137d60 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient(hunting): picked mon.noname-b con 0x7fb780138210 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb780131120 con 0x7fb780138210 2024-04-25T23:59:05.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb780131400 con 0x7fb780137d60 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb78012f7c0 con 0x7fb7801346f0 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient(hunting): authenticate will time out at 1201.100325s 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb784da4640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb7801346f0 0x7fb78012e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39726/0 (socket says 172.21.15.106:39726) 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fb780137d60 0x7fb78012f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:43644/0 (socket says 172.21.15.106:43644) 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb784da4640 1 -- 172.21.15.106:0/4041332700 learned_addr learned my addr 172.21.15.106:0/4041332700 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1168913771 0 0) 0x7fb78012f7c0 con 0x7fb7801346f0 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): my global_id is 5784 2024-04-25T23:59:05.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb76c003530 con 0x7fb7801346f0 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59690387 0 0) 0x7fb780131400 con 0x7fb780137d60 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): my global_id is 144247 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb78012f7c0 con 0x7fb780137d60 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874840823 0 0) 0x7fb780131120 con 0x7fb780138210 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): my global_id is 5753 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb780131400 con 0x7fb780138210 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2922534146 0 0) 0x7fb76c003530 con 0x7fb7801346f0 2024-04-25T23:59:05.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb780131120 con 0x7fb7801346f0 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb770001aa0 con 0x7fb7801346f0 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.570 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3074433414 0 0) 0x7fb78012f7c0 con 0x7fb780137d60 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb76c003530 con 0x7fb780137d60 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3298886378 0 0) 0x7fb780131400 con 0x7fb780138210 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb78012f7c0 con 0x7fb780138210 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb774001920 con 0x7fb780137d60 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.572 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb778001b40 con 0x7fb780138210 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.573 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1707241331 0 0) 0x7fb780131120 con 0x7fb7801346f0 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.106:6791/0 conn(0x7fb780137d60 legacy=0x7fb78012f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.106:6790/0 conn(0x7fb780138210 legacy=0x7fb7801d4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 monclient: found mon.d 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7801340a0 con 0x7fb7801346f0 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 5 monclient: authenticate success, global_id 5784 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient: _renew_subs 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb78006d990 con 0x7fb7801346f0 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient: _renew_subs 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb78012ff50 con 0x7fb7801346f0 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb7700038d0 con 0x7fb7801346f0 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb770003e40 con 0x7fb7801346f0 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77effd640 4 set_mon_vals no callback set 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: dump: 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.576 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb770003fe0 con 0x7fb7801346f0 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb7600065d0 con 0x7fb760002870 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(107..107 src has 1..107) ==== 5597+0+0 (unknown 1115912382 0 0) 0x7fb770044c80 con 0x7fb7801346f0 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003965273 0 0) 0x7fb7600065d0 con 0x7fb760002870 2024-04-25T23:59:05.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient(hunting): my global_id is 144256 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb780131120 con 0x7fb760002870 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb7855a5640 10 monclient: get_auth_request con 0x7fb76c038290 auth_method 0 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2559924302 0 0) 0x7fb780131120 con 0x7fb760002870 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7600065d0 con 0x7fb760002870 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb774003960 con 0x7fb760002870 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: dump: 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.578 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.579 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2109047689 0 0) 0x7fb7600065d0 con 0x7fb760002870 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb76000a160 con 0x7fb760002870 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb7740057d0 con 0x7fb760002870 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.106:6791/0 conn(0x7fb760002870 legacy=0x7fb760004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.573+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.106:6791/0 conn(0x7fb760002870 legacy=0x7fb760004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:05.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb760009e50 con 0x7fb760009110 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 281204678 0 0) 0x7fb760009e50 con 0x7fb760009110 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient(hunting): my global_id is 144265 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7600065d0 con 0x7fb760009110 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4213318853 0 0) 0x7fb7600065d0 con 0x7fb760009110 2024-04-25T23:59:05.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb760009e50 con 0x7fb760009110 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb7740041f0 con 0x7fb760009110 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient: dump: 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.583 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4237399031 0 0) 0x7fb760009e50 con 0x7fb760009110 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb76000c3e0 con 0x7fb760009110 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 1863725678) 0x7fb774005980 con 0x7fb760009110 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.106:6791/0 conn(0x7fb760009110 legacy=0x7fb7600095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb77d7fa640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.106:6791/0 conn(0x7fb760009110 legacy=0x7fb7600095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:05.584 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9111, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:05.585 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.586 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.587 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:05.588 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.589 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.590 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.591 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:05.592 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.593 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.595 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:05.596 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.597 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.598 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:05.601 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.602 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:05.603 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.605 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.606 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.608 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.609 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:05.609 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.171:6812/722422047 conn(0x7fb76c038290 legacy=0x7fb76c03a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 10 monclient: shutdown 2024-04-25T23:59:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 >> v1:172.21.15.106:6792/0 conn(0x7fb7801346f0 legacy=0x7fb78012e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb7855a5640 1 -- 172.21.15.106:0/4041332700 reap_dead start 2024-04-25T23:59:05.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb7855a5640 1 -- 172.21.15.106:0/4041332700 reap_dead start 2024-04-25T23:59:05.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 shutdown_connections 2024-04-25T23:59:05.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 >> 172.21.15.106:0/4041332700 conn(0x7fb7800a83a0 msgr2=0x7fb7800a58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 shutdown_connections 2024-04-25T23:59:05.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.581+0000 7fb787008640 1 -- 172.21.15.106:0/4041332700 wait complete. 2024-04-25T23:59:05.614 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:05.614 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-25T23:59:05.614 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:59:05.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.723+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}]=0 add item id 12 name 'osd.12' weight 123 at location {host=foobaz,root=default} to crush map v108) ==== 220+0+0 (unknown 458349866 0 0) 0x7f075c0159b0 con 0x7f07600a1790 2024-04-25T23:59:05.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.723+0000 7f07567fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:05.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.723+0000 7f07567fc640 10 monclient: _finish_command 2 = system:0 add item id 12 name 'osd.12' weight 123 at location {host=foobaz,root=default} to crush map 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient: get_monmap_and_config 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient: monmap: 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:05.747718+0000 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:05.747718+0000 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.727 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.728 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 1 Processor -- start 2024-04-25T23:59:05.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 1 -- start start 2024-04-25T23:59:05.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient: init 2024-04-25T23:59:05.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient: _add_conns ranks=[1,6,0,8,5,4,7,2,3] 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient(hunting): picked mon.noname-f con 0x7fdc30134970 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient(hunting): picked mon.noname-d con 0x7fdc300a4820 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient(hunting): picked mon.noname-a con 0x7fdc3013e200 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3006dd40 con 0x7fdc3013e200 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc300a2b10 con 0x7fdc30134970 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc300a2df0 con 0x7fdc300a4820 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient(hunting): authenticate will time out at 1201.274920s 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc35c4c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdc3013e200 0x7fdc301405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39214/0 (socket says 172.21.15.106:39214) 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc35c4c640 1 -- 172.21.15.106:0/3256787993 learned_addr learned my addr 172.21.15.106:0/3256787993 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc34c4a640 1 --1- 172.21.15.106:0/3256787993 >> v1:172.21.15.106:6792/0 conn(0x7fdc300a4820 0x7fdc3013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39736/0 (socket says 172.21.15.106:39736) 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251009866 0 0) 0x7fdc300a2df0 con 0x7fdc300a4820 2024-04-25T23:59:05.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): my global_id is 5793 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc1c003530 con 0x7fdc300a4820 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996660059 0 0) 0x7fdc3006dd40 con 0x7fdc3013e200 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient(hunting): my global_id is 5859 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc300a2df0 con 0x7fdc3013e200 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1332336373 0 0) 0x7fdc1c003530 con 0x7fdc300a4820 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 >> v1:172.21.15.171:6789/0 conn(0x7fdc30134970 legacy=0x7fdc30134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 >> v1:172.21.15.106:6789/0 conn(0x7fdc3013e200 legacy=0x7fdc301405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 monclient: found mon.noname-d 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc300a30d0 con 0x7fdc300a4820 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc200017c0 con 0x7fdc300a4820 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:05.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: dump: 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.739 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 5 monclient: authenticate success, global_id 5793 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc20001a70 con 0x7fdc300a4820 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 1 -- 172.21.15.106:0/3256787993 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc20004b30 con 0x7fdc300a4820 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc27fff640 10 monclient: dump: 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.740 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.745+0000 7fdc376af640 4 set_mon_vals no callback set 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: shutdown 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3256787993 >> v1:172.21.15.106:6792/0 conn(0x7fdc300a4820 legacy=0x7fdc3013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3256787993 shutdown_connections 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3256787993 >> 172.21.15.106:0/3256787993 conn(0x7fdc300a9e20 msgr2=0x7fdc300aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3256787993 shutdown_connections 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3256787993 wait complete. 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: monmap: 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.742 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 Processor -- start 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- start start 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: init 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: _add_conns ranks=[1,8,6,7,3,4,2,5,0] 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient(hunting): picked mon.noname-f con 0x7fdc300a4820 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient(hunting): picked mon.noname-e con 0x7fdc30134970 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:05.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient(hunting): picked mon.noname-d con 0x7fdc3013e200 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3013b770 con 0x7fdc300a4820 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3013ba50 con 0x7fdc3013e200 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc30139ef0 con 0x7fdc30134970 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient(hunting): authenticate will time out at 1201.277892s 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc35c4c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fdc3013e200 0x7fdc301d43d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39742/0 (socket says 172.21.15.106:39742) 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc35c4c640 1 -- 172.21.15.106:0/3087224188 learned_addr learned my addr 172.21.15.106:0/3087224188 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 676126446 0 0) 0x7fdc3013ba50 con 0x7fdc3013e200 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): my global_id is 5802 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc14003530 con 0x7fdc3013e200 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1632385909 0 0) 0x7fdc30139ef0 con 0x7fdc30134970 2024-04-25T23:59:05.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): my global_id is 144251 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc3013ba50 con 0x7fdc30134970 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1229219271 0 0) 0x7fdc3013b770 con 0x7fdc300a4820 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): my global_id is 144262 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc30139ef0 con 0x7fdc300a4820 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3480926647 0 0) 0x7fdc14003530 con 0x7fdc3013e200 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc3013b770 con 0x7fdc3013e200 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc28001d00 con 0x7fdc3013e200 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:05.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.746 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2889461664 0 0) 0x7fdc3013ba50 con 0x7fdc30134970 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc14003530 con 0x7fdc30134970 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc20001780 con 0x7fdc30134970 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.747 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1011081830 0 0) 0x7fdc3013b770 con 0x7fdc3013e200 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.106:6793/0 conn(0x7fdc30134970 legacy=0x7fdc30138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.171:6789/0 conn(0x7fdc300a4820 legacy=0x7fdc301388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 monclient: found mon.d 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc301396d0 con 0x7fdc3013e200 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 5 monclient: authenticate success, global_id 5802 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: _renew_subs 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdc30139a60 con 0x7fdc3013e200 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: _renew_subs 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fdc3013c150 con 0x7fdc3013e200 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc28004e20 con 0x7fdc3013e200 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc277fe640 4 set_mon_vals no callback set 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc28005310 con 0x7fdc3013e200 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 10 monclient: dump: 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.751 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdc100065d0 con 0x7fdc10002870 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdc280100b0 con 0x7fdc3013e200 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(108..108 src has 1..108) ==== 5781+0+0 (unknown 4033463565 0 0) 0x7fdc28044f20 con 0x7fdc3013e200 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.749+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965897722 0 0) 0x7fdc100065d0 con 0x7fdc10002870 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient(hunting): my global_id is 5811 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc3013b770 con 0x7fdc10002870 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc34c4a640 10 monclient: get_auth_request con 0x7fdc14037ee0 auth_method 0 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3874664380 0 0) 0x7fdc3013b770 con 0x7fdc10002870 2024-04-25T23:59:05.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc100065d0 con 0x7fdc10002870 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc2c0018b0 con 0x7fdc10002870 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient: dump: 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.753 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3409159807 0 0) 0x7fdc100065d0 con 0x7fdc10002870 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc1000a160 con 0x7fdc10002870 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdc2c001c70 con 0x7fdc10002870 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.106:6792/0 conn(0x7fdc10002870 legacy=0x7fdc10004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.753+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.106:6792/0 conn(0x7fdc10002870 legacy=0x7fdc10004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdc10009e50 con 0x7fdc10009110 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2791246166 0 0) 0x7fdc10009e50 con 0x7fdc10009110 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient(hunting): my global_id is 5820 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc100065d0 con 0x7fdc10009110 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1613210467 0 0) 0x7fdc100065d0 con 0x7fdc10009110 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc10009e50 con 0x7fdc10009110 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc2c003b50 con 0x7fdc10009110 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient: dump: 2024-04-25T23:59:05.756 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2033993032 0 0) 0x7fdc10009e50 con 0x7fdc10009110 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdc1000c3e0 con 0x7fdc10009110 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 999719496) 0x7fdc2c003e90 con 0x7fdc10009110 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.106:6792/0 conn(0x7fdc10009110 legacy=0x7fdc100095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc25ffb640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.106:6792/0 conn(0x7fdc10009110 legacy=0x7fdc100095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:05.758 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 264296, 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:05.759 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:05.760 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:05.760 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:05.760 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:05.760 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:05.760 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:05.760 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:05.761 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.761 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-25T23:59:05.761 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.761 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:05.761 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:05.761 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.762 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.762 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.762 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.762 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.763 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.763 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.763 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.763 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.763 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:05.765 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.766 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.769 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:05.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.775 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:05.776 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.778 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.779 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:05.780 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.171:6812/722422047 conn(0x7fdc14037ee0 legacy=0x7fdc1403a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 10 monclient: shutdown 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 >> v1:172.21.15.106:6792/0 conn(0x7fdc3013e200 legacy=0x7fdc301d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc35c4c640 1 -- 172.21.15.106:0/3087224188 reap_dead start 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc35c4c640 1 -- 172.21.15.106:0/3087224188 reap_dead start 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 shutdown_connections 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.757+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 >> 172.21.15.106:0/3087224188 conn(0x7fdc300a9e20 msgr2=0x7fdc30130910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.761+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 shutdown_connections 2024-04-25T23:59:05.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.761+0000 7fdc376af640 1 -- 172.21.15.106:0/3087224188 wait complete. 2024-04-25T23:59:05.783 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:05.783 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-25T23:59:05.783 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-25T23:59:05.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.831+0000 7f076818d640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:05.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.831+0000 7f076818d640 10 monclient: _send_command 3 [{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:05.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.831+0000 7f076818d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:05.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.831+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]} v 0) -- 0x7f0748005c50 con 0x7f07600a1790 2024-04-25T23:59:05.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.831+0000 7f07567fc640 1 -- 172.21.15.171:0/408070259 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}]=0 set item id 12 name 'osd.12' weight 123 at location {host=foobaz,root=default}: no change v108) ==== 218+0+0 (unknown 176011899 0 0) 0x7f075c0152b0 con 0x7f07600a1790 2024-04-25T23:59:05.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.831+0000 7f07567fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add", "id": 12, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:05.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.831+0000 7f07567fc640 10 monclient: _finish_command 3 = system:0 set item id 12 name 'osd.12' weight 123 at location {host=foobaz,root=default}: no change 2024-04-25T23:59:05.817 INFO:tasks.workunit.client.0.smithi171.stderr:set item id 12 name 'osd.12' weight 123 at location {host=foobaz,root=default}: no change 2024-04-25T23:59:05.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 >> v1:172.21.15.171:6812/722422047 conn(0x7f07440379e0 legacy=0x7f0744039ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 10 monclient: shutdown 2024-04-25T23:59:05.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 >> v1:172.21.15.171:6789/0 conn(0x7f07600a1790 legacy=0x7f076006f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 shutdown_connections 2024-04-25T23:59:05.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 >> 172.21.15.171:0/408070259 conn(0x7f07600a2690 msgr2=0x7f07600a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 shutdown_connections 2024-04-25T23:59:05.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.835+0000 7f076818d640 1 -- 172.21.15.171:0/408070259 wait complete. 2024-04-25T23:59:05.834 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add 14 123 root=default host=foobaz 2024-04-25T23:59:05.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: get_monmap_and_config 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: monmap: 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:05.919121+0000 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:05.919121+0000 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.899 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 Processor -- start 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- start start 2024-04-25T23:59:05.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: init 2024-04-25T23:59:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: _add_conns ranks=[6,0,2,3,7,8,1,5,4] 2024-04-25T23:59:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient(hunting): picked mon.noname-d con 0x7f149c0a4f60 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient(hunting): picked mon.noname-a con 0x7f149c0a4680 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:05.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient(hunting): picked mon.noname-b con 0x7f149c13e060 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c0a5a50 con 0x7f149c0a4680 2024-04-25T23:59:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c0a2610 con 0x7f149c13e060 2024-04-25T23:59:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c0a3e30 con 0x7f149c0a4f60 2024-04-25T23:59:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient(hunting): authenticate will time out at 1201.446191s 2024-04-25T23:59:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f149a7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f149c0a4680 0x7f149c13c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39230/0 (socket says 172.21.15.106:39230) 2024-04-25T23:59:05.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f149a7fc640 1 -- 172.21.15.106:0/3525352140 learned_addr learned my addr 172.21.15.106:0/3525352140 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f149affd640 1 --1- 172.21.15.106:0/3525352140 >> v1:172.21.15.106:6792/0 conn(0x7f149c0a4f60 0x7f149c0a5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39770/0 (socket says 172.21.15.106:39770) 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f149b7fe640 1 --1- 172.21.15.106:0/3525352140 >> v1:172.21.15.106:6790/0 conn(0x7f149c13e060 0x7f149c140450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43670/0 (socket says 172.21.15.106:43670) 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334046393 0 0) 0x7f149c0a2610 con 0x7f149c13e060 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): my global_id is 5762 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1484003530 con 0x7f149c13e060 2024-04-25T23:59:05.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 426568997 0 0) 0x7f149c0a3e30 con 0x7f149c0a4f60 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): my global_id is 5829 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f149c0a2610 con 0x7f149c0a4f60 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1926691708 0 0) 0x7f1490001120 con 0x7f149c0a4680 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient(hunting): my global_id is 5868 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f149c0a3e30 con 0x7f149c0a4680 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4103717912 0 0) 0x7f1484003530 con 0x7f149c13e060 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 >> v1:172.21.15.106:6792/0 conn(0x7f149c0a4f60 legacy=0x7f149c0a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 >> v1:172.21.15.106:6789/0 conn(0x7f149c0a4680 legacy=0x7f149c13c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 monclient: found mon.noname-b 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c0a1310 con 0x7f149c13e060 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1494001b40 con 0x7f149c13e060 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:05.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: dump: 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.915 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 5 monclient: authenticate success, global_id 5762 2024-04-25T23:59:05.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1494001de0 con 0x7f149c13e060 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 1 -- 172.21.15.106:0/3525352140 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1494004eb0 con 0x7f149c13e060 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 4 set_mon_vals no callback set 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f1499ffb640 10 monclient: dump: 2024-04-25T23:59:05.917 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.918 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 10 monclient: shutdown 2024-04-25T23:59:05.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- 172.21.15.106:0/3525352140 >> v1:172.21.15.106:6790/0 conn(0x7f149c13e060 legacy=0x7f149c140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- 172.21.15.106:0/3525352140 shutdown_connections 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- 172.21.15.106:0/3525352140 >> 172.21.15.106:0/3525352140 conn(0x7f149c0a9c80 msgr2=0x7f149c0aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- 172.21.15.106:0/3525352140 shutdown_connections 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.917+0000 7f14a17bc640 1 -- 172.21.15.106:0/3525352140 wait complete. 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: monmap: 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:05.920 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.921 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 Processor -- start 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 -- start start 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: init 2024-04-25T23:59:05.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: _add_conns ranks=[2,3,5,4,6,7,1,8,0] 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient(hunting): picked mon.noname-b con 0x7f149c0a4680 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient(hunting): picked mon.noname-g con 0x7f149c0a4f60 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient(hunting): picked mon.noname-h con 0x7f149c13e060 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c09dcb0 con 0x7f149c0a4680 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c0a40e0 con 0x7f149c0a4f60 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f149c09d3d0 con 0x7f149c13e060 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient(hunting): authenticate will time out at 1201.449426s 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f149affd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f149c0a4680 0x7f149c1337c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43680/0 (socket says 172.21.15.106:43680) 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f149affd640 1 -- 172.21.15.106:0/3282183997 learned_addr learned my addr 172.21.15.106:0/3282183997 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:05.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 511976948 0 0) 0x7f149c09dcb0 con 0x7f149c0a4680 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): my global_id is 5771 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1488003530 con 0x7f149c0a4680 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 882254104 0 0) 0x7f1488003530 con 0x7f149c0a4680 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f149c09dcb0 con 0x7f149c0a4680 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f148c001a80 con 0x7f149c0a4680 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): dump: 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.924 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604215225 0 0) 0x7f149c0a40e0 con 0x7f149c0a4f60 2024-04-25T23:59:05.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): my global_id is 6006 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1488003530 con 0x7f149c0a4f60 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3765797668 0 0) 0x7f149c09dcb0 con 0x7f149c0a4680 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.171:6791/0 conn(0x7f149c13e060 legacy=0x7f149c1d4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.171:6790/0 conn(0x7f149c0a4f60 legacy=0x7f149c1d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 monclient: found mon.b 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f149c09f3e0 con 0x7f149c0a4680 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 5 monclient: authenticate success, global_id 5771 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: _renew_subs 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f149c0a0640 con 0x7f149c0a4680 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: _renew_subs 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f149c09b780 con 0x7f149c0a4680 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f148c004b20 con 0x7f149c0a4680 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f148c005010 con 0x7f149c0a4680 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14997fa640 4 set_mon_vals no callback set 2024-04-25T23:59:05.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: dump: 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.928 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f147c0065d0 con 0x7f147c002870 2024-04-25T23:59:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f148c0051b0 con 0x7f149c0a4680 2024-04-25T23:59:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(108..108 src has 1..108) ==== 5781+0+0 (unknown 4033463565 0 0) 0x7f148c044ef0 con 0x7f149c0a4680 2024-04-25T23:59:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729456853 0 0) 0x7f147c0065d0 con 0x7f147c002870 2024-04-25T23:59:05.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient(hunting): my global_id is 144260 2024-04-25T23:59:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f149c09dcb0 con 0x7f147c002870 2024-04-25T23:59:05.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f149b7fe640 10 monclient: get_auth_request con 0x7f1488037890 auth_method 0 2024-04-25T23:59:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2285807826 0 0) 0x7f149c09dcb0 con 0x7f147c002870 2024-04-25T23:59:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f147c0065d0 con 0x7f147c002870 2024-04-25T23:59:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f14900014d0 con 0x7f147c002870 2024-04-25T23:59:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:05.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 10 monclient: dump: 2024-04-25T23:59:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.932 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1142504184 0 0) 0x7f147c0065d0 con 0x7f147c002870 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.921+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f147c00a160 con 0x7f147c002870 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.925+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1490001860 con 0x7f147c002870 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.925+0000 7f14837fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.925+0000 7f14837fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.925+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.106:6793/0 conn(0x7f147c002870 legacy=0x7f147c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.925+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.106:6793/0 conn(0x7f147c002870 legacy=0x7f147c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:05.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f147c009e30 con 0x7f147c0090f0 2024-04-25T23:59:05.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3870469275 0 0) 0x7f147c009e30 con 0x7f147c0090f0 2024-04-25T23:59:05.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient(hunting): my global_id is 144269 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f147c0065d0 con 0x7f147c0090f0 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 524535088 0 0) 0x7f147c0065d0 con 0x7f147c0090f0 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f147c009e30 con 0x7f147c0090f0 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1490004d20 con 0x7f147c0090f0 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient: dump: 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.936 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 358490914 0 0) 0x7f147c009e30 con 0x7f147c0090f0 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f147c00c3a0 con 0x7f147c0090f0 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 1232585292) 0x7f1490007090 con 0x7f147c0090f0 2024-04-25T23:59:05.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.106:6793/0 conn(0x7f147c0090f0 legacy=0x7f147c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14837fe640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.106:6793/0 conn(0x7f147c0090f0 legacy=0x7f147c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9459, 2024-04-25T23:59:05.938 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.939 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.940 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.941 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:05.942 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:05.943 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.944 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:05.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:05.947 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:05.948 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:05.952 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:05.954 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:05.956 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:05.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:05.957 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:05.957 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.171:6812/722422047 conn(0x7f1488037890 legacy=0x7f1488039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 10 monclient: shutdown 2024-04-25T23:59:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 >> v1:172.21.15.106:6790/0 conn(0x7f149c0a4680 legacy=0x7f149c1337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f149b7fe640 1 -- 172.21.15.106:0/3282183997 reap_dead start 2024-04-25T23:59:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f149b7fe640 1 -- 172.21.15.106:0/3282183997 reap_dead start 2024-04-25T23:59:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 shutdown_connections 2024-04-25T23:59:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 >> 172.21.15.106:0/3282183997 conn(0x7f149c0a9c80 msgr2=0x7f149c1377d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 shutdown_connections 2024-04-25T23:59:05.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:05.929+0000 7f14a17bc640 1 -- 172.21.15.106:0/3282183997 wait complete. 2024-04-25T23:59:05.959 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:05.959 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-25T23:59:05.960 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient: get_monmap_and_config 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient: monmap: 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:05.975718+0000 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:05.975718+0000 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.968 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 1 Processor -- start 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 1 -- start start 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient: init 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient: _add_conns ranks=[6,4,2,1,0,5,7,8,3] 2024-04-25T23:59:05.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient(hunting): picked mon.noname-d con 0x7fa4c409fa10 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient(hunting): picked mon.noname-c con 0x7fa4c4135b70 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient(hunting): picked mon.noname-b con 0x7fa4c4135f80 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c40687f0 con 0x7fa4c4135f80 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c409da80 con 0x7fa4c4135b70 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c409dfd0 con 0x7fa4c409fa10 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient(hunting): authenticate will time out at 1196.682735s 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c37fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fa4c409fa10 0x7fa4c409fdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:55142/0 (socket says 172.21.15.171:55142) 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c37fe640 1 -- 172.21.15.171:0/3318173011 learned_addr learned my addr 172.21.15.171:0/3318173011 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c2ffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fa4c4135b70 0x7fa4c413aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:53412/0 (socket says 172.21.15.171:53412) 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c3fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fa4c4135f80 0x7fa4c413e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:33962/0 (socket says 172.21.15.171:33962) 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2005031064 0 0) 0x7fa4c409da80 con 0x7fa4c4135b70 2024-04-25T23:59:05.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): my global_id is 144274 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4ac003530 con 0x7fa4c4135b70 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902372977 0 0) 0x7fa4c40687f0 con 0x7fa4c4135f80 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): my global_id is 5780 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c409da80 con 0x7fa4c4135f80 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2768937247 0 0) 0x7fa4bc001120 con 0x7fa4c409fa10 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient(hunting): my global_id is 5838 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c40687f0 con 0x7fa4c409fa10 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2839005741 0 0) 0x7fa4c40687f0 con 0x7fa4c409fa10 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 >> v1:172.21.15.106:6791/0 conn(0x7fa4c4135b70 legacy=0x7fa4c413aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 >> v1:172.21.15.106:6790/0 conn(0x7fa4c4135f80 legacy=0x7fa4c413e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 monclient: found mon.noname-d 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c40a0500 con 0x7fa4c409fa10 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4bc0018b0 con 0x7fa4c409fa10 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 5 monclient: authenticate success, global_id 5838 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: dump: 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.973 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4bc001ae0 con 0x7fa4c409fa10 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 1 -- 172.21.15.171:0/3318173011 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4bc004bf0 con 0x7fa4c409fa10 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c9df2640 4 set_mon_vals no callback set 2024-04-25T23:59:05.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.971+0000 7fa4c27fc640 10 monclient: dump: 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.975 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: shutdown 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/3318173011 >> v1:172.21.15.106:6792/0 conn(0x7fa4c409fa10 legacy=0x7fa4c409fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/3318173011 shutdown_connections 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/3318173011 >> 172.21.15.171:0/3318173011 conn(0x7fa4c40a2ee0 msgr2=0x7fa4c40a32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/3318173011 shutdown_connections 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/3318173011 wait complete. 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: build_initial_monmap 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: monmap: 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:05.976 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:05.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 Processor -- start 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- start start 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: init 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _add_conns ranks=[0,1,8,3,5,6,7,2,4] 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient(hunting): picked mon.noname-a con 0x7fa4c409fa10 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient(hunting): picked mon.noname-f con 0x7fa4c4135b70 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient(hunting): picked mon.noname-e con 0x7fa4c4135f80 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c41ca6f0 con 0x7fa4c409fa10 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c412e100 con 0x7fa4c4135b70 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4c412fbc0 con 0x7fa4c4135f80 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient(hunting): authenticate will time out at 1196.686032s 2024-04-25T23:59:05.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c2ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa4c4135b70 0x7fa4c41cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49290/0 (socket says 172.21.15.171:49290) 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c2ffd640 1 -- 172.21.15.171:0/2261509117 learned_addr learned my addr 172.21.15.171:0/2261509117 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858507594 0 0) 0x7fa4c412e100 con 0x7fa4c4135b70 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): my global_id is 144271 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4b0003530 con 0x7fa4c4135b70 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3523274792 0 0) 0x7fa4c41ca6f0 con 0x7fa4c409fa10 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): my global_id is 5877 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c412e100 con 0x7fa4c409fa10 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1905313392 0 0) 0x7fa4c412fbc0 con 0x7fa4c4135f80 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): my global_id is 144278 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c41ca6f0 con 0x7fa4c4135f80 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1358542714 0 0) 0x7fa4b0003530 con 0x7fa4c4135b70 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4c412fbc0 con 0x7fa4c4135b70 2024-04-25T23:59:05.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4b8001810 con 0x7fa4c4135b70 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): dump: 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.981 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1969565433 0 0) 0x7fa4c412e100 con 0x7fa4c409fa10 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4b0003530 con 0x7fa4c409fa10 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4bc004b30 con 0x7fa4c409fa10 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient(hunting): dump: 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.982 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:05.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3482202067 0 0) 0x7fa4c412fbc0 con 0x7fa4c4135b70 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 >> v1:172.21.15.106:6793/0 conn(0x7fa4c4135f80 legacy=0x7fa4c41d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 >> v1:172.21.15.106:6789/0 conn(0x7fa4c409fa10 legacy=0x7fa4c41349c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 monclient: found mon.f 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c412ec60 con 0x7fa4c4135b70 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: _finish_auth 0 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 5 monclient: authenticate success, global_id 144271 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _renew_subs 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:05.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c41350d0 con 0x7fa4c4135b70 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _renew_subs 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4c41ca210 con 0x7fa4c4135b70 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4b8004e20 con 0x7fa4c4135b70 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4b8005310 con 0x7fa4c4135b70 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c1ffb640 4 set_mon_vals no callback set 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 10 monclient: dump: 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:05.985 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa4b8010130 con 0x7fa4c4135b70 2024-04-25T23:59:05.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:05.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.975+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4a4005090 con 0x7fa4c4135b70 2024-04-25T23:59:05.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.979+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(108..108 src has 1..108) ==== 5781+0+0 (unknown 4033463565 0 0) 0x7fa4b80452b0 con 0x7fa4c4135b70 2024-04-25T23:59:05.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.979+0000 7fa4c37fe640 10 monclient: get_auth_request con 0x7fa4b0037f80 auth_method 0 2024-04-25T23:59:05.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.983+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa4b8015cf0 con 0x7fa4c4135b70 2024-04-25T23:59:05.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.983+0000 7fa4abfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:05.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:05.983+0000 7fa4abfff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.097+0000 7f9820e7d640 10 monclient: get_monmap_and_config 2024-04-25T23:59:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.097+0000 7f9820e7d640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.097+0000 7f9820e7d640 10 monclient: monmap: 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:06.101971+0000 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:06.101971+0000 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.082 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.083 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.084 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 Processor -- start 2024-04-25T23:59:06.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- start start 2024-04-25T23:59:06.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: init 2024-04-25T23:59:06.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: _add_conns ranks=[4,1,6,3,5,7,0,8,2] 2024-04-25T23:59:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient(hunting): picked mon.noname-c con 0x7f981c135870 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient(hunting): picked mon.noname-f con 0x7f981c1353b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient(hunting): picked mon.noname-d con 0x7f981c13bdf0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c06f2d0 con 0x7f981c1353b0 2024-04-25T23:59:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c072330 con 0x7f981c135870 2024-04-25T23:59:06.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c072610 con 0x7f981c13bdf0 2024-04-25T23:59:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient(hunting): authenticate will time out at 1201.629174s 2024-04-25T23:59:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981a59c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f981c135870 0x7f981c135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:43660/0 (socket says 172.21.15.106:43660) 2024-04-25T23:59:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981a59c640 1 -- 172.21.15.106:0/2252370402 learned_addr learned my addr 172.21.15.106:0/2252370402 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98579850 0 0) 0x7f981c072330 con 0x7f981c135870 2024-04-25T23:59:06.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): my global_id is 144283 2024-04-25T23:59:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9804003530 con 0x7f981c135870 2024-04-25T23:59:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287387032 0 0) 0x7f981c072610 con 0x7f981c13bdf0 2024-04-25T23:59:06.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient(hunting): my global_id is 5847 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c072330 con 0x7f981c13bdf0 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3485076983 0 0) 0x7f981c072330 con 0x7f981c13bdf0 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 >> v1:172.21.15.106:6791/0 conn(0x7f981c135870 legacy=0x7f981c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 >> v1:172.21.15.171:6789/0 conn(0x7f981c1353b0 legacy=0x7f981c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 monclient: found mon.noname-d 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c0a3260 con 0x7f981c13bdf0 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9814001ae0 con 0x7f981c13bdf0 2024-04-25T23:59:06.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 5 monclient: authenticate success, global_id 5847 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: dump: 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.106 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.107 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9814001d30 con 0x7f981c13bdf0 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 4 set_mon_vals no callback set 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 1 -- 172.21.15.106:0/2252370402 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9814003ce0 con 0x7f981c13bdf0 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f981959a640 10 monclient: dump: 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.109 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: shutdown 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- 172.21.15.106:0/2252370402 >> v1:172.21.15.106:6792/0 conn(0x7f981c13bdf0 legacy=0x7f981c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- 172.21.15.106:0/2252370402 shutdown_connections 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- 172.21.15.106:0/2252370402 >> 172.21.15.106:0/2252370402 conn(0x7f981c0a64e0 msgr2=0x7f981c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- 172.21.15.106:0/2252370402 shutdown_connections 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- 172.21.15.106:0/2252370402 wait complete. 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: monmap: 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:06.110 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 Processor -- start 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 1 -- start start 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.101+0000 7f9820e7d640 10 monclient: init 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient: _add_conns ranks=[7,1,4,5,6,3,0,2,8] 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient(hunting): picked mon.noname-i con 0x7f981c1353b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient(hunting): picked mon.noname-f con 0x7f981c135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient(hunting): picked mon.noname-c con 0x7f981c13bdf0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c1312b0 con 0x7f981c135870 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c09f930 con 0x7f981c13bdf0 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f981c070e00 con 0x7f981c1353b0 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient(hunting): authenticate will time out at 1201.632143s 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f981ad9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f981c13bdf0 0x7f981c1d4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:43662/0 (socket says 172.21.15.106:43662) 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f981ad9d640 1 -- 172.21.15.106:0/35496314 learned_addr learned my addr 172.21.15.106:0/35496314 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2525312833 0 0) 0x7f981c09f930 con 0x7f981c13bdf0 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): my global_id is 144292 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97fc003530 con 0x7f981c13bdf0 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 744258676 0 0) 0x7f97fc003530 con 0x7f981c13bdf0 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f981c09f930 con 0x7f981c13bdf0 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f98140016a0 con 0x7f981c13bdf0 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): dump: 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.113 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1610883629 0 0) 0x7f981c070e00 con 0x7f981c1353b0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): my global_id is 144160 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97fc003530 con 0x7f981c1353b0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2808283311 0 0) 0x7f981c09f930 con 0x7f981c13bdf0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.171:6792/0 conn(0x7f981c1353b0 legacy=0x7f981c1347b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.171:6789/0 conn(0x7f981c135870 legacy=0x7f981c1d1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 monclient: found mon.c 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f981c1cc990 con 0x7f981c13bdf0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 5 monclient: authenticate success, global_id 144292 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient: _renew_subs 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f981c06ff10 con 0x7f981c13bdf0 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient: _renew_subs 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f981c134ec0 con 0x7f981c13bdf0 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9814003f50 con 0x7f981c13bdf0 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f98140044c0 con 0x7f981c13bdf0 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: dump: 2024-04-25T23:59:06.116 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9818d99640 4 set_mon_vals no callback set 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98000065d0 con 0x7f9800002870 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9814004660 con 0x7f981c13bdf0 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(108..108 src has 1..108) ==== 5781+0+0 (unknown 4033463565 0 0) 0x7f9814045050 con 0x7f981c13bdf0 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f9819d9b640 10 monclient: get_auth_request con 0x7f97fc0377c0 auth_method 0 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3853976503 0 0) 0x7f98000065d0 con 0x7f9800002870 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient(hunting): my global_id is 144298 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f981c09f930 con 0x7f9800002870 2024-04-25T23:59:06.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 713929496 0 0) 0x7f981c09f930 con 0x7f9800002870 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98000065d0 con 0x7f9800002870 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9810001560 con 0x7f9800002870 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: dump: 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.119 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2436956770 0 0) 0x7f98000065d0 con 0x7f9800002870 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f980000a160 con 0x7f9800002870 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f98100047f0 con 0x7f9800002870 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.105+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.171:6789/0 conn(0x7f9800002870 legacy=0x7f9800004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.109+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.171:6789/0 conn(0x7f9800002870 legacy=0x7f9800004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f9820e7d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9800009e30 con 0x7f98000090f0 2024-04-25T23:59:06.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 501475822 0 0) 0x7f9800009e30 con 0x7f98000090f0 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 10 monclient(hunting): my global_id is 144307 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98000065d0 con 0x7f98000090f0 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 828851338 0 0) 0x7f98000065d0 con 0x7f98000090f0 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9800009e30 con 0x7f98000090f0 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9810004de0 con 0x7f98000090f0 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 10 monclient: dump: 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.121 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1835169926 0 0) 0x7f9800009e30 con 0x7f98000090f0 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.113+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f980000c3a0 con 0x7f98000090f0 2024-04-25T23:59:06.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 1943326389) 0x7f9810007150 con 0x7f98000090f0 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f980affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f980affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.171:6789/0 conn(0x7f98000090f0 legacy=0x7f9800009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f980affd640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.171:6789/0 conn(0x7f98000090f0 legacy=0x7f9800009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:06.123 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9643, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:06.124 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.125 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.126 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:06.127 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.128 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:06.129 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.131 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.135 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.136 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:06.138 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:06.139 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.140 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.141 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.142 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.142 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:06.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.142 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.142 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:06.142 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:06.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.171:6812/722422047 conn(0x7f97fc0377c0 legacy=0x7f97fc039c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 10 monclient: shutdown 2024-04-25T23:59:06.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 >> v1:172.21.15.106:6791/0 conn(0x7f981c13bdf0 legacy=0x7f981c1d4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f981ad9d640 1 -- 172.21.15.106:0/35496314 reap_dead start 2024-04-25T23:59:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f981ad9d640 1 -- 172.21.15.106:0/35496314 reap_dead start 2024-04-25T23:59:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 shutdown_connections 2024-04-25T23:59:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 >> 172.21.15.106:0/35496314 conn(0x7f981c0a64e0 msgr2=0x7f981c13ef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 shutdown_connections 2024-04-25T23:59:06.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.117+0000 7f9820e7d640 1 -- 172.21.15.106:0/35496314 wait complete. 2024-04-25T23:59:06.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:06.144 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-25T23:59:06.145 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:59:06.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.147+0000 7fa4c9df2640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:06.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.147+0000 7fa4c9df2640 10 monclient: _send_command 2 [{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:06.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.147+0000 7fa4c9df2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:06.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.147+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]} v 0) -- 0x7fa4a4005380 con 0x7fa4c4135b70 2024-04-25T23:59:06.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient: get_monmap_and_config 2024-04-25T23:59:06.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient: monmap: 2024-04-25T23:59:06.266 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.266 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.266 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:06.287044+0000 2024-04-25T23:59:06.266 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:06.287044+0000 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.267 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 1 Processor -- start 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 1 -- start start 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient: init 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient: _add_conns ranks=[2,4,8,1,7,0,6,5,3] 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient(hunting): picked mon.noname-b con 0x7f7a300a5030 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient(hunting): picked mon.noname-c con 0x7f7a30072710 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient(hunting): picked mon.noname-e con 0x7f7a30072b70 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a30137d60 con 0x7f7a300a5030 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a30138550 con 0x7f7a30072710 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3006cf60 con 0x7f7a30072b70 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 10 monclient(hunting): authenticate will time out at 1201.814948s 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a34e99640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7a300a5030 0x7f7a30137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43686/0 (socket says 172.21.15.106:43686) 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a34e99640 1 -- 172.21.15.106:0/1984686590 learned_addr learned my addr 172.21.15.106:0/1984686590 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2ffff640 1 --1- 172.21.15.106:0/1984686590 >> v1:172.21.15.106:6791/0 conn(0x7f7a30072710 0x7f7a3013c970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:43668/0 (socket says 172.21.15.106:43668) 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626526196 0 0) 0x7f7a30137d60 con 0x7f7a300a5030 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): my global_id is 5789 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a18003530 con 0x7f7a300a5030 2024-04-25T23:59:06.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3481602089 0 0) 0x7f7a3006cf60 con 0x7f7a30072b70 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): my global_id is 144287 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a30137d60 con 0x7f7a30072b70 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3602049291 0 0) 0x7f7a30138550 con 0x7f7a30072710 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient(hunting): my global_id is 144301 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a3006cf60 con 0x7f7a30072710 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 893012708 0 0) 0x7f7a3006cf60 con 0x7f7a30072710 2024-04-25T23:59:06.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 >> v1:172.21.15.106:6793/0 conn(0x7f7a30072b70 legacy=0x7f7a301400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 >> v1:172.21.15.106:6790/0 conn(0x7f7a300a5030 legacy=0x7f7a30137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 monclient: found mon.noname-c 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a3006e240 con 0x7f7a30072710 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a24001610 con 0x7f7a30072710 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 5 monclient: authenticate success, global_id 144301 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a2f7fe640 10 monclient: dump: 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.275 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.285+0000 7f7a370fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a24001840 con 0x7f7a30072710 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 4 set_mon_vals no callback set 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2f7fe640 1 -- 172.21.15.106:0/1984686590 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a240047f0 con 0x7f7a30072710 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2f7fe640 10 monclient: dump: 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.276 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: shutdown 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/1984686590 >> v1:172.21.15.106:6791/0 conn(0x7f7a30072710 legacy=0x7f7a3013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/1984686590 shutdown_connections 2024-04-25T23:59:06.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/1984686590 >> 172.21.15.106:0/1984686590 conn(0x7f7a300a83a0 msgr2=0x7f7a300a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/1984686590 shutdown_connections 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/1984686590 wait complete. 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: monmap: 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.278 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 Processor -- start 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- start start 2024-04-25T23:59:06.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: init 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: _add_conns ranks=[0,8,2,3,4,7,6,1,5] 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient(hunting): picked mon.noname-a con 0x7f7a30072710 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient(hunting): picked mon.noname-e con 0x7f7a30072b70 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient(hunting): picked mon.noname-b con 0x7f7a300a5030 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3006d4c0 con 0x7f7a30072710 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a301cd4d0 con 0x7f7a300a5030 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a3006d9a0 con 0x7f7a30072b70 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient(hunting): authenticate will time out at 1201.818053s 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a34e99640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7a30072710 0x7f7a301cc6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39244/0 (socket says 172.21.15.106:39244) 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a34e99640 1 -- 172.21.15.106:0/763658464 learned_addr learned my addr 172.21.15.106:0/763658464 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521587056 0 0) 0x7f7a200014f0 con 0x7f7a30072710 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): my global_id is 5886 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a1c003530 con 0x7f7a30072710 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3574883904 0 0) 0x7f7a3006d9a0 con 0x7f7a30072b70 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): my global_id is 144296 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a200014f0 con 0x7f7a30072b70 2024-04-25T23:59:06.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2541460996 0 0) 0x7f7a301cd4d0 con 0x7f7a300a5030 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): my global_id is 5798 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a3006d9a0 con 0x7f7a300a5030 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2890737351 0 0) 0x7f7a1c003530 con 0x7f7a30072710 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a301cd4d0 con 0x7f7a30072710 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a20001f80 con 0x7f7a30072710 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.288 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4211995985 0 0) 0x7f7a200014f0 con 0x7f7a30072b70 2024-04-25T23:59:06.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a1c003530 con 0x7f7a30072b70 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 396692158 0 0) 0x7f7a3006d9a0 con 0x7f7a300a5030 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a200014f0 con 0x7f7a300a5030 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a240015d0 con 0x7f7a30072b70 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.290 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a28001480 con 0x7f7a300a5030 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.291 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2874398865 0 0) 0x7f7a301cd4d0 con 0x7f7a30072710 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.106:6793/0 conn(0x7f7a30072b70 legacy=0x7f7a301ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.106:6790/0 conn(0x7f7a300a5030 legacy=0x7f7a301d4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 monclient: found mon.a 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a30131680 con 0x7f7a30072710 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 5 monclient: authenticate success, global_id 5886 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: _renew_subs 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7a30131000 con 0x7f7a30072710 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: _renew_subs 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:06.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7a30133970 con 0x7f7a30072710 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7a20004e90 con 0x7f7a30072710 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a20005400 con 0x7f7a30072710 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2effd640 4 set_mon_vals no callback set 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a2d7fa640 10 monclient: dump: 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.294 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.289+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a100065d0 con 0x7f7a10002870 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7a20010220 con 0x7f7a30072710 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(108..108 src has 1..108) ==== 5781+0+0 (unknown 4033463565 0 0) 0x7f7a20045320 con 0x7f7a30072710 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a3569a640 10 monclient: get_auth_request con 0x7f7a1c0381b0 auth_method 0 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2595984534 0 0) 0x7f7a100065d0 con 0x7f7a10002870 2024-04-25T23:59:06.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient(hunting): my global_id is 6015 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a301cd4d0 con 0x7f7a10002870 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 747823891 0 0) 0x7f7a301cd4d0 con 0x7f7a10002870 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a100065d0 con 0x7f7a10002870 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a24001840 con 0x7f7a10002870 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient: dump: 2024-04-25T23:59:06.296 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.297 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 824260968 0 0) 0x7f7a100065d0 con 0x7f7a10002870 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a1000a160 con 0x7f7a10002870 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7a24005150 con 0x7f7a10002870 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.171:6790/0 conn(0x7f7a10002870 legacy=0x7f7a10004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.293+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.171:6790/0 conn(0x7f7a10002870 legacy=0x7f7a10004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7a10009e50 con 0x7f7a10009110 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383568468 0 0) 0x7f7a10009e50 con 0x7f7a10009110 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient(hunting): my global_id is 6024 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a100065d0 con 0x7f7a10009110 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3154991610 0 0) 0x7f7a100065d0 con 0x7f7a10009110 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a10009e50 con 0x7f7a10009110 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a24005940 con 0x7f7a10009110 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient: dump: 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.299 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2733946714 0 0) 0x7f7a10009e50 con 0x7f7a10009110 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7a1000c3e0 con 0x7f7a10009110 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2731209303) 0x7f7a24005c60 con 0x7f7a10009110 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.171:6790/0 conn(0x7f7a10009110 legacy=0x7f7a100095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a2d7fa640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.171:6790/0 conn(0x7f7a10009110 legacy=0x7f7a100095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 264821, 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:06.301 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.302 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.303 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:06.304 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:06.305 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.306 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:06.310 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.312 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.313 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.314 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:06.315 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.316 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:06.318 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:06.319 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.171:6812/722422047 conn(0x7f7a1c0381b0 legacy=0x7f7a1c03a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 10 monclient: shutdown 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 >> v1:172.21.15.106:6789/0 conn(0x7f7a30072710 legacy=0x7f7a301cc6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a3569a640 1 -- 172.21.15.106:0/763658464 reap_dead start 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a3569a640 1 -- 172.21.15.106:0/763658464 reap_dead start 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 shutdown_connections 2024-04-25T23:59:06.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 >> 172.21.15.106:0/763658464 conn(0x7f7a300a83a0 msgr2=0x7f7a30135940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 shutdown_connections 2024-04-25T23:59:06.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.301+0000 7f7a370fd640 1 -- 172.21.15.106:0/763658464 wait complete. 2024-04-25T23:59:06.322 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:06.322 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-25T23:59:06.323 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:59:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.453+0000 7f2f1bdd1640 10 monclient: get_monmap_and_config 2024-04-25T23:59:06.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.453+0000 7f2f1bdd1640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.453+0000 7f2f1bdd1640 10 monclient: monmap: 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:06.458167+0000 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:06.458167+0000 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.438 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.439 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.439 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 Processor -- start 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- start start 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: init 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: _add_conns ranks=[1,8,0,5,2,4,7,3,6] 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient(hunting): picked mon.noname-f con 0x7f2f14137c40 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient(hunting): picked mon.noname-e con 0x7f2f1409fca0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:06.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient(hunting): picked mon.noname-a con 0x7f2f14137570 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1406ee10 con 0x7f2f14137570 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f140a2220 con 0x7f2f14137c40 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f1406f0f0 con 0x7f2f1409fca0 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient(hunting): authenticate will time out at 1201.985323s 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1936c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f2f1409fca0 0x7f2f140a1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33420/0 (socket says 172.21.15.106:33420) 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1936c640 1 -- 172.21.15.106:0/1295637597 learned_addr learned my addr 172.21.15.106:0/1295637597 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638949944 0 0) 0x7f2f1406f0f0 con 0x7f2f1409fca0 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): my global_id is 144305 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f00003530 con 0x7f2f1409fca0 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340605306 0 0) 0x7f2f0c0014a0 con 0x7f2f14137570 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient(hunting): my global_id is 5895 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f1406f0f0 con 0x7f2f14137570 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2748170802 0 0) 0x7f2f00003530 con 0x7f2f1409fca0 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 >> v1:172.21.15.171:6789/0 conn(0x7f2f14137c40 legacy=0x7f2f140a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 >> v1:172.21.15.106:6789/0 conn(0x7f2f14137570 legacy=0x7f2f141408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 monclient: found mon.noname-e 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f1406f3d0 con 0x7f2f1409fca0 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f100017c0 con 0x7f2f1409fca0 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: dump: 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.449 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 5 monclient: authenticate success, global_id 144305 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f10001a70 con 0x7f2f1409fca0 2024-04-25T23:59:06.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 1 -- 172.21.15.106:0/1295637597 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f10004bf0 con 0x7f2f1409fca0 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 4 set_mon_vals no callback set 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f18b6b640 10 monclient: dump: 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.451 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: shutdown 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/1295637597 >> v1:172.21.15.106:6793/0 conn(0x7f2f1409fca0 legacy=0x7f2f140a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/1295637597 shutdown_connections 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/1295637597 >> 172.21.15.106:0/1295637597 conn(0x7f2f140a64e0 msgr2=0x7f2f140a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/1295637597 shutdown_connections 2024-04-25T23:59:06.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/1295637597 wait complete. 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: monmap: 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.453 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 Processor -- start 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 1 -- start start 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.457+0000 7f2f1bdd1640 10 monclient: init 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient: _add_conns ranks=[6,1,3,0,7,5,8,2,4] 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient(hunting): picked mon.noname-d con 0x7f2f1409fca0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient(hunting): picked mon.noname-f con 0x7f2f14137570 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient(hunting): picked mon.noname-g con 0x7f2f14137c40 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f141209f0 con 0x7f2f14137570 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f14072970 con 0x7f2f14137c40 2024-04-25T23:59:06.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f14120e90 con 0x7f2f1409fca0 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient(hunting): authenticate will time out at 1201.988463s 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f19b6d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f2f1409fca0 0x7f2f14131510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39784/0 (socket says 172.21.15.106:39784) 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f19b6d640 1 -- 172.21.15.106:0/3045073779 learned_addr learned my addr 172.21.15.106:0/3045073779 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207276473 0 0) 0x7f2f14120e90 con 0x7f2f1409fca0 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): my global_id is 5856 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ef8003530 con 0x7f2f1409fca0 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3713261090 0 0) 0x7f2ef8003530 con 0x7f2f1409fca0 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f14120e90 con 0x7f2f1409fca0 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f04001a40 con 0x7f2f1409fca0 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.456 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1272549626 0 0) 0x7f2f14120e90 con 0x7f2f1409fca0 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.171:6790/0 conn(0x7f2f14137c40 legacy=0x7f2f141d50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.171:6789/0 conn(0x7f2f14137570 legacy=0x7f2f141d1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 monclient: found mon.d 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f140724d0 con 0x7f2f1409fca0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 5 monclient: authenticate success, global_id 5856 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient: _renew_subs 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f14122a00 con 0x7f2f1409fca0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient: _renew_subs 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f14131c20 con 0x7f2f1409fca0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f040038d0 con 0x7f2f1409fca0 2024-04-25T23:59:06.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f04003e40 con 0x7f2f1409fca0 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0bfff640 4 set_mon_vals no callback set 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: dump: 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.459 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2f04004060 con 0x7f2f1409fca0 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2efc0065d0 con 0x7f2efc002870 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(108..108 src has 1..108) ==== 5781+0+0 (unknown 4033463565 0 0) 0x7f2f04044d80 con 0x7f2f1409fca0 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f1a36e640 10 monclient: get_auth_request con 0x7f2ef80377e0 auth_method 0 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993136285 0 0) 0x7f2efc0065d0 con 0x7f2efc002870 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient(hunting): my global_id is 5702 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f14120e90 con 0x7f2efc002870 2024-04-25T23:59:06.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 333003538 0 0) 0x7f2f14120e90 con 0x7f2efc002870 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2efc0065d0 con 0x7f2efc002870 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f10001780 con 0x7f2efc002870 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 10 monclient: dump: 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.461 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2749110448 0 0) 0x7f2efc0065d0 con 0x7f2efc002870 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.461+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2efc00a160 con 0x7f2efc002870 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.465+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2f10001780 con 0x7f2efc002870 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.465+0000 7f2f0a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.465+0000 7f2f0a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.465+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.171:6791/0 conn(0x7f2efc002870 legacy=0x7f2efc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.465+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.171:6791/0 conn(0x7f2efc002870 legacy=0x7f2efc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f1bdd1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2efc009e50 con 0x7f2efc009110 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438786827 0 0) 0x7f2efc009e50 con 0x7f2efc009110 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f0a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f0a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f0a7fc640 10 monclient(hunting): my global_id is 5711 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.469+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2efc0065d0 con 0x7f2efc009110 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1536231420 0 0) 0x7f2efc0065d0 con 0x7f2efc009110 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2efc009e50 con 0x7f2efc009110 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f10005000 con 0x7f2efc009110 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 10 monclient: dump: 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.465 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1466345727 0 0) 0x7f2efc009e50 con 0x7f2efc009110 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2efc00c3e0 con 0x7f2efc009110 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1665988786) 0x7f2f100071e0 con 0x7f2efc009110 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.171:6791/0 conn(0x7f2efc009110 legacy=0x7f2efc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f0a7fc640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.171:6791/0 conn(0x7f2efc009110 legacy=0x7f2efc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:06.466 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 264973, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:06.467 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.469 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-25T23:59:06.469 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.469 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:06.469 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:06.469 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.469 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.470 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:06.471 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.472 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:06.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.475 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:06.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.479 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.480 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.483 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.484 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:06.485 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:06.486 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:06.487 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:06.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.171:6812/722422047 conn(0x7f2ef80377e0 legacy=0x7f2ef8039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 10 monclient: shutdown 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 >> v1:172.21.15.106:6792/0 conn(0x7f2f1409fca0 legacy=0x7f2f14131510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1a36e640 1 -- 172.21.15.106:0/3045073779 reap_dead start 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1a36e640 1 -- 172.21.15.106:0/3045073779 reap_dead start 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 shutdown_connections 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 >> 172.21.15.106:0/3045073779 conn(0x7f2f140a64e0 msgr2=0x7f2f1406fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 shutdown_connections 2024-04-25T23:59:06.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.473+0000 7f2f1bdd1640 1 -- 172.21.15.106:0/3045073779 wait complete. 2024-04-25T23:59:06.489 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:06.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-25T23:59:06.490 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-25T23:59:06.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.515+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}]=0 add item id 14 name 'osd.14' weight 123 at location {host=foobaz,root=default} to crush map v109) ==== 220+0+0 (unknown 21260919 0 0) 0x7fa4b80155f0 con 0x7fa4c4135b70 2024-04-25T23:59:06.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.515+0000 7fa4abfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:06.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.515+0000 7fa4abfff640 10 monclient: _finish_command 2 = system:0 add item id 14 name 'osd.14' weight 123 at location {host=foobaz,root=default} to crush map 2024-04-25T23:59:06.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.619+0000 7fa4c9df2640 10 start_mon_command cmd=[{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:06.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.619+0000 7fa4c9df2640 10 monclient: _send_command 3 [{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:06.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.619+0000 7fa4c9df2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:06.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.619+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]} v 0) -- 0x7fa4a4005c50 con 0x7fa4c4135b70 2024-04-25T23:59:06.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4abfff640 1 -- 172.21.15.171:0/2261509117 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}]=0 set item id 14 name 'osd.14' weight 123 at location {host=foobaz,root=default}: no change v109) ==== 218+0+0 (unknown 3186741685 0 0) 0x7fa4b801e1a0 con 0x7fa4c4135b70 2024-04-25T23:59:06.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4abfff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add", "id": 14, "weight": 123.0, "args": ["root=default", "host=foobaz"]}] 2024-04-25T23:59:06.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4abfff640 10 monclient: _finish_command 3 = system:0 set item id 14 name 'osd.14' weight 123 at location {host=foobaz,root=default}: no change 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:set item id 14 name 'osd.14' weight 123 at location {host=foobaz,root=default}: no change 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 >> v1:172.21.15.171:6812/722422047 conn(0x7fa4b0037f80 legacy=0x7fa4b003a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 10 monclient: shutdown 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 >> v1:172.21.15.171:6789/0 conn(0x7fa4c4135b70 legacy=0x7fa4c41cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 shutdown_connections 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 >> 172.21.15.171:0/2261509117 conn(0x7fa4c40a2ee0 msgr2=0x7fa4c41bd7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 shutdown_connections 2024-04-25T23:59:06.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.623+0000 7fa4c9df2640 1 -- 172.21.15.171:0/2261509117 wait complete. 2024-04-25T23:59:06.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: get_monmap_and_config 2024-04-25T23:59:06.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: monmap: 2024-04-25T23:59:06.619 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.619 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:06.626510+0000 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:06.626510+0000 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 Processor -- start 2024-04-25T23:59:06.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- start start 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: init 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: _add_conns ranks=[5,8,7,6,2,4,1,0,3] 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient(hunting): picked mon.noname-h con 0x7efe14071870 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient(hunting): picked mon.noname-e con 0x7efe1409f120 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient(hunting): picked mon.noname-i con 0x7efe1413ad00 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1409f500 con 0x7efe14071870 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1409fe80 con 0x7efe1413ad00 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe140a0160 con 0x7efe1409f120 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient(hunting): authenticate will time out at 1202.153430s 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe0bfff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7efe1409f120 0x7efe141395e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33428/0 (socket says 172.21.15.106:33428) 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe0bfff640 1 -- 172.21.15.106:0/3647264644 learned_addr learned my addr 172.21.15.106:0/3647264644 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3750668967 0 0) 0x7efe140a0160 con 0x7efe1409f120 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): my global_id is 144314 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe00003530 con 0x7efe1409f120 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695909822 0 0) 0x7efe1409f500 con 0x7efe14071870 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient(hunting): my global_id is 5720 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe140a0160 con 0x7efe14071870 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4046797242 0 0) 0x7efe00003530 con 0x7efe1409f120 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 >> v1:172.21.15.171:6792/0 conn(0x7efe1413ad00 legacy=0x7efe1413d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 >> v1:172.21.15.171:6791/0 conn(0x7efe14071870 legacy=0x7efe14071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 monclient: found mon.noname-e 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe140a0440 con 0x7efe1409f120 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdfc001780 con 0x7efe1409f120 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 5 monclient: authenticate success, global_id 144314 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: dump: 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.623 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdfc0019e0 con 0x7efe1409f120 2024-04-25T23:59:06.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 1 -- 172.21.15.106:0/3647264644 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdfc0048b0 con 0x7efe1409f120 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 4 set_mon_vals no callback set 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe11d9b640 10 monclient: dump: 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.625 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: shutdown 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- 172.21.15.106:0/3647264644 >> v1:172.21.15.106:6793/0 conn(0x7efe1409f120 legacy=0x7efe141395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- 172.21.15.106:0/3647264644 shutdown_connections 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- 172.21.15.106:0/3647264644 >> 172.21.15.106:0/3647264644 conn(0x7efe140a36e0 msgr2=0x7efe140a3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- 172.21.15.106:0/3647264644 shutdown_connections 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 1 -- 172.21.15.106:0/3647264644 wait complete. 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.625+0000 7efe18b5f640 10 monclient: monmap: 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.627 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 Processor -- start 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 -- start start 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient: init 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient: _add_conns ranks=[5,4,2,6,8,1,0,7,3] 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient(hunting): picked mon.noname-h con 0x7efe14071870 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient(hunting): picked mon.noname-c con 0x7efe1409f120 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient(hunting): picked mon.noname-b con 0x7efe1413ad00 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1406bbb0 con 0x7efe1413ad00 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1411fbc0 con 0x7efe1409f120 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe1409f780 con 0x7efe14071870 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient(hunting): authenticate will time out at 1202.156618s 2024-04-25T23:59:06.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe12d9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7efe1413ad00 0x7efe141d2d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43696/0 (socket says 172.21.15.106:43696) 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe12d9d640 1 -- 172.21.15.106:0/499979198 learned_addr learned my addr 172.21.15.106:0/499979198 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2804572620 0 0) 0x7efe1411fbc0 con 0x7efe1409f120 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): my global_id is 144310 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf4003530 con 0x7efe1409f120 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3323700504 0 0) 0x7efe1406bbb0 con 0x7efe1413ad00 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): my global_id is 5807 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe1411fbc0 con 0x7efe1413ad00 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230086445 0 0) 0x7efe1409f780 con 0x7efe14071870 2024-04-25T23:59:06.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): my global_id is 5729 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe1406bbb0 con 0x7efe14071870 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4020766849 0 0) 0x7efdf4003530 con 0x7efe1409f120 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe1409f780 con 0x7efe1409f120 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdfc001700 con 0x7efe1409f120 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): dump: 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.630 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2159856490 0 0) 0x7efe1411fbc0 con 0x7efe1413ad00 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdf4003530 con 0x7efe1413ad00 2024-04-25T23:59:06.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe0c001d40 con 0x7efe1413ad00 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): dump: 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.632 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 307102842 0 0) 0x7efe1409f780 con 0x7efe1409f120 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.171:6791/0 conn(0x7efe14071870 legacy=0x7efe14134660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.106:6790/0 conn(0x7efe1413ad00 legacy=0x7efe141d2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 monclient: found mon.c 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe1411f920 con 0x7efe1409f120 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 5 monclient: authenticate success, global_id 144310 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient: _renew_subs 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe14121010 con 0x7efe1409f120 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient: _renew_subs 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7efe141ca7d0 con 0x7efe1409f120 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdfc0019e0 con 0x7efe1409f120 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdfc0048f0 con 0x7efe1409f120 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe1159a640 4 set_mon_vals no callback set 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: dump: 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.635 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efdf80065d0 con 0x7efdf8002870 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7efdfc00fda0 con 0x7efe1409f120 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7efdfc044c10 con 0x7efe1409f120 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe12d9d640 10 monclient: get_auth_request con 0x7efdf4037e40 auth_method 0 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906178205 0 0) 0x7efdf80065d0 con 0x7efdf8002870 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient(hunting): my global_id is 144178 2024-04-25T23:59:06.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe1409f780 con 0x7efdf8002870 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 163366344 0 0) 0x7efe1409f780 con 0x7efdf8002870 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdf80065d0 con 0x7efdf8002870 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe040018f0 con 0x7efdf8002870 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: dump: 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.637 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3451926923 0 0) 0x7efdf80065d0 con 0x7efdf8002870 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdf800a160 con 0x7efdf8002870 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efe04004650 con 0x7efdf8002870 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:06.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:06.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.171:6792/0 conn(0x7efdf8002870 legacy=0x7efdf8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.629+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.171:6792/0 conn(0x7efdf8002870 legacy=0x7efdf8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe18b5f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:06.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efdf8009e50 con 0x7efdf8009110 2024-04-25T23:59:06.640 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:59:06.640 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep osd.12 2024-04-25T23:59:06.640 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 123 2024-04-25T23:59:06.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3501628936 0 0) 0x7efdf8009e50 con 0x7efdf8009110 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient(hunting): my global_id is 144187 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdf80065d0 con 0x7efdf8009110 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4216694674 0 0) 0x7efdf80065d0 con 0x7efdf8009110 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdf8009e50 con 0x7efdf8009110 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe04003c50 con 0x7efdf8009110 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient: dump: 2024-04-25T23:59:06.641 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.642 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2421549295 0 0) 0x7efdf8009e50 con 0x7efdf8009110 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efdf800c3e0 con 0x7efdf8009110 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 2016578013) 0x7efe040048a0 con 0x7efdf8009110 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.171:6792/0 conn(0x7efdf8009110 legacy=0x7efdf80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.637+0000 7efe0affd640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.171:6792/0 conn(0x7efdf8009110 legacy=0x7efdf80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:06.643 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 34, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 10167, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:06.644 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:06.645 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.646 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:06.647 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:06.648 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:06.648 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:06.648 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:06.648 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:06.648 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:06.648 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:06.648 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:06.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.650 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.652 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.654 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.655 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.657 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.658 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.659 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:06.660 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.661 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:06.662 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.171:6812/722422047 conn(0x7efdf4037e40 legacy=0x7efdf403a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 10 monclient: shutdown 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 >> v1:172.21.15.106:6791/0 conn(0x7efe1409f120 legacy=0x7efe141cf630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe12d9d640 1 -- 172.21.15.106:0/499979198 reap_dead start 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe12d9d640 1 -- 172.21.15.106:0/499979198 reap_dead start 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 shutdown_connections 2024-04-25T23:59:06.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 >> 172.21.15.106:0/499979198 conn(0x7efe140a36e0 msgr2=0x7efe140a52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 shutdown_connections 2024-04-25T23:59:06.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.641+0000 7efe18b5f640 1 -- 172.21.15.106:0/499979198 wait complete. 2024-04-25T23:59:06.665 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-25T23:59:06.665 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['e'] 2024-04-25T23:59:06.665 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-25T23:59:06.665 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-04-25T23:59:06.665 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-25T23:59:06.665 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-04-25T23:59:06.666 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T23:59:06.678 INFO:tasks.ceph.mon.e:Stopped 2024-04-25T23:59:06.678 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-04-25T23:59:06.679 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:59:06.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.751+0000 7f6400a96640 10 monclient: get_monmap_and_config 2024-04-25T23:59:06.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.751+0000 7f6400a96640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.751+0000 7f6400a96640 10 monclient: monmap: 2024-04-25T23:59:06.737 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:06.737 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:06.757923+0000 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:06.757923+0000 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.738 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.739 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.739 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:06.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 Processor -- start 2024-04-25T23:59:06.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- start start 2024-04-25T23:59:06.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient: init 2024-04-25T23:59:06.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient: _add_conns ranks=[5,0,7,1,8,3,4,6,2] 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient(hunting): picked mon.noname-h con 0x7f63fc0a38d0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient(hunting): picked mon.noname-a con 0x7f63fc135cb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient(hunting): picked mon.noname-i con 0x7f63fc13c230 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc072bc0 con 0x7f63fc135cb0 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc072ea0 con 0x7f63fc0a38d0 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63fa59c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f63fc0a38d0 0x7f63fc0a1550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45782/0 (socket says 172.21.15.171:45782) 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63fa59c640 1 -- 172.21.15.171:0/3612105403 learned_addr learned my addr 172.21.15.171:0/3612105403 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- 172.21.15.171:0/3612105403 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc073180 con 0x7f63fc13c230 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient(hunting): authenticate will time out at 1197.465804s 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 423535845 0 0) 0x7f63fc072bc0 con 0x7f63fc135cb0 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:06.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient(hunting): my global_id is 5904 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e8003530 con 0x7f63fc135cb0 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3683487779 0 0) 0x7f63e8003530 con 0x7f63fc135cb0 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 >> v1:172.21.15.171:6792/0 conn(0x7f63fc13c230 legacy=0x7f63fc13e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 >> v1:172.21.15.171:6791/0 conn(0x7f63fc0a38d0 legacy=0x7f63fc0a1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 monclient: found mon.noname-a 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63fc0a20e0 con 0x7f63fc135cb0 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: _finish_auth 0 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:06.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63e40016f0 con 0x7f63fc135cb0 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 5 monclient: authenticate success, global_id 5904 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: dump: 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.746 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63e40019e0 con 0x7f63fc135cb0 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 4 set_mon_vals no callback set 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 1 -- 172.21.15.171:0/3612105403 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63e4003960 con 0x7f63fc135cb0 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:06.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f63f959a640 10 monclient: dump: 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:06.748 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient: shutdown 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- 172.21.15.171:0/3612105403 >> v1:172.21.15.106:6789/0 conn(0x7f63fc135cb0 legacy=0x7f63fc13ab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- 172.21.15.171:0/3612105403 shutdown_connections 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- 172.21.15.171:0/3612105403 >> 172.21.15.171:0/3612105403 conn(0x7f63fc06b390 msgr2=0x7f63fc06b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- 172.21.15.171:0/3612105403 shutdown_connections 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 1 -- 172.21.15.171:0/3612105403 wait complete. 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.755+0000 7f6400a96640 10 monclient: monmap: 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:06.749 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.750 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 1 Processor -- start 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 1 -- start start 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient: init 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient: _add_conns ranks=[6,2,5,1,4,8,7,0,3] 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient(hunting): picked mon.noname-d con 0x7f63fc0a38d0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient(hunting): picked mon.noname-b con 0x7f63fc135cb0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient(hunting): picked mon.noname-h con 0x7f63fc13c230 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc09bc40 con 0x7f63fc135cb0 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc09ec30 con 0x7f63fc13c230 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc134fa0 con 0x7f63fc0a38d0 2024-04-25T23:59:06.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f6400a96640 10 monclient(hunting): authenticate will time out at 1197.468728s 2024-04-25T23:59:06.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f63fad9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f63fc13c230 0x7f63fc1d2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45792/0 (socket says 172.21.15.171:45792) 2024-04-25T23:59:06.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:06.759+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 learned_addr learned my addr 172.21.15.171:0/1747652369 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:06.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient: get_monmap_and_config 2024-04-25T23:59:06.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient: build_initial_monmap 2024-04-25T23:59:06.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient: monmap: 2024-04-25T23:59:06.839 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:06.860201+0000 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:06.860201+0000 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:06.840 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:06.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 1 Processor -- start 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 1 -- start start 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient: init 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient: _add_conns ranks=[7,5,1,6,4,2,3,0,8] 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient(hunting): picked mon.noname-i con 0x7f6b1c134820 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient(hunting): picked mon.noname-h con 0x7f6b1c0725d0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient(hunting): picked mon.noname-f con 0x7f6b1c13ace0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c071270 con 0x7f6b1c13ace0 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c0714e0 con 0x7f6b1c0725d0 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c0729f0 con 0x7f6b1c134820 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b2358a640 10 monclient(hunting): authenticate will time out at 1202.387449s 2024-04-25T23:59:06.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b20b25640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6b1c0725d0 0x7f6b1c1395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:59216/0 (socket says 172.21.15.106:59216) 2024-04-25T23:59:06.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:06.857+0000 7f6b20b25640 1 -- 172.21.15.106:0/3125815071 learned_addr learned my addr 172.21.15.106:0/3125815071 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:09.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient(hunting): tick 2024-04-25T23:59:09.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:59:09.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 1 monclient(hunting): continuing hunt 2024-04-25T23:59:09.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6792/0 conn(0x7f63fc0a38d0 legacy=0x7f63fc09da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.171:6791/0 conn(0x7f63fc13c230 legacy=0x7f63fc1d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6790/0 conn(0x7f63fc135cb0 legacy=0x7f63fc1cf7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient: _add_conns ranks=[7,4,8,1,3,0] 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-i con 0x7f63e00037f0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f63e0007440 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-e con 0x7f63e000b1b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63fc09c4e0 con 0x7f63e0007440 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e000ffe0 con 0x7f63e00037f0 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e0011270 con 0x7f63e000b1b0 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63f1ffb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:09.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.759+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000b1b0 legacy=0x7f63e000d670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:09.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient(hunting): tick 2024-04-25T23:59:09.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:59:09.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 1 monclient(hunting): continuing hunt 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 1 -- 172.21.15.106:0/3125815071 >> v1:172.21.15.171:6792/0 conn(0x7f6b1c134820 legacy=0x7f6b1c134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 1 -- 172.21.15.106:0/3125815071 >> v1:172.21.15.171:6791/0 conn(0x7f6b1c0725d0 legacy=0x7f6b1c1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 1 -- 172.21.15.106:0/3125815071 >> v1:172.21.15.171:6789/0 conn(0x7f6b1c13ace0 legacy=0x7f6b1c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient: _add_conns ranks=[0,2,8,6,3,4] 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient(hunting): picked mon.noname-a con 0x7f6b00005a00 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient(hunting): picked mon.noname-b con 0x7f6b00009690 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient(hunting): picked mon.noname-e con 0x7f6b0000d420 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 1 -- 172.21.15.106:0/3125815071 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c0717c0 con 0x7f6b00005a00 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 1 -- 172.21.15.106:0/3125815071 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b000121f0 con 0x7f6b00009690 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 1 -- 172.21.15.106:0/3125815071 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b00013480 con 0x7f6b0000d420 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b12ffd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:09.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.857+0000 7f6b21b27640 1 -- 172.21.15.106:0/3125815071 >> v1:172.21.15.106:6793/0 conn(0x7f6b0000d420 legacy=0x7f6b0000f8c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:09.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931502232 0 0) 0x7f6b1c0717c0 con 0x7f6b00005a00 2024-04-25T23:59:09.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:09.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:09.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:09.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient(hunting): my global_id is 5913 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b08003530 con 0x7f6b00005a00 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1414854436 0 0) 0x7f6b08003530 con 0x7f6b00005a00 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 >> v1:172.21.15.106:6793/0 conn(0x7f6b0000d420 legacy=0x7f6b0000f8c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 >> v1:172.21.15.106:6790/0 conn(0x7f6b00009690 legacy=0x7f6b0000bb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 monclient: found mon.noname-a 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b21b27640 1 -- 172.21.15.106:0/3125815071 reap_dead start 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b00014710 con 0x7f6b00005a00 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:09.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b18001880 con 0x7f6b00005a00 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: dump: 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:09.846 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 5 monclient: authenticate success, global_id 5913 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b18001ad0 con 0x7f6b00005a00 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 1 -- 172.21.15.106:0/3125815071 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b18001d00 con 0x7f6b00005a00 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 4 set_mon_vals no callback set 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:09.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b13fff640 10 monclient: dump: 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:09.848 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 10 monclient: shutdown 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 1 -- 172.21.15.106:0/3125815071 >> v1:172.21.15.106:6789/0 conn(0x7f6b00005a00 legacy=0x7f6b00007e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 1 -- 172.21.15.106:0/3125815071 shutdown_connections 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 1 -- 172.21.15.106:0/3125815071 >> 172.21.15.106:0/3125815071 conn(0x7f6b1c0a64e0 msgr2=0x7f6b1c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 1 -- 172.21.15.106:0/3125815071 shutdown_connections 2024-04-25T23:59:09.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 1 -- 172.21.15.106:0/3125815071 wait complete. 2024-04-25T23:59:09.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 10 monclient: build_initial_monmap 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.861+0000 7f6b2358a640 10 monclient: monmap: 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:09.854 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 Processor -- start 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 -- start start 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: init 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _add_conns ranks=[5,8,0,4,6,3,7,1,2] 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient(hunting): picked mon.noname-h con 0x7f6b00005a00 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient(hunting): picked mon.noname-e con 0x7f6b1c133ce0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient(hunting): picked mon.noname-a con 0x7f6b1c1cc470 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c121a90 con 0x7f6b1c1cc470 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c1205e0 con 0x7f6b00005a00 2024-04-25T23:59:09.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b1c139610 con 0x7f6b1c133ce0 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient(hunting): authenticate will time out at 1205.393000s 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b20b25640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f6b1c133ce0 legacy=0x7f6b1c1d1530 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b21b27640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6b1c1cc470 0x7f6b1c1d4c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39280/0 (socket says 172.21.15.106:39280) 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b21b27640 1 -- 172.21.15.106:0/2768090196 learned_addr learned my addr 172.21.15.106:0/2768090196 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254513303 0 0) 0x7f6b1c121a90 con 0x7f6b1c1cc470 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): my global_id is 5922 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b00007550 con 0x7f6b1c1cc470 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2275871597 0 0) 0x7f6b00007550 con 0x7f6b1c1cc470 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b1c121a90 con 0x7f6b1c1cc470 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b14001c90 con 0x7f6b1c1cc470 2024-04-25T23:59:09.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:09.857 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3080864782 0 0) 0x7f6b1c121a90 con 0x7f6b1c1cc470 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 >> v1:172.21.15.106:6793/0 conn(0x7f6b1c133ce0 legacy=0x7f6b1c1d1530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 >> v1:172.21.15.171:6791/0 conn(0x7f6b00005a00 legacy=0x7f6b1c1335d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 monclient: found mon.a 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b1c1217b0 con 0x7f6b1c1cc470 2024-04-25T23:59:09.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 5 monclient: authenticate success, global_id 5922 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _renew_subs 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6b1c139a70 con 0x7f6b1c1cc470 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _renew_subs 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6b1c1d6550 con 0x7f6b1c1cc470 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6b140020a0 con 0x7f6b1c1cc470 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6b14003f70 con 0x7f6b1c1cc470 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:09.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b137fe640 4 set_mon_vals no callback set 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 10 monclient: dump: 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:09.860 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6b14004110 con 0x7f6b1c1cc470 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6afc005090 con 0x7f6b1c1cc470 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7f6b14045090 con 0x7f6b1c1cc470 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.865+0000 7f6b21326640 10 monclient: get_auth_request con 0x7f6b00038de0 auth_method 0 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.873+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6b14015a20 con 0x7f6b1c1cc470 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.873+0000 7f6b11ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:09.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:09.873+0000 7f6b11ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:09.963+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000b1b0 legacy=0x7f63e000d670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:10.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.085+0000 7f6b2358a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:59:10.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.085+0000 7f6b2358a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:10.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.085+0000 7f6b2358a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:10.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.085+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6afc005380 con 0x7f6b1c1cc470 2024-04-25T23:59:10.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.085+0000 7f6b11ffb640 1 -- 172.21.15.106:0/2768090196 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 3597381148) 0x7f6b14015320 con 0x7f6b1c1cc470 2024-04-25T23:59:10.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.085+0000 7f6b11ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:10.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.085+0000 7f6b11ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:10.068 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":34,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 >> v1:172.21.15.171:6812/722422047 conn(0x7f6b00038de0 legacy=0x7f6b0003b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 10 monclient: shutdown 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 >> v1:172.21.15.106:6789/0 conn(0x7f6b1c1cc470 legacy=0x7f6b1c1d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 shutdown_connections 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 >> 172.21.15.106:0/2768090196 conn(0x7f6b1c0a64e0 msgr2=0x7f6b1c0a1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 shutdown_connections 2024-04-25T23:59:10.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:10.089+0000 7f6b2358a640 1 -- 172.21.15.106:0/2768090196 wait complete. 2024-04-25T23:59:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:10.367+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000b1b0 legacy=0x7f63e000d670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:11.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:11.171+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000b1b0 legacy=0x7f63e000d670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient(hunting): tick 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 1 monclient(hunting): continuing hunt 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000b1b0 legacy=0x7f63e000d670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.171:6792/0 conn(0x7f63e00037f0 legacy=0x7f63e0005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6791/0 conn(0x7f63e0007440 legacy=0x7f63e00098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 reap_dead start 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 reap_dead start 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient: _add_conns ranks=[3,1,0] 2024-04-25T23:59:12.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-g con 0x7f63e000f0a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:12.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-f con 0x7f63e000f560 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:12.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-a con 0x7f63e0007910 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:12.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e0012560 con 0x7f63e0007910 2024-04-25T23:59:12.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e0011270 con 0x7f63e000f560 2024-04-25T23:59:12.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e000fb60 con 0x7f63e000f0a0 2024-04-25T23:59:12.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:12.759+0000 7f63f1ffb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:13.085 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient: get_monmap_and_config 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient: build_initial_monmap 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient: monmap: 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:13.235634+0000 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:13.235634+0000 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:13.215 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:13.216 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:13.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 1 Processor -- start 2024-04-25T23:59:13.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 1 -- start start 2024-04-25T23:59:13.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient: init 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient: _add_conns ranks=[0,8,6,1,2,4,3,7,5] 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient(hunting): picked mon.noname-a con 0x7ff734134820 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient(hunting): picked mon.noname-e con 0x7ff7340725d0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient(hunting): picked mon.noname-d con 0x7ff73413ace0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff734071270 con 0x7ff734134820 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7340714e0 con 0x7ff73413ace0 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7340729f0 con 0x7ff7340725d0 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff73b751640 10 monclient(hunting): authenticate will time out at 1208.762730s 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff738cec640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff7340725d0 legacy=0x7ff7341395c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff739cee640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff73413ace0 0x7ff73413d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39796/0 (socket says 172.21.15.106:39796) 2024-04-25T23:59:13.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff7394ed640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff734134820 0x7ff734134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:39288/0 (socket says 172.21.15.106:39288) 2024-04-25T23:59:13.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.233+0000 7ff739cee640 1 -- 172.21.15.106:0/249372398 learned_addr learned my addr 172.21.15.106:0/249372398 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:13.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.437+0000 7ff738cec640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6793/0 conn(0x7ff7340725d0 legacy=0x7ff7341395c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:13.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:13.841+0000 7ff738cec640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6793/0 conn(0x7ff7340725d0 legacy=0x7ff7341395c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:14.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:14.645+0000 7ff738cec640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6793/0 conn(0x7ff7340725d0 legacy=0x7ff7341395c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:15.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient(hunting): tick 2024-04-25T23:59:15.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:59:15.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 1 monclient(hunting): continuing hunt 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.171:6790/0 conn(0x7f63e000f0a0 legacy=0x7f63e000d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.171:6789/0 conn(0x7f63e000f560 legacy=0x7f63e0011440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6789/0 conn(0x7f63e0007910 legacy=0x7f63e0011b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient: _add_conns ranks=[2,4,8,5,1,3,6,7,0] 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f63e0005c20 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f63e000a7c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-e con 0x7f63e000aba0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e0009d40 con 0x7f63e0005c20 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e001d720 con 0x7f63e000a7c0 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e001e900 con 0x7f63e000aba0 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000aba0 legacy=0x7f63e001aff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:15.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.759+0000 7f63f1ffb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:15.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:15.963+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000aba0 legacy=0x7f63e001aff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:16.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient(hunting): tick 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 1 monclient(hunting): continuing hunt 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6793/0 conn(0x7ff7340725d0 legacy=0x7ff7341395c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6792/0 conn(0x7ff73413ace0 legacy=0x7ff73413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6789/0 conn(0x7ff734134820 legacy=0x7ff734134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient: _add_conns ranks=[7,1,2,4,5,3] 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient(hunting): picked mon.noname-i con 0x7ff7180037c0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient(hunting): picked mon.noname-f con 0x7ff718007450 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient(hunting): picked mon.noname-b con 0x7ff71800b1e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:16.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7340717c0 con 0x7ff718007450 2024-04-25T23:59:16.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7340729f0 con 0x7ff71800b1e0 2024-04-25T23:59:16.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff718011030 con 0x7ff7180037c0 2024-04-25T23:59:16.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:16.233+0000 7ff72affd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:16.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:16.367+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000aba0 legacy=0x7f63e001aff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:17.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:17.171+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000aba0 legacy=0x7f63e001aff0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient(hunting): tick 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 1 monclient(hunting): continuing hunt 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6793/0 conn(0x7f63e000aba0 legacy=0x7f63e001aff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6791/0 conn(0x7f63e000a7c0 legacy=0x7f63e00178c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6790/0 conn(0x7f63e0005c20 legacy=0x7f63e000a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63fad9d640 1 -- 172.21.15.171:0/1747652369 reap_dead start 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient: _add_conns ranks=[5,3,6,0,7,1] 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-h con 0x7f63e0007910 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-g con 0x7f63e000a0b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient(hunting): picked mon.noname-d con 0x7f63e001da60 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e001fb20 con 0x7f63e000a0b0 2024-04-25T23:59:18.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e001e900 con 0x7f63e0007910 2024-04-25T23:59:18.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63e000a5d0 con 0x7f63e001da60 2024-04-25T23:59:18.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:18.759+0000 7f63f1ffb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient(hunting): tick 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient(hunting): _check_auth_tickets 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 1 monclient(hunting): continuing hunt 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient(hunting): _reopen_session rank -1 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.171:6792/0 conn(0x7ff7180037c0 legacy=0x7ff718005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6790/0 conn(0x7ff71800b1e0 legacy=0x7ff71800d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.171:6789/0 conn(0x7ff718007450 legacy=0x7ff718009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient: _add_conns ranks=[3,5,4] 2024-04-25T23:59:19.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff739cee640 1 -- 172.21.15.106:0/249372398 reap_dead start 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient(hunting): picked mon.noname-g con 0x7ff7180113c0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient(hunting): picked mon.noname-h con 0x7ff7180063e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient(hunting): picked mon.noname-c con 0x7ff718006860 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff739cee640 1 -- 172.21.15.106:0/249372398 reap_dead start 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7180122c0 con 0x7ff7180113c0 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff718006d50 con 0x7ff718006860 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff718006fb0 con 0x7ff7180063e0 2024-04-25T23:59:19.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:19.233+0000 7ff72affd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3642999235 0 0) 0x7ff7180122c0 con 0x7ff7180113c0 2024-04-25T23:59:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): my global_id is 6051 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff720003530 con 0x7ff7180113c0 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418471431 0 0) 0x7ff718006fb0 con 0x7ff7180063e0 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient(hunting): my global_id is 5747 2024-04-25T23:59:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7180122c0 con 0x7ff7180063e0 2024-04-25T23:59:21.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072703493 0 0) 0x7f63e001fb20 con 0x7f63e000a0b0 2024-04-25T23:59:21.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): my global_id is 6042 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63dc003530 con 0x7f63e000a0b0 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2901784860 0 0) 0x7f63e001e900 con 0x7f63e0007910 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): my global_id is 5738 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63e001fb20 con 0x7f63e0007910 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3558658888 0 0) 0x7f63dc003530 con 0x7f63e000a0b0 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63e001e900 con 0x7f63e000a0b0 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63e4003a00 con 0x7f63e000a0b0 2024-04-25T23:59:21.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.537 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2827390124 0 0) 0x7f63e001fb20 con 0x7f63e0007910 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63dc003530 con 0x7f63e0007910 2024-04-25T23:59:21.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63ec001c10 con 0x7f63e0007910 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.539 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1689707442 0 0) 0x7f63e001e900 con 0x7f63e000a0b0 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.106:6792/0 conn(0x7f63e001da60 legacy=0x7f63e001de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.171:6791/0 conn(0x7f63e0007910 legacy=0x7f63e0011440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 monclient: found mon.g 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e001e550 con 0x7f63e000a0b0 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f63f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f6400a96640 5 monclient: authenticate success, global_id 6042 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f6400a96640 10 monclient: _renew_subs 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f6400a96640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:21.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63fc09af70 con 0x7f63e000a0b0 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f6400a96640 10 monclient: _renew_subs 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f6400a96640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.543+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f63fc1ca8c0 con 0x7f63e000a0b0 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63e4001740 con 0x7f63e000a0b0 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63e4001170 con 0x7f63e000a0b0 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f8d99640 4 set_mon_vals no callback set 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 10 monclient: dump: 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f6400a96640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f6400a96640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f6400a96640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63d4005090 con 0x7f63e000a0b0 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f63e400ebb0 con 0x7f63e000a0b0 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7f63e4043820 con 0x7f63e000a0b0 2024-04-25T23:59:21.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.547+0000 7f63fa59c640 10 monclient: get_auth_request con 0x7f63dc03c140 auth_method 0 2024-04-25T23:59:21.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.551+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f63fc09bc40 con 0x7f63e000a0b0 2024-04-25T23:59:21.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.551+0000 7f63f2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.551+0000 7f63f2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3946764179 0 0) 0x7ff720003530 con 0x7ff7180113c0 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.171:6791/0 conn(0x7ff7180063e0 legacy=0x7ff718005c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.106:6791/0 conn(0x7ff718006860 legacy=0x7ff718009910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 1 monclient: found mon.noname-g 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.545+0000 7ff72bfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff718007210 con 0x7ff7180113c0 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: _finish_auth 0 2024-04-25T23:59:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff730001700 con 0x7ff7180113c0 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: dump: 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 5 monclient: authenticate success, global_id 6051 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff730001960 con 0x7ff7180113c0 2024-04-25T23:59:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 1 -- 172.21.15.106:0/249372398 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff730004b30 con 0x7ff7180113c0 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 4 set_mon_vals no callback set 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff72bfff640 10 monclient: dump: 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 10 monclient: shutdown 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 1 -- 172.21.15.106:0/249372398 >> v1:172.21.15.171:6790/0 conn(0x7ff7180113c0 legacy=0x7ff7180117a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 1 -- 172.21.15.106:0/249372398 shutdown_connections 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 1 -- 172.21.15.106:0/249372398 >> 172.21.15.106:0/249372398 conn(0x7ff7340a64e0 msgr2=0x7ff7340a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 1 -- 172.21.15.106:0/249372398 shutdown_connections 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 1 -- 172.21.15.106:0/249372398 wait complete. 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 10 monclient: build_initial_monmap 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 10 monclient: monmap: 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 1 Processor -- start 2024-04-25T23:59:21.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 1 -- start start 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.549+0000 7ff73b751640 10 monclient: init 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _add_conns ranks=[3,2,6,8,0,7,5,1,4] 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient(hunting): picked mon.noname-g con 0x7ff7180063e0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient(hunting): picked mon.noname-b con 0x7ff718006860 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient(hunting): picked mon.noname-d con 0x7ff7180113c0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff734139bf0 con 0x7ff718006860 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff734133820 con 0x7ff7180063e0 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff734072c60 con 0x7ff7180113c0 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient(hunting): authenticate will time out at 1217.080798s 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff738cec640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7ff718006860 0x7ff7341cd250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39192/0 (socket says 172.21.15.106:39192) 2024-04-25T23:59:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff739cee640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff7180113c0 0x7ff7341d0980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:37058/0 (socket says 172.21.15.106:37058) 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff738cec640 1 -- 172.21.15.106:0/78470594 learned_addr learned my addr 172.21.15.106:0/78470594 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072097074 0 0) 0x7ff734139bf0 con 0x7ff718006860 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): my global_id is 5816 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff718006fb0 con 0x7ff718006860 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3313915975 0 0) 0x7ff718006fb0 con 0x7ff718006860 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff734139bf0 con 0x7ff718006860 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff7240044a0 con 0x7ff718006860 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:21.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2014865662 0 0) 0x7ff734139bf0 con 0x7ff718006860 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 >> v1:172.21.15.106:6792/0 conn(0x7ff7180113c0 legacy=0x7ff7341d0980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 >> v1:172.21.15.171:6790/0 conn(0x7ff7180063e0 legacy=0x7ff734133110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 monclient: found mon.b 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff73411d7c0 con 0x7ff718006860 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 5 monclient: authenticate success, global_id 5816 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _renew_subs 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff73411c310 con 0x7ff718006860 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _renew_subs 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff734138040 con 0x7ff718006860 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff7240048f0 con 0x7ff718006860 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff724004de0 con 0x7ff718006860 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff72b7fe640 4 set_mon_vals no callback set 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 10 monclient: dump: 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff724005040 con 0x7ff718006860 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff714005090 con 0x7ff718006860 2024-04-25T23:59:21.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7ff724044ee0 con 0x7ff718006860 2024-04-25T23:59:21.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.553+0000 7ff7394ed640 10 monclient: get_auth_request con 0x7ff71803c050 auth_method 0 2024-04-25T23:59:21.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.561+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff724015870 con 0x7ff718006860 2024-04-25T23:59:21.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.561+0000 7ff729ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.561+0000 7ff729ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:21.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.735+0000 7f6400a96640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:21.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.735+0000 7f6400a96640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:21.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.735+0000 7f6400a96640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:21.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.735+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f63d4004fc0 con 0x7f63e000a0b0 2024-04-25T23:59:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.735+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v109) ==== 56+0+1449 (unknown 487677150 0 1618612635) 0x7f63e40144d0 con 0x7f63e000a0b0 2024-04-25T23:59:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.735+0000 7f63f2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.735+0000 7f63f2ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:21.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.759+0000 7f63f1ffb640 10 monclient: tick 2024-04-25T23:59:21.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.759+0000 7f63f1ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.759+0000 7f63f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.759+0000 7f63f1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.785+0000 7ff73b751640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-25T23:59:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.785+0000 7ff73b751640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.785+0000 7ff73b751640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.785+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7ff714005380 con 0x7ff718006860 2024-04-25T23:59:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.785+0000 7ff729ffb640 1 -- 172.21.15.106:0/78470594 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2738 (unknown 254746657 0 3618241949) 0x7ff724015170 con 0x7ff718006860 2024-04-25T23:59:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff729ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-25T23:59:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff729ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:21.770 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":38,"quorum":[0,1,2,3,4,5,6,7],"quorum_names":["a","f","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-25T23:59:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 >> v1:172.21.15.171:6812/722422047 conn(0x7ff71803c050 legacy=0x7ff71803e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 10 monclient: shutdown 2024-04-25T23:59:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 >> v1:172.21.15.106:6790/0 conn(0x7ff718006860 legacy=0x7ff7341cd250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 shutdown_connections 2024-04-25T23:59:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 >> 172.21.15.106:0/78470594 conn(0x7ff7340a64e0 msgr2=0x7ff7340a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 shutdown_connections 2024-04-25T23:59:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.789+0000 7ff73b751640 1 -- 172.21.15.106:0/78470594 wait complete. 2024-04-25T23:59:21.787 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-04-25T23:59:21.788 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-04-25T23:59:21.788 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-25T23:59:21.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.831+0000 7f6400a96640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:21.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.831+0000 7f6400a96640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:21.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.831+0000 7f6400a96640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:21.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.831+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7f63d4004fa0 con 0x7f63e000a0b0 2024-04-25T23:59:21.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.831+0000 7f63f2ffd640 1 -- 172.21.15.171:0/1747652369 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v109) ==== 56+0+1449 (unknown 487677150 0 1618612635) 0x7f63e4013dd0 con 0x7f63e000a0b0 2024-04-25T23:59:21.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.831+0000 7f63f2ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:21.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.831+0000 7f63f2ffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.171:6812/722422047 conn(0x7f63dc03c140 legacy=0x7f63dc03e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 10 monclient: shutdown 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 >> v1:172.21.15.171:6790/0 conn(0x7f63e000a0b0 legacy=0x7f63e0011b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 shutdown_connections 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 >> 172.21.15.171:0/1747652369 conn(0x7f63fc06b390 msgr2=0x7f63fc131fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 shutdown_connections 2024-04-25T23:59:21.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.835+0000 7f6400a96640 1 -- 172.21.15.171:0/1747652369 wait complete. 2024-04-25T23:59:21.834 INFO:tasks.workunit.client.0.smithi171.stdout: 12 123.00000 osd.12 down 1.00000 1.00000 2024-04-25T23:59:21.835 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:59:21.835 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep osd.14 2024-04-25T23:59:21.835 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 123 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.925+0000 7feadf3fb640 10 monclient: get_monmap_and_config 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.925+0000 7feadf3fb640 10 monclient: build_initial_monmap 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.925+0000 7feadf3fb640 10 monclient: monmap: 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:21.930205+0000 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:21.930205+0000 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:21.909 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:21.910 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 Processor -- start 2024-04-25T23:59:21.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- start start 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient: init 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient: _add_conns ranks=[6,3,8,0,2,5,4,7,1] 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient(hunting): picked mon.noname-d con 0x7fead8071080 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient(hunting): picked mon.noname-g con 0x7fead8072750 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient(hunting): picked mon.noname-e con 0x7fead8072b70 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead806e240 con 0x7fead8072750 2024-04-25T23:59:21.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead80705a0 con 0x7fead8071080 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead8070880 con 0x7fead8072b70 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient(hunting): authenticate will time out at 1217.457605s 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadd998640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fead8072b70 legacy=0x7fead8140010 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadd197640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fead8071080 0x7fead8137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:37062/0 (socket says 172.21.15.106:37062) 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadd197640 1 -- 172.21.15.106:0/1169100983 learned_addr learned my addr 172.21.15.106:0/1169100983 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3566622990 0 0) 0x7fead80705a0 con 0x7fead8071080 2024-04-25T23:59:21.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): my global_id is 5865 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feac4003530 con 0x7fead8071080 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528675701 0 0) 0x7fead806e240 con 0x7fead8072750 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient(hunting): my global_id is 6060 2024-04-25T23:59:21.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead80705a0 con 0x7fead8072750 2024-04-25T23:59:21.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 733266100 0 0) 0x7feac4003530 con 0x7fead8071080 2024-04-25T23:59:21.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 >> v1:172.21.15.106:6793/0 conn(0x7fead8072b70 legacy=0x7fead8140010 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:21.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 >> v1:172.21.15.171:6790/0 conn(0x7fead8072750 legacy=0x7fead813c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:21.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 monclient: found mon.noname-d 2024-04-25T23:59:21.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:21.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead806cee0 con 0x7fead8071080 2024-04-25T23:59:21.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: _finish_auth 0 2024-04-25T23:59:21.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fead40017c0 con 0x7fead8071080 2024-04-25T23:59:21.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 5 monclient: authenticate success, global_id 5865 2024-04-25T23:59:21.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:21.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:21.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: dump: 2024-04-25T23:59:21.925 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.925 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.925 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.925 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.925 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.925 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.925 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.926 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.927 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:21.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fead4001a70 con 0x7fead8071080 2024-04-25T23:59:21.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:21.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:21.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 4 set_mon_vals no callback set 2024-04-25T23:59:21.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 1 -- 172.21.15.106:0/1169100983 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fead4004bf0 con 0x7fead8071080 2024-04-25T23:59:21.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:21.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feacffff640 10 monclient: dump: 2024-04-25T23:59:21.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.929 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.929 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.929 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.929 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.929 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.929 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient: shutdown 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- 172.21.15.106:0/1169100983 >> v1:172.21.15.106:6792/0 conn(0x7fead8071080 legacy=0x7fead8137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- 172.21.15.106:0/1169100983 shutdown_connections 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- 172.21.15.106:0/1169100983 >> 172.21.15.106:0/1169100983 conn(0x7fead80a8370 msgr2=0x7fead80a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- 172.21.15.106:0/1169100983 shutdown_connections 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 1 -- 172.21.15.106:0/1169100983 wait complete. 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient: build_initial_monmap 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.929+0000 7feadf3fb640 10 monclient: monmap: 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:21.931 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 Processor -- start 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 -- start start 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient: init 2024-04-25T23:59:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient: _add_conns ranks=[7,6,4,0,5,8,3,2,1] 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient(hunting): picked mon.noname-i con 0x7fead8071080 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient(hunting): picked mon.noname-d con 0x7fead8072750 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient(hunting): picked mon.noname-c con 0x7fead8072b70 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead813ee50 con 0x7fead8072b70 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead81cd8f0 con 0x7fead8072750 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead806d930 con 0x7fead8071080 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient(hunting): authenticate will time out at 1217.460608s 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadc996640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fead8072750 0x7fead81cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:37070/0 (socket says 172.21.15.106:37070) 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadc996640 1 -- 172.21.15.106:0/247767815 learned_addr learned my addr 172.21.15.106:0/247767815 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192600020 0 0) 0x7fead81cd8f0 con 0x7fead8072750 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): my global_id is 5874 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feabc003530 con 0x7fead8072750 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3310397821 0 0) 0x7fead813ee50 con 0x7fead8072b70 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): my global_id is 144319 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead81cd8f0 con 0x7fead8072b70 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134906399 0 0) 0x7fead806d930 con 0x7fead8071080 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): my global_id is 144196 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead813ee50 con 0x7fead8071080 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2731472985 0 0) 0x7fead81cd8f0 con 0x7fead8072b70 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fead806d930 con 0x7fead8072b70 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2917732325 0 0) 0x7feabc003530 con 0x7fead8072750 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fead81cd8f0 con 0x7fead8072750 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fead00044e0 con 0x7fead8072b70 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): dump: 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.935 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:21.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feac8001a40 con 0x7fead8072750 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): dump: 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.937 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 774666939 0 0) 0x7fead806d930 con 0x7fead8072b70 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.171:6792/0 conn(0x7fead8071080 legacy=0x7fead81ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.106:6792/0 conn(0x7fead8072750 legacy=0x7fead81cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:21.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 monclient: found mon.c 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead806d450 con 0x7fead8072b70 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 5 monclient: authenticate success, global_id 144319 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient: _renew_subs 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fead813cb60 con 0x7fead8072b70 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient: _renew_subs 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fead813f600 con 0x7fead8072b70 2024-04-25T23:59:21.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fead0004780 con 0x7fead8072b70 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fead0004cf0 con 0x7fead8072b70 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacf7fe640 4 set_mon_vals no callback set 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: dump: 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.940 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feab80065d0 con 0x7feab8002870 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fead0004e90 con 0x7fead8072b70 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7fead0044ef0 con 0x7fead8072b70 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628103964 0 0) 0x7feab80065d0 con 0x7feab8002870 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient(hunting): my global_id is 5931 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fead806d930 con 0x7feab8002870 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3131344872 0 0) 0x7fead806d930 con 0x7feab8002870 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feab80065d0 con 0x7feab8002870 2024-04-25T23:59:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fead4001780 con 0x7feab8002870 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feadc996640 10 monclient: get_auth_request con 0x7feabc037f00 auth_method 0 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: dump: 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4227621473 0 0) 0x7feab80065d0 con 0x7feab8002870 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feab800a160 con 0x7feab8002870 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fead4001780 con 0x7feab8002870 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.106:6789/0 conn(0x7feab8002870 legacy=0x7feab8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.933+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.106:6789/0 conn(0x7feab8002870 legacy=0x7feab8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7feab8009e50 con 0x7feab8009110 2024-04-25T23:59:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407190255 0 0) 0x7feab8009e50 con 0x7feab8009110 2024-04-25T23:59:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient(hunting): my global_id is 5940 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab80065d0 con 0x7feab8009110 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 510626777 0 0) 0x7feab80065d0 con 0x7feab8009110 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feab8009e50 con 0x7feab8009110 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fead4005000 con 0x7feab8009110 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient: dump: 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.948 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2381929445 0 0) 0x7feab8009e50 con 0x7feab8009110 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7feab800c3e0 con 0x7feab8009110 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7556 (unknown 0 0 4027210021) 0x7fead40064f0 con 0x7feab8009110 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.106:6789/0 conn(0x7feab8009110 legacy=0x7feab80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feacdffb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.106:6789/0 conn(0x7feab8009110 legacy=0x7feab80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:21.949 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 280500, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:21.950 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:21.951 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:21.952 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:21.953 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:21.954 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:21.956 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.957 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.958 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:21.959 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:21.960 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.961 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.962 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.963 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.965 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.966 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:21.969 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.171:6812/722422047 conn(0x7feabc037f00 legacy=0x7feabc03a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 10 monclient: shutdown 2024-04-25T23:59:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 >> v1:172.21.15.106:6791/0 conn(0x7fead8072b70 legacy=0x7fead81d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadd998640 1 -- 172.21.15.106:0/247767815 reap_dead start 2024-04-25T23:59:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadd998640 1 -- 172.21.15.106:0/247767815 reap_dead start 2024-04-25T23:59:21.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 shutdown_connections 2024-04-25T23:59:21.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 >> 172.21.15.106:0/247767815 conn(0x7fead80a8370 msgr2=0x7fead81409d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:21.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 shutdown_connections 2024-04-25T23:59:21.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:21.941+0000 7feadf3fb640 1 -- 172.21.15.106:0/247767815 wait complete. 2024-04-25T23:59:21.971 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:21.971 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-04-25T23:59:21.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-25T23:59:21.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.963+0000 7ff1cc012640 10 monclient: get_monmap_and_config 2024-04-25T23:59:21.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.963+0000 7ff1cc012640 10 monclient: build_initial_monmap 2024-04-25T23:59:21.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.963+0000 7ff1cc012640 10 monclient: monmap: 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:21.970306+0000 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:21.970306+0000 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:21.981 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 Processor -- start 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- start start 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient: init 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient: _add_conns ranks=[8,6,0,7,3,5,2,1,4] 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient(hunting): picked mon.noname-e con 0x7ff1c409bb70 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient(hunting): picked mon.noname-d con 0x7ff1c40a1a40 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient(hunting): picked mon.noname-a con 0x7ff1c409c660 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c40a2000 con 0x7ff1c409c660 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c409e220 con 0x7ff1c40a1a40 2024-04-25T23:59:21.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c409f580 con 0x7ff1c409bb70 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient(hunting): authenticate will time out at 1212.677361s 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c9dae640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7ff1c409bb70 legacy=0x7ff1c409bf50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1ca5af640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff1c409c660 0x7ff1c413d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:57794/0 (socket says 172.21.15.171:57794) 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c95ad640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff1c40a1a40 0x7ff1c4139b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:45032/0 (socket says 172.21.15.171:45032) 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1ca5af640 1 -- 172.21.15.171:0/1989935115 learned_addr learned my addr 172.21.15.171:0/1989935115 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3344432086 0 0) 0x7ff1c409e220 con 0x7ff1c40a1a40 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): my global_id is 5883 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1b0003530 con 0x7ff1c40a1a40 2024-04-25T23:59:21.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047470208 0 0) 0x7ff1c40a2000 con 0x7ff1c409c660 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient(hunting): my global_id is 5949 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c409e220 con 0x7ff1c409c660 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3695873270 0 0) 0x7ff1b0003530 con 0x7ff1c40a1a40 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 >> v1:172.21.15.106:6793/0 conn(0x7ff1c409bb70 legacy=0x7ff1c409bf50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 >> v1:172.21.15.106:6789/0 conn(0x7ff1c409c660 legacy=0x7ff1c413d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: _finish_hunting 0 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 monclient: found mon.noname-d 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c409d310 con 0x7ff1c40a1a40 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: _finish_auth 0 2024-04-25T23:59:21.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 5 monclient: authenticate success, global_id 5883 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff1b40017c0 con 0x7ff1c40a1a40 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: dump: 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.985 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1b4001a60 con 0x7ff1c40a1a40 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:21.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 4 set_mon_vals no callback set 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 1 -- 172.21.15.171:0/1989935115 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff1b4004b30 con 0x7ff1c40a1a40 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1c8dac640 10 monclient: dump: 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.987 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient: shutdown 2024-04-25T23:59:21.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- 172.21.15.171:0/1989935115 >> v1:172.21.15.106:6792/0 conn(0x7ff1c40a1a40 legacy=0x7ff1c4139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- 172.21.15.171:0/1989935115 shutdown_connections 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- 172.21.15.171:0/1989935115 >> 172.21.15.171:0/1989935115 conn(0x7ff1c40a28a0 msgr2=0x7ff1c40a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- 172.21.15.171:0/1989935115 shutdown_connections 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 -- 172.21.15.171:0/1989935115 wait complete. 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient: build_initial_monmap 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 10 monclient: monmap: 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:21.989 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.967+0000 7ff1cc012640 1 Processor -- start 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 1 -- start start 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: init 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _add_conns ranks=[5,6,7,3,2,4,0,8,1] 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient(hunting): picked mon.noname-h con 0x7ff1c409bb70 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient(hunting): picked mon.noname-d con 0x7ff1c409c660 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient(hunting): picked mon.noname-i con 0x7ff1c40a1a40 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c40a2d60 con 0x7ff1c409bb70 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c406f780 con 0x7ff1c409c660 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff1c406fa60 con 0x7ff1c40a1a40 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient(hunting): authenticate will time out at 1212.680518s 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1c9dae640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7ff1c409bb70 0x7ff1c413b870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50250/0 (socket says 172.21.15.171:50250) 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ca5af640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7ff1c40a1a40 0x7ff1c41d4940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52766/0 (socket says 172.21.15.171:52766) 2024-04-25T23:59:21.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1c9dae640 1 -- 172.21.15.171:0/2540802937 learned_addr learned my addr 172.21.15.171:0/2540802937 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4187280839 0 0) 0x7ff1c40a2d60 con 0x7ff1c409bb70 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): my global_id is 5756 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1a8003530 con 0x7ff1c409bb70 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359005603 0 0) 0x7ff1c406fa60 con 0x7ff1c40a1a40 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): my global_id is 144205 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c40a2d60 con 0x7ff1c40a1a40 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 591295680 0 0) 0x7ff1c406f780 con 0x7ff1c409c660 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:21.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): my global_id is 5892 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff1c406fa60 con 0x7ff1c409c660 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 122518999 0 0) 0x7ff1a8003530 con 0x7ff1c409bb70 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1c406f780 con 0x7ff1c409bb70 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff1c0004380 con 0x7ff1c409bb70 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.993 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3590981007 0 0) 0x7ff1c40a2d60 con 0x7ff1c40a1a40 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1a8003530 con 0x7ff1c40a1a40 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff1bc0018a0 con 0x7ff1c40a1a40 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.995 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 260253307 0 0) 0x7ff1c406fa60 con 0x7ff1c409c660 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff1c40a2d60 con 0x7ff1c409c660 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff1b4001780 con 0x7ff1c409c660 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:21.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:21.997 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3737339322 0 0) 0x7ff1c406f780 con 0x7ff1c409bb70 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 >> v1:172.21.15.171:6792/0 conn(0x7ff1c40a1a40 legacy=0x7ff1c41d4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 >> v1:172.21.15.106:6792/0 conn(0x7ff1c409c660 legacy=0x7ff1c413bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 monclient: found mon.h 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:21.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1c409fbe0 con 0x7ff1c409bb70 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 5 monclient: authenticate success, global_id 5756 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _renew_subs 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff1c409dd30 con 0x7ff1c409bb70 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _renew_subs 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff1c413d2b0 con 0x7ff1c409bb70 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff1c0004630 con 0x7ff1c409bb70 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff1c0004ba0 con 0x7ff1c409bb70 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1bbfff640 4 set_mon_vals no callback set 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 10 monclient: dump: 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff1ac005090 con 0x7ff1c409bb70 2024-04-25T23:59:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff1c0004e00 con 0x7ff1c409bb70 2024-04-25T23:59:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7ff1c0044d30 con 0x7ff1c409bb70 2024-04-25T23:59:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.971+0000 7ff1c95ad640 10 monclient: get_auth_request con 0x7ff1a8038160 auth_method 0 2024-04-25T23:59:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.975+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff1c00158d0 con 0x7ff1c409bb70 2024-04-25T23:59:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.975+0000 7ff1ba7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:21.975+0000 7ff1ba7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient: get_monmap_and_config 2024-04-25T23:59:22.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient: monmap: 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:22.104558+0000 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:22.104558+0000 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.084 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.085 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.085 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.085 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 1 Processor -- start 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 1 -- start start 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient: init 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient: _add_conns ranks=[1,8,4,6,0,2,5,3,7] 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient(hunting): picked mon.noname-f con 0x7fc23c135870 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient(hunting): picked mon.noname-e con 0x7fc23c1353b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient(hunting): picked mon.noname-c con 0x7fc23c13bdf0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c06f2d0 con 0x7fc23c135870 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c072330 con 0x7fc23c13bdf0 2024-04-25T23:59:22.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c072610 con 0x7fc23c1353b0 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc244137640 10 monclient(hunting): authenticate will time out at 1217.631642s 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc2416d2640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fc23c1353b0 legacy=0x7fc23c13a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc2426d4640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fc23c13bdf0 0x7fc23c13e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:51338/0 (socket says 172.21.15.106:51338) 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.101+0000 7fc2426d4640 1 -- 172.21.15.106:0/2901054937 learned_addr learned my addr 172.21.15.106:0/2901054937 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743553247 0 0) 0x7fc23c072330 con 0x7fc23c13bdf0 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient(hunting): my global_id is 144328 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc224003530 con 0x7fc23c13bdf0 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2839506737 0 0) 0x7fc224003530 con 0x7fc23c13bdf0 2024-04-25T23:59:22.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 >> v1:172.21.15.106:6793/0 conn(0x7fc23c1353b0 legacy=0x7fc23c13a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 >> v1:172.21.15.171:6789/0 conn(0x7fc23c135870 legacy=0x7fc23c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 monclient: found mon.noname-c 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c0a3260 con 0x7fc23c13bdf0 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc22c0017c0 con 0x7fc23c13bdf0 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: dump: 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.097 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 5 monclient: authenticate success, global_id 144328 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc22c001b20 con 0x7fc23c13bdf0 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 1 -- 172.21.15.106:0/2901054937 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc22c001d50 con 0x7fc23c13bdf0 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 4 set_mon_vals no callback set 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc240ed1640 10 monclient: dump: 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: shutdown 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- 172.21.15.106:0/2901054937 >> v1:172.21.15.106:6791/0 conn(0x7fc23c13bdf0 legacy=0x7fc23c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- 172.21.15.106:0/2901054937 shutdown_connections 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- 172.21.15.106:0/2901054937 >> 172.21.15.106:0/2901054937 conn(0x7fc23c0a64e0 msgr2=0x7fc23c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- 172.21.15.106:0/2901054937 shutdown_connections 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- 172.21.15.106:0/2901054937 wait complete. 2024-04-25T23:59:22.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: monmap: 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.102 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 Processor -- start 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- start start 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: init 2024-04-25T23:59:22.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: _add_conns ranks=[4,0,6,5,8,3,1,7,2] 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient(hunting): picked mon.noname-c con 0x7fc23c1353b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient(hunting): picked mon.noname-a con 0x7fc23c135870 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient(hunting): picked mon.noname-d con 0x7fc23c13bdf0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c070310 con 0x7fc23c135870 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c09f930 con 0x7fc23c1353b0 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc23c09f470 con 0x7fc23c13bdf0 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient(hunting): authenticate will time out at 1217.634804s 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc241ed3640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fc23c1353b0 0x7fc23c06f4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:51344/0 (socket says 172.21.15.106:51344) 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc241ed3640 1 -- 172.21.15.106:0/92979586 learned_addr learned my addr 172.21.15.106:0/92979586 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3947144460 0 0) 0x7fc23c09f930 con 0x7fc23c1353b0 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): my global_id is 144337 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc228003530 con 0x7fc23c1353b0 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2565765835 0 0) 0x7fc23c070310 con 0x7fc23c135870 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): my global_id is 5958 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc23c09f930 con 0x7fc23c135870 2024-04-25T23:59:22.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2460733801 0 0) 0x7fc23c09f470 con 0x7fc23c13bdf0 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): my global_id is 5901 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc23c070310 con 0x7fc23c13bdf0 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3054238225 0 0) 0x7fc228003530 con 0x7fc23c1353b0 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc23c09f470 con 0x7fc23c1353b0 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc234001e60 con 0x7fc23c1353b0 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:22.106 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.107 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3774800360 0 0) 0x7fc23c070310 con 0x7fc23c13bdf0 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc228003530 con 0x7fc23c13bdf0 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1409671731 0 0) 0x7fc23c09f930 con 0x7fc23c135870 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc23c070310 con 0x7fc23c135870 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc22c001780 con 0x7fc23c13bdf0 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.108 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.109 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2300041f0 con 0x7fc23c135870 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.110 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.111 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.111 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1802156698 0 0) 0x7fc23c09f470 con 0x7fc23c1353b0 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.106:6792/0 conn(0x7fc23c13bdf0 legacy=0x7fc23c1d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.106:6789/0 conn(0x7fc23c135870 legacy=0x7fc23c06fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 monclient: found mon.c 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc23c136b70 con 0x7fc23c1353b0 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 5 monclient: authenticate success, global_id 144337 2024-04-25T23:59:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: _renew_subs 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc23c070e70 con 0x7fc23c1353b0 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: _renew_subs 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc23c134c30 con 0x7fc23c1353b0 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc234003c50 con 0x7fc23c1353b0 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc234004140 con 0x7fc23c1353b0 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23bfff640 4 set_mon_vals no callback set 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.105+0000 7fc23a7fc640 10 monclient: dump: 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc244137640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc21c0065d0 con 0x7fc21c002870 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc2340042e0 con 0x7fc23c1353b0 2024-04-25T23:59:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7fc2340450c0 con 0x7fc23c1353b0 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548272066 0 0) 0x7fc21c0065d0 con 0x7fc21c002870 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient(hunting): my global_id is 5825 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc23c09f470 con 0x7fc21c002870 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 965698549 0 0) 0x7fc23c09f470 con 0x7fc21c002870 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc21c0065d0 con 0x7fc21c002870 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc2426d4640 10 monclient: get_auth_request con 0x7fc228038250 auth_method 0 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc230004950 con 0x7fc21c002870 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient: dump: 2024-04-25T23:59:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4214040485 0 0) 0x7fc21c0065d0 con 0x7fc21c002870 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc21c00a160 con 0x7fc21c002870 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc230004d80 con 0x7fc21c002870 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.106:6790/0 conn(0x7fc21c002870 legacy=0x7fc21c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.109+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.106:6790/0 conn(0x7fc21c002870 legacy=0x7fc21c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc244137640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc21c009e50 con 0x7fc21c009110 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080806044 0 0) 0x7fc21c009e50 con 0x7fc21c009110 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc23a7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc23a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc23a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc23a7fc640 10 monclient(hunting): my global_id is 5834 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.113+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc21c0065d0 con 0x7fc21c009110 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 218874127 0 0) 0x7fc21c0065d0 con 0x7fc21c009110 2024-04-25T23:59:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc21c009e50 con 0x7fc21c009110 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc230005560 con 0x7fc21c009110 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 10 monclient: dump: 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1576743982 0 0) 0x7fc21c009e50 con 0x7fc21c009110 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc21c00c3e0 con 0x7fc21c009110 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7894 (unknown 0 0 2566015377) 0x7fc230006900 con 0x7fc21c009110 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.106:6790/0 conn(0x7fc21c009110 legacy=0x7fc21c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc23a7fc640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.106:6790/0 conn(0x7fc21c009110 legacy=0x7fc21c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 280680, 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:22.124 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.125 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:22.126 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.127 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:22.128 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.129 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.133 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.134 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:59:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:22.143 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.171:6812/722422047 conn(0x7fc228038250 legacy=0x7fc22803a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 10 monclient: shutdown 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 >> v1:172.21.15.106:6791/0 conn(0x7fc23c1353b0 legacy=0x7fc23c06f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc2426d4640 1 -- 172.21.15.106:0/92979586 reap_dead start 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc2426d4640 1 -- 172.21.15.106:0/92979586 reap_dead start 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 shutdown_connections 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 >> 172.21.15.106:0/92979586 conn(0x7fc23c0a64e0 msgr2=0x7fc23c0a1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 shutdown_connections 2024-04-25T23:59:22.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.117+0000 7fc244137640 1 -- 172.21.15.106:0/92979586 wait complete. 2024-04-25T23:59:22.145 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:22.146 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-04-25T23:59:22.146 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-25T23:59:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.139+0000 7ff1cc012640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.139+0000 7ff1cc012640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.139+0000 7ff1cc012640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.139+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7ff1ac005b90 con 0x7ff1c409bb70 2024-04-25T23:59:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.139+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v109) ==== 56+0+1449 (unknown 487677150 0 1618612635) 0x7ff1c00151d0 con 0x7ff1c409bb70 2024-04-25T23:59:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.139+0000 7ff1ba7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.139+0000 7ff1ba7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:22.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.231+0000 7ff1cc012640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:22.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.231+0000 7ff1cc012640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:22.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.231+0000 7ff1cc012640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:22.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.231+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7ff1ac005d60 con 0x7ff1c409bb70 2024-04-25T23:59:22.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.231+0000 7ff1ba7fc640 1 -- 172.21.15.171:0/2540802937 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v109) ==== 56+0+1449 (unknown 487677150 0 1618612635) 0x7ff1c0013530 con 0x7ff1c409bb70 2024-04-25T23:59:22.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.231+0000 7ff1ba7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:22.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.231+0000 7ff1ba7fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:22.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 >> v1:172.21.15.171:6812/722422047 conn(0x7ff1a8038160 legacy=0x7ff1a803a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 10 monclient: shutdown 2024-04-25T23:59:22.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 >> v1:172.21.15.171:6791/0 conn(0x7ff1c409bb70 legacy=0x7ff1c413b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 shutdown_connections 2024-04-25T23:59:22.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 >> 172.21.15.171:0/2540802937 conn(0x7ff1c40a28a0 msgr2=0x7ff1c4139370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 shutdown_connections 2024-04-25T23:59:22.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.235+0000 7ff1cc012640 1 -- 172.21.15.171:0/2540802937 wait complete. 2024-04-25T23:59:22.233 INFO:tasks.workunit.client.0.smithi171.stdout: 14 123.00000 osd.14 down 1.00000 1.00000 2024-04-25T23:59:22.233 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush reweight-subtree foobaz 155 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient: get_monmap_and_config 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient: monmap: 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:22.280357+0000 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:22.280357+0000 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.259 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.260 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 1 Processor -- start 2024-04-25T23:59:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 1 -- start start 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient: init 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient: _add_conns ranks=[4,0,2,5,1,3,7,6,8] 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient(hunting): picked mon.noname-c con 0x7f7750135870 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient(hunting): picked mon.noname-a con 0x7f77501353b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient(hunting): picked mon.noname-b con 0x7f775013bdf0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f775006f2d0 con 0x7f77501353b0 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750072330 con 0x7f775013bdf0 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750072610 con 0x7f7750135870 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f7756b0b640 10 monclient(hunting): authenticate will time out at 1217.807530s 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f77550a8640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f775013bdf0 0x7f775013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39214/0 (socket says 172.21.15.106:39214) 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.277+0000 7f77550a8640 1 -- 172.21.15.106:0/2138829167 learned_addr learned my addr 172.21.15.106:0/2138829167 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275889991 0 0) 0x7f7750072330 con 0x7f775013bdf0 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): my global_id is 5843 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7738003530 con 0x7f775013bdf0 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3431090875 0 0) 0x7f775006f2d0 con 0x7f77501353b0 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): my global_id is 5967 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7750072330 con 0x7f77501353b0 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875541011 0 0) 0x7f7750072610 con 0x7f7750135870 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient(hunting): my global_id is 144346 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f775006f2d0 con 0x7f7750135870 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 732616678 0 0) 0x7f7738003530 con 0x7f775013bdf0 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 >> v1:172.21.15.106:6791/0 conn(0x7f7750135870 legacy=0x7f7750135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 >> v1:172.21.15.106:6789/0 conn(0x7f77501353b0 legacy=0x7f775013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 monclient: found mon.noname-b 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77500a3260 con 0x7f775013bdf0 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f77400017c0 con 0x7f775013bdf0 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 5 monclient: authenticate success, global_id 5843 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: dump: 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.273 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.274 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.275 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7740001ae0 con 0x7f775013bdf0 2024-04-25T23:59:22.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 1 -- 172.21.15.106:0/2138829167 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7740001d50 con 0x7f775013bdf0 2024-04-25T23:59:22.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 4 set_mon_vals no callback set 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774f7fe640 10 monclient: dump: 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.276 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: shutdown 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- 172.21.15.106:0/2138829167 >> v1:172.21.15.106:6790/0 conn(0x7f775013bdf0 legacy=0x7f775013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- 172.21.15.106:0/2138829167 shutdown_connections 2024-04-25T23:59:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- 172.21.15.106:0/2138829167 >> 172.21.15.106:0/2138829167 conn(0x7f77500a64e0 msgr2=0x7f77500a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- 172.21.15.106:0/2138829167 shutdown_connections 2024-04-25T23:59:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- 172.21.15.106:0/2138829167 wait complete. 2024-04-25T23:59:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: monmap: 2024-04-25T23:59:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.282 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 Processor -- start 2024-04-25T23:59:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- start start 2024-04-25T23:59:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: init 2024-04-25T23:59:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: _add_conns ranks=[0,6,2,5,3,1,8,4,7] 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient(hunting): picked mon.noname-a con 0x7f77501353b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient(hunting): picked mon.noname-d con 0x7f7750135870 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient(hunting): picked mon.noname-b con 0x7f775013bdf0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750132610 con 0x7f77501353b0 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750134900 con 0x7f775013bdf0 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7750134060 con 0x7f7750135870 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient(hunting): authenticate will time out at 1217.810421s 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f77550a8640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f775013bdf0 0x7f77501d32e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39230/0 (socket says 172.21.15.106:39230) 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f77550a8640 1 -- 172.21.15.106:0/3257925328 learned_addr learned my addr 172.21.15.106:0/3257925328 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f77548a7640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f77501353b0 0x7f77501cac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47572/0 (socket says 172.21.15.106:47572) 2024-04-25T23:59:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774ffff640 1 --1- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6792/0 conn(0x7f7750135870 0x7f77501cfbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:37092/0 (socket says 172.21.15.106:37092) 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742212780 0 0) 0x7f7750134060 con 0x7f7750135870 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): my global_id is 5910 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f773c003530 con 0x7f7750135870 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772914654 0 0) 0x7f7750134900 con 0x7f775013bdf0 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): my global_id is 5852 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7750134060 con 0x7f775013bdf0 2024-04-25T23:59:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358876898 0 0) 0x7f7750132610 con 0x7f77501353b0 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): my global_id is 5976 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7750134900 con 0x7f77501353b0 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1452335383 0 0) 0x7f773c003530 con 0x7f7750135870 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7750132610 con 0x7f7750135870 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f77440014c0 con 0x7f7750135870 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2346924890 0 0) 0x7f7750134900 con 0x7f77501353b0 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f773c003530 con 0x7f77501353b0 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4182262435 0 0) 0x7f7750134060 con 0x7f775013bdf0 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7750134900 con 0x7f775013bdf0 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7748001e20 con 0x7f77501353b0 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7740001780 con 0x7f775013bdf0 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1905314191 0 0) 0x7f7750132610 con 0x7f7750135870 2024-04-25T23:59:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6790/0 conn(0x7f775013bdf0 legacy=0x7f77501d32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6789/0 conn(0x7f77501353b0 legacy=0x7f77501cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 monclient: found mon.d 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77501334b0 con 0x7f7750135870 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 5 monclient: authenticate success, global_id 5910 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: _renew_subs 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7750133170 con 0x7f7750135870 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: _renew_subs 2024-04-25T23:59:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7750131b20 con 0x7f7750135870 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f77440038b0 con 0x7f7750135870 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7744003da0 con 0x7f7750135870 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774effd640 4 set_mon_vals no callback set 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.281+0000 7f774d7fa640 10 monclient: dump: 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f7756b0b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f77300065d0 con 0x7f7730002870 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7744003f40 con 0x7f7750135870 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7f7744044cf0 con 0x7f7750135870 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2055812809 0 0) 0x7f77300065d0 con 0x7f7730002870 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient(hunting): my global_id is 144355 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7750132610 con 0x7f7730002870 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f77550a8640 10 monclient: get_auth_request con 0x7f773c0381a0 auth_method 0 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4140716406 0 0) 0x7f7750132610 con 0x7f7730002870 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f77300065d0 con 0x7f7730002870 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7748003ce0 con 0x7f7730002870 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient: dump: 2024-04-25T23:59:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3077123335 0 0) 0x7f77300065d0 con 0x7f7730002870 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f773000a160 con 0x7f7730002870 2024-04-25T23:59:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7748005b50 con 0x7f7730002870 2024-04-25T23:59:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6791/0 conn(0x7f7730002870 legacy=0x7f7730004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.285+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6791/0 conn(0x7f7730002870 legacy=0x7f7730004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f7756b0b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7730009e30 con 0x7f77300090f0 2024-04-25T23:59:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838141941 0 0) 0x7f7730009e30 con 0x7f77300090f0 2024-04-25T23:59:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient(hunting): my global_id is 144364 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f77300065d0 con 0x7f77300090f0 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 974686426 0 0) 0x7f77300065d0 con 0x7f77300090f0 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7730009e30 con 0x7f77300090f0 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f77480045c0 con 0x7f77300090f0 2024-04-25T23:59:22.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient: dump: 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4174352688 0 0) 0x7f7730009e30 con 0x7f77300090f0 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f773000c3a0 con 0x7f77300090f0 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7553 (unknown 0 0 3196178995) 0x7f7748007d90 con 0x7f77300090f0 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6791/0 conn(0x7f77300090f0 legacy=0x7f7730009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.289+0000 7f774d7fa640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6791/0 conn(0x7f77300090f0 legacy=0x7f7730009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.303 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 25819, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:22.322 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.171:6812/722422047 conn(0x7f773c0381a0 legacy=0x7f773c03a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 10 monclient: shutdown 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 >> v1:172.21.15.106:6792/0 conn(0x7f7750135870 legacy=0x7f77501cfbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f77550a8640 1 -- 172.21.15.106:0/3257925328 reap_dead start 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f77550a8640 1 -- 172.21.15.106:0/3257925328 reap_dead start 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 shutdown_connections 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 >> 172.21.15.106:0/3257925328 conn(0x7f77500a64e0 msgr2=0x7f775012e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 shutdown_connections 2024-04-25T23:59:22.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.293+0000 7f7756b0b640 1 -- 172.21.15.106:0/3257925328 wait complete. 2024-04-25T23:59:22.325 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:22.325 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-04-25T23:59:22.325 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-25T23:59:22.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.363+0000 7f4d42c8f640 10 monclient: get_monmap_and_config 2024-04-25T23:59:22.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.363+0000 7f4d42c8f640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient: monmap: 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:22.370659+0000 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:22.370659+0000 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.350 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.351 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.351 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.351 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.351 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.351 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.351 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.351 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 Processor -- start 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- start start 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient: init 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient: _add_conns ranks=[5,2,3,1,0,8,6,7,4] 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient(hunting): picked mon.noname-h con 0x7f4d3c0a49c0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient(hunting): picked mon.noname-b con 0x7f4d3c0a4da0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient(hunting): picked mon.noname-g con 0x7f4d3c1423b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3c0a1530 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3c0a1770 con 0x7f4d3c1423b0 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3c0a2a20 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.358 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient(hunting): authenticate will time out at 1213.077800s 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d40a2b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4d3c0a49c0 0x7f4d3c0a3a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50256/0 (socket says 172.21.15.171:50256) 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d40a2b640 1 -- 172.21.15.171:0/4044993055 learned_addr learned my addr 172.21.15.171:0/4044993055 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d4122c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f4d3c1423b0 0x7f4d3c1447a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48574/0 (socket says 172.21.15.171:48574) 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930360448 0 0) 0x7f4d3c0a2a20 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): my global_id is 5765 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d28003530 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688061001 0 0) 0x7f4d3c0a1770 con 0x7f4d3c1423b0 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): my global_id is 6069 2024-04-25T23:59:22.359 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d3c0a2a20 con 0x7f4d3c1423b0 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023626067 0 0) 0x7f4d3c0a1530 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient(hunting): my global_id is 5861 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d3c0a1770 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 54110605 0 0) 0x7f4d28003530 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 >> v1:172.21.15.171:6790/0 conn(0x7f4d3c1423b0 legacy=0x7f4d3c1447a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 >> v1:172.21.15.106:6790/0 conn(0x7f4d3c0a4da0 legacy=0x7f4d3c0a5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 monclient: found mon.noname-h 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c0a4180 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.360 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d2c001b40 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 5 monclient: authenticate success, global_id 5765 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: dump: 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.361 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d2c001e60 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:22.362 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 4 set_mon_vals no callback set 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 1 -- 172.21.15.171:0/4044993055 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d2c004f70 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d3b7fe640 10 monclient: dump: 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.363 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 10 monclient: shutdown 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- 172.21.15.171:0/4044993055 >> v1:172.21.15.171:6791/0 conn(0x7f4d3c0a49c0 legacy=0x7f4d3c0a3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- 172.21.15.171:0/4044993055 shutdown_connections 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- 172.21.15.171:0/4044993055 >> 172.21.15.171:0/4044993055 conn(0x7f4d3c0a6c90 msgr2=0x7f4d3c0a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- 172.21.15.171:0/4044993055 shutdown_connections 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.367+0000 7f4d42c8f640 1 -- 172.21.15.171:0/4044993055 wait complete. 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: monmap: 2024-04-25T23:59:22.364 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.365 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 Processor -- start 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 -- start start 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: init 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _add_conns ranks=[6,4,8,2,1,5,7,3,0] 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient(hunting): picked mon.noname-d con 0x7f4d3c0a49c0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient(hunting): picked mon.noname-c con 0x7f4d3c0a4da0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient(hunting): picked mon.noname-e con 0x7f4d3c1423b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3c13d180 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3c0724e0 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3c071680 con 0x7f4d3c1423b0 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient(hunting): authenticate will time out at 1213.081091s 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d4122c640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f4d3c1423b0 legacy=0x7f4d3c1d8f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:22.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d3bfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f4d3c0a4da0 0x7f4d3c070f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:36002/0 (socket says 172.21.15.171:36002) 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d40a2b640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4d3c0a49c0 0x7f4d3c070860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:45050/0 (socket says 172.21.15.171:45050) 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d3bfff640 1 -- 172.21.15.171:0/2888893774 learned_addr learned my addr 172.21.15.171:0/2888893774 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2578012844 0 0) 0x7f4d3c13d180 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): my global_id is 144373 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d1c003530 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3766231520 0 0) 0x7f4d3c0724e0 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): my global_id is 5919 2024-04-25T23:59:22.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d3c13d180 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 732514221 0 0) 0x7f4d1c003530 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d3c0724e0 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d24001b00 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.368 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3278434556 0 0) 0x7f4d3c13d180 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d1c003530 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d2c001b00 con 0x7f4d3c0a49c0 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.369 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2692438997 0 0) 0x7f4d3c0724e0 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 >> v1:172.21.15.106:6793/0 conn(0x7f4d3c1423b0 legacy=0x7f4d3c1d8f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 >> v1:172.21.15.106:6792/0 conn(0x7f4d3c0a49c0 legacy=0x7f4d3c070860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 monclient: found mon.c 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3c09b7c0 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 5 monclient: authenticate success, global_id 144373 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _renew_subs 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d3c09baa0 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _renew_subs 2024-04-25T23:59:22.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d3c09c480 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d240038d0 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d3affd640 4 set_mon_vals no callback set 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4d24003e40 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 10 monclient: dump: 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:22.372 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4d240040a0 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d20005090 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7f4d24044ec0 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.371+0000 7f4d40a2b640 10 monclient: get_auth_request con 0x7f4d1c037ca0 auth_method 0 2024-04-25T23:59:22.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.379+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f4d24015850 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.379+0000 7f4d397fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.379+0000 7f4d397fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.461+0000 7f9777304640 10 monclient: get_monmap_and_config 2024-04-25T23:59:22.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.461+0000 7f9777304640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.461+0000 7f9777304640 10 monclient: monmap: 2024-04-25T23:59:22.445 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.445 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.445 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:22.465282+0000 2024-04-25T23:59:22.445 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:22.465282+0000 2024-04-25T23:59:22.445 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.445 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.446 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.447 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.447 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 Processor -- start 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- start start 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: init 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: _add_conns ranks=[6,8,5,4,7,0,1,3,2] 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): picked mon.noname-d con 0x7f977006e3e0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): picked mon.noname-e con 0x7f977006fba0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): picked mon.noname-h con 0x7f977006eed0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9770070f80 con 0x7f977006eed0 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9770071e00 con 0x7f977006e3e0 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700709c0 con 0x7f977006fba0 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): authenticate will time out at 1217.992903s 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f977489f640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f977006fba0 legacy=0x7f97701391f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f97750a0640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f977006e3e0 0x7f977006e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:37100/0 (socket says 172.21.15.106:37100) 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f97750a0640 1 -- 172.21.15.106:0/3480469095 learned_addr learned my addr 172.21.15.106:0/3480469095 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723186506 0 0) 0x7f9770071e00 con 0x7f977006e3e0 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient(hunting): my global_id is 5928 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f975c004640 con 0x7f977006e3e0 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3849362007 0 0) 0x7f975c004640 con 0x7f977006e3e0 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 >> v1:172.21.15.106:6793/0 conn(0x7f977006fba0 legacy=0x7f97701391f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 >> v1:172.21.15.171:6791/0 conn(0x7f977006eed0 legacy=0x7f977013c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 monclient: found mon.noname-d 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9770070ca0 con 0x7f977006e3e0 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f976c0017c0 con 0x7f977006e3e0 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 5 monclient: authenticate success, global_id 5928 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: dump: 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f976c001a20 con 0x7f977006e3e0 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 1 -- 172.21.15.106:0/3480469095 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f976c004bf0 con 0x7f977006e3e0 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9767fff640 10 monclient: dump: 2024-04-25T23:59:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 4 set_mon_vals no callback set 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: shutdown 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- 172.21.15.106:0/3480469095 >> v1:172.21.15.106:6792/0 conn(0x7f977006e3e0 legacy=0x7f977006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- 172.21.15.106:0/3480469095 shutdown_connections 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- 172.21.15.106:0/3480469095 >> 172.21.15.106:0/3480469095 conn(0x7f97700a64e0 msgr2=0x7f97700a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- 172.21.15.106:0/3480469095 shutdown_connections 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- 172.21.15.106:0/3480469095 wait complete. 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: monmap: 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 Processor -- start 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- start start 2024-04-25T23:59:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: init 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient: _add_conns ranks=[5,0,6,4,3,8,1,7,2] 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): picked mon.noname-h con 0x7f977006e3e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): picked mon.noname-a con 0x7f977006eed0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): picked mon.noname-d con 0x7f977006fba0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97701aa0d0 con 0x7f977006eed0 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9770070000 con 0x7f977006e3e0 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97701a8b60 con 0x7f977006fba0 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.465+0000 7f9777304640 10 monclient(hunting): authenticate will time out at 1217.995915s 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f977489f640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f977006eed0 0x7f97701d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47576/0 (socket says 172.21.15.106:47576) 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f977489f640 1 -- 172.21.15.106:0/3496304072 learned_addr learned my addr 172.21.15.106:0/3496304072 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f97758a1640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f977006fba0 0x7f97701d4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:37104/0 (socket says 172.21.15.106:37104) 2024-04-25T23:59:22.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131794865 0 0) 0x7f97701a8b60 con 0x7f977006fba0 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): my global_id is 5937 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9754003560 con 0x7f977006fba0 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2867924647 0 0) 0x7f97701aa0d0 con 0x7f977006eed0 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): my global_id is 5985 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97701a8b60 con 0x7f977006eed0 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 260842106 0 0) 0x7f9770070000 con 0x7f977006e3e0 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): my global_id is 5783 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97701aa0d0 con 0x7f977006e3e0 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2265864332 0 0) 0x7f9754003560 con 0x7f977006fba0 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9770070000 con 0x7f977006fba0 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 213487805 0 0) 0x7f97701a8b60 con 0x7f977006eed0 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9754003560 con 0x7f977006eed0 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9768001ce0 con 0x7f977006fba0 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.472 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:22.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9760004280 con 0x7f977006eed0 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.474 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4154223606 0 0) 0x7f9754003560 con 0x7f977006eed0 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.106:6792/0 conn(0x7f977006fba0 legacy=0x7f97701d4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.171:6791/0 conn(0x7f977006e3e0 legacy=0x7f97701bc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 monclient: found mon.a 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97701a7de0 con 0x7f977006eed0 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 5 monclient: authenticate success, global_id 5985 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 10 monclient: _renew_subs 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f97701a9df0 con 0x7f977006eed0 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 10 monclient: _renew_subs 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f97701c9600 con 0x7f977006eed0 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9760004790 con 0x7f977006eed0 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9760004c80 con 0x7f977006eed0 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f97677fe640 4 set_mon_vals no callback set 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:22.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: dump: 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.477 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f97500065d0 con 0x7f9750002870 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9760004e20 con 0x7f977006eed0 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(109..109 src has 1..109) ==== 5861+0+0 (unknown 1706259233 0 0) 0x7f9760044c90 con 0x7f977006eed0 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 581387687 0 0) 0x7f97500065d0 con 0x7f9750002870 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient(hunting): my global_id is 5946 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9754003560 con 0x7f9750002870 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f97758a1640 10 monclient: get_auth_request con 0x7f9754037fa0 auth_method 0 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1950839036 0 0) 0x7f9754003560 con 0x7f9750002870 2024-04-25T23:59:22.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97500065d0 con 0x7f9750002870 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f976c001240 con 0x7f9750002870 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: dump: 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.479 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4191821731 0 0) 0x7f97500065d0 con 0x7f9750002870 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f975000a160 con 0x7f9750002870 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f976c001680 con 0x7f9750002870 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.106:6792/0 conn(0x7f9750002870 legacy=0x7f9750004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.469+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.106:6792/0 conn(0x7f9750002870 legacy=0x7f9750004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9750009e50 con 0x7f9750009110 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697339157 0 0) 0x7f9750009e50 con 0x7f9750009110 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient(hunting): my global_id is 5955 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97500065d0 con 0x7f9750009110 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3819720010 0 0) 0x7f97500065d0 con 0x7f9750009110 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9750009e50 con 0x7f9750009110 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f976c005000 con 0x7f9750009110 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient: dump: 2024-04-25T23:59:22.481 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.482 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2614145949 0 0) 0x7f9750009e50 con 0x7f9750009110 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f975000c3e0 con 0x7f9750009110 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 697807487) 0x7f976c006470 con 0x7f9750009110 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.106:6792/0 conn(0x7f9750009110 legacy=0x7f97500095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9765ffb640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.106:6792/0 conn(0x7f9750009110 legacy=0x7f97500095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 281016, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-25T23:59:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.490 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.491 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.492 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.493 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.494 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.495 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.497 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.498 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.499 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:22.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:22.501 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.171:6812/722422047 conn(0x7f9754037fa0 legacy=0x7f975403a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 10 monclient: shutdown 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 >> v1:172.21.15.106:6789/0 conn(0x7f977006eed0 legacy=0x7f97701d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f97758a1640 1 -- 172.21.15.106:0/3496304072 reap_dead start 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f97758a1640 1 -- 172.21.15.106:0/3496304072 reap_dead start 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 shutdown_connections 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 >> 172.21.15.106:0/3496304072 conn(0x7f97700a64e0 msgr2=0x7f97700a4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 shutdown_connections 2024-04-25T23:59:22.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.477+0000 7f9777304640 1 -- 172.21.15.106:0/3496304072 wait complete. 2024-04-25T23:59:22.504 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:22.504 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-04-25T23:59:22.504 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-25T23:59:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.543+0000 7f4d42c8f640 10 start_mon_command cmd=[{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}] 2024-04-25T23:59:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.543+0000 7f4d42c8f640 10 monclient: _send_command 2 [{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}] 2024-04-25T23:59:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.543+0000 7f4d42c8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:22.543+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0} v 0) -- 0x7f4d20005380 con 0x7f4d3c0a4da0 2024-04-25T23:59:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: get_monmap_and_config 2024-04-25T23:59:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: monmap: 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:22.642699+0000 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:22.642699+0000 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.623 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 Processor -- start 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- start start 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: init 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: _add_conns ranks=[3,0,8,7,5,1,2,4,6] 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient(hunting): picked mon.noname-g con 0x7f1ed8131160 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient(hunting): picked mon.noname-a con 0x7f1ed809c710 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient(hunting): picked mon.noname-e con 0x7f1ed809cb70 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed8067c20 con 0x7f1ed809c710 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed8131c50 con 0x7f1ed8131160 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed809ba50 con 0x7f1ed809cb70 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient(hunting): authenticate will time out at 1218.169838s 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1edcf76640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f1ed809cb70 legacy=0x7f1ed81401d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed77fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1ed809c710 0x7f1ed813caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47588/0 (socket says 172.21.15.106:47588) 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed77fe640 1 -- 172.21.15.106:0/36319257 learned_addr learned my addr 172.21.15.106:0/36319257 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2782365396 0 0) 0x7f1ed8067c20 con 0x7f1ed809c710 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient(hunting): my global_id is 5994 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ec0003530 con 0x7f1ed809c710 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1186509503 0 0) 0x7f1ec0003530 con 0x7f1ed809c710 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 >> v1:172.21.15.106:6793/0 conn(0x7f1ed809cb70 legacy=0x7f1ed81401d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 >> v1:172.21.15.171:6790/0 conn(0x7f1ed8131160 legacy=0x7f1ed8131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 monclient: found mon.noname-a 2024-04-25T23:59:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed809bd30 con 0x7f1ed809c710 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ec80017c0 con 0x7f1ed809c710 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 5 monclient: authenticate success, global_id 5994 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: dump: 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ec8001b20 con 0x7f1ed809c710 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 1 -- 172.21.15.106:0/36319257 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ec8004bf0 con 0x7f1ed809c710 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ed6ffd640 10 monclient: dump: 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.636 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 4 set_mon_vals no callback set 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 10 monclient: shutdown 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- 172.21.15.106:0/36319257 >> v1:172.21.15.106:6789/0 conn(0x7f1ed809c710 legacy=0x7f1ed813caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- 172.21.15.106:0/36319257 shutdown_connections 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- 172.21.15.106:0/36319257 >> 172.21.15.106:0/36319257 conn(0x7f1ed80a2d20 msgr2=0x7f1ed80a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- 172.21.15.106:0/36319257 shutdown_connections 2024-04-25T23:59:22.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.641+0000 7f1ede9d9640 1 -- 172.21.15.106:0/36319257 wait complete. 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: monmap: 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.638 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 Processor -- start 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 -- start start 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: init 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: _add_conns ranks=[4,7,0,2,1,3,6,8,5] 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient(hunting): picked mon.noname-c con 0x7f1ed809c710 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient(hunting): picked mon.noname-i con 0x7f1ed809cb70 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient(hunting): picked mon.noname-a con 0x7f1ed8131160 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed80714b0 con 0x7f1ed8131160 2024-04-25T23:59:22.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed8067e50 con 0x7f1ed809c710 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ed812b1c0 con 0x7f1ed809cb70 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient(hunting): authenticate will time out at 1218.173056s 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1edcf76640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1ed8131160 0x7f1ed81d4b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47602/0 (socket says 172.21.15.106:47602) 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1edcf76640 1 -- 172.21.15.106:0/2955278034 learned_addr learned my addr 172.21.15.106:0/2955278034 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723939322 0 0) 0x7f1ed80714b0 con 0x7f1ed8131160 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): my global_id is 6003 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ec4003530 con 0x7f1ed8131160 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449419820 0 0) 0x7f1ed8067e50 con 0x7f1ed809c710 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): my global_id is 144382 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ed80714b0 con 0x7f1ed809c710 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3225694727 0 0) 0x7f1ec4003530 con 0x7f1ed8131160 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ed8067e50 con 0x7f1ed8131160 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ed0004560 con 0x7f1ed8131160 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.641 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3825758710 0 0) 0x7f1ed812b1c0 con 0x7f1ed809cb70 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): my global_id is 144214 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ec4003530 con 0x7f1ed809cb70 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3772431013 0 0) 0x7f1ed80714b0 con 0x7f1ed809c710 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1ed812b1c0 con 0x7f1ed809c710 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ecc001980 con 0x7f1ed809c710 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.643 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3879643736 0 0) 0x7f1ed8067e50 con 0x7f1ed8131160 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.171:6792/0 conn(0x7f1ed809cb70 legacy=0x7f1ed8070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.106:6791/0 conn(0x7f1ed809c710 legacy=0x7f1ed806fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 monclient: found mon.a 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ed8072f00 con 0x7f1ed8131160 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 5 monclient: authenticate success, global_id 6003 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: _renew_subs 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1ed8131e70 con 0x7f1ed8131160 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: _renew_subs 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1ed8130b60 con 0x7f1ed8131160 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ed0004810 con 0x7f1ed8131160 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ed0004d00 con 0x7f1ed8131160 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed67fc640 4 set_mon_vals no callback set 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: dump: 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.646 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1eb80065d0 con 0x7f1eb8002870 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1ed0004f20 con 0x7f1ed8131160 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 5861+0+0 (unknown 3797382526 0 0) 0x7f1ed0045030 con 0x7f1ed8131160 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed77fe640 10 monclient: get_auth_request con 0x7f1ec4037fa0 auth_method 0 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 252869387 0 0) 0x7f1eb80065d0 con 0x7f1eb8002870 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient(hunting): my global_id is 144343 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1ed8067e50 con 0x7f1eb8002870 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1949767951 0 0) 0x7f1ed8067e50 con 0x7f1eb8002870 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1eb80065d0 con 0x7f1eb8002870 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ecc003960 con 0x7f1eb8002870 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.645+0000 7f1ed4ff9640 10 monclient: dump: 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.648 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.649 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.649 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.649 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.649 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.649 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.649 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.650 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.650 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.650 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.650 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.650 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.650 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.650 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.649+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 721161104 0 0) 0x7f1eb80065d0 con 0x7f1eb8002870 2024-04-25T23:59:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.649+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1eb800a160 con 0x7f1eb8002870 2024-04-25T23:59:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.649+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1ecc004650 con 0x7f1eb8002870 2024-04-25T23:59:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.649+0000 7f1ed4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.649+0000 7f1ed4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.649+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.171:6789/0 conn(0x7f1eb8002870 legacy=0x7f1eb8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.649+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.171:6789/0 conn(0x7f1eb8002870 legacy=0x7f1eb8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ede9d9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:22.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1eb8009e50 con 0x7f1eb8009110 2024-04-25T23:59:22.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859809332 0 0) 0x7f1eb8009e50 con 0x7f1eb8009110 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ed4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ed4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ed4ff9640 10 monclient(hunting): my global_id is 144352 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.653+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1eb80065d0 con 0x7f1eb8009110 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3072165144 0 0) 0x7f1eb80065d0 con 0x7f1eb8009110 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1eb8009e50 con 0x7f1eb8009110 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ecc004200 con 0x7f1eb8009110 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 10 monclient: dump: 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.653 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 450116380 0 0) 0x7f1eb8009e50 con 0x7f1eb8009110 2024-04-25T23:59:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1eb800c3e0 con 0x7f1eb8009110 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7553 (unknown 0 0 3611644542) 0x7f1ecc004800 con 0x7f1eb8009110 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.171:6789/0 conn(0x7f1eb8009110 legacy=0x7f1eb80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ed4ff9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.171:6789/0 conn(0x7f1eb8009110 legacy=0x7f1eb80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:22.655 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 26187, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:22.656 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.657 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:22.658 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:22.659 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:22.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.661 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.664 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.665 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.666 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.668 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.669 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:22.670 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.671 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.673 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.673 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:22.673 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:22.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.171:6812/722422047 conn(0x7f1ec4037fa0 legacy=0x7f1ec403a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 10 monclient: shutdown 2024-04-25T23:59:22.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 >> v1:172.21.15.106:6789/0 conn(0x7f1ed8131160 legacy=0x7f1ed81d4b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1edcf76640 1 -- 172.21.15.106:0/2955278034 reap_dead start 2024-04-25T23:59:22.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1edcf76640 1 -- 172.21.15.106:0/2955278034 reap_dead start 2024-04-25T23:59:22.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 shutdown_connections 2024-04-25T23:59:22.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 >> 172.21.15.106:0/2955278034 conn(0x7f1ed80a2d20 msgr2=0x7f1ed8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 shutdown_connections 2024-04-25T23:59:22.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.657+0000 7f1ede9d9640 1 -- 172.21.15.106:0/2955278034 wait complete. 2024-04-25T23:59:22.675 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:22.675 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-04-25T23:59:22.675 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.805+0000 7f000c93b640 10 monclient: get_monmap_and_config 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.805+0000 7f000c93b640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.805+0000 7f000c93b640 10 monclient: monmap: 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:22.810031+0000 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:22.810031+0000 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.790 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 Processor -- start 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- start start 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: init 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: _add_conns ranks=[7,8,2,0,4,5,6,1,3] 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient(hunting): picked mon.noname-i con 0x7f0008134760 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient(hunting): picked mon.noname-e con 0x7f00080a0d70 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient(hunting): picked mon.noname-b con 0x7f000813df70 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:22.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000806b910 con 0x7f000813df70 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000809fac0 con 0x7f0008134760 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00080a0080 con 0x7f00080a0d70 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient(hunting): authenticate will time out at 1218.337166s 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f0005d9b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f00080a0d70 legacy=0x7f000813c850 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f0006d9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f000813df70 0x7f0008140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39244/0 (socket says 172.21.15.106:39244) 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f0006d9d640 1 -- 172.21.15.106:0/1157447076 learned_addr learned my addr 172.21.15.106:0/1157447076 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418761202 0 0) 0x7f000806b910 con 0x7f000813df70 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient(hunting): my global_id is 5870 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efff0003530 con 0x7f000813df70 2024-04-25T23:59:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3789512898 0 0) 0x7efff0003530 con 0x7f000813df70 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 >> v1:172.21.15.106:6793/0 conn(0x7f00080a0d70 legacy=0x7f000813c850 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 >> v1:172.21.15.171:6792/0 conn(0x7f0008134760 legacy=0x7f0008134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 monclient: found mon.noname-b 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f000809f280 con 0x7f000813df70 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0000001b40 con 0x7f000813df70 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: dump: 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.800 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 5 monclient: authenticate success, global_id 5870 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0000001da0 con 0x7f000813df70 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 1 -- 172.21.15.106:0/1157447076 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0000004f70 con 0x7f000813df70 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 4 set_mon_vals no callback set 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000559a640 10 monclient: dump: 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: shutdown 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- 172.21.15.106:0/1157447076 >> v1:172.21.15.106:6790/0 conn(0x7f000813df70 legacy=0x7f0008140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- 172.21.15.106:0/1157447076 shutdown_connections 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- 172.21.15.106:0/1157447076 >> 172.21.15.106:0/1157447076 conn(0x7f00080a7240 msgr2=0x7f00080a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- 172.21.15.106:0/1157447076 shutdown_connections 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- 172.21.15.106:0/1157447076 wait complete. 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: monmap: 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 Processor -- start 2024-04-25T23:59:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 1 -- start start 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.809+0000 7f000c93b640 10 monclient: init 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient: _add_conns ranks=[0,8,3,5,4,6,1,2,7] 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient(hunting): picked mon.noname-a con 0x7f00080a0d70 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient(hunting): picked mon.noname-e con 0x7f0008134760 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient(hunting): picked mon.noname-g con 0x7f000813df70 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000812ea40 con 0x7f00080a0d70 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000812ed20 con 0x7f000813df70 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f000812f000 con 0x7f0008134760 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient(hunting): authenticate will time out at 1218.340083s 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f0005d9b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f0008134760 legacy=0x7f0008131820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f00080a0d70 0x7f00081cc190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47608/0 (socket says 172.21.15.106:47608) 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000659c640 1 -- 172.21.15.106:0/1725805268 learned_addr learned my addr 172.21.15.106:0/1725805268 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 547090213 0 0) 0x7f000812ea40 con 0x7f00080a0d70 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): my global_id is 6012 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effe8003530 con 0x7f00080a0d70 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2915572831 0 0) 0x7effe8003530 con 0x7f00080a0d70 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f000812ea40 con 0x7f00080a0d70 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efff8001b90 con 0x7f00080a0d70 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.806 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:22.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3681414245 0 0) 0x7f000812ea40 con 0x7f00080a0d70 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.106:6793/0 conn(0x7f0008134760 legacy=0x7f0008131820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.171:6790/0 conn(0x7f000813df70 legacy=0x7f00081d4410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 monclient: found mon.a 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0008072350 con 0x7f00080a0d70 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 5 monclient: authenticate success, global_id 6012 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient: _renew_subs 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0008131f30 con 0x7f00080a0d70 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient: _renew_subs 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f000812dcb0 con 0x7f00080a0d70 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0008075890 con 0x7f00080a4eb0 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efff80038d0 con 0x7f00080a0d70 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efff8003e40 con 0x7f00080a0d70 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: dump: 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.809 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f0004d99640 4 set_mon_vals no callback set 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7efff8003fe0 con 0x7f00080a0d70 2024-04-25T23:59:22.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 5861+0+0 (unknown 3797382526 0 0) 0x7efff8044e40 con 0x7f00080a0d70 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850966414 0 0) 0x7f0008075890 con 0x7f00080a4eb0 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient(hunting): my global_id is 6096 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f000812ea40 con 0x7f00080a4eb0 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7f0006d9d640 10 monclient: get_auth_request con 0x7effe8037790 auth_method 0 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1470485205 0 0) 0x7f000812ea40 con 0x7f00080a4eb0 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0008075890 con 0x7f00080a4eb0 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efffc004110 con 0x7f00080a4eb0 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: dump: 2024-04-25T23:59:22.811 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.812 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2089504300 0 0) 0x7f0008075890 con 0x7f00080a4eb0 2024-04-25T23:59:22.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0008062e50 con 0x7f00080a4eb0 2024-04-25T23:59:22.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efffc006560 con 0x7f00080a4eb0 2024-04-25T23:59:22.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.171:6790/0 conn(0x7f00080a4eb0 legacy=0x7f00080a5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.813+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.171:6790/0 conn(0x7f00080a4eb0 legacy=0x7f00080a5290 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7f000c93b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0008132100 con 0x7f00080a59a0 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49290809 0 0) 0x7f0008132100 con 0x7f00080a59a0 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 10 monclient(hunting): my global_id is 6105 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0008075890 con 0x7f00080a59a0 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 96522843 0 0) 0x7f0008075890 con 0x7f00080a59a0 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0008132100 con 0x7f00080a59a0 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efffc004ba0 con 0x7f00080a59a0 2024-04-25T23:59:22.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 10 monclient: dump: 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.816 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1284919806 0 0) 0x7f0008132100 con 0x7f00080a59a0 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.821+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f000806d420 con 0x7f00080a59a0 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7554 (unknown 0 0 1802457876) 0x7efffc006030 con 0x7f00080a59a0 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7efff6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7efff6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.171:6790/0 conn(0x7f00080a59a0 legacy=0x7f00081d9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7efff6ffd640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.171:6790/0 conn(0x7f00080a59a0 legacy=0x7f00081d9b50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:22.817 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 281341, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.835 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:22.836 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.171:6812/722422047 conn(0x7effe8037790 legacy=0x7effe8039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 10 monclient: shutdown 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 >> v1:172.21.15.106:6789/0 conn(0x7f00080a0d70 legacy=0x7f00081cc190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f0006d9d640 1 -- 172.21.15.106:0/1725805268 reap_dead start 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f0006d9d640 1 -- 172.21.15.106:0/1725805268 reap_dead start 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 shutdown_connections 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 >> 172.21.15.106:0/1725805268 conn(0x7f00080a7240 msgr2=0x7f0008133210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 shutdown_connections 2024-04-25T23:59:22.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.825+0000 7f000c93b640 1 -- 172.21.15.106:0/1725805268 wait complete. 2024-04-25T23:59:22.839 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:22.839 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-04-25T23:59:22.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: get_monmap_and_config 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: monmap: 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:22.966511+0000 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:22.966511+0000 2024-04-25T23:59:22.945 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.946 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 Processor -- start 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- start start 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: init 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: _add_conns ranks=[0,4,8,1,3,2,7,5,6] 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient(hunting): picked mon.noname-a con 0x7fae74134970 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient(hunting): picked mon.noname-c con 0x7fae740a4820 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient(hunting): picked mon.noname-e con 0x7fae7413e200 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7406dd40 con 0x7fae74134970 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae740a2b10 con 0x7fae740a4820 2024-04-25T23:59:22.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae740a2df0 con 0x7fae7413e200 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient(hunting): authenticate will time out at 1218.493643s 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae78822640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fae74134970 0x7fae74134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47610/0 (socket says 172.21.15.106:47610) 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae78822640 1 -- 172.21.15.106:0/2099823123 learned_addr learned my addr 172.21.15.106:0/2099823123 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae79023640 1 -- 172.21.15.106:0/2099823123 >> v1:172.21.15.106:6793/0 conn(0x7fae7413e200 legacy=0x7fae741405f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935026702 0 0) 0x7fae7406dd40 con 0x7fae74134970 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): my global_id is 6021 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae5c003530 con 0x7fae74134970 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1994443270 0 0) 0x7fae740a2b10 con 0x7fae740a4820 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient(hunting): my global_id is 144391 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae7406dd40 con 0x7fae740a4820 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898708110 0 0) 0x7fae7406dd40 con 0x7fae740a4820 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 >> v1:172.21.15.106:6793/0 conn(0x7fae7413e200 legacy=0x7fae741405f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 >> v1:172.21.15.106:6789/0 conn(0x7fae74134970 legacy=0x7fae74134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 monclient: found mon.noname-c 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae740a30d0 con 0x7fae740a4820 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae680017a0 con 0x7fae740a4820 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: dump: 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.957 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 5 monclient: authenticate success, global_id 144391 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae68001a10 con 0x7fae740a4820 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 4 set_mon_vals no callback set 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 1 -- 172.21.15.106:0/2099823123 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae68003960 con 0x7fae740a4820 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae737fe640 10 monclient: dump: 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: shutdown 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- 172.21.15.106:0/2099823123 >> v1:172.21.15.106:6791/0 conn(0x7fae740a4820 legacy=0x7fae7413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- 172.21.15.106:0/2099823123 shutdown_connections 2024-04-25T23:59:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- 172.21.15.106:0/2099823123 >> 172.21.15.106:0/2099823123 conn(0x7fae740a9e20 msgr2=0x7fae740aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- 172.21.15.106:0/2099823123 shutdown_connections 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 1 -- 172.21.15.106:0/2099823123 wait complete. 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: build_initial_monmap 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.965+0000 7fae7aa86640 10 monclient: monmap: 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 Processor -- start 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 -- start start 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient: init 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient: _add_conns ranks=[3,1,7,8,2,4,5,6,0] 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient(hunting): picked mon.noname-g con 0x7fae740a4820 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient(hunting): picked mon.noname-f con 0x7fae74134970 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient(hunting): picked mon.noname-i con 0x7fae7413e200 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7413a370 con 0x7fae74134970 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7413bc30 con 0x7fae740a4820 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae741396d0 con 0x7fae7413e200 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient(hunting): authenticate will time out at 1218.496526s 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae78822640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fae740a4820 0x7fae741388b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:44212/0 (socket says 172.21.15.106:44212) 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae78822640 1 -- 172.21.15.106:0/204735396 learned_addr learned my addr 172.21.15.106:0/204735396 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae73fff640 1 --1- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6789/0 conn(0x7fae74134970 0x7fae74138fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:48076/0 (socket says 172.21.15.106:48076) 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017182419 0 0) 0x7fae7413bc30 con 0x7fae740a4820 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): my global_id is 6114 2024-04-25T23:59:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae60003530 con 0x7fae740a4820 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2735628577 0 0) 0x7fae7413a370 con 0x7fae74134970 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): my global_id is 144361 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae7413bc30 con 0x7fae74134970 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650830398 0 0) 0x7fae741396d0 con 0x7fae7413e200 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): my global_id is 144232 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae7413a370 con 0x7fae7413e200 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3333400782 0 0) 0x7fae60003530 con 0x7fae740a4820 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae741396d0 con 0x7fae740a4820 2024-04-25T23:59:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae6c0018e0 con 0x7fae740a4820 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1042399850 0 0) 0x7fae7413a370 con 0x7fae7413e200 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae60003530 con 0x7fae7413e200 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3289753832 0 0) 0x7fae7413bc30 con 0x7fae74134970 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae7413a370 con 0x7fae74134970 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae64004090 con 0x7fae7413e200 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae680016a0 con 0x7fae74134970 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient(hunting): dump: 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3064123105 0 0) 0x7fae741396d0 con 0x7fae740a4820 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6792/0 conn(0x7fae7413e200 legacy=0x7fae741d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6789/0 conn(0x7fae74134970 legacy=0x7fae74138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 monclient: found mon.g 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae740a1a40 con 0x7fae740a4820 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 5 monclient: authenticate success, global_id 6114 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient: _renew_subs 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae7413b950 con 0x7fae740a4820 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient: _renew_subs 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fae7413c410 con 0x7fae740a4820 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae6c001b40 con 0x7fae740a4820 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae6c0051e0 con 0x7fae740a4820 2024-04-25T23:59:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae72ffd640 4 set_mon_vals no callback set 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 10 monclient: dump: 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae540065d0 con 0x7fae54002870 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fae6c00ff80 con 0x7fae740a4820 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.969+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(110..110 src has 1..110) ==== 5861+0+0 (unknown 3797382526 0 0) 0x7fae6c045010 con 0x7fae740a4820 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363572968 0 0) 0x7fae540065d0 con 0x7fae54002870 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient(hunting): my global_id is 5792 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae741396d0 con 0x7fae54002870 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae79023640 10 monclient: get_auth_request con 0x7fae60038190 auth_method 0 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1656098019 0 0) 0x7fae741396d0 con 0x7fae54002870 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae540065d0 con 0x7fae54002870 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae68001d50 con 0x7fae54002870 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient: dump: 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 938493826 0 0) 0x7fae540065d0 con 0x7fae54002870 2024-04-25T23:59:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae5400a160 con 0x7fae54002870 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fae68003d60 con 0x7fae54002870 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6791/0 conn(0x7fae54002870 legacy=0x7fae54004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.973+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6791/0 conn(0x7fae54002870 legacy=0x7fae54004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.977+0000 7fae7aa86640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.977+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae54009e50 con 0x7fae54009110 2024-04-25T23:59:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1657120193 0 0) 0x7fae54009e50 con 0x7fae54009110 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient(hunting): my global_id is 5801 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae540065d0 con 0x7fae54009110 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2404035767 0 0) 0x7fae540065d0 con 0x7fae54009110 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae54009e50 con 0x7fae54009110 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae68004540 con 0x7fae54009110 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient: dump: 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2652864010 0 0) 0x7fae54009e50 con 0x7fae54009110 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fae5400c3e0 con 0x7fae54009110 2024-04-25T23:59:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 1266559920) 0x7fae680048b0 con 0x7fae54009110 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6791/0 conn(0x7fae54009110 legacy=0x7fae540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae717fa640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6791/0 conn(0x7fae54009110 legacy=0x7fae540095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:22.978 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 281481, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:22.979 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:22.980 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:22.981 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:22.982 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:22.983 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:22.984 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.986 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.987 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.989 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:22.990 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.992 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:22.994 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.995 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.996 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:22.997 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:22.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6812/722422047 conn(0x7fae60038190 legacy=0x7fae6003a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 10 monclient: shutdown 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 >> v1:172.21.15.171:6790/0 conn(0x7fae740a4820 legacy=0x7fae741388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae79023640 1 -- 172.21.15.106:0/204735396 reap_dead start 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae79023640 1 -- 172.21.15.106:0/204735396 reap_dead start 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 shutdown_connections 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 >> 172.21.15.106:0/204735396 conn(0x7fae740a9e20 msgr2=0x7fae740a85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 shutdown_connections 2024-04-25T23:59:22.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:22.981+0000 7fae7aa86640 1 -- 172.21.15.106:0/204735396 wait complete. 2024-04-25T23:59:22.999 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:23.000 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-04-25T23:59:23.000 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-25T23:59:23.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.121+0000 7f81516b5640 10 monclient: get_monmap_and_config 2024-04-25T23:59:23.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.121+0000 7f81516b5640 10 monclient: build_initial_monmap 2024-04-25T23:59:23.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: monmap: 2024-04-25T23:59:23.105 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:23.105 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.105 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:59:23.126340+0000 2024-04-25T23:59:23.105 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:59:23.126340+0000 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:23.106 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 Processor -- start 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- start start 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: init 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: _add_conns ranks=[8,1,6,0,7,5,3,4,2] 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient(hunting): picked mon.noname-e con 0x7f814c135870 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient(hunting): picked mon.noname-f con 0x7f814c1353b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient(hunting): picked mon.noname-d con 0x7f814c13bdf0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814c06f2d0 con 0x7f814c1353b0 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814c072330 con 0x7f814c13bdf0 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814c072610 con 0x7f814c135870 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient(hunting): authenticate will time out at 1218.653402s 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f814affd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f814c135870 legacy=0x7f814c135c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:23.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f814b7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f814c13bdf0 0x7f814c13e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:37130/0 (socket says 172.21.15.106:37130) 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f814b7fe640 1 -- 172.21.15.106:0/714577878 learned_addr learned my addr 172.21.15.106:0/714577878 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387316822 0 0) 0x7f814c072330 con 0x7f814c13bdf0 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient(hunting): my global_id is 5964 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8134003530 con 0x7f814c13bdf0 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2162961423 0 0) 0x7f8134003530 con 0x7f814c13bdf0 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 >> v1:172.21.15.106:6793/0 conn(0x7f814c135870 legacy=0x7f814c135c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 >> v1:172.21.15.171:6789/0 conn(0x7f814c1353b0 legacy=0x7f814c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 monclient: found mon.noname-d 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:23.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814c0a3260 con 0x7f814c13bdf0 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 5 monclient: authenticate success, global_id 5964 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8144001b40 con 0x7f814c13bdf0 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: dump: 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:23.116 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8144001e70 con 0x7f814c13bdf0 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 4 set_mon_vals no callback set 2024-04-25T23:59:23.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 1 -- 172.21.15.106:0/714577878 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8144004f70 con 0x7f814c13bdf0 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f8149ffb640 10 monclient: dump: 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:23.118 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: shutdown 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- 172.21.15.106:0/714577878 >> v1:172.21.15.106:6792/0 conn(0x7f814c13bdf0 legacy=0x7f814c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- 172.21.15.106:0/714577878 shutdown_connections 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- 172.21.15.106:0/714577878 >> 172.21.15.106:0/714577878 conn(0x7f814c0a64e0 msgr2=0x7f814c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- 172.21.15.106:0/714577878 shutdown_connections 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- 172.21.15.106:0/714577878 wait complete. 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: build_initial_monmap 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: monmap: 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-25T23:59:23.119 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 Processor -- start 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 1 -- start start 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.125+0000 7f81516b5640 10 monclient: init 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient: _add_conns ranks=[3,2,0,1,7,6,8,4,5] 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient(hunting): picked mon.noname-g con 0x7f814c1353b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient(hunting): picked mon.noname-b con 0x7f814c135870 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient(hunting): picked mon.noname-a con 0x7f814c13bdf0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814c09f470 con 0x7f814c13bdf0 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814c09e530 con 0x7f814c135870 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f814c131ad0 con 0x7f814c1353b0 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient(hunting): authenticate will time out at 1218.656251s 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f814a7fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f814c135870 0x7f814c1cf1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39252/0 (socket says 172.21.15.106:39252) 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f814b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f814c13bdf0 0x7f814c1d2910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:47612/0 (socket says 172.21.15.106:47612) 2024-04-25T23:59:23.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f814a7fc640 1 -- 172.21.15.106:0/967217812 learned_addr learned my addr 172.21.15.106:0/967217812 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573742394 0 0) 0x7f814c09f470 con 0x7f814c13bdf0 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): my global_id is 6030 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8138003530 con 0x7f814c13bdf0 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968591515 0 0) 0x7f814c09e530 con 0x7f814c135870 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): my global_id is 5879 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f814c09f470 con 0x7f814c135870 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2289726597 0 0) 0x7f8138003530 con 0x7f814c13bdf0 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f814c09e530 con 0x7f814c13bdf0 2024-04-25T23:59:23.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3411508379 0 0) 0x7f814c09f470 con 0x7f814c135870 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8138003530 con 0x7f814c135870 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8140001a40 con 0x7f814c135870 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): dump: 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:23.123 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8144004eb0 con 0x7f814c13bdf0 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): dump: 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.124 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2979837051 0 0) 0x7f814c131ad0 con 0x7f814c1353b0 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:23.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): my global_id is 6123 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f814c09f470 con 0x7f814c1353b0 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 841811085 0 0) 0x7f814c09e530 con 0x7f814c13bdf0 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.171:6790/0 conn(0x7f814c1353b0 legacy=0x7f814c1348b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.106:6790/0 conn(0x7f814c135870 legacy=0x7f814c1cf1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 monclient: found mon.a 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f814c134fc0 con 0x7f814c13bdf0 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 5 monclient: authenticate success, global_id 6030 2024-04-25T23:59:23.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient: _renew_subs 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f814c1ca3b0 con 0x7f814c13bdf0 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient: _renew_subs 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f814c130db0 con 0x7f814c13bdf0 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8144001e70 con 0x7f814c13bdf0 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f81440020a0 con 0x7f814c13bdf0 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81497fa640 4 set_mon_vals no callback set 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: dump: 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:23.127 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f81440103d0 con 0x7f814c13bdf0 2024-04-25T23:59:23.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f812c0065d0 con 0x7f812c002870 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(110..110 src has 1..110) ==== 5861+0+0 (unknown 3797382526 0 0) 0x7f8144045140 con 0x7f814c13bdf0 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f814a7fc640 10 monclient: get_auth_request con 0x7f8138037e00 auth_method 0 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3731807242 0 0) 0x7f812c0065d0 con 0x7f812c002870 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient(hunting): my global_id is 144241 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f814c09e530 con 0x7f812c002870 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 840710514 0 0) 0x7f814c09e530 con 0x7f812c002870 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f812c0065d0 con 0x7f812c002870 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f813c0041d0 con 0x7f812c002870 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:23.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 10 monclient: dump: 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:23.130 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2843821161 0 0) 0x7f812c0065d0 con 0x7f812c002870 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.129+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f812c00a160 con 0x7f812c002870 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.133+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f813c0065e0 con 0x7f812c002870 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.133+0000 7f81337fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.133+0000 7f81337fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.133+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.171:6792/0 conn(0x7f812c002870 legacy=0x7f812c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.133+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.171:6792/0 conn(0x7f812c002870 legacy=0x7f812c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:23.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81516b5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-25T23:59:23.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f812c009e30 con 0x7f812c0090f0 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219042559 0 0) 0x7f812c009e30 con 0x7f812c0090f0 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 10 monclient(hunting): my global_id is 144250 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f812c0065d0 con 0x7f812c0090f0 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 319115339 0 0) 0x7f812c0065d0 con 0x7f812c0090f0 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f812c009e30 con 0x7f812c0090f0 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f813c004b30 con 0x7f812c0090f0 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 10 monclient: dump: 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-25T23:59:23.133 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-25T23:59:23.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1284484242 0 0) 0x7f812c009e30 con 0x7f812c0090f0 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.137+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f812c00c3a0 con 0x7f812c0090f0 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7553 (unknown 0 0 3194872333) 0x7f813c005f00 con 0x7f812c0090f0 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81337fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81337fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.171:6792/0 conn(0x7f812c0090f0 legacy=0x7f812c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81337fe640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.171:6792/0 conn(0x7f812c0090f0 legacy=0x7f812c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-25T23:59:23.135 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 38, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 26667, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:23.136 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-25T23:59:23.137 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.138 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-25T23:59:23.139 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-25T23:59:23.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-25T23:59:23.141 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.142 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.143 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-25T23:59:23.144 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-25T23:59:23.146 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.147 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.148 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.149 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-25T23:59:23.150 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-25T23:59:23.152 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-25T23:59:23.153 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-25T23:59:23.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-25T23:59:23.153 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-25T23:59:23.153 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-25T23:59:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.171:6812/722422047 conn(0x7f8138037e00 legacy=0x7f813803a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 10 monclient: shutdown 2024-04-25T23:59:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 >> v1:172.21.15.106:6789/0 conn(0x7f814c13bdf0 legacy=0x7f814c1d2910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f814b7fe640 1 -- 172.21.15.106:0/967217812 reap_dead start 2024-04-25T23:59:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f814b7fe640 1 -- 172.21.15.106:0/967217812 reap_dead start 2024-04-25T23:59:23.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 shutdown_connections 2024-04-25T23:59:23.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 >> 172.21.15.106:0/967217812 conn(0x7f814c0a64e0 msgr2=0x7f814c0a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:23.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 shutdown_connections 2024-04-25T23:59:23.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-25T23:59:23.141+0000 7f81516b5640 1 -- 172.21.15.106:0/967217812 wait complete. 2024-04-25T23:59:23.155 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-25T23:59:23.155 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-25T23:59:23.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:23.567+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}]=0 reweighted subtree id -10 name 'foobaz' to 155 in crush map v111) ==== 168+0+0 (unknown 1314649835 0 0) 0x7f4d24015150 con 0x7f4d3c0a4da0 2024-04-25T23:59:23.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:23.567+0000 7f4d397fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}] 2024-04-25T23:59:23.553 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:23.567+0000 7f4d397fa640 10 monclient: _finish_command 2 = system:0 reweighted subtree id -10 name 'foobaz' to 155 in crush map 2024-04-25T23:59:23.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:23.667+0000 7f4d42c8f640 10 start_mon_command cmd=[{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}] 2024-04-25T23:59:23.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:23.667+0000 7f4d42c8f640 10 monclient: _send_command 3 [{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}] 2024-04-25T23:59:23.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:23.667+0000 7f4d42c8f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:23.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:23.667+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0} v 0) -- 0x7f4d20005ac0 con 0x7f4d3c0a4da0 2024-04-25T23:59:24.566 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d397fa640 1 -- 172.21.15.171:0/2888893774 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}]=0 reweighted subtree id -10 name 'foobaz' to 155 in crush map v112) ==== 168+0+0 (unknown 435931192 0 0) 0x7f4d2401dd60 con 0x7f4d3c0a4da0 2024-04-25T23:59:24.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d397fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 155.0}] 2024-04-25T23:59:24.567 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d397fa640 10 monclient: _finish_command 3 = system:0 reweighted subtree id -10 name 'foobaz' to 155 in crush map 2024-04-25T23:59:24.567 INFO:tasks.workunit.client.0.smithi171.stderr:reweighted subtree id -10 name 'foobaz' to 155 in crush map 2024-04-25T23:59:24.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 >> v1:172.21.15.171:6812/722422047 conn(0x7f4d1c037ca0 legacy=0x7f4d1c03a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:24.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d42c8f640 10 monclient: shutdown 2024-04-25T23:59:24.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d42c8f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:24.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 >> v1:172.21.15.106:6791/0 conn(0x7f4d3c0a4da0 legacy=0x7f4d3c070f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:24.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 shutdown_connections 2024-04-25T23:59:24.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.583+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 >> 172.21.15.171:0/2888893774 conn(0x7f4d3c0a6c90 msgr2=0x7f4d3c141b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:24.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.587+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 shutdown_connections 2024-04-25T23:59:24.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.587+0000 7f4d42c8f640 1 -- 172.21.15.171:0/2888893774 wait complete. 2024-04-25T23:59:24.589 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush reweight-subtree foobaz 123456 2024-04-25T23:59:24.589 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:59:24.589 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush reweight-subtree foobaz 123456 2024-04-25T23:59:24.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient: get_monmap_and_config 2024-04-25T23:59:24.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient: build_initial_monmap 2024-04-25T23:59:24.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient: monmap: 2024-04-25T23:59:24.708 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:24.708 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:24.729024+0000 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:24.729024+0000 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:24.709 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:24.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 1 Processor -- start 2024-04-25T23:59:24.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 1 -- start start 2024-04-25T23:59:24.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient: init 2024-04-25T23:59:24.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient: _add_conns ranks=[7,0,3,5,6,2,1,8,4] 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient(hunting): picked mon.noname-i con 0x7f41ac137de0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient(hunting): picked mon.noname-a con 0x7f41ac09cd90 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient(hunting): picked mon.noname-g con 0x7f41ac13e360 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41ac09c950 con 0x7f41ac09cd90 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41ac09bf70 con 0x7f41ac13e360 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41ac09c250 con 0x7f41ac137de0 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.723+0000 7f41b1145640 10 monclient(hunting): authenticate will time out at 1215.435873s 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41ab59e640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f41ac13e360 0x7f41ac140750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48580/0 (socket says 172.21.15.171:48580) 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41ab59e640 1 -- 172.21.15.171:0/984290106 learned_addr learned my addr 172.21.15.171:0/984290106 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41aad9d640 1 --1- 172.21.15.171:0/984290106 >> v1:172.21.15.171:6792/0 conn(0x7f41ac137de0 0x7f41ac1381c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52782/0 (socket says 172.21.15.171:52782) 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2682811825 0 0) 0x7f41ac09bf70 con 0x7f41ac13e360 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:24.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): my global_id is 6132 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4194003530 con 0x7f41ac13e360 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1391026760 0 0) 0x7f41ac09c250 con 0x7f41ac137de0 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient(hunting): my global_id is 144259 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41ac09bf70 con 0x7f41ac137de0 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4053913412 0 0) 0x7f4194003530 con 0x7f41ac13e360 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 >> v1:172.21.15.171:6792/0 conn(0x7f41ac137de0 legacy=0x7f41ac1381c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 >> v1:172.21.15.106:6789/0 conn(0x7f41ac09cd90 legacy=0x7f41ac13cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:24.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 monclient: found mon.noname-g 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ac09d1b0 con 0x7f41ac13e360 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: _finish_auth 0 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41a4001b40 con 0x7f41ac13e360 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: dump: 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.719 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 5 monclient: authenticate success, global_id 6132 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:24.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41a4001e60 con 0x7f41ac13e360 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 4 set_mon_vals no callback set 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 1 -- 172.21.15.171:0/984290106 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41a4004f70 con 0x7f41ac13e360 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a9d9b640 10 monclient: dump: 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:24.721 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: shutdown 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- 172.21.15.171:0/984290106 >> v1:172.21.15.171:6790/0 conn(0x7f41ac13e360 legacy=0x7f41ac140750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- 172.21.15.171:0/984290106 shutdown_connections 2024-04-25T23:59:24.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- 172.21.15.171:0/984290106 >> 172.21.15.171:0/984290106 conn(0x7f41ac0a2de0 msgr2=0x7f41ac0a31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- 172.21.15.171:0/984290106 shutdown_connections 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- 172.21.15.171:0/984290106 wait complete. 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: build_initial_monmap 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: monmap: 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:24.723 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 Processor -- start 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- start start 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: init 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: _add_conns ranks=[4,7,6,1,5,2,0,3,8] 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient(hunting): picked mon.noname-c con 0x7f41ac09cd90 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient(hunting): picked mon.noname-i con 0x7f41ac137de0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient(hunting): picked mon.noname-d con 0x7f41ac13e360 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:24.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41ac09b6a0 con 0x7f41ac09cd90 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41ac071dc0 con 0x7f41ac13e360 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41ac138cd0 con 0x7f41ac137de0 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient(hunting): authenticate will time out at 1215.438902s 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41aa59c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f41ac137de0 0x7f41ac1d1890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52796/0 (socket says 172.21.15.171:52796) 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41aa59c640 1 -- 172.21.15.171:0/2981300338 learned_addr learned my addr 172.21.15.171:0/2981300338 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384432021 0 0) 0x7f41ac138cd0 con 0x7f41ac137de0 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:24.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): my global_id is 144268 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4198003530 con 0x7f41ac137de0 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2311259692 0 0) 0x7f4198003530 con 0x7f41ac137de0 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41ac138cd0 con 0x7f41ac137de0 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41a0001a00 con 0x7f41ac137de0 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): dump: 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:24.726 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:24.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1734645144 0 0) 0x7f41ac09b6a0 con 0x7f41ac09cd90 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient(hunting): my global_id is 144400 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4198003530 con 0x7f41ac09cd90 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1881660417 0 0) 0x7f41ac138cd0 con 0x7f41ac137de0 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 >> v1:172.21.15.106:6792/0 conn(0x7f41ac13e360 legacy=0x7f41ac1d4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 >> v1:172.21.15.106:6791/0 conn(0x7f41ac09cd90 legacy=0x7f41ac13cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 monclient: found mon.i 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:24.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41ac138960 con 0x7f41ac137de0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 5 monclient: authenticate success, global_id 144268 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: _renew_subs 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41ac132010 con 0x7f41ac137de0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: _renew_subs 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41b1145640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f41ac13d3a0 con 0x7f41ac137de0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41a0003950 con 0x7f41ac137de0 2024-04-25T23:59:24.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41a0003ec0 con 0x7f41ac137de0 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41a959a640 4 set_mon_vals no callback set 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.727+0000 7f41937fe640 10 monclient: dump: 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:24.730 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.731+0000 7f41b1145640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.731+0000 7f41b1145640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.731+0000 7f41b1145640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.731+0000 7f41b1145640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f418c005090 con 0x7f41ac137de0 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.731+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f41a00040e0 con 0x7f41ac137de0 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.731+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(112..112 src has 1..112) ==== 5861+0+0 (unknown 3236095501 0 0) 0x7f41a0044cf0 con 0x7f41ac137de0 2024-04-25T23:59:24.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.731+0000 7f41aad9d640 10 monclient: get_auth_request con 0x7f4198037890 auth_method 0 2024-04-25T23:59:24.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.735+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f41ac09c950 con 0x7f41ac137de0 2024-04-25T23:59:24.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.735+0000 7f41937fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:24.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.735+0000 7f41937fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:24.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.903+0000 7f41b1145640 10 start_mon_command cmd=[{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 123456.0}] 2024-04-25T23:59:24.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.903+0000 7f41b1145640 10 monclient: _send_command 2 [{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 123456.0}] 2024-04-25T23:59:24.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.903+0000 7f41b1145640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:24.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.903+0000 7f41b1145640 1 -- 172.21.15.171:0/2981300338 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 123456.0} v 0) -- 0x7f418c005380 con 0x7f41ac137de0 2024-04-25T23:59:24.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.903+0000 7f41937fe640 1 -- 172.21.15.171:0/2981300338 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 123456.0}]=-75 (75) Value too large for defined data type v112) ==== 154+0+0 (unknown 703388148 0 0) 0x7f41a0015890 con 0x7f41ac137de0 2024-04-25T23:59:24.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.903+0000 7f41937fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush reweight-subtree", "name": "foobaz", "weight": 123456.0}] 2024-04-25T23:59:24.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:24.903+0000 7f41937fe640 10 monclient: _finish_command 2 = mon:75 (75) Value too large for defined data type 2024-04-25T23:59:24.888 INFO:tasks.workunit.client.0.smithi171.stderr:Error EOVERFLOW: (75) Value too large for defined data type 2024-04-25T23:59:24.892 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:59:24.892 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:59:24.892 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep osd.12 2024-04-25T23:59:24.893 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 155 2024-04-25T23:59:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.019+0000 7fbf0033e640 10 monclient: get_monmap_and_config 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.019+0000 7fbf0033e640 10 monclient: build_initial_monmap 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.019+0000 7fbf0033e640 10 monclient: monmap: 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:25.026175+0000 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:25.026175+0000 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:25.007 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 Processor -- start 2024-04-25T23:59:25.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- start start 2024-04-25T23:59:25.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: init 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: _add_conns ranks=[3,2,4,1,0,7,8,5,6] 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient(hunting): picked mon.noname-g con 0x7fbef809bb70 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient(hunting): picked mon.noname-b con 0x7fbef80a1a40 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient(hunting): picked mon.noname-c con 0x7fbef809c660 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef80a2000 con 0x7fbef80a1a40 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef809e220 con 0x7fbef809bb70 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef809f580 con 0x7fbef809c660 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient(hunting): authenticate will time out at 1215.733110s 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefe0da640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbef809bb70 0x7fbef809bf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48590/0 (socket says 172.21.15.171:48590) 2024-04-25T23:59:25.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefe0da640 1 -- 172.21.15.171:0/2391500073 learned_addr learned my addr 172.21.15.171:0/2391500073 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3938600067 0 0) 0x7fbef809e220 con 0x7fbef809bb70 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient(hunting): my global_id is 6141 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbee4005740 con 0x7fbef809bb70 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1193156404 0 0) 0x7fbee4005740 con 0x7fbef809bb70 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 >> v1:172.21.15.106:6791/0 conn(0x7fbef809c660 legacy=0x7fbef813d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 >> v1:172.21.15.106:6790/0 conn(0x7fbef80a1a40 legacy=0x7fbef8139b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: _finish_hunting 0 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 monclient: found mon.noname-g 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:25.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef809d310 con 0x7fbef809bb70 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: _finish_auth 0 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: _check_auth_tickets 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 5 monclient: authenticate success, global_id 6141 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbef40017c0 con 0x7fbef809bb70 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: dump: 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.017 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:25.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbef4001aa0 con 0x7fbef809bb70 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 1 -- 172.21.15.171:0/2391500073 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbef4004bf0 con 0x7fbef809bb70 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 4 set_mon_vals no callback set 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbefd0d8640 10 monclient: dump: 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.019 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: shutdown 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:25.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- 172.21.15.171:0/2391500073 >> v1:172.21.15.171:6790/0 conn(0x7fbef809bb70 legacy=0x7fbef809bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- 172.21.15.171:0/2391500073 shutdown_connections 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- 172.21.15.171:0/2391500073 >> 172.21.15.171:0/2391500073 conn(0x7fbef80a28a0 msgr2=0x7fbef80a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- 172.21.15.171:0/2391500073 shutdown_connections 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- 172.21.15.171:0/2391500073 wait complete. 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: build_initial_monmap 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: monmap: 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:25.021 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 Processor -- start 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 1 -- start start 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.023+0000 7fbf0033e640 10 monclient: init 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:25.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _add_conns ranks=[4,6,0,8,2,3,5,7,1] 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient(hunting): picked mon.noname-c con 0x7fbef809bb70 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient(hunting): picked mon.noname-d con 0x7fbef809c660 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient(hunting): picked mon.noname-a con 0x7fbef80a1a40 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef81a5ea0 con 0x7fbef80a1a40 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef809fbe0 con 0x7fbef809bb70 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbef81a5bc0 con 0x7fbef809c660 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient(hunting): authenticate will time out at 1215.736239s 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbefd8d9640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fbef809c660 0x7fbef81cd100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:45066/0 (socket says 172.21.15.171:45066) 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbefe0da640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fbef809bb70 0x7fbef81b84e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:36042/0 (socket says 172.21.15.171:36042) 2024-04-25T23:59:25.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbefe8db640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbef80a1a40 0x7fbef81d0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:57810/0 (socket says 172.21.15.171:57810) 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbefd8d9640 1 -- 172.21.15.171:0/3982574259 learned_addr learned my addr 172.21.15.171:0/3982574259 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479575573 0 0) 0x7fbef81a5ea0 con 0x7fbef80a1a40 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): my global_id is 6048 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbedc003530 con 0x7fbef80a1a40 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735728991 0 0) 0x7fbef809fbe0 con 0x7fbef809bb70 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): my global_id is 144418 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbef81a5ea0 con 0x7fbef809bb70 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4201370966 0 0) 0x7fbef81a5bc0 con 0x7fbef809c660 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): my global_id is 5982 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbef809fbe0 con 0x7fbef809c660 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2113979465 0 0) 0x7fbef809fbe0 con 0x7fbef809c660 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbef81a5bc0 con 0x7fbef809c660 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3855977954 0 0) 0x7fbef81a5ea0 con 0x7fbef809bb70 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbef809fbe0 con 0x7fbef809bb70 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbee8001980 con 0x7fbef809c660 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): dump: 2024-04-25T23:59:25.025 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.026 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbef4004b30 con 0x7fbef809bb70 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): dump: 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.027 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2152864134 0 0) 0x7fbedc003530 con 0x7fbef80a1a40 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbef81a5ea0 con 0x7fbef80a1a40 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbef0001d60 con 0x7fbef80a1a40 2024-04-25T23:59:25.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient(hunting): dump: 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.029 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1974909276 0 0) 0x7fbef81a5bc0 con 0x7fbef809c660 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 >> v1:172.21.15.106:6791/0 conn(0x7fbef809bb70 legacy=0x7fbef81b84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 >> v1:172.21.15.106:6789/0 conn(0x7fbef80a1a40 legacy=0x7fbef81d0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 monclient: found mon.d 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:25.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef81a4420 con 0x7fbef809c660 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 5 monclient: authenticate success, global_id 5982 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _renew_subs 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbef81b8bf0 con 0x7fbef809c660 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _renew_subs 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbef81b9050 con 0x7fbef809c660 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbee80038d0 con 0x7fbef809c660 2024-04-25T23:59:25.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbee8001d50 con 0x7fbef809c660 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbefc8d7640 4 set_mon_vals no callback set 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 10 monclient: dump: 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.032 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee0005090 con 0x7fbef809c660 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbee8003e40 con 0x7fbef809c660 2024-04-25T23:59:25.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(112..112 src has 1..112) ==== 5861+0+0 (unknown 3236095501 0 0) 0x7fbee8044c80 con 0x7fbef809c660 2024-04-25T23:59:25.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.027+0000 7fbefe0da640 10 monclient: get_auth_request con 0x7fbedc0381a0 auth_method 0 2024-04-25T23:59:25.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.043+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbee8015610 con 0x7fbef809c660 2024-04-25T23:59:25.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.043+0000 7fbeeeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.043+0000 7fbeeeffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:25.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.203+0000 7fbf0033e640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:25.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.203+0000 7fbf0033e640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.203+0000 7fbf0033e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:25.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.203+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fbee0005b90 con 0x7fbef809c660 2024-04-25T23:59:25.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.203+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v112) ==== 56+0+1449 (unknown 3664589273 0 393162120) 0x7fbee8014f10 con 0x7fbef809c660 2024-04-25T23:59:25.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.203+0000 7fbeeeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.203+0000 7fbeeeffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:25.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.299+0000 7fbf0033e640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.299+0000 7fbf0033e640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.299+0000 7fbf0033e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.299+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fbee00008e0 con 0x7fbef809c660 2024-04-25T23:59:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbeeeffd640 1 -- 172.21.15.171:0/3982574259 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v112) ==== 56+0+1449 (unknown 3664589273 0 393162120) 0x7fbee8019260 con 0x7fbef809c660 2024-04-25T23:59:25.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbeeeffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbeeeffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 >> v1:172.21.15.171:6812/722422047 conn(0x7fbedc0381a0 legacy=0x7fbedc03a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 10 monclient: shutdown 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 >> v1:172.21.15.106:6792/0 conn(0x7fbef809c660 legacy=0x7fbef81cd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 shutdown_connections 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 >> 172.21.15.171:0/3982574259 conn(0x7fbef80a28a0 msgr2=0x7fbef80a4530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 shutdown_connections 2024-04-25T23:59:25.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.303+0000 7fbf0033e640 1 -- 172.21.15.171:0/3982574259 wait complete. 2024-04-25T23:59:25.302 INFO:tasks.workunit.client.0.smithi171.stdout: 12 155.00000 osd.12 down 1.00000 1.00000 2024-04-25T23:59:25.303 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd tree 2024-04-25T23:59:25.303 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 155 2024-04-25T23:59:25.303 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep osd.14 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient: get_monmap_and_config 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient: build_initial_monmap 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient: monmap: 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:25.436712+0000 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:25.436712+0000 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:25.416 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:25.417 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 1 Processor -- start 2024-04-25T23:59:25.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 1 -- start start 2024-04-25T23:59:25.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient: init 2024-04-25T23:59:25.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:25.423 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient: _add_conns ranks=[3,1,6,7,5,0,8,4,2] 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient(hunting): picked mon.noname-g con 0x7fdee809f330 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient(hunting): picked mon.noname-f con 0x7fdee80a0060 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient(hunting): picked mon.noname-d con 0x7fdee813e3a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee809c660 con 0x7fdee80a0060 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee809fe20 con 0x7fdee809f330 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee809c0a0 con 0x7fdee813e3a0 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdeed8d5640 10 monclient(hunting): authenticate will time out at 1216.143624s 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdee67fc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fdee80a0060 0x7fdee813cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54794/0 (socket says 172.21.15.171:54794) 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdee67fc640 1 -- 172.21.15.171:0/2699833706 learned_addr learned my addr 172.21.15.171:0/2699833706 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.431+0000 7fdee6ffd640 1 --1- 172.21.15.171:0/2699833706 >> v1:172.21.15.171:6790/0 conn(0x7fdee809f330 0x7fdee809f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48602/0 (socket says 172.21.15.171:48602) 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563467425 0 0) 0x7fdee809fe20 con 0x7fdee809f330 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.424 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): my global_id is 6150 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fded4003530 con 0x7fdee809f330 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357194302 0 0) 0x7fded0001120 con 0x7fdee80a0060 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient(hunting): my global_id is 144370 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdee809fe20 con 0x7fdee80a0060 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3637717626 0 0) 0x7fded4003530 con 0x7fdee809f330 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 >> v1:172.21.15.106:6792/0 conn(0x7fdee813e3a0 legacy=0x7fdee8140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 >> v1:172.21.15.171:6789/0 conn(0x7fdee80a0060 legacy=0x7fdee813cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 monclient: found mon.noname-g 2024-04-25T23:59:25.425 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee809c380 con 0x7fdee809f330 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdee00016f0 con 0x7fdee809f330 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: dump: 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.426 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 5 monclient: authenticate success, global_id 6150 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdee0001950 con 0x7fdee809f330 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 1 -- 172.21.15.171:0/2699833706 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdee00047f0 con 0x7fdee809f330 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee5ffb640 10 monclient: dump: 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.428 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 4 set_mon_vals no callback set 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: shutdown 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- 172.21.15.171:0/2699833706 >> v1:172.21.15.171:6790/0 conn(0x7fdee809f330 legacy=0x7fdee809f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- 172.21.15.171:0/2699833706 shutdown_connections 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- 172.21.15.171:0/2699833706 >> 172.21.15.171:0/2699833706 conn(0x7fdee80a28a0 msgr2=0x7fdee80a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- 172.21.15.171:0/2699833706 shutdown_connections 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- 172.21.15.171:0/2699833706 wait complete. 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: build_initial_monmap 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: monmap: 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:25.430 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 Processor -- start 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- start start 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: init 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: _add_conns ranks=[0,1,4,6,7,5,8,2,3] 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient(hunting): picked mon.noname-a con 0x7fdee809f330 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient(hunting): picked mon.noname-f con 0x7fdee80a0060 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient(hunting): picked mon.noname-c con 0x7fdee813e3a0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee8136ec0 con 0x7fdee809f330 2024-04-25T23:59:25.431 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee8122150 con 0x7fdee80a0060 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdee81cd390 con 0x7fdee813e3a0 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient(hunting): authenticate will time out at 1216.146577s 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee67fc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fdee80a0060 0x7fdee81d17f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54806/0 (socket says 172.21.15.171:54806) 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee67fc640 1 -- 172.21.15.171:0/3734661739 learned_addr learned my addr 172.21.15.171:0/3734661739 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2692156852 0 0) 0x7fdee8122150 con 0x7fdee80a0060 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): my global_id is 144379 2024-04-25T23:59:25.432 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdec8003530 con 0x7fdee80a0060 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 61663745 0 0) 0x7fdec8003530 con 0x7fdee80a0060 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdee8122150 con 0x7fdee80a0060 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fded0001730 con 0x7fdee80a0060 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): dump: 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.433 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1697695530 0 0) 0x7fdee8122150 con 0x7fdee80a0060 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 >> v1:172.21.15.106:6791/0 conn(0x7fdee813e3a0 legacy=0x7fdee81d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.434 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 >> v1:172.21.15.106:6789/0 conn(0x7fdee809f330 legacy=0x7fdee81367b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 monclient: found mon.f 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdee809b800 con 0x7fdee80a0060 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: _finish_auth 0 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 5 monclient: authenticate success, global_id 144379 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: _renew_subs 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdee809b2b0 con 0x7fdee80a0060 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: _renew_subs 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:25.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdee81c3490 con 0x7fdee80a0060 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fded0004b10 con 0x7fdee80a0060 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fded0005080 con 0x7fdee80a0060 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdee57fa640 4 set_mon_vals no callback set 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.435+0000 7fdedffff640 10 monclient: dump: 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.436 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.439+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fded00052a0 con 0x7fdee80a0060 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.439+0000 7fdeed8d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.439+0000 7fdeed8d5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.439+0000 7fdeed8d5640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.439+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdecc005090 con 0x7fdee80a0060 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.439+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(112..112 src has 1..112) ==== 5861+0+0 (unknown 3236095501 0 0) 0x7fded0044f90 con 0x7fdee80a0060 2024-04-25T23:59:25.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.439+0000 7fdee6ffd640 10 monclient: get_auth_request con 0x7fdec80377d0 auth_method 0 2024-04-25T23:59:25.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.443+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdee809c660 con 0x7fdee80a0060 2024-04-25T23:59:25.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.443+0000 7fdedffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.443+0000 7fdedffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:25.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.607+0000 7fdeed8d5640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:25.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.607+0000 7fdeed8d5640 10 monclient: _send_command 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.607+0000 7fdeed8d5640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:25.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.607+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fdecc005b90 con 0x7fdee80a0060 2024-04-25T23:59:25.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.607+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v112) ==== 56+0+1449 (unknown 3664589273 0 393162120) 0x7fded0015980 con 0x7fdee80a0060 2024-04-25T23:59:25.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.607+0000 7fdedffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.607+0000 7fdedffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:25.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.695+0000 7fdeed8d5640 10 start_mon_command cmd=[{"prefix": "osd tree"}] 2024-04-25T23:59:25.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.695+0000 7fdeed8d5640 10 monclient: _send_command 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.695+0000 7fdeed8d5640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:25.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.695+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd tree"} v 0) -- 0x7fdecc006740 con 0x7fdee80a0060 2024-04-25T23:59:25.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.695+0000 7fdedffff640 1 -- 172.21.15.171:0/3734661739 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd tree"}]=0 v112) ==== 56+0+1449 (unknown 3664589273 0 393162120) 0x7fded0015280 con 0x7fdee80a0060 2024-04-25T23:59:25.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.695+0000 7fdedffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd tree"}] 2024-04-25T23:59:25.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.695+0000 7fdedffff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:25.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 >> v1:172.21.15.171:6812/722422047 conn(0x7fdec80377d0 legacy=0x7fdec8039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 10 monclient: shutdown 2024-04-25T23:59:25.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:25.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 >> v1:172.21.15.171:6789/0 conn(0x7fdee80a0060 legacy=0x7fdee81d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 shutdown_connections 2024-04-25T23:59:25.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 >> 172.21.15.171:0/3734661739 conn(0x7fdee80a28a0 msgr2=0x7fdee80a2140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:25.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 shutdown_connections 2024-04-25T23:59:25.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.699+0000 7fdeed8d5640 1 -- 172.21.15.171:0/3734661739 wait complete. 2024-04-25T23:59:25.696 INFO:tasks.workunit.client.0.smithi171.stdout: 14 155.00000 osd.14 down 1.00000 1.00000 2024-04-25T23:59:25.696 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm osd.12 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient: get_monmap_and_config 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient: build_initial_monmap 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient: monmap: 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:25.831522+0000 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:25.831522+0000 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:25.811 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:25.812 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:25.812 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:25.812 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:25.812 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:25.812 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:25.812 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 1 Processor -- start 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 1 -- start start 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient: init 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient: _add_conns ranks=[0,6,8,4,1,2,5,7,3] 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient(hunting): picked mon.noname-a con 0x7f100806fe00 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient(hunting): picked mon.noname-d con 0x7f100806f600 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:25.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient(hunting): picked mon.noname-e con 0x7f10080701e0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100806fa00 con 0x7f100806fe00 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1008135400 con 0x7f100806f600 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1008071670 con 0x7f10080701e0 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 10 monclient(hunting): authenticate will time out at 1216.538482s 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f1006d9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f10080701e0 legacy=0x7f100813d930 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f1005d9b640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f100806f600 0x7f1008134cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:45082/0 (socket says 172.21.15.171:45082) 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f1005d9b640 1 -- 172.21.15.171:0/3252482682 learned_addr learned my addr 172.21.15.171:0/3252482682 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3275904485 0 0) 0x7f1008135400 con 0x7f100806f600 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): my global_id is 6000 2024-04-25T23:59:25.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ff4003530 con 0x7f100806f600 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1867560840 0 0) 0x7f100806fa00 con 0x7f100806fe00 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient(hunting): my global_id is 6066 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1008135400 con 0x7f100806fe00 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 48287105 0 0) 0x7f1008135400 con 0x7f100806fe00 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 >> v1:172.21.15.106:6793/0 conn(0x7f10080701e0 legacy=0x7f100813d930 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 >> v1:172.21.15.106:6792/0 conn(0x7f100806f600 legacy=0x7f1008134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 monclient: found mon.noname-a 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-25T23:59:25.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1008070630 con 0x7f100806fe00 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient: _finish_auth 0 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 5 monclient: authenticate success, global_id 6066 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ff00017a0 con 0x7f100806fe00 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100559a640 10 monclient: dump: 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.822 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.823 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.827+0000 7f100cc10640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ff0001a90 con 0x7f100806fe00 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100559a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100559a640 1 -- 172.21.15.171:0/3252482682 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ff0003960 con 0x7f100806fe00 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100559a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100559a640 10 monclient: dump: 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.824 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 4 set_mon_vals no callback set 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: shutdown 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- 172.21.15.171:0/3252482682 >> v1:172.21.15.106:6789/0 conn(0x7f100806fe00 legacy=0x7f10081345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- 172.21.15.171:0/3252482682 shutdown_connections 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- 172.21.15.171:0/3252482682 >> 172.21.15.171:0/3252482682 conn(0x7f10080a2620 msgr2=0x7f10080a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- 172.21.15.171:0/3252482682 shutdown_connections 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- 172.21.15.171:0/3252482682 wait complete. 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: build_initial_monmap 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: monmap: 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:25.826 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 Processor -- start 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- start start 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: init 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: _add_conns ranks=[6,0,5,4,8,3,1,7,2] 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient(hunting): picked mon.noname-d con 0x7f100806f600 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:25.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient(hunting): picked mon.noname-a con 0x7f100806fe00 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient(hunting): picked mon.noname-h con 0x7f10080701e0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1008070880 con 0x7f100806fe00 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f100809f810 con 0x7f10080701e0 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10081235e0 con 0x7f100806f600 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient(hunting): authenticate will time out at 1216.542340s 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f1006d9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f10080701e0 0x7f10081d4d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50262/0 (socket says 172.21.15.171:50262) 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f1006d9d640 1 -- 172.21.15.171:0/762711362 learned_addr learned my addr 172.21.15.171:0/762711362 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003539632 0 0) 0x7f100809f810 con 0x7f10080701e0 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): my global_id is 5810 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe8003530 con 0x7f10080701e0 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 449197818 0 0) 0x7f0fe8003530 con 0x7f10080701e0 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f100809f810 con 0x7f10080701e0 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1000004560 con 0x7f10080701e0 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): dump: 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.829 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244719643 0 0) 0x7f10081235e0 con 0x7f100806f600 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:25.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient(hunting): my global_id is 6009 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fe8003530 con 0x7f100806f600 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2594290287 0 0) 0x7f100809f810 con 0x7f10080701e0 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 >> v1:172.21.15.106:6792/0 conn(0x7f100806f600 legacy=0x7f1008133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 >> v1:172.21.15.106:6789/0 conn(0x7f100806fe00 legacy=0x7f10081d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 monclient: found mon.h 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1008122d40 con 0x7f10080701e0 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:25.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 5 monclient: authenticate success, global_id 5810 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: _renew_subs 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1008122110 con 0x7f10080701e0 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: _renew_subs 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1008134310 con 0x7f10080701e0 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1000004850 con 0x7f10080701e0 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1000004dc0 con 0x7f10080701e0 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffffff640 4 set_mon_vals no callback set 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.831+0000 7f0ffeffd640 10 monclient: dump: 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:25.832 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:25.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.835+0000 7f100cc10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.835+0000 7f100cc10640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.835+0000 7f100cc10640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.835+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fec005090 con 0x7f10080701e0 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.835+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1000004f60 con 0x7f10080701e0 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.835+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(112..112 src has 1..112) ==== 5861+0+0 (unknown 3236095501 0 0) 0x7f1000045030 con 0x7f10080701e0 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.835+0000 7f100659c640 10 monclient: get_auth_request con 0x7f0fe8037820 auth_method 0 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.839+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1000015b00 con 0x7f10080701e0 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.839+0000 7f0ffeffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:25.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.839+0000 7f0ffeffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:25.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.995+0000 7f100cc10640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.12"}] 2024-04-25T23:59:25.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.995+0000 7f100cc10640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "osd.12"}] 2024-04-25T23:59:25.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.995+0000 7f100cc10640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:25.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:25.995+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.12"} v 0) -- 0x7f0fec005380 con 0x7f10080701e0 2024-04-25T23:59:26.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.515+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.12"}]=0 removed item id 12 name 'osd.12' from crush map v113) ==== 125+0+0 (unknown 674883614 0 0) 0x7f1000015400 con 0x7f10080701e0 2024-04-25T23:59:26.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.515+0000 7f0ffeffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "osd.12"}] 2024-04-25T23:59:26.502 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.515+0000 7f0ffeffd640 10 monclient: _finish_command 2 = system:0 removed item id 12 name 'osd.12' from crush map 2024-04-25T23:59:26.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.627+0000 7f100cc10640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.12"}] 2024-04-25T23:59:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.627+0000 7f100cc10640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "osd.12"}] 2024-04-25T23:59:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.627+0000 7f100cc10640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:26.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.627+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.12"} v 0) -- 0x7f0fec002220 con 0x7f10080701e0 2024-04-25T23:59:26.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.627+0000 7f0ffeffd640 1 -- 172.21.15.171:0/762711362 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.12"}]=0 device 'osd.12' does not appear in the crush map v113) ==== 126+0+0 (unknown 2389322427 0 0) 0x7f1000019750 con 0x7f10080701e0 2024-04-25T23:59:26.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.627+0000 7f0ffeffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "osd.12"}] 2024-04-25T23:59:26.613 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.627+0000 7f0ffeffd640 10 monclient: _finish_command 3 = system:0 device 'osd.12' does not appear in the crush map 2024-04-25T23:59:26.613 INFO:tasks.workunit.client.0.smithi171.stderr:device 'osd.12' does not appear in the crush map 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 >> v1:172.21.15.171:6812/722422047 conn(0x7f0fe8037820 legacy=0x7f0fe8039ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 10 monclient: shutdown 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 >> v1:172.21.15.171:6791/0 conn(0x7f10080701e0 legacy=0x7f10081d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 shutdown_connections 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 >> 172.21.15.171:0/762711362 conn(0x7f10080a2620 msgr2=0x7f10081ba3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 shutdown_connections 2024-04-25T23:59:26.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.631+0000 7f100cc10640 1 -- 172.21.15.171:0/762711362 wait complete. 2024-04-25T23:59:26.630 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm osd.14 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient: get_monmap_and_config 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient: build_initial_monmap 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient: monmap: 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:26.755712+0000 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:26.755712+0000 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:26.735 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:26.736 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 1 Processor -- start 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 1 -- start start 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient: init 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient: _add_conns ranks=[0,1,8,4,7,6,2,5,3] 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient(hunting): picked mon.noname-a con 0x7ff8ac0a52c0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient(hunting): picked mon.noname-f con 0x7ff8ac0a4a30 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:26.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient(hunting): picked mon.noname-e con 0x7ff8ac13e3a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ac0a2fe0 con 0x7ff8ac0a52c0 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ac0a5db0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ac0a2a20 con 0x7ff8ac13e3a0 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b29c6640 10 monclient(hunting): authenticate will time out at 1217.463432s 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8ab7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff8ac0a4a30 0x7ff8ac13cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54818/0 (socket says 172.21.15.171:54818) 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8ab7fe640 1 -- 172.21.15.171:0/3966075206 learned_addr learned my addr 172.21.15.171:0/3966075206 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8b0f63640 1 -- 172.21.15.171:0/3966075206 >> v1:172.21.15.106:6793/0 conn(0x7ff8ac13e3a0 legacy=0x7ff8ac140790 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3183733141 0 0) 0x7ff8ac0a5db0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8aaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8aaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8aaffd640 10 monclient(hunting): my global_id is 144388 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff894003530 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.751+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2748244082 0 0) 0x7ff894003530 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 >> v1:172.21.15.106:6793/0 conn(0x7ff8ac13e3a0 legacy=0x7ff8ac140790 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 >> v1:172.21.15.106:6789/0 conn(0x7ff8ac0a52c0 legacy=0x7ff8ac0a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 1 monclient: found mon.noname-f 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac0a2d00 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8a00017c0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:26.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: dump: 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:26.745 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 5 monclient: authenticate success, global_id 144388 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8a0001b20 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 1 -- 172.21.15.171:0/3966075206 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff8a0001d50 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 4 set_mon_vals no callback set 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aaffd640 10 monclient: dump: 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:26.746 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:26.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: shutdown 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/3966075206 >> v1:172.21.15.171:6789/0 conn(0x7ff8ac0a4a30 legacy=0x7ff8ac13cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/3966075206 shutdown_connections 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/3966075206 >> 172.21.15.171:0/3966075206 conn(0x7ff8ac0aa030 msgr2=0x7ff8ac0aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/3966075206 shutdown_connections 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/3966075206 wait complete. 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: build_initial_monmap 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: monmap: 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:26.748 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 Processor -- start 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- start start 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: init 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _add_conns ranks=[3,4,8,2,1,6,5,0,7] 2024-04-25T23:59:26.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient(hunting): picked mon.noname-g con 0x7ff8ac0a4a30 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient(hunting): picked mon.noname-c con 0x7ff8ac0a52c0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient(hunting): picked mon.noname-e con 0x7ff8ac13e3a0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ac13b4f0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ac13bcf0 con 0x7ff8ac0a52c0 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ac13d480 con 0x7ff8ac13e3a0 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient(hunting): authenticate will time out at 1217.466041s 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8abfff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff8ac0a4a30 0x7ff8ac13a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48618/0 (socket says 172.21.15.171:48618) 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8abfff640 1 -- 172.21.15.171:0/2938084350 learned_addr learned my addr 172.21.15.171:0/2938084350 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b0f63640 1 -- 172.21.15.171:0/2938084350 >> v1:172.21.15.106:6793/0 conn(0x7ff8ac13e3a0 legacy=0x7ff8ac1d4990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706800223 0 0) 0x7ff8ac13b4f0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:26.750 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): my global_id is 6159 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff898003530 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1420660914 0 0) 0x7ff898003530 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8ac13b4f0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff89c001ae0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:26.751 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 737573895 0 0) 0x7ff8ac13b4f0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 >> v1:172.21.15.106:6793/0 conn(0x7ff8ac13e3a0 legacy=0x7ff8ac1d4990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 >> v1:172.21.15.106:6791/0 conn(0x7ff8ac0a52c0 legacy=0x7ff8ac13ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:26.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 monclient: found mon.g 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ac0a0f80 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 5 monclient: authenticate success, global_id 6159 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _renew_subs 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ac0a1f50 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _renew_subs 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8ac13d8a0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff89c0038d0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff89c003e40 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8aa7fc640 4 set_mon_vals no callback set 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 10 monclient: dump: 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:26.754 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff88c005090 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.755+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff89c004060 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.759+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(113..113 src has 1..113) ==== 5839+0+0 (unknown 1931196572 0 0) 0x7ff89c044e20 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.759+0000 7ff8ab7fe640 10 monclient: get_auth_request con 0x7ff8980376c0 auth_method 0 2024-04-25T23:59:26.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.763+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff8ac0a2fe0 con 0x7ff8ac0a4a30 2024-04-25T23:59:26.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.763+0000 7ff8a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:26.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.763+0000 7ff8a8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.927+0000 7ff8b29c6640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.14"}] 2024-04-25T23:59:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.927+0000 7ff8b29c6640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "osd.14"}] 2024-04-25T23:59:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.927+0000 7ff8b29c6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:26.927+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.14"} v 0) -- 0x7ff88c005380 con 0x7ff8ac0a4a30 2024-04-25T23:59:27.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.607+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.14"}]=0 removed item id 14 name 'osd.14' from crush map v114) ==== 125+0+0 (unknown 3924400599 0 0) 0x7ff89c015910 con 0x7ff8ac0a4a30 2024-04-25T23:59:27.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.607+0000 7ff8a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "osd.14"}] 2024-04-25T23:59:27.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.607+0000 7ff8a8ff9640 10 monclient: _finish_command 2 = system:0 removed item id 14 name 'osd.14' from crush map 2024-04-25T23:59:27.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.707+0000 7ff8b29c6640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "osd.14"}] 2024-04-25T23:59:27.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.707+0000 7ff8b29c6640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "osd.14"}] 2024-04-25T23:59:27.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.707+0000 7ff8b29c6640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:27.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.707+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "osd.14"} v 0) -- 0x7ff88c002220 con 0x7ff8ac0a4a30 2024-04-25T23:59:27.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8a8ff9640 1 -- 172.21.15.171:0/2938084350 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "osd.14"}]=0 device 'osd.14' does not appear in the crush map v114) ==== 126+0+0 (unknown 4096000897 0 0) 0x7ff89c019560 con 0x7ff8ac0a4a30 2024-04-25T23:59:27.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8a8ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "osd.14"}] 2024-04-25T23:59:27.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8a8ff9640 10 monclient: _finish_command 3 = system:0 device 'osd.14' does not appear in the crush map 2024-04-25T23:59:27.694 INFO:tasks.workunit.client.0.smithi171.stderr:device 'osd.14' does not appear in the crush map 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 >> v1:172.21.15.171:6812/722422047 conn(0x7ff8980376c0 legacy=0x7ff898039b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 10 monclient: shutdown 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 >> v1:172.21.15.171:6790/0 conn(0x7ff8ac0a4a30 legacy=0x7ff8ac13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 shutdown_connections 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 >> 172.21.15.171:0/2938084350 conn(0x7ff8ac0aa030 msgr2=0x7ff8ac131aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 shutdown_connections 2024-04-25T23:59:27.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.711+0000 7ff8b29c6640 1 -- 172.21.15.171:0/2938084350 wait complete. 2024-04-25T23:59:27.709 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd rm osd.12 2024-04-25T23:59:27.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient: get_monmap_and_config 2024-04-25T23:59:27.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient: build_initial_monmap 2024-04-25T23:59:27.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient: monmap: 2024-04-25T23:59:27.823 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:27.823 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:27.823 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:27.843946+0000 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:27.843946+0000 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:27.824 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:27.825 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:27.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 1 Processor -- start 2024-04-25T23:59:27.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 1 -- start start 2024-04-25T23:59:27.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient: init 2024-04-25T23:59:27.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient: _add_conns ranks=[1,5,6,0,2,8,7,3,4] 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient(hunting): picked mon.noname-f con 0x7f2468132a30 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient(hunting): picked mon.noname-h con 0x7f24680727b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient(hunting): picked mon.noname-d con 0x7f2468132e10 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2468136400 con 0x7f2468132a30 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f246809fa80 con 0x7f24680727b0 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f246809b890 con 0x7f2468132e10 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient(hunting): authenticate will time out at 1218.550900s 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246da54640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f24680727b0 0x7f2468135cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50266/0 (socket says 172.21.15.171:50266) 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246e255640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2468132a30 0x7f24681355e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54824/0 (socket says 172.21.15.171:54824) 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246da54640 1 -- 172.21.15.171:0/540692384 learned_addr learned my addr 172.21.15.171:0/540692384 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:27.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114778585 0 0) 0x7f2468136400 con 0x7f2468132a30 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): _negotiate 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): my global_id is 144397 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2450003530 con 0x7f2468132a30 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61924391 0 0) 0x7f246809fa80 con 0x7f24680727b0 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): _negotiate 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient(hunting): my global_id is 5819 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2468136400 con 0x7f24680727b0 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1976475983 0 0) 0x7f2468136400 con 0x7f24680727b0 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 >> v1:172.21.15.106:6792/0 conn(0x7f2468132e10 legacy=0x7f246813e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:27.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 >> v1:172.21.15.171:6789/0 conn(0x7f2468132a30 legacy=0x7f24681355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: _finish_hunting 0 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 monclient: found mon.noname-h 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24680a3500 con 0x7f24680727b0 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: _finish_auth 0 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: _check_auth_tickets 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f245c0017c0 con 0x7f24680727b0 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: dump: 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:27.834 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:27.835 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 5 monclient: authenticate success, global_id 5819 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f245c001a20 con 0x7f24680727b0 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f24704b9640 4 set_mon_vals no callback set 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 1 -- 172.21.15.171:0/540692384 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f245c004bf0 con 0x7f24680727b0 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.839+0000 7f246d253640 10 monclient: dump: 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:27.836 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: shutdown 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/540692384 >> v1:172.21.15.171:6791/0 conn(0x7f24680727b0 legacy=0x7f2468135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/540692384 shutdown_connections 2024-04-25T23:59:27.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/540692384 >> 172.21.15.171:0/540692384 conn(0x7f24680a67e0 msgr2=0x7f24680a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/540692384 shutdown_connections 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/540692384 wait complete. 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: build_initial_monmap 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: monmap: 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:27.838 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 Processor -- start 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- start start 2024-04-25T23:59:27.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: init 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _add_conns ranks=[1,8,0,7,5,3,2,4,6] 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient(hunting): picked mon.noname-f con 0x7f24680727b0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient(hunting): picked mon.noname-e con 0x7f2468132a30 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient(hunting): picked mon.noname-a con 0x7f2468132e10 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24681242f0 con 0x7f2468132e10 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24681224a0 con 0x7f24680727b0 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2468122020 con 0x7f2468132a30 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient(hunting): authenticate will time out at 1218.553867s 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f246e255640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f24680727b0 0x7f24681308d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54828/0 (socket says 172.21.15.171:54828) 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f246e255640 1 -- 172.21.15.171:0/3241648008 learned_addr learned my addr 172.21.15.171:0/3241648008 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f246da54640 1 -- 172.21.15.171:0/3241648008 >> v1:172.21.15.106:6793/0 conn(0x7f2468132a30 legacy=0x7f24681d19c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996008400 0 0) 0x7f24681224a0 con 0x7f24680727b0 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:27.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): my global_id is 144406 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2454003530 con 0x7f24680727b0 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3507621408 0 0) 0x7f2454003530 con 0x7f24680727b0 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24681224a0 con 0x7f24680727b0 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24600013d0 con 0x7f24680727b0 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:27.841 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:27.842 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3268493677 0 0) 0x7f24681224a0 con 0x7f24680727b0 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 >> v1:172.21.15.106:6793/0 conn(0x7f2468132a30 legacy=0x7f24681d19c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 >> v1:172.21.15.106:6789/0 conn(0x7f2468132e10 legacy=0x7f24681d50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 monclient: found mon.f 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2468072c10 con 0x7f24680727b0 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 5 monclient: authenticate success, global_id 144406 2024-04-25T23:59:27.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _renew_subs 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2468124010 con 0x7f24680727b0 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _renew_subs 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f24681311b0 con 0x7f24680727b0 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2460004aa0 con 0x7f24680727b0 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2460004f90 con 0x7f24680727b0 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f246ca52640 4 set_mon_vals no callback set 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 10 monclient: dump: 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.844 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f246000fd30 con 0x7f24680727b0 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:27.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:27.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2448005090 con 0x7f24680727b0 2024-04-25T23:59:27.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.843+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(114..114 src has 1..114) ==== 5817+0+0 (unknown 354967178 0 0) 0x7f2460044e10 con 0x7f24680727b0 2024-04-25T23:59:27.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.847+0000 7f246da54640 10 monclient: get_auth_request con 0x7f2454037860 auth_method 0 2024-04-25T23:59:27.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.851+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f24600157d0 con 0x7f24680727b0 2024-04-25T23:59:27.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.851+0000 7f2466ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:27.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:27.851+0000 7f2466ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:27.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.007+0000 7f24704b9640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["osd.12"]}] 2024-04-25T23:59:27.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.007+0000 7f24704b9640 10 monclient: _send_command 2 [{"prefix": "osd rm", "ids": ["osd.12"]}] 2024-04-25T23:59:27.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.007+0000 7f24704b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:27.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.007+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd rm", "ids": ["osd.12"]} v 0) -- 0x7f2448005380 con 0x7f24680727b0 2024-04-25T23:59:27.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:28.012+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e114 definitely_dead 0 2024-04-25T23:59:28.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.623+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["osd.12"]}]=0 removed osd.12 v115) ==== 87+0+0 (unknown 3523029245 0 0) 0x7f24600150d0 con 0x7f24680727b0 2024-04-25T23:59:28.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.623+0000 7f2466ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd rm", "ids": ["osd.12"]}] 2024-04-25T23:59:28.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.623+0000 7f2466ffd640 10 monclient: _finish_command 2 = system:0 removed osd.12 2024-04-25T23:59:28.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.731+0000 7f24704b9640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["osd.12"]}] 2024-04-25T23:59:28.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.731+0000 7f24704b9640 10 monclient: _send_command 3 [{"prefix": "osd rm", "ids": ["osd.12"]}] 2024-04-25T23:59:28.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.731+0000 7f24704b9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:28.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.731+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd rm", "ids": ["osd.12"]} v 0) -- 0x7f2448000bd0 con 0x7f24680727b0 2024-04-25T23:59:28.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:28.736+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e115 definitely_dead 0 2024-04-25T23:59:28.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f2466ffd640 1 -- 172.21.15.171:0/3241648008 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["osd.12"]}]=0 osd.12 does not exist. v115) ==== 96+0+0 (unknown 783064281 0 0) 0x7f2460019420 con 0x7f24680727b0 2024-04-25T23:59:28.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f2466ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd rm", "ids": ["osd.12"]}] 2024-04-25T23:59:28.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f2466ffd640 10 monclient: _finish_command 3 = system:0 osd.12 does not exist. 2024-04-25T23:59:28.719 INFO:tasks.workunit.client.0.smithi171.stderr:osd.12 does not exist. 2024-04-25T23:59:28.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 >> v1:172.21.15.171:6812/722422047 conn(0x7f2454037860 legacy=0x7f2454039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:28.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f24704b9640 10 monclient: shutdown 2024-04-25T23:59:28.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f24704b9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:28.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 >> v1:172.21.15.171:6789/0 conn(0x7f24680727b0 legacy=0x7f24681308d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:28.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 shutdown_connections 2024-04-25T23:59:28.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.735+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 >> 172.21.15.171:0/3241648008 conn(0x7f24680a67e0 msgr2=0x7f2468131b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:28.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.739+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 shutdown_connections 2024-04-25T23:59:28.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.739+0000 7f24704b9640 1 -- 172.21.15.171:0/3241648008 wait complete. 2024-04-25T23:59:28.735 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd rm osd.14 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: get_monmap_and_config 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: build_initial_monmap 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: monmap: 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:28.871645+0000 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:28.871645+0000 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:28.852 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 1 Processor -- start 2024-04-25T23:59:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 1 -- start start 2024-04-25T23:59:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: init 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: _add_conns ranks=[4,1,8,6,0,2,3,7,5] 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient(hunting): picked mon.noname-c con 0x7f68101349b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient(hunting): picked mon.noname-f con 0x7f6810134d90 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient(hunting): picked mon.noname-e con 0x7f681013e2c0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6810138470 con 0x7f6810134d90 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681009c110 con 0x7f68101349b0 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681009c3f0 con 0x7f681013e2c0 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient(hunting): authenticate will time out at 1219.578546s 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680dd9b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f6810134d90 0x7f681013cba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54840/0 (socket says 172.21.15.171:54840) 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680ed9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f681013e2c0 legacy=0x7f68101406b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680dd9b640 1 -- 172.21.15.171:0/2168767005 learned_addr learned my addr 172.21.15.171:0/2168767005 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214630463 0 0) 0x7f6810138470 con 0x7f6810134d90 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient(hunting): my global_id is 144415 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67f8003530 con 0x7f6810134d90 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 400658287 0 0) 0x7f67f8003530 con 0x7f6810134d90 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 >> v1:172.21.15.106:6793/0 conn(0x7f681013e2c0 legacy=0x7f68101406b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 >> v1:172.21.15.106:6791/0 conn(0x7f68101349b0 legacy=0x7f6810137d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 monclient: found mon.noname-f 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68101351f0 con 0x7f6810134d90 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: _finish_auth 0 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f68040017e0 con 0x7f6810134d90 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 5 monclient: authenticate success, global_id 144415 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: dump: 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6804001ad0 con 0x7f6810134d90 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 1 -- 172.21.15.171:0/2168767005 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6804004bf0 con 0x7f6810134d90 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f680d59a640 10 monclient: dump: 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 4 set_mon_vals no callback set 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 10 monclient: shutdown 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.867+0000 7f68149ee640 1 -- 172.21.15.171:0/2168767005 >> v1:172.21.15.171:6789/0 conn(0x7f6810134d90 legacy=0x7f681013cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- 172.21.15.171:0/2168767005 shutdown_connections 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- 172.21.15.171:0/2168767005 >> 172.21.15.171:0/2168767005 conn(0x7f68100a67e0 msgr2=0x7f68100a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:28.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- 172.21.15.171:0/2168767005 shutdown_connections 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- 172.21.15.171:0/2168767005 wait complete. 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: build_initial_monmap 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: monmap: 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:28.866 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 Processor -- start 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- start start 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: init 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _add_conns ranks=[0,6,3,4,1,7,5,8,2] 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient(hunting): picked mon.noname-a con 0x7f68101349b0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:28.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient(hunting): picked mon.noname-d con 0x7f6810134d90 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient(hunting): picked mon.noname-g con 0x7f681013e2c0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681011e840 con 0x7f68101349b0 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681011e420 con 0x7f681013e2c0 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681011cc90 con 0x7f6810134d90 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient(hunting): authenticate will time out at 1219.581746s 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f680ed9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f681013e2c0 0x7f68101d4db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48622/0 (socket says 172.21.15.171:48622) 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f680ed9d640 1 -- 172.21.15.171:0/2244872695 learned_addr learned my addr 172.21.15.171:0/2244872695 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4192555971 0 0) 0x7f681011e420 con 0x7f681013e2c0 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): my global_id is 6168 2024-04-25T23:59:28.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67f0003530 con 0x7f681013e2c0 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1315373734 0 0) 0x7f67f0003530 con 0x7f681013e2c0 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f681011e420 con 0x7f681013e2c0 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f68080045a0 con 0x7f681013e2c0 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): dump: 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:28.869 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658412205 0 0) 0x7f681009c110 con 0x7f68101349b0 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:28.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): my global_id is 6093 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67f0003530 con 0x7f68101349b0 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1211356634 0 0) 0x7f681011cc90 con 0x7f6810134d90 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient(hunting): my global_id is 6027 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f681009c110 con 0x7f6810134d90 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3118141201 0 0) 0x7f681011e420 con 0x7f681013e2c0 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 >> v1:172.21.15.106:6792/0 conn(0x7f6810134d90 legacy=0x7f68101d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 >> v1:172.21.15.106:6789/0 conn(0x7f68101349b0 legacy=0x7f68101cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 monclient: found mon.g 2024-04-25T23:59:28.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f681009b8e0 con 0x7f681013e2c0 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 5 monclient: authenticate success, global_id 6168 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _renew_subs 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f681011c9e0 con 0x7f681013e2c0 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _renew_subs 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6810133f10 con 0x7f681013e2c0 2024-04-25T23:59:28.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6810068fb0 con 0x7f681013e2c0 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6808004890 con 0x7f681013e2c0 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6808004e00 con 0x7f681013e2c0 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 10 monclient: dump: 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:28.873 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f680cd99640 4 set_mon_vals no callback set 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.871+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6808004fa0 con 0x7f681013e2c0 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.875+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(115..115 src has 1..115) ==== 5759+0+0 (unknown 2507996249 0 0) 0x7f6808044fa0 con 0x7f681013e2c0 2024-04-25T23:59:28.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.875+0000 7f680e59c640 10 monclient: get_auth_request con 0x7f67f0037a60 auth_method 0 2024-04-25T23:59:28.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.879+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6808015a00 con 0x7f681013e2c0 2024-04-25T23:59:28.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.879+0000 7f67feffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:28.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:28.879+0000 7f67feffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:29.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.047+0000 7f68149ee640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["osd.14"]}] 2024-04-25T23:59:29.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.047+0000 7f68149ee640 10 monclient: _send_command 2 [{"prefix": "osd rm", "ids": ["osd.14"]}] 2024-04-25T23:59:29.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.047+0000 7f68149ee640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:29.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.047+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd rm", "ids": ["osd.14"]} v 0) -- 0x7f6810075940 con 0x7f681013e2c0 2024-04-25T23:59:29.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:29.048+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e115 definitely_dead 0 2024-04-25T23:59:29.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.635+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["osd.14"]}]=0 removed osd.14 v116) ==== 87+0+0 (unknown 2025787314 0 0) 0x7f6808015300 con 0x7f681013e2c0 2024-04-25T23:59:29.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.635+0000 7f67feffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd rm", "ids": ["osd.14"]}] 2024-04-25T23:59:29.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.635+0000 7f67feffd640 10 monclient: _finish_command 2 = system:0 removed osd.14 2024-04-25T23:59:29.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.743+0000 7f68149ee640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["osd.14"]}] 2024-04-25T23:59:29.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.743+0000 7f68149ee640 10 monclient: _send_command 3 [{"prefix": "osd rm", "ids": ["osd.14"]}] 2024-04-25T23:59:29.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.743+0000 7f68149ee640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:29.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.743+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd rm", "ids": ["osd.14"]} v 0) -- 0x7f681013c9b0 con 0x7f681013e2c0 2024-04-25T23:59:29.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-25T23:59:29.748+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e116 definitely_dead 0 2024-04-25T23:59:29.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f67feffd640 1 -- 172.21.15.171:0/2244872695 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["osd.14"]}]=0 osd.14 does not exist. v116) ==== 96+0+0 (unknown 4069942990 0 0) 0x7f680801deb0 con 0x7f681013e2c0 2024-04-25T23:59:29.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f67feffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd rm", "ids": ["osd.14"]}] 2024-04-25T23:59:29.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f67feffd640 10 monclient: _finish_command 3 = system:0 osd.14 does not exist. 2024-04-25T23:59:29.730 INFO:tasks.workunit.client.0.smithi171.stderr:osd.14 does not exist. 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 >> v1:172.21.15.171:6812/722422047 conn(0x7f67f0037a60 legacy=0x7f67f0039f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 10 monclient: shutdown 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 >> v1:172.21.15.171:6790/0 conn(0x7f681013e2c0 legacy=0x7f68101d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 shutdown_connections 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 >> 172.21.15.171:0/2244872695 conn(0x7f68100a67e0 msgr2=0x7f68100a1870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 shutdown_connections 2024-04-25T23:59:29.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.747+0000 7f68149ee640 1 -- 172.21.15.171:0/2244872695 wait complete. 2024-04-25T23:59:29.747 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd set-require-min-compat-client luminous 2024-04-25T23:59:29.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.875+0000 7f1a86537640 10 monclient: get_monmap_and_config 2024-04-25T23:59:29.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.875+0000 7f1a86537640 10 monclient: build_initial_monmap 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.875+0000 7f1a86537640 10 monclient: monmap: 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:29.882277+0000 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:29.882277+0000 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:29.866 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 Processor -- start 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- start start 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient: init 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient: _add_conns ranks=[5,3,6,7,8,2,0,4,1] 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient(hunting): picked mon.noname-h con 0x7f1a80131880 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:29.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient(hunting): picked mon.noname-g con 0x7f1a8009e7b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient(hunting): picked mon.noname-d con 0x7f1a8009ebf0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8009c660 con 0x7f1a8009e7b0 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8009da10 con 0x7f1a80131880 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8009dcf0 con 0x7f1a8009ebf0 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient(hunting): authenticate will time out at 1220.589357s 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7f7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f1a8009e7b0 0x7f1a80139880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:48634/0 (socket says 172.21.15.171:48634) 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7f7fe640 1 -- 172.21.15.171:0/1031408999 learned_addr learned my addr 172.21.15.171:0/1031408999 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7ffff640 1 --1- 172.21.15.171:0/1031408999 >> v1:172.21.15.171:6791/0 conn(0x7f1a80131880 0x7f1a80131c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50282/0 (socket says 172.21.15.171:50282) 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1123555565 0 0) 0x7f1a8009da10 con 0x7f1a80131880 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): my global_id is 5828 2024-04-25T23:59:29.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a68003530 con 0x7f1a80131880 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487511684 0 0) 0x7f1a8009c660 con 0x7f1a8009e7b0 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient(hunting): my global_id is 6177 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a8009da10 con 0x7f1a8009e7b0 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 545923707 0 0) 0x7f1a68003530 con 0x7f1a80131880 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 >> v1:172.21.15.106:6792/0 conn(0x7f1a8009ebf0 legacy=0x7f1a8013cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 >> v1:172.21.15.171:6790/0 conn(0x7f1a8009e7b0 legacy=0x7f1a80139880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 monclient: found mon.noname-h 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a8009dfd0 con 0x7f1a80131880 2024-04-25T23:59:29.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: _finish_auth 0 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 5 monclient: authenticate success, global_id 5828 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a700017c0 con 0x7f1a80131880 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: dump: 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:29.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a70001a30 con 0x7f1a80131880 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:29.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 1 -- 172.21.15.171:0/1031408999 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a70004b30 con 0x7f1a80131880 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 4 set_mon_vals no callback set 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a7effd640 10 monclient: dump: 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:29.872 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient: shutdown 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- 172.21.15.171:0/1031408999 >> v1:172.21.15.171:6791/0 conn(0x7f1a80131880 legacy=0x7f1a80131c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- 172.21.15.171:0/1031408999 shutdown_connections 2024-04-25T23:59:29.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- 172.21.15.171:0/1031408999 >> 172.21.15.171:0/1031408999 conn(0x7f1a800a67e0 msgr2=0x7f1a800a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- 172.21.15.171:0/1031408999 shutdown_connections 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 -- 172.21.15.171:0/1031408999 wait complete. 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient: build_initial_monmap 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 10 monclient: monmap: 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:29.874 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.879+0000 7f1a86537640 1 Processor -- start 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 1 -- start start 2024-04-25T23:59:29.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: init 2024-04-25T23:59:29.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:29.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _add_conns ranks=[8,7,0,2,5,4,3,1,6] 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient(hunting): picked mon.noname-e con 0x7f1a8009e7b0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient(hunting): picked mon.noname-i con 0x7f1a8009ebf0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient(hunting): picked mon.noname-a con 0x7f1a80131880 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8012bf10 con 0x7f1a80131880 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8013e310 con 0x7f1a8009ebf0 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8009b090 con 0x7f1a8009e7b0 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient(hunting): authenticate will time out at 1220.592640s 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7ffff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f1a8009e7b0 legacy=0x7f1a8013d4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7f7fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f1a8009ebf0 0x7f1a8013dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52798/0 (socket says 172.21.15.171:52798) 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7f7fe640 1 -- 172.21.15.171:0/3061833222 learned_addr learned my addr 172.21.15.171:0/3061833222 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 137250885 0 0) 0x7f1a8013e310 con 0x7f1a8009ebf0 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:29.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): my global_id is 144277 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a6c003530 con 0x7f1a8009ebf0 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 861677753 0 0) 0x7f1a6c003530 con 0x7f1a8009ebf0 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a8013e310 con 0x7f1a8009ebf0 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a740013e0 con 0x7f1a8009ebf0 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): dump: 2024-04-25T23:59:29.880 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:29.881 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854169259 0 0) 0x7f1a8012bf10 con 0x7f1a80131880 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient(hunting): my global_id is 6102 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a6c003530 con 0x7f1a80131880 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3649333127 0 0) 0x7f1a8013e310 con 0x7f1a8009ebf0 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 >> v1:172.21.15.106:6793/0 conn(0x7f1a8009e7b0 legacy=0x7f1a8013d4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 >> v1:172.21.15.106:6789/0 conn(0x7f1a80131880 legacy=0x7f1a801d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 monclient: found mon.i 2024-04-25T23:59:29.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a80072810 con 0x7f1a8009ebf0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 5 monclient: authenticate success, global_id 144277 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _renew_subs 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a8011c760 con 0x7f1a8009ebf0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _renew_subs 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a8009b750 con 0x7f1a8009ebf0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a74004aa0 con 0x7f1a8009ebf0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a74004f90 con 0x7f1a8009ebf0 2024-04-25T23:59:29.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7e7fc640 4 set_mon_vals no callback set 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 10 monclient: dump: 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:29.884 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1a7400fd30 con 0x7f1a8009ebf0 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a60005090 con 0x7f1a8009ebf0 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(116..116 src has 1..116) ==== 5759+0+0 (unknown 445151535 0 0) 0x7f1a74044da0 con 0x7f1a8009ebf0 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.883+0000 7f1a7ffff640 10 monclient: get_auth_request con 0x7f1a6c037710 auth_method 0 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.887+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1a740158e0 con 0x7f1a8009ebf0 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.887+0000 7f1a7cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:29.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:29.887+0000 7f1a7cff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:30.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.055+0000 7f1a86537640 10 start_mon_command cmd=[{"prefix": "osd set-require-min-compat-client", "version": "luminous"}] 2024-04-25T23:59:30.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.055+0000 7f1a86537640 10 monclient: _send_command 2 [{"prefix": "osd set-require-min-compat-client", "version": "luminous"}] 2024-04-25T23:59:30.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.055+0000 7f1a86537640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:30.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.055+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "luminous"} v 0) -- 0x7f1a60005b90 con 0x7f1a8009ebf0 2024-04-25T23:59:30.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.651+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "luminous"}]=0 set require_min_compat_client to luminous v117) ==== 145+0+0 (unknown 2204521362 0 0) 0x7f1a740151e0 con 0x7f1a8009ebf0 2024-04-25T23:59:30.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.651+0000 7f1a7cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd set-require-min-compat-client", "version": "luminous"}] 2024-04-25T23:59:30.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.651+0000 7f1a7cff9640 10 monclient: _finish_command 2 = system:0 set require_min_compat_client to luminous 2024-04-25T23:59:30.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.755+0000 7f1a86537640 10 start_mon_command cmd=[{"prefix": "osd set-require-min-compat-client", "version": "luminous"}] 2024-04-25T23:59:30.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.755+0000 7f1a86537640 10 monclient: _send_command 3 [{"prefix": "osd set-require-min-compat-client", "version": "luminous"}] 2024-04-25T23:59:30.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.755+0000 7f1a86537640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:30.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:30.755+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "luminous"} v 0) -- 0x7f1a600010a0 con 0x7f1a8009ebf0 2024-04-25T23:59:31.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a7cff9640 1 -- 172.21.15.171:0/3061833222 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "luminous"}]=0 set require_min_compat_client to luminous v118) ==== 145+0+0 (unknown 3673119606 0 0) 0x7f1a74019530 con 0x7f1a8009ebf0 2024-04-25T23:59:31.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a7cff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd set-require-min-compat-client", "version": "luminous"}] 2024-04-25T23:59:31.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a7cff9640 10 monclient: _finish_command 3 = system:0 set require_min_compat_client to luminous 2024-04-25T23:59:31.639 INFO:tasks.workunit.client.0.smithi171.stderr:set require_min_compat_client to luminous 2024-04-25T23:59:31.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 >> v1:172.21.15.171:6812/722422047 conn(0x7f1a6c037710 legacy=0x7f1a6c039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:31.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 10 monclient: shutdown 2024-04-25T23:59:31.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:31.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 >> v1:172.21.15.171:6792/0 conn(0x7f1a8009ebf0 legacy=0x7f1a8013dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:31.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 shutdown_connections 2024-04-25T23:59:31.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 >> 172.21.15.171:0/3061833222 conn(0x7f1a800a67e0 msgr2=0x7f1a800a5140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:31.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 shutdown_connections 2024-04-25T23:59:31.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.655+0000 7f1a86537640 1 -- 172.21.15.171:0/3061833222 wait complete. 2024-04-25T23:59:31.661 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set dump 2024-04-25T23:59:31.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient: get_monmap_and_config 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient: build_initial_monmap 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient: monmap: 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:31.803588+0000 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:31.803588+0000 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:31.784 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 1 Processor -- start 2024-04-25T23:59:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 1 -- start start 2024-04-25T23:59:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient: init 2024-04-25T23:59:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient: _add_conns ranks=[8,5,7,3,1,6,2,0,4] 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient(hunting): picked mon.noname-e con 0x7f95580a3930 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient(hunting): picked mon.noname-h con 0x7f9558138150 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient(hunting): picked mon.noname-i con 0x7f9558138570 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95580a2b70 con 0x7f9558138150 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95580a2e50 con 0x7f9558138570 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95580a4460 con 0x7f95580a3930 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient(hunting): authenticate will time out at 1222.510751s 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f9556ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f9558138150 0x7f955813cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45400/0 (socket says 172.21.15.171:45400) 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f9557fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f9558138570 0x7f95581406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36484/0 (socket says 172.21.15.171:36484) 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f9556ffd640 1 -- 172.21.15.171:0/623899215 learned_addr learned my addr 172.21.15.171:0/623899215 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95577fe640 1 -- 172.21.15.171:0/623899215 >> v1:172.21.15.106:6793/0 conn(0x7f95580a3930 legacy=0x7f9558137a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014210100 0 0) 0x7f95580a2e50 con 0x7f9558138570 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): my global_id is 144286 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9540003530 con 0x7f9558138570 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2135740652 0 0) 0x7f95580a2b70 con 0x7f9558138150 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient(hunting): my global_id is 5837 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95580a2e50 con 0x7f9558138150 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 627376579 0 0) 0x7f9540003530 con 0x7f9558138570 2024-04-25T23:59:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 >> v1:172.21.15.106:6793/0 conn(0x7f95580a3930 legacy=0x7f9558137a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 >> v1:172.21.15.171:6791/0 conn(0x7f9558138150 legacy=0x7f955813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 monclient: found mon.noname-i 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95580a1810 con 0x7f9558138570 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9550001b40 con 0x7f9558138570 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 5 monclient: authenticate success, global_id 144286 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: dump: 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9550001e60 con 0x7f9558138570 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f955dbd0640 4 set_mon_vals no callback set 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 1 -- 172.21.15.171:0/623899215 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9550004eb0 con 0x7f9558138570 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.799+0000 7f95567fc640 10 monclient: dump: 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient: shutdown 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- 172.21.15.171:0/623899215 >> v1:172.21.15.171:6792/0 conn(0x7f9558138570 legacy=0x7f95581406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- 172.21.15.171:0/623899215 shutdown_connections 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- 172.21.15.171:0/623899215 >> 172.21.15.171:0/623899215 conn(0x7f95580a6d70 msgr2=0x7f95580a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- 172.21.15.171:0/623899215 shutdown_connections 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- 172.21.15.171:0/623899215 wait complete. 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient: build_initial_monmap 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient: monmap: 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 Processor -- start 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- start start 2024-04-25T23:59:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient: init 2024-04-25T23:59:31.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient: _add_conns ranks=[2,8,6,1,3,7,5,4,0] 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient(hunting): picked mon.noname-b con 0x7f95580a3930 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient(hunting): picked mon.noname-e con 0x7f9558138150 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient(hunting): picked mon.noname-d con 0x7f9558138570 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9558138d40 con 0x7f95580a3930 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95580a1030 con 0x7f9558138570 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f955809ec80 con 0x7f9558138150 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f955dbd0640 10 monclient(hunting): authenticate will time out at 1222.514691s 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f9556ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9558138150 legacy=0x7f95581d1580 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f9557fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9558138570 0x7f95581d4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:49480/0 (socket says 172.21.15.171:49480) 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f95577fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f95580a3930 0x7f9558133a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:45780/0 (socket says 172.21.15.171:45780) 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f9557fff640 1 -- 172.21.15.171:0/1693996944 learned_addr learned my addr 172.21.15.171:0/1693996944 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288841230 0 0) 0x7f95580a1030 con 0x7f9558138570 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): my global_id is 6045 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9544003560 con 0x7f9558138570 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635413069 0 0) 0x7f9558138d40 con 0x7f95580a3930 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): my global_id is 5897 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95580a1030 con 0x7f95580a3930 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1398390161 0 0) 0x7f9544003560 con 0x7f9558138570 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9558138d40 con 0x7f9558138570 2024-04-25T23:59:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9550001b00 con 0x7f9558138570 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.803+0000 7f953ffff640 10 monclient(hunting): dump: 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2879906428 0 0) 0x7f95580a1030 con 0x7f95580a3930 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9544003560 con 0x7f95580a3930 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f954c0042a0 con 0x7f95580a3930 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient(hunting): dump: 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:31.804 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:31.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3357960672 0 0) 0x7f9558138d40 con 0x7f9558138570 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 >> v1:172.21.15.106:6793/0 conn(0x7f9558138150 legacy=0x7f95581d1580 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 >> v1:172.21.15.106:6790/0 conn(0x7f95580a3930 legacy=0x7f9558133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 monclient: found mon.d 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95581213c0 con 0x7f9558138570 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: _finish_auth 0 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 5 monclient: authenticate success, global_id 6045 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 10 monclient: _renew_subs 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f95581206f0 con 0x7f9558138570 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 10 monclient: _renew_subs 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9558134110 con 0x7f9558138570 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9550001e60 con 0x7f9558138570 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9550002010 con 0x7f9558138570 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f9555ffb640 4 set_mon_vals no callback set 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 10 monclient: dump: 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9538005090 con 0x7f9558138570 2024-04-25T23:59:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f95500103b0 con 0x7f9558138570 2024-04-25T23:59:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(118..118 src has 1..118) ==== 5759+0+0 (unknown 1940617915 0 0) 0x7f95500450f0 con 0x7f9558138570 2024-04-25T23:59:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.807+0000 7f95577fe640 10 monclient: get_auth_request con 0x7f9544037da0 auth_method 0 2024-04-25T23:59:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.819+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9550015bb0 con 0x7f9558138570 2024-04-25T23:59:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.819+0000 7f953ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.819+0000 7f953ffff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.991+0000 7f955dbd0640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.991+0000 7f955dbd0640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.991+0000 7f955dbd0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:31.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.991+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush weight-set dump"} v 0) -- 0x7f9538005380 con 0x7f9558138570 2024-04-25T23:59:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.995+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set dump"}]=0 v118) ==== 73+0+3 (unknown 1887001698 0 2423995997) 0x7f95500154b0 con 0x7f9558138570 2024-04-25T23:59:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.995+0000 7f953ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:31.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:31.995+0000 7f953ffff640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:32.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:32.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:32.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:32.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush weight-set dump"} v 0) -- 0x7f9538005ac0 con 0x7f9558138570 2024-04-25T23:59:32.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f953ffff640 1 -- 172.21.15.171:0/1693996944 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set dump"}]=0 v118) ==== 73+0+3 (unknown 1887001698 0 2423995997) 0x7f955001e000 con 0x7f9558138570 2024-04-25T23:59:32.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f953ffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:32.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f953ffff640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:32.087 INFO:tasks.workunit.client.0.smithi171.stdout:{} 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 >> v1:172.21.15.171:6812/722422047 conn(0x7f9544037da0 legacy=0x7f954403a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 10 monclient: shutdown 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 >> v1:172.21.15.106:6792/0 conn(0x7f9558138570 legacy=0x7f95581d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 shutdown_connections 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 >> 172.21.15.171:0/1693996944 conn(0x7f95580a6d70 msgr2=0x7f9558136a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 shutdown_connections 2024-04-25T23:59:32.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.103+0000 7f955dbd0640 1 -- 172.21.15.171:0/1693996944 wait complete. 2024-04-25T23:59:32.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:32.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.235+0000 7f131ffbf640 10 monclient: get_monmap_and_config 2024-04-25T23:59:32.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.235+0000 7f131ffbf640 10 monclient: build_initial_monmap 2024-04-25T23:59:32.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.235+0000 7f131ffbf640 10 monclient: monmap: 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:32.241439+0000 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:32.241439+0000 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:32.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:32.222 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.235+0000 7f131ffbf640 1 Processor -- start 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.235+0000 7f131ffbf640 1 -- start start 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.235+0000 7f131ffbf640 10 monclient: init 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: _add_conns ranks=[7,4,5,2,3,8,1,6,0] 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): picked mon.noname-i con 0x7f13180a3930 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): picked mon.noname-c con 0x7f1318138150 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:32.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): picked mon.noname-h con 0x7f1318138570 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13180a2b70 con 0x7f1318138150 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13180a2e50 con 0x7f1318138570 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13180a4460 con 0x7f13180a3930 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): authenticate will time out at 1222.948332s 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131e55c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f1318138570 0x7f13181406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45410/0 (socket says 172.21.15.171:45410) 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131dd5b640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f13180a3930 0x7f1318137a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36492/0 (socket says 172.21.15.171:36492) 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131e55c640 1 -- 172.21.15.171:0/2560022270 learned_addr learned my addr 172.21.15.171:0/2560022270 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938703229 0 0) 0x7f13180a4460 con 0x7f13180a3930 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): my global_id is 144295 2024-04-25T23:59:32.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1304003530 con 0x7f13180a3930 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126851071 0 0) 0x7f13180a2e50 con 0x7f1318138570 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient(hunting): my global_id is 5846 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13180a4460 con 0x7f1318138570 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2779183492 0 0) 0x7f1304003530 con 0x7f13180a3930 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 >> v1:172.21.15.171:6791/0 conn(0x7f1318138570 legacy=0x7f13181406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 >> v1:172.21.15.106:6791/0 conn(0x7f1318138150 legacy=0x7f131813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: _finish_hunting 0 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 monclient: found mon.noname-i 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:32.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13180a1810 con 0x7f13180a3930 2024-04-25T23:59:32.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: _finish_auth 0 2024-04-25T23:59:32.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: _check_auth_tickets 2024-04-25T23:59:32.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:32.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13140017c0 con 0x7f13180a3930 2024-04-25T23:59:32.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: dump: 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.234 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 5 monclient: authenticate success, global_id 144295 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1314001a20 con 0x7f13180a3930 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 1 -- 172.21.15.171:0/2560022270 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1314004b30 con 0x7f13180a3930 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:32.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 4 set_mon_vals no callback set 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131cd59640 10 monclient: dump: 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.236 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: shutdown 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- 172.21.15.171:0/2560022270 >> v1:172.21.15.171:6792/0 conn(0x7f13180a3930 legacy=0x7f1318137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- 172.21.15.171:0/2560022270 shutdown_connections 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- 172.21.15.171:0/2560022270 >> 172.21.15.171:0/2560022270 conn(0x7f13180a6d70 msgr2=0x7f13180a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- 172.21.15.171:0/2560022270 shutdown_connections 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- 172.21.15.171:0/2560022270 wait complete. 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: build_initial_monmap 2024-04-25T23:59:32.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: monmap: 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:32.238 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 Processor -- start 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- start start 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: init 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient: _add_conns ranks=[1,8,0,3,2,6,5,4,7] 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): picked mon.noname-f con 0x7f13180a3930 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:32.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): picked mon.noname-e con 0x7f1318138150 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): picked mon.noname-a con 0x7f1318138570 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f131809eab0 con 0x7f1318138570 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1318138d40 con 0x7f13180a3930 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13180a1030 con 0x7f1318138150 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131ffbf640 10 monclient(hunting): authenticate will time out at 1222.951500s 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131d55a640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f1318138150 legacy=0x7f13181d16d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131dd5b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f13180a3930 0x7f1318133a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59944/0 (socket says 172.21.15.171:59944) 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f131dd5b640 1 -- 172.21.15.171:0/3524215586 learned_addr learned my addr 172.21.15.171:0/3524215586 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2787150398 0 0) 0x7f1318138d40 con 0x7f13180a3930 2024-04-25T23:59:32.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f130e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f130e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f130e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f130e7fc640 10 monclient(hunting): my global_id is 144424 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.239+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12fc003530 con 0x7f13180a3930 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1682319242 0 0) 0x7f12fc003530 con 0x7f13180a3930 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1318138d40 con 0x7f13180a3930 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1314001bd0 con 0x7f13180a3930 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.241 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146990457 0 0) 0x7f131809eab0 con 0x7f1318138570 2024-04-25T23:59:32.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient(hunting): my global_id is 6111 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12fc003530 con 0x7f1318138570 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3431973245 0 0) 0x7f1318138d40 con 0x7f13180a3930 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 >> v1:172.21.15.106:6793/0 conn(0x7f1318138150 legacy=0x7f13181d16d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 >> v1:172.21.15.106:6789/0 conn(0x7f1318138570 legacy=0x7f13181d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 monclient: found mon.f 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13181213e0 con 0x7f13180a3930 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:32.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131ffbf640 5 monclient: authenticate success, global_id 144424 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131ffbf640 10 monclient: _renew_subs 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131ffbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131ffbf640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1318120b40 con 0x7f13180a3930 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131ffbf640 10 monclient: _renew_subs 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131ffbf640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131ffbf640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f131809f830 con 0x7f13180a3930 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1314004de0 con 0x7f13180a3930 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f13140052d0 con 0x7f13180a3930 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130ffff640 4 set_mon_vals no callback set 2024-04-25T23:59:32.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 10 monclient: dump: 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.245 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1314010070 con 0x7f13180a3930 2024-04-25T23:59:32.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f12fbfff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f12fbfff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f12fbfff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:32.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12f4005090 con 0x7f13180a3930 2024-04-25T23:59:32.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(118..118 src has 1..118) ==== 5759+0+0 (unknown 1940617915 0 0) 0x7f13140450e0 con 0x7f13180a3930 2024-04-25T23:59:32.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.243+0000 7f131d55a640 10 monclient: get_auth_request con 0x7f12fc037870 auth_method 0 2024-04-25T23:59:32.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.247+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1314015b40 con 0x7f13180a3930 2024-04-25T23:59:32.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.247+0000 7f130e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.247+0000 7f130e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:32.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.411+0000 7f12fbfff640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:32.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.411+0000 7f12fbfff640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:32.464 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.411+0000 7f12fbfff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:32.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.411+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f12f4005380 con 0x7f13180a3930 2024-04-25T23:59:32.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.411+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v118) ==== 71+0+0 (unknown 1001918175 0 0) 0x7f131401dff0 con 0x7f13180a3930 2024-04-25T23:59:32.465 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.411+0000 7f130e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:32.466 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.411+0000 7f130e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:32.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:32.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:32.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:32.491 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f12f4000bd0 con 0x7f13180a3930 2024-04-25T23:59:32.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f130e7fc640 1 -- 172.21.15.171:0/3524215586 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v118) ==== 71+0+0 (unknown 1001918175 0 0) 0x7f1314042650 con 0x7f13180a3930 2024-04-25T23:59:32.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f130e7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:32.492 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f130e7fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:32.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 >> v1:172.21.15.171:6812/722422047 conn(0x7f12fc037870 legacy=0x7f12fc039d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 10 monclient: shutdown 2024-04-25T23:59:32.493 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:32.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 >> v1:172.21.15.171:6789/0 conn(0x7f13180a3930 legacy=0x7f1318133a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 shutdown_connections 2024-04-25T23:59:32.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 >> 172.21.15.171:0/3524215586 conn(0x7f13180a6d70 msgr2=0x7f1318136bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:32.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 shutdown_connections 2024-04-25T23:59:32.494 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.507+0000 7f12fbfff640 1 -- 172.21.15.171:0/3524215586 wait complete. 2024-04-25T23:59:32.506 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush weight-set reweight fooset osd.0 .9 2024-04-25T23:59:32.506 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:59:32.506 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight fooset osd.0 .9 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.639+0000 7fdffb408640 10 monclient: get_monmap_and_config 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.639+0000 7fdffb408640 10 monclient: build_initial_monmap 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.639+0000 7fdffb408640 10 monclient: monmap: 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:32.644899+0000 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:32.644899+0000 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:32.624 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:32.625 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.639+0000 7fdffb408640 1 Processor -- start 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.639+0000 7fdffb408640 1 -- start start 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.639+0000 7fdffb408640 10 monclient: init 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _add_conns ranks=[7,8,0,1,4,2,3,6,5] 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): picked mon.noname-i con 0x7fdff409c250 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): picked mon.noname-e con 0x7fdff409c630 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): picked mon.noname-a con 0x7fdff409ca90 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff40a2b80 con 0x7fdff409ca90 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff409a480 con 0x7fdff409c250 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff409a760 con 0x7fdff409c630 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:32.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): authenticate will time out at 1223.352266s 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdff91a4640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fdff409c250 0x7fdff4135ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36506/0 (socket says 172.21.15.171:36506) 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdff91a4640 1 -- 172.21.15.171:0/2388887374 learned_addr learned my addr 172.21.15.171:0/2388887374 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdff89a3640 1 -- 172.21.15.171:0/2388887374 >> v1:172.21.15.106:6793/0 conn(0x7fdff409c630 legacy=0x7fdff413a940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3012892438 0 0) 0x7fdff409a480 con 0x7fdff409c250 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient(hunting): my global_id is 144304 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfe0003530 con 0x7fdff409c250 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2594852596 0 0) 0x7fdfe0003530 con 0x7fdff409c250 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 >> v1:172.21.15.106:6793/0 conn(0x7fdff409c630 legacy=0x7fdff413a940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 >> v1:172.21.15.106:6789/0 conn(0x7fdff409ca90 legacy=0x7fdff413e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 monclient: found mon.noname-i 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff409aa40 con 0x7fdff409c250 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: _finish_auth 0 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdfe40017c0 con 0x7fdff409c250 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: dump: 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.635 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 5 monclient: authenticate success, global_id 144304 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdfe4001ab0 con 0x7fdff409c250 2024-04-25T23:59:32.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 4 set_mon_vals no callback set 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 1 -- 172.21.15.171:0/2388887374 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdfe4004bf0 con 0x7fdff409c250 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfebfff640 10 monclient: dump: 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.637 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: shutdown 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- 172.21.15.171:0/2388887374 >> v1:172.21.15.171:6792/0 conn(0x7fdff409c250 legacy=0x7fdff4135ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- 172.21.15.171:0/2388887374 shutdown_connections 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- 172.21.15.171:0/2388887374 >> 172.21.15.171:0/2388887374 conn(0x7fdff40a67e0 msgr2=0x7fdff40a6bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- 172.21.15.171:0/2388887374 shutdown_connections 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- 172.21.15.171:0/2388887374 wait complete. 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: build_initial_monmap 2024-04-25T23:59:32.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: monmap: 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:32.639 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 Processor -- start 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- start start 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: init 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _add_conns ranks=[8,3,7,6,0,2,5,4,1] 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): picked mon.noname-e con 0x7fdff409c250 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): picked mon.noname-g con 0x7fdff409c630 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): picked mon.noname-i con 0x7fdff409ca90 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff41cb620 con 0x7fdff409c630 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff40a0000 con 0x7fdff409ca90 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff409d250 con 0x7fdff409c250 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient(hunting): authenticate will time out at 1223.354774s 2024-04-25T23:59:32.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdff89a3640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fdff409c630 0x7fdff41caf10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58058/0 (socket says 172.21.15.171:58058) 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdff99a5640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fdff409ca90 0x7fdff41d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36522/0 (socket says 172.21.15.171:36522) 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdff91a4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fdff409c250 legacy=0x7fdff41ca800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdff89a3640 1 -- 172.21.15.171:0/1877656352 learned_addr learned my addr 172.21.15.171:0/1877656352 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680954892 0 0) 0x7fdff40a0000 con 0x7fdff409ca90 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): my global_id is 144313 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd8003530 con 0x7fdff409ca90 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 869632906 0 0) 0x7fdff41cb620 con 0x7fdff409c630 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): my global_id is 6186 2024-04-25T23:59:32.641 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdff40a0000 con 0x7fdff409c630 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2746198298 0 0) 0x7fdfd8003530 con 0x7fdff409ca90 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdff41cb620 con 0x7fdff409ca90 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdfec001cc0 con 0x7fdff409ca90 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.642 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.645 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.645 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:32.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4143882492 0 0) 0x7fdff40a0000 con 0x7fdff409c630 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdfd8003530 con 0x7fdff409c630 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdff00042b0 con 0x7fdff409c630 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.647 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2949859636 0 0) 0x7fdff41cb620 con 0x7fdff409ca90 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 >> v1:172.21.15.106:6793/0 conn(0x7fdff409c250 legacy=0x7fdff41ca800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 >> v1:172.21.15.171:6790/0 conn(0x7fdff409c630 legacy=0x7fdff41caf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 monclient: found mon.i 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:32.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff408cea0 con 0x7fdff409ca90 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdfe9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 5 monclient: authenticate success, global_id 144313 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _renew_subs 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdff408d180 con 0x7fdff409ca90 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _renew_subs 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.643+0000 7fdffb408640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fdff4099570 con 0x7fdff409ca90 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdfec002090 con 0x7fdff409ca90 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdfec003f90 con 0x7fdff409ca90 2024-04-25T23:59:32.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfeb7fe640 4 set_mon_vals no callback set 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 10 monclient: dump: 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.650 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdffb408640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdfec0041b0 con 0x7fdff409ca90 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdffb408640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdffb408640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdffb408640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfd4005090 con 0x7fdff409ca90 2024-04-25T23:59:32.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(118..118 src has 1..118) ==== 5759+0+0 (unknown 1940617915 0 0) 0x7fdfec044f80 con 0x7fdff409ca90 2024-04-25T23:59:32.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.647+0000 7fdff91a4640 10 monclient: get_auth_request con 0x7fdfd8037e50 auth_method 0 2024-04-25T23:59:32.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.651+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdfec015980 con 0x7fdff409ca90 2024-04-25T23:59:32.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.651+0000 7fdfe9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.651+0000 7fdfe9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:32.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.823+0000 7fdffb408640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:32.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.823+0000 7fdffb408640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:32.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.823+0000 7fdffb408640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:32.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.823+0000 7fdffb408640 1 -- 172.21.15.171:0/1877656352 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]} v 0) -- 0x7fdfd4005380 con 0x7fdff409ca90 2024-04-25T23:59:32.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.823+0000 7fdfe9ffb640 1 -- 172.21.15.171:0/1877656352 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}]=-2 pool 'fooset' not found v118) ==== 152+0+0 (unknown 2159622029 0 0) 0x7fdfec015280 con 0x7fdff409ca90 2024-04-25T23:59:32.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.823+0000 7fdfe9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:32.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.823+0000 7fdfe9ffb640 10 monclient: _finish_command 2 = mon:2 pool 'fooset' not found 2024-04-25T23:59:32.809 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOENT: pool 'fooset' not found 2024-04-25T23:59:32.813 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:59:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create fooset 8 2024-04-25T23:59:32.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient: get_monmap_and_config 2024-04-25T23:59:32.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient: build_initial_monmap 2024-04-25T23:59:32.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient: monmap: 2024-04-25T23:59:32.932 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:32.953119+0000 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:32.953119+0000 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:32.933 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:32.934 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 1 Processor -- start 2024-04-25T23:59:32.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 1 -- start start 2024-04-25T23:59:32.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient: init 2024-04-25T23:59:32.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:32.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient: _add_conns ranks=[5,6,4,7,0,8,3,2,1] 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient(hunting): picked mon.noname-h con 0x7fb6a80a1530 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient(hunting): picked mon.noname-d con 0x7fb6a8071c00 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.947+0000 7fb6afd53640 10 monclient(hunting): picked mon.noname-c con 0x7fb6a8071730 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a806ea70 con 0x7fb6a8071730 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a80723d0 con 0x7fb6a80a1530 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a8072990 con 0x7fb6a8071c00 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient(hunting): authenticate will time out at 1223.660047s 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6adaef640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb6a80a1530 0x7fb6a80a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45416/0 (socket says 172.21.15.171:45416) 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6adaef640 1 -- 172.21.15.171:0/2240105323 learned_addr learned my addr 172.21.15.171:0/2240105323 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1314199399 0 0) 0x7fb6a80723d0 con 0x7fb6a80a1530 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient(hunting): my global_id is 5855 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb694003530 con 0x7fb6a80a1530 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3575256756 0 0) 0x7fb694003530 con 0x7fb6a80a1530 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 >> v1:172.21.15.106:6792/0 conn(0x7fb6a8071c00 legacy=0x7fb6a813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 >> v1:172.21.15.106:6791/0 conn(0x7fb6a8071730 legacy=0x7fb6a813e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: _finish_hunting 0 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 monclient: found mon.noname-h 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a80a3100 con 0x7fb6a80a1530 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: _finish_auth 0 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: _check_auth_tickets 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:32.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb6a40017c0 con 0x7fb6a80a1530 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 5 monclient: authenticate success, global_id 5855 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: dump: 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.943 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6a4001ab0 con 0x7fb6a80a1530 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 4 set_mon_vals no callback set 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 1 -- 172.21.15.171:0/2240105323 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb6a4004bf0 con 0x7fb6a80a1530 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6acaed640 10 monclient: dump: 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.945 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: shutdown 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- 172.21.15.171:0/2240105323 >> v1:172.21.15.171:6791/0 conn(0x7fb6a80a1530 legacy=0x7fb6a80a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- 172.21.15.171:0/2240105323 shutdown_connections 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- 172.21.15.171:0/2240105323 >> 172.21.15.171:0/2240105323 conn(0x7fb6a80a62d0 msgr2=0x7fb6a80a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- 172.21.15.171:0/2240105323 shutdown_connections 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- 172.21.15.171:0/2240105323 wait complete. 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: build_initial_monmap 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: monmap: 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:32.946 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 Processor -- start 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- start start 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: init 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: _add_conns ranks=[8,1,5,2,4,3,0,7,6] 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient(hunting): picked mon.noname-e con 0x7fb6a8071730 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient(hunting): picked mon.noname-f con 0x7fb6a8071c00 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient(hunting): picked mon.noname-h con 0x7fb6a80a1530 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a81cd130 con 0x7fb6a8071c00 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a81223e0 con 0x7fb6a80a1530 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a809f660 con 0x7fb6a8071730 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient(hunting): authenticate will time out at 1223.663079s 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6adaef640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb6a8071730 legacy=0x7fb6a8132a00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6ae2f0640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb6a80a1530 0x7fb6a81d4550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45428/0 (socket says 172.21.15.171:45428) 2024-04-25T23:59:32.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6ae2f0640 1 -- 172.21.15.171:0/2248386870 learned_addr learned my addr 172.21.15.171:0/2248386870 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2430530771 0 0) 0x7fb6a81223e0 con 0x7fb6a80a1530 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): my global_id is 5864 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb68c003530 con 0x7fb6a80a1530 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990327026 0 0) 0x7fb6a81cd130 con 0x7fb6a8071c00 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): my global_id is 144433 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a81223e0 con 0x7fb6a8071c00 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1095882868 0 0) 0x7fb68c003530 con 0x7fb6a80a1530 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6a81cd130 con 0x7fb6a80a1530 2024-04-25T23:59:32.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 970207420 0 0) 0x7fb6a81223e0 con 0x7fb6a8071c00 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb68c003530 con 0x7fb6a8071c00 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb6a0001d80 con 0x7fb6a80a1530 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.950 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb698001990 con 0x7fb6a8071c00 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:32.951 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.952 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2852253306 0 0) 0x7fb6a81cd130 con 0x7fb6a80a1530 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 >> v1:172.21.15.106:6793/0 conn(0x7fb6a8071730 legacy=0x7fb6a8132a00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 >> v1:172.21.15.171:6789/0 conn(0x7fb6a8071c00 legacy=0x7fb6a81cc210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 monclient: found mon.h 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a8122100 con 0x7fb6a80a1530 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb69e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 5 monclient: authenticate success, global_id 5864 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: _renew_subs 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:32.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a81209d0 con 0x7fb6a80a1530 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: _renew_subs 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.951+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6a8133110 con 0x7fb6a80a1530 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6a0003c50 con 0x7fb6a80a1530 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb6a00041c0 con 0x7fb6a80a1530 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69ffff640 4 set_mon_vals no callback set 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 10 monclient: dump: 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.954 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb6afd53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb6a00043e0 con 0x7fb6a80a1530 2024-04-25T23:59:32.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb6afd53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb6afd53640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:32.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb690005090 con 0x7fb6a80a1530 2024-04-25T23:59:32.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(118..118 src has 1..118) ==== 5759+0+0 (unknown 1940617915 0 0) 0x7fb6a0045110 con 0x7fb6a80a1530 2024-04-25T23:59:32.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.955+0000 7fb6adaef640 10 monclient: get_auth_request con 0x7fb68c037d70 auth_method 0 2024-04-25T23:59:32.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.959+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb6a0015b30 con 0x7fb6a80a1530 2024-04-25T23:59:32.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.959+0000 7fb69e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:32.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:32.959+0000 7fb69e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:33.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.107+0000 7fb6afd53640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}] 2024-04-25T23:59:33.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.107+0000 7fb6afd53640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}] 2024-04-25T23:59:33.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.107+0000 7fb6afd53640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:33.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.107+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "fooset", "pg_num": 8} v 0) -- 0x7fb690005b90 con 0x7fb6a80a1530 2024-04-25T23:59:33.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.695+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}]=0 pool 'fooset' created v119) ==== 115+0+0 (unknown 2594174340 0 0) 0x7fb6a0015430 con 0x7fb6a80a1530 2024-04-25T23:59:33.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.695+0000 7fb69e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}] 2024-04-25T23:59:33.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.695+0000 7fb69e7fc640 10 monclient: _finish_command 2 = system:0 pool 'fooset' created 2024-04-25T23:59:33.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.787+0000 7fb6afd53640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}] 2024-04-25T23:59:33.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.787+0000 7fb6afd53640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}] 2024-04-25T23:59:33.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.787+0000 7fb6afd53640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:33.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.787+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "fooset", "pg_num": 8} v 0) -- 0x7fb6900010a0 con 0x7fb6a80a1530 2024-04-25T23:59:33.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.787+0000 7fb69e7fc640 1 -- 172.21.15.171:0/2248386870 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}]=0 pool 'fooset' already exists v119) ==== 122+0+0 (unknown 2847755681 0 0) 0x7fb6a0019780 con 0x7fb6a80a1530 2024-04-25T23:59:33.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.787+0000 7fb69e7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "fooset", "pg_num": 8}] 2024-04-25T23:59:33.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.787+0000 7fb69e7fc640 10 monclient: _finish_command 3 = system:0 pool 'fooset' already exists 2024-04-25T23:59:33.773 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'fooset' already exists 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 >> v1:172.21.15.171:6812/722422047 conn(0x7fb68c037d70 legacy=0x7fb68c03a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 10 monclient: shutdown 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 >> v1:172.21.15.171:6791/0 conn(0x7fb6a80a1530 legacy=0x7fb6a81d4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 shutdown_connections 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 >> 172.21.15.171:0/2248386870 conn(0x7fb6a80a62d0 msgr2=0x7fb6a81bd800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 shutdown_connections 2024-04-25T23:59:33.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.791+0000 7fb6afd53640 1 -- 172.21.15.171:0/2248386870 wait complete. 2024-04-25T23:59:33.789 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create barset 8 2024-04-25T23:59:33.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient: get_monmap_and_config 2024-04-25T23:59:33.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient: build_initial_monmap 2024-04-25T23:59:33.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient: monmap: 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:33.928923+0000 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:33.928923+0000 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:33.909 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:33.910 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:33.910 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:33.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 1 Processor -- start 2024-04-25T23:59:33.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 1 -- start start 2024-04-25T23:59:33.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient: init 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient: _add_conns ranks=[7,6,2,3,4,0,8,1,5] 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient(hunting): picked mon.noname-i con 0x7f89e80a1530 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient(hunting): picked mon.noname-d con 0x7f89e80a2020 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient(hunting): picked mon.noname-b con 0x7f89e8072540 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e806ff90 con 0x7f89e8072540 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e8071270 con 0x7f89e80a2020 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e806fb20 con 0x7f89e80a1530 2024-04-25T23:59:33.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89eff37640 10 monclient(hunting): authenticate will time out at 1224.635807s 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89edcd3640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f89e80a1530 0x7f89e80a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36528/0 (socket says 172.21.15.171:36528) 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.923+0000 7f89edcd3640 1 -- 172.21.15.171:0/3060341756 learned_addr learned my addr 172.21.15.171:0/3060341756 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1698318339 0 0) 0x7f89e806fb20 con 0x7f89e80a1530 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient(hunting): _negotiate 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient(hunting): my global_id is 144322 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89d4003530 con 0x7f89e80a1530 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4236369229 0 0) 0x7f89d4003530 con 0x7f89e80a1530 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 >> v1:172.21.15.106:6792/0 conn(0x7f89e80a2020 legacy=0x7f89e8139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 >> v1:172.21.15.106:6790/0 conn(0x7f89e8072540 legacy=0x7f89e813d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: _finish_hunting 0 2024-04-25T23:59:33.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 monclient: found mon.noname-i 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e80a3100 con 0x7f89e80a1530 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: _finish_auth 0 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: _check_auth_tickets 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89e40017c0 con 0x7f89e80a1530 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: dump: 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.918 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 5 monclient: authenticate success, global_id 144322 2024-04-25T23:59:33.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89e4001ab0 con 0x7f89e80a1530 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 1 -- 172.21.15.171:0/3060341756 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89e4004bf0 con 0x7f89e80a1530 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 4 set_mon_vals no callback set 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eccd1640 10 monclient: dump: 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:33.920 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: shutdown 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- 172.21.15.171:0/3060341756 >> v1:172.21.15.171:6792/0 conn(0x7f89e80a1530 legacy=0x7f89e80a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- 172.21.15.171:0/3060341756 shutdown_connections 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- 172.21.15.171:0/3060341756 >> 172.21.15.171:0/3060341756 conn(0x7f89e80a62d0 msgr2=0x7f89e80a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:33.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- 172.21.15.171:0/3060341756 shutdown_connections 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- 172.21.15.171:0/3060341756 wait complete. 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: build_initial_monmap 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: monmap: 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:33.922 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 Processor -- start 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- start start 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: init 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: _add_conns ranks=[7,6,8,5,4,2,1,3,0] 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient(hunting): picked mon.noname-i con 0x7f89e8072540 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient(hunting): picked mon.noname-d con 0x7f89e80a1530 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient(hunting): picked mon.noname-e con 0x7f89e80a2020 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e80708b0 con 0x7f89e80a1530 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e80704f0 con 0x7f89e8072540 2024-04-25T23:59:33.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89e8131a30 con 0x7f89e80a2020 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient(hunting): authenticate will time out at 1224.638937s 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89edcd3640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f89e8072540 0x7f89e8130c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36532/0 (socket says 172.21.15.171:36532) 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89ee4d4640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f89e80a2020 legacy=0x7f89e81d2ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89edcd3640 1 -- 172.21.15.171:0/649566119 learned_addr learned my addr 172.21.15.171:0/649566119 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386357662 0 0) 0x7f89e80a3100 con 0x7f89e8072540 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): my global_id is 144331 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89cc003530 con 0x7f89e8072540 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 37611899 0 0) 0x7f89cc003530 con 0x7f89e8072540 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89e80a3100 con 0x7f89e8072540 2024-04-25T23:59:33.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89e4004b30 con 0x7f89e8072540 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:33.925 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2193457053 0 0) 0x7f89e8071270 con 0x7f89e80a1530 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient(hunting): my global_id is 6072 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89cc003530 con 0x7f89e80a1530 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 332443478 0 0) 0x7f89e80a3100 con 0x7f89e8072540 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 >> v1:172.21.15.106:6793/0 conn(0x7f89e80a2020 legacy=0x7f89e81d2ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:33.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 >> v1:172.21.15.106:6792/0 conn(0x7f89e80a1530 legacy=0x7f89e8131320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 monclient: found mon.i 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89e806f030 con 0x7f89e8072540 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 5 monclient: authenticate success, global_id 144331 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: _renew_subs 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89e8136310 con 0x7f89e8072540 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: _renew_subs 2024-04-25T23:59:33.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f89e81368d0 con 0x7f89e8072540 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89e4001ab0 con 0x7f89e8072540 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89e4001ce0 con 0x7f89e8072540 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89dffff640 4 set_mon_vals no callback set 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.927+0000 7f89de7fc640 10 monclient: dump: 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:33.928 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.931+0000 7f89eff37640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.931+0000 7f89eff37640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.931+0000 7f89eff37640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.931+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d0005090 con 0x7f89e8072540 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.931+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f89e40100e0 con 0x7f89e8072540 2024-04-25T23:59:33.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.931+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(119..119 src has 1..119) ==== 6104+0+0 (unknown 3587182812 0 0) 0x7f89e4045110 con 0x7f89e8072540 2024-04-25T23:59:33.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.931+0000 7f89ed4d2640 10 monclient: get_auth_request con 0x7f89cc037800 auth_method 0 2024-04-25T23:59:33.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.935+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f89e80704f0 con 0x7f89e8072540 2024-04-25T23:59:33.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.935+0000 7f89de7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:33.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:33.935+0000 7f89de7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:34.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.099+0000 7f89eff37640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}] 2024-04-25T23:59:34.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.099+0000 7f89eff37640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}] 2024-04-25T23:59:34.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.099+0000 7f89eff37640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:34.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.099+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "barset", "pg_num": 8} v 0) -- 0x7f89d0005b90 con 0x7f89e8072540 2024-04-25T23:59:34.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.695+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}]=0 pool 'barset' created v120) ==== 115+0+0 (unknown 1312594989 0 0) 0x7f89e4015ad0 con 0x7f89e8072540 2024-04-25T23:59:34.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.695+0000 7f89de7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}] 2024-04-25T23:59:34.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.695+0000 7f89de7fc640 10 monclient: _finish_command 2 = system:0 pool 'barset' created 2024-04-25T23:59:34.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.803+0000 7f89eff37640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}] 2024-04-25T23:59:34.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.803+0000 7f89eff37640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}] 2024-04-25T23:59:34.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.803+0000 7f89eff37640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:34.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.803+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "barset", "pg_num": 8} v 0) -- 0x7f89d00010a0 con 0x7f89e8072540 2024-04-25T23:59:34.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89de7fc640 1 -- 172.21.15.171:0/649566119 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}]=0 pool 'barset' already exists v120) ==== 122+0+0 (unknown 2287243759 0 0) 0x7f89e40153d0 con 0x7f89e8072540 2024-04-25T23:59:34.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89de7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "barset", "pg_num": 8}] 2024-04-25T23:59:34.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89de7fc640 10 monclient: _finish_command 3 = system:0 pool 'barset' already exists 2024-04-25T23:59:34.791 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'barset' already exists 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 >> v1:172.21.15.171:6812/722422047 conn(0x7f89cc037800 legacy=0x7f89cc039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 10 monclient: shutdown 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 >> v1:172.21.15.171:6792/0 conn(0x7f89e8072540 legacy=0x7f89e8130c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 shutdown_connections 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 >> 172.21.15.171:0/649566119 conn(0x7f89e80a62d0 msgr2=0x7f89e81334f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 shutdown_connections 2024-04-25T23:59:34.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.807+0000 7f89eff37640 1 -- 172.21.15.171:0/649566119 wait complete. 2024-04-25T23:59:34.807 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set barset size 3 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient: get_monmap_and_config 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient: build_initial_monmap 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient: monmap: 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:34.947845+0000 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:34.947845+0000 2024-04-25T23:59:34.927 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:34.928 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 1 Processor -- start 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 1 -- start start 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient: init 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient: _add_conns ranks=[3,4,1,5,2,0,6,8,7] 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient(hunting): picked mon.noname-g con 0x7fb1e0137cb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient(hunting): picked mon.noname-c con 0x7fb1e00a0e50 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient(hunting): picked mon.noname-f con 0x7fb1e013e2c0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e006b860 con 0x7fb1e013e2c0 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e009fb80 con 0x7fb1e0137cb0 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e009fe60 con 0x7fb1e00a0e50 2024-04-25T23:59:34.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1e583c640 10 monclient(hunting): authenticate will time out at 1225.655623s 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1df7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb1e013e2c0 0x7fb1e01406b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59972/0 (socket says 172.21.15.171:59972) 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1df7fe640 1 -- 172.21.15.171:0/3361587334 learned_addr learned my addr 172.21.15.171:0/3361587334 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.943+0000 7fb1deffd640 1 --1- 172.21.15.171:0/3361587334 >> v1:172.21.15.171:6790/0 conn(0x7fb1e0137cb0 0x7fb1e0138090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58074/0 (socket says 172.21.15.171:58074) 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719524237 0 0) 0x7fb1e009fb80 con 0x7fb1e0137cb0 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): my global_id is 6195 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1c8003530 con 0x7fb1e0137cb0 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3061252747 0 0) 0x7fb1e006b860 con 0x7fb1e013e2c0 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:34.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient(hunting): my global_id is 144442 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1e009fb80 con 0x7fb1e013e2c0 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1303531448 0 0) 0x7fb1c8003530 con 0x7fb1e0137cb0 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 >> v1:172.21.15.106:6791/0 conn(0x7fb1e00a0e50 legacy=0x7fb1e013cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 >> v1:172.21.15.171:6789/0 conn(0x7fb1e013e2c0 legacy=0x7fb1e01406b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 monclient: found mon.noname-g 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e00a0140 con 0x7fb1e0137cb0 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:34.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 5 monclient: authenticate success, global_id 6195 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb1d0001b40 con 0x7fb1e0137cb0 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: dump: 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:34.939 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1d0001db0 con 0x7fb1e0137cb0 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 4 set_mon_vals no callback set 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 1 -- 172.21.15.171:0/3361587334 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb1d0004eb0 con 0x7fb1e0137cb0 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1ddffb640 10 monclient: dump: 2024-04-25T23:59:34.940 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:34.941 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: shutdown 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- 172.21.15.171:0/3361587334 >> v1:172.21.15.171:6790/0 conn(0x7fb1e0137cb0 legacy=0x7fb1e0138090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- 172.21.15.171:0/3361587334 shutdown_connections 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- 172.21.15.171:0/3361587334 >> 172.21.15.171:0/3361587334 conn(0x7fb1e00a7350 msgr2=0x7fb1e00a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- 172.21.15.171:0/3361587334 shutdown_connections 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- 172.21.15.171:0/3361587334 wait complete. 2024-04-25T23:59:34.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: build_initial_monmap 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: monmap: 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:34.943 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 Processor -- start 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- start start 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: init 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: _add_conns ranks=[3,8,6,5,1,2,4,7,0] 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient(hunting): picked mon.noname-g con 0x7fb1e00a0e50 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient(hunting): picked mon.noname-e con 0x7fb1e0137cb0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient(hunting): picked mon.noname-d con 0x7fb1e013e2c0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e0134b80 con 0x7fb1e00a0e50 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e0134e60 con 0x7fb1e013e2c0 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1e012c160 con 0x7fb1e0137cb0 2024-04-25T23:59:34.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient(hunting): authenticate will time out at 1225.658856s 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1deffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fb1e00a0e50 0x7fb1e012b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58090/0 (socket says 172.21.15.171:58090) 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1deffd640 1 -- 172.21.15.171:0/1227053873 learned_addr learned my addr 172.21.15.171:0/1227053873 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1de7fc640 1 -- 172.21.15.171:0/1227053873 >> v1:172.21.15.106:6793/0 conn(0x7fb1e0137cb0 legacy=0x7fb1e012ba50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1731443945 0 0) 0x7fb1e0134b80 con 0x7fb1e00a0e50 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): my global_id is 6204 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1cc003530 con 0x7fb1e00a0e50 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3863212189 0 0) 0x7fb1cc003530 con 0x7fb1e00a0e50 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1e0134b80 con 0x7fb1e00a0e50 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb1d0001b00 con 0x7fb1e00a0e50 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:34.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): dump: 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:34.946 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3014521646 0 0) 0x7fb1e0134e60 con 0x7fb1e013e2c0 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient(hunting): my global_id is 6081 2024-04-25T23:59:34.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1cc003530 con 0x7fb1e013e2c0 2024-04-25T23:59:34.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 587424453 0 0) 0x7fb1e0134b80 con 0x7fb1e00a0e50 2024-04-25T23:59:34.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 >> v1:172.21.15.106:6793/0 conn(0x7fb1e0137cb0 legacy=0x7fb1e012ba50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:34.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 >> v1:172.21.15.106:6792/0 conn(0x7fb1e013e2c0 legacy=0x7fb1e01d48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 monclient: found mon.g 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1e01336d0 con 0x7fb1e00a0e50 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 5 monclient: authenticate success, global_id 6204 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: _renew_subs 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb1e009f430 con 0x7fb1e00a0e50 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: _renew_subs 2024-04-25T23:59:34.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb1e0135640 con 0x7fb1e00a0e50 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb1d0001db0 con 0x7fb1e00a0e50 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb1d0002000 con 0x7fb1e00a0e50 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1dd7fa640 4 set_mon_vals no callback set 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.947+0000 7fb1c7fff640 10 monclient: dump: 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:34.950 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.951+0000 7fb1e583c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.951+0000 7fb1e583c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.951+0000 7fb1e583c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:34.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.951+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1c0005090 con 0x7fb1e00a0e50 2024-04-25T23:59:34.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.951+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb1d00103f0 con 0x7fb1e00a0e50 2024-04-25T23:59:34.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.951+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(120..120 src has 1..120) ==== 6449+0+0 (unknown 3948807489 0 0) 0x7fb1d00454e0 con 0x7fb1e00a0e50 2024-04-25T23:59:34.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.951+0000 7fb1de7fc640 10 monclient: get_auth_request con 0x7fb1cc037840 auth_method 0 2024-04-25T23:59:34.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.955+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb1d0015ce0 con 0x7fb1e00a0e50 2024-04-25T23:59:34.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.955+0000 7fb1c7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:34.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:34.955+0000 7fb1c7fff640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:35.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.115+0000 7fb1e583c640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}] 2024-04-25T23:59:35.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.115+0000 7fb1e583c640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}] 2024-04-25T23:59:35.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.115+0000 7fb1e583c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:35.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.115+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"} v 0) -- 0x7fb1c0005b90 con 0x7fb1e00a0e50 2024-04-25T23:59:35.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.703+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}]=0 set pool 10 size to 3 v121) ==== 126+0+0 (unknown 3200291347 0 0) 0x7fb1d001e190 con 0x7fb1e00a0e50 2024-04-25T23:59:35.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.703+0000 7fb1c7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}] 2024-04-25T23:59:35.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.703+0000 7fb1c7fff640 10 monclient: _finish_command 2 = system:0 set pool 10 size to 3 2024-04-25T23:59:35.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.807+0000 7fb1e583c640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}] 2024-04-25T23:59:35.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.807+0000 7fb1e583c640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}] 2024-04-25T23:59:35.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.807+0000 7fb1e583c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:35.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:35.807+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"} v 0) -- 0x7fb1c00010a0 con 0x7fb1e00a0e50 2024-04-25T23:59:36.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.703+0000 7fb1c7fff640 1 -- 172.21.15.171:0/1227053873 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}]=0 set pool 10 size to 3 v122) ==== 126+0+0 (unknown 1015358924 0 0) 0x7fb1d00139b0 con 0x7fb1e00a0e50 2024-04-25T23:59:36.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.703+0000 7fb1c7fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "barset", "var": "size", "val": "3"}] 2024-04-25T23:59:36.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.703+0000 7fb1c7fff640 10 monclient: _finish_command 3 = system:0 set pool 10 size to 3 2024-04-25T23:59:36.689 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 10 size to 3 2024-04-25T23:59:36.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 >> v1:172.21.15.171:6812/722422047 conn(0x7fb1cc037840 legacy=0x7fb1cc039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:36.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 10 monclient: shutdown 2024-04-25T23:59:36.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:36.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 >> v1:172.21.15.171:6790/0 conn(0x7fb1e00a0e50 legacy=0x7fb1e012b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:36.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 shutdown_connections 2024-04-25T23:59:36.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 >> 172.21.15.171:0/1227053873 conn(0x7fb1e00a7350 msgr2=0x7fb1e0131af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:36.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 shutdown_connections 2024-04-25T23:59:36.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.707+0000 7fb1e583c640 1 -- 172.21.15.171:0/1227053873 wait complete. 2024-04-25T23:59:36.715 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush weight-set reweight fooset osd.0 .9 2024-04-25T23:59:36.715 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:59:36.715 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight fooset osd.0 .9 2024-04-25T23:59:36.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.847+0000 7f0eab40d640 10 monclient: get_monmap_and_config 2024-04-25T23:59:36.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.847+0000 7f0eab40d640 10 monclient: build_initial_monmap 2024-04-25T23:59:36.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.847+0000 7f0eab40d640 10 monclient: monmap: 2024-04-25T23:59:36.832 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:36.832 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:36.853183+0000 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:36.853183+0000 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:36.833 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:36.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.847+0000 7f0eab40d640 1 Processor -- start 2024-04-25T23:59:36.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.847+0000 7f0eab40d640 1 -- start start 2024-04-25T23:59:36.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.847+0000 7f0eab40d640 10 monclient: init 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: _add_conns ranks=[5,3,6,0,2,8,4,1,7] 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): picked mon.noname-h con 0x7f0ea4135a00 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): picked mon.noname-g con 0x7f0ea40a1790 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): picked mon.noname-d con 0x7f0ea413c130 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea40a1d80 con 0x7f0ea40a1790 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea4072f70 con 0x7f0ea4135a00 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea4072640 con 0x7f0ea413c130 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): authenticate will time out at 1227.560132s 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0ea91a9640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f0ea4135a00 0x7f0ea4135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45440/0 (socket says 172.21.15.171:45440) 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0ea91a9640 1 -- 172.21.15.171:0/2916482981 learned_addr learned my addr 172.21.15.171:0/2916482981 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:36.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472499990 0 0) 0x7f0ea40a1d80 con 0x7f0ea40a1790 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): my global_id is 6213 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e90003530 con 0x7f0ea40a1790 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1940174539 0 0) 0x7f0ea4072f70 con 0x7f0ea4135a00 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient(hunting): my global_id is 5873 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea40a1d80 con 0x7f0ea4135a00 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2353742427 0 0) 0x7f0e90003530 con 0x7f0ea40a1790 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 >> v1:172.21.15.106:6792/0 conn(0x7f0ea413c130 legacy=0x7f0ea413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:36.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 >> v1:172.21.15.171:6791/0 conn(0x7f0ea4135a00 legacy=0x7f0ea4135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 monclient: found mon.noname-g 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea4072920 con 0x7f0ea40a1790 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: _finish_auth 0 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0e940017c0 con 0x7f0ea40a1790 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 5 monclient: authenticate success, global_id 6213 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:36.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: dump: 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:36.844 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e94001a30 con 0x7f0ea40a1790 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 1 -- 172.21.15.171:0/2916482981 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0e94003960 con 0x7f0ea40a1790 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 4 set_mon_vals no callback set 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e9bfff640 10 monclient: dump: 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.845 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: shutdown 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:36.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- 172.21.15.171:0/2916482981 >> v1:172.21.15.171:6790/0 conn(0x7f0ea40a1790 legacy=0x7f0ea413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- 172.21.15.171:0/2916482981 shutdown_connections 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- 172.21.15.171:0/2916482981 >> 172.21.15.171:0/2916482981 conn(0x7f0ea40a2690 msgr2=0x7f0ea40a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- 172.21.15.171:0/2916482981 shutdown_connections 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- 172.21.15.171:0/2916482981 wait complete. 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: build_initial_monmap 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: monmap: 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:36.847 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 Processor -- start 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- start start 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: init 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient: _add_conns ranks=[1,7,2,8,0,4,3,5,6] 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): picked mon.noname-f con 0x7f0ea40a1790 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:36.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): picked mon.noname-i con 0x7f0ea4135a00 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): picked mon.noname-b con 0x7f0ea413c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea4071210 con 0x7f0ea40a1790 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea409fc40 con 0x7f0ea413c130 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ea41321c0 con 0x7f0ea4135a00 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0eab40d640 10 monclient(hunting): authenticate will time out at 1227.563294s 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0ea91a9640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0ea40a1790 0x7f0ea412c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59974/0 (socket says 172.21.15.171:59974) 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0ea91a9640 1 -- 172.21.15.171:0/575568580 learned_addr learned my addr 172.21.15.171:0/575568580 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2936741007 0 0) 0x7f0ea0001a40 con 0x7f0ea40a1790 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): my global_id is 144451 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e88003530 con 0x7f0ea40a1790 2024-04-25T23:59:36.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067760558 0 0) 0x7f0ea41321c0 con 0x7f0ea4135a00 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): my global_id is 144340 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea0001a40 con 0x7f0ea4135a00 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 21985926 0 0) 0x7f0e88003530 con 0x7f0ea40a1790 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ea41321c0 con 0x7f0ea40a1790 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ea0001800 con 0x7f0ea40a1790 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.851+0000 7f0e99ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:36.850 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:36.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4257310854 0 0) 0x7f0ea0001a40 con 0x7f0ea4135a00 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e88003530 con 0x7f0ea4135a00 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0e94003940 con 0x7f0ea4135a00 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:36.852 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2236920740 0 0) 0x7f0ea4072640 con 0x7f0ea413c130 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient(hunting): my global_id is 5915 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea0001a40 con 0x7f0ea413c130 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3302466118 0 0) 0x7f0ea41321c0 con 0x7f0ea40a1790 2024-04-25T23:59:36.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 >> v1:172.21.15.171:6792/0 conn(0x7f0ea4135a00 legacy=0x7f0ea412c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 >> v1:172.21.15.106:6790/0 conn(0x7f0ea413c130 legacy=0x7f0ea41d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 monclient: found mon.f 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ea41324a0 con 0x7f0ea40a1790 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 5 monclient: authenticate success, global_id 144451 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 10 monclient: _renew_subs 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:36.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ea4131c00 con 0x7f0ea40a1790 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 10 monclient: _renew_subs 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ea40705a0 con 0x7f0ea40a1790 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ea0004b90 con 0x7f0ea40a1790 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ea0005080 con 0x7f0ea40a1790 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e9b7fe640 4 set_mon_vals no callback set 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 10 monclient: dump: 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:36.855 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:36.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0eab40d640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e84005090 con 0x7f0ea40a1790 2024-04-25T23:59:36.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0ea00052e0 con 0x7f0ea40a1790 2024-04-25T23:59:36.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(122..122 src has 1..122) ==== 6449+0+0 (unknown 3564260000 0 0) 0x7f0ea0045240 con 0x7f0ea40a1790 2024-04-25T23:59:36.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.855+0000 7f0ea89a8640 10 monclient: get_auth_request con 0x7f0e88037e90 auth_method 0 2024-04-25T23:59:36.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.859+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0ea4071210 con 0x7f0ea40a1790 2024-04-25T23:59:36.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.859+0000 7f0e99ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:36.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:36.859+0000 7f0e99ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.027+0000 7f0eab40d640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:37.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.027+0000 7f0eab40d640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.027+0000 7f0eab40d640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:37.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.027+0000 7f0eab40d640 1 -- 172.21.15.171:0/575568580 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]} v 0) -- 0x7f0e84005380 con 0x7f0ea40a1790 2024-04-25T23:59:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.031+0000 7f0e99ffb640 1 -- 172.21.15.171:0/575568580 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}]=-2 no weight-set for pool 'fooset' v122) ==== 160+0+0 (unknown 4173571234 0 0) 0x7f0ea0015a50 con 0x7f0ea40a1790 2024-04-25T23:59:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.031+0000 7f0e99ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.031+0000 7f0e99ffb640 10 monclient: _finish_command 2 = mon:2 no weight-set for pool 'fooset' 2024-04-25T23:59:37.015 INFO:tasks.workunit.client.0.smithi171.stderr:Error ENOENT: no weight-set for pool 'fooset' 2024-04-25T23:59:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:59:37.021 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create fooset flat 2024-04-25T23:59:37.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient: get_monmap_and_config 2024-04-25T23:59:37.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient: build_initial_monmap 2024-04-25T23:59:37.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient: monmap: 2024-04-25T23:59:37.135 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:37.135 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.135 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:37.156092+0000 2024-04-25T23:59:37.135 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:37.156092+0000 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:37.136 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 1 Processor -- start 2024-04-25T23:59:37.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 1 -- start start 2024-04-25T23:59:37.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient: init 2024-04-25T23:59:37.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:37.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient: _add_conns ranks=[7,6,4,8,5,1,0,2,3] 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient(hunting): picked mon.noname-i con 0x7fb39c09dc80 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient(hunting): picked mon.noname-d con 0x7fb39c09fbc0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 10 monclient(hunting): picked mon.noname-c con 0x7fb39c099850 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.151+0000 7fb3a2d7c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c09ec20 con 0x7fb39c099850 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c0a1f10 con 0x7fb39c09fbc0 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c0a27d0 con 0x7fb39c09dc80 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient(hunting): authenticate will time out at 1227.864084s 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a0b18640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fb39c09dc80 0x7fb39c0a10f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36552/0 (socket says 172.21.15.171:36552) 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a0b18640 1 -- 172.21.15.171:0/123167908 learned_addr learned my addr 172.21.15.171:0/123167908 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2897164525 0 0) 0x7fb39c0a27d0 con 0x7fb39c09dc80 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient(hunting): my global_id is 144349 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb38c003530 con 0x7fb39c09dc80 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3308673829 0 0) 0x7fb38c003530 con 0x7fb39c09dc80 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 >> v1:172.21.15.106:6792/0 conn(0x7fb39c09fbc0 legacy=0x7fb39c0a1800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 >> v1:172.21.15.106:6791/0 conn(0x7fb39c099850 legacy=0x7fb39c1406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 monclient: found mon.noname-i 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c075480 con 0x7fb39c09dc80 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:37.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3900017c0 con 0x7fb39c09dc80 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: dump: 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.142 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 5 monclient: authenticate success, global_id 144349 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb390001b20 con 0x7fb39c09dc80 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 4 set_mon_vals no callback set 2024-04-25T23:59:37.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 1 -- 172.21.15.171:0/123167908 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb390001d50 con 0x7fb39c09dc80 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb39b7fe640 10 monclient: dump: 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.144 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient: shutdown 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/123167908 >> v1:172.21.15.171:6792/0 conn(0x7fb39c09dc80 legacy=0x7fb39c0a10f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/123167908 shutdown_connections 2024-04-25T23:59:37.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/123167908 >> 172.21.15.171:0/123167908 conn(0x7fb39c0a66c0 msgr2=0x7fb39c0a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/123167908 shutdown_connections 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/123167908 wait complete. 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient: build_initial_monmap 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient: monmap: 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:37.146 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:37.147 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:37.147 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:37.147 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:37.147 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:37.147 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:37.147 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:37.147 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 Processor -- start 2024-04-25T23:59:37.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- start start 2024-04-25T23:59:37.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient: init 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient: _add_conns ranks=[4,0,6,5,7,8,2,3,1] 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient(hunting): picked mon.noname-c con 0x7fb39c099850 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient(hunting): picked mon.noname-a con 0x7fb39c09dc80 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient(hunting): picked mon.noname-d con 0x7fb39c09fbc0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c1bec40 con 0x7fb39c09dc80 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c0a61f0 con 0x7fb39c099850 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb39c09e3c0 con 0x7fb39c09fbc0 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a2d7c640 10 monclient(hunting): authenticate will time out at 1227.867145s 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a0b18640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fb39c099850 0x7fb39c1cd960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:49778/0 (socket says 172.21.15.171:49778) 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a0b18640 1 -- 172.21.15.171:0/17137600 learned_addr learned my addr 172.21.15.171:0/17137600 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3a1319640 1 --1- 172.21.15.171:0/17137600 >> v1:172.21.15.106:6792/0 conn(0x7fb39c09fbc0 0x7fb39c1d5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:49538/0 (socket says 172.21.15.171:49538) 2024-04-25T23:59:37.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1468850272 0 0) 0x7fb39c1bec40 con 0x7fb39c09dc80 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3997fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3997fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.155+0000 7fb3997fa640 10 monclient(hunting): my global_id is 6129 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb380003530 con 0x7fb39c09dc80 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 286022322 0 0) 0x7fb3940014b0 con 0x7fb39c09fbc0 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): my global_id is 6108 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb39c1bec40 con 0x7fb39c09fbc0 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545929273 0 0) 0x7fb39c0a61f0 con 0x7fb39c099850 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): my global_id is 144490 2024-04-25T23:59:37.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3940014b0 con 0x7fb39c099850 2024-04-25T23:59:37.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3158427959 0 0) 0x7fb380003530 con 0x7fb39c09dc80 2024-04-25T23:59:37.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb39c0a61f0 con 0x7fb39c09dc80 2024-04-25T23:59:37.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb388001a70 con 0x7fb39c09dc80 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): dump: 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.157 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1471921463 0 0) 0x7fb39c1bec40 con 0x7fb39c09fbc0 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb380003530 con 0x7fb39c09fbc0 2024-04-25T23:59:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb394001ea0 con 0x7fb39c09fbc0 2024-04-25T23:59:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): dump: 2024-04-25T23:59:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3236345695 0 0) 0x7fb3940014b0 con 0x7fb39c099850 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb39c1bec40 con 0x7fb39c099850 2024-04-25T23:59:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb390001780 con 0x7fb39c099850 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient(hunting): dump: 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 665433355 0 0) 0x7fb39c0a61f0 con 0x7fb39c09dc80 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 >> v1:172.21.15.106:6792/0 conn(0x7fb39c09fbc0 legacy=0x7fb39c1d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 >> v1:172.21.15.106:6791/0 conn(0x7fb39c099850 legacy=0x7fb39c1cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 monclient: found mon.a 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c092770 con 0x7fb39c09dc80 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 5 monclient: authenticate success, global_id 6129 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 10 monclient: _renew_subs 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb39c09da50 con 0x7fb39c09dc80 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 10 monclient: _renew_subs 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb39c092490 con 0x7fb39c09dc80 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb388003780 con 0x7fb39c09dc80 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb388003cf0 con 0x7fb39c09dc80 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb39affd640 4 set_mon_vals no callback set 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 10 monclient: dump: 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb37c005090 con 0x7fb39c09dc80 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb388003f10 con 0x7fb39c09dc80 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(122..122 src has 1..122) ==== 6449+0+0 (unknown 3564260000 0 0) 0x7fb388043c20 con 0x7fb39c09dc80 2024-04-25T23:59:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.159+0000 7fb3a0b18640 10 monclient: get_auth_request con 0x7fb380038150 auth_method 0 2024-04-25T23:59:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.171+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb388014560 con 0x7fb39c09dc80 2024-04-25T23:59:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.175+0000 7fb3997fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.175+0000 7fb3997fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.339+0000 7fb3a2d7c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}] 2024-04-25T23:59:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.339+0000 7fb3a2d7c640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}] 2024-04-25T23:59:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.339+0000 7fb3a2d7c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:37.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.339+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"} v 0) -- 0x7fb37c005380 con 0x7fb39c09dc80 2024-04-25T23:59:37.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.699+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}]=0 v123) ==== 109+0+0 (unknown 308570655 0 0) 0x7fb388013e60 con 0x7fb39c09dc80 2024-04-25T23:59:37.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.699+0000 7fb3997fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}] 2024-04-25T23:59:37.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.699+0000 7fb3997fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:37.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.811+0000 7fb3a2d7c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}] 2024-04-25T23:59:37.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.811+0000 7fb3a2d7c640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}] 2024-04-25T23:59:37.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.811+0000 7fb3a2d7c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:37.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.811+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"} v 0) -- 0x7fb37c005ac0 con 0x7fb39c09dc80 2024-04-25T23:59:37.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.811+0000 7fb3997fa640 1 -- 172.21.15.171:0/17137600 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}]=0 weight-set for pool 'fooset' already created v123) ==== 153+0+0 (unknown 3682873716 0 0) 0x7fb38801c9b0 con 0x7fb39c09dc80 2024-04-25T23:59:37.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.811+0000 7fb3997fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create", "pool": "fooset", "mode": "flat"}] 2024-04-25T23:59:37.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.811+0000 7fb3997fa640 10 monclient: _finish_command 3 = system:0 weight-set for pool 'fooset' already created 2024-04-25T23:59:37.797 INFO:tasks.workunit.client.0.smithi171.stderr:weight-set for pool 'fooset' already created 2024-04-25T23:59:37.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 >> v1:172.21.15.171:6812/722422047 conn(0x7fb380038150 legacy=0x7fb38003a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 10 monclient: shutdown 2024-04-25T23:59:37.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:37.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 >> v1:172.21.15.106:6789/0 conn(0x7fb39c09dc80 legacy=0x7fb39c1d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 shutdown_connections 2024-04-25T23:59:37.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 >> 172.21.15.171:0/17137600 conn(0x7fb39c0a66c0 msgr2=0x7fb39c1bdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:37.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 shutdown_connections 2024-04-25T23:59:37.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.815+0000 7fb3a2d7c640 1 -- 172.21.15.171:0/17137600 wait complete. 2024-04-25T23:59:37.814 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create barset positional 2024-04-25T23:59:37.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.947+0000 7fe34b1fb640 10 monclient: get_monmap_and_config 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.947+0000 7fe34b1fb640 10 monclient: build_initial_monmap 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.947+0000 7fe34b1fb640 10 monclient: monmap: 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:37.954460+0000 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:37.954460+0000 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:37.934 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:37.935 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:37.935 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:37.935 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:37.935 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:37.935 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 Processor -- start 2024-04-25T23:59:37.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- start start 2024-04-25T23:59:37.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: init 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: _add_conns ranks=[7,8,5,3,1,6,2,0,4] 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient(hunting): picked mon.noname-i con 0x7fe344135a00 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient(hunting): picked mon.noname-e con 0x7fe3440a1790 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient(hunting): picked mon.noname-h con 0x7fe34413c130 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3440a1d80 con 0x7fe34413c130 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe344072f70 con 0x7fe344135a00 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe344072640 con 0x7fe3440a1790 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient(hunting): authenticate will time out at 1228.661379s 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe348f97640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fe344135a00 0x7fe344135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36566/0 (socket says 172.21.15.171:36566) 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe348f97640 1 -- 172.21.15.171:0/169297599 learned_addr learned my addr 172.21.15.171:0/169297599 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe343fff640 1 -- 172.21.15.171:0/169297599 >> v1:172.21.15.106:6793/0 conn(0x7fe3440a1790 legacy=0x7fe34413aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2335173513 0 0) 0x7fe3440a1d80 con 0x7fe34413c130 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): my global_id is 5882 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe330003530 con 0x7fe34413c130 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3899805547 0 0) 0x7fe344072f70 con 0x7fe344135a00 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient(hunting): my global_id is 144358 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3440a1d80 con 0x7fe344135a00 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1549201021 0 0) 0x7fe330003530 con 0x7fe34413c130 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 >> v1:172.21.15.106:6793/0 conn(0x7fe3440a1790 legacy=0x7fe34413aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:37.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 >> v1:172.21.15.171:6792/0 conn(0x7fe344135a00 legacy=0x7fe344135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 monclient: found mon.noname-h 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe344072920 con 0x7fe34413c130 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe33c001b40 con 0x7fe34413c130 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 5 monclient: authenticate success, global_id 5882 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:37.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: dump: 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.945 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe33c001da0 con 0x7fe34413c130 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 4 set_mon_vals no callback set 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 1 -- 172.21.15.171:0/169297599 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe33c003ce0 con 0x7fe34413c130 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe3437fe640 10 monclient: dump: 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.946 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: shutdown 2024-04-25T23:59:37.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- 172.21.15.171:0/169297599 >> v1:172.21.15.171:6791/0 conn(0x7fe34413c130 legacy=0x7fe34413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- 172.21.15.171:0/169297599 shutdown_connections 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- 172.21.15.171:0/169297599 >> 172.21.15.171:0/169297599 conn(0x7fe3440a2690 msgr2=0x7fe3440a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- 172.21.15.171:0/169297599 shutdown_connections 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- 172.21.15.171:0/169297599 wait complete. 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: build_initial_monmap 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: monmap: 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:37.948 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 Processor -- start 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 1 -- start start 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.951+0000 7fe34b1fb640 10 monclient: init 2024-04-25T23:59:37.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _add_conns ranks=[5,4,3,2,1,8,7,0,6] 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient(hunting): picked mon.noname-h con 0x7fe3440a1790 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient(hunting): picked mon.noname-c con 0x7fe344135a00 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient(hunting): picked mon.noname-g con 0x7fe34413c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe344136b10 con 0x7fe34413c130 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34413b480 con 0x7fe344135a00 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34409eb70 con 0x7fe3440a1790 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient(hunting): authenticate will time out at 1228.664379s 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe348f97640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe3440a1790 0x7fe34409b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45454/0 (socket says 172.21.15.171:45454) 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe348f97640 1 -- 172.21.15.171:0/2278939559 learned_addr learned my addr 172.21.15.171:0/2278939559 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 136545345 0 0) 0x7fe344136b10 con 0x7fe34413c130 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): my global_id is 6222 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe324003530 con 0x7fe34413c130 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989818160 0 0) 0x7fe34409eb70 con 0x7fe3440a1790 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): my global_id is 5891 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe344136b10 con 0x7fe3440a1790 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 87475781 0 0) 0x7fe324003530 con 0x7fe34413c130 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe34409eb70 con 0x7fe34413c130 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe33c001a40 con 0x7fe34413c130 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:37.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): dump: 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.952 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1288960482 0 0) 0x7fe344136b10 con 0x7fe3440a1790 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe324003530 con 0x7fe3440a1790 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3340013f0 con 0x7fe3440a1790 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): dump: 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229743263 0 0) 0x7fe34413b480 con 0x7fe344135a00 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:37.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient(hunting): my global_id is 144499 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe344136b10 con 0x7fe344135a00 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1762460632 0 0) 0x7fe34409eb70 con 0x7fe34413c130 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 >> v1:172.21.15.171:6791/0 conn(0x7fe3440a1790 legacy=0x7fe34409b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 >> v1:172.21.15.106:6791/0 conn(0x7fe344135a00 legacy=0x7fe34409bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 monclient: found mon.g 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34409fc40 con 0x7fe34413c130 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:37.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 5 monclient: authenticate success, global_id 6222 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _renew_subs 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe34409f6f0 con 0x7fe34413c130 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _renew_subs 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe34409c2f0 con 0x7fe34413c130 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe33c001d70 con 0x7fe34413c130 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe33c004290 con 0x7fe34413c130 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3427fc640 4 set_mon_vals no callback set 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 10 monclient: dump: 2024-04-25T23:59:37.956 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:37.957 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe328005090 con 0x7fe34413c130 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe33c00f030 con 0x7fe34413c130 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(123..123 src has 1..123) ==== 6781+0+0 (unknown 1846166789 0 0) 0x7fe33c044310 con 0x7fe34413c130 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.955+0000 7fe348f97640 10 monclient: get_auth_request con 0x7fe324037ee0 auth_method 0 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.959+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe33c0149d0 con 0x7fe34413c130 2024-04-25T23:59:37.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.959+0000 7fe3417fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:37.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:37.959+0000 7fe3417fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:38.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.115+0000 7fe34b1fb640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}] 2024-04-25T23:59:38.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.115+0000 7fe34b1fb640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}] 2024-04-25T23:59:38.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.115+0000 7fe34b1fb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:38.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.115+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"} v 0) -- 0x7fe328005380 con 0x7fe34413c130 2024-04-25T23:59:38.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.751+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}]=0 v124) ==== 115+0+0 (unknown 62422334 0 0) 0x7fe33c0142d0 con 0x7fe34413c130 2024-04-25T23:59:38.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.751+0000 7fe3417fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}] 2024-04-25T23:59:38.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.751+0000 7fe3417fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:38.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.859+0000 7fe34b1fb640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}] 2024-04-25T23:59:38.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.859+0000 7fe34b1fb640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}] 2024-04-25T23:59:38.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.859+0000 7fe34b1fb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:38.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.859+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"} v 0) -- 0x7fe328005be0 con 0x7fe34413c130 2024-04-25T23:59:38.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe3417fa640 1 -- 172.21.15.171:0/2278939559 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}]=0 weight-set for pool 'barset' already created v124) ==== 159+0+0 (unknown 175948579 0 0) 0x7fe33c01ce20 con 0x7fe34413c130 2024-04-25T23:59:38.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe3417fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create", "pool": "barset", "mode": "positional"}] 2024-04-25T23:59:38.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe3417fa640 10 monclient: _finish_command 3 = system:0 weight-set for pool 'barset' already created 2024-04-25T23:59:38.846 INFO:tasks.workunit.client.0.smithi171.stderr:weight-set for pool 'barset' already created 2024-04-25T23:59:38.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 >> v1:172.21.15.171:6812/722422047 conn(0x7fe324037ee0 legacy=0x7fe32403a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:38.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 10 monclient: shutdown 2024-04-25T23:59:38.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:38.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 >> v1:172.21.15.171:6790/0 conn(0x7fe34413c130 legacy=0x7fe3441d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:38.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 shutdown_connections 2024-04-25T23:59:38.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 >> 172.21.15.171:0/2278939559 conn(0x7fe3440a2690 msgr2=0x7fe34412f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:38.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 shutdown_connections 2024-04-25T23:59:38.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.863+0000 7fe34b1fb640 1 -- 172.21.15.171:0/2278939559 wait complete. 2024-04-25T23:59:38.861 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:38.862 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep fooset 2024-04-25T23:59:38.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient: get_monmap_and_config 2024-04-25T23:59:38.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient: build_initial_monmap 2024-04-25T23:59:38.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient: monmap: 2024-04-25T23:59:38.971 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:38.971 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:38.991904+0000 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:38.991904+0000 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:38.972 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 1 Processor -- start 2024-04-25T23:59:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 1 -- start start 2024-04-25T23:59:38.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient: init 2024-04-25T23:59:38.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:38.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient: _add_conns ranks=[3,8,7,6,5,4,0,2,1] 2024-04-25T23:59:38.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient(hunting): picked mon.noname-g con 0x7f1348135bb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:38.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient(hunting): picked mon.noname-e con 0x7f13481356f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:38.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient(hunting): picked mon.noname-i con 0x7f134813c130 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:38.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13480a1da0 con 0x7f1348135bb0 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13480a1fe0 con 0x7f134813c130 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1348072720 con 0x7f13481356f0 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient(hunting): authenticate will time out at 1229.698765s 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134e918640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f134813c130 0x7f134813e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36574/0 (socket says 172.21.15.171:36574) 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134e918640 1 -- 172.21.15.171:0/3151303419 learned_addr learned my addr 172.21.15.171:0/3151303419 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134e117640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f1348135bb0 0x7f1348135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58114/0 (socket says 172.21.15.171:58114) 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d916640 1 -- 172.21.15.171:0/3151303419 >> v1:172.21.15.106:6793/0 conn(0x7f13481356f0 legacy=0x7f134813aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975691343 0 0) 0x7f13480a1fe0 con 0x7f134813c130 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): _negotiate 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:38.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): my global_id is 144367 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1334003530 con 0x7f134813c130 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833857494 0 0) 0x7f13480a1da0 con 0x7f1348135bb0 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): _negotiate 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient(hunting): my global_id is 6231 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13480a1fe0 con 0x7f1348135bb0 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 998194569 0 0) 0x7f1334003530 con 0x7f134813c130 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 >> v1:172.21.15.106:6793/0 conn(0x7f13481356f0 legacy=0x7f134813aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 >> v1:172.21.15.171:6790/0 conn(0x7f1348135bb0 legacy=0x7f1348135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: _finish_hunting 0 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 monclient: found mon.noname-i 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:38.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13480a17f0 con 0x7f134813c130 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: _finish_auth 0 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: _check_auth_tickets 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1340001a70 con 0x7f134813c130 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 5 monclient: authenticate success, global_id 144367 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: dump: 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.982 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1340001cd0 con 0x7f134813c130 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:38.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f135037b640 4 set_mon_vals no callback set 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 1 -- 172.21.15.171:0/3151303419 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1340004f70 con 0x7f134813c130 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.987+0000 7f134d115640 10 monclient: dump: 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:38.984 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: shutdown 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/3151303419 >> v1:172.21.15.171:6792/0 conn(0x7f134813c130 legacy=0x7f134813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/3151303419 shutdown_connections 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/3151303419 >> 172.21.15.171:0/3151303419 conn(0x7f13480a2620 msgr2=0x7f13480a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/3151303419 shutdown_connections 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/3151303419 wait complete. 2024-04-25T23:59:38.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: build_initial_monmap 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: monmap: 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:38.986 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 Processor -- start 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- start start 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: init 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _add_conns ranks=[6,0,3,7,5,8,4,2,1] 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient(hunting): picked mon.noname-d con 0x7f13481356f0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient(hunting): picked mon.noname-a con 0x7f1348135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient(hunting): picked mon.noname-g con 0x7f134813c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:38.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1348139170 con 0x7f1348135bb0 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1348071ef0 con 0x7f134813c130 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f134813b460 con 0x7f13481356f0 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient(hunting): authenticate will time out at 1229.701752s 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f134e918640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f134813c130 0x7f13481d2960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58126/0 (socket says 172.21.15.171:58126) 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f134e918640 1 -- 172.21.15.171:0/4205991764 learned_addr learned my addr 172.21.15.171:0/4205991764 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1214279577 0 0) 0x7f13480a17f0 con 0x7f134813c130 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): my global_id is 6240 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f132c003530 con 0x7f134813c130 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 436272256 0 0) 0x7f132c003530 con 0x7f134813c130 2024-04-25T23:59:38.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13480a17f0 con 0x7f134813c130 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1340001a70 con 0x7f134813c130 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): dump: 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:38.989 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182700384 0 0) 0x7f134813b460 con 0x7f13481356f0 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient(hunting): my global_id is 6117 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f132c003530 con 0x7f13481356f0 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3564920148 0 0) 0x7f13480a17f0 con 0x7f134813c130 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 >> v1:172.21.15.106:6792/0 conn(0x7f13481356f0 legacy=0x7f1348133830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:38.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 >> v1:172.21.15.106:6789/0 conn(0x7f1348135bb0 legacy=0x7f13481cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 monclient: found mon.g 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13480719a0 con 0x7f134813c130 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: _finish_auth 0 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 5 monclient: authenticate success, global_id 6240 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _renew_subs 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f134813b180 con 0x7f134813c130 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _renew_subs 2024-04-25T23:59:38.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f134813bbe0 con 0x7f134813c130 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1340001cd0 con 0x7f134813c130 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1340005520 con 0x7f134813c130 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f134c914640 4 set_mon_vals no callback set 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 10 monclient: dump: 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:38.992 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f13400102c0 con 0x7f134813c130 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1330005090 con 0x7f134813c130 2024-04-25T23:59:38.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(124..124 src has 1..124) ==== 7393+0+0 (unknown 3652982850 0 0) 0x7f1340045880 con 0x7f134813c130 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.991+0000 7f134e117640 10 monclient: get_auth_request con 0x7f132c037890 auth_method 0 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.995+0000 7f134e117640 1 -- 172.21.15.171:0/4205991764 >> v1:172.21.15.171:6812/722422047 conn(0x7f132c037890 legacy=0x7f132c039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.995+0000 7f134e117640 1 -- 172.21.15.171:0/4205991764 >> v1:172.21.15.171:6812/722422047 conn(0x7f132c037890 legacy=0x7f132c039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.995+0000 7f134e117640 1 --1- 172.21.15.171:0/4205991764 >> v1:172.21.15.171:6812/722422047 conn(0x7f132c037890 0x7f132c039d50 :-1 s=OPENED pgs=317 cs=1 l=1).handle_message read tag failed 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.995+0000 7f134e117640 1 --1- 172.21.15.171:0/4205991764 >> v1:172.21.15.171:6812/722422047 conn(0x7f132c037890 0x7f132c039d50 :-1 s=OPENED pgs=317 cs=1 l=1).fault on lossy channel, failing 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.995+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 >> v1:172.21.15.171:6812/722422047 conn(0x7f132c037890 legacy=0x7f132c039d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.999+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1348071ef0 con 0x7f134813c130 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.999+0000 7f133effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:38.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:38.999+0000 7f133effd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:39.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.167+0000 7f135037b640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.167+0000 7f135037b640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.167+0000 7f135037b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:39.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.167+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f1330005380 con 0x7f134813c130 2024-04-25T23:59:39.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.167+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v124) ==== 71+0+14 (unknown 3707170821 0 3003798303) 0x7f1340015d30 con 0x7f134813c130 2024-04-25T23:59:39.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.167+0000 7f133effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.167+0000 7f133effd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:39.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:39.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f1330005ac0 con 0x7f134813c130 2024-04-25T23:59:39.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f133effd640 1 -- 172.21.15.171:0/4205991764 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v124) ==== 71+0+14 (unknown 3707170821 0 3003798303) 0x7f1340015630 con 0x7f134813c130 2024-04-25T23:59:39.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f133effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f133effd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:39.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 10 monclient: shutdown 2024-04-25T23:59:39.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:39.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 >> v1:172.21.15.171:6790/0 conn(0x7f134813c130 legacy=0x7f13481d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 shutdown_connections 2024-04-25T23:59:39.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 >> 172.21.15.171:0/4205991764 conn(0x7f13480a2620 msgr2=0x7f134813e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:39.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 shutdown_connections 2024-04-25T23:59:39.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.263+0000 7f135037b640 1 -- 172.21.15.171:0/4205991764 wait complete. 2024-04-25T23:59:39.261 INFO:tasks.workunit.client.0.smithi171.stdout:fooset 2024-04-25T23:59:39.262 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep barset 2024-04-25T23:59:39.262 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:39.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: get_monmap_and_config 2024-04-25T23:59:39.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: build_initial_monmap 2024-04-25T23:59:39.370 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: monmap: 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:39.391447+0000 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:39.391447+0000 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:39.371 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:39.372 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:39.372 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 Processor -- start 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- start start 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: init 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: _add_conns ranks=[8,4,1,0,3,7,6,2,5] 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient(hunting): picked mon.noname-e con 0x7f9be40a3930 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient(hunting): picked mon.noname-c con 0x7f9be4138150 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:39.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient(hunting): picked mon.noname-f con 0x7f9be4138570 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be40a2b70 con 0x7f9be4138570 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be40a2e50 con 0x7f9be4138150 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be40a4460 con 0x7f9be40a3930 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient(hunting): authenticate will time out at 1230.098436s 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be8959640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9be4138570 0x7f9be41406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59988/0 (socket says 172.21.15.171:59988) 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be8959640 1 -- 172.21.15.171:0/4259661743 learned_addr learned my addr 172.21.15.171:0/4259661743 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be3fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9be40a3930 legacy=0x7f9be4137a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320546593 0 0) 0x7f9be40a2b70 con 0x7f9be4138570 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient(hunting): my global_id is 144460 2024-04-25T23:59:39.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bd0003530 con 0x7f9be4138570 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605437062 0 0) 0x7f9bd0003530 con 0x7f9be4138570 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 >> v1:172.21.15.106:6793/0 conn(0x7f9be40a3930 legacy=0x7f9be4137a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 >> v1:172.21.15.106:6791/0 conn(0x7f9be4138150 legacy=0x7f9be413cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 monclient: found mon.noname-f 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be40a1810 con 0x7f9be4138570 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bdc001b40 con 0x7f9be4138570 2024-04-25T23:59:39.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: dump: 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.382 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 5 monclient: authenticate success, global_id 144460 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bdc001ea0 con 0x7f9be4138570 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 1 -- 172.21.15.171:0/4259661743 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bdc0020d0 con 0x7f9be4138570 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 4 set_mon_vals no callback set 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9be2ffd640 10 monclient: dump: 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.383 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.384 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.384 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.384 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.384 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.384 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.384 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 10 monclient: shutdown 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- 172.21.15.171:0/4259661743 >> v1:172.21.15.171:6789/0 conn(0x7f9be4138570 legacy=0x7f9be41406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- 172.21.15.171:0/4259661743 shutdown_connections 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- 172.21.15.171:0/4259661743 >> 172.21.15.171:0/4259661743 conn(0x7f9be40a6d70 msgr2=0x7f9be40a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- 172.21.15.171:0/4259661743 shutdown_connections 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.387+0000 7f9bea3bc640 1 -- 172.21.15.171:0/4259661743 wait complete. 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: build_initial_monmap 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: monmap: 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:39.386 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 1 Processor -- start 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 1 -- start start 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: init 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: _add_conns ranks=[2,6,4,8,3,7,5,0,1] 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient(hunting): picked mon.noname-b con 0x7f9be40a3930 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient(hunting): picked mon.noname-d con 0x7f9be4138150 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:39.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient(hunting): picked mon.noname-c con 0x7f9be4138570 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be41214a0 con 0x7f9be40a3930 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be40a1030 con 0x7f9be4138570 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9be4138d40 con 0x7f9be4138150 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient(hunting): authenticate will time out at 1230.101666s 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be8959640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9be4138570 0x7f9be41d4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:49810/0 (socket says 172.21.15.171:49810) 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be8959640 1 -- 172.21.15.171:0/3209534276 learned_addr learned my addr 172.21.15.171:0/3209534276 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be37fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9be4138150 0x7f9be41d16c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:49562/0 (socket says 172.21.15.171:49562) 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1662365478 0 0) 0x7f9be41214a0 con 0x7f9be40a3930 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): my global_id is 5924 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bc4003530 con 0x7f9be40a3930 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357346552 0 0) 0x7f9be40a1030 con 0x7f9be4138570 2024-04-25T23:59:39.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): my global_id is 144517 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be41214a0 con 0x7f9be4138570 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 524266131 0 0) 0x7f9be4138d40 con 0x7f9be4138150 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): my global_id is 6126 2024-04-25T23:59:39.389 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9be40a1030 con 0x7f9be4138150 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2906725054 0 0) 0x7f9be41214a0 con 0x7f9be4138570 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9be4138d40 con 0x7f9be4138570 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bdc001b00 con 0x7f9be4138570 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.390 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2045821475 0 0) 0x7f9bc4003530 con 0x7f9be40a3930 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9be41214a0 con 0x7f9be40a3930 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 930923274 0 0) 0x7f9be40a1030 con 0x7f9be4138150 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bc4003530 con 0x7f9be4138150 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bd4005360 con 0x7f9be40a3930 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:39.391 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.392 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bcc001a20 con 0x7f9be4138150 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.393 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 805083985 0 0) 0x7f9be4138d40 con 0x7f9be4138570 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 >> v1:172.21.15.106:6792/0 conn(0x7f9be4138150 legacy=0x7f9be41d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 >> v1:172.21.15.106:6790/0 conn(0x7f9be40a3930 legacy=0x7f9be4133ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:39.394 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 monclient: found mon.c 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9be409ecd0 con 0x7f9be4138570 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 5 monclient: authenticate success, global_id 144517 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: _renew_subs 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9be41211c0 con 0x7f9be4138570 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: _renew_subs 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9be409fa50 con 0x7f9be4138570 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bdc001ea0 con 0x7f9be4138570 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:39.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be27fc640 4 set_mon_vals no callback set 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.391+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bdc005390 con 0x7f9be4138570 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9be0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9be0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9be0ff9640 10 monclient: dump: 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.396 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9bea3bc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9bea3bc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9bea3bc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc8005090 con 0x7f9be4138570 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9bdc010130 con 0x7f9be4138570 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(124..124 src has 1..124) ==== 7393+0+0 (unknown 3652982850 0 0) 0x7f9bdc0456d0 con 0x7f9be4138570 2024-04-25T23:59:39.397 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.395+0000 7f9be3fff640 10 monclient: get_auth_request con 0x7f9bc4038140 auth_method 0 2024-04-25T23:59:39.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.407+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9bdc015ac0 con 0x7f9be4138570 2024-04-25T23:59:39.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.407+0000 7f9be0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:39.398 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.407+0000 7f9be0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:39.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.563+0000 7f9bea3bc640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.563+0000 7f9bea3bc640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.563+0000 7f9bea3bc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:39.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.563+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f9bc8005380 con 0x7f9be4138570 2024-04-25T23:59:39.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.567+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v124) ==== 71+0+14 (unknown 3707170821 0 3003798303) 0x7f9bdc01df70 con 0x7f9be4138570 2024-04-25T23:59:39.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.567+0000 7f9be0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.567+0000 7f9be0ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:39.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.659+0000 7f9bea3bc640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.659+0000 7f9bea3bc640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.659+0000 7f9bea3bc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-25T23:59:39.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.659+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f9bc8005ac0 con 0x7f9be4138570 2024-04-25T23:59:39.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9be0ff9640 1 -- 172.21.15.171:0/3209534276 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v124) ==== 71+0+14 (unknown 3707170821 0 3003798303) 0x7f9bdc040af0 con 0x7f9be4138570 2024-04-25T23:59:39.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9be0ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:39.645 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9be0ff9640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 >> v1:172.21.15.171:6812/722422047 conn(0x7f9bc4038140 legacy=0x7f9bc403a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 10 monclient: shutdown 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 >> v1:172.21.15.106:6791/0 conn(0x7f9be4138570 legacy=0x7f9be41d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 shutdown_connections 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 >> 172.21.15.171:0/3209534276 conn(0x7f9be40a6d70 msgr2=0x7f9be4136b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 shutdown_connections 2024-04-25T23:59:39.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.663+0000 7f9bea3bc640 1 -- 172.21.15.171:0/3209534276 wait complete. 2024-04-25T23:59:39.660 INFO:tasks.workunit.client.0.smithi171.stdout:barset 2024-04-25T23:59:39.661 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set dump 2024-04-25T23:59:39.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: get_monmap_and_config 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: build_initial_monmap 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: monmap: 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:39.794600+0000 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:39.794600+0000 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:39.774 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:39.775 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 Processor -- start 2024-04-25T23:59:39.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- start start 2024-04-25T23:59:39.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: init 2024-04-25T23:59:39.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:39.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: _add_conns ranks=[6,2,1,7,0,5,4,3,8] 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): picked mon.noname-d con 0x7f8ca80a3930 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): picked mon.noname-b con 0x7f8ca8138150 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): picked mon.noname-f con 0x7f8ca8138570 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca80a2b70 con 0x7f8ca8138570 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca80a2e50 con 0x7f8ca8138150 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca80a4460 con 0x7f8ca80a3930 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): authenticate will time out at 1230.501271s 2024-04-25T23:59:39.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8caea9a640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8ca8138570 0x7f8ca81406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59996/0 (socket says 172.21.15.171:59996) 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8caea9a640 1 -- 172.21.15.171:0/2264803838 learned_addr learned my addr 172.21.15.171:0/2264803838 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2651627811 0 0) 0x7f8ca80a2b70 con 0x7f8ca8138570 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient(hunting): _negotiate 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient(hunting): my global_id is 144469 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c90003530 con 0x7f8ca8138570 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2895429400 0 0) 0x7f8c90003530 con 0x7f8ca8138570 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 >> v1:172.21.15.106:6792/0 conn(0x7f8ca80a3930 legacy=0x7f8ca8137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 >> v1:172.21.15.106:6790/0 conn(0x7f8ca8138150 legacy=0x7f8ca813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: _finish_hunting 0 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 monclient: found mon.noname-f 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:39.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca80a1810 con 0x7f8ca8138570 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: _finish_auth 0 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: _check_auth_tickets 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c980017c0 con 0x7f8ca8138570 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: dump: 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.785 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 5 monclient: authenticate success, global_id 144469 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c98001ab0 con 0x7f8ca8138570 2024-04-25T23:59:39.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 1 -- 172.21.15.171:0/2264803838 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c98004bf0 con 0x7f8ca8138570 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cad297640 10 monclient: dump: 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.787 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 4 set_mon_vals no callback set 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: shutdown 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- 172.21.15.171:0/2264803838 >> v1:172.21.15.171:6789/0 conn(0x7f8ca8138570 legacy=0x7f8ca81406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- 172.21.15.171:0/2264803838 shutdown_connections 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- 172.21.15.171:0/2264803838 >> 172.21.15.171:0/2264803838 conn(0x7f8ca80a6d70 msgr2=0x7f8ca80a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:39.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- 172.21.15.171:0/2264803838 shutdown_connections 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- 172.21.15.171:0/2264803838 wait complete. 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: build_initial_monmap 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: monmap: 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:39.789 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 Processor -- start 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- start start 2024-04-25T23:59:39.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: init 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient: _add_conns ranks=[4,8,7,2,6,3,1,5,0] 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): picked mon.noname-c con 0x7f8ca80a3930 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): picked mon.noname-e con 0x7f8ca8138150 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): picked mon.noname-i con 0x7f8ca8138570 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca80a1030 con 0x7f8ca80a3930 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca8138d40 con 0x7f8ca8138570 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ca81cd3e0 con 0x7f8ca8138150 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.791+0000 7f8cb04fd640 10 monclient(hunting): authenticate will time out at 1230.503944s 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cada98640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8ca8138150 legacy=0x7f8ca81d1820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8caea9a640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f8ca8138570 0x7f8ca81d4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36586/0 (socket says 172.21.15.171:36586) 2024-04-25T23:59:39.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8caea9a640 1 -- 172.21.15.171:0/974360307 learned_addr learned my addr 172.21.15.171:0/974360307 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57722765 0 0) 0x7f8ca8138d40 con 0x7f8ca8138570 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): my global_id is 144376 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8c94003530 con 0x7f8ca8138570 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2999014168 0 0) 0x7f8c94003530 con 0x7f8ca8138570 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ca8138d40 con 0x7f8ca8138570 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c98001780 con 0x7f8ca8138570 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.792 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1533561531 0 0) 0x7f8ca8138d40 con 0x7f8ca8138570 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 >> v1:172.21.15.106:6793/0 conn(0x7f8ca8138150 legacy=0x7f8ca81d1820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 >> v1:172.21.15.106:6791/0 conn(0x7f8ca80a3930 legacy=0x7f8ca81cccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 monclient: found mon.i 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ca8120b70 con 0x7f8ca8138570 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 5 monclient: authenticate success, global_id 144376 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 10 monclient: _renew_subs 2024-04-25T23:59:39.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ca809ef00 con 0x7f8ca8138570 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 10 monclient: _renew_subs 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ca8120ee0 con 0x7f8ca8138570 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8c98001ab0 con 0x7f8ca8138570 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8c98001ce0 con 0x7f8ca8138570 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8caca96640 4 set_mon_vals no callback set 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 10 monclient: dump: 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:39.795 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:39.796 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8c980100f0 con 0x7f8ca8138570 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c88005090 con 0x7f8ca8138570 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(124..124 src has 1..124) ==== 7393+0+0 (unknown 3652982850 0 0) 0x7f8c98045580 con 0x7f8ca8138570 2024-04-25T23:59:39.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.795+0000 7f8cae299640 10 monclient: get_auth_request con 0x7f8c94037800 auth_method 0 2024-04-25T23:59:39.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.799+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8c98015a10 con 0x7f8ca8138570 2024-04-25T23:59:39.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.799+0000 7f8ca6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:39.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.799+0000 7f8ca6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.967+0000 7f8cb04fd640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.967+0000 7f8cb04fd640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.967+0000 7f8cb04fd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.967+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set dump"} v 0) -- 0x7f8c88005380 con 0x7f8ca8138570 2024-04-25T23:59:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.967+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set dump"}]=0 v124) ==== 73+0+6748 (unknown 2922337620 0 3407865348) 0x7f8c9801de60 con 0x7f8ca8138570 2024-04-25T23:59:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.967+0000 7f8ca6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:39.967+0000 7f8ca6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.067+0000 7f8cb04fd640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.067+0000 7f8cb04fd640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.067+0000 7f8cb04fd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:40.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.067+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set dump"} v 0) -- 0x7f8c88000bd0 con 0x7f8ca8138570 2024-04-25T23:59:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.067+0000 7f8ca6ffd640 1 -- 172.21.15.171:0/974360307 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set dump"}]=0 v124) ==== 73+0+6748 (unknown 2922337620 0 3407865348) 0x7f8c980424c0 con 0x7f8ca8138570 2024-04-25T23:59:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.067+0000 7f8ca6ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set dump"}] 2024-04-25T23:59:40.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.067+0000 7f8ca6ffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:40.053 INFO:tasks.workunit.client.0.smithi171.stdout:{ 2024-04-25T23:59:40.053 INFO:tasks.workunit.client.0.smithi171.stdout: "9": [ 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -1, 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -2, 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.054 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -3, 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.055 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -4, 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -5, 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.056 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -6, 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -7, 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.057 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -8, 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -9, 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.058 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -10, 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.059 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -11, 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -12, 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -13, 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.060 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -14, 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -15, 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:59:40.061 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: "10": [ 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -1, 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.062 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: 0.263671875, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -2, 2024-04-25T23:59:40.063 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -3, 2024-04-25T23:59:40.064 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.065 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -4, 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -5, 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.066 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.067 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -6, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.068 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.069 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -7, 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.070 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -8, 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -9, 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.071 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: ], 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: [ 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0.087890625, 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0, 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: 0 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.072 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -10, 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -11, 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.073 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -12, 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -13, 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.074 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -14, 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: }, 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: { 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: "bucket_id": -15, 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: "weight_set": [ 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.075 INFO:tasks.workunit.client.0.smithi171.stdout: [], 2024-04-25T23:59:40.076 INFO:tasks.workunit.client.0.smithi171.stdout: [] 2024-04-25T23:59:40.076 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.076 INFO:tasks.workunit.client.0.smithi171.stdout: } 2024-04-25T23:59:40.076 INFO:tasks.workunit.client.0.smithi171.stdout: ] 2024-04-25T23:59:40.076 INFO:tasks.workunit.client.0.smithi171.stdout:} 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 >> v1:172.21.15.171:6812/722422047 conn(0x7f8c94037800 legacy=0x7f8c94039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 10 monclient: shutdown 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 >> v1:172.21.15.171:6792/0 conn(0x7f8ca8138570 legacy=0x7f8ca81d4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 shutdown_connections 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 >> 172.21.15.171:0/974360307 conn(0x7f8ca80a6d70 msgr2=0x7f8ca81bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 shutdown_connections 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.071+0000 7f8cb04fd640 1 -- 172.21.15.171:0/974360307 wait complete. 2024-04-25T23:59:40.077 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight fooset osd.0 .9 2024-04-25T23:59:40.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient: get_monmap_and_config 2024-04-25T23:59:40.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient: build_initial_monmap 2024-04-25T23:59:40.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient: monmap: 2024-04-25T23:59:40.188 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:40.188 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:40.188 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:40.209089+0000 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:40.209089+0000 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:40.189 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:40.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 1 Processor -- start 2024-04-25T23:59:40.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 1 -- start start 2024-04-25T23:59:40.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient: init 2024-04-25T23:59:40.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient: _add_conns ranks=[2,7,5,4,6,8,3,1,0] 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient(hunting): picked mon.noname-b con 0x7fca3c135a00 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient(hunting): picked mon.noname-i con 0x7fca3c0a1790 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 10 monclient(hunting): picked mon.noname-h con 0x7fca3c13c130 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c0a1d80 con 0x7fca3c135a00 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.203+0000 7fca4249c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c072f70 con 0x7fca3c13c130 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c072640 con 0x7fca3c0a1790 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 10 monclient(hunting): authenticate will time out at 1230.916018s 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca40a39640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fca3c13c130 0x7fca3c13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45470/0 (socket says 172.21.15.171:45470) 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca40a39640 1 -- 172.21.15.171:0/775898958 learned_addr learned my addr 172.21.15.171:0/775898958 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca33fff640 1 --1- 172.21.15.171:0/775898958 >> v1:172.21.15.171:6792/0 conn(0x7fca3c0a1790 0x7fca3c13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36596/0 (socket says 172.21.15.171:36596) 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373701241 0 0) 0x7fca3c072f70 con 0x7fca3c13c130 2024-04-25T23:59:40.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): my global_id is 5900 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca28003530 con 0x7fca3c13c130 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243713317 0 0) 0x7fca3c072640 con 0x7fca3c0a1790 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): my global_id is 144385 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca3c072f70 con 0x7fca3c0a1790 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040212812 0 0) 0x7fca3c0a1d80 con 0x7fca3c135a00 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:40.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient(hunting): my global_id is 5933 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca3c072640 con 0x7fca3c135a00 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2584060483 0 0) 0x7fca28003530 con 0x7fca3c13c130 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 >> v1:172.21.15.171:6792/0 conn(0x7fca3c0a1790 legacy=0x7fca3c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 >> v1:172.21.15.106:6790/0 conn(0x7fca3c135a00 legacy=0x7fca3c135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 monclient: found mon.noname-h 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c072920 con 0x7fca3c13c130 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:40.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fca34001b40 con 0x7fca3c13c130 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 5 monclient: authenticate success, global_id 5900 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: dump: 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:40.196 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca34001da0 con 0x7fca3c13c130 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 1 -- 172.21.15.171:0/775898958 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fca34004f70 con 0x7fca3c13c130 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:40.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca3b7fe640 10 monclient: dump: 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:40.198 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 4 set_mon_vals no callback set 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 10 monclient: shutdown 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 -- 172.21.15.171:0/775898958 >> v1:172.21.15.171:6791/0 conn(0x7fca3c13c130 legacy=0x7fca3c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 -- 172.21.15.171:0/775898958 shutdown_connections 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 -- 172.21.15.171:0/775898958 >> 172.21.15.171:0/775898958 conn(0x7fca3c0a2690 msgr2=0x7fca3c0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 -- 172.21.15.171:0/775898958 shutdown_connections 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 -- 172.21.15.171:0/775898958 wait complete. 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 10 monclient: build_initial_monmap 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 10 monclient: monmap: 2024-04-25T23:59:40.199 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:40.200 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:40.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 Processor -- start 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 1 -- start start 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.207+0000 7fca4249c640 10 monclient: init 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _add_conns ranks=[7,4,0,6,1,2,3,8,5] 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient(hunting): picked mon.noname-i con 0x7fca3c0a1790 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient(hunting): picked mon.noname-c con 0x7fca3c135a00 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient(hunting): picked mon.noname-a con 0x7fca3c13c130 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c136ba0 con 0x7fca3c13c130 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c09fc40 con 0x7fca3c135a00 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca3c09f6f0 con 0x7fca3c0a1790 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:40.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient(hunting): authenticate will time out at 1230.920337s 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca3bfff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fca3c0a1790 0x7fca3c13a0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36610/0 (socket says 172.21.15.171:36610) 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca3bfff640 1 -- 172.21.15.171:0/2898958314 learned_addr learned my addr 172.21.15.171:0/2898958314 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4028430841 0 0) 0x7fca3c09f6f0 con 0x7fca3c0a1790 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): my global_id is 144394 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca1c003530 con 0x7fca3c0a1790 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1934933477 0 0) 0x7fca1c003530 con 0x7fca3c0a1790 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca3c09f6f0 con 0x7fca3c0a1790 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fca2c001b40 con 0x7fca3c0a1790 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:40.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): dump: 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:40.206 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1221697408 0 0) 0x7fca3c09f6f0 con 0x7fca3c0a1790 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 >> v1:172.21.15.106:6791/0 conn(0x7fca3c135a00 legacy=0x7fca3c1cd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 >> v1:172.21.15.106:6789/0 conn(0x7fca3c13c130 legacy=0x7fca3c1d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 monclient: found mon.i 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c1368c0 con 0x7fca3c0a1790 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:40.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 5 monclient: authenticate success, global_id 144394 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _renew_subs 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c13a800 con 0x7fca3c0a1790 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _renew_subs 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fca3c09c2c0 con 0x7fca3c0a1790 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca2c0038d0 con 0x7fca3c0a1790 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fca2c003e40 con 0x7fca3c0a1790 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 10 monclient: dump: 2024-04-25T23:59:40.208 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:40.209 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca3affd640 4 set_mon_vals no callback set 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fca2c003fe0 con 0x7fca3c0a1790 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca20005090 con 0x7fca3c0a1790 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(124..124 src has 1..124) ==== 7393+0+0 (unknown 3652982850 0 0) 0x7fca2c045500 con 0x7fca3c0a1790 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.211+0000 7fca33fff640 10 monclient: get_auth_request con 0x7fca1c037830 auth_method 0 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.215+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fca2c015890 con 0x7fca3c0a1790 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.215+0000 7fca397fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:40.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.215+0000 7fca397fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:40.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.371+0000 7fca4249c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:40.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.371+0000 7fca4249c640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:40.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.371+0000 7fca4249c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:40.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.371+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]} v 0) -- 0x7fca20005380 con 0x7fca3c0a1790 2024-04-25T23:59:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.779+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}]=0 v125) ==== 129+0+0 (unknown 903083362 0 0) 0x7fca2c015190 con 0x7fca3c0a1790 2024-04-25T23:59:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.779+0000 7fca397fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:40.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.779+0000 7fca397fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:40.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.895+0000 7fca4249c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:40.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.895+0000 7fca4249c640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:40.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.895+0000 7fca4249c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:40.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:40.895+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]} v 0) -- 0x7fca20001150 con 0x7fca3c0a1790 2024-04-25T23:59:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.807+0000 7fca397fa640 1 -- 172.21.15.171:0/2898958314 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}]=0 v126) ==== 129+0+0 (unknown 4042788291 0 0) 0x7fca2c0194e0 con 0x7fca3c0a1790 2024-04-25T23:59:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.807+0000 7fca397fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.807+0000 7fca397fa640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 >> v1:172.21.15.171:6812/722422047 conn(0x7fca1c037830 legacy=0x7fca1c039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 10 monclient: shutdown 2024-04-25T23:59:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 >> v1:172.21.15.171:6792/0 conn(0x7fca3c0a1790 legacy=0x7fca3c13a0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 shutdown_connections 2024-04-25T23:59:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 >> 172.21.15.171:0/2898958314 conn(0x7fca3c0a2690 msgr2=0x7fca3c12d9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 shutdown_connections 2024-04-25T23:59:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.811+0000 7fca4249c640 1 -- 172.21.15.171:0/2898958314 wait complete. 2024-04-25T23:59:41.817 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush weight-set reweight fooset osd.0 .9 .9 2024-04-25T23:59:41.817 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:59:41.817 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight fooset osd.0 .9 .9 2024-04-25T23:59:41.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: get_monmap_and_config 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: build_initial_monmap 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: monmap: 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:41.958646+0000 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:41.958646+0000 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:41.938 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:41.939 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:41.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 Processor -- start 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- start start 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: init 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: _add_conns ranks=[4,7,1,8,2,0,3,6,5] 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient(hunting): picked mon.noname-c con 0x7f21741347b0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient(hunting): picked mon.noname-i con 0x7f2174134b90 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient(hunting): picked mon.noname-f con 0x7f217413e200 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21740a3320 con 0x7f217413e200 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217409fe40 con 0x7f21741347b0 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21740a0120 con 0x7f2174134b90 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient(hunting): authenticate will time out at 1232.665752s 2024-04-25T23:59:41.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2178cc4640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f2174134b90 0x7f217413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:58436/0 (socket says 172.21.15.171:58436) 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2178cc4640 1 -- 172.21.15.171:0/3329932700 learned_addr learned my addr 172.21.15.171:0/3329932700 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3672144292 0 0) 0x7f21740a0120 con 0x7f2174134b90 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): my global_id is 144403 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2160003530 con 0x7f2174134b90 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 946206922 0 0) 0x7f21740a3320 con 0x7f217413e200 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:41.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient(hunting): my global_id is 144478 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21740a0120 con 0x7f217413e200 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3398513453 0 0) 0x7f2160003530 con 0x7f2174134b90 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 >> v1:172.21.15.106:6791/0 conn(0x7f21741347b0 legacy=0x7f2174072980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 >> v1:172.21.15.171:6789/0 conn(0x7f217413e200 legacy=0x7f21741405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 monclient: found mon.noname-i 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21740a0400 con 0x7f2174134b90 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:41.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2170001b40 con 0x7f2174134b90 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 5 monclient: authenticate success, global_id 144403 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: dump: 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:41.950 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2170001db0 con 0x7f2174134b90 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 4 set_mon_vals no callback set 2024-04-25T23:59:41.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 1 -- 172.21.15.171:0/3329932700 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2170004f70 con 0x7f2174134b90 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f2167fff640 10 monclient: dump: 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:41.952 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: shutdown 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- 172.21.15.171:0/3329932700 >> v1:172.21.15.171:6792/0 conn(0x7f2174134b90 legacy=0x7f217413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- 172.21.15.171:0/3329932700 shutdown_connections 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- 172.21.15.171:0/3329932700 >> 172.21.15.171:0/3329932700 conn(0x7f21740a7620 msgr2=0x7f21740a36a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- 172.21.15.171:0/3329932700 shutdown_connections 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 1 -- 172.21.15.171:0/3329932700 wait complete. 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.955+0000 7f217b729640 10 monclient: build_initial_monmap 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: monmap: 2024-04-25T23:59:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 Processor -- start 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 -- start start 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: init 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _add_conns ranks=[5,4,8,2,7,3,6,1,0] 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient(hunting): picked mon.noname-h con 0x7f21741347b0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient(hunting): picked mon.noname-c con 0x7f2174134b90 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient(hunting): picked mon.noname-e con 0x7f217413e200 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f217412d410 con 0x7f2174134b90 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2174134580 con 0x7f21741347b0 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2174135ff0 con 0x7f217413e200 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:41.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient(hunting): authenticate will time out at 1232.668895s 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f21794c5640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f21741347b0 0x7f217413c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45406/0 (socket says 172.21.15.171:45406) 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f21794c5640 1 -- 172.21.15.171:0/343739721 learned_addr learned my addr 172.21.15.171:0/343739721 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2179cc6640 1 -- 172.21.15.171:0/343739721 >> v1:172.21.15.106:6793/0 conn(0x7f217413e200 legacy=0x7f21741d4ed0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587973822 0 0) 0x7f217409fe40 con 0x7f21741347b0 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): my global_id is 5909 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2158003530 con 0x7f21741347b0 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 401977501 0 0) 0x7f2158003530 con 0x7f21741347b0 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f217409fe40 con 0x7f21741347b0 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2168001ae0 con 0x7f21741347b0 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:41.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:41.957 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928112597 0 0) 0x7f217412d410 con 0x7f2174134b90 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient(hunting): my global_id is 144553 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2158003530 con 0x7f2174134b90 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 104279111 0 0) 0x7f217409fe40 con 0x7f21741347b0 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 >> v1:172.21.15.106:6793/0 conn(0x7f217413e200 legacy=0x7f21741d4ed0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:41.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 >> v1:172.21.15.106:6791/0 conn(0x7f2174134b90 legacy=0x7f21741d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 monclient: found mon.h 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f217409f150 con 0x7f21741347b0 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 5 monclient: authenticate success, global_id 5909 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _renew_subs 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2174135d10 con 0x7f21741347b0 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _renew_subs 2024-04-25T23:59:41.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f217413cc80 con 0x7f21741347b0 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2168003950 con 0x7f21741347b0 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2168003ec0 con 0x7f21741347b0 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f21677fe640 4 set_mon_vals no callback set 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 10 monclient: dump: 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.960 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:41.961 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:41.961 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:41.961 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:41.961 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:41.961 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:41.961 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:41.961 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f217b729640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2154005090 con 0x7f21741347b0 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2168004060 con 0x7f21741347b0 2024-04-25T23:59:41.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(126..126 src has 1..126) ==== 7393+0+0 (unknown 2966940024 0 0) 0x7f2168045450 con 0x7f21741347b0 2024-04-25T23:59:41.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.959+0000 7f2178cc4640 10 monclient: get_auth_request con 0x7f2158037850 auth_method 0 2024-04-25T23:59:41.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.963+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2174134580 con 0x7f21741347b0 2024-04-25T23:59:41.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.963+0000 7f2165ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:41.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:41.963+0000 7f2165ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:42.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.131+0000 7f217b729640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9, 0.9]}] 2024-04-25T23:59:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.135+0000 7f217b729640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9, 0.9]}] 2024-04-25T23:59:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.135+0000 7f217b729640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:42.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.135+0000 7f217b729640 1 -- 172.21.15.171:0/343739721 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9, 0.9]} v 0) -- 0x7f2154005380 con 0x7f21741347b0 2024-04-25T23:59:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.135+0000 7f2165ffb640 1 -- 172.21.15.171:0/343739721 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9, 0.9]}]=-22 must specify exact 1 weight values v126) ==== 168+0+0 (unknown 1213370565 0 0) 0x7f2168015910 con 0x7f21741347b0 2024-04-25T23:59:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.135+0000 7f2165ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "fooset", "item": "osd.0", "weight": [0.9, 0.9]}] 2024-04-25T23:59:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.135+0000 7f2165ffb640 10 monclient: _finish_command 2 = mon:22 must specify exact 1 weight values 2024-04-25T23:59:42.120 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: must specify exact 1 weight values 2024-04-25T23:59:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:59:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect_false ceph osd crush weight-set reweight barset osd.0 .9 2024-04-25T23:59:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -x 2024-04-25T23:59:42.126 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight barset osd.0 .9 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient: get_monmap_and_config 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient: build_initial_monmap 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient: monmap: 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:42.267911+0000 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:42.267911+0000 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:42.247 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:42.248 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 1 Processor -- start 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 1 -- start start 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient: init 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient: _add_conns ranks=[4,3,8,5,6,0,2,7,1] 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient(hunting): picked mon.noname-c con 0x7fd580135a00 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient(hunting): picked mon.noname-g con 0x7fd5800a1790 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient(hunting): picked mon.noname-e con 0x7fd58013c130 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5800a1d80 con 0x7fd5800a1790 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd580072f70 con 0x7fd580135a00 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd580072640 con 0x7fd58013c130 2024-04-25T23:59:42.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient(hunting): authenticate will time out at 1232.974769s 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd584d55640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd5800a1790 0x7fd58013aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:47636/0 (socket says 172.21.15.171:47636) 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd584d55640 1 -- 172.21.15.171:0/435728753 learned_addr learned my addr 172.21.15.171:0/435728753 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd585d57640 1 -- 172.21.15.171:0/435728753 >> v1:172.21.15.106:6793/0 conn(0x7fd58013c130 legacy=0x7fd58013e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 748700434 0 0) 0x7fd5800a1d80 con 0x7fd5800a1790 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient(hunting): my global_id is 6249 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd56c003530 con 0x7fd5800a1790 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2193664254 0 0) 0x7fd56c003530 con 0x7fd5800a1790 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 >> v1:172.21.15.106:6793/0 conn(0x7fd58013c130 legacy=0x7fd58013e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 >> v1:172.21.15.106:6791/0 conn(0x7fd580135a00 legacy=0x7fd580135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 monclient: found mon.noname-g 2024-04-25T23:59:42.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd580072920 con 0x7fd5800a1790 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5700017c0 con 0x7fd5800a1790 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 5 monclient: authenticate success, global_id 6249 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: dump: 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.257 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:42.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd570001a30 con 0x7fd5800a1790 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd5877ba640 4 set_mon_vals no callback set 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 1 -- 172.21.15.171:0/435728753 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd570004bf0 con 0x7fd5800a1790 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.263+0000 7fd577fff640 10 monclient: dump: 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.259 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: shutdown 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/435728753 >> v1:172.21.15.171:6790/0 conn(0x7fd5800a1790 legacy=0x7fd58013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/435728753 shutdown_connections 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/435728753 >> 172.21.15.171:0/435728753 conn(0x7fd5800a2690 msgr2=0x7fd5800a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/435728753 shutdown_connections 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/435728753 wait complete. 2024-04-25T23:59:42.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: build_initial_monmap 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: monmap: 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:42.261 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:42.262 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:42.262 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:42.262 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 Processor -- start 2024-04-25T23:59:42.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- start start 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: init 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _add_conns ranks=[8,7,2,1,3,5,0,6,4] 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient(hunting): picked mon.noname-e con 0x7fd5800a1790 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient(hunting): picked mon.noname-i con 0x7fd580135a00 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient(hunting): picked mon.noname-b con 0x7fd58013c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd580136dd0 con 0x7fd58013c130 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58009fc40 con 0x7fd580135a00 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd58009f6f0 con 0x7fd5800a1790 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient(hunting): authenticate will time out at 1232.978058s 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd585556640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fd5800a1790 legacy=0x7fd58012c570 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd584d55640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fd580135a00 0x7fd5801cf700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:58452/0 (socket says 172.21.15.171:58452) 2024-04-25T23:59:42.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd584d55640 1 -- 172.21.15.171:0/2243260837 learned_addr learned my addr 172.21.15.171:0/2243260837 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107681663 0 0) 0x7fd58009fc40 con 0x7fd580135a00 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): my global_id is 144412 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd564003530 con 0x7fd580135a00 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3882455978 0 0) 0x7fd564003530 con 0x7fd580135a00 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd58009fc40 con 0x7fd580135a00 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd570004b30 con 0x7fd580135a00 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.264 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 551404138 0 0) 0x7fd580136dd0 con 0x7fd58013c130 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:42.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient(hunting): my global_id is 5942 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd564003530 con 0x7fd58013c130 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1952299982 0 0) 0x7fd58009fc40 con 0x7fd580135a00 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 >> v1:172.21.15.106:6793/0 conn(0x7fd5800a1790 legacy=0x7fd58012c570 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 >> v1:172.21.15.106:6790/0 conn(0x7fd58013c130 legacy=0x7fd5801d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 monclient: found mon.i 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd580136af0 con 0x7fd580135a00 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:42.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 5 monclient: authenticate success, global_id 144412 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _renew_subs 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd580133f60 con 0x7fd580135a00 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _renew_subs 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fd580133cb0 con 0x7fd580135a00 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd570001a30 con 0x7fd580135a00 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd570005240 con 0x7fd580135a00 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5777fe640 4 set_mon_vals no callback set 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd575ffb640 10 monclient: dump: 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.267 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.267+0000 7fd5877ba640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd560005090 con 0x7fd580135a00 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.271+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd57000ffe0 con 0x7fd580135a00 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.271+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(126..126 src has 1..126) ==== 7393+0+0 (unknown 2966940024 0 0) 0x7fd5700455b0 con 0x7fd580135a00 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.271+0000 7fd585556640 10 monclient: get_auth_request con 0x7fd564037800 auth_method 0 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.275+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd570015ae0 con 0x7fd580135a00 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.275+0000 7fd575ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:42.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.275+0000 7fd575ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:42.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.443+0000 7fd5877ba640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:42.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.443+0000 7fd5877ba640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:42.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.443+0000 7fd5877ba640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:42.428 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.443+0000 7fd5877ba640 1 -- 172.21.15.171:0/2243260837 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9]} v 0) -- 0x7fd560005380 con 0x7fd580135a00 2024-04-25T23:59:42.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.447+0000 7fd575ffb640 1 -- 172.21.15.171:0/2243260837 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9]}]=-22 must specify exact 3 weight values v126) ==== 163+0+0 (unknown 2709714329 0 0) 0x7fd5700153e0 con 0x7fd580135a00 2024-04-25T23:59:42.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.447+0000 7fd575ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9]}] 2024-04-25T23:59:42.429 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.447+0000 7fd575ffb640 10 monclient: _finish_command 2 = mon:22 must specify exact 3 weight values 2024-04-25T23:59:42.430 INFO:tasks.workunit.client.0.smithi171.stderr:Error EINVAL: must specify exact 3 weight values 2024-04-25T23:59:42.434 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-25T23:59:42.434 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight barset osd.0 .9 .9 .9 2024-04-25T23:59:42.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient: get_monmap_and_config 2024-04-25T23:59:42.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient: build_initial_monmap 2024-04-25T23:59:42.554 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient: monmap: 2024-04-25T23:59:42.554 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:42.554 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:42.575345+0000 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:42.575345+0000 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:42.555 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 1 Processor -- start 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 1 -- start start 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient: init 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient: _add_conns ranks=[2,4,1,7,3,0,8,5,6] 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient(hunting): picked mon.noname-b con 0x7f20b8132790 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient(hunting): picked mon.noname-c con 0x7f20b80717a0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient(hunting): picked mon.noname-f con 0x7f20b813c000 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b806ea40 con 0x7f20b813c000 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b8072340 con 0x7f20b8132790 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b8072620 con 0x7f20b80717a0 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20be08c640 10 monclient(hunting): authenticate will time out at 1233.283103s 2024-04-25T23:59:42.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b7fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f20b813c000 0x7f20b813e3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59666/0 (socket says 172.21.15.171:59666) 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b7fff640 1 -- 172.21.15.171:0/761993139 learned_addr learned my addr 172.21.15.171:0/761993139 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088743335 0 0) 0x7f20b806ea40 con 0x7f20b813c000 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b6ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b6ffd640 10 monclient(hunting): my global_id is 144487 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.571+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20a4003530 con 0x7f20b813c000 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1019846671 0 0) 0x7f20a4003530 con 0x7f20b813c000 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 >> v1:172.21.15.106:6791/0 conn(0x7f20b80717a0 legacy=0x7f20b813a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 >> v1:172.21.15.106:6790/0 conn(0x7f20b8132790 legacy=0x7f20b8132b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 monclient: found mon.noname-f 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:42.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b8071c70 con 0x7f20b813c000 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b0001b40 con 0x7f20b813c000 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 5 monclient: authenticate success, global_id 144487 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: dump: 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.561 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20b0001ea0 con 0x7f20b813c000 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:42.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 1 -- 172.21.15.171:0/761993139 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b0004f70 con 0x7f20b813c000 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 4 set_mon_vals no callback set 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b6ffd640 10 monclient: dump: 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.563 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: shutdown 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- 172.21.15.171:0/761993139 >> v1:172.21.15.171:6789/0 conn(0x7f20b813c000 legacy=0x7f20b813e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- 172.21.15.171:0/761993139 shutdown_connections 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- 172.21.15.171:0/761993139 >> 172.21.15.171:0/761993139 conn(0x7f20b80a6180 msgr2=0x7f20b80a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- 172.21.15.171:0/761993139 shutdown_connections 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- 172.21.15.171:0/761993139 wait complete. 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: build_initial_monmap 2024-04-25T23:59:42.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: monmap: 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:42.565 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 Processor -- start 2024-04-25T23:59:42.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- start start 2024-04-25T23:59:42.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: init 2024-04-25T23:59:42.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:42.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: _add_conns ranks=[5,0,1,3,7,6,8,4,2] 2024-04-25T23:59:42.569 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient(hunting): picked mon.noname-h con 0x7f20b80717a0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient(hunting): picked mon.noname-a con 0x7f20b8132790 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient(hunting): picked mon.noname-f con 0x7f20b813c000 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b809c480 con 0x7f20b8132790 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b809f5c0 con 0x7f20b813c000 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20b8136400 con 0x7f20b80717a0 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient(hunting): authenticate will time out at 1233.286665s 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b77fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f20b80717a0 0x7f20b809e230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45418/0 (socket says 172.21.15.171:45418) 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b77fe640 1 -- 172.21.15.171:0/3181777389 learned_addr learned my addr 172.21.15.171:0/3181777389 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:42.570 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815649263 0 0) 0x7f20b809f5c0 con 0x7f20b813c000 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): my global_id is 144496 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2098003530 con 0x7f20b813c000 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745588992 0 0) 0x7f20b8136400 con 0x7f20b80717a0 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): my global_id is 5918 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20b809f5c0 con 0x7f20b80717a0 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1437232867 0 0) 0x7f2098003530 con 0x7f20b813c000 2024-04-25T23:59:42.571 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20b8136400 con 0x7f20b813c000 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b00020b0 con 0x7f20b813c000 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.572 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3693245752 0 0) 0x7f20b8072620 con 0x7f20b8132790 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): my global_id is 6156 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2098003530 con 0x7f20b8132790 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3824010792 0 0) 0x7f20b809f5c0 con 0x7f20b80717a0 2024-04-25T23:59:42.573 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20b8072620 con 0x7f20b80717a0 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20a8001ac0 con 0x7f20b80717a0 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.574 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 123341925 0 0) 0x7f20b8136400 con 0x7f20b813c000 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 >> v1:172.21.15.171:6791/0 conn(0x7f20b80717a0 legacy=0x7f20b809e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 >> v1:172.21.15.106:6789/0 conn(0x7f20b8132790 legacy=0x7f20b81d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 monclient: found mon.f 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:42.575 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20b809cd20 con 0x7f20b813c000 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 5 monclient: authenticate success, global_id 144496 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: _renew_subs 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f20b81ccc90 con 0x7f20b813c000 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: _renew_subs 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f20b809e940 con 0x7f20b813c000 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20b0001ea0 con 0x7f20b813c000 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b00013d0 con 0x7f20b813c000 2024-04-25T23:59:42.576 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b67fc640 4 set_mon_vals no callback set 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.575+0000 7f20b4ff9640 10 monclient: dump: 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:42.577 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.579+0000 7f20be08c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.579+0000 7f20be08c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.579+0000 7f20be08c640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.579+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f209c005090 con 0x7f20b813c000 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.579+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f20b00100a0 con 0x7f20b813c000 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.579+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(126..126 src has 1..126) ==== 7393+0+0 (unknown 2966940024 0 0) 0x7f20b0045550 con 0x7f20b813c000 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.579+0000 7f20b77fe640 10 monclient: get_auth_request con 0x7f2098037ff0 auth_method 0 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.583+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f20b00159a0 con 0x7f20b813c000 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.583+0000 7f20b4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:42.578 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.583+0000 7f20b4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:42.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.743+0000 7f20be08c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}] 2024-04-25T23:59:42.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.743+0000 7f20be08c640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}] 2024-04-25T23:59:42.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.743+0000 7f20be08c640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:42.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:42.743+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]} v 0) -- 0x7f209c005380 con 0x7f20b813c000 2024-04-25T23:59:43.514 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:43.527+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}]=0 v127) ==== 139+0+0 (unknown 4202094069 0 0) 0x7f20b00152a0 con 0x7f20b813c000 2024-04-25T23:59:43.514 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:43.527+0000 7f20b4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}] 2024-04-25T23:59:43.514 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:43.527+0000 7f20b4ff9640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:43.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:43.631+0000 7f20be08c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}] 2024-04-25T23:59:43.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:43.631+0000 7f20be08c640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}] 2024-04-25T23:59:43.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:43.631+0000 7f20be08c640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:43.617 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:43.631+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]} v 0) -- 0x7f209c0010a0 con 0x7f20b813c000 2024-04-25T23:59:44.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.539+0000 7f20b4ff9640 1 -- 172.21.15.171:0/3181777389 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}]=0 v128) ==== 139+0+0 (unknown 2653420188 0 0) 0x7f20b001ddf0 con 0x7f20b813c000 2024-04-25T23:59:44.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.539+0000 7f20b4ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight", "pool": "barset", "item": "osd.0", "weight": [0.9, 0.9, 0.9]}] 2024-04-25T23:59:44.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.539+0000 7f20b4ff9640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:44.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 >> v1:172.21.15.171:6812/722422047 conn(0x7f2098037ff0 legacy=0x7f209803a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 10 monclient: shutdown 2024-04-25T23:59:44.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:44.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 >> v1:172.21.15.171:6789/0 conn(0x7f20b813c000 legacy=0x7f20b81d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 shutdown_connections 2024-04-25T23:59:44.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 >> 172.21.15.171:0/3181777389 conn(0x7f20b80a6180 msgr2=0x7f20b80a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:44.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 shutdown_connections 2024-04-25T23:59:44.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.543+0000 7f20be08c640 1 -- 172.21.15.171:0/3181777389 wait complete. 2024-04-25T23:59:44.550 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:44.550 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c fooset 2024-04-25T23:59:44.550 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 1 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient: get_monmap_and_config 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient: build_initial_monmap 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient: monmap: 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:44.688728+0000 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:44.688728+0000 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:44.668 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:44.669 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 1 Processor -- start 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 1 -- start start 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient: init 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient: _add_conns ranks=[5,0,4,7,3,1,2,8,6] 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient(hunting): picked mon.noname-h con 0x7f00b8135bb0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient(hunting): picked mon.noname-a con 0x7f00b81356f0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:44.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient(hunting): picked mon.noname-c con 0x7f00b813c130 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b80a1da0 con 0x7f00b81356f0 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b80a1fe0 con 0x7f00b813c130 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b8072720 con 0x7f00b8135bb0 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bf6c5640 10 monclient(hunting): authenticate will time out at 1235.395783s 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bd461640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f00b8135bb0 0x7f00b8135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45426/0 (socket says 172.21.15.171:45426) 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.683+0000 7f00bd461640 1 -- 172.21.15.171:0/1002728830 learned_addr learned my addr 172.21.15.171:0/1002728830 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889051613 0 0) 0x7f00b8072720 con 0x7f00b8135bb0 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:44.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient(hunting): my global_id is 5927 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00a4003530 con 0x7f00b8135bb0 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3771163789 0 0) 0x7f00a4003530 con 0x7f00b8135bb0 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 >> v1:172.21.15.106:6791/0 conn(0x7f00b813c130 legacy=0x7f00b813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 >> v1:172.21.15.106:6789/0 conn(0x7f00b81356f0 legacy=0x7f00b813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 monclient: found mon.noname-h 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b80a17f0 con 0x7f00b8135bb0 2024-04-25T23:59:44.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: _finish_auth 0 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00b40017c0 con 0x7f00b8135bb0 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 5 monclient: authenticate success, global_id 5927 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: dump: 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:44.680 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:44.681 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00b4001ab0 con 0x7f00b8135bb0 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 1 -- 172.21.15.171:0/1002728830 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00b4004bf0 con 0x7f00b8135bb0 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 4 set_mon_vals no callback set 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:44.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00affff640 10 monclient: dump: 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:44.683 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: shutdown 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- 172.21.15.171:0/1002728830 >> v1:172.21.15.171:6791/0 conn(0x7f00b8135bb0 legacy=0x7f00b8135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- 172.21.15.171:0/1002728830 shutdown_connections 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- 172.21.15.171:0/1002728830 >> 172.21.15.171:0/1002728830 conn(0x7f00b80a2620 msgr2=0x7f00b80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- 172.21.15.171:0/1002728830 shutdown_connections 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- 172.21.15.171:0/1002728830 wait complete. 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: build_initial_monmap 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: monmap: 2024-04-25T23:59:44.684 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:44.685 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 Processor -- start 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- start start 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: init 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: _add_conns ranks=[8,7,2,4,6,3,1,0,5] 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient(hunting): picked mon.noname-e con 0x7f00b81356f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient(hunting): picked mon.noname-i con 0x7f00b8135bb0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:44.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient(hunting): picked mon.noname-b con 0x7f00b813c130 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b80a1330 con 0x7f00b813c130 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b812e620 con 0x7f00b8135bb0 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00b809d060 con 0x7f00b81356f0 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient(hunting): authenticate will time out at 1235.398731s 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bd461640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f00b81356f0 legacy=0x7f00b809c240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bcc60640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f00b8135bb0 0x7f00b809c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:58454/0 (socket says 172.21.15.171:58454) 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bcc60640 1 -- 172.21.15.171:0/713649345 learned_addr learned my addr 172.21.15.171:0/713649345 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682765534 0 0) 0x7f00b812e620 con 0x7f00b8135bb0 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:44.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): my global_id is 144421 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003530 con 0x7f00b8135bb0 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2948371027 0 0) 0x7f009c003530 con 0x7f00b8135bb0 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00b812e620 con 0x7f00b8135bb0 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00a8001a50 con 0x7f00b8135bb0 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): dump: 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.688 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:44.689 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420494727 0 0) 0x7f00b80a1330 con 0x7f00b813c130 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient(hunting): my global_id is 5960 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f009c003530 con 0x7f00b813c130 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3575057952 0 0) 0x7f00b812e620 con 0x7f00b8135bb0 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 >> v1:172.21.15.106:6793/0 conn(0x7f00b81356f0 legacy=0x7f00b809c240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 >> v1:172.21.15.106:6790/0 conn(0x7f00b813c130 legacy=0x7f00b81d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 monclient: found mon.i 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00b809dd50 con 0x7f00b8135bb0 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 5 monclient: authenticate success, global_id 144421 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: _renew_subs 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:44.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f00b8071ef0 con 0x7f00b8135bb0 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: _renew_subs 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f00b812e340 con 0x7f00b8135bb0 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00a8003950 con 0x7f00b8135bb0 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00a8003ec0 con 0x7f00b8135bb0 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00af7fe640 4 set_mon_vals no callback set 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.687+0000 7f00adffb640 10 monclient: dump: 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:44.692 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:44.693 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.691+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f00a80040e0 con 0x7f00b8135bb0 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.691+0000 7f00bf6c5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.691+0000 7f00bf6c5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.691+0000 7f00bf6c5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.691+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0098005090 con 0x7f00b8135bb0 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.691+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(128..128 src has 1..128) ==== 7393+0+0 (unknown 1414871405 0 0) 0x7f00a8045570 con 0x7f00b8135bb0 2024-04-25T23:59:44.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.691+0000 7f00bd461640 10 monclient: get_auth_request con 0x7f009c037800 auth_method 0 2024-04-25T23:59:44.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.695+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f00a8015960 con 0x7f00b8135bb0 2024-04-25T23:59:44.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.695+0000 7f00adffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:44.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.695+0000 7f00adffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:44.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.863+0000 7f00bf6c5640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:44.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.863+0000 7f00bf6c5640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:44.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.863+0000 7f00bf6c5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:44.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.863+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f0098005380 con 0x7f00b8135bb0 2024-04-25T23:59:44.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.863+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v128) ==== 71+0+14 (unknown 43352416 0 3003798303) 0x7f00a8015260 con 0x7f00b8135bb0 2024-04-25T23:59:44.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.863+0000 7f00adffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:44.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.863+0000 7f00adffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:44.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.967+0000 7f00bf6c5640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:44.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.967+0000 7f00bf6c5640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.967+0000 7f00bf6c5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.967+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f0098000bd0 con 0x7f00b8135bb0 2024-04-25T23:59:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.967+0000 7f00adffb640 1 -- 172.21.15.171:0/713649345 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v128) ==== 71+0+14 (unknown 43352416 0 3003798303) 0x7f00a801de10 con 0x7f00b8135bb0 2024-04-25T23:59:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.967+0000 7f00adffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:44.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.967+0000 7f00adffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:44.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 >> v1:172.21.15.171:6812/722422047 conn(0x7f009c037800 legacy=0x7f009c039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 10 monclient: shutdown 2024-04-25T23:59:44.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 >> v1:172.21.15.171:6792/0 conn(0x7f00b8135bb0 legacy=0x7f00b809c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 shutdown_connections 2024-04-25T23:59:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 >> 172.21.15.171:0/713649345 conn(0x7f00b80a2620 msgr2=0x7f00b812c510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 shutdown_connections 2024-04-25T23:59:44.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:44.971+0000 7f00bf6c5640 1 -- 172.21.15.171:0/713649345 wait complete. 2024-04-25T23:59:44.970 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set rm fooset 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient: get_monmap_and_config 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient: build_initial_monmap 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient: monmap: 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:45.109055+0000 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:45.109055+0000 2024-04-25T23:59:45.088 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:45.089 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 1 Processor -- start 2024-04-25T23:59:45.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 1 -- start start 2024-04-25T23:59:45.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient: init 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient: _add_conns ranks=[0,3,5,7,4,1,2,6,8] 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient(hunting): picked mon.noname-a con 0x7f87e006b1c0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient(hunting): picked mon.noname-g con 0x7f87e006bcb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient(hunting): picked mon.noname-h con 0x7f87e009efd0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e009fee0 con 0x7f87e006b1c0 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e00a28b0 con 0x7f87e006bcb0 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e009f830 con 0x7f87e009efd0 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.103+0000 7f87e4afa640 10 monclient(hunting): authenticate will time out at 1235.815964s 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87ddd9b640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f87e006bcb0 0x7f87e013cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:47642/0 (socket says 172.21.15.171:47642) 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87ded9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f87e009efd0 0x7f87e0140470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45430/0 (socket says 172.21.15.171:45430) 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87ddd9b640 1 -- 172.21.15.171:0/2187892614 learned_addr learned my addr 172.21.15.171:0/2187892614 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3903836039 0 0) 0x7f87e009f830 con 0x7f87e009efd0 2024-04-25T23:59:45.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): my global_id is 5936 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87c8003530 con 0x7f87e009efd0 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2100298466 0 0) 0x7f87e00a28b0 con 0x7f87e006bcb0 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient(hunting): my global_id is 6258 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e009f830 con 0x7f87e006bcb0 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2080118839 0 0) 0x7f87c8003530 con 0x7f87e009efd0 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 >> v1:172.21.15.171:6790/0 conn(0x7f87e006bcb0 legacy=0x7f87e013cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:45.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 >> v1:172.21.15.106:6789/0 conn(0x7f87e006b1c0 legacy=0x7f87e006b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 monclient: found mon.noname-h 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e0144bc0 con 0x7f87e009efd0 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: _finish_auth 0 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d8001b40 con 0x7f87e009efd0 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 5 monclient: authenticate success, global_id 5936 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: dump: 2024-04-25T23:59:45.099 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:45.100 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87d8001de0 con 0x7f87e009efd0 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 4 set_mon_vals no callback set 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 1 -- 172.21.15.171:0/2187892614 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d8004eb0 con 0x7f87e009efd0 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87dd59a640 10 monclient: dump: 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.101 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient: shutdown 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- 172.21.15.171:0/2187892614 >> v1:172.21.15.171:6791/0 conn(0x7f87e009efd0 legacy=0x7f87e0140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- 172.21.15.171:0/2187892614 shutdown_connections 2024-04-25T23:59:45.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- 172.21.15.171:0/2187892614 >> 172.21.15.171:0/2187892614 conn(0x7f87e00a7680 msgr2=0x7f87e00a3710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- 172.21.15.171:0/2187892614 shutdown_connections 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- 172.21.15.171:0/2187892614 wait complete. 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient: build_initial_monmap 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient: monmap: 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:45.103 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 Processor -- start 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- start start 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient: init 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient: _add_conns ranks=[6,0,2,4,5,7,8,3,1] 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient(hunting): picked mon.noname-d con 0x7f87e006b1c0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient(hunting): picked mon.noname-a con 0x7f87e006bcb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient(hunting): picked mon.noname-b con 0x7f87e009efd0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:45.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e0072770 con 0x7f87e006bcb0 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e0123d10 con 0x7f87e009efd0 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e0072ca0 con 0x7f87e006b1c0 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87e4afa640 10 monclient(hunting): authenticate will time out at 1235.819240s 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87ddd9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f87e006bcb0 0x7f87e01d0af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:41936/0 (socket says 172.21.15.171:41936) 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.107+0000 7f87ddd9b640 1 -- 172.21.15.171:0/4238166889 learned_addr learned my addr 172.21.15.171:0/4238166889 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 918439511 0 0) 0x7f87d4001a60 con 0x7f87e006bcb0 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): my global_id is 6183 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87c0003560 con 0x7f87e006bcb0 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614435285 0 0) 0x7f87e0072ca0 con 0x7f87e006b1c0 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:45.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): my global_id is 6135 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87d4001a60 con 0x7f87e006b1c0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881866381 0 0) 0x7f87e0123d10 con 0x7f87e009efd0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): my global_id is 5969 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87e0072ca0 con 0x7f87e009efd0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 319119948 0 0) 0x7f87e0072ca0 con 0x7f87e009efd0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87e0123d10 con 0x7f87e009efd0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1281891478 0 0) 0x7f87c0003560 con 0x7f87e006bcb0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87e0072ca0 con 0x7f87e006bcb0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d8001b00 con 0x7f87e009efd0 2024-04-25T23:59:45.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): dump: 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:45.107 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4229519841 0 0) 0x7f87d4001a60 con 0x7f87e006b1c0 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87c0003560 con 0x7f87e006b1c0 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d4001cf0 con 0x7f87e006bcb0 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): dump: 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.108 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d00019a0 con 0x7f87e006b1c0 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient(hunting): dump: 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:45.109 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2509406731 0 0) 0x7f87e0123d10 con 0x7f87e009efd0 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 >> v1:172.21.15.106:6792/0 conn(0x7f87e006b1c0 legacy=0x7f87e0141000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 >> v1:172.21.15.106:6789/0 conn(0x7f87e006bcb0 legacy=0x7f87e01d0af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 monclient: found mon.b 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e0124fa0 con 0x7f87e009efd0 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 5 monclient: authenticate success, global_id 5969 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 10 monclient: _renew_subs 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f87e0125280 con 0x7f87e009efd0 2024-04-25T23:59:45.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 10 monclient: _renew_subs 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f87e01d5940 con 0x7f87e009efd0 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87d8001de0 con 0x7f87e009efd0 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87dcd99640 4 set_mon_vals no callback set 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d8001490 con 0x7f87e009efd0 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 10 monclient: dump: 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:45.112 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c4005090 con 0x7f87e009efd0 2024-04-25T23:59:45.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f87d8010060 con 0x7f87e009efd0 2024-04-25T23:59:45.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(128..128 src has 1..128) ==== 7393+0+0 (unknown 1414871405 0 0) 0x7f87d8045530 con 0x7f87e009efd0 2024-04-25T23:59:45.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.111+0000 7f87de59c640 10 monclient: get_auth_request con 0x7f87c00380f0 auth_method 0 2024-04-25T23:59:45.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.123+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f87d80159e0 con 0x7f87e009efd0 2024-04-25T23:59:45.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.123+0000 7f87ceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:45.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.123+0000 7f87ceffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:45.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.291+0000 7f87e4afa640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm", "pool": "fooset"}] 2024-04-25T23:59:45.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.291+0000 7f87e4afa640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set rm", "pool": "fooset"}] 2024-04-25T23:59:45.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.291+0000 7f87e4afa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:45.275 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.291+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush weight-set rm", "pool": "fooset"} v 0) -- 0x7f87c4005380 con 0x7f87e009efd0 2024-04-25T23:59:45.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.547+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set rm", "pool": "fooset"}]=0 v129) ==== 89+0+0 (unknown 37901553 0 0) 0x7f87d80152e0 con 0x7f87e009efd0 2024-04-25T23:59:45.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.547+0000 7f87ceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set rm", "pool": "fooset"}] 2024-04-25T23:59:45.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.547+0000 7f87ceffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:45.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.659+0000 7f87e4afa640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm", "pool": "fooset"}] 2024-04-25T23:59:45.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.659+0000 7f87e4afa640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set rm", "pool": "fooset"}] 2024-04-25T23:59:45.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.659+0000 7f87e4afa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-25T23:59:45.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:45.659+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush weight-set rm", "pool": "fooset"} v 0) -- 0x7f87c4005770 con 0x7f87e009efd0 2024-04-25T23:59:46.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.563+0000 7f87ceffd640 1 -- 172.21.15.171:0/4238166889 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set rm", "pool": "fooset"}]=0 v130) ==== 89+0+0 (unknown 3302232522 0 0) 0x7f87d801de30 con 0x7f87e009efd0 2024-04-25T23:59:46.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.563+0000 7f87ceffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set rm", "pool": "fooset"}] 2024-04-25T23:59:46.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.563+0000 7f87ceffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:46.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 >> v1:172.21.15.171:6812/722422047 conn(0x7f87c00380f0 legacy=0x7f87c003a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.550 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 10 monclient: shutdown 2024-04-25T23:59:46.551 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:46.551 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 >> v1:172.21.15.106:6790/0 conn(0x7f87e009efd0 legacy=0x7f87e01d4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.551 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 shutdown_connections 2024-04-25T23:59:46.551 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 >> 172.21.15.171:0/4238166889 conn(0x7f87e00a7680 msgr2=0x7f87e0142990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:46.551 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 shutdown_connections 2024-04-25T23:59:46.551 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.567+0000 7f87e4afa640 1 -- 172.21.15.171:0/4238166889 wait complete. 2024-04-25T23:59:46.575 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:46.575 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c fooset 2024-04-25T23:59:46.575 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 0 2024-04-25T23:59:46.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient: get_monmap_and_config 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient: build_initial_monmap 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient: monmap: 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:46.712859+0000 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:46.712859+0000 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:46.692 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:46.693 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:46.693 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:46.693 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:46.693 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:46.693 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 1 Processor -- start 2024-04-25T23:59:46.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 1 -- start start 2024-04-25T23:59:46.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient: init 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient: _add_conns ranks=[1,7,8,3,5,2,4,0,6] 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient(hunting): picked mon.noname-f con 0x7fcdc4135bb0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient(hunting): picked mon.noname-i con 0x7fcdc41356f0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient(hunting): picked mon.noname-e con 0x7fcdc413c130 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc40a1da0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc40a1fe0 con 0x7fcdc41356f0 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc4072720 con 0x7fcdc413c130 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdcbb26640 10 monclient(hunting): authenticate will time out at 1237.419779s 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdc98c2640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fcdc4135bb0 0x7fcdc4135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59688/0 (socket says 172.21.15.171:59688) 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdc98c2640 1 -- 172.21.15.171:0/3749518386 learned_addr learned my addr 172.21.15.171:0/3749518386 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.707+0000 7fcdca0c3640 1 -- 172.21.15.171:0/3749518386 >> v1:172.21.15.106:6793/0 conn(0x7fcdc413c130 legacy=0x7fcdc413e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1557415499 0 0) 0x7fcdc40a1da0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): _negotiate 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): my global_id is 144505 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdb0003530 con 0x7fcdc4135bb0 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829849607 0 0) 0x7fcdc40a1fe0 con 0x7fcdc41356f0 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): _negotiate 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient(hunting): my global_id is 144430 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc40a1da0 con 0x7fcdc41356f0 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1561680691 0 0) 0x7fcdc40a1da0 con 0x7fcdc41356f0 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 >> v1:172.21.15.106:6793/0 conn(0x7fcdc413c130 legacy=0x7fcdc413e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 >> v1:172.21.15.171:6789/0 conn(0x7fcdc4135bb0 legacy=0x7fcdc4135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: _finish_hunting 0 2024-04-25T23:59:46.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 monclient: found mon.noname-i 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc40a17f0 con 0x7fcdc41356f0 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: _finish_auth 0 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: _check_auth_tickets 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcdc00017a0 con 0x7fcdc41356f0 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: dump: 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:46.704 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 5 monclient: authenticate success, global_id 144430 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcdc0001a80 con 0x7fcdc41356f0 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:46.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 4 set_mon_vals no callback set 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 1 -- 172.21.15.171:0/3749518386 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcdc0003960 con 0x7fcdc41356f0 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc88c0640 10 monclient: dump: 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:46.706 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient: shutdown 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- 172.21.15.171:0/3749518386 >> v1:172.21.15.171:6792/0 conn(0x7fcdc41356f0 legacy=0x7fcdc413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- 172.21.15.171:0/3749518386 shutdown_connections 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- 172.21.15.171:0/3749518386 >> 172.21.15.171:0/3749518386 conn(0x7fcdc40a2620 msgr2=0x7fcdc40a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- 172.21.15.171:0/3749518386 shutdown_connections 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- 172.21.15.171:0/3749518386 wait complete. 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient: build_initial_monmap 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient: monmap: 2024-04-25T23:59:46.707 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 Processor -- start 2024-04-25T23:59:46.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- start start 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient: init 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient: _add_conns ranks=[2,6,0,5,4,1,8,3,7] 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient(hunting): picked mon.noname-b con 0x7fcdc41356f0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient(hunting): picked mon.noname-d con 0x7fcdc4135bb0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient(hunting): picked mon.noname-a con 0x7fcdc413c130 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc4071ef0 con 0x7fcdc413c130 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc40719a0 con 0x7fcdc41356f0 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdc413b210 con 0x7fcdc4135bb0 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdcbb26640 10 monclient(hunting): authenticate will time out at 1237.423220s 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc90c1640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fcdc4135bb0 0x7fcdc41cf1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:50322/0 (socket says 172.21.15.171:50322) 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.711+0000 7fcdc90c1640 1 -- 172.21.15.171:0/4163438503 learned_addr learned my addr 172.21.15.171:0/4163438503 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884487556 0 0) 0x7fcdc413b210 con 0x7fcdc4135bb0 2024-04-25T23:59:46.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:46.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:46.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:46.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): my global_id is 6144 2024-04-25T23:59:46.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcda8003530 con 0x7fcdc4135bb0 2024-04-25T23:59:46.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482324610 0 0) 0x7fcdc4071ef0 con 0x7fcdc413c130 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): my global_id is 6192 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc413b210 con 0x7fcdc413c130 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 495510556 0 0) 0x7fcdc40719a0 con 0x7fcdc41356f0 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): my global_id is 5978 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdc4071ef0 con 0x7fcdc41356f0 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1004180813 0 0) 0x7fcda8003530 con 0x7fcdc4135bb0 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdc40719a0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2442631060 0 0) 0x7fcdc413b210 con 0x7fcdc413c130 2024-04-25T23:59:46.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcda8003530 con 0x7fcdc413c130 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcdc00016a0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.712 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcdbc004560 con 0x7fcdc413c130 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:46.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:46.714 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 699955603 0 0) 0x7fcdc4071ef0 con 0x7fcdc41356f0 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdc413b210 con 0x7fcdc41356f0 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcdb4001560 con 0x7fcdc41356f0 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient(hunting): dump: 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:46.715 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2487103425 0 0) 0x7fcdc40719a0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 >> v1:172.21.15.106:6790/0 conn(0x7fcdc41356f0 legacy=0x7fcdc41338f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 >> v1:172.21.15.106:6789/0 conn(0x7fcdc413c130 legacy=0x7fcdc41d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 monclient: found mon.d 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdc413b4f0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 5 monclient: authenticate success, global_id 6144 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 10 monclient: _renew_subs 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcdc4139ab0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 10 monclient: _renew_subs 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fcdc4137580 con 0x7fcdc4135bb0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcdc0001a80 con 0x7fcdc4135bb0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcdc0004260 con 0x7fcdc4135bb0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdbbfff640 4 set_mon_vals no callback set 2024-04-25T23:59:46.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 10 monclient: dump: 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:46.718 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcdac005090 con 0x7fcdc4135bb0 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcdc0004480 con 0x7fcdc4135bb0 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(130..130 src has 1..130) ==== 7061+0+0 (unknown 411639597 0 0) 0x7fcdc00452c0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.715+0000 7fcdc98c2640 10 monclient: get_auth_request con 0x7fcda8038090 auth_method 0 2024-04-25T23:59:46.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.727+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fcdc0015860 con 0x7fcdc4135bb0 2024-04-25T23:59:46.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.727+0000 7fcdba7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:46.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.727+0000 7fcdba7fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:46.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.899+0000 7fcdcbb26640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:46.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.899+0000 7fcdcbb26640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:46.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.899+0000 7fcdcbb26640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:46.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.899+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7fcdac005380 con 0x7fcdc4135bb0 2024-04-25T23:59:46.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.899+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v130) ==== 71+0+7 (unknown 914116082 0 1352219128) 0x7fcdc0015160 con 0x7fcdc4135bb0 2024-04-25T23:59:46.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.899+0000 7fcdba7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:46.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:46.899+0000 7fcdba7fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:46.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.003+0000 7fcdcbb26640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:46.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.003+0000 7fcdcbb26640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:46.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.003+0000 7fcdcbb26640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-25T23:59:46.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.003+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7fcdac005ac0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.003+0000 7fcdba7fc640 1 -- 172.21.15.171:0/4163438503 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v130) ==== 71+0+7 (unknown 914116082 0 1352219128) 0x7fcdc001dcb0 con 0x7fcdc4135bb0 2024-04-25T23:59:46.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.003+0000 7fcdba7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:46.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.003+0000 7fcdba7fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:46.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 >> v1:172.21.15.171:6812/722422047 conn(0x7fcda8038090 legacy=0x7fcda803a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 10 monclient: shutdown 2024-04-25T23:59:46.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:46.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 >> v1:172.21.15.106:6792/0 conn(0x7fcdc4135bb0 legacy=0x7fcdc41cf1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:46.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 shutdown_connections 2024-04-25T23:59:46.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 >> 172.21.15.171:0/4163438503 conn(0x7fcdc40a2620 msgr2=0x7fcdc40a42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:46.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 shutdown_connections 2024-04-25T23:59:46.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.007+0000 7fcdcbb26640 1 -- 172.21.15.171:0/4163438503 wait complete. 2024-04-25T23:59:47.007 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:47.007 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep barset 2024-04-25T23:59:47.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: get_monmap_and_config 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: build_initial_monmap 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: monmap: 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:47.139645+0000 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:47.139645+0000 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:47.119 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:47.120 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:47.120 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:47.120 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:47.120 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 1 Processor -- start 2024-04-25T23:59:47.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 1 -- start start 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: init 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: _add_conns ranks=[7,8,1,0,3,4,6,5,2] 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient(hunting): picked mon.noname-i con 0x7f04fc0720b0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient(hunting): picked mon.noname-e con 0x7f04fc137d90 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient(hunting): picked mon.noname-f con 0x7f04fc13e300 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc138170 con 0x7f04fc13e300 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc06d630 con 0x7f04fc0720b0 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc06ed20 con 0x7f04fc137d90 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient(hunting): authenticate will time out at 1237.846516s 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f050220f640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f04fc13e300 0x7f04fc1406f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59694/0 (socket says 172.21.15.171:59694) 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f050220f640 1 -- 172.21.15.171:0/763347707 learned_addr learned my addr 172.21.15.171:0/763347707 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f050120d640 1 -- 172.21.15.171:0/763347707 >> v1:172.21.15.106:6793/0 conn(0x7f04fc137d90 legacy=0x7f04fc13cbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:47.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2508616251 0 0) 0x7f04fc06d630 con 0x7f04fc0720b0 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): my global_id is 144439 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e8003530 con 0x7f04fc0720b0 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029305243 0 0) 0x7f04fc138170 con 0x7f04fc13e300 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient(hunting): my global_id is 144514 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04fc06d630 con 0x7f04fc13e300 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1689258512 0 0) 0x7f04fc06d630 con 0x7f04fc13e300 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 >> v1:172.21.15.106:6793/0 conn(0x7f04fc137d90 legacy=0x7f04fc13cbe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 >> v1:172.21.15.171:6792/0 conn(0x7f04fc0720b0 legacy=0x7f04fc072490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: _finish_hunting 0 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 monclient: found mon.noname-f 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc06f000 con 0x7f04fc13e300 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: _finish_auth 0 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: _check_auth_tickets 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04f4001aa0 con 0x7f04fc13e300 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 5 monclient: authenticate success, global_id 144514 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: dump: 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.129 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:47.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04f4001d10 con 0x7f04fc13e300 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 1 -- 172.21.15.171:0/763347707 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04f4004f70 con 0x7f04fc13e300 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0500a0c640 10 monclient: dump: 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.131 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 4 set_mon_vals no callback set 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 10 monclient: shutdown 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.135+0000 7f0503c72640 1 -- 172.21.15.171:0/763347707 >> v1:172.21.15.171:6789/0 conn(0x7f04fc13e300 legacy=0x7f04fc1406f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- 172.21.15.171:0/763347707 shutdown_connections 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- 172.21.15.171:0/763347707 >> 172.21.15.171:0/763347707 conn(0x7f04fc0a85a0 msgr2=0x7f04fc0a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- 172.21.15.171:0/763347707 shutdown_connections 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- 172.21.15.171:0/763347707 wait complete. 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: build_initial_monmap 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: monmap: 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:47.133 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 Processor -- start 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- start start 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: init 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:47.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _add_conns ranks=[3,2,8,7,5,6,1,4,0] 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient(hunting): picked mon.noname-g con 0x7f04fc0720b0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient(hunting): picked mon.noname-b con 0x7f04fc137d90 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient(hunting): picked mon.noname-e con 0x7f04fc13e300 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc136940 con 0x7f04fc137d90 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc136c20 con 0x7f04fc0720b0 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04fc1cd2a0 con 0x7f04fc13e300 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient(hunting): authenticate will time out at 1237.849530s 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0501a0e640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f04fc0720b0 0x7f04fc1cc480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:47644/0 (socket says 172.21.15.171:47644) 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0501a0e640 1 -- 172.21.15.171:0/2779116412 learned_addr learned my addr 172.21.15.171:0/2779116412 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f050220f640 1 -- 172.21.15.171:0/2779116412 >> v1:172.21.15.106:6793/0 conn(0x7f04fc13e300 legacy=0x7f04fc1d4750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3690671708 0 0) 0x7f04fc136c20 con 0x7f04fc0720b0 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): my global_id is 6267 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e0003530 con 0x7f04fc0720b0 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 677172480 0 0) 0x7f04e0003530 con 0x7f04fc0720b0 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04fc136c20 con 0x7f04fc0720b0 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04ec001680 con 0x7f04fc0720b0 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): dump: 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.136 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1454901932 0 0) 0x7f04fc136c20 con 0x7f04fc0720b0 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 >> v1:172.21.15.106:6793/0 conn(0x7f04fc13e300 legacy=0x7f04fc1d4750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 >> v1:172.21.15.106:6790/0 conn(0x7f04fc137d90 legacy=0x7f04fc1ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 monclient: found mon.g 2024-04-25T23:59:47.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04fc134dd0 con 0x7f04fc0720b0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 5 monclient: authenticate success, global_id 6267 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _renew_subs 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04fc135490 con 0x7f04fc0720b0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _renew_subs 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f04fc136660 con 0x7f04fc0720b0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04ec0039e0 con 0x7f04fc0720b0 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:47.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04ec003f50 con 0x7f04fc0720b0 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f3fff640 4 set_mon_vals no callback set 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 10 monclient: dump: 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.139 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f04ec0040f0 con 0x7f04fc0720b0 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04e4005090 con 0x7f04fc0720b0 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(130..130 src has 1..130) ==== 7061+0+0 (unknown 411639597 0 0) 0x7f04ec045490 con 0x7f04fc0720b0 2024-04-25T23:59:47.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.139+0000 7f050120d640 10 monclient: get_auth_request con 0x7f04e0037700 auth_method 0 2024-04-25T23:59:47.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.147+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f04ec0159d0 con 0x7f04fc0720b0 2024-04-25T23:59:47.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.147+0000 7f04f27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:47.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.147+0000 7f04f27fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:47.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.303+0000 7f0503c72640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:47.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.303+0000 7f0503c72640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:47.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.303+0000 7f0503c72640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:47.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.303+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f04e4005380 con 0x7f04fc0720b0 2024-04-25T23:59:47.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.303+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v130) ==== 71+0+7 (unknown 914116082 0 1352219128) 0x7f04ec0152d0 con 0x7f04fc0720b0 2024-04-25T23:59:47.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.303+0000 7f04f27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:47.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.303+0000 7f04f27fc640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:47.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:47.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:47.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:47.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f04e4000bd0 con 0x7f04fc0720b0 2024-04-25T23:59:47.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f04f27fc640 1 -- 172.21.15.171:0/2779116412 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v130) ==== 71+0+7 (unknown 914116082 0 1352219128) 0x7f04ec01de80 con 0x7f04fc0720b0 2024-04-25T23:59:47.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f04f27fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:47.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f04f27fc640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:47.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 >> v1:172.21.15.171:6812/722422047 conn(0x7f04e0037700 legacy=0x7f04e0039bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 10 monclient: shutdown 2024-04-25T23:59:47.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:47.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 >> v1:172.21.15.171:6790/0 conn(0x7f04fc0720b0 legacy=0x7f04fc1cc480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 shutdown_connections 2024-04-25T23:59:47.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 >> 172.21.15.171:0/2779116412 conn(0x7f04fc0a85a0 msgr2=0x7f04fc0a39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:47.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 shutdown_connections 2024-04-25T23:59:47.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.399+0000 7f0503c72640 1 -- 172.21.15.171:0/2779116412 wait complete. 2024-04-25T23:59:47.398 INFO:tasks.workunit.client.0.smithi171.stdout:barset 2024-04-25T23:59:47.398 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set rm barset 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.531+0000 7f78e49c7640 10 monclient: get_monmap_and_config 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.531+0000 7f78e49c7640 10 monclient: build_initial_monmap 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.531+0000 7f78e49c7640 10 monclient: monmap: 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:47.537213+0000 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:47.537213+0000 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.516 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:47.517 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.531+0000 7f78e49c7640 1 Processor -- start 2024-04-25T23:59:47.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.531+0000 7f78e49c7640 1 -- start start 2024-04-25T23:59:47.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.531+0000 7f78e49c7640 10 monclient: init 2024-04-25T23:59:47.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:47.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient: _add_conns ranks=[6,4,2,1,7,5,8,3,0] 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient(hunting): picked mon.noname-d con 0x7f78e0137880 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient(hunting): picked mon.noname-c con 0x7f78e0138370 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient(hunting): picked mon.noname-b con 0x7f78e00a47e0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00a2ea0 con 0x7f78e00a47e0 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00a2bc0 con 0x7f78e0138370 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e00a28e0 con 0x7f78e0137880 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient(hunting): authenticate will time out at 1238.244445s 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78ddd9b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f78e0138370 0x7f78e013cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:38828/0 (socket says 172.21.15.171:38828) 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78ddd9b640 1 -- 172.21.15.171:0/3659493989 learned_addr learned my addr 172.21.15.171:0/3659493989 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522467089 0 0) 0x7f78d80014a0 con 0x7f78e00a47e0 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.521 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): my global_id is 5996 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78c8003530 con 0x7f78e00a47e0 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258762909 0 0) 0x7f78e00a28e0 con 0x7f78e0137880 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): my global_id is 6153 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78d80014a0 con 0x7f78e0137880 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4037912295 0 0) 0x7f78e00a2bc0 con 0x7f78e0138370 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient(hunting): my global_id is 144580 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78e00a28e0 con 0x7f78e0138370 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 367926441 0 0) 0x7f78c8003530 con 0x7f78e00a47e0 2024-04-25T23:59:47.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 >> v1:172.21.15.106:6792/0 conn(0x7f78e0137880 legacy=0x7f78e0137c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 >> v1:172.21.15.106:6791/0 conn(0x7f78e0138370 legacy=0x7f78e013cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 monclient: found mon.noname-b 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e00a4230 con 0x7f78e00a47e0 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: _finish_auth 0 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78d8001d10 con 0x7f78e00a47e0 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 5 monclient: authenticate success, global_id 5996 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:47.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: dump: 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.524 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78d8001fc0 con 0x7f78e00a47e0 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 1 -- 172.21.15.171:0/3659493989 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78d8003ce0 con 0x7f78e00a47e0 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 4 set_mon_vals no callback set 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78dd59a640 10 monclient: dump: 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.525 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient: shutdown 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- 172.21.15.171:0/3659493989 >> v1:172.21.15.106:6790/0 conn(0x7f78e00a47e0 legacy=0x7f78e0140520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- 172.21.15.171:0/3659493989 shutdown_connections 2024-04-25T23:59:47.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- 172.21.15.171:0/3659493989 >> 172.21.15.171:0/3659493989 conn(0x7f78e00a9ee0 msgr2=0x7f78e00aa2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:47.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- 172.21.15.171:0/3659493989 shutdown_connections 2024-04-25T23:59:47.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- 172.21.15.171:0/3659493989 wait complete. 2024-04-25T23:59:47.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient: build_initial_monmap 2024-04-25T23:59:47.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient: monmap: 2024-04-25T23:59:47.530 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 Processor -- start 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 1 -- start start 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.535+0000 7f78e49c7640 10 monclient: init 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _add_conns ranks=[1,0,2,7,3,4,8,6,5] 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient(hunting): picked mon.noname-f con 0x7f78e00a47e0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient(hunting): picked mon.noname-a con 0x7f78e0137880 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient(hunting): picked mon.noname-b con 0x7f78e0138370 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e0133600 con 0x7f78e0137880 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e0134430 con 0x7f78e00a47e0 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78e0135050 con 0x7f78e0138370 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient(hunting): authenticate will time out at 1238.248497s 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78de59c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f78e00a47e0 0x7f78e0136e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59706/0 (socket says 172.21.15.171:59706) 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78de59c640 1 -- 172.21.15.171:0/3354087107 learned_addr learned my addr 172.21.15.171:0/3354087107 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:47.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584782723 0 0) 0x7f78e0134430 con 0x7f78e00a47e0 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): my global_id is 144523 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78c0003530 con 0x7f78e00a47e0 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2686429308 0 0) 0x7f78c0003530 con 0x7f78e00a47e0 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78e0134430 con 0x7f78e00a47e0 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78d0001aa0 con 0x7f78e00a47e0 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): dump: 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.533 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989640993 0 0) 0x7f78e0133600 con 0x7f78e0137880 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:47.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient(hunting): my global_id is 6201 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78c0003530 con 0x7f78e0137880 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1792900419 0 0) 0x7f78e0134430 con 0x7f78e00a47e0 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 >> v1:172.21.15.106:6790/0 conn(0x7f78e0138370 legacy=0x7f78e01d4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 >> v1:172.21.15.106:6789/0 conn(0x7f78e0137880 legacy=0x7f78e01d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 monclient: found mon.f 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78e0135330 con 0x7f78e00a47e0 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 5 monclient: authenticate success, global_id 144523 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _renew_subs 2024-04-25T23:59:47.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78e0137530 con 0x7f78e00a47e0 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _renew_subs 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f78e01cc6a0 con 0x7f78e00a47e0 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78d0003950 con 0x7f78e00a47e0 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78d0003e40 con 0x7f78e00a47e0 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78dcd99640 4 set_mon_vals no callback set 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 10 monclient: dump: 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:47.536 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f78d0003fe0 con 0x7f78e00a47e0 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:47.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:47.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78c4005090 con 0x7f78e00a47e0 2024-04-25T23:59:47.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(130..130 src has 1..130) ==== 7061+0+0 (unknown 411639597 0 0) 0x7f78d0045370 con 0x7f78e00a47e0 2024-04-25T23:59:47.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.539+0000 7f78ddd9b640 10 monclient: get_auth_request con 0x7f78c00377f0 auth_method 0 2024-04-25T23:59:47.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.543+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f78d0015850 con 0x7f78e00a47e0 2024-04-25T23:59:47.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.543+0000 7f78ceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:47.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.543+0000 7f78ceffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:47.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.715+0000 7f78e49c7640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm", "pool": "barset"}] 2024-04-25T23:59:47.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.715+0000 7f78e49c7640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set rm", "pool": "barset"}] 2024-04-25T23:59:47.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.715+0000 7f78e49c7640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:47.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:47.715+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set rm", "pool": "barset"} v 0) -- 0x7f78c4005380 con 0x7f78e00a47e0 2024-04-25T23:59:48.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:48.603+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set rm", "pool": "barset"}]=0 v131) ==== 89+0+0 (unknown 1639954963 0 0) 0x7f78d0015150 con 0x7f78e00a47e0 2024-04-25T23:59:48.587 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:48.603+0000 7f78ceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set rm", "pool": "barset"}] 2024-04-25T23:59:48.588 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:48.603+0000 7f78ceffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:48.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:48.711+0000 7f78e49c7640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm", "pool": "barset"}] 2024-04-25T23:59:48.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:48.711+0000 7f78e49c7640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set rm", "pool": "barset"}] 2024-04-25T23:59:48.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:48.711+0000 7f78e49c7640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:48.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:48.711+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set rm", "pool": "barset"} v 0) -- 0x7f78c4002220 con 0x7f78e00a47e0 2024-04-25T23:59:49.584 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.599+0000 7f78ceffd640 1 -- 172.21.15.171:0/3354087107 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set rm", "pool": "barset"}]=0 v132) ==== 89+0+0 (unknown 2869787261 0 0) 0x7f78d00194a0 con 0x7f78e00a47e0 2024-04-25T23:59:49.584 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.599+0000 7f78ceffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set rm", "pool": "barset"}] 2024-04-25T23:59:49.585 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.599+0000 7f78ceffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:49.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 >> v1:172.21.15.171:6812/722422047 conn(0x7f78c00377f0 legacy=0x7f78c0039cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:49.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 10 monclient: shutdown 2024-04-25T23:59:49.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:49.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 >> v1:172.21.15.171:6789/0 conn(0x7f78e00a47e0 legacy=0x7f78e0136e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:49.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 shutdown_connections 2024-04-25T23:59:49.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 >> 172.21.15.171:0/3354087107 conn(0x7f78e00a9ee0 msgr2=0x7f78e0130810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:49.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 shutdown_connections 2024-04-25T23:59:49.592 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.607+0000 7f78e49c7640 1 -- 172.21.15.171:0/3354087107 wait complete. 2024-04-25T23:59:49.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -c barset 2024-04-25T23:59:49.617 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep -q 0 2024-04-25T23:59:49.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: get_monmap_and_config 2024-04-25T23:59:49.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: build_initial_monmap 2024-04-25T23:59:49.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: monmap: 2024-04-25T23:59:49.735 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:49.735 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:49.735 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:49.755298+0000 2024-04-25T23:59:49.735 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:49.755298+0000 2024-04-25T23:59:49.735 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:49.735 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:49.736 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:49.736 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:49.736 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:49.736 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:49.736 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:49.736 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:49.736 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:49.737 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:49.737 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:49.737 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:49.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 Processor -- start 2024-04-25T23:59:49.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- start start 2024-04-25T23:59:49.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: init 2024-04-25T23:59:49.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:49.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: _add_conns ranks=[0,1,3,4,7,5,8,6,2] 2024-04-25T23:59:49.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient(hunting): picked mon.noname-a con 0x7f7ac4135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:49.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient(hunting): picked mon.noname-f con 0x7f7ac41356f0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient(hunting): picked mon.noname-g con 0x7f7ac413c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac40a1da0 con 0x7f7ac4135bb0 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac40a1fe0 con 0x7f7ac41356f0 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac4072720 con 0x7f7ac413c130 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient(hunting): authenticate will time out at 1240.462309s 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9a58640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7ac41356f0 0x7f7ac413aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59716/0 (socket says 172.21.15.171:59716) 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9a58640 1 -- 172.21.15.171:0/1282434826 learned_addr learned my addr 172.21.15.171:0/1282434826 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283069414 0 0) 0x7f7ac40a1fe0 con 0x7f7ac41356f0 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): _negotiate 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): my global_id is 144532 2024-04-25T23:59:49.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ab0003530 con 0x7f7ac41356f0 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2138853431 0 0) 0x7f7ac4072720 con 0x7f7ac413c130 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): _negotiate 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient(hunting): my global_id is 6276 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ac40a1fe0 con 0x7f7ac413c130 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 805953785 0 0) 0x7f7ab0003530 con 0x7f7ac41356f0 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 >> v1:172.21.15.171:6790/0 conn(0x7f7ac413c130 legacy=0x7f7ac413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 >> v1:172.21.15.106:6789/0 conn(0x7f7ac4135bb0 legacy=0x7f7ac4135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: _finish_hunting 0 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 monclient: found mon.noname-f 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:49.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac40a17f0 con 0x7f7ac41356f0 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: _finish_auth 0 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: _check_auth_tickets 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7ab40017c0 con 0x7f7ac41356f0 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 5 monclient: authenticate success, global_id 144532 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: dump: 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:49.747 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:49.748 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7ab4001aa0 con 0x7f7ac41356f0 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 4 set_mon_vals no callback set 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 1 -- 172.21.15.171:0/1282434826 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7ab4004bf0 con 0x7f7ac41356f0 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7ac9257640 10 monclient: dump: 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:49.749 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:49.750 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 10 monclient: shutdown 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- 172.21.15.171:0/1282434826 >> v1:172.21.15.171:6789/0 conn(0x7f7ac41356f0 legacy=0x7f7ac413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- 172.21.15.171:0/1282434826 shutdown_connections 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- 172.21.15.171:0/1282434826 >> 172.21.15.171:0/1282434826 conn(0x7f7ac40a2620 msgr2=0x7f7ac40a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- 172.21.15.171:0/1282434826 shutdown_connections 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.751+0000 7f7acc4bd640 1 -- 172.21.15.171:0/1282434826 wait complete. 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: build_initial_monmap 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: monmap: 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:49.751 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 Processor -- start 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 -- start start 2024-04-25T23:59:49.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: init 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _add_conns ranks=[8,4,3,6,1,5,7,0,2] 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient(hunting): picked mon.noname-e con 0x7f7ac41356f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient(hunting): picked mon.noname-c con 0x7f7ac4135bb0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient(hunting): picked mon.noname-g con 0x7f7ac413c130 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac413b630 con 0x7f7ac413c130 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac413b910 con 0x7f7ac4135bb0 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ac41caee0 con 0x7f7ac41356f0 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient(hunting): authenticate will time out at 1240.465479s 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acaa5a640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f7ac413c130 0x7f7ac41d2460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:47670/0 (socket says 172.21.15.171:47670) 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acaa5a640 1 -- 172.21.15.171:0/2824771791 learned_addr learned my addr 172.21.15.171:0/2824771791 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7aca259640 1 -- 172.21.15.171:0/2824771791 >> v1:172.21.15.106:6793/0 conn(0x7f7ac41356f0 legacy=0x7f7ac41ca0c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:49.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1092219813 0 0) 0x7f7ac413b630 con 0x7f7ac413c130 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): my global_id is 6285 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa8003530 con 0x7f7ac413c130 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 721809593 0 0) 0x7f7aa8003530 con 0x7f7ac413c130 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ac413b630 con 0x7f7ac413c130 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7abc001d60 con 0x7f7ac413c130 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): dump: 2024-04-25T23:59:49.754 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:49.755 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148219186 0 0) 0x7f7ac413b910 con 0x7f7ac4135bb0 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient(hunting): my global_id is 144589 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa8003530 con 0x7f7ac4135bb0 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1133653342 0 0) 0x7f7ac413b630 con 0x7f7ac413c130 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 >> v1:172.21.15.106:6793/0 conn(0x7f7ac41356f0 legacy=0x7f7ac41ca0c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 >> v1:172.21.15.106:6791/0 conn(0x7f7ac4135bb0 legacy=0x7f7ac41ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 monclient: found mon.g 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:49.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ac4071ef0 con 0x7f7ac413c130 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 5 monclient: authenticate success, global_id 6285 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _renew_subs 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7ac40719a0 con 0x7f7ac413c130 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _renew_subs 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7ac413bd30 con 0x7f7ac413c130 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7abc003cb0 con 0x7f7ac413c130 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7abc004220 con 0x7f7ac413c130 2024-04-25T23:59:49.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 10 monclient: dump: 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:49.758 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7ac8a56640 4 set_mon_vals no callback set 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ac4068fb0 con 0x7f7ac413c130 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7abc004440 con 0x7f7ac413c130 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(132..132 src has 1..132) ==== 6449+0+0 (unknown 1748007445 0 0) 0x7f7abc045410 con 0x7f7ac413c130 2024-04-25T23:59:49.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.755+0000 7f7aca259640 10 monclient: get_auth_request con 0x7f7aa8037830 auth_method 0 2024-04-25T23:59:49.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.759+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7abc015bb0 con 0x7f7ac413c130 2024-04-25T23:59:49.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.763+0000 7f7abaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:49.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.763+0000 7f7abaffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:49.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.931+0000 7f7acc4bd640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:49.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.931+0000 7f7acc4bd640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:49.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.931+0000 7f7acc4bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:49.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.931+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f7ac4075870 con 0x7f7ac413c130 2024-04-25T23:59:49.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.931+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v132) ==== 71+0+0 (unknown 1799755844 0 0) 0x7f7abc0154b0 con 0x7f7ac413c130 2024-04-25T23:59:49.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.931+0000 7f7abaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:49.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:49.931+0000 7f7abaffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:50.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:50.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:50.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-25T23:59:50.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f7ac413a330 con 0x7f7ac413c130 2024-04-25T23:59:50.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7abaffd640 1 -- 172.21.15.171:0/2824771791 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v132) ==== 71+0+0 (unknown 1799755844 0 0) 0x7f7abc01e060 con 0x7f7ac413c130 2024-04-25T23:59:50.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7abaffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:50.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7abaffd640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 >> v1:172.21.15.171:6812/722422047 conn(0x7f7aa8037830 legacy=0x7f7aa8039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 10 monclient: shutdown 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 >> v1:172.21.15.171:6790/0 conn(0x7f7ac413c130 legacy=0x7f7ac41d2460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 shutdown_connections 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 >> 172.21.15.171:0/2824771791 conn(0x7f7ac40a2620 msgr2=0x7f7ac413e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 shutdown_connections 2024-04-25T23:59:50.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.035+0000 7f7acc4bd640 1 -- 172.21.15.171:0/2824771791 wait complete. 2024-04-25T23:59:50.036 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create-compat 2024-04-25T23:59:50.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient: get_monmap_and_config 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient: build_initial_monmap 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient: monmap: 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:50.171796+0000 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:50.171796+0000 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:50.151 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:50.152 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:50.152 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:50.152 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:50.152 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 1 Processor -- start 2024-04-25T23:59:50.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 1 -- start start 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient: init 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient: _add_conns ranks=[3,5,4,8,6,7,2,1,0] 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient(hunting): picked mon.noname-g con 0x7f74b8135bb0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient(hunting): picked mon.noname-h con 0x7f74b81356f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient(hunting): picked mon.noname-c con 0x7f74b813c130 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b80a1da0 con 0x7f74b8135bb0 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b80a1fe0 con 0x7f74b813c130 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b8072720 con 0x7f74b81356f0 2024-04-25T23:59:50.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient(hunting): authenticate will time out at 1240.878673s 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74bcd8e640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f74b8135bb0 0x7f74b8135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:47682/0 (socket says 172.21.15.171:47682) 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74bcd8e640 1 -- 172.21.15.171:0/4164831804 learned_addr learned my addr 172.21.15.171:0/4164831804 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b7fff640 1 --1- 172.21.15.171:0/4164831804 >> v1:172.21.15.171:6791/0 conn(0x7f74b81356f0 0x7f74b813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:45444/0 (socket says 172.21.15.171:45444) 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 111123940 0 0) 0x7f74b8072720 con 0x7f74b81356f0 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): my global_id is 5945 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a0003530 con 0x7f74b81356f0 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734925374 0 0) 0x7f74b80a1da0 con 0x7f74b8135bb0 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient(hunting): my global_id is 6294 2024-04-25T23:59:50.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74b8072720 con 0x7f74b8135bb0 2024-04-25T23:59:50.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 101013799 0 0) 0x7f74a0003530 con 0x7f74b81356f0 2024-04-25T23:59:50.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 >> v1:172.21.15.106:6791/0 conn(0x7f74b813c130 legacy=0x7f74b813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 >> v1:172.21.15.171:6790/0 conn(0x7f74b8135bb0 legacy=0x7f74b8135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 monclient: found mon.noname-h 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b80a17f0 con 0x7f74b81356f0 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74ac0017c0 con 0x7f74b81356f0 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 5 monclient: authenticate success, global_id 5945 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:50.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: dump: 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.163 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74ac001a20 con 0x7f74b81356f0 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74beff2640 4 set_mon_vals no callback set 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 1 -- 172.21.15.171:0/4164831804 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74ac004b30 con 0x7f74b81356f0 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.167+0000 7f74b77fe640 10 monclient: dump: 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.164 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: shutdown 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/4164831804 >> v1:172.21.15.171:6791/0 conn(0x7f74b81356f0 legacy=0x7f74b813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/4164831804 shutdown_connections 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/4164831804 >> 172.21.15.171:0/4164831804 conn(0x7f74b80a2620 msgr2=0x7f74b80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/4164831804 shutdown_connections 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/4164831804 wait complete. 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: build_initial_monmap 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: monmap: 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:50.166 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 Processor -- start 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- start start 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: init 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _add_conns ranks=[2,1,8,7,6,0,3,5,4] 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient(hunting): picked mon.noname-b con 0x7f74b81356f0 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient(hunting): picked mon.noname-f con 0x7f74b8135bb0 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:50.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient(hunting): picked mon.noname-e con 0x7f74b813c130 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b813bf20 con 0x7f74b8135bb0 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b8132f60 con 0x7f74b81356f0 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74b8071560 con 0x7f74b813c130 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient(hunting): authenticate will time out at 1240.881802s 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b7fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f74b8135bb0 0x7f74b81c8e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:59726/0 (socket says 172.21.15.171:59726) 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b7fff640 1 -- 172.21.15.171:0/224839173 learned_addr learned my addr 172.21.15.171:0/224839173 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74bd58f640 1 -- 172.21.15.171:0/224839173 >> v1:172.21.15.106:6793/0 conn(0x7f74b813c130 legacy=0x7f74b81d4750 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697699679 0 0) 0x7f74b813bf20 con 0x7f74b8135bb0 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): my global_id is 144541 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a4003530 con 0x7f74b8135bb0 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3586171502 0 0) 0x7f74a4003530 con 0x7f74b8135bb0 2024-04-25T23:59:50.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74b813bf20 con 0x7f74b8135bb0 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74ac0016c0 con 0x7f74b8135bb0 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): dump: 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.169 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496724571 0 0) 0x7f74b8132f60 con 0x7f74b81356f0 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient(hunting): my global_id is 6014 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74a4003530 con 0x7f74b81356f0 2024-04-25T23:59:50.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 116693161 0 0) 0x7f74b813bf20 con 0x7f74b8135bb0 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 >> v1:172.21.15.106:6793/0 conn(0x7f74b813c130 legacy=0x7f74b81d4750 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 >> v1:172.21.15.106:6790/0 conn(0x7f74b81356f0 legacy=0x7f74b813b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: _finish_hunting 0 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 monclient: found mon.f 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b8070390 con 0x7f74b8135bb0 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: _finish_auth 0 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: _check_auth_tickets 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 5 monclient: authenticate success, global_id 144541 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _renew_subs 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f74b8071ef0 con 0x7f74b8135bb0 2024-04-25T23:59:50.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _renew_subs 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f74b80700a0 con 0x7f74b8135bb0 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74ac004e80 con 0x7f74b8135bb0 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74ac005370 con 0x7f74b8135bb0 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b6ffd640 4 set_mon_vals no callback set 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 10 monclient: dump: 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.172 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f74ac010110 con 0x7f74b8135bb0 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7498005090 con 0x7f74b8135bb0 2024-04-25T23:59:50.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.171+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(132..132 src has 1..132) ==== 6449+0+0 (unknown 1748007445 0 0) 0x7f74ac045050 con 0x7f74b8135bb0 2024-04-25T23:59:50.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.175+0000 7f74bcd8e640 10 monclient: get_auth_request con 0x7f74a4037840 auth_method 0 2024-04-25T23:59:50.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.179+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f74ac0159f0 con 0x7f74b8135bb0 2024-04-25T23:59:50.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.179+0000 7f74b57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:50.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.179+0000 7f74b57fa640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:50.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.335+0000 7f74beff2640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:50.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.335+0000 7f74beff2640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:50.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.335+0000 7f74beff2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:50.319 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.335+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7f7498005380 con 0x7f74b8135bb0 2024-04-25T23:59:50.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.627+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 v133) ==== 82+0+0 (unknown 1623075820 0 0) 0x7f74ac0152f0 con 0x7f74b8135bb0 2024-04-25T23:59:50.610 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.627+0000 7f74b57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:50.611 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.627+0000 7f74b57fa640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:50.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.727+0000 7f74beff2640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:50.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.727+0000 7f74beff2640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:50.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.727+0000 7f74beff2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:50.712 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.727+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7f7498002220 con 0x7f74b8135bb0 2024-04-25T23:59:50.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.727+0000 7f74b57fa640 1 -- 172.21.15.171:0/224839173 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 compat weight-set already created v133) ==== 115+0+0 (unknown 348221919 0 0) 0x7f74ac013650 con 0x7f74b8135bb0 2024-04-25T23:59:50.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.727+0000 7f74b57fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:50.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.727+0000 7f74b57fa640 10 monclient: _finish_command 3 = system:0 compat weight-set already created 2024-04-25T23:59:50.713 INFO:tasks.workunit.client.0.smithi171.stderr:compat weight-set already created 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 >> v1:172.21.15.171:6812/722422047 conn(0x7f74a4037840 legacy=0x7f74a4039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 10 monclient: shutdown 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 >> v1:172.21.15.171:6789/0 conn(0x7f74b8135bb0 legacy=0x7f74b81c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 shutdown_connections 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 >> 172.21.15.171:0/224839173 conn(0x7f74b80a2620 msgr2=0x7f74b8134540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 shutdown_connections 2024-04-25T23:59:50.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.731+0000 7f74beff2640 1 -- 172.21.15.171:0/224839173 wait complete. 2024-04-25T23:59:50.729 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set ls 2024-04-25T23:59:50.729 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '(compat)' 2024-04-25T23:59:50.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient: get_monmap_and_config 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient: build_initial_monmap 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient: monmap: 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:50.867788+0000 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:50.867788+0000 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:50.847 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:50.848 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:50.848 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:50.848 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:50.848 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:50.848 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 1 Processor -- start 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 1 -- start start 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient: init 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient: _add_conns ranks=[7,3,8,4,0,1,2,6,5] 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient(hunting): picked mon.noname-i con 0x7f8cfc135bb0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient(hunting): picked mon.noname-g con 0x7f8cfc1356f0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient(hunting): picked mon.noname-e con 0x7f8cfc13c130 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:50.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc0a1da0 con 0x7f8cfc1356f0 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc0a1fe0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc072720 con 0x7f8cfc13c130 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient(hunting): authenticate will time out at 1241.574810s 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cfa59c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f8cfc1356f0 0x7f8cfc13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:33560/0 (socket says 172.21.15.171:33560) 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cfad9d640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f8cfc135bb0 0x7f8cfc135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36832/0 (socket says 172.21.15.171:36832) 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cfa59c640 1 -- 172.21.15.171:0/3541331689 learned_addr learned my addr 172.21.15.171:0/3541331689 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cfb59e640 1 -- 172.21.15.171:0/3541331689 >> v1:172.21.15.106:6793/0 conn(0x7f8cfc13c130 legacy=0x7f8cfc13e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645908910 0 0) 0x7f8cfc0a1fe0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): my global_id is 144448 2024-04-25T23:59:50.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce4003530 con 0x7f8cfc135bb0 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551580508 0 0) 0x7f8cfc0a1da0 con 0x7f8cfc1356f0 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient(hunting): my global_id is 6303 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cfc0a1fe0 con 0x7f8cfc1356f0 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1257092872 0 0) 0x7f8ce4003530 con 0x7f8cfc135bb0 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 >> v1:172.21.15.106:6793/0 conn(0x7f8cfc13c130 legacy=0x7f8cfc13e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 >> v1:172.21.15.171:6790/0 conn(0x7f8cfc1356f0 legacy=0x7f8cfc13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 monclient: found mon.noname-i 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:50.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc0a17f0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: _finish_auth 0 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8cf00017c0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 5 monclient: authenticate success, global_id 144448 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: dump: 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.858 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8cf0001a60 con 0x7f8cfc135bb0 2024-04-25T23:59:50.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8d0110a640 4 set_mon_vals no callback set 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 1 -- 172.21.15.171:0/3541331689 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8cf0004b30 con 0x7f8cfc135bb0 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.863+0000 7f8cf9d9b640 10 monclient: dump: 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.860 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: shutdown 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- 172.21.15.171:0/3541331689 >> v1:172.21.15.171:6792/0 conn(0x7f8cfc135bb0 legacy=0x7f8cfc135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- 172.21.15.171:0/3541331689 shutdown_connections 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- 172.21.15.171:0/3541331689 >> 172.21.15.171:0/3541331689 conn(0x7f8cfc0a2620 msgr2=0x7f8cfc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:50.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- 172.21.15.171:0/3541331689 shutdown_connections 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- 172.21.15.171:0/3541331689 wait complete. 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: build_initial_monmap 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: monmap: 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:50.862 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 Processor -- start 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- start start 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: init 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: _add_conns ranks=[8,0,4,5,3,2,1,7,6] 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient(hunting): picked mon.noname-e con 0x7f8cfc1356f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient(hunting): picked mon.noname-a con 0x7f8cfc135bb0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient(hunting): picked mon.noname-c con 0x7f8cfc13c130 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:50.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc1cada0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc0719a0 con 0x7f8cfc13c130 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8cfc139220 con 0x7f8cfc1356f0 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient(hunting): authenticate will time out at 1241.577807s 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8cfad9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8cfc1356f0 legacy=0x7f8cfc1c9f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8cfa59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8cfc135bb0 0x7f8cfc1ca690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:60880/0 (socket says 172.21.15.171:60880) 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8cfa59c640 1 -- 172.21.15.171:0/714455513 learned_addr learned my addr 172.21.15.171:0/714455513 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3472864681 0 0) 0x7f8cfc1cada0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): my global_id is 6219 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ce8003530 con 0x7f8cfc135bb0 2024-04-25T23:59:50.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080355962 0 0) 0x7f8cfc0719a0 con 0x7f8cfc13c130 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): my global_id is 144607 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8cfc1cada0 con 0x7f8cfc13c130 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 751498594 0 0) 0x7f8ce8003530 con 0x7f8cfc135bb0 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8cfc0719a0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8cec001510 con 0x7f8cfc135bb0 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): dump: 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.865 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.866 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1316434860 0 0) 0x7f8cfc1cada0 con 0x7f8cfc13c130 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ce8003530 con 0x7f8cfc13c130 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8cf40044e0 con 0x7f8cfc13c130 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient(hunting): dump: 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.867 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3167555495 0 0) 0x7f8cfc0719a0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 >> v1:172.21.15.106:6793/0 conn(0x7f8cfc1356f0 legacy=0x7f8cfc1c9f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 >> v1:172.21.15.106:6791/0 conn(0x7f8cfc13c130 legacy=0x7f8cfc1d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:50.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 monclient: found mon.a 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cfc13b230 con 0x7f8cfc135bb0 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 5 monclient: authenticate success, global_id 6219 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: _renew_subs 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8cfc13a0c0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: _renew_subs 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8cfc13bc90 con 0x7f8cfc135bb0 2024-04-25T23:59:50.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8cec004aa0 con 0x7f8cfc135bb0 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8cec004f90 con 0x7f8cfc135bb0 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8cf959a640 4 set_mon_vals no callback set 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.867+0000 7f8ce37fe640 10 monclient: dump: 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:50.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.871+0000 7f8d0110a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.871+0000 7f8d0110a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.871+0000 7f8d0110a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.871+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cdc005090 con 0x7f8cfc135bb0 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.871+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8cec00fd30 con 0x7f8cfc135bb0 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.871+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(133..133 src has 1..133) ==== 6781+0+0 (unknown 2597990656 0 0) 0x7f8cec045100 con 0x7f8cfc135bb0 2024-04-25T23:59:50.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.871+0000 7f8cfad9d640 10 monclient: get_auth_request con 0x7f8ce8037c50 auth_method 0 2024-04-25T23:59:50.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.883+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8cec015700 con 0x7f8cfc135bb0 2024-04-25T23:59:50.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.883+0000 7f8ce37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:50.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:50.883+0000 7f8ce37fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:51.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.051+0000 7f8d0110a640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:51.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.051+0000 7f8d0110a640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:51.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.051+0000 7f8d0110a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:51.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.051+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f8cdc005380 con 0x7f8cfc135bb0 2024-04-25T23:59:51.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.051+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v133) ==== 71+0+9 (unknown 1899167245 0 1822970295) 0x7f8cec015000 con 0x7f8cfc135bb0 2024-04-25T23:59:51.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.051+0000 7f8ce37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:51.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.051+0000 7f8ce37fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.151+0000 7f8d0110a640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.151+0000 7f8d0110a640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.151+0000 7f8d0110a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-25T23:59:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.151+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush weight-set ls"} v 0) -- 0x7f8cdc005ac0 con 0x7f8cfc135bb0 2024-04-25T23:59:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8ce37fe640 1 -- 172.21.15.171:0/714455513 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set ls"}]=0 v133) ==== 71+0+9 (unknown 1899167245 0 1822970295) 0x7f8cec019350 con 0x7f8cfc135bb0 2024-04-25T23:59:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8ce37fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set ls"}] 2024-04-25T23:59:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8ce37fe640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 >> v1:172.21.15.171:6812/722422047 conn(0x7f8ce8037c50 legacy=0x7f8ce803a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 10 monclient: shutdown 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 >> v1:172.21.15.106:6789/0 conn(0x7f8cfc135bb0 legacy=0x7f8cfc1ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 shutdown_connections 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 >> 172.21.15.171:0/714455513 conn(0x7f8cfc0a2620 msgr2=0x7f8cfc13e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 shutdown_connections 2024-04-25T23:59:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.155+0000 7f8d0110a640 1 -- 172.21.15.171:0/714455513 wait complete. 2024-04-25T23:59:51.154 INFO:tasks.workunit.client.0.smithi171.stdout:(compat) 2024-04-25T23:59:51.154 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set rm-compat 2024-04-25T23:59:51.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.287+0000 7f34777b5640 10 monclient: get_monmap_and_config 2024-04-25T23:59:51.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.287+0000 7f34777b5640 10 monclient: build_initial_monmap 2024-04-25T23:59:51.272 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.287+0000 7f34777b5640 10 monclient: monmap: 2024-04-25T23:59:51.272 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:51.272 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:51.272 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:51.293265+0000 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:51.293265+0000 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:51.273 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.287+0000 7f34777b5640 1 Processor -- start 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.287+0000 7f34777b5640 1 -- start start 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.287+0000 7f34777b5640 10 monclient: init 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: _add_conns ranks=[5,8,3,4,1,7,6,0,2] 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): picked mon.noname-h con 0x7f34700a3930 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): picked mon.noname-e con 0x7f3470138150 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): picked mon.noname-g con 0x7f3470138570 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:51.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700a2b70 con 0x7f3470138570 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700a2e50 con 0x7f34700a3930 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34700a4460 con 0x7f3470138150 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): authenticate will time out at 1242.000245s 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3475d52640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f3470138570 0x7f34701406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:33570/0 (socket says 172.21.15.171:33570) 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3475d52640 1 -- 172.21.15.171:0/2402270600 learned_addr learned my addr 172.21.15.171:0/2402270600 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3475551640 1 --1- 172.21.15.171:0/2402270600 >> v1:172.21.15.171:6791/0 conn(0x7f34700a3930 0x7f3470137a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33240/0 (socket says 172.21.15.171:33240) 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3474d50640 1 -- 172.21.15.171:0/2402270600 >> v1:172.21.15.106:6793/0 conn(0x7f3470138150 legacy=0x7f347013cf70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535426444 0 0) 0x7f34700a2b70 con 0x7f3470138570 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): my global_id is 6312 2024-04-25T23:59:51.281 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345c003530 con 0x7f3470138570 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1609700270 0 0) 0x7f34700a2e50 con 0x7f34700a3930 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient(hunting): my global_id is 5954 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34700a2b70 con 0x7f34700a3930 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1482242081 0 0) 0x7f345c003530 con 0x7f3470138570 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 >> v1:172.21.15.106:6793/0 conn(0x7f3470138150 legacy=0x7f347013cf70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 >> v1:172.21.15.171:6791/0 conn(0x7f34700a3930 legacy=0x7f3470137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 monclient: found mon.noname-g 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34700a1810 con 0x7f3470138570 2024-04-25T23:59:51.282 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3468001b40 con 0x7f3470138570 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 5 monclient: authenticate success, global_id 6312 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: dump: 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:51.283 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3468001e60 con 0x7f3470138570 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 4 set_mon_vals no callback set 2024-04-25T23:59:51.284 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 1 -- 172.21.15.171:0/2402270600 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3468004f70 con 0x7f3470138570 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3467fff640 10 monclient: dump: 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:51.285 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: shutdown 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- 172.21.15.171:0/2402270600 >> v1:172.21.15.171:6790/0 conn(0x7f3470138570 legacy=0x7f34701406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- 172.21.15.171:0/2402270600 shutdown_connections 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- 172.21.15.171:0/2402270600 >> 172.21.15.171:0/2402270600 conn(0x7f34700a6d70 msgr2=0x7f34700a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- 172.21.15.171:0/2402270600 shutdown_connections 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- 172.21.15.171:0/2402270600 wait complete. 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: build_initial_monmap 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: monmap: 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:51.286 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:51.287 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 Processor -- start 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- start start 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: init 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient: _add_conns ranks=[4,7,2,6,8,5,0,1,3] 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): picked mon.noname-c con 0x7f34700a3930 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): picked mon.noname-i con 0x7f3470138150 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): picked mon.noname-b con 0x7f3470138570 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f347009e490 con 0x7f3470138570 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3470120a40 con 0x7f34700a3930 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3470120d20 con 0x7f3470138150 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f34777b5640 10 monclient(hunting): authenticate will time out at 1242.003161s 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3474d50640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f3470138150 0x7f34701d1560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36846/0 (socket says 172.21.15.171:36846) 2024-04-25T23:59:51.288 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3474d50640 1 -- 172.21.15.171:0/3478349876 learned_addr learned my addr 172.21.15.171:0/3478349876 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1808901260 0 0) 0x7f3470120d20 con 0x7f3470138150 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): my global_id is 144457 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3454003530 con 0x7f3470138150 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3714131302 0 0) 0x7f3454003530 con 0x7f3470138150 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3470120d20 con 0x7f3470138150 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3460004330 con 0x7f3470138150 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:51.289 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:51.290 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1711397911 0 0) 0x7f3470120d20 con 0x7f3470138150 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.291+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 >> v1:172.21.15.106:6791/0 conn(0x7f34700a3930 legacy=0x7f3470133900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 >> v1:172.21.15.106:6790/0 conn(0x7f3470138570 legacy=0x7f34701d4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 1 monclient: found mon.i 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34701206f0 con 0x7f3470138150 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 5 monclient: authenticate success, global_id 144457 2024-04-25T23:59:51.291 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 10 monclient: _renew_subs 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f347009eff0 con 0x7f3470138150 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 10 monclient: _renew_subs 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f34701341e0 con 0x7f3470138150 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3460004690 con 0x7f3470138150 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3460004c00 con 0x7f3470138150 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34677fe640 4 set_mon_vals no callback set 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 10 monclient: dump: 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.292 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:51.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3450005090 con 0x7f3470138150 2024-04-25T23:59:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3460004e60 con 0x7f3470138150 2024-04-25T23:59:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(133..133 src has 1..133) ==== 6781+0+0 (unknown 2597990656 0 0) 0x7f3460045250 con 0x7f3470138150 2024-04-25T23:59:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.295+0000 7f3475551640 10 monclient: get_auth_request con 0x7f3454037860 auth_method 0 2024-04-25T23:59:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.299+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3460015910 con 0x7f3470138150 2024-04-25T23:59:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.299+0000 7f3465ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.299+0000 7f3465ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:51.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.467+0000 7f34777b5640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-25T23:59:51.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.467+0000 7f34777b5640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-25T23:59:51.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.467+0000 7f34777b5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:51.450 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.467+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f3450005380 con 0x7f3470138150 2024-04-25T23:59:51.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.631+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v134) ==== 78+0+0 (unknown 1300440148 0 0) 0x7f3460015210 con 0x7f3470138150 2024-04-25T23:59:51.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.631+0000 7f3465ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-25T23:59:51.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.631+0000 7f3465ffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:51.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.739+0000 7f34777b5640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-25T23:59:51.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.739+0000 7f34777b5640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-25T23:59:51.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.739+0000 7f34777b5640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:51.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:51.739+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f3450002220 con 0x7f3470138150 2024-04-25T23:59:52.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.655+0000 7f3465ffb640 1 -- 172.21.15.171:0/3478349876 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v135) ==== 78+0+0 (unknown 205680241 0 0) 0x7f346001ddc0 con 0x7f3470138150 2024-04-25T23:59:52.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.655+0000 7f3465ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-25T23:59:52.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.655+0000 7f3465ffb640 10 monclient: _finish_command 3 = system:0 2024-04-25T23:59:52.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 >> v1:172.21.15.171:6812/722422047 conn(0x7f3454037860 legacy=0x7f3454039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:52.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 10 monclient: shutdown 2024-04-25T23:59:52.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:52.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 >> v1:172.21.15.171:6792/0 conn(0x7f3470138150 legacy=0x7f34701d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:52.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 shutdown_connections 2024-04-25T23:59:52.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 >> 172.21.15.171:0/3478349876 conn(0x7f34700a6d70 msgr2=0x7f34700a8ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:52.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 shutdown_connections 2024-04-25T23:59:52.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.659+0000 7f34777b5640 1 -- 172.21.15.171:0/3478349876 wait complete. 2024-04-25T23:59:52.660 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create cool 2 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.795+0000 7f642b93a640 10 monclient: get_monmap_and_config 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.795+0000 7f642b93a640 10 monclient: build_initial_monmap 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.795+0000 7f642b93a640 10 monclient: monmap: 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:52.801165+0000 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:52.801165+0000 2024-04-25T23:59:52.780 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:52.781 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.795+0000 7f642b93a640 1 Processor -- start 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.795+0000 7f642b93a640 1 -- start start 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.795+0000 7f642b93a640 10 monclient: init 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: _add_conns ranks=[5,0,4,1,8,3,6,2,7] 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): picked mon.noname-h con 0x7f6424135c90 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): picked mon.noname-a con 0x7f6424071c00 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:52.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): picked mon.noname-c con 0x7f6424136070 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6424135ab0 con 0x7f6424071c00 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64240a2350 con 0x7f6424136070 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6424072990 con 0x7f6424135c90 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): authenticate will time out at 1243.508583s 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f64296d6640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6424135c90 0x7f64240a1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33256/0 (socket says 172.21.15.171:33256) 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f64296d6640 1 -- 172.21.15.171:0/3487493457 learned_addr learned my addr 172.21.15.171:0/3487493457 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1089062186 0 0) 0x7f6424072990 con 0x7f6424135c90 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient(hunting): my global_id is 5963 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f640c003530 con 0x7f6424135c90 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1775300856 0 0) 0x7f640c003530 con 0x7f6424135c90 2024-04-25T23:59:52.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 >> v1:172.21.15.106:6791/0 conn(0x7f6424136070 legacy=0x7f642413e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 >> v1:172.21.15.106:6789/0 conn(0x7f6424071c00 legacy=0x7f64240a1c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 monclient: found mon.noname-h 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64241364c0 con 0x7f6424135c90 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: _finish_auth 0 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f641c001b40 con 0x7f6424135c90 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:52.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: dump: 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:52.787 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 5 monclient: authenticate success, global_id 5963 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f641c001ea0 con 0x7f6424135c90 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 4 set_mon_vals no callback set 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 1 -- 172.21.15.171:0/3487493457 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f641c004f70 con 0x7f6424135c90 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f6423fff640 10 monclient: dump: 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: shutdown 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:52.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- 172.21.15.171:0/3487493457 >> v1:172.21.15.171:6791/0 conn(0x7f6424135c90 legacy=0x7f64240a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- 172.21.15.171:0/3487493457 shutdown_connections 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- 172.21.15.171:0/3487493457 >> 172.21.15.171:0/3487493457 conn(0x7f64240a62d0 msgr2=0x7f64240a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- 172.21.15.171:0/3487493457 shutdown_connections 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- 172.21.15.171:0/3487493457 wait complete. 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: build_initial_monmap 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: monmap: 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:52.790 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 Processor -- start 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- start start 2024-04-25T23:59:52.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: init 2024-04-25T23:59:52.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:52.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient: _add_conns ranks=[3,5,0,2,7,1,4,8,6] 2024-04-25T23:59:52.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): picked mon.noname-g con 0x7f6424071c00 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:52.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): picked mon.noname-h con 0x7f6424135c90 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:52.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): picked mon.noname-a con 0x7f6424136070 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642411f990 con 0x7f6424136070 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642411f570 con 0x7f6424071c00 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642411d000 con 0x7f6424135c90 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f642b93a640 10 monclient(hunting): authenticate will time out at 1243.511853s 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f64296d6640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6424071c00 0x7f642411c1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:33580/0 (socket says 172.21.15.171:33580) 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.799+0000 7f64296d6640 1 -- 172.21.15.171:0/1542894331 learned_addr learned my addr 172.21.15.171:0/1542894331 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026840676 0 0) 0x7f642411d000 con 0x7f6424135c90 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): my global_id is 5972 2024-04-25T23:59:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6410003530 con 0x7f6424135c90 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612612065 0 0) 0x7f642411f570 con 0x7f6424071c00 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): my global_id is 6321 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642411d000 con 0x7f6424071c00 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1838157496 0 0) 0x7f6410003530 con 0x7f6424135c90 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f642411f570 con 0x7f6424135c90 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6418001a20 con 0x7f6424135c90 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:52.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1116565981 0 0) 0x7f642411d000 con 0x7f6424071c00 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6410003530 con 0x7f6424071c00 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808526906 0 0) 0x7f64240a2350 con 0x7f6424136070 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): my global_id is 6237 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642411d000 con 0x7f6424136070 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f641c001b00 con 0x7f6424071c00 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient(hunting): dump: 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:52.799 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3559709983 0 0) 0x7f642411f570 con 0x7f6424135c90 2024-04-25T23:59:52.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 >> v1:172.21.15.171:6790/0 conn(0x7f6424071c00 legacy=0x7f642411c1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 >> v1:172.21.15.106:6789/0 conn(0x7f6424136070 legacy=0x7f64241d0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 monclient: found mon.h 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642409fb20 con 0x7f6424135c90 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 5 monclient: authenticate success, global_id 5972 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 10 monclient: _renew_subs 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f642409f660 con 0x7f6424135c90 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 10 monclient: _renew_subs 2024-04-25T23:59:52.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f642411f290 con 0x7f6424135c90 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64180038d0 con 0x7f6424135c90 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6418003e40 con 0x7f6424135c90 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f64237fe640 4 set_mon_vals no callback set 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 10 monclient: dump: 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:52.802 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6404005090 con 0x7f6424135c90 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6418004060 con 0x7f6424135c90 2024-04-25T23:59:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(135..135 src has 1..135) ==== 6449+0+0 (unknown 3397134716 0 0) 0x7f6418043f50 con 0x7f6424135c90 2024-04-25T23:59:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.803+0000 7f64296d6640 10 monclient: get_auth_request con 0x7f6410037f90 auth_method 0 2024-04-25T23:59:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.807+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6424135ab0 con 0x7f6424135c90 2024-04-25T23:59:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.807+0000 7f6421ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.807+0000 7f6421ffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:52.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.971+0000 7f642b93a640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}] 2024-04-25T23:59:52.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.971+0000 7f642b93a640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}] 2024-04-25T23:59:52.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.971+0000 7f642b93a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:52.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:52.971+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "cool", "pg_num": 2} v 0) -- 0x7f6404005b90 con 0x7f6424135c90 2024-04-25T23:59:53.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.671+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}]=0 pool 'cool' created v136) ==== 111+0+0 (unknown 939921657 0 0) 0x7f6418014710 con 0x7f6424135c90 2024-04-25T23:59:53.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.671+0000 7f6421ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}] 2024-04-25T23:59:53.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.671+0000 7f6421ffb640 10 monclient: _finish_command 2 = system:0 pool 'cool' created 2024-04-25T23:59:53.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}] 2024-04-25T23:59:53.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}] 2024-04-25T23:59:53.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:53.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool create", "pool": "cool", "pg_num": 2} v 0) -- 0x7f64040010a0 con 0x7f6424135c90 2024-04-25T23:59:53.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f6421ffb640 1 -- 172.21.15.171:0/1542894331 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}]=0 pool 'cool' already exists v136) ==== 118+0+0 (unknown 2570299145 0 0) 0x7f6418014010 con 0x7f6424135c90 2024-04-25T23:59:53.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f6421ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "cool", "pg_num": 2}] 2024-04-25T23:59:53.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f6421ffb640 10 monclient: _finish_command 3 = system:0 pool 'cool' already exists 2024-04-25T23:59:53.759 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'cool' already exists 2024-04-25T23:59:53.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 >> v1:172.21.15.171:6812/722422047 conn(0x7f6410037f90 legacy=0x7f641003a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:53.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 10 monclient: shutdown 2024-04-25T23:59:53.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:53.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 >> v1:172.21.15.171:6791/0 conn(0x7f6424135c90 legacy=0x7f642411c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:53.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 shutdown_connections 2024-04-25T23:59:53.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.775+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 >> 172.21.15.171:0/1542894331 conn(0x7f64240a62d0 msgr2=0x7f6424134940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:53.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.779+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 shutdown_connections 2024-04-25T23:59:53.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.779+0000 7f642b93a640 1 -- 172.21.15.171:0/1542894331 wait complete. 2024-04-25T23:59:53.776 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool create cold 2 2024-04-25T23:59:53.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.903+0000 7f8a09133640 10 monclient: get_monmap_and_config 2024-04-25T23:59:53.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.903+0000 7f8a09133640 10 monclient: build_initial_monmap 2024-04-25T23:59:53.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.903+0000 7f8a09133640 10 monclient: monmap: 2024-04-25T23:59:53.889 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:53.889 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:53.889 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:53.910463+0000 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:53.910463+0000 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:53.890 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:53.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 Processor -- start 2024-04-25T23:59:53.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- start start 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient: init 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient: _add_conns ranks=[6,7,4,5,3,2,8,0,1] 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient(hunting): picked mon.noname-d con 0x7f8a04137a70 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient(hunting): picked mon.noname-i con 0x7f8a04138560 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient(hunting): picked mon.noname-c con 0x7f8a040a4750 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a040a2a40 con 0x7f8a040a4750 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a040a2d20 con 0x7f8a04137a70 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a040a16e0 con 0x7f8a04138560 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient(hunting): authenticate will time out at 1244.617599s 2024-04-25T23:59:53.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a0259c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f8a04138560 0x7f8a0413cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36850/0 (socket says 172.21.15.171:36850) 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a0259c640 1 -- 172.21.15.171:0/3418982234 learned_addr learned my addr 172.21.15.171:0/3418982234 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1427731457 0 0) 0x7f8a040a16e0 con 0x7f8a04138560 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient(hunting): _negotiate 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient(hunting): my global_id is 144466 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89ec003530 con 0x7f8a04138560 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 87632461 0 0) 0x7f89ec003530 con 0x7f8a04138560 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 >> v1:172.21.15.106:6792/0 conn(0x7f8a04137a70 legacy=0x7f8a04137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 >> v1:172.21.15.106:6791/0 conn(0x7f8a040a4750 legacy=0x7f8a041406d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: _finish_hunting 0 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 monclient: found mon.noname-i 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:53.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a040a3a90 con 0x7f8a04138560 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: _finish_auth 0 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: _check_auth_tickets 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89f8001800 con 0x7f8a04138560 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: dump: 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:53.899 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 5 monclient: authenticate success, global_id 144466 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89f8001b10 con 0x7f8a04138560 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 1 -- 172.21.15.171:0/3418982234 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89f8004bf0 con 0x7f8a04138560 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 4 set_mon_vals no callback set 2024-04-25T23:59:53.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a01d9b640 10 monclient: dump: 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:53.901 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient: shutdown 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- 172.21.15.171:0/3418982234 >> v1:172.21.15.171:6792/0 conn(0x7f8a04138560 legacy=0x7f8a0413cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- 172.21.15.171:0/3418982234 shutdown_connections 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- 172.21.15.171:0/3418982234 >> 172.21.15.171:0/3418982234 conn(0x7f8a040aa020 msgr2=0x7f8a040aa430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- 172.21.15.171:0/3418982234 shutdown_connections 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 1 -- 172.21.15.171:0/3418982234 wait complete. 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient: build_initial_monmap 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.907+0000 7f8a09133640 10 monclient: monmap: 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:53.902 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 Processor -- start 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 -- start start 2024-04-25T23:59:53.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: init 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _add_conns ranks=[4,7,6,5,8,3,2,1,0] 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient(hunting): picked mon.noname-c con 0x7f8a040a4750 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient(hunting): picked mon.noname-i con 0x7f8a04137a70 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient(hunting): picked mon.noname-d con 0x7f8a04138560 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a04122b30 con 0x7f8a040a4750 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a041213a0 con 0x7f8a04138560 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a040a22a0 con 0x7f8a04137a70 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient(hunting): authenticate will time out at 1244.620775s 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a0259c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f8a04137a70 0x7f8a041d1af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36860/0 (socket says 172.21.15.171:36860) 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a0259c640 1 -- 172.21.15.171:0/2505221469 learned_addr learned my addr 172.21.15.171:0/2505221469 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262879671 0 0) 0x7f8a040a22a0 con 0x7f8a04137a70 2024-04-25T23:59:53.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): my global_id is 144475 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89f0003530 con 0x7f8a04137a70 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 418062812 0 0) 0x7f89f0003530 con 0x7f8a04137a70 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a040a22a0 con 0x7f8a04137a70 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89f80017c0 con 0x7f8a04137a70 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): dump: 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:53.905 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743367814 0 0) 0x7f8a04122b30 con 0x7f8a040a4750 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:53.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): my global_id is 144643 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89f0003530 con 0x7f8a040a4750 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112221981 0 0) 0x7f8a041213a0 con 0x7f8a04138560 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient(hunting): my global_id is 6171 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a04122b30 con 0x7f8a04138560 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2615270378 0 0) 0x7f8a040a22a0 con 0x7f8a04137a70 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 >> v1:172.21.15.106:6792/0 conn(0x7f8a04138560 legacy=0x7f8a041d5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 >> v1:172.21.15.106:6791/0 conn(0x7f8a040a4750 legacy=0x7f8a041ccad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 monclient: found mon.i 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a04120840 con 0x7f8a04137a70 2024-04-25T23:59:53.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 5 monclient: authenticate success, global_id 144475 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _renew_subs 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a04122850 con 0x7f8a04137a70 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _renew_subs 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a04123120 con 0x7f8a04137a70 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89f8001b10 con 0x7f8a04137a70 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89f8001d40 con 0x7f8a04137a70 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a0159a640 4 set_mon_vals no callback set 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 10 monclient: dump: 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89e4005090 con 0x7f8a04137a70 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f89f8010050 con 0x7f8a04137a70 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(136..136 src has 1..136) ==== 6792+0+0 (unknown 2590819451 0 0) 0x7f89f8045260 con 0x7f8a04137a70 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.911+0000 7f8a02d9d640 10 monclient: get_auth_request con 0x7f89f0037be0 auth_method 0 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.915+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f89f80159d0 con 0x7f8a04137a70 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.915+0000 7f89eb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:53.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:53.915+0000 7f89eb7fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:54.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.079+0000 7f8a09133640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}] 2024-04-25T23:59:54.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.079+0000 7f8a09133640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}] 2024-04-25T23:59:54.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.079+0000 7f8a09133640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:54.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.079+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "cold", "pg_num": 2} v 0) -- 0x7f89e4005b90 con 0x7f8a04137a70 2024-04-25T23:59:54.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.675+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}]=0 pool 'cold' created v137) ==== 111+0+0 (unknown 3095812247 0 0) 0x7f89f80152d0 con 0x7f8a04137a70 2024-04-25T23:59:54.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.675+0000 7f89eb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}] 2024-04-25T23:59:54.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.675+0000 7f89eb7fe640 10 monclient: _finish_command 2 = system:0 pool 'cold' created 2024-04-25T23:59:54.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.783+0000 7f8a09133640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}] 2024-04-25T23:59:54.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.783+0000 7f8a09133640 10 monclient: _send_command 3 [{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}] 2024-04-25T23:59:54.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.783+0000 7f8a09133640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-25T23:59:54.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.783+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd pool create", "pool": "cold", "pg_num": 2} v 0) -- 0x7f89e40010a0 con 0x7f8a04137a70 2024-04-25T23:59:54.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.783+0000 7f89eb7fe640 1 -- 172.21.15.171:0/2505221469 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}]=0 pool 'cold' already exists v137) ==== 118+0+0 (unknown 3041623357 0 0) 0x7f89f80423c0 con 0x7f8a04137a70 2024-04-25T23:59:54.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.783+0000 7f89eb7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool create", "pool": "cold", "pg_num": 2}] 2024-04-25T23:59:54.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.783+0000 7f89eb7fe640 10 monclient: _finish_command 3 = system:0 pool 'cold' already exists 2024-04-25T23:59:54.768 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'cold' already exists 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 >> v1:172.21.15.171:6812/722422047 conn(0x7f89f0037be0 legacy=0x7f89f003a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 10 monclient: shutdown 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 >> v1:172.21.15.171:6792/0 conn(0x7f8a04137a70 legacy=0x7f8a041d1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 shutdown_connections 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 >> 172.21.15.171:0/2505221469 conn(0x7f8a040aa020 msgr2=0x7f8a04135100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 shutdown_connections 2024-04-25T23:59:54.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.787+0000 7f8a09133640 1 -- 172.21.15.171:0/2505221469 wait complete. 2024-04-25T23:59:54.785 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool set cold size 2 2024-04-25T23:59:54.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.919+0000 7f7053daa640 10 monclient: get_monmap_and_config 2024-04-25T23:59:54.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.919+0000 7f7053daa640 10 monclient: build_initial_monmap 2024-04-25T23:59:54.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.919+0000 7f7053daa640 10 monclient: monmap: 2024-04-25T23:59:54.906 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:54.906 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:54.906 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:54.926266+0000 2024-04-25T23:59:54.906 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:54.926266+0000 2024-04-25T23:59:54.906 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:54.906 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:54.907 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:54.908 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:54.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 Processor -- start 2024-04-25T23:59:54.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- start start 2024-04-25T23:59:54.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient: init 2024-04-25T23:59:54.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:54.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient: _add_conns ranks=[5,4,3,1,7,6,0,8,2] 2024-04-25T23:59:54.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient(hunting): picked mon.noname-h con 0x7f704c0a3eb0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:54.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient(hunting): picked mon.noname-c con 0x7f704c06bee0 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient(hunting): picked mon.noname-g con 0x7f704c06b850 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c0a1130 con 0x7f704c06b850 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c09ec40 con 0x7f704c06bee0 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c09de50 con 0x7f704c0a3eb0 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient(hunting): authenticate will time out at 1245.633589s 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7051b46640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f704c0a3eb0 0x7f704c137de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33272/0 (socket says 172.21.15.171:33272) 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7051b46640 1 -- 172.21.15.171:0/3897898182 learned_addr learned my addr 172.21.15.171:0/3897898182 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:54.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2039962611 0 0) 0x7f704c09de50 con 0x7f704c0a3eb0 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): _negotiate 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): my global_id is 5981 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7038003530 con 0x7f704c0a3eb0 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1623717436 0 0) 0x7f704c0a1130 con 0x7f704c06b850 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): _negotiate 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:54.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient(hunting): my global_id is 6330 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f704c09de50 con 0x7f704c06b850 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3669207835 0 0) 0x7f7038003530 con 0x7f704c0a3eb0 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 >> v1:172.21.15.106:6791/0 conn(0x7f704c06bee0 legacy=0x7f704c13cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 >> v1:172.21.15.171:6790/0 conn(0x7f704c06b850 legacy=0x7f704c140320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: _finish_hunting 0 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 monclient: found mon.noname-h 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704c1384f0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: _finish_auth 0 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: _check_auth_tickets 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f70480017c0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: dump: 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:54.922 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:54.923 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 5 monclient: authenticate success, global_id 5981 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7048001aa0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 1 -- 172.21.15.171:0/3897898182 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7048004bf0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 4 set_mon_vals no callback set 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7050b44640 10 monclient: dump: 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:54.925 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:54.926 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient: shutdown 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- 172.21.15.171:0/3897898182 >> v1:172.21.15.171:6791/0 conn(0x7f704c0a3eb0 legacy=0x7f704c137de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- 172.21.15.171:0/3897898182 shutdown_connections 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- 172.21.15.171:0/3897898182 >> 172.21.15.171:0/3897898182 conn(0x7f704c0a72a0 msgr2=0x7f704c0a37a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- 172.21.15.171:0/3897898182 shutdown_connections 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 1 -- 172.21.15.171:0/3897898182 wait complete. 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient: build_initial_monmap 2024-04-25T23:59:54.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.923+0000 7f7053daa640 10 monclient: monmap: 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:54.928 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:54.929 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:54.929 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:54.929 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:54.929 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:54.929 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:54.929 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:54.930 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:54.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 Processor -- start 2024-04-25T23:59:54.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 -- start start 2024-04-25T23:59:54.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: init 2024-04-25T23:59:54.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:54.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _add_conns ranks=[5,1,4,7,6,3,0,2,8] 2024-04-25T23:59:54.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient(hunting): picked mon.noname-h con 0x7f704c0a3eb0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:54.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient(hunting): picked mon.noname-f con 0x7f704c125180 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:54.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient(hunting): picked mon.noname-c con 0x7f704c1d2b00 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:54.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c1235d0 con 0x7f704c125180 2024-04-25T23:59:54.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c124d60 con 0x7f704c1d2b00 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f704c122520 con 0x7f704c0a3eb0 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient(hunting): authenticate will time out at 1245.637050s 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7051b46640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f704c0a3eb0 0x7f704c121700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33278/0 (socket says 172.21.15.171:33278) 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7051b46640 1 -- 172.21.15.171:0/3306598857 learned_addr learned my addr 172.21.15.171:0/3306598857 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7051345640 1 --1- 172.21.15.171:0/3306598857 >> v1:172.21.15.171:6789/0 conn(0x7f704c125180 0x7f704c121e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56526/0 (socket says 172.21.15.171:56526) 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 487153848 0 0) 0x7f704c122520 con 0x7f704c0a3eb0 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:54.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): my global_id is 5990 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7030003530 con 0x7f704c0a3eb0 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 460391472 0 0) 0x7f704c1235d0 con 0x7f704c125180 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): my global_id is 144550 2024-04-25T23:59:54.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f704c122520 con 0x7f704c125180 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1471569002 0 0) 0x7f7030003530 con 0x7f704c0a3eb0 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f704c1235d0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7048004b30 con 0x7f704c0a3eb0 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): dump: 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:54.934 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:54.935 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082073594 0 0) 0x7f704c124d60 con 0x7f704c1d2b00 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _negotiate 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:54.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): my global_id is 144661 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7030003530 con 0x7f704c1d2b00 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2586510781 0 0) 0x7f704c122520 con 0x7f704c125180 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f704c124d60 con 0x7f704c125180 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f703c001a60 con 0x7f704c125180 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient(hunting): dump: 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 443926824 0 0) 0x7f704c1235d0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 >> v1:172.21.15.106:6791/0 conn(0x7f704c1d2b00 legacy=0x7f704c1d4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 >> v1:172.21.15.171:6789/0 conn(0x7f704c125180 legacy=0x7f704c121e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: _finish_hunting 0 2024-04-25T23:59:54.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 monclient: found mon.h 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f704c09e3a0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: _finish_auth 0 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: _check_auth_tickets 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 5 monclient: authenticate success, global_id 5990 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _renew_subs 2024-04-25T23:59:54.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f704c122ef0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _renew_subs 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f704c09d6d0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70480011c0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7048005150 con 0x7f704c0a3eb0 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7043fff640 4 set_mon_vals no callback set 2024-04-25T23:59:54.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 10 monclient: dump: 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:54.942 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:54.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7034005090 con 0x7f704c0a3eb0 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f704800fef0 con 0x7f704c0a3eb0 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(137..137 src has 1..137) ==== 7135+0+0 (unknown 2392174386 0 0) 0x7f7048045430 con 0x7f704c0a3eb0 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.927+0000 7f7051345640 10 monclient: get_auth_request con 0x7f7030037f40 auth_method 0 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.931+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7048015990 con 0x7f704c0a3eb0 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.931+0000 7f70427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:54.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:54.931+0000 7f70427fc640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:55.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.095+0000 7f7053daa640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}] 2024-04-25T23:59:55.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.095+0000 7f7053daa640 10 monclient: _send_command 2 [{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}] 2024-04-25T23:59:55.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.095+0000 7f7053daa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:55.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.095+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"} v 0) -- 0x7f7034005b90 con 0x7f704c0a3eb0 2024-04-25T23:59:55.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.679+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}]=0 set pool 12 size to 2 v138) ==== 124+0+0 (unknown 3491643649 0 0) 0x7f7048015290 con 0x7f704c0a3eb0 2024-04-25T23:59:55.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.679+0000 7f70427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}] 2024-04-25T23:59:55.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.679+0000 7f70427fc640 10 monclient: _finish_command 2 = system:0 set pool 12 size to 2 2024-04-25T23:59:55.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.783+0000 7f7053daa640 10 start_mon_command cmd=[{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}] 2024-04-25T23:59:55.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.783+0000 7f7053daa640 10 monclient: _send_command 3 [{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}] 2024-04-25T23:59:55.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.783+0000 7f7053daa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:55.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:55.783+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"} v 0) -- 0x7f70340010a0 con 0x7f704c0a3eb0 2024-04-25T23:59:56.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.535+0000 7f70427fc640 1 -- 172.21.15.171:0/3306598857 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}]=0 set pool 12 size to 2 v139) ==== 124+0+0 (unknown 2752074814 0 0) 0x7f704801dde0 con 0x7f704c0a3eb0 2024-04-25T23:59:56.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.535+0000 7f70427fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool set", "pool": "cold", "var": "size", "val": "2"}] 2024-04-25T23:59:56.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.535+0000 7f70427fc640 10 monclient: _finish_command 3 = system:0 set pool 12 size to 2 2024-04-25T23:59:56.518 INFO:tasks.workunit.client.0.smithi171.stderr:set pool 12 size to 2 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 >> v1:172.21.15.171:6812/722422047 conn(0x7f7030037f40 legacy=0x7f703003a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 10 monclient: shutdown 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 >> v1:172.21.15.171:6791/0 conn(0x7f704c0a3eb0 legacy=0x7f704c121700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 shutdown_connections 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 >> 172.21.15.171:0/3306598857 conn(0x7f704c0a72a0 msgr2=0x7f704c0a4aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 shutdown_connections 2024-04-25T23:59:56.523 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.539+0000 7f7053daa640 1 -- 172.21.15.171:0/3306598857 wait complete. 2024-04-25T23:59:56.542 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create-compat 2024-04-25T23:59:56.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient: get_monmap_and_config 2024-04-25T23:59:56.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient: build_initial_monmap 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient: monmap: 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:56.683677+0000 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:56.683677+0000 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:56.663 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:56.664 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:56.664 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:56.664 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:56.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 1 Processor -- start 2024-04-25T23:59:56.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 1 -- start start 2024-04-25T23:59:56.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient: init 2024-04-25T23:59:56.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient: _add_conns ranks=[0,1,6,5,4,7,8,2,3] 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient(hunting): picked mon.noname-a con 0x7f0f9c072210 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient(hunting): picked mon.noname-f con 0x7f0f9c137e20 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient(hunting): picked mon.noname-d con 0x7f0f9c13e3a0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c072d00 con 0x7f0f9c072210 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c06faa0 con 0x7f0f9c137e20 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c072f20 con 0x7f0f9c13e3a0 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient(hunting): authenticate will time out at 1247.390642s 2024-04-25T23:59:56.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f99d9b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0f9c137e20 0x7f0f9c13cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56542/0 (socket says 172.21.15.171:56542) 2024-04-25T23:59:56.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f99d9b640 1 -- 172.21.15.171:0/1321694529 learned_addr learned my addr 172.21.15.171:0/1321694529 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:56.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1108666326 0 0) 0x7f0f9c06faa0 con 0x7f0f9c137e20 2024-04-25T23:59:56.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient(hunting): _negotiate 2024-04-25T23:59:56.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:56.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:56.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient(hunting): my global_id is 144559 2024-04-25T23:59:56.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f88003530 con 0x7f0f9c137e20 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1296918321 0 0) 0x7f0f88003530 con 0x7f0f9c137e20 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 >> v1:172.21.15.106:6792/0 conn(0x7f0f9c13e3a0 legacy=0x7f0f9c140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 >> v1:172.21.15.106:6789/0 conn(0x7f0f9c072210 legacy=0x7f0f9c0725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: _finish_hunting 0 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 monclient: found mon.noname-f 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c06f200 con 0x7f0f9c137e20 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: _finish_auth 0 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: _check_auth_tickets 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f8c0017c0 con 0x7f0f9c137e20 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:56.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: dump: 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:56.676 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 5 monclient: authenticate success, global_id 144559 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f8c001ab0 con 0x7f0f9c137e20 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0fa0f69640 4 set_mon_vals no callback set 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 1 -- 172.21.15.171:0/1321694529 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f8c004bf0 con 0x7f0f9c137e20 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.679+0000 7f0f9959a640 10 monclient: dump: 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:56.677 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: shutdown 2024-04-25T23:59:56.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/1321694529 >> v1:172.21.15.171:6789/0 conn(0x7f0f9c137e20 legacy=0x7f0f9c13cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/1321694529 shutdown_connections 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/1321694529 >> 172.21.15.171:0/1321694529 conn(0x7f0f9c0a2620 msgr2=0x7f0f9c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/1321694529 shutdown_connections 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/1321694529 wait complete. 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: build_initial_monmap 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: monmap: 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:56.679 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 Processor -- start 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- start start 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: init 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:56.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _add_conns ranks=[6,1,3,2,8,7,4,5,0] 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient(hunting): picked mon.noname-d con 0x7f0f9c072210 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient(hunting): picked mon.noname-f con 0x7f0f9c137e20 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient(hunting): picked mon.noname-g con 0x7f0f9c13e3a0 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c13d200 con 0x7f0f9c137e20 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c132a20 con 0x7f0f9c13e3a0 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f9c06ec60 con 0x7f0f9c072210 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient(hunting): authenticate will time out at 1247.393754s 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f99d9b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0f9c137e20 0x7f0f9c1d1970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56554/0 (socket says 172.21.15.171:56554) 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f99d9b640 1 -- 172.21.15.171:0/3972808634 learned_addr learned my addr 172.21.15.171:0/3972808634 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3489653854 0 0) 0x7f0f9c13d200 con 0x7f0f9c137e20 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:56.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): my global_id is 144568 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f7c003530 con 0x7f0f9c137e20 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505053754 0 0) 0x7f0f9c132a20 con 0x7f0f9c13e3a0 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): my global_id is 6339 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f9c13d200 con 0x7f0f9c13e3a0 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4034408971 0 0) 0x7f0f7c003530 con 0x7f0f9c137e20 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f9c132a20 con 0x7f0f9c137e20 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f8c001780 con 0x7f0f9c137e20 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:56.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:56.683 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1647264391 0 0) 0x7f0f9c13d200 con 0x7f0f9c13e3a0 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f7c003530 con 0x7f0f9c13e3a0 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355672267 0 0) 0x7f0f9c06ec60 con 0x7f0f9c072210 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): my global_id is 6189 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f9c13d200 con 0x7f0f9c072210 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f94001b70 con 0x7f0f9c13e3a0 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:56.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient(hunting): dump: 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:56.685 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3801696737 0 0) 0x7f0f9c132a20 con 0x7f0f9c137e20 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 >> v1:172.21.15.106:6792/0 conn(0x7f0f9c072210 legacy=0x7f0f9c12b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 >> v1:172.21.15.171:6790/0 conn(0x7f0f9c13e3a0 legacy=0x7f0f9c1d50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 monclient: found mon.f 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c06e710 con 0x7f0f9c137e20 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 5 monclient: authenticate success, global_id 144568 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _renew_subs 2024-04-25T23:59:56.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c13d4e0 con 0x7f0f9c137e20 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _renew_subs 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f9c13a810 con 0x7f0f9c137e20 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f8c001ab0 con 0x7f0f9c137e20 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f8c001ce0 con 0x7f0f9c137e20 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f93fff640 4 set_mon_vals no callback set 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 10 monclient: dump: 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:56.687 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0f8c0100f0 con 0x7f0f9c137e20 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:56.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:56.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f80005090 con 0x7f0f9c137e20 2024-04-25T23:59:56.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(139..139 src has 1..139) ==== 7135+0+0 (unknown 4103068537 0 0) 0x7f0f8c0453b0 con 0x7f0f9c137e20 2024-04-25T23:59:56.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.683+0000 7f0f9a59c640 10 monclient: get_auth_request con 0x7f0f7c037fd0 auth_method 0 2024-04-25T23:59:56.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.691+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0f8c0159d0 con 0x7f0f9c137e20 2024-04-25T23:59:56.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.691+0000 7f0f92ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:56.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.691+0000 7f0f92ffd640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:56.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.863+0000 7f0fa0f69640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:56.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.863+0000 7f0fa0f69640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:56.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.863+0000 7f0fa0f69640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:56.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:56.863+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7f0f80005380 con 0x7f0f9c137e20 2024-04-25T23:59:57.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.715+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 v140) ==== 82+0+0 (unknown 537863739 0 0) 0x7f0f8c0423c0 con 0x7f0f9c137e20 2024-04-25T23:59:57.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.715+0000 7f0f92ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:57.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.715+0000 7f0f92ffd640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:57.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.827+0000 7f0fa0f69640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:57.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.827+0000 7f0fa0f69640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:57.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.827+0000 7f0fa0f69640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-25T23:59:57.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.827+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7f0f80002220 con 0x7f0f9c137e20 2024-04-25T23:59:57.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.827+0000 7f0f92ffd640 1 -- 172.21.15.171:0/3972808634 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 compat weight-set already created v140) ==== 115+0+0 (unknown 1754517887 0 0) 0x7f0f8c042740 con 0x7f0f9c137e20 2024-04-25T23:59:57.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.827+0000 7f0f92ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-25T23:59:57.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.827+0000 7f0f92ffd640 10 monclient: _finish_command 3 = system:0 compat weight-set already created 2024-04-25T23:59:57.812 INFO:tasks.workunit.client.0.smithi171.stderr:compat weight-set already created 2024-04-25T23:59:57.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 >> v1:172.21.15.171:6812/722422047 conn(0x7f0f7c037fd0 legacy=0x7f0f7c03a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:57.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 10 monclient: shutdown 2024-04-25T23:59:57.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:57.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 >> v1:172.21.15.171:6789/0 conn(0x7f0f9c137e20 legacy=0x7f0f9c1d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:57.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 shutdown_connections 2024-04-25T23:59:57.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 >> 172.21.15.171:0/3972808634 conn(0x7f0f9c0a2620 msgr2=0x7f0f9c0a4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:57.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 shutdown_connections 2024-04-25T23:59:57.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.831+0000 7f0fa0f69640 1 -- 172.21.15.171:0/3972808634 wait complete. 2024-04-25T23:59:57.828 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create cool flat 2024-04-25T23:59:57.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.959+0000 7f9a812d0640 10 monclient: get_monmap_and_config 2024-04-25T23:59:57.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.959+0000 7f9a812d0640 10 monclient: build_initial_monmap 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient: monmap: 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:57.966555+0000 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:57.966555+0000 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:57.946 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:57.947 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:57.947 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:57.947 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:57.947 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:57.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 Processor -- start 2024-04-25T23:59:57.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- start start 2024-04-25T23:59:57.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient: init 2024-04-25T23:59:57.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:57.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient: _add_conns ranks=[8,0,6,5,7,3,2,1,4] 2024-04-25T23:59:57.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient(hunting): picked mon.noname-e con 0x7f9a7c075220 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:57.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient(hunting): picked mon.noname-a con 0x7f9a7c09aaf0 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient(hunting): picked mon.noname-d con 0x7f9a7c09aef0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c09d350 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c0a2a80 con 0x7f9a7c09aef0 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c09c520 con 0x7f9a7c075220 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient(hunting): authenticate will time out at 1248.673707s 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a7affd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f9a7c075220 legacy=0x7f9a7c09a3e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a7a7fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9a7c09aaf0 0x7f9a7c139950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:60926/0 (socket says 172.21.15.171:60926) 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a7a7fc640 1 -- 172.21.15.171:0/4279601894 learned_addr learned my addr 172.21.15.171:0/4279601894 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3315440305 0 0) 0x7f9a7c0a2a80 con 0x7f9a7c09aef0 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:57.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): my global_id is 6198 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a68003530 con 0x7f9a7c09aef0 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233610269 0 0) 0x7f9a64001050 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient(hunting): my global_id is 6255 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a7c0a2a80 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 365013628 0 0) 0x7f9a68003530 con 0x7f9a7c09aef0 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 >> v1:172.21.15.106:6793/0 conn(0x7f9a7c075220 legacy=0x7f9a7c09a3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 >> v1:172.21.15.106:6789/0 conn(0x7f9a7c09aaf0 legacy=0x7f9a7c139950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:57.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 monclient: found mon.noname-d 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c09c800 con 0x7f9a7c09aef0 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a74001b40 con 0x7f9a7c09aef0 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: dump: 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.957 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:57.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 5 monclient: authenticate success, global_id 6198 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a74001df0 con 0x7f9a7c09aef0 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 4 set_mon_vals no callback set 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 1 -- 172.21.15.171:0/4279601894 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a74003ce0 con 0x7f9a7c09aef0 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a79ffb640 10 monclient: dump: 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.959 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 10 monclient: shutdown 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:57.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- 172.21.15.171:0/4279601894 >> v1:172.21.15.106:6792/0 conn(0x7f9a7c09aef0 legacy=0x7f9a7c13d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- 172.21.15.171:0/4279601894 shutdown_connections 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- 172.21.15.171:0/4279601894 >> 172.21.15.171:0/4279601894 conn(0x7f9a7c0a6770 msgr2=0x7f9a7c0a6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- 172.21.15.171:0/4279601894 shutdown_connections 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.963+0000 7f9a812d0640 1 -- 172.21.15.171:0/4279601894 wait complete. 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: build_initial_monmap 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: monmap: 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:57.961 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 Processor -- start 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 -- start start 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: init 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:57.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _add_conns ranks=[4,5,6,7,1,3,2,8,0] 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient(hunting): picked mon.noname-c con 0x7f9a7c075220 addr v1:172.21.15.106:6791/0 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient(hunting): picked mon.noname-h con 0x7f9a7c09aaf0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient(hunting): picked mon.noname-d con 0x7f9a7c09aef0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c08d310 con 0x7f9a7c075220 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c1352e0 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a7c08d5f0 con 0x7f9a7c09aef0 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient(hunting): authenticate will time out at 1248.677423s 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a7a7fc640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f9a7c09aaf0 0x7f9a7c134bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33296/0 (socket says 172.21.15.171:33296) 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a7a7fc640 1 -- 172.21.15.171:0/1392137637 learned_addr learned my addr 172.21.15.171:0/1392137637 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2716088780 0 0) 0x7f9a7c1352e0 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:57.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): my global_id is 5999 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a5c003560 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 521445989 0 0) 0x7f9a5c003560 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a7c1352e0 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a64001b60 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): dump: 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:57.964 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974599287 0 0) 0x7f9a7c08d5f0 con 0x7f9a7c09aef0 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:57.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): my global_id is 6207 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a5c003560 con 0x7f9a7c09aef0 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 600700188 0 0) 0x7f9a7c08d310 con 0x7f9a7c075220 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _negotiate 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient(hunting): my global_id is 144670 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a7c08d5f0 con 0x7f9a7c075220 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3360495326 0 0) 0x7f9a7c1352e0 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 >> v1:172.21.15.106:6792/0 conn(0x7f9a7c09aef0 legacy=0x7f9a7c1d2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 >> v1:172.21.15.106:6791/0 conn(0x7f9a7c075220 legacy=0x7f9a7c1344c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: _finish_hunting 0 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 monclient: found mon.h 2024-04-25T23:59:57.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c08d030 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: _finish_auth 0 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: _check_auth_tickets 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 5 monclient: authenticate success, global_id 5999 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _renew_subs 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c08da10 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _renew_subs 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a7c099b00 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a64004b20 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9a64005090 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a797fa640 4 set_mon_vals no callback set 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 10 monclient: dump: 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:57.968 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9a64005230 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a60005090 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(140..140 src has 1..140) ==== 7467+0+0 (unknown 4137487582 0 0) 0x7f9a64045540 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.967+0000 7f9a7affd640 10 monclient: get_auth_request con 0x7f9a5c037a70 auth_method 0 2024-04-25T23:59:57.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.975+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9a7c09d350 con 0x7f9a7c09aaf0 2024-04-25T23:59:57.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.975+0000 7f9a737fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:57.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:57.975+0000 7f9a737fe640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:58.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.127+0000 7f9a812d0640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}] 2024-04-25T23:59:58.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.127+0000 7f9a812d0640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}] 2024-04-25T23:59:58.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.127+0000 7f9a812d0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:58.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.127+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"} v 0) -- 0x7f9a60005380 con 0x7f9a7c09aaf0 2024-04-25T23:59:58.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.735+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}]=0 v141) ==== 107+0+0 (unknown 1480991178 0 0) 0x7f9a64015830 con 0x7f9a7c09aaf0 2024-04-25T23:59:58.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.735+0000 7f9a737fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}] 2024-04-25T23:59:58.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.735+0000 7f9a737fe640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:58.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.839+0000 7f9a812d0640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}] 2024-04-25T23:59:58.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.839+0000 7f9a812d0640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}] 2024-04-25T23:59:58.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.839+0000 7f9a812d0640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:58.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.839+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"} v 0) -- 0x7f9a60005be0 con 0x7f9a7c09aaf0 2024-04-25T23:59:58.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.839+0000 7f9a737fe640 1 -- 172.21.15.171:0/1392137637 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}]=0 weight-set for pool 'cool' already created v141) ==== 149+0+0 (unknown 1978132493 0 0) 0x7f9a640194e0 con 0x7f9a7c09aaf0 2024-04-25T23:59:58.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.839+0000 7f9a737fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create", "pool": "cool", "mode": "flat"}] 2024-04-25T23:59:58.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.839+0000 7f9a737fe640 10 monclient: _finish_command 3 = system:0 weight-set for pool 'cool' already created 2024-04-25T23:59:58.824 INFO:tasks.workunit.client.0.smithi171.stderr:weight-set for pool 'cool' already created 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 >> v1:172.21.15.171:6812/722422047 conn(0x7f9a5c037a70 legacy=0x7f9a5c039f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 10 monclient: shutdown 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 >> v1:172.21.15.171:6791/0 conn(0x7f9a7c09aaf0 legacy=0x7f9a7c134bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 shutdown_connections 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 >> 172.21.15.171:0/1392137637 conn(0x7f9a7c0a6770 msgr2=0x7f9a7c0a1020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 shutdown_connections 2024-04-25T23:59:58.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.843+0000 7f9a812d0640 1 -- 172.21.15.171:0/1392137637 wait complete. 2024-04-25T23:59:58.842 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create cold positional 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: get_monmap_and_config 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: build_initial_monmap 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: monmap: 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:58.986940+0000 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:58.986940+0000 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:58.966 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:58.967 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:58.967 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:58.967 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:58.967 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:58.967 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:58.967 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:58.967 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:58.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 Processor -- start 2024-04-25T23:59:58.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- start start 2024-04-25T23:59:58.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: init 2024-04-25T23:59:58.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: _add_conns ranks=[3,1,6,4,8,5,7,0,2] 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient(hunting): picked mon.noname-g con 0x7f5968135a00 addr v1:172.21.15.171:6790/0 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient(hunting): picked mon.noname-f con 0x7f59680a1790 addr v1:172.21.15.171:6789/0 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient(hunting): picked mon.noname-d con 0x7f596813c130 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59680a1d80 con 0x7f59680a1790 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5968072f70 con 0x7f5968135a00 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5968072640 con 0x7f596813c130 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient(hunting): authenticate will time out at 1249.693901s 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596d568640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5968135a00 0x7f5968135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:33610/0 (socket says 172.21.15.171:33610) 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596d568640 1 -- 172.21.15.171:0/2771215310 learned_addr learned my addr 172.21.15.171:0/2771215310 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596cd67640 1 --1- 172.21.15.171:0/2771215310 >> v1:172.21.15.171:6789/0 conn(0x7f59680a1790 0x7f596813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56572/0 (socket says 172.21.15.171:56572) 2024-04-25T23:59:58.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2444737326 0 0) 0x7f5968072f70 con 0x7f5968135a00 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): my global_id is 6348 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5954003530 con 0x7f5968135a00 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787290912 0 0) 0x7f59680a1d80 con 0x7f59680a1790 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): _negotiate 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient(hunting): my global_id is 144577 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5968072f70 con 0x7f59680a1790 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4038206065 0 0) 0x7f5968072f70 con 0x7f59680a1790 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 >> v1:172.21.15.106:6792/0 conn(0x7f596813c130 legacy=0x7f596813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:58.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 >> v1:172.21.15.171:6790/0 conn(0x7f5968135a00 legacy=0x7f5968135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: _finish_hunting 0 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 monclient: found mon.noname-f 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5968072920 con 0x7f59680a1790 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: _finish_auth 0 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: _check_auth_tickets 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5958001740 con 0x7f59680a1790 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: dump: 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:58.976 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:58.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 5 monclient: authenticate success, global_id 144577 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5958001930 con 0x7f59680a1790 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 4 set_mon_vals no callback set 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 1 -- 172.21.15.171:0/2771215310 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59580047f0 con 0x7f59680a1790 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f595ffff640 10 monclient: dump: 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.978 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 10 monclient: shutdown 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- 172.21.15.171:0/2771215310 >> v1:172.21.15.171:6789/0 conn(0x7f59680a1790 legacy=0x7f596813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:58.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- 172.21.15.171:0/2771215310 shutdown_connections 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- 172.21.15.171:0/2771215310 >> 172.21.15.171:0/2771215310 conn(0x7f59680a2690 msgr2=0x7f59680a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- 172.21.15.171:0/2771215310 shutdown_connections 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.983+0000 7f596f7cc640 1 -- 172.21.15.171:0/2771215310 wait complete. 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: build_initial_monmap 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: monmap: 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:58.980 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 Processor -- start 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 -- start start 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: init 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _add_conns ranks=[0,2,5,4,8,7,6,1,3] 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient(hunting): picked mon.noname-a con 0x7f59680a1790 addr v1:172.21.15.106:6789/0 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient(hunting): picked mon.noname-b con 0x7f5968135a00 addr v1:172.21.15.106:6790/0 2024-04-25T23:59:58.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient(hunting): picked mon.noname-h con 0x7f596813c130 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596809fc40 con 0x7f59680a1790 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596809f6f0 con 0x7f5968135a00 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f596809d310 con 0x7f596813c130 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient(hunting): authenticate will time out at 1249.697168s 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596dd69640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f596813c130 0x7f59681d2720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33300/0 (socket says 172.21.15.171:33300) 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596dd69640 1 -- 172.21.15.171:0/4276712752 learned_addr learned my addr 172.21.15.171:0/4276712752 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 812719570 0 0) 0x7f596809d310 con 0x7f596813c130 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): my global_id is 6008 2024-04-25T23:59:58.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f594c003530 con 0x7f596813c130 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2095393575 0 0) 0x7f594c003530 con 0x7f596813c130 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f596809d310 con 0x7f596813c130 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5960001dc0 con 0x7f596813c130 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): dump: 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:58.983 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633864616 0 0) 0x7f596809f6f0 con 0x7f5968135a00 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): my global_id is 6032 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f594c003530 con 0x7f5968135a00 2024-04-25T23:59:58.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1475394136 0 0) 0x7f596809fc40 con 0x7f59680a1790 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _negotiate 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient(hunting): my global_id is 6264 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f596809f6f0 con 0x7f59680a1790 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 800732792 0 0) 0x7f596809d310 con 0x7f596813c130 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 >> v1:172.21.15.106:6790/0 conn(0x7f5968135a00 legacy=0x7f596812cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 >> v1:172.21.15.106:6789/0 conn(0x7f59680a1790 legacy=0x7f596812c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: _finish_hunting 0 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 monclient: found mon.h 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5968137040 con 0x7f596813c130 2024-04-25T23:59:58.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: _finish_auth 0 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: _check_auth_tickets 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 5 monclient: authenticate success, global_id 6008 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _renew_subs 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f596809eaa0 con 0x7f596813c130 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _renew_subs 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f596809ca40 con 0x7f596813c130 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5960003cd0 con 0x7f596813c130 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5960004240 con 0x7f596813c130 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:58.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595f7fe640 4 set_mon_vals no callback set 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 10 monclient: dump: 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:58.987 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5948005090 con 0x7f596813c130 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5960004460 con 0x7f596813c130 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(141..141 src has 1..141) ==== 7799+0+0 (unknown 3489033789 0 0) 0x7f59600459f0 con 0x7f596813c130 2024-04-25T23:59:58.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.987+0000 7f596d568640 10 monclient: get_auth_request con 0x7f594c037a60 auth_method 0 2024-04-25T23:59:58.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.991+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5960015bf0 con 0x7f596813c130 2024-04-25T23:59:58.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.991+0000 7f595dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:58.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:58.991+0000 7f595dffb640 10 monclient: _finish_command 1 = system:0 2024-04-25T23:59:59.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.151+0000 7f596f7cc640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}] 2024-04-25T23:59:59.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.151+0000 7f596f7cc640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}] 2024-04-25T23:59:59.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.151+0000 7f596f7cc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:59.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.151+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"} v 0) -- 0x7f5948005380 con 0x7f596813c130 2024-04-25T23:59:59.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.739+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}]=0 v142) ==== 113+0+0 (unknown 2952636617 0 0) 0x7f59600154f0 con 0x7f596813c130 2024-04-25T23:59:59.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.739+0000 7f595dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}] 2024-04-25T23:59:59.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.739+0000 7f595dffb640 10 monclient: _finish_command 2 = system:0 2024-04-25T23:59:59.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.847+0000 7f596f7cc640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}] 2024-04-25T23:59:59.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.847+0000 7f596f7cc640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}] 2024-04-25T23:59:59.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.847+0000 7f596f7cc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:59.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.847+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"} v 0) -- 0x7f5948005be0 con 0x7f596813c130 2024-04-25T23:59:59.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f595dffb640 1 -- 172.21.15.171:0/4276712752 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}]=0 weight-set for pool 'cold' already created v142) ==== 155+0+0 (unknown 174935603 0 0) 0x7f5960019840 con 0x7f596813c130 2024-04-25T23:59:59.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f595dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create", "pool": "cold", "mode": "positional"}] 2024-04-25T23:59:59.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f595dffb640 10 monclient: _finish_command 3 = system:0 weight-set for pool 'cold' already created 2024-04-25T23:59:59.834 INFO:tasks.workunit.client.0.smithi171.stderr:weight-set for pool 'cold' already created 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 >> v1:172.21.15.171:6812/722422047 conn(0x7f594c037a60 legacy=0x7f594c039f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 10 monclient: shutdown 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 >> v1:172.21.15.171:6791/0 conn(0x7f596813c130 legacy=0x7f59681d2720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 shutdown_connections 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 >> 172.21.15.171:0/4276712752 conn(0x7f59680a2690 msgr2=0x7f59680a0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 shutdown_connections 2024-04-25T23:59:59.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.851+0000 7f596f7cc640 1 -- 172.21.15.171:0/4276712752 wait complete. 2024-04-25T23:59:59.850 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm-device-class osd.0 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient: get_monmap_and_config 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient: build_initial_monmap 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient: monmap: 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:59:59.987890+0000 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:59:59.987890+0000 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:59.967 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:59.968 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:59.968 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:59.968 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:59.968 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:59.968 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:59.968 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:59.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 1 Processor -- start 2024-04-25T23:59:59.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 1 -- start start 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient: init 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient: _add_conns ranks=[6,5,7,1,2,4,0,8,3] 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient(hunting): picked mon.noname-d con 0x7fd5b4135bb0 addr v1:172.21.15.106:6792/0 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient(hunting): picked mon.noname-h con 0x7fd5b41356f0 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient(hunting): picked mon.noname-i con 0x7fd5b413c130 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b40a1da0 con 0x7fd5b41356f0 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b40a1fe0 con 0x7fd5b4135bb0 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b4072720 con 0x7fd5b413c130 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient(hunting): authenticate will time out at 1250.694753s 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b8e12640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fd5b413c130 0x7fd5b413e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36882/0 (socket says 172.21.15.171:36882) 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b8e12640 1 -- 172.21.15.171:0/2599750591 learned_addr learned my addr 172.21.15.171:0/2599750591 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2188649908 0 0) 0x7fd5b4072720 con 0x7fd5b413c130 2024-04-25T23:59:59.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): my global_id is 144484 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5a0003530 con 0x7fd5b413c130 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528612594 0 0) 0x7fd5b40a1da0 con 0x7fd5b41356f0 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): _negotiate 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient(hunting): my global_id is 6017 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5b4072720 con 0x7fd5b41356f0 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4023630040 0 0) 0x7fd5a0003530 con 0x7fd5b413c130 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 >> v1:172.21.15.106:6792/0 conn(0x7fd5b4135bb0 legacy=0x7fd5b4135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 >> v1:172.21.15.171:6791/0 conn(0x7fd5b41356f0 legacy=0x7fd5b413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:59.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: _finish_hunting 0 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 monclient: found mon.noname-i 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b40a17f0 con 0x7fd5b413c130 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: _finish_auth 0 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: _check_auth_tickets 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5a40017c0 con 0x7fd5b413c130 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: dump: 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:59.977 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:59.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 5 monclient: authenticate success, global_id 144484 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5a4001aa0 con 0x7fd5b413c130 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 10 monclient: get_monmap_and_config success 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 1 -- 172.21.15.171:0/2599750591 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5a4004bf0 con 0x7fd5b413c130 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5ba875640 4 set_mon_vals no callback set 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.983+0000 7fd5b2ffd640 10 monclient: dump: 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.979 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: shutdown 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-25T23:59:59.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/2599750591 >> v1:172.21.15.171:6792/0 conn(0x7fd5b413c130 legacy=0x7fd5b413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/2599750591 shutdown_connections 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/2599750591 >> 172.21.15.171:0/2599750591 conn(0x7fd5b40a2620 msgr2=0x7fd5b40a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/2599750591 shutdown_connections 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/2599750591 wait complete. 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: build_initial_monmap 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: monmap: 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-25T23:59:59.981 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 Processor -- start 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- start start 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: init 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _reopen_session rank -1 2024-04-25T23:59:59.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _add_conns ranks=[8,7,5,4,2,3,6,0,1] 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient(hunting): picked mon.noname-e con 0x7fd5b41356f0 addr v1:172.21.15.106:6793/0 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient(hunting): picked mon.noname-i con 0x7fd5b4135bb0 addr v1:172.21.15.171:6792/0 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient(hunting): picked mon.noname-h con 0x7fd5b413c130 addr v1:172.21.15.171:6791/0 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b409d9c0 con 0x7fd5b413c130 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b409dca0 con 0x7fd5b4135bb0 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5b409bbf0 con 0x7fd5b41356f0 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient(hunting): _renew_subs 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient(hunting): authenticate will time out at 1250.697731s 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b37fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fd5b4135bb0 0x7fd5b409b4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:36888/0 (socket says 172.21.15.171:36888) 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b37fe640 1 -- 172.21.15.171:0/3066762144 learned_addr learned my addr 172.21.15.171:0/3066762144 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b3fff640 1 -- 172.21.15.171:0/3066762144 >> v1:172.21.15.106:6793/0 conn(0x7fd5b41356f0 legacy=0x7fd5b409add0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1230144676 0 0) 0x7fd5b409d9c0 con 0x7fd5b413c130 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:59.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): my global_id is 6026 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd594003530 con 0x7fd5b413c130 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366714585 0 0) 0x7fd5b409dca0 con 0x7fd5b4135bb0 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): _negotiate 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): my global_id is 144493 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5b409d9c0 con 0x7fd5b4135bb0 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1179214155 0 0) 0x7fd594003530 con 0x7fd5b413c130 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5b409dca0 con 0x7fd5b413c130 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5a4004b30 con 0x7fd5b413c130 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-25T23:59:59.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:59.985 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1210320632 0 0) 0x7fd5b409d9c0 con 0x7fd5b4135bb0 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd594003530 con 0x7fd5b4135bb0 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd59c001a00 con 0x7fd5b4135bb0 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient(hunting): dump: 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.986 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4054819792 0 0) 0x7fd5b409dca0 con 0x7fd5b413c130 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 >> v1:172.21.15.106:6793/0 conn(0x7fd5b41356f0 legacy=0x7fd5b409add0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 >> v1:172.21.15.171:6792/0 conn(0x7fd5b4135bb0 legacy=0x7fd5b409b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T23:59:59.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: _finish_hunting 0 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 monclient: found mon.h 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5b4071ef0 con 0x7fd5b413c130 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: _finish_auth 0 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: _check_auth_tickets 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 5 monclient: authenticate success, global_id 6026 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _renew_subs 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5b40719a0 con 0x7fd5b413c130 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _renew_subs 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5b409d6e0 con 0x7fd5b413c130 2024-04-25T23:59:59.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5a4001070 con 0x7fd5b413c130 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: handle_config config(0 keys) 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5a4005150 con 0x7fd5b413c130 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b27fc640 4 set_mon_vals no callback set 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 10 monclient: dump: 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-25T23:59:59.989 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd598005090 con 0x7fd5b413c130 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd5a400fef0 con 0x7fd5b413c130 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(142..142 src has 1..142) ==== 8271+0+0 (unknown 4193528620 0 0) 0x7fd5a4045710 con 0x7fd5b413c130 2024-04-25T23:59:59.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.987+0000 7fd5b3fff640 10 monclient: get_auth_request con 0x7fd594037cf0 auth_method 0 2024-04-25T23:59:59.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.995+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd5a40158e0 con 0x7fd5b413c130 2024-04-25T23:59:59.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.995+0000 7fd5b0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-25T23:59:59.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-25T23:59:59.995+0000 7fd5b0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:00.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.155+0000 7fd5ba875640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:00.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.155+0000 7fd5ba875640 10 monclient: _send_command 2 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:00.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.155+0000 7fd5ba875640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:00.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.155+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["osd.0"]} v 0) -- 0x7fd598005b90 con 0x7fd5b413c130 2024-04-26T00:00:00.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.767+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}]=0 done removing class of osd(s): 0 v143) ==== 123+0+0 (unknown 980694632 0 0) 0x7fd5a40151e0 con 0x7fd5b413c130 2024-04-26T00:00:00.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.767+0000 7fd5b0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:00.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.767+0000 7fd5b0ff9640 10 monclient: _finish_command 2 = system:0 done removing class of osd(s): 0 2024-04-26T00:00:00.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.871+0000 7fd5ba875640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:00.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.871+0000 7fd5ba875640 10 monclient: _send_command 3 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:00.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.871+0000 7fd5ba875640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:00.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:00.871+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["osd.0"]} v 0) -- 0x7fd5980010a0 con 0x7fd5b413c130 2024-04-26T00:00:01.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.775+0000 7fd5b0ff9640 1 -- 172.21.15.171:0/3066762144 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}]=0 osd.0 belongs to no class, done removing class of osd(s): v144) ==== 149+0+0 (unknown 1730350939 0 0) 0x7fd5a40422c0 con 0x7fd5b413c130 2024-04-26T00:00:01.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.775+0000 7fd5b0ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:01.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.775+0000 7fd5b0ff9640 10 monclient: _finish_command 3 = system:0 osd.0 belongs to no class, done removing class of osd(s): 2024-04-26T00:00:01.759 INFO:tasks.workunit.client.0.smithi171.stderr:osd.0 belongs to no class, done removing class of osd(s): 2024-04-26T00:00:01.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 >> v1:172.21.15.171:6812/722422047 conn(0x7fd594037cf0 legacy=0x7fd59403a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:01.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 10 monclient: shutdown 2024-04-26T00:00:01.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:01.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 >> v1:172.21.15.171:6791/0 conn(0x7fd5b413c130 legacy=0x7fd5b41d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:01.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 shutdown_connections 2024-04-26T00:00:01.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 >> 172.21.15.171:0/3066762144 conn(0x7fd5b40a2620 msgr2=0x7fd5b413b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:01.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 shutdown_connections 2024-04-26T00:00:01.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.779+0000 7fd5ba875640 1 -- 172.21.15.171:0/3066762144 wait complete. 2024-04-26T00:00:01.785 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight-compat osd.0 10.5 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.923+0000 7fda6cf01640 10 monclient: get_monmap_and_config 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.923+0000 7fda6cf01640 10 monclient: build_initial_monmap 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.923+0000 7fda6cf01640 10 monclient: monmap: 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:01.930153+0000 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:01.930153+0000 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:01.909 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:01.910 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:01.910 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:01.910 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:01.910 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:01.910 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:01.910 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:01.910 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 Processor -- start 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- start start 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient: init 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient: _add_conns ranks=[1,4,2,6,3,7,0,5,8] 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient(hunting): picked mon.noname-f con 0x7fda68135a00 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient(hunting): picked mon.noname-c con 0x7fda680a1790 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:01.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient(hunting): picked mon.noname-b con 0x7fda6813c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda680a1d80 con 0x7fda68135a00 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda68072f70 con 0x7fda6813c130 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda68072640 con 0x7fda680a1790 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient(hunting): authenticate will time out at 1252.637269s 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6659c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fda68135a00 0x7fda68135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36272/0 (socket says 172.21.15.171:36272) 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6659c640 1 -- 172.21.15.171:0/248402279 learned_addr learned my addr 172.21.15.171:0/248402279 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984605331 0 0) 0x7fda680a1d80 con 0x7fda68135a00 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient(hunting): my global_id is 144586 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda50003530 con 0x7fda68135a00 2024-04-26T00:00:01.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2641398971 0 0) 0x7fda50003530 con 0x7fda68135a00 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 >> v1:172.21.15.106:6791/0 conn(0x7fda680a1790 legacy=0x7fda6813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 >> v1:172.21.15.106:6790/0 conn(0x7fda6813c130 legacy=0x7fda6813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: _finish_hunting 0 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 monclient: found mon.noname-f 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68072920 con 0x7fda68135a00 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: _finish_auth 0 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: _check_auth_tickets 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda580017c0 con 0x7fda68135a00 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:01.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: dump: 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:01.919 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 5 monclient: authenticate success, global_id 144586 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda58001ab0 con 0x7fda68135a00 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 1 -- 172.21.15.171:0/248402279 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda58004bf0 con 0x7fda68135a00 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 4 set_mon_vals no callback set 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6559a640 10 monclient: dump: 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.920 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient: shutdown 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:01.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- 172.21.15.171:0/248402279 >> v1:172.21.15.171:6789/0 conn(0x7fda68135a00 legacy=0x7fda68135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:01.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- 172.21.15.171:0/248402279 shutdown_connections 2024-04-26T00:00:01.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- 172.21.15.171:0/248402279 >> 172.21.15.171:0/248402279 conn(0x7fda680a2690 msgr2=0x7fda680a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:01.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- 172.21.15.171:0/248402279 shutdown_connections 2024-04-26T00:00:01.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 -- 172.21.15.171:0/248402279 wait complete. 2024-04-26T00:00:01.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient: build_initial_monmap 2024-04-26T00:00:01.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 10 monclient: monmap: 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:01.923 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.927+0000 7fda6cf01640 1 Processor -- start 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 1 -- start start 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: init 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _add_conns ranks=[6,5,0,7,8,2,3,4,1] 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient(hunting): picked mon.noname-d con 0x7fda680a1790 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient(hunting): picked mon.noname-h con 0x7fda68135a00 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient(hunting): picked mon.noname-a con 0x7fda6813c130 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda680713f0 con 0x7fda6813c130 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda681354f0 con 0x7fda68135a00 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda6809fc40 con 0x7fda680a1790 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:01.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient(hunting): authenticate will time out at 1252.640643s 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda65d9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fda68135a00 0x7fda681d1c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40406/0 (socket says 172.21.15.171:40406) 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda65d9b640 1 -- 172.21.15.171:0/1173739181 learned_addr learned my addr 172.21.15.171:0/1173739181 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568697933 0 0) 0x7fda681354f0 con 0x7fda68135a00 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): my global_id is 6035 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda48003530 con 0x7fda68135a00 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3574411407 0 0) 0x7fda48003530 con 0x7fda68135a00 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda681354f0 con 0x7fda68135a00 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda5c001a50 con 0x7fda68135a00 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:01.925 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:01.926 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933808123 0 0) 0x7fda680713f0 con 0x7fda6813c130 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): my global_id is 6273 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda48003530 con 0x7fda6813c130 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1807284825 0 0) 0x7fda6809fc40 con 0x7fda680a1790 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient(hunting): my global_id is 6234 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda680713f0 con 0x7fda680a1790 2024-04-26T00:00:01.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1094911224 0 0) 0x7fda681354f0 con 0x7fda68135a00 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 >> v1:172.21.15.106:6792/0 conn(0x7fda680a1790 legacy=0x7fda6813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 >> v1:172.21.15.106:6789/0 conn(0x7fda6813c130 legacy=0x7fda681d5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 monclient: found mon.h 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda68071110 con 0x7fda68135a00 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 5 monclient: authenticate success, global_id 6035 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _renew_subs 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda6813b2a0 con 0x7fda68135a00 2024-04-26T00:00:01.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _renew_subs 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fda6806ff40 con 0x7fda68135a00 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda5c003950 con 0x7fda68135a00 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda5c003ec0 con 0x7fda68135a00 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda64d99640 4 set_mon_vals no callback set 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 10 monclient: dump: 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:01.929 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:01.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:01.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda4c005090 con 0x7fda68135a00 2024-04-26T00:00:01.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fda5c0040e0 con 0x7fda68135a00 2024-04-26T00:00:01.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(144..144 src has 1..144) ==== 8239+0+0 (unknown 3077123923 0 0) 0x7fda5c0458a0 con 0x7fda68135a00 2024-04-26T00:00:01.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.931+0000 7fda6659c640 10 monclient: get_auth_request con 0x7fda480379f0 auth_method 0 2024-04-26T00:00:01.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.935+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fda5c0158e0 con 0x7fda68135a00 2024-04-26T00:00:01.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.935+0000 7fda56ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:01.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:01.935+0000 7fda56ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:02.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.103+0000 7fda6cf01640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}] 2024-04-26T00:00:02.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.103+0000 7fda6cf01640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}] 2024-04-26T00:00:02.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.103+0000 7fda6cf01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:02.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.103+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]} v 0) -- 0x7fda4c005380 con 0x7fda68135a00 2024-04-26T00:00:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.791+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}]=0 v145) ==== 119+0+0 (unknown 4140392404 0 0) 0x7fda5c0151e0 con 0x7fda68135a00 2024-04-26T00:00:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.791+0000 7fda56ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}] 2024-04-26T00:00:02.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.791+0000 7fda56ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:02.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.903+0000 7fda6cf01640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}] 2024-04-26T00:00:02.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.903+0000 7fda6cf01640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}] 2024-04-26T00:00:02.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.903+0000 7fda6cf01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:02.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:02.903+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]} v 0) -- 0x7fda4c005c00 con 0x7fda68135a00 2024-04-26T00:00:03.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda56ffd640 1 -- 172.21.15.171:0/1173739181 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}]=0 v146) ==== 119+0+0 (unknown 4230661651 0 0) 0x7fda5c019530 con 0x7fda68135a00 2024-04-26T00:00:03.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda56ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [10.5]}] 2024-04-26T00:00:03.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda56ffd640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 >> v1:172.21.15.171:6812/722422047 conn(0x7fda480379f0 legacy=0x7fda48039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda6cf01640 10 monclient: shutdown 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda6cf01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 >> v1:172.21.15.171:6791/0 conn(0x7fda68135a00 legacy=0x7fda681d1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 shutdown_connections 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.823+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 >> 172.21.15.171:0/1173739181 conn(0x7fda680a2690 msgr2=0x7fda6812f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.827+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 shutdown_connections 2024-04-26T00:00:03.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.827+0000 7fda6cf01640 1 -- 172.21.15.171:0/1173739181 wait complete. 2024-04-26T00:00:03.830 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight cool osd.0 11.5 2024-04-26T00:00:03.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient: get_monmap_and_config 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient: build_initial_monmap 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient: monmap: 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:03.971893+0000 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:03.971893+0000 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:03.951 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:03.952 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:03.952 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:03.952 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:03.952 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:03.952 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:03.952 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:03.952 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 1 Processor -- start 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 1 -- start start 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient: init 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient: _add_conns ranks=[8,5,2,0,7,1,6,3,4] 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient(hunting): picked mon.noname-e con 0x7f331c135a00 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient(hunting): picked mon.noname-h con 0x7f331c0a1790 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient(hunting): picked mon.noname-b con 0x7f331c13c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c0a1d80 con 0x7f331c13c130 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c072f70 con 0x7f331c0a1790 2024-04-26T00:00:03.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c072640 con 0x7f331c135a00 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient(hunting): authenticate will time out at 1254.678788s 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331b7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f331c0a1790 0x7f331c13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40420/0 (socket says 172.21.15.171:40420) 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331b7fe640 1 -- 172.21.15.171:0/4165494381 learned_addr learned my addr 172.21.15.171:0/4165494381 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331bfff640 1 -- 172.21.15.171:0/4165494381 >> v1:172.21.15.106:6793/0 conn(0x7f331c135a00 legacy=0x7f331c135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 95659361 0 0) 0x7f331c072f70 con 0x7f331c0a1790 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient(hunting): my global_id is 6044 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3308003530 con 0x7f331c0a1790 2024-04-26T00:00:03.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1335142684 0 0) 0x7f3308003530 con 0x7f331c0a1790 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 >> v1:172.21.15.106:6793/0 conn(0x7f331c135a00 legacy=0x7f331c135de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 >> v1:172.21.15.106:6790/0 conn(0x7f331c13c130 legacy=0x7f331c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 monclient: found mon.noname-h 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c072920 con 0x7f331c0a1790 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: _finish_auth 0 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f33040017c0 con 0x7f331c0a1790 2024-04-26T00:00:03.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: dump: 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:03.963 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 5 monclient: authenticate success, global_id 6044 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3304001ab0 con 0x7f331c0a1790 2024-04-26T00:00:03.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 1 -- 172.21.15.171:0/4165494381 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3304004bf0 con 0x7f331c0a1790 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f33226b7640 4 set_mon_vals no callback set 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.967+0000 7f331affd640 10 monclient: dump: 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:03.965 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:03.966 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: shutdown 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- 172.21.15.171:0/4165494381 >> v1:172.21.15.171:6791/0 conn(0x7f331c0a1790 legacy=0x7f331c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- 172.21.15.171:0/4165494381 shutdown_connections 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- 172.21.15.171:0/4165494381 >> 172.21.15.171:0/4165494381 conn(0x7f331c0a2690 msgr2=0x7f331c0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:03.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- 172.21.15.171:0/4165494381 shutdown_connections 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- 172.21.15.171:0/4165494381 wait complete. 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: build_initial_monmap 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: monmap: 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:03.968 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 Processor -- start 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- start start 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: init 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: _add_conns ranks=[6,4,8,2,0,3,1,7,5] 2024-04-26T00:00:03.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient(hunting): picked mon.noname-d con 0x7f331c0a1790 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient(hunting): picked mon.noname-c con 0x7f331c135a00 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient(hunting): picked mon.noname-e con 0x7f331c13c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c09bb60 con 0x7f331c135a00 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c09e450 con 0x7f331c0a1790 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f331c09fc40 con 0x7f331c13c130 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient(hunting): authenticate will time out at 1254.681950s 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3320c54640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f331c13c130 legacy=0x7f331c1d4890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f331b7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f331c135a00 0x7f331c09b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:54150/0 (socket says 172.21.15.171:54150) 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f331b7fe640 1 -- 172.21.15.171:0/2344865772 learned_addr learned my addr 172.21.15.171:0/2344865772 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 308232534 0 0) 0x7f331c09bb60 con 0x7f331c135a00 2024-04-26T00:00:03.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): my global_id is 144688 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32fc003530 con 0x7f331c135a00 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1476745845 0 0) 0x7f331c09e450 con 0x7f331c0a1790 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): my global_id is 6243 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f331c09bb60 con 0x7f331c0a1790 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 30153886 0 0) 0x7f32fc003530 con 0x7f331c135a00 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f331c09e450 con 0x7f331c135a00 2024-04-26T00:00:03.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3304001780 con 0x7f331c135a00 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:03.972 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3823423037 0 0) 0x7f331c09bb60 con 0x7f331c0a1790 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32fc003530 con 0x7f331c0a1790 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3314004620 con 0x7f331c0a1790 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:03.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:03.974 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3992918425 0 0) 0x7f331c09e450 con 0x7f331c135a00 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 >> v1:172.21.15.106:6793/0 conn(0x7f331c13c130 legacy=0x7f331c1d4890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 >> v1:172.21.15.106:6792/0 conn(0x7f331c0a1790 legacy=0x7f331c09ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 monclient: found mon.c 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:03.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f331c09f6f0 con 0x7f331c135a00 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 5 monclient: authenticate success, global_id 144688 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: _renew_subs 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f331c09de90 con 0x7f331c135a00 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: _renew_subs 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f331c09c9d0 con 0x7f331c135a00 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3304004b50 con 0x7f331c135a00 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:03.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f33040051b0 con 0x7f331c135a00 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f331a7fc640 4 set_mon_vals no callback set 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.971+0000 7f3318ff9640 10 monclient: dump: 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:03.977 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.975+0000 7f33226b7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.975+0000 7f33226b7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.975+0000 7f33226b7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:03.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.975+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3300005090 con 0x7f331c135a00 2024-04-26T00:00:03.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.975+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f330400ff50 con 0x7f331c135a00 2024-04-26T00:00:03.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.975+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(146..146 src has 1..146) ==== 8421+0+0 (unknown 2462494597 0 0) 0x7f33040458b0 con 0x7f331c135a00 2024-04-26T00:00:03.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.975+0000 7f331bfff640 10 monclient: get_auth_request con 0x7f32fc037d80 auth_method 0 2024-04-26T00:00:03.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.987+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3304015960 con 0x7f331c135a00 2024-04-26T00:00:03.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.987+0000 7f3318ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:03.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:03.987+0000 7f3318ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:04.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.155+0000 7f33226b7640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}] 2024-04-26T00:00:04.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.155+0000 7f33226b7640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}] 2024-04-26T00:00:04.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.155+0000 7f33226b7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:04.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.155+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]} v 0) -- 0x7f3300005380 con 0x7f331c135a00 2024-04-26T00:00:04.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.831+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}]=0 v147) ==== 128+0+0 (unknown 3531060156 0 0) 0x7f3304015260 con 0x7f331c135a00 2024-04-26T00:00:04.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.831+0000 7f3318ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}] 2024-04-26T00:00:04.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.831+0000 7f3318ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:04.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.943+0000 7f33226b7640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}] 2024-04-26T00:00:04.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.943+0000 7f33226b7640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}] 2024-04-26T00:00:04.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.943+0000 7f33226b7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:04.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:04.943+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]} v 0) -- 0x7f3300001150 con 0x7f331c135a00 2024-04-26T00:00:05.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.859+0000 7f3318ff9640 1 -- 172.21.15.171:0/2344865772 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}]=0 v148) ==== 128+0+0 (unknown 3412569123 0 0) 0x7f3304040b10 con 0x7f331c135a00 2024-04-26T00:00:05.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.859+0000 7f3318ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [11.5]}] 2024-04-26T00:00:05.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.859+0000 7f3318ff9640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:05.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.863+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 >> v1:172.21.15.171:6812/722422047 conn(0x7f32fc037d80 legacy=0x7f32fc03a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:05.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.863+0000 7f33226b7640 10 monclient: shutdown 2024-04-26T00:00:05.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.863+0000 7f33226b7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:05.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.863+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 >> v1:172.21.15.106:6791/0 conn(0x7f331c135a00 legacy=0x7f331c09b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:05.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.867+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 shutdown_connections 2024-04-26T00:00:05.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.867+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 >> 172.21.15.171:0/2344865772 conn(0x7f331c0a2690 msgr2=0x7f331c1317b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:05.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.867+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 shutdown_connections 2024-04-26T00:00:05.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:05.867+0000 7f33226b7640 1 -- 172.21.15.171:0/2344865772 wait complete. 2024-04-26T00:00:05.870 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight cold osd.0 12.5 12.4 2024-04-26T00:00:05.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient: get_monmap_and_config 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient: build_initial_monmap 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient: monmap: 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:06.012871+0000 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:06.012871+0000 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:05.992 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:05.993 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:06.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 1 Processor -- start 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 1 -- start start 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient: init 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient: _add_conns ranks=[3,7,1,8,6,4,2,5,0] 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient(hunting): picked mon.noname-g con 0x7f89ac075220 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient(hunting): picked mon.noname-i con 0x7f89ac0a2490 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient(hunting): picked mon.noname-f con 0x7f89ac0a28b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac0758e0 con 0x7f89ac0a28b0 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac09a7f0 con 0x7f89ac075220 2024-04-26T00:00:06.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac09aad0 con 0x7f89ac0a2490 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89b272a640 10 monclient(hunting): authenticate will time out at 1256.719724s 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89ab7fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f89ac0a2490 0x7f89ac13a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46216/0 (socket says 172.21.15.171:46216) 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.007+0000 7f89ab7fe640 1 -- 172.21.15.171:0/2595598725 learned_addr learned my addr 172.21.15.171:0/2595598725 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632924370 0 0) 0x7f89ac09aad0 con 0x7f89ac0a2490 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): my global_id is 144502 2024-04-26T00:00:06.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8994003530 con 0x7f89ac0a2490 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1898356010 0 0) 0x7f89ac0758e0 con 0x7f89ac0a28b0 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): my global_id is 144595 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89ac09aad0 con 0x7f89ac0a28b0 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482391247 0 0) 0x7f89ac09a7f0 con 0x7f89ac075220 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient(hunting): my global_id is 6357 2024-04-26T00:00:06.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89ac0758e0 con 0x7f89ac075220 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1384312117 0 0) 0x7f8994003530 con 0x7f89ac0a2490 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 >> v1:172.21.15.171:6790/0 conn(0x7f89ac075220 legacy=0x7f89ac0a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 >> v1:172.21.15.171:6789/0 conn(0x7f89ac0a28b0 legacy=0x7f89ac13e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 monclient: found mon.noname-i 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac09a510 con 0x7f89ac0a2490 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:06.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89a0001800 con 0x7f89ac0a2490 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: dump: 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:06.006 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 5 monclient: authenticate success, global_id 144502 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89a0001a60 con 0x7f89ac0a2490 2024-04-26T00:00:06.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 1 -- 172.21.15.171:0/2595598725 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89a0004bf0 con 0x7f89ac0a2490 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89aaffd640 10 monclient: dump: 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:06.008 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 4 set_mon_vals no callback set 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient: shutdown 2024-04-26T00:00:06.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- 172.21.15.171:0/2595598725 >> v1:172.21.15.171:6792/0 conn(0x7f89ac0a2490 legacy=0x7f89ac13a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- 172.21.15.171:0/2595598725 shutdown_connections 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- 172.21.15.171:0/2595598725 >> 172.21.15.171:0/2595598725 conn(0x7f89ac0a2e70 msgr2=0x7f89ac0a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- 172.21.15.171:0/2595598725 shutdown_connections 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- 172.21.15.171:0/2595598725 wait complete. 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient: build_initial_monmap 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient: monmap: 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:06.010 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:06.011 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 Processor -- start 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- start start 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient: init 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient: _add_conns ranks=[4,8,0,2,3,7,6,5,1] 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient(hunting): picked mon.noname-c con 0x7f89ac075220 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient(hunting): picked mon.noname-e con 0x7f89ac0a2490 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient(hunting): picked mon.noname-a con 0x7f89ac0a28b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac13e4d0 con 0x7f89ac0a28b0 2024-04-26T00:00:06.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac0a01a0 con 0x7f89ac075220 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac09fde0 con 0x7f89ac0a2490 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b272a640 10 monclient(hunting): authenticate will time out at 1256.723263s 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89ab7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f89ac0a2490 legacy=0x7f89ac1cf950 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b0cc7640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f89ac0a28b0 0x7f89ac1d3080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:52068/0 (socket says 172.21.15.171:52068) 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89abfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f89ac075220 0x7f89ac135460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:54180/0 (socket says 172.21.15.171:54180) 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.011+0000 7f89b0cc7640 1 -- 172.21.15.171:0/3346987731 learned_addr learned my addr 172.21.15.171:0/3346987731 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460512766 0 0) 0x7f89ac0a01a0 con 0x7f89ac075220 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:06.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): my global_id is 144697 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8998003530 con 0x7f89ac075220 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148162466 0 0) 0x7f89ac13e4d0 con 0x7f89ac0a28b0 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): my global_id is 6282 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89ac0a01a0 con 0x7f89ac0a28b0 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3427172815 0 0) 0x7f8998003530 con 0x7f89ac075220 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89ac13e4d0 con 0x7f89ac075220 2024-04-26T00:00:06.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f899c001a80 con 0x7f89ac075220 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:06.015 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 649057719 0 0) 0x7f89ac0a01a0 con 0x7f89ac0a28b0 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8998003530 con 0x7f89ac0a28b0 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89a4001d20 con 0x7f89ac0a28b0 2024-04-26T00:00:06.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:06.017 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3057243302 0 0) 0x7f89ac13e4d0 con 0x7f89ac075220 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 >> v1:172.21.15.106:6793/0 conn(0x7f89ac0a2490 legacy=0x7f89ac1cf950 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 >> v1:172.21.15.106:6789/0 conn(0x7f89ac0a28b0 legacy=0x7f89ac1d3080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:06.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:06.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 monclient: found mon.c 2024-04-26T00:00:06.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:06.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:06.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac1c4b70 con 0x7f89ac075220 2024-04-26T00:00:06.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:06.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:06.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 5 monclient: authenticate success, global_id 144697 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 10 monclient: _renew_subs 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac12bc20 con 0x7f89ac075220 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 10 monclient: _renew_subs 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f89ac13cec0 con 0x7f89ac075220 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f899c0038d0 con 0x7f89ac075220 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f899c003dc0 con 0x7f89ac075220 2024-04-26T00:00:06.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89aa7fc640 4 set_mon_vals no callback set 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 10 monclient: dump: 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:06.021 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:06.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:06.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f898c005090 con 0x7f89ac075220 2024-04-26T00:00:06.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f899c003f60 con 0x7f89ac075220 2024-04-26T00:00:06.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(148..148 src has 1..148) ==== 8396+0+0 (unknown 2989147716 0 0) 0x7f899c045720 con 0x7f89ac075220 2024-04-26T00:00:06.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.015+0000 7f89ab7fe640 10 monclient: get_auth_request con 0x7f8998037d70 auth_method 0 2024-04-26T00:00:06.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.027+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f89ac13cec0 con 0x7f89ac075220 2024-04-26T00:00:06.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.027+0000 7f89a8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:06.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.027+0000 7f89a8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:06.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.199+0000 7f89b272a640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}] 2024-04-26T00:00:06.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.199+0000 7f89b272a640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}] 2024-04-26T00:00:06.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.199+0000 7f89b272a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:06.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.199+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]} v 0) -- 0x7f898c005380 con 0x7f89ac075220 2024-04-26T00:00:06.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.535+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}]=0 v149) ==== 134+0+0 (unknown 962590776 0 0) 0x7f899c0156c0 con 0x7f89ac075220 2024-04-26T00:00:06.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.535+0000 7f89a8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}] 2024-04-26T00:00:06.519 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.535+0000 7f89a8ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:06.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.643+0000 7f89b272a640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}] 2024-04-26T00:00:06.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.643+0000 7f89b272a640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}] 2024-04-26T00:00:06.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.643+0000 7f89b272a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:06.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:06.643+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]} v 0) -- 0x7f898c001150 con 0x7f89ac075220 2024-04-26T00:00:07.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.539+0000 7f89a8ff9640 1 -- 172.21.15.171:0/3346987731 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}]=0 v150) ==== 134+0+0 (unknown 796944355 0 0) 0x7f899c014fc0 con 0x7f89ac075220 2024-04-26T00:00:07.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.539+0000 7f89a8ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [12.5, 12.4]}] 2024-04-26T00:00:07.522 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.539+0000 7f89a8ff9640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 >> v1:172.21.15.171:6812/722422047 conn(0x7f8998037d70 legacy=0x7f899803a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 10 monclient: shutdown 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 >> v1:172.21.15.106:6791/0 conn(0x7f89ac075220 legacy=0x7f89ac135460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 shutdown_connections 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 >> 172.21.15.171:0/3346987731 conn(0x7f89ac0a2e70 msgr2=0x7f89ac13ee80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 shutdown_connections 2024-04-26T00:00:07.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.543+0000 7f89b272a640 1 -- 172.21.15.171:0/3346987731 wait complete. 2024-04-26T00:00:07.547 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush set-device-class fish osd.0 2024-04-26T00:00:07.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.679+0000 7f9752493640 10 monclient: get_monmap_and_config 2024-04-26T00:00:07.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.679+0000 7f9752493640 10 monclient: build_initial_monmap 2024-04-26T00:00:07.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.679+0000 7f9752493640 10 monclient: monmap: 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:07.685012+0000 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:07.685012+0000 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:07.665 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:07.666 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:07.666 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:07.666 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:07.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.679+0000 7f9752493640 1 Processor -- start 2024-04-26T00:00:07.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- start start 2024-04-26T00:00:07.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: init 2024-04-26T00:00:07.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: _add_conns ranks=[3,5,1,8,2,6,0,4,7] 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient(hunting): picked mon.noname-g con 0x7f974c0a52a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient(hunting): picked mon.noname-h con 0x7f974c0a49c0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient(hunting): picked mon.noname-f con 0x7f974c13e2a0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c0a5d90 con 0x7f974c13e2a0 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c0a18e0 con 0x7f974c0a52a0 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c0a28f0 con 0x7f974c0a49c0 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient(hunting): authenticate will time out at 1258.393030s 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9750a30640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f974c13e2a0 0x7f974c140690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36294/0 (socket says 172.21.15.171:36294) 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9750a30640 1 -- 172.21.15.171:0/3301688513 learned_addr learned my addr 172.21.15.171:0/3301688513 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:07.674 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027782485 0 0) 0x7f974c0a18e0 con 0x7f974c0a52a0 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): my global_id is 6366 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9738003530 con 0x7f974c0a52a0 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2272095209 0 0) 0x7f974c0a28f0 con 0x7f974c0a49c0 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): my global_id is 6053 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f974c0a18e0 con 0x7f974c0a49c0 2024-04-26T00:00:07.675 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4029146341 0 0) 0x7f97440014a0 con 0x7f974c13e2a0 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient(hunting): my global_id is 144604 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f974c0a28f0 con 0x7f974c13e2a0 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3776570069 0 0) 0x7f9738003530 con 0x7f974c0a52a0 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 >> v1:172.21.15.171:6791/0 conn(0x7f974c0a49c0 legacy=0x7f974c13cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 >> v1:172.21.15.171:6789/0 conn(0x7f974c13e2a0 legacy=0x7f974c140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:07.676 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 monclient: found mon.noname-g 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c0a2bd0 con 0x7f974c0a52a0 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f973c0017c0 con 0x7f974c0a52a0 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 5 monclient: authenticate success, global_id 6366 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:07.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: dump: 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f973c0019f0 con 0x7f974c0a52a0 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 1 -- 172.21.15.171:0/3301688513 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f973c003960 con 0x7f974c0a52a0 2024-04-26T00:00:07.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:07.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:07.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f974b7fe640 10 monclient: dump: 2024-04-26T00:00:07.680 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:07.680 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:07.680 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.680 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.680 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 4 set_mon_vals no callback set 2024-04-26T00:00:07.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: shutdown 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- 172.21.15.171:0/3301688513 >> v1:172.21.15.171:6790/0 conn(0x7f974c0a52a0 legacy=0x7f974c0a5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- 172.21.15.171:0/3301688513 shutdown_connections 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- 172.21.15.171:0/3301688513 >> 172.21.15.171:0/3301688513 conn(0x7f974c0a6c90 msgr2=0x7f974c0a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- 172.21.15.171:0/3301688513 shutdown_connections 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- 172.21.15.171:0/3301688513 wait complete. 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: build_initial_monmap 2024-04-26T00:00:07.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: monmap: 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:07.683 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 Processor -- start 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 1 -- start start 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: init 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.683+0000 7f9752493640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient: _add_conns ranks=[5,3,8,7,4,6,2,1,0] 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient(hunting): picked mon.noname-h con 0x7f974c0a49c0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:07.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient(hunting): picked mon.noname-g con 0x7f974c0a52a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient(hunting): picked mon.noname-e con 0x7f974c13e2a0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c1cd4c0 con 0x7f974c0a52a0 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c13beb0 con 0x7f974c0a49c0 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f974c13c190 con 0x7f974c13e2a0 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient(hunting): authenticate will time out at 1258.396084s 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f974bfff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f974c0a49c0 0x7f974c1cc6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40444/0 (socket says 172.21.15.171:40444) 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f974bfff640 1 -- 172.21.15.171:0/1354168549 learned_addr learned my addr 172.21.15.171:0/1354168549 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9750a30640 1 -- 172.21.15.171:0/1354168549 >> v1:172.21.15.106:6793/0 conn(0x7f974c13e2a0 legacy=0x7f974c1d4bf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2815842926 0 0) 0x7f974c13beb0 con 0x7f974c0a49c0 2024-04-26T00:00:07.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): my global_id is 6062 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f972c003530 con 0x7f974c0a49c0 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80788135 0 0) 0x7f974c1cd4c0 con 0x7f974c0a52a0 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): my global_id is 6375 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f974c13beb0 con 0x7f974c0a52a0 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 315117366 0 0) 0x7f974c13beb0 con 0x7f974c0a52a0 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f974c1cd4c0 con 0x7f974c0a52a0 2024-04-26T00:00:07.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f97340019e0 con 0x7f974c0a52a0 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): dump: 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:07.687 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 429354919 0 0) 0x7f972c003530 con 0x7f974c0a49c0 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f974c13beb0 con 0x7f974c0a49c0 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f973c003940 con 0x7f974c0a49c0 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient(hunting): dump: 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:07.688 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:07.689 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4102125529 0 0) 0x7f974c1cd4c0 con 0x7f974c0a52a0 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 >> v1:172.21.15.106:6793/0 conn(0x7f974c13e2a0 legacy=0x7f974c1d4bf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 >> v1:172.21.15.171:6791/0 conn(0x7f974c0a49c0 legacy=0x7f974c1cc6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 monclient: found mon.g 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f974c13d290 con 0x7f974c0a52a0 2024-04-26T00:00:07.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 5 monclient: authenticate success, global_id 6375 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient: _renew_subs 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f974c136b10 con 0x7f974c0a52a0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient: _renew_subs 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f974c13cd90 con 0x7f974c0a52a0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f97340038d0 con 0x7f974c0a52a0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9734003e40 con 0x7f974c0a52a0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:07.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f974affd640 4 set_mon_vals no callback set 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 10 monclient: dump: 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:07.692 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9730005090 con 0x7f974c0a52a0 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9734003fe0 con 0x7f974c0a52a0 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(150..150 src has 1..150) ==== 8396+0+0 (unknown 1923696734 0 0) 0x7f9734044500 con 0x7f974c0a52a0 2024-04-26T00:00:07.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.687+0000 7f974bfff640 10 monclient: get_auth_request con 0x7f972c037dd0 auth_method 0 2024-04-26T00:00:07.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.691+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9734014520 con 0x7f974c0a52a0 2024-04-26T00:00:07.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.691+0000 7f97497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:07.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.691+0000 7f97497fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:07.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.855+0000 7f9752493640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}] 2024-04-26T00:00:07.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.855+0000 7f9752493640 10 monclient: _send_command 2 [{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}] 2024-04-26T00:00:07.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.855+0000 7f9752493640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:07.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:07.855+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]} v 0) -- 0x7f9730005380 con 0x7f974c0a52a0 2024-04-26T00:00:08.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:08.543+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}]=0 set osd(s) 0 to class 'fish' v151) ==== 137+0+0 (unknown 110050353 0 0) 0x7f9734013e20 con 0x7f974c0a52a0 2024-04-26T00:00:08.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:08.543+0000 7f97497fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}] 2024-04-26T00:00:08.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:08.543+0000 7f97497fa640 10 monclient: _finish_command 2 = system:0 set osd(s) 0 to class 'fish' 2024-04-26T00:00:08.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:08.647+0000 7f9752493640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}] 2024-04-26T00:00:08.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:08.647+0000 7f9752493640 10 monclient: _send_command 3 [{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}] 2024-04-26T00:00:08.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:08.647+0000 7f9752493640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:08.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:08.647+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]} v 0) -- 0x7f97300010a0 con 0x7f974c0a52a0 2024-04-26T00:00:09.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.555+0000 7f97497fa640 1 -- 172.21.15.171:0/1354168549 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}]=0 osd.0 already set to class fish. set-device-class item id 0 name 'osd.0' device_class 'fish': no change. set osd(s) to class 'fish' v152) ==== 241+0+0 (unknown 3700707988 0 0) 0x7f973401c9d0 con 0x7f974c0a52a0 2024-04-26T00:00:09.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.555+0000 7f97497fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush set-device-class", "class": "fish", "ids": ["osd.0"]}] 2024-04-26T00:00:09.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.555+0000 7f97497fa640 10 monclient: _finish_command 3 = system:0 osd.0 already set to class fish. set-device-class item id 0 name 'osd.0' device_class 'fish': no change. set osd(s) to class 'fish' 2024-04-26T00:00:09.541 INFO:tasks.workunit.client.0.smithi171.stderr:osd.0 already set to class fish. set-device-class item id 0 name 'osd.0' device_class 'fish': no change. set osd(s) to class 'fish' 2024-04-26T00:00:09.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 >> v1:172.21.15.171:6812/722422047 conn(0x7f972c037dd0 legacy=0x7f972c03a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 10 monclient: shutdown 2024-04-26T00:00:09.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:09.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 >> v1:172.21.15.171:6790/0 conn(0x7f974c0a52a0 legacy=0x7f974c1ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 shutdown_connections 2024-04-26T00:00:09.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 >> 172.21.15.171:0/1354168549 conn(0x7f974c0a6c90 msgr2=0x7f974c0a7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:09.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 shutdown_connections 2024-04-26T00:00:09.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.559+0000 7f9752493640 1 -- 172.21.15.171:0/1354168549 wait complete. 2024-04-26T00:00:09.564 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:09.565 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep fish 2024-04-26T00:00:09.565 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:09.565 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '10\.' 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient: get_monmap_and_config 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient: build_initial_monmap 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient: monmap: 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:09.699496+0000 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:09.699496+0000 2024-04-26T00:00:09.678 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:09.679 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 1 Processor -- start 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 1 -- start start 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient: init 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient: _add_conns ranks=[7,1,6,8,0,3,5,4,2] 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient(hunting): picked mon.noname-i con 0x7f05080a3930 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient(hunting): picked mon.noname-f con 0x7f0508138150 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:09.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient(hunting): picked mon.noname-d con 0x7f0508138570 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080a2b70 con 0x7f0508138150 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080a2e50 con 0x7f0508138570 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080a4460 con 0x7f05080a3930 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050cb0f640 10 monclient(hunting): authenticate will time out at 1260.407240s 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050659c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f05080a3930 0x7f0508137a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46238/0 (socket says 172.21.15.171:46238) 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050659c640 1 -- 172.21.15.171:0/1253599778 learned_addr learned my addr 172.21.15.171:0/1253599778 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:09.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f0505d9b640 1 --1- 172.21.15.171:0/1253599778 >> v1:172.21.15.171:6789/0 conn(0x7f0508138150 0x7f050813cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36316/0 (socket says 172.21.15.171:36316) 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662417796 0 0) 0x7f05080a4460 con 0x7f05080a3930 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): my global_id is 144511 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04f0003530 con 0x7f05080a3930 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550852613 0 0) 0x7f05080a2b70 con 0x7f0508138150 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 10 monclient(hunting): my global_id is 144613 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.695+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05080a4460 con 0x7f0508138150 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2751028403 0 0) 0x7f04f0003530 con 0x7f05080a3930 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 >> v1:172.21.15.106:6792/0 conn(0x7f0508138570 legacy=0x7f05081406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 >> v1:172.21.15.171:6789/0 conn(0x7f0508138150 legacy=0x7f050813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: _finish_hunting 0 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 monclient: found mon.noname-i 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05080a1810 con 0x7f05080a3930 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: _finish_auth 0 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: _check_auth_tickets 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04f8001b40 con 0x7f05080a3930 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 5 monclient: authenticate success, global_id 144511 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:09.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: dump: 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:09.691 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04f8001e20 con 0x7f05080a3930 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 4 set_mon_vals no callback set 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 1 -- 172.21.15.171:0/1253599778 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04f8004f70 con 0x7f05080a3930 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050559a640 10 monclient: dump: 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:09.692 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: shutdown 2024-04-26T00:00:09.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- 172.21.15.171:0/1253599778 >> v1:172.21.15.171:6792/0 conn(0x7f05080a3930 legacy=0x7f0508137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- 172.21.15.171:0/1253599778 shutdown_connections 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- 172.21.15.171:0/1253599778 >> 172.21.15.171:0/1253599778 conn(0x7f05080a6d70 msgr2=0x7f05080a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- 172.21.15.171:0/1253599778 shutdown_connections 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- 172.21.15.171:0/1253599778 wait complete. 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: build_initial_monmap 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: monmap: 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.694 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:09.695 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 Processor -- start 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- start start 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: init 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: _add_conns ranks=[5,7,1,3,6,8,0,2,4] 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient(hunting): picked mon.noname-h con 0x7f05080a3930 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient(hunting): picked mon.noname-i con 0x7f0508138150 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient(hunting): picked mon.noname-f con 0x7f0508138570 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0508134220 con 0x7f0508138570 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080a0060 con 0x7f05080a3930 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05080a1030 con 0x7f0508138150 2024-04-26T00:00:09.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient(hunting): authenticate will time out at 1260.410450s 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050659c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f05080a3930 0x7f0508133b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40450/0 (socket says 172.21.15.171:40450) 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050659c640 1 -- 172.21.15.171:0/3394822936 learned_addr learned my addr 172.21.15.171:0/3394822936 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823331171 0 0) 0x7f05080a1030 con 0x7f0508138150 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 144520 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04e8003530 con 0x7f0508138150 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680099034 0 0) 0x7f0508134220 con 0x7f0508138570 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:09.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 144622 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f05080a1030 con 0x7f0508138570 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112237440 0 0) 0x7f05080a0060 con 0x7f05080a3930 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): my global_id is 6071 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0508134220 con 0x7f05080a3930 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1826784300 0 0) 0x7f04e8003530 con 0x7f0508138150 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05080a0060 con 0x7f0508138150 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2434441463 0 0) 0x7f05080a1030 con 0x7f0508138570 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04e8003530 con 0x7f0508138570 2024-04-26T00:00:09.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04fc0019e0 con 0x7f0508138150 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:09.699 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0500001920 con 0x7f0508138570 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:09.700 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:09.701 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3297349365 0 0) 0x7f0508134220 con 0x7f05080a3930 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f05080a1030 con 0x7f05080a3930 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04f8004eb0 con 0x7f05080a3930 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:09.702 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 919001707 0 0) 0x7f05080a0060 con 0x7f0508138150 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 >> v1:172.21.15.171:6791/0 conn(0x7f05080a3930 legacy=0x7f0508133b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 >> v1:172.21.15.171:6789/0 conn(0x7f0508138570 legacy=0x7f05081d5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:09.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 monclient: found mon.i 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0508138d40 con 0x7f0508138150 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 5 monclient: authenticate success, global_id 144520 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: _renew_subs 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f050809ed70 con 0x7f0508138150 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: _renew_subs 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f05081cc760 con 0x7f0508138150 2024-04-26T00:00:09.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f04fc001d30 con 0x7f0508138150 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04fc004de0 con 0x7f0508138150 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f0504d99640 4 set_mon_vals no callback set 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.699+0000 7f04f6ffd640 10 monclient: dump: 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:09.705 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.703+0000 7f050cb0f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.703+0000 7f050cb0f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.703+0000 7f050cb0f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.703+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f04fc005000 con 0x7f0508138150 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.703+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04ec005090 con 0x7f0508138150 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.703+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(152..152 src has 1..152) ==== 9061+0+0 (unknown 1438872676 0 0) 0x7f04fc0458c0 con 0x7f0508138150 2024-04-26T00:00:09.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.703+0000 7f050659c640 10 monclient: get_auth_request con 0x7f04e8038100 auth_method 0 2024-04-26T00:00:09.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.707+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f04fc015650 con 0x7f0508138150 2024-04-26T00:00:09.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.707+0000 7f04f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:09.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.707+0000 7f04f6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:09.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.875+0000 7f050cb0f640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:09.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.875+0000 7f050cb0f640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:09.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.875+0000 7f050cb0f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:09.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.875+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f04ec005380 con 0x7f0508138150 2024-04-26T00:00:09.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.875+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v152) ==== 83+0+2175 (unknown 3934654694 0 3929702274) 0x7f04fc01db00 con 0x7f0508138150 2024-04-26T00:00:09.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.875+0000 7f04f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:09.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.875+0000 7f04f6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:09.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:09.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:09.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:09.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f04ec0065d0 con 0x7f0508138150 2024-04-26T00:00:09.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f04f6ffd640 1 -- 172.21.15.171:0/3394822936 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v152) ==== 83+0+2175 (unknown 3934654694 0 3929702274) 0x7f04fc013320 con 0x7f0508138150 2024-04-26T00:00:09.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f04f6ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:09.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f04f6ffd640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 >> v1:172.21.15.171:6812/722422047 conn(0x7f04e8038100 legacy=0x7f04e803a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 10 monclient: shutdown 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 >> v1:172.21.15.171:6792/0 conn(0x7f0508138150 legacy=0x7f05081d18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 shutdown_connections 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 >> 172.21.15.171:0/3394822936 conn(0x7f05080a6d70 msgr2=0x7f05081bfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 shutdown_connections 2024-04-26T00:00:09.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:09.979+0000 7f050cb0f640 1 -- 172.21.15.171:0/3394822936 wait complete. 2024-04-26T00:00:09.979 INFO:tasks.workunit.client.0.smithi171.stdout: 0 fish 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:09.979 INFO:tasks.workunit.client.0.smithi171.stdout: 0 fish 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:09.980 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:09.980 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:09.980 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep fish 2024-04-26T00:00:09.980 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '11\.' 2024-04-26T00:00:10.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: get_monmap_and_config 2024-04-26T00:00:10.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: build_initial_monmap 2024-04-26T00:00:10.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: monmap: 2024-04-26T00:00:10.098 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:10.098 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.098 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:10.119411+0000 2024-04-26T00:00:10.098 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:10.119411+0000 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:10.099 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 1 Processor -- start 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 1 -- start start 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: init 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: _add_conns ranks=[1,2,5,0,6,7,8,3,4] 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient(hunting): picked mon.noname-f con 0x7fdf84072210 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient(hunting): picked mon.noname-b con 0x7fdf84137e20 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient(hunting): picked mon.noname-h con 0x7fdf8413e3a0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf84072d00 con 0x7fdf84072210 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8406faa0 con 0x7fdf84137e20 2024-04-26T00:00:10.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf84072f20 con 0x7fdf8413e3a0 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient(hunting): authenticate will time out at 1260.826483s 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf83fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fdf84072210 0x7fdf840725f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:36334/0 (socket says 172.21.15.171:36334) 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf83fff640 1 -- 172.21.15.171:0/2671347625 learned_addr learned my addr 172.21.15.171:0/2671347625 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf88fd3640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fdf8413e3a0 0x7fdf84140790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40454/0 (socket says 172.21.15.171:40454) 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044541021 0 0) 0x7fdf84072d00 con 0x7fdf84072210 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): my global_id is 144631 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf6c003530 con 0x7fdf84072210 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292189118 0 0) 0x7fdf84072f20 con 0x7fdf8413e3a0 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient(hunting): my global_id is 6080 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf84072d00 con 0x7fdf8413e3a0 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 878171835 0 0) 0x7fdf6c003530 con 0x7fdf84072210 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 >> v1:172.21.15.171:6791/0 conn(0x7fdf8413e3a0 legacy=0x7fdf84140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 >> v1:172.21.15.106:6790/0 conn(0x7fdf84137e20 legacy=0x7fdf8413cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 monclient: found mon.noname-f 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf8406f200 con 0x7fdf84072210 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:10.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdf740017e0 con 0x7fdf84072210 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: dump: 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.109 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 5 monclient: authenticate success, global_id 144631 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf740019d0 con 0x7fdf84072210 2024-04-26T00:00:10.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:10.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 1 -- 172.21.15.171:0/2671347625 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdf74004bf0 con 0x7fdf84072210 2024-04-26T00:00:10.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:10.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf82ffd640 10 monclient: dump: 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.114 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 4 set_mon_vals no callback set 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 10 monclient: shutdown 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.115+0000 7fdf8aa36640 1 -- 172.21.15.171:0/2671347625 >> v1:172.21.15.171:6789/0 conn(0x7fdf84072210 legacy=0x7fdf840725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- 172.21.15.171:0/2671347625 shutdown_connections 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- 172.21.15.171:0/2671347625 >> 172.21.15.171:0/2671347625 conn(0x7fdf840a2620 msgr2=0x7fdf840a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- 172.21.15.171:0/2671347625 shutdown_connections 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- 172.21.15.171:0/2671347625 wait complete. 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: build_initial_monmap 2024-04-26T00:00:10.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: monmap: 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:10.116 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 Processor -- start 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- start start 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: init 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _add_conns ranks=[3,0,2,6,4,7,1,5,8] 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient(hunting): picked mon.noname-g con 0x7fdf84072210 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient(hunting): picked mon.noname-a con 0x7fdf84137e20 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient(hunting): picked mon.noname-b con 0x7fdf8413e3a0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8412c080 con 0x7fdf84137e20 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf84133490 con 0x7fdf8413e3a0 2024-04-26T00:00:10.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf841343d0 con 0x7fdf84072210 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient(hunting): authenticate will time out at 1260.829567s 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf83fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fdf84072210 0x7fdf8412b260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58036/0 (socket says 172.21.15.171:58036) 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf83fff640 1 -- 172.21.15.171:0/3326413452 learned_addr learned my addr 172.21.15.171:0/3326413452 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4067527805 0 0) 0x7fdf841343d0 con 0x7fdf84072210 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): my global_id is 6384 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf70003530 con 0x7fdf84072210 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1410050223 0 0) 0x7fdf70003530 con 0x7fdf84072210 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf841343d0 con 0x7fdf84072210 2024-04-26T00:00:10.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdf740047f0 con 0x7fdf84072210 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.119 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3514415988 0 0) 0x7fdf841343d0 con 0x7fdf84072210 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 >> v1:172.21.15.106:6790/0 conn(0x7fdf8413e3a0 legacy=0x7fdf841d4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 >> v1:172.21.15.106:6789/0 conn(0x7fdf84137e20 legacy=0x7fdf8412b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 monclient: found mon.g 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:10.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf841346b0 con 0x7fdf84072210 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 5 monclient: authenticate success, global_id 6384 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _renew_subs 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdf84134990 con 0x7fdf84072210 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _renew_subs 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdf841330f0 con 0x7fdf84072210 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf740019d0 con 0x7fdf84072210 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf827fc640 4 set_mon_vals no callback set 2024-04-26T00:00:10.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdf74001180 con 0x7fdf84072210 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 10 monclient: dump: 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.122 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf64005090 con 0x7fdf84072210 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdf7400fe30 con 0x7fdf84072210 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(152..152 src has 1..152) ==== 9061+0+0 (unknown 1438872676 0 0) 0x7fdf74045c00 con 0x7fdf84072210 2024-04-26T00:00:10.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.119+0000 7fdf837fe640 10 monclient: get_auth_request con 0x7fdf70037860 auth_method 0 2024-04-26T00:00:10.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.127+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdf74015930 con 0x7fdf84072210 2024-04-26T00:00:10.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.127+0000 7fdf80ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.127+0000 7fdf80ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:10.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.295+0000 7fdf8aa36640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.295+0000 7fdf8aa36640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.295+0000 7fdf8aa36640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:10.279 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.295+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7fdf64005380 con 0x7fdf84072210 2024-04-26T00:00:10.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.295+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v152) ==== 83+0+2175 (unknown 3934654694 0 3929702274) 0x7fdf74019580 con 0x7fdf84072210 2024-04-26T00:00:10.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.295+0000 7fdf80ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.280 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.295+0000 7fdf80ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:10.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.399+0000 7fdf8aa36640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.399+0000 7fdf8aa36640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.399+0000 7fdf8aa36640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:10.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.399+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7fdf640065d0 con 0x7fdf84072210 2024-04-26T00:00:10.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.399+0000 7fdf80ff9640 1 -- 172.21.15.171:0/3326413452 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v152) ==== 83+0+2175 (unknown 3934654694 0 3929702274) 0x7fdf7401de40 con 0x7fdf84072210 2024-04-26T00:00:10.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.399+0000 7fdf80ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.384 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.399+0000 7fdf80ff9640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 >> v1:172.21.15.171:6812/722422047 conn(0x7fdf70037860 legacy=0x7fdf70039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 10 monclient: shutdown 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 >> v1:172.21.15.171:6790/0 conn(0x7fdf84072210 legacy=0x7fdf8412b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 shutdown_connections 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 >> 172.21.15.171:0/3326413452 conn(0x7fdf840a2620 msgr2=0x7fdf84135550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 shutdown_connections 2024-04-26T00:00:10.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.403+0000 7fdf8aa36640 1 -- 172.21.15.171:0/3326413452 wait complete. 2024-04-26T00:00:10.401 INFO:tasks.workunit.client.0.smithi171.stdout: 0 fish 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:10.401 INFO:tasks.workunit.client.0.smithi171.stdout: 0 fish 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:10.402 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:10.402 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:10.402 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep fish 2024-04-26T00:00:10.402 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '12\.' 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.535+0000 7f54b288d640 10 monclient: get_monmap_and_config 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.535+0000 7f54b288d640 10 monclient: build_initial_monmap 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.535+0000 7f54b288d640 10 monclient: monmap: 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:10.541151+0000 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:10.541151+0000 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:10.520 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:10.521 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:10.521 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:10.521 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:10.521 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:10.521 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:10.521 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:10.521 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 Processor -- start 2024-04-26T00:00:10.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- start start 2024-04-26T00:00:10.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: init 2024-04-26T00:00:10.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:10.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: _add_conns ranks=[7,1,2,5,6,0,3,8,4] 2024-04-26T00:00:10.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): picked mon.noname-i con 0x7f54ac0a52c0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:10.524 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): picked mon.noname-f con 0x7f54ac0a4a30 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): picked mon.noname-b con 0x7f54ac13e3a0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0a2fe0 con 0x7f54ac0a4a30 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0a5db0 con 0x7f54ac13e3a0 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0a2a20 con 0x7f54ac0a52c0 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): authenticate will time out at 1261.248875s 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54abfff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f54ac0a52c0 0x7f54ac0a56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54556/0 (socket says 172.21.15.171:54556) 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54a3fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f54ac0a4a30 0x7f54ac13cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54628/0 (socket says 172.21.15.171:54628) 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54abfff640 1 -- 172.21.15.171:0/2278460398 learned_addr learned my addr 172.21.15.171:0/2278460398 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:10.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876627726 0 0) 0x7f5494001120 con 0x7f54ac0a4a30 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): my global_id is 144640 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5498003530 con 0x7f54ac0a4a30 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1618069179 0 0) 0x7f54ac0a2a20 con 0x7f54ac0a52c0 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient(hunting): my global_id is 144529 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5494001120 con 0x7f54ac0a52c0 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2005648187 0 0) 0x7f5494001120 con 0x7f54ac0a52c0 2024-04-26T00:00:10.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 >> v1:172.21.15.106:6790/0 conn(0x7f54ac13e3a0 legacy=0x7f54ac140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 >> v1:172.21.15.171:6789/0 conn(0x7f54ac0a4a30 legacy=0x7f54ac13cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 monclient: found mon.noname-i 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac0a2d00 con 0x7f54ac0a52c0 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f549c0017c0 con 0x7f54ac0a52c0 2024-04-26T00:00:10.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: dump: 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.528 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 5 monclient: authenticate success, global_id 144529 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f549c001a20 con 0x7f54ac0a52c0 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 1 -- 172.21.15.171:0/2278460398 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f549c004bf0 con 0x7f54ac0a52c0 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 4 set_mon_vals no callback set 2024-04-26T00:00:10.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54ab7fe640 10 monclient: dump: 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.530 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: shutdown 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- 172.21.15.171:0/2278460398 >> v1:172.21.15.171:6792/0 conn(0x7f54ac0a52c0 legacy=0x7f54ac0a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- 172.21.15.171:0/2278460398 shutdown_connections 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- 172.21.15.171:0/2278460398 >> 172.21.15.171:0/2278460398 conn(0x7f54ac0aa030 msgr2=0x7f54ac0aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- 172.21.15.171:0/2278460398 shutdown_connections 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- 172.21.15.171:0/2278460398 wait complete. 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: build_initial_monmap 2024-04-26T00:00:10.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: monmap: 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:10.532 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:10.533 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 Processor -- start 2024-04-26T00:00:10.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- start start 2024-04-26T00:00:10.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: init 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient: _add_conns ranks=[0,4,7,1,6,2,3,5,8] 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): picked mon.noname-a con 0x7f54ac0a4a30 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): picked mon.noname-c con 0x7f54ac0a52c0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): picked mon.noname-i con 0x7f54ac13e3a0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac09f5e0 con 0x7f54ac0a4a30 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac1345d0 con 0x7f54ac0a52c0 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54ac0a0f80 con 0x7f54ac13e3a0 2024-04-26T00:00:10.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.539+0000 7f54b288d640 10 monclient(hunting): authenticate will time out at 1261.251907s 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b0e2a640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f54ac13e3a0 0x7f54ac1d4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54558/0 (socket says 172.21.15.171:54558) 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b0e2a640 1 -- 172.21.15.171:0/3352091271 learned_addr learned my addr 172.21.15.171:0/3352091271 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4005147530 0 0) 0x7f54ac0a0f80 con 0x7f54ac13e3a0 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): my global_id is 144538 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f548c003530 con 0x7f54ac13e3a0 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1999778653 0 0) 0x7f548c003530 con 0x7f54ac13e3a0 2024-04-26T00:00:10.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54ac0a0f80 con 0x7f54ac13e3a0 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f54a4001d40 con 0x7f54ac13e3a0 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): dump: 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.538 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3805682882 0 0) 0x7f54ac0a0f80 con 0x7f54ac13e3a0 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 >> v1:172.21.15.106:6791/0 conn(0x7f54ac0a52c0 legacy=0x7f54ac133ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 >> v1:172.21.15.106:6789/0 conn(0x7f54ac0a4a30 legacy=0x7f54ac1337b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 monclient: found mon.i 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54ac09f300 con 0x7f54ac13e3a0 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 5 monclient: authenticate success, global_id 144538 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 10 monclient: _renew_subs 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:10.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54ac09dba0 con 0x7f54ac13e3a0 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 10 monclient: _renew_subs 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f54ac09ff30 con 0x7f54ac13e3a0 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f54a4003c50 con 0x7f54ac13e3a0 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f54a40041c0 con 0x7f54ac13e3a0 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54aaffd640 4 set_mon_vals no callback set 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 10 monclient: dump: 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.541 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.542 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5490005090 con 0x7f54ac13e3a0 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f54a4004360 con 0x7f54ac13e3a0 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(152..152 src has 1..152) ==== 9061+0+0 (unknown 1438872676 0 0) 0x7f54a4045da0 con 0x7f54ac13e3a0 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.543+0000 7f54abfff640 10 monclient: get_auth_request con 0x7f548c0377e0 auth_method 0 2024-04-26T00:00:10.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.547+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f54a4015ab0 con 0x7f54ac13e3a0 2024-04-26T00:00:10.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.547+0000 7f54a97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.544 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.547+0000 7f54a97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:10.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.719+0000 7f54b288d640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.719+0000 7f54b288d640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.719+0000 7f54b288d640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:10.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.719+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f5490005380 con 0x7f54ac13e3a0 2024-04-26T00:00:10.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.719+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v152) ==== 83+0+2175 (unknown 3934654694 0 3929702274) 0x7f54a40153b0 con 0x7f54ac13e3a0 2024-04-26T00:00:10.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.719+0000 7f54a97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.719+0000 7f54a97fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:10.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.819+0000 7f54b288d640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.819+0000 7f54b288d640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.819+0000 7f54b288d640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:10.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.819+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f5490005ac0 con 0x7f54ac13e3a0 2024-04-26T00:00:10.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54a97fa640 1 -- 172.21.15.171:0/3352091271 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v152) ==== 83+0+2175 (unknown 3934654694 0 3929702274) 0x7f54a4019700 con 0x7f54ac13e3a0 2024-04-26T00:00:10.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54a97fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:10.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54a97fa640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:10.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 >> v1:172.21.15.171:6812/722422047 conn(0x7f548c0377e0 legacy=0x7f548c039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 10 monclient: shutdown 2024-04-26T00:00:10.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:10.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 >> v1:172.21.15.171:6792/0 conn(0x7f54ac13e3a0 legacy=0x7f54ac1d4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 shutdown_connections 2024-04-26T00:00:10.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 >> 172.21.15.171:0/3352091271 conn(0x7f54ac0aa030 msgr2=0x7f54ac1369e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:10.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 shutdown_connections 2024-04-26T00:00:10.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.823+0000 7f54b288d640 1 -- 172.21.15.171:0/3352091271 wait complete. 2024-04-26T00:00:10.822 INFO:tasks.workunit.client.0.smithi171.stdout: 0 fish 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:10.822 INFO:tasks.workunit.client.0.smithi171.stdout: 0 fish 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:10.822 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm-device-class osd.0 2024-04-26T00:00:10.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient: get_monmap_and_config 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient: build_initial_monmap 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient: monmap: 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:10.959940+0000 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:10.959940+0000 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:10.940 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 1 Processor -- start 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 1 -- start start 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient: init 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient: _add_conns ranks=[1,2,8,0,7,3,6,4,5] 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient(hunting): picked mon.noname-f con 0x7f8054135bb0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient(hunting): picked mon.noname-b con 0x7f80541356f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient(hunting): picked mon.noname-e con 0x7f805413c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80540a1da0 con 0x7f8054135bb0 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80540a1fe0 con 0x7f80541356f0 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8054072720 con 0x7f805413c130 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient(hunting): authenticate will time out at 1261.666855s 2024-04-26T00:00:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80537fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8054135bb0 0x7f8054135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54644/0 (socket says 172.21.15.171:54644) 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80537fe640 1 -- 172.21.15.171:0/419726159 learned_addr learned my addr 172.21.15.171:0/419726159 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8053fff640 1 -- 172.21.15.171:0/419726159 >> v1:172.21.15.106:6793/0 conn(0x7f805413c130 legacy=0x7f805413e520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022418936 0 0) 0x7f80540a1da0 con 0x7f8054135bb0 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient(hunting): my global_id is 144649 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f803c003530 con 0x7f8054135bb0 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1577258646 0 0) 0x7f803c003530 con 0x7f8054135bb0 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 >> v1:172.21.15.106:6793/0 conn(0x7f805413c130 legacy=0x7f805413e520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 >> v1:172.21.15.106:6790/0 conn(0x7f80541356f0 legacy=0x7f805413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 monclient: found mon.noname-f 2024-04-26T00:00:10.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80540a17f0 con 0x7f8054135bb0 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 5 monclient: authenticate success, global_id 144649 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80440017c0 con 0x7f8054135bb0 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: dump: 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.951 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8044001b20 con 0x7f8054135bb0 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 1 -- 172.21.15.171:0/419726159 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8044004bf0 con 0x7f8054135bb0 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f8059fdd640 4 set_mon_vals no callback set 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.955+0000 7f80527fc640 10 monclient: dump: 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: shutdown 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/419726159 >> v1:172.21.15.171:6789/0 conn(0x7f8054135bb0 legacy=0x7f8054135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/419726159 shutdown_connections 2024-04-26T00:00:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/419726159 >> 172.21.15.171:0/419726159 conn(0x7f80540a2620 msgr2=0x7f80540a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/419726159 shutdown_connections 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/419726159 wait complete. 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: build_initial_monmap 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: monmap: 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 Processor -- start 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- start start 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: init 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _add_conns ranks=[5,2,6,8,0,4,1,7,3] 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient(hunting): picked mon.noname-h con 0x7f80541356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient(hunting): picked mon.noname-b con 0x7f8054135bb0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient(hunting): picked mon.noname-d con 0x7f805413c130 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8054070aa0 con 0x7f8054135bb0 2024-04-26T00:00:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8054071400 con 0x7f80541356f0 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8054070f80 con 0x7f805413c130 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient(hunting): authenticate will time out at 1261.670036s 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f80537fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f80541356f0 0x7f8054134440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40842/0 (socket says 172.21.15.171:40842) 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f80537fe640 1 -- 172.21.15.171:0/1679352742 learned_addr learned my addr 172.21.15.171:0/1679352742 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679203171 0 0) 0x7f8054071400 con 0x7f80541356f0 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): my global_id is 6089 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8040003530 con 0x7f80541356f0 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1653946339 0 0) 0x7f8040003530 con 0x7f80541356f0 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8054071400 con 0x7f80541356f0 2024-04-26T00:00:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8044001780 con 0x7f80541356f0 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): dump: 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4017454687 0 0) 0x7f8054070aa0 con 0x7f8054135bb0 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): my global_id is 6095 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8040003530 con 0x7f8054135bb0 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3900439668 0 0) 0x7f8054070f80 con 0x7f805413c130 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient(hunting): my global_id is 6261 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8054070aa0 con 0x7f805413c130 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1199338935 0 0) 0x7f8054071400 con 0x7f80541356f0 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 >> v1:172.21.15.106:6792/0 conn(0x7f805413c130 legacy=0x7f80541d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 >> v1:172.21.15.106:6790/0 conn(0x7f8054135bb0 legacy=0x7f80541d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 monclient: found mon.h 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8054071ef0 con 0x7f80541356f0 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: _finish_auth 0 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 5 monclient: authenticate success, global_id 6089 2024-04-26T00:00:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _renew_subs 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80540719a0 con 0x7f80541356f0 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _renew_subs 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f805412d740 con 0x7f80541356f0 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8044001b20 con 0x7f80541356f0 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80440051b0 con 0x7f80541356f0 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f80517fa640 4 set_mon_vals no callback set 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f803bfff640 10 monclient: dump: 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.959+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8034005090 con 0x7f80541356f0 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.963+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f804400ff50 con 0x7f80541356f0 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.963+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(152..152 src has 1..152) ==== 9061+0+0 (unknown 1438872676 0 0) 0x7f8044045b10 con 0x7f80541356f0 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.963+0000 7f8052ffd640 10 monclient: get_auth_request con 0x7f8040037a10 auth_method 0 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.967+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8044015960 con 0x7f80541356f0 2024-04-26T00:00:10.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.967+0000 7f803bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:10.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:10.967+0000 7f803bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:11.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.123+0000 7f8059fdd640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:11.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.123+0000 7f8059fdd640 10 monclient: _send_command 2 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:11.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.123+0000 7f8059fdd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:11.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.123+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["osd.0"]} v 0) -- 0x7f8034005b90 con 0x7f80541356f0 2024-04-26T00:00:11.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.531+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}]=0 done removing class of osd(s): 0 v153) ==== 123+0+0 (unknown 2169363404 0 0) 0x7f8044013630 con 0x7f80541356f0 2024-04-26T00:00:11.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.531+0000 7f803bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:11.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.531+0000 7f803bfff640 10 monclient: _finish_command 2 = system:0 done removing class of osd(s): 0 2024-04-26T00:00:11.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.643+0000 7f8059fdd640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:11.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.643+0000 7f8059fdd640 10 monclient: _send_command 3 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:11.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.643+0000 7f8059fdd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:11.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:11.643+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["osd.0"]} v 0) -- 0x7f80340010a0 con 0x7f80541356f0 2024-04-26T00:00:12.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f803bfff640 1 -- 172.21.15.171:0/1679352742 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}]=0 osd.0 belongs to no class, done removing class of osd(s): v154) ==== 149+0+0 (unknown 3264209139 0 0) 0x7f80440423b0 con 0x7f80541356f0 2024-04-26T00:00:12.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f803bfff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:12.602 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f803bfff640 10 monclient: _finish_command 3 = system:0 osd.0 belongs to no class, done removing class of osd(s): 2024-04-26T00:00:12.602 INFO:tasks.workunit.client.0.smithi171.stderr:osd.0 belongs to no class, done removing class of osd(s): 2024-04-26T00:00:12.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 >> v1:172.21.15.171:6812/722422047 conn(0x7f8040037a10 legacy=0x7f8040039ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:12.604 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 10 monclient: shutdown 2024-04-26T00:00:12.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:12.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 >> v1:172.21.15.171:6791/0 conn(0x7f80541356f0 legacy=0x7f8054134440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:12.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 shutdown_connections 2024-04-26T00:00:12.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 >> 172.21.15.171:0/1679352742 conn(0x7f80540a2620 msgr2=0x7f805413e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:12.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 shutdown_connections 2024-04-26T00:00:12.605 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.619+0000 7f8059fdd640 1 -- 172.21.15.171:0/1679352742 wait complete. 2024-04-26T00:00:12.622 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush set-device-class globster osd.0 2024-04-26T00:00:12.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient: get_monmap_and_config 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient: build_initial_monmap 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient: monmap: 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:12.768091+0000 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:12.768091+0000 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:12.747 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:12.748 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:12.748 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:12.748 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:12.748 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:12.748 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:12.748 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 1 Processor -- start 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 1 -- start start 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient: init 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient: _add_conns ranks=[8,7,1,3,0,2,4,5,6] 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient(hunting): picked mon.noname-e con 0x7f59480a1530 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient(hunting): picked mon.noname-i con 0x7f5948071c00 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient(hunting): picked mon.noname-f con 0x7f5948071730 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:12.756 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594806ea70 con 0x7f5948071730 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59480723d0 con 0x7f5948071c00 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5948072990 con 0x7f59480a1530 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 10 monclient(hunting): authenticate will time out at 1263.475053s 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5947fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f59480a1530 legacy=0x7f59480a1910 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594cdbe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5948071730 0x7f594813e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54658/0 (socket says 172.21.15.171:54658) 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594cdbe640 1 -- 172.21.15.171:0/1552183783 learned_addr learned my addr 172.21.15.171:0/1552183783 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437736380 0 0) 0x7f59480723d0 con 0x7f5948071c00 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): my global_id is 144547 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5930003530 con 0x7f5948071c00 2024-04-26T00:00:12.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2012406026 0 0) 0x7f594806ea70 con 0x7f5948071730 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient(hunting): my global_id is 144658 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59480723d0 con 0x7f5948071730 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 597556529 0 0) 0x7f59480723d0 con 0x7f5948071730 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 >> v1:172.21.15.106:6793/0 conn(0x7f59480a1530 legacy=0x7f59480a1910 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 >> v1:172.21.15.171:6792/0 conn(0x7f5948071c00 legacy=0x7f594813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 monclient: found mon.noname-f 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:12.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59480a3100 con 0x7f5948071730 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5940001b20 con 0x7f5948071730 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f5946ffd640 10 monclient: dump: 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.759 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 5 monclient: authenticate success, global_id 144658 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.763+0000 7f594e821640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5940001e80 con 0x7f5948071730 2024-04-26T00:00:12.760 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5946ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5946ffd640 1 -- 172.21.15.171:0/1552183783 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5940004f70 con 0x7f5948071730 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 4 set_mon_vals no callback set 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5946ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5946ffd640 10 monclient: dump: 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:12.761 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: shutdown 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- 172.21.15.171:0/1552183783 >> v1:172.21.15.171:6789/0 conn(0x7f5948071730 legacy=0x7f594813e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- 172.21.15.171:0/1552183783 shutdown_connections 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- 172.21.15.171:0/1552183783 >> 172.21.15.171:0/1552183783 conn(0x7f59480a62d0 msgr2=0x7f59480a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:12.762 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- 172.21.15.171:0/1552183783 shutdown_connections 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- 172.21.15.171:0/1552183783 wait complete. 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: build_initial_monmap 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: monmap: 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:12.763 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 Processor -- start 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- start start 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: init 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: _add_conns ranks=[3,5,7,6,8,2,0,4,1] 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient(hunting): picked mon.noname-g con 0x7f5948071730 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient(hunting): picked mon.noname-h con 0x7f5948071c00 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient(hunting): picked mon.noname-i con 0x7f59480a1530 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:12.764 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59481bbe30 con 0x7f5948071730 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594811ff40 con 0x7f5948071c00 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5948122230 con 0x7f59480a1530 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient(hunting): authenticate will time out at 1263.478520s 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5947fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5948071730 0x7f5948132a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:46706/0 (socket says 172.21.15.171:46706) 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5947fff640 1 -- 172.21.15.171:0/1940396039 learned_addr learned my addr 172.21.15.171:0/1940396039 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f59477fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5948071c00 0x7f59481cf210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40848/0 (socket says 172.21.15.171:40848) 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154302486 0 0) 0x7f5948122230 con 0x7f59480a1530 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): my global_id is 144556 2024-04-26T00:00:12.765 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5934003530 con 0x7f59480a1530 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2171742690 0 0) 0x7f59481bbe30 con 0x7f5948071730 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): my global_id is 6393 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5948122230 con 0x7f5948071730 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021364639 0 0) 0x7f594811ff40 con 0x7f5948071c00 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): my global_id is 6098 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59481bbe30 con 0x7f5948071c00 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 760567440 0 0) 0x7f5934003530 con 0x7f59480a1530 2024-04-26T00:00:12.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f594811ff40 con 0x7f59480a1530 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1063396071 0 0) 0x7f5948122230 con 0x7f5948071730 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5934003530 con 0x7f5948071730 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5940001c00 con 0x7f59480a1530 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:12.767 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59380042b0 con 0x7f5948071730 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:12.768 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:12.769 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 828704702 0 0) 0x7f59481bbe30 con 0x7f5948071c00 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5948122230 con 0x7f5948071c00 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f593c001bc0 con 0x7f5948071c00 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:12.770 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 325315978 0 0) 0x7f594811ff40 con 0x7f59480a1530 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 >> v1:172.21.15.171:6791/0 conn(0x7f5948071c00 legacy=0x7f59481cf210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 >> v1:172.21.15.171:6790/0 conn(0x7f5948071730 legacy=0x7f5948132a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:12.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 monclient: found mon.i 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594809fb20 con 0x7f59480a1530 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 5 monclient: authenticate success, global_id 144556 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: _renew_subs 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f594809f660 con 0x7f59480a1530 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: _renew_subs 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f59481207f0 con 0x7f59480a1530 2024-04-26T00:00:12.772 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5940001e80 con 0x7f59480a1530 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59400054a0 con 0x7f59480a1530 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f59467fc640 4 set_mon_vals no callback set 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.767+0000 7f5944ff9640 10 monclient: dump: 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:12.773 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.771+0000 7f594e821640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.771+0000 7f594e821640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.771+0000 7f594e821640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.771+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5928005090 con 0x7f59480a1530 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.771+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5940010240 con 0x7f59480a1530 2024-04-26T00:00:12.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.771+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(154..154 src has 1..154) ==== 8396+0+0 (unknown 4202201568 0 0) 0x7f5940045af0 con 0x7f59480a1530 2024-04-26T00:00:12.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.771+0000 7f5947fff640 10 monclient: get_auth_request con 0x7f5934038210 auth_method 0 2024-04-26T00:00:12.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.775+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5940015c40 con 0x7f59480a1530 2024-04-26T00:00:12.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.775+0000 7f5944ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:12.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.775+0000 7f5944ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:12.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.939+0000 7f594e821640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}] 2024-04-26T00:00:12.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.939+0000 7f594e821640 10 monclient: _send_command 2 [{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}] 2024-04-26T00:00:12.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.939+0000 7f594e821640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:12.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:12.939+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]} v 0) -- 0x7f5928005380 con 0x7f59480a1530 2024-04-26T00:00:13.607 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:13.623+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}]=0 set osd(s) 0 to class 'globster' v155) ==== 145+0+0 (unknown 172702741 0 0) 0x7f5940015540 con 0x7f59480a1530 2024-04-26T00:00:13.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:13.623+0000 7f5944ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}] 2024-04-26T00:00:13.608 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:13.623+0000 7f5944ff9640 10 monclient: _finish_command 2 = system:0 set osd(s) 0 to class 'globster' 2024-04-26T00:00:13.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:13.727+0000 7f594e821640 10 start_mon_command cmd=[{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}] 2024-04-26T00:00:13.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:13.727+0000 7f594e821640 10 monclient: _send_command 3 [{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}] 2024-04-26T00:00:13.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:13.727+0000 7f594e821640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:13.713 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:13.727+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]} v 0) -- 0x7f5928000c00 con 0x7f59480a1530 2024-04-26T00:00:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.655+0000 7f5944ff9640 1 -- 172.21.15.171:0/1940396039 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}]=0 osd.0 already set to class globster. set-device-class item id 0 name 'osd.0' device_class 'globster': no change. set osd(s) to class 'globster' v156) ==== 257+0+0 (unknown 1607106326 0 0) 0x7f5940042620 con 0x7f59480a1530 2024-04-26T00:00:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.655+0000 7f5944ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush set-device-class", "class": "globster", "ids": ["osd.0"]}] 2024-04-26T00:00:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.655+0000 7f5944ff9640 10 monclient: _finish_command 3 = system:0 osd.0 already set to class globster. set-device-class item id 0 name 'osd.0' device_class 'globster': no change. set osd(s) to class 'globster' 2024-04-26T00:00:14.640 INFO:tasks.workunit.client.0.smithi171.stderr:osd.0 already set to class globster. set-device-class item id 0 name 'osd.0' device_class 'globster': no change. set osd(s) to class 'globster' 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 >> v1:172.21.15.171:6812/722422047 conn(0x7f5934038210 legacy=0x7f593403a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 10 monclient: shutdown 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 >> v1:172.21.15.171:6792/0 conn(0x7f59480a1530 legacy=0x7f59481d2940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 shutdown_connections 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 >> 172.21.15.171:0/1940396039 conn(0x7f59480a62d0 msgr2=0x7f59481bb720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 shutdown_connections 2024-04-26T00:00:14.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.659+0000 7f594e821640 1 -- 172.21.15.171:0/1940396039 wait complete. 2024-04-26T00:00:14.661 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:14.661 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:14.661 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep globster 2024-04-26T00:00:14.661 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '10\.' 2024-04-26T00:00:14.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient: get_monmap_and_config 2024-04-26T00:00:14.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient: build_initial_monmap 2024-04-26T00:00:14.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient: monmap: 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:14.799944+0000 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:14.799944+0000 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:14.779 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:14.780 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:14.780 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:14.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 1 Processor -- start 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 1 -- start start 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient: init 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient: _add_conns ranks=[7,3,2,4,1,6,5,8,0] 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient(hunting): picked mon.noname-i con 0x7f5eec0a1610 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient(hunting): picked mon.noname-g con 0x7f5eec135c00 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient(hunting): picked mon.noname-b con 0x7f5eec136070 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec072740 con 0x7f5eec136070 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec072a20 con 0x7f5eec135c00 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec072d00 con 0x7f5eec0a1610 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef400b640 10 monclient(hunting): authenticate will time out at 1265.507588s 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef15a6640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5eec135c00 0x7f5eec13a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:46708/0 (socket says 172.21.15.171:46708) 2024-04-26T00:00:14.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef15a6640 1 -- 172.21.15.171:0/399976705 learned_addr learned my addr 172.21.15.171:0/399976705 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.795+0000 7f5ef1da7640 1 --1- 172.21.15.171:0/399976705 >> v1:172.21.15.171:6792/0 conn(0x7f5eec0a1610 0x7f5eec0a19f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54588/0 (socket says 172.21.15.171:54588) 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827369010 0 0) 0x7f5eec072a20 con 0x7f5eec135c00 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): _negotiate 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): my global_id is 6402 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed8003530 con 0x7f5eec135c00 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919046717 0 0) 0x7f5eec072d00 con 0x7f5eec0a1610 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): _negotiate 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient(hunting): my global_id is 144565 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eec072a20 con 0x7f5eec0a1610 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1110829808 0 0) 0x7f5eec072a20 con 0x7f5eec0a1610 2024-04-26T00:00:14.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 >> v1:172.21.15.171:6790/0 conn(0x7f5eec135c00 legacy=0x7f5eec13a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 >> v1:172.21.15.106:6790/0 conn(0x7f5eec136070 legacy=0x7f5eec13e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: _finish_hunting 0 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 monclient: found mon.noname-i 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec0a4610 con 0x7f5eec0a1610 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: _finish_auth 0 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: _check_auth_tickets 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ee80016d0 con 0x7f5eec0a1610 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 5 monclient: authenticate success, global_id 144565 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:14.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: dump: 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:14.790 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ee8001940 con 0x7f5eec0a1610 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 4 set_mon_vals no callback set 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 1 -- 172.21.15.171:0/399976705 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ee80047f0 con 0x7f5eec0a1610 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef0da5640 10 monclient: dump: 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.791 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: shutdown 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- 172.21.15.171:0/399976705 >> v1:172.21.15.171:6792/0 conn(0x7f5eec0a1610 legacy=0x7f5eec0a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:14.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- 172.21.15.171:0/399976705 shutdown_connections 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- 172.21.15.171:0/399976705 >> 172.21.15.171:0/399976705 conn(0x7f5eec0a88b0 msgr2=0x7f5eec0a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- 172.21.15.171:0/399976705 shutdown_connections 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- 172.21.15.171:0/399976705 wait complete. 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: build_initial_monmap 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: monmap: 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:14.793 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 Processor -- start 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- start start 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: init 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:14.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: _add_conns ranks=[4,3,0,2,8,6,1,7,5] 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient(hunting): picked mon.noname-c con 0x7f5eec0a1610 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient(hunting): picked mon.noname-g con 0x7f5eec135c00 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient(hunting): picked mon.noname-a con 0x7f5eec136070 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec130ca0 con 0x7f5eec136070 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec0a2160 con 0x7f5eec135c00 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec0a13e0 con 0x7f5eec0a1610 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient(hunting): authenticate will time out at 1265.511001s 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef15a6640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f5eec135c00 0x7f5eec130590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:46720/0 (socket says 172.21.15.171:46720) 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef15a6640 1 -- 172.21.15.171:0/3477430868 learned_addr learned my addr 172.21.15.171:0/3477430868 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996545439 0 0) 0x7f5eec0a2160 con 0x7f5eec135c00 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:14.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): my global_id is 6411 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed0003530 con 0x7f5eec135c00 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3519262043 0 0) 0x7f5ed0003530 con 0x7f5eec135c00 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5eec0a2160 con 0x7f5eec135c00 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5edc001560 con 0x7f5eec135c00 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): dump: 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:14.796 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2530659281 0 0) 0x7f5eec0a2160 con 0x7f5eec135c00 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 >> v1:172.21.15.106:6791/0 conn(0x7f5eec0a1610 legacy=0x7f5eec12fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:14.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 >> v1:172.21.15.106:6789/0 conn(0x7f5eec136070 legacy=0x7f5eec1d26b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 monclient: found mon.g 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec132c10 con 0x7f5eec135c00 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 5 monclient: authenticate success, global_id 6411 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: _renew_subs 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec09dd30 con 0x7f5eec135c00 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: _renew_subs 2024-04-26T00:00:14.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5eec1d3dd0 con 0x7f5eec135c00 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5edc004aa0 con 0x7f5eec135c00 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.799+0000 7f5ee27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5edc004f90 con 0x7f5eec135c00 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ee27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ee3fff640 4 set_mon_vals no callback set 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ee27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ee27fc640 10 monclient: dump: 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:14.799 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ef400b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ef400b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ef400b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ed4005090 con 0x7f5eec135c00 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5edc005130 con 0x7f5eec135c00 2024-04-26T00:00:14.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(156..156 src has 1..156) ==== 9085+0+0 (unknown 988703048 0 0) 0x7f5edc045b90 con 0x7f5eec135c00 2024-04-26T00:00:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.803+0000 7f5ef1da7640 10 monclient: get_auth_request con 0x7f5ed00377e0 auth_method 0 2024-04-26T00:00:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.807+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5edc015840 con 0x7f5eec135c00 2024-04-26T00:00:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.807+0000 7f5ee27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:14.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.807+0000 7f5ee27fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:14.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.975+0000 7f5ef400b640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:14.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.975+0000 7f5ef400b640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:14.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.975+0000 7f5ef400b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:14.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.975+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f5ed4005380 con 0x7f5eec135c00 2024-04-26T00:00:14.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.975+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v156) ==== 83+0+2378 (unknown 2042302870 0 2052822566) 0x7f5edc0194f0 con 0x7f5eec135c00 2024-04-26T00:00:14.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.975+0000 7f5ee27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:14.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:14.975+0000 7f5ee27fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:15.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.079+0000 7f5ef400b640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.079+0000 7f5ef400b640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.079+0000 7f5ef400b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.079+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f5ed40065d0 con 0x7f5eec135c00 2024-04-26T00:00:15.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.079+0000 7f5ee27fc640 1 -- 172.21.15.171:0/3477430868 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v156) ==== 83+0+2378 (unknown 2042302870 0 2052822566) 0x7f5edc01ddb0 con 0x7f5eec135c00 2024-04-26T00:00:15.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.079+0000 7f5ee27fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.079+0000 7f5ee27fc640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:15.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 >> v1:172.21.15.171:6812/722422047 conn(0x7f5ed00377e0 legacy=0x7f5ed0039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 10 monclient: shutdown 2024-04-26T00:00:15.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:15.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 >> v1:172.21.15.171:6790/0 conn(0x7f5eec135c00 legacy=0x7f5eec130590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 shutdown_connections 2024-04-26T00:00:15.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 >> 172.21.15.171:0/3477430868 conn(0x7f5eec0a88b0 msgr2=0x7f5eec12eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:15.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 shutdown_connections 2024-04-26T00:00:15.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.083+0000 7f5ef400b640 1 -- 172.21.15.171:0/3477430868 wait complete. 2024-04-26T00:00:15.082 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:15.082 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:15.082 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:15.083 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:15.083 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep globster 2024-04-26T00:00:15.083 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '11\.' 2024-04-26T00:00:15.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient: get_monmap_and_config 2024-04-26T00:00:15.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient: build_initial_monmap 2024-04-26T00:00:15.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient: monmap: 2024-04-26T00:00:15.199 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:15.220628+0000 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:15.220628+0000 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:15.200 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:15.201 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:15.201 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 1 Processor -- start 2024-04-26T00:00:15.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 1 -- start start 2024-04-26T00:00:15.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient: init 2024-04-26T00:00:15.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:15.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient: _add_conns ranks=[2,1,7,5,4,3,8,0,6] 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient(hunting): picked mon.noname-b con 0x7fd710072210 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient(hunting): picked mon.noname-f con 0x7fd710137e20 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient(hunting): picked mon.noname-i con 0x7fd71013e3a0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd710072d00 con 0x7fd710137e20 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd71006faa0 con 0x7fd710072210 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd710072f20 con 0x7fd71013e3a0 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd71530b640 10 monclient(hunting): authenticate will time out at 1265.927765s 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd70f7fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fd71013e3a0 0x7fd710140790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54590/0 (socket says 172.21.15.171:54590) 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.215+0000 7fd70f7fe640 1 -- 172.21.15.171:0/2527212275 learned_addr learned my addr 172.21.15.171:0/2527212275 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2166788070 0 0) 0x7fd710072f20 con 0x7fd71013e3a0 2024-04-26T00:00:15.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): my global_id is 144574 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f8003530 con 0x7fd71013e3a0 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013880061 0 0) 0x7fd710072d00 con 0x7fd710137e20 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient(hunting): my global_id is 144667 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd710072f20 con 0x7fd710137e20 2024-04-26T00:00:15.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 442898698 0 0) 0x7fd6f8003530 con 0x7fd71013e3a0 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 >> v1:172.21.15.106:6790/0 conn(0x7fd710072210 legacy=0x7fd7100725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 >> v1:172.21.15.171:6789/0 conn(0x7fd710137e20 legacy=0x7fd71013cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 monclient: found mon.noname-i 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd71006f200 con 0x7fd71013e3a0 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd708001b80 con 0x7fd71013e3a0 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:15.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: dump: 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.212 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 5 monclient: authenticate success, global_id 144574 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:15.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd708001de0 con 0x7fd71013e3a0 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 1 -- 172.21.15.171:0/2527212275 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd708004f70 con 0x7fd71013e3a0 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 4 set_mon_vals no callback set 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70dffb640 10 monclient: dump: 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.214 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.215 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient: shutdown 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- 172.21.15.171:0/2527212275 >> v1:172.21.15.171:6792/0 conn(0x7fd71013e3a0 legacy=0x7fd710140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- 172.21.15.171:0/2527212275 shutdown_connections 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- 172.21.15.171:0/2527212275 >> 172.21.15.171:0/2527212275 conn(0x7fd7100a2620 msgr2=0x7fd7100a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- 172.21.15.171:0/2527212275 shutdown_connections 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- 172.21.15.171:0/2527212275 wait complete. 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient: build_initial_monmap 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient: monmap: 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:15.216 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:15.217 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 Processor -- start 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- start start 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient: init 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient: _add_conns ranks=[1,0,3,4,8,6,2,7,5] 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient(hunting): picked mon.noname-f con 0x7fd710072210 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient(hunting): picked mon.noname-a con 0x7fd710137e20 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:15.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient(hunting): picked mon.noname-g con 0x7fd71013e3a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd710131720 con 0x7fd710137e20 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd710129050 con 0x7fd710072210 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd71012fe90 con 0x7fd71013e3a0 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd71530b640 10 monclient(hunting): authenticate will time out at 1265.931114s 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70f7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd71013e3a0 0x7fd7101d4780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:46726/0 (socket says 172.21.15.171:46726) 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70f7fe640 1 -- 172.21.15.171:0/2136658983 learned_addr learned my addr 172.21.15.171:0/2136658983 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd70effd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd710072210 0x7fd710128230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54680/0 (socket says 172.21.15.171:54680) 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3416193109 0 0) 0x7fd710129050 con 0x7fd710072210 2024-04-26T00:00:15.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): my global_id is 144676 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6fc003560 con 0x7fd710072210 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933767008 0 0) 0x7fd71012fe90 con 0x7fd71013e3a0 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): my global_id is 6420 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd710129050 con 0x7fd71013e3a0 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1895885915 0 0) 0x7fd6fc003560 con 0x7fd710072210 2024-04-26T00:00:15.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd71012fe90 con 0x7fd710072210 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd700001a40 con 0x7fd710072210 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): dump: 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.221 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:15.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3884061841 0 0) 0x7fd710129050 con 0x7fd71013e3a0 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6fc003560 con 0x7fd71013e3a0 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 586960632 0 0) 0x7fd710131720 con 0x7fd710137e20 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): my global_id is 6318 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd710129050 con 0x7fd710137e20 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd708004eb0 con 0x7fd71013e3a0 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.219+0000 7fd6f77fe640 10 monclient(hunting): dump: 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.223 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.224 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 287835022 0 0) 0x7fd71012fe90 con 0x7fd710072210 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 >> v1:172.21.15.171:6790/0 conn(0x7fd71013e3a0 legacy=0x7fd7101d4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 >> v1:172.21.15.106:6789/0 conn(0x7fd710137e20 legacy=0x7fd710128940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 monclient: found mon.f 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd710131a00 con 0x7fd710072210 2024-04-26T00:00:15.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 5 monclient: authenticate success, global_id 144676 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 10 monclient: _renew_subs 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd71006ec60 con 0x7fd710072210 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 10 monclient: _renew_subs 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd710130280 con 0x7fd710072210 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7000038d0 con 0x7fd710072210 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:15.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd700003e40 con 0x7fd710072210 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd70d7fa640 4 set_mon_vals no callback set 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 10 monclient: dump: 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.227 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:15.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd700003fe0 con 0x7fd710072210 2024-04-26T00:00:15.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6f0005090 con 0x7fd710072210 2024-04-26T00:00:15.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(156..156 src has 1..156) ==== 9085+0+0 (unknown 988703048 0 0) 0x7fd700045940 con 0x7fd710072210 2024-04-26T00:00:15.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.223+0000 7fd70e7fc640 10 monclient: get_auth_request con 0x7fd6fc037ec0 auth_method 0 2024-04-26T00:00:15.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.227+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd7000156b0 con 0x7fd710072210 2024-04-26T00:00:15.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.227+0000 7fd6f77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:15.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.227+0000 7fd6f77fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:15.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.395+0000 7fd71530b640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.395+0000 7fd71530b640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.395+0000 7fd71530b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:15.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.395+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7fd6f0005380 con 0x7fd710072210 2024-04-26T00:00:15.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.395+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v156) ==== 83+0+2378 (unknown 2042302870 0 2052822566) 0x7fd700014fb0 con 0x7fd710072210 2024-04-26T00:00:15.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.395+0000 7fd6f77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.395+0000 7fd6f77fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:15.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:15.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7fd6f00065d0 con 0x7fd710072210 2024-04-26T00:00:15.482 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd6f77fe640 1 -- 172.21.15.171:0/2136658983 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v156) ==== 83+0+2378 (unknown 2042302870 0 2052822566) 0x7fd70001db60 con 0x7fd710072210 2024-04-26T00:00:15.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd6f77fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.483 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd6f77fe640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 >> v1:172.21.15.171:6812/722422047 conn(0x7fd6fc037ec0 legacy=0x7fd6fc03a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 10 monclient: shutdown 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 >> v1:172.21.15.171:6789/0 conn(0x7fd710072210 legacy=0x7fd710128230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 shutdown_connections 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 >> 172.21.15.171:0/2136658983 conn(0x7fd7100a2620 msgr2=0x7fd71009ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.499+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 shutdown_connections 2024-04-26T00:00:15.485 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.503+0000 7fd71530b640 1 -- 172.21.15.171:0/2136658983 wait complete. 2024-04-26T00:00:15.500 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:15.500 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:15.501 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:15.501 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:15.501 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '12\.' 2024-04-26T00:00:15.501 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep globster 2024-04-26T00:00:15.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.631+0000 7effb9be2640 10 monclient: get_monmap_and_config 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.631+0000 7effb9be2640 10 monclient: build_initial_monmap 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.631+0000 7effb9be2640 10 monclient: monmap: 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:15.637217+0000 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:15.637217+0000 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:15.616 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:15.617 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:15.617 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:15.617 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:15.617 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:15.617 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:15.617 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.631+0000 7effb9be2640 1 Processor -- start 2024-04-26T00:00:15.623 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.631+0000 7effb9be2640 1 -- start start 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.631+0000 7effb9be2640 10 monclient: init 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: _add_conns ranks=[3,7,2,0,8,5,4,6,1] 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): picked mon.noname-g con 0x7effb4135bb0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): picked mon.noname-i con 0x7effb41356f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): picked mon.noname-b con 0x7effb413c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40a1da0 con 0x7effb413c130 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40a1fe0 con 0x7effb4135bb0 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb4072720 con 0x7effb41356f0 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): authenticate will time out at 1266.344435s 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb2ffd640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7effb41356f0 0x7effb413aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54606/0 (socket says 172.21.15.171:54606) 2024-04-26T00:00:15.624 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb37fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7effb4135bb0 0x7effb4135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:46736/0 (socket says 172.21.15.171:46736) 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb2ffd640 1 -- 172.21.15.171:0/2014778507 learned_addr learned my addr 172.21.15.171:0/2014778507 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185452107 0 0) 0x7effb40a1fe0 con 0x7effb4135bb0 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): my global_id is 6429 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff9c003530 con 0x7effb4135bb0 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2450675523 0 0) 0x7effb4072720 con 0x7effb41356f0 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient(hunting): my global_id is 144583 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effb40a1fe0 con 0x7effb41356f0 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 869888866 0 0) 0x7eff9c003530 con 0x7effb4135bb0 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 >> v1:172.21.15.171:6792/0 conn(0x7effb41356f0 legacy=0x7effb413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.625 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 >> v1:172.21.15.106:6790/0 conn(0x7effb413c130 legacy=0x7effb413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 monclient: found mon.noname-g 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40a17f0 con 0x7effb4135bb0 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7effa4001b40 con 0x7effb4135bb0 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: dump: 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.626 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.627 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 5 monclient: authenticate success, global_id 6429 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effa4001e20 con 0x7effb4135bb0 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 4 set_mon_vals no callback set 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 1 -- 172.21.15.171:0/2014778507 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7effa4004eb0 con 0x7effb4135bb0 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb27fc640 10 monclient: dump: 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.628 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: shutdown 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- 172.21.15.171:0/2014778507 >> v1:172.21.15.171:6790/0 conn(0x7effb4135bb0 legacy=0x7effb4135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.629 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- 172.21.15.171:0/2014778507 shutdown_connections 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- 172.21.15.171:0/2014778507 >> 172.21.15.171:0/2014778507 conn(0x7effb40a2620 msgr2=0x7effb40a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- 172.21.15.171:0/2014778507 shutdown_connections 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- 172.21.15.171:0/2014778507 wait complete. 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: build_initial_monmap 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: monmap: 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:15.630 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 Processor -- start 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- start start 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: init 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient: _add_conns ranks=[4,2,3,1,0,7,8,5,6] 2024-04-26T00:00:15.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): picked mon.noname-c con 0x7effb41356f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): picked mon.noname-b con 0x7effb4135bb0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): picked mon.noname-g con 0x7effb413c130 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb40707e0 con 0x7effb4135bb0 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb4132850 con 0x7effb413c130 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effb4071ef0 con 0x7effb41356f0 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb9be2640 10 monclient(hunting): authenticate will time out at 1266.347609s 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb3fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7effb413c130 0x7effb41d4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:46742/0 (socket says 172.21.15.171:46742) 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7effb3fff640 1 -- 172.21.15.171:0/1829239213 learned_addr learned my addr 172.21.15.171:0/1829239213 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2808225764 0 0) 0x7effb4132850 con 0x7effb413c130 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7eff9bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7eff9bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:15.632 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7eff9bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7eff9bfff640 10 monclient(hunting): my global_id is 6438 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.635+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa0003530 con 0x7effb413c130 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3348559343 0 0) 0x7effa0003530 con 0x7effb413c130 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7effb4132850 con 0x7effb413c130 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7effac0019c0 con 0x7effb413c130 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient(hunting): dump: 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.633 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2747440247 0 0) 0x7effb4132850 con 0x7effb413c130 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 >> v1:172.21.15.106:6791/0 conn(0x7effb41356f0 legacy=0x7effb4131a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 >> v1:172.21.15.106:6790/0 conn(0x7effb4135bb0 legacy=0x7effb4132140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 monclient: found mon.g 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effb40719a0 con 0x7effb413c130 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: _finish_auth 0 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 5 monclient: authenticate success, global_id 6438 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 10 monclient: _renew_subs 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7effb409ebf0 con 0x7effb413c130 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 10 monclient: _renew_subs 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.635 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7effb4071430 con 0x7effb413c130 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7effac0038d0 con 0x7effb413c130 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb1ffb640 4 set_mon_vals no callback set 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7effac003e40 con 0x7effb413c130 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 10 monclient: dump: 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:15.636 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff94005090 con 0x7effb413c130 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7effac004060 con 0x7effb413c130 2024-04-26T00:00:15.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(156..156 src has 1..156) ==== 9085+0+0 (unknown 988703048 0 0) 0x7effac045b20 con 0x7effb413c130 2024-04-26T00:00:15.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.639+0000 7effb37fe640 10 monclient: get_auth_request con 0x7effa00376a0 auth_method 0 2024-04-26T00:00:15.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.643+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7effac015890 con 0x7effb413c130 2024-04-26T00:00:15.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.643+0000 7eff9bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:15.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.643+0000 7eff9bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:15.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.811+0000 7effb9be2640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.811+0000 7effb9be2640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.811+0000 7effb9be2640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.811+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7eff94005380 con 0x7effb413c130 2024-04-26T00:00:15.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.815+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v156) ==== 83+0+2378 (unknown 2042302870 0 2052822566) 0x7effac015190 con 0x7effb413c130 2024-04-26T00:00:15.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.815+0000 7eff9bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.815+0000 7eff9bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:15.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.911+0000 7effb9be2640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.911+0000 7effb9be2640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.911+0000 7effb9be2640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:15.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.911+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7eff94005ac0 con 0x7effb413c130 2024-04-26T00:00:15.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7eff9bfff640 1 -- 172.21.15.171:0/1829239213 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v156) ==== 83+0+2378 (unknown 2042302870 0 2052822566) 0x7effac01dd40 con 0x7effb413c130 2024-04-26T00:00:15.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7eff9bfff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:15.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7eff9bfff640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 >> v1:172.21.15.171:6812/722422047 conn(0x7effa00376a0 legacy=0x7effa0039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 10 monclient: shutdown 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 >> v1:172.21.15.171:6790/0 conn(0x7effb413c130 legacy=0x7effb41d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 shutdown_connections 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 >> 172.21.15.171:0/1829239213 conn(0x7effb40a2620 msgr2=0x7effb413e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 shutdown_connections 2024-04-26T00:00:15.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:15.915+0000 7effb9be2640 1 -- 172.21.15.171:0/1829239213 wait complete. 2024-04-26T00:00:15.913 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:15.913 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 10.50000 11.50000 12.50000 osd.0 2024-04-26T00:00:15.914 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight-compat osd.0 7.5 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.047+0000 7fae490f3640 10 monclient: get_monmap_and_config 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.047+0000 7fae490f3640 10 monclient: build_initial_monmap 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.047+0000 7fae490f3640 10 monclient: monmap: 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:16.054405+0000 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:16.054405+0000 2024-04-26T00:00:16.033 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:16.034 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:16.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 Processor -- start 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- start start 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: init 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: _add_conns ranks=[6,7,2,0,3,8,4,5,1] 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient(hunting): picked mon.noname-d con 0x7fae441379d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient(hunting): picked mon.noname-i con 0x7fae441384c0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient(hunting): picked mon.noname-b con 0x7fae4413e620 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae440a2b00 con 0x7fae4413e620 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae440a2de0 con 0x7fae441379d0 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae440a17a0 con 0x7fae441384c0 2024-04-26T00:00:16.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient(hunting): authenticate will time out at 1266.761305s 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae4259c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fae441384c0 0x7fae4413cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54608/0 (socket says 172.21.15.171:54608) 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae4259c640 1 -- 172.21.15.171:0/376854612 learned_addr learned my addr 172.21.15.171:0/376854612 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608968508 0 0) 0x7fae440a17a0 con 0x7fae441384c0 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient(hunting): my global_id is 144592 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae2c003530 con 0x7fae441384c0 2024-04-26T00:00:16.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 849169047 0 0) 0x7fae2c003530 con 0x7fae441384c0 2024-04-26T00:00:16.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 >> v1:172.21.15.106:6792/0 conn(0x7fae441379d0 legacy=0x7fae44137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:16.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 >> v1:172.21.15.106:6790/0 conn(0x7fae4413e620 legacy=0x7fae44140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:16.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:00:16.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 monclient: found mon.noname-i 2024-04-26T00:00:16.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:16.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:16.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae440a3b20 con 0x7fae441384c0 2024-04-26T00:00:16.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: _finish_auth 0 2024-04-26T00:00:16.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:00:16.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:16.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 5 monclient: authenticate success, global_id 144592 2024-04-26T00:00:16.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae380017c0 con 0x7fae441384c0 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: dump: 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.047 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae38001ab0 con 0x7fae441384c0 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:16.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 4 set_mon_vals no callback set 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 1 -- 172.21.15.171:0/376854612 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae38004bf0 con 0x7fae441384c0 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae41d9b640 10 monclient: dump: 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:16.049 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: shutdown 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- 172.21.15.171:0/376854612 >> v1:172.21.15.171:6792/0 conn(0x7fae441384c0 legacy=0x7fae4413cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- 172.21.15.171:0/376854612 shutdown_connections 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- 172.21.15.171:0/376854612 >> 172.21.15.171:0/376854612 conn(0x7fae440a6b30 msgr2=0x7fae440a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- 172.21.15.171:0/376854612 shutdown_connections 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- 172.21.15.171:0/376854612 wait complete. 2024-04-26T00:00:16.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: build_initial_monmap 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: monmap: 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:16.051 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 Processor -- start 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 1 -- start start 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.051+0000 7fae490f3640 10 monclient: init 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _add_conns ranks=[1,4,3,5,8,2,6,0,7] 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient(hunting): picked mon.noname-f con 0x7fae441379d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient(hunting): picked mon.noname-c con 0x7fae441384c0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient(hunting): picked mon.noname-g con 0x7fae4413e620 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae440a0fa0 con 0x7fae441379d0 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae44138cd0 con 0x7fae4413e620 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae4409c240 con 0x7fae441384c0 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:16.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient(hunting): authenticate will time out at 1266.764311s 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae4359e640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fae4413e620 0x7fae441d52f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:46750/0 (socket says 172.21.15.171:46750) 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae4359e640 1 -- 172.21.15.171:0/4267720686 learned_addr learned my addr 172.21.15.171:0/4267720686 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae42d9d640 1 --1- 172.21.15.171:0/4267720686 >> v1:172.21.15.171:6789/0 conn(0x7fae441379d0 0x7fae4409fad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54682/0 (socket says 172.21.15.171:54682) 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3330931092 0 0) 0x7fae440a0fa0 con 0x7fae441379d0 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): my global_id is 144685 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae30003530 con 0x7fae441379d0 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475086059 0 0) 0x7fae44138cd0 con 0x7fae4413e620 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): my global_id is 6447 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae440a0fa0 con 0x7fae4413e620 2024-04-26T00:00:16.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3599320468 0 0) 0x7fae30003530 con 0x7fae441379d0 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae44138cd0 con 0x7fae441379d0 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae34001a60 con 0x7fae441379d0 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): dump: 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:16.054 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4171330569 0 0) 0x7fae440a0fa0 con 0x7fae4413e620 2024-04-26T00:00:16.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae30003530 con 0x7fae4413e620 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 156684800 0 0) 0x7fae4409c240 con 0x7fae441384c0 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): my global_id is 144733 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae440a0fa0 con 0x7fae441384c0 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae3c001c40 con 0x7fae4413e620 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient(hunting): dump: 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.056 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:16.057 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:16.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2549355144 0 0) 0x7fae44138cd0 con 0x7fae441379d0 2024-04-26T00:00:16.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 >> v1:172.21.15.106:6791/0 conn(0x7fae441384c0 legacy=0x7fae441d1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:16.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 >> v1:172.21.15.171:6790/0 conn(0x7fae4413e620 legacy=0x7fae441d52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:16.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:16.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 monclient: found mon.f 2024-04-26T00:00:16.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:16.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:16.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae4409e5a0 con 0x7fae441379d0 2024-04-26T00:00:16.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:16.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:16.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:16.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 5 monclient: authenticate success, global_id 144685 2024-04-26T00:00:16.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _renew_subs 2024-04-26T00:00:16.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:16.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae440a01e0 con 0x7fae441379d0 2024-04-26T00:00:16.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _renew_subs 2024-04-26T00:00:16.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:16.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae441ccae0 con 0x7fae441379d0 2024-04-26T00:00:16.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae340038d0 con 0x7fae441379d0 2024-04-26T00:00:16.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:16.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fae34003e40 con 0x7fae441379d0 2024-04-26T00:00:16.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:16.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae4159a640 4 set_mon_vals no callback set 2024-04-26T00:00:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 10 monclient: dump: 2024-04-26T00:00:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:16.062 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.063 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:16.063 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:16.063 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:16.063 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:16.063 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:16.063 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:16.064 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:16.064 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:16.064 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:16.064 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:16.064 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:16.065 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:16.065 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:16.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:16.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:16.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:16.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fae34003fe0 con 0x7fae441379d0 2024-04-26T00:00:16.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae24005090 con 0x7fae441379d0 2024-04-26T00:00:16.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(156..156 src has 1..156) ==== 9085+0+0 (unknown 988703048 0 0) 0x7fae34045a00 con 0x7fae441379d0 2024-04-26T00:00:16.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.055+0000 7fae4259c640 10 monclient: get_auth_request con 0x7fae30038020 auth_method 0 2024-04-26T00:00:16.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.059+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fae340156d0 con 0x7fae441379d0 2024-04-26T00:00:16.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.059+0000 7fae2b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:16.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.059+0000 7fae2b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:16.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.219+0000 7fae490f3640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}] 2024-04-26T00:00:16.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.219+0000 7fae490f3640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}] 2024-04-26T00:00:16.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.219+0000 7fae490f3640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:16.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.219+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]} v 0) -- 0x7fae24005380 con 0x7fae441379d0 2024-04-26T00:00:16.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.547+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}]=0 v157) ==== 118+0+0 (unknown 1949066829 0 0) 0x7fae34019380 con 0x7fae441379d0 2024-04-26T00:00:16.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.547+0000 7fae2b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}] 2024-04-26T00:00:16.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.547+0000 7fae2b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:16.633 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.651+0000 7fae490f3640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}] 2024-04-26T00:00:16.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.651+0000 7fae490f3640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}] 2024-04-26T00:00:16.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.651+0000 7fae490f3640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:16.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:16.651+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]} v 0) -- 0x7fae24005770 con 0x7fae441379d0 2024-04-26T00:00:17.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.547+0000 7fae2b7fe640 1 -- 172.21.15.171:0/4267720686 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}]=0 v158) ==== 118+0+0 (unknown 3004103463 0 0) 0x7fae3401dc40 con 0x7fae441379d0 2024-04-26T00:00:17.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.547+0000 7fae2b7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight-compat", "item": "osd.0", "weight": [7.5]}] 2024-04-26T00:00:17.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.547+0000 7fae2b7fe640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:17.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 >> v1:172.21.15.171:6812/722422047 conn(0x7fae30038020 legacy=0x7fae3003a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:17.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 10 monclient: shutdown 2024-04-26T00:00:17.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:17.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 >> v1:172.21.15.171:6789/0 conn(0x7fae441379d0 legacy=0x7fae4409fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:17.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 shutdown_connections 2024-04-26T00:00:17.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 >> 172.21.15.171:0/4267720686 conn(0x7fae440a6b30 msgr2=0x7fae440a8a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:17.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 shutdown_connections 2024-04-26T00:00:17.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.551+0000 7fae490f3640 1 -- 172.21.15.171:0/4267720686 wait complete. 2024-04-26T00:00:17.550 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight cool osd.0 8.5 2024-04-26T00:00:17.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient: get_monmap_and_config 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient: build_initial_monmap 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient: monmap: 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:17.692198+0000 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:17.692198+0000 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:17.671 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:17.672 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:17.672 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:17.672 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:17.672 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:17.672 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 1 Processor -- start 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 1 -- start start 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient: init 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient: _add_conns ranks=[2,7,4,6,8,1,3,5,0] 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient(hunting): picked mon.noname-b con 0x7fcc9406f950 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient(hunting): picked mon.noname-i con 0x7fcc941378f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient(hunting): picked mon.noname-c con 0x7fcc9413b400 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc940a1e70 con 0x7fcc9406f950 2024-04-26T00:00:17.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc940714e0 con 0x7fcc9413b400 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc940717c0 con 0x7fcc941378f0 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc99e7a640 10 monclient(hunting): authenticate will time out at 1268.399695s 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc92ffd640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fcc941378f0 0x7fcc94139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54614/0 (socket says 172.21.15.171:54614) 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.687+0000 7fcc92ffd640 1 -- 172.21.15.171:0/2410415564 learned_addr learned my addr 172.21.15.171:0/2410415564 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2323531874 0 0) 0x7fcc940717c0 con 0x7fcc941378f0 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient(hunting): my global_id is 144601 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc7c003530 con 0x7fcc941378f0 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4119809773 0 0) 0x7fcc7c003530 con 0x7fcc941378f0 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 >> v1:172.21.15.106:6791/0 conn(0x7fcc9413b400 legacy=0x7fcc9413d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:17.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 >> v1:172.21.15.106:6790/0 conn(0x7fcc9406f950 legacy=0x7fcc9406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 monclient: found mon.noname-i 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc94071aa0 con 0x7fcc941378f0 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcc880017c0 con 0x7fcc941378f0 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: dump: 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:17.681 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:17.682 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 5 monclient: authenticate success, global_id 144601 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcc88001ab0 con 0x7fcc941378f0 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 4 set_mon_vals no callback set 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 1 -- 172.21.15.171:0/2410415564 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcc88004bf0 con 0x7fcc941378f0 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc927fc640 10 monclient: dump: 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.683 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: shutdown 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:17.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- 172.21.15.171:0/2410415564 >> v1:172.21.15.171:6792/0 conn(0x7fcc941378f0 legacy=0x7fcc94139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- 172.21.15.171:0/2410415564 shutdown_connections 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- 172.21.15.171:0/2410415564 >> 172.21.15.171:0/2410415564 conn(0x7fcc940a2690 msgr2=0x7fcc940a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- 172.21.15.171:0/2410415564 shutdown_connections 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- 172.21.15.171:0/2410415564 wait complete. 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: build_initial_monmap 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: monmap: 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:17.685 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:17.686 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:17.687 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:17.687 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:17.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 Processor -- start 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- start start 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: init 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: _add_conns ranks=[7,5,2,6,0,3,8,4,1] 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient(hunting): picked mon.noname-i con 0x7fcc9406f950 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient(hunting): picked mon.noname-h con 0x7fcc941378f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient(hunting): picked mon.noname-b con 0x7fcc9413b400 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc9409fa10 con 0x7fcc9413b400 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc9412d100 con 0x7fcc941378f0 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc94070b40 con 0x7fcc9406f950 2024-04-26T00:00:17.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient(hunting): authenticate will time out at 1268.402788s 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc92ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fcc941378f0 0x7fcc9412c9f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:40866/0 (socket says 172.21.15.171:40866) 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc92ffd640 1 -- 172.21.15.171:0/3958964337 learned_addr learned my addr 172.21.15.171:0/3958964337 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1342778237 0 0) 0x7fcc9412d100 con 0x7fcc941378f0 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): my global_id is 6107 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc80003530 con 0x7fcc941378f0 2024-04-26T00:00:17.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2479185172 0 0) 0x7fcc94070b40 con 0x7fcc9406f950 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): my global_id is 144610 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc9412d100 con 0x7fcc9406f950 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3378532841 0 0) 0x7fcc9412d100 con 0x7fcc9406f950 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcc94070b40 con 0x7fcc9406f950 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcc84001a20 con 0x7fcc9406f950 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:17.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): dump: 2024-04-26T00:00:17.691 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:17.691 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:17.691 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.691 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.691 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:17.691 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:17.691 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 907778806 0 0) 0x7fcc80003530 con 0x7fcc941378f0 2024-04-26T00:00:17.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcc9412d100 con 0x7fcc941378f0 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3545114978 0 0) 0x7fcc9409fa10 con 0x7fcc9413b400 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): my global_id is 6158 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcc80003530 con 0x7fcc9413b400 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcc88001780 con 0x7fcc941378f0 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:17.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient(hunting): dump: 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:17.694 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 272479207 0 0) 0x7fcc94070b40 con 0x7fcc9406f950 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 >> v1:172.21.15.171:6791/0 conn(0x7fcc941378f0 legacy=0x7fcc9412c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 >> v1:172.21.15.106:6790/0 conn(0x7fcc9413b400 legacy=0x7fcc941d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 monclient: found mon.i 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:17.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc94070760 con 0x7fcc9406f950 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: _finish_auth 0 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 5 monclient: authenticate success, global_id 144610 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: _renew_subs 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcc94135540 con 0x7fcc9406f950 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: _renew_subs 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:17.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fcc94138ce0 con 0x7fcc9406f950 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcc84001ce0 con 0x7fcc9406f950 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcc84003c70 con 0x7fcc9406f950 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc7bfff640 10 monclient: dump: 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:17.697 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:17.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.691+0000 7fcc91ffb640 4 set_mon_vals no callback set 2024-04-26T00:00:17.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.695+0000 7fcc99e7a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:17.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.695+0000 7fcc99e7a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:17.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.695+0000 7fcc99e7a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:17.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.695+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcc84003e10 con 0x7fcc9406f950 2024-04-26T00:00:17.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.695+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc74005090 con 0x7fcc9406f950 2024-04-26T00:00:17.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.695+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(158..158 src has 1..158) ==== 9023+0+0 (unknown 255996924 0 0) 0x7fcc840447f0 con 0x7fcc9406f950 2024-04-26T00:00:17.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.695+0000 7fcc92ffd640 10 monclient: get_auth_request con 0x7fcc80038040 auth_method 0 2024-04-26T00:00:17.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.699+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fcc84014580 con 0x7fcc9406f950 2024-04-26T00:00:17.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.699+0000 7fcc7bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:17.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.699+0000 7fcc7bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:17.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.863+0000 7fcc99e7a640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}] 2024-04-26T00:00:17.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.863+0000 7fcc99e7a640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}] 2024-04-26T00:00:17.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.863+0000 7fcc99e7a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:17.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:17.863+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]} v 0) -- 0x7fcc74005380 con 0x7fcc9406f950 2024-04-26T00:00:18.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:18.551+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}]=0 v159) ==== 127+0+0 (unknown 543606421 0 0) 0x7fcc84013e80 con 0x7fcc9406f950 2024-04-26T00:00:18.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:18.551+0000 7fcc7bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}] 2024-04-26T00:00:18.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:18.551+0000 7fcc7bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:18.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:18.655+0000 7fcc99e7a640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}] 2024-04-26T00:00:18.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:18.655+0000 7fcc99e7a640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}] 2024-04-26T00:00:18.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:18.655+0000 7fcc99e7a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:18.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:18.655+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]} v 0) -- 0x7fcc74001180 con 0x7fcc9406f950 2024-04-26T00:00:19.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.551+0000 7fcc7bfff640 1 -- 172.21.15.171:0/3958964337 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}]=0 v160) ==== 127+0+0 (unknown 1757210535 0 0) 0x7fcc74001180 con 0x7fcc9406f950 2024-04-26T00:00:19.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.551+0000 7fcc7bfff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight", "pool": "cool", "item": "osd.0", "weight": [8.5]}] 2024-04-26T00:00:19.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.551+0000 7fcc7bfff640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:19.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 >> v1:172.21.15.171:6812/722422047 conn(0x7fcc80038040 legacy=0x7fcc8003a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:19.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 10 monclient: shutdown 2024-04-26T00:00:19.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:19.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 >> v1:172.21.15.171:6792/0 conn(0x7fcc9406f950 legacy=0x7fcc9412c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:19.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 shutdown_connections 2024-04-26T00:00:19.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 >> 172.21.15.171:0/3958964337 conn(0x7fcc940a2690 msgr2=0x7fcc940a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:19.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 shutdown_connections 2024-04-26T00:00:19.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.555+0000 7fcc99e7a640 1 -- 172.21.15.171:0/3958964337 wait complete. 2024-04-26T00:00:19.556 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set reweight cold osd.0 6.5 6.6 2024-04-26T00:00:19.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.699+0000 7f7d8f4e2640 10 monclient: get_monmap_and_config 2024-04-26T00:00:19.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.699+0000 7f7d8f4e2640 10 monclient: build_initial_monmap 2024-04-26T00:00:19.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.699+0000 7f7d8f4e2640 10 monclient: monmap: 2024-04-26T00:00:19.684 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:19.684 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:19.684 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:19.705617+0000 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:19.705617+0000 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:19.685 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:19.686 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:19.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.699+0000 7f7d8f4e2640 1 Processor -- start 2024-04-26T00:00:19.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.699+0000 7f7d8f4e2640 1 -- start start 2024-04-26T00:00:19.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.699+0000 7f7d8f4e2640 10 monclient: init 2024-04-26T00:00:19.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:19.692 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: _add_conns ranks=[2,8,7,4,6,3,0,1,5] 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): picked mon.noname-b con 0x7f7d880a1530 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): picked mon.noname-e con 0x7f7d880a2020 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): picked mon.noname-i con 0x7f7d880724e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d8806ff60 con 0x7f7d880a1530 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d88071240 con 0x7f7d880724e0 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d88071520 con 0x7f7d880a2020 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): authenticate will time out at 1270.412524s 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8ca7d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f7d880a2020 legacy=0x7f7d88139a70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8da7f640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f7d880724e0 0x7f7d8813d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54626/0 (socket says 172.21.15.171:54626) 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8da7f640 1 -- 172.21.15.171:0/3875788497 learned_addr learned my addr 172.21.15.171:0/3875788497 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2953885455 0 0) 0x7f7d88071240 con 0x7f7d880724e0 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:19.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): my global_id is 144619 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d74003530 con 0x7f7d880724e0 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555108187 0 0) 0x7f7d8806ff60 con 0x7f7d880a1530 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient(hunting): my global_id is 6167 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d88071240 con 0x7f7d880a1530 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1791269087 0 0) 0x7f7d74003530 con 0x7f7d880724e0 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 >> v1:172.21.15.106:6793/0 conn(0x7f7d880a2020 legacy=0x7f7d88139a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 >> v1:172.21.15.106:6790/0 conn(0x7f7d880a1530 legacy=0x7f7d880a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:19.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 monclient: found mon.noname-i 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d880a2fc0 con 0x7f7d880724e0 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: _finish_auth 0 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7d80001b40 con 0x7f7d880724e0 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 5 monclient: authenticate success, global_id 144619 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: dump: 2024-04-26T00:00:19.695 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:19.696 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:19.696 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.696 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.696 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:19.696 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:19.696 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:19.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d80001e60 con 0x7f7d880724e0 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 1 -- 172.21.15.171:0/3875788497 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7d80004f70 con 0x7f7d880724e0 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 4 set_mon_vals no callback set 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d7ffff640 10 monclient: dump: 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:19.698 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: shutdown 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3875788497 >> v1:172.21.15.171:6792/0 conn(0x7f7d880724e0 legacy=0x7f7d8813d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:19.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3875788497 shutdown_connections 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3875788497 >> 172.21.15.171:0/3875788497 conn(0x7f7d880a6180 msgr2=0x7f7d880a2620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3875788497 shutdown_connections 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3875788497 wait complete. 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: build_initial_monmap 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: monmap: 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:19.700 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 Processor -- start 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- start start 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: init 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient: _add_conns ranks=[2,4,1,8,5,6,3,7,0] 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): picked mon.noname-b con 0x7f7d880724e0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): picked mon.noname-c con 0x7f7d880a1530 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:19.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): picked mon.noname-f con 0x7f7d880a2020 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d880707e0 con 0x7f7d880a2020 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d881a3980 con 0x7f7d880724e0 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d881a5990 con 0x7f7d880a1530 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8f4e2640 10 monclient(hunting): authenticate will time out at 1270.415863s 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8da7f640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7d880a2020 0x7f7d881d0500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:54688/0 (socket says 172.21.15.171:54688) 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.703+0000 7f7d8da7f640 1 -- 172.21.15.171:0/3653747456 learned_addr learned my addr 172.21.15.171:0/3653747456 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175999724 0 0) 0x7f7d880707e0 con 0x7f7d880a2020 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:19.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): my global_id is 144694 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d6c003530 con 0x7f7d880a2020 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2986375309 0 0) 0x7f7d6c003530 con 0x7f7d880a2020 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7d880707e0 con 0x7f7d880a2020 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7d80001b00 con 0x7f7d880a2020 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:19.703 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781232267 0 0) 0x7f7d881a5990 con 0x7f7d880a1530 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:19.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): my global_id is 144751 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d6c003530 con 0x7f7d880a1530 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790835491 0 0) 0x7f7d881a3980 con 0x7f7d880724e0 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient(hunting): my global_id is 6176 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d881a5990 con 0x7f7d880724e0 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3630004912 0 0) 0x7f7d880707e0 con 0x7f7d880a2020 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 >> v1:172.21.15.106:6791/0 conn(0x7f7d880a1530 legacy=0x7f7d881ccdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 >> v1:172.21.15.106:6790/0 conn(0x7f7d880724e0 legacy=0x7f7d881b82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 monclient: found mon.f 2024-04-26T00:00:19.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d881a5c70 con 0x7f7d880a2020 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 5 monclient: authenticate success, global_id 144694 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 10 monclient: _renew_subs 2024-04-26T00:00:19.706 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7d881a4230 con 0x7f7d880a2020 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 10 monclient: _renew_subs 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7d881b8b90 con 0x7f7d880a2020 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7d80001e60 con 0x7f7d880a2020 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7d80002010 con 0x7f7d880a2020 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7f7fe640 4 set_mon_vals no callback set 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:19.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 10 monclient: dump: 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:19.708 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d68005090 con 0x7f7d880a2020 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7d800103f0 con 0x7f7d880a2020 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(160..160 src has 1..160) ==== 9023+0+0 (unknown 2640140769 0 0) 0x7f7d80045eb0 con 0x7f7d880a2020 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.707+0000 7f7d8d27e640 10 monclient: get_auth_request con 0x7f7d6c037a40 auth_method 0 2024-04-26T00:00:19.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.711+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7d80015cc0 con 0x7f7d880a2020 2024-04-26T00:00:19.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.711+0000 7f7d7dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:19.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.711+0000 7f7d7dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:19.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.875+0000 7f7d8f4e2640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}] 2024-04-26T00:00:19.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.875+0000 7f7d8f4e2640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}] 2024-04-26T00:00:19.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.875+0000 7f7d8f4e2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:19.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:19.875+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]} v 0) -- 0x7f7d68005380 con 0x7f7d880a2020 2024-04-26T00:00:20.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:20.563+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}]=0 v161) ==== 132+0+0 (unknown 185118270 0 0) 0x7f7d8001e170 con 0x7f7d880a2020 2024-04-26T00:00:20.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:20.563+0000 7f7d7dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}] 2024-04-26T00:00:20.548 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:20.563+0000 7f7d7dffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:20.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:20.675+0000 7f7d8f4e2640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}] 2024-04-26T00:00:20.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:20.675+0000 7f7d8f4e2640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}] 2024-04-26T00:00:20.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:20.675+0000 7f7d8f4e2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:20.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:20.675+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]} v 0) -- 0x7f7d68001180 con 0x7f7d880a2020 2024-04-26T00:00:21.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.575+0000 7f7d7dffb640 1 -- 172.21.15.171:0/3653747456 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}]=0 v162) ==== 132+0+0 (unknown 2760931569 0 0) 0x7f7d68001180 con 0x7f7d880a2020 2024-04-26T00:00:21.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.575+0000 7f7d7dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set reweight", "pool": "cold", "item": "osd.0", "weight": [6.5, 6.6]}] 2024-04-26T00:00:21.559 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.575+0000 7f7d7dffb640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:21.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 >> v1:172.21.15.171:6812/722422047 conn(0x7f7d6c037a40 legacy=0x7f7d6c039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:21.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 10 monclient: shutdown 2024-04-26T00:00:21.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:21.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 >> v1:172.21.15.171:6789/0 conn(0x7f7d880a2020 legacy=0x7f7d881d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:21.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 shutdown_connections 2024-04-26T00:00:21.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 >> 172.21.15.171:0/3653747456 conn(0x7f7d880a6180 msgr2=0x7f7d881bb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:21.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 shutdown_connections 2024-04-26T00:00:21.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.579+0000 7f7d8f4e2640 1 -- 172.21.15.171:0/3653747456 wait complete. 2024-04-26T00:00:21.590 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:21.590 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:21.590 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '7\.' 2024-04-26T00:00:21.591 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep globster 2024-04-26T00:00:21.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.727+0000 7f766d9ce640 10 monclient: get_monmap_and_config 2024-04-26T00:00:21.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.727+0000 7f766d9ce640 10 monclient: build_initial_monmap 2024-04-26T00:00:21.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.727+0000 7f766d9ce640 10 monclient: monmap: 2024-04-26T00:00:21.711 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:21.711 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:21.711 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:21.732676+0000 2024-04-26T00:00:21.711 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:21.732676+0000 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:21.712 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.727+0000 7f766d9ce640 1 Processor -- start 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.727+0000 7f766d9ce640 1 -- start start 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.727+0000 7f766d9ce640 10 monclient: init 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: _add_conns ranks=[1,3,4,2,7,6,8,5,0] 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): picked mon.noname-f con 0x7f76680a3930 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): picked mon.noname-g con 0x7f7668138150 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): picked mon.noname-c con 0x7f7668138570 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680a2b70 con 0x7f76680a3930 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680a2e50 con 0x7f7668138150 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76680a4460 con 0x7f7668138570 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:21.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): authenticate will time out at 1272.440187s 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f765ffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f7668138150 0x7f766813cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:45712/0 (socket says 172.21.15.171:45712) 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f765ffff640 1 -- 172.21.15.171:0/947754193 learned_addr learned my addr 172.21.15.171:0/947754193 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2216766914 0 0) 0x7f76680a2b70 con 0x7f76680a3930 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): my global_id is 144703 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7654003530 con 0x7f76680a3930 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876424258 0 0) 0x7f76680a2e50 con 0x7f7668138150 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient(hunting): my global_id is 6456 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76680a2b70 con 0x7f7668138150 2024-04-26T00:00:21.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2049897056 0 0) 0x7f76680a2b70 con 0x7f7668138150 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 >> v1:172.21.15.106:6791/0 conn(0x7f7668138570 legacy=0x7f76681406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 >> v1:172.21.15.171:6789/0 conn(0x7f76680a3930 legacy=0x7f7668137a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 monclient: found mon.noname-g 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76680a1810 con 0x7f7668138150 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76500017c0 con 0x7f7668138150 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 5 monclient: authenticate success, global_id 6456 2024-04-26T00:00:21.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: dump: 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:21.723 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76500019b0 con 0x7f7668138150 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 1 -- 172.21.15.171:0/947754193 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7650004bf0 con 0x7f7668138150 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 4 set_mon_vals no callback set 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76667fc640 10 monclient: dump: 2024-04-26T00:00:21.724 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:21.725 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: shutdown 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- 172.21.15.171:0/947754193 >> v1:172.21.15.171:6790/0 conn(0x7f7668138150 legacy=0x7f766813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- 172.21.15.171:0/947754193 shutdown_connections 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- 172.21.15.171:0/947754193 >> 172.21.15.171:0/947754193 conn(0x7f76680a6d70 msgr2=0x7f76680a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- 172.21.15.171:0/947754193 shutdown_connections 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- 172.21.15.171:0/947754193 wait complete. 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: build_initial_monmap 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: monmap: 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:21.726 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 Processor -- start 2024-04-26T00:00:21.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- start start 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: init 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient: _add_conns ranks=[5,0,1,8,7,3,4,2,6] 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): picked mon.noname-h con 0x7f76680a3930 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): picked mon.noname-a con 0x7f7668138150 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): picked mon.noname-f con 0x7f7668138570 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f766809eb50 con 0x7f7668138150 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7668120a40 con 0x7f7668138570 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7668120d20 con 0x7f76680a3930 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f766d9ce640 10 monclient(hunting): authenticate will time out at 1272.443190s 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76677fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7668138570 0x7f76681d4de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60166/0 (socket says 172.21.15.171:60166) 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7666ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f76680a3930 0x7f7668133900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47426/0 (socket says 172.21.15.171:47426) 2024-04-26T00:00:21.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f76677fe640 1 -- 172.21.15.171:0/2258723659 learned_addr learned my addr 172.21.15.171:0/2258723659 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1781607895 0 0) 0x7f7668120a40 con 0x7f7668138570 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): my global_id is 144712 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7648003530 con 0x7f7668138570 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1105380766 0 0) 0x7f7668120d20 con 0x7f76680a3930 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): my global_id is 6116 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7668120a40 con 0x7f76680a3930 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3630596226 0 0) 0x7f7648003530 con 0x7f7668138570 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7668120d20 con 0x7f7668138570 2024-04-26T00:00:21.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1506363913 0 0) 0x7f7668120a40 con 0x7f76680a3930 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7648003530 con 0x7f76680a3930 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7660001da0 con 0x7f7668138570 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:21.730 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7658001890 con 0x7f76680a3930 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:21.731 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:21.732 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1850279169 0 0) 0x7f766809eb50 con 0x7f7668138150 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 10 monclient(hunting): my global_id is 6327 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.731+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7668120a40 con 0x7f7668138150 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1301929323 0 0) 0x7f7668120d20 con 0x7f7668138570 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 >> v1:172.21.15.171:6791/0 conn(0x7f76680a3930 legacy=0x7f7668133900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 >> v1:172.21.15.106:6789/0 conn(0x7f7668138150 legacy=0x7f76681d16b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 monclient: found mon.f 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:21.733 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76681206f0 con 0x7f7668138570 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 5 monclient: authenticate success, global_id 144712 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 10 monclient: _renew_subs 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f766809f6b0 con 0x7f7668138570 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 10 monclient: _renew_subs 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f76681341e0 con 0x7f7668138570 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7660003c50 con 0x7f7668138570 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:21.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76600041c0 con 0x7f7668138570 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7665ffb640 4 set_mon_vals no callback set 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 10 monclient: dump: 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:21.735 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7660004360 con 0x7f7668138570 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(162..162 src has 29..162) ==== 9023+0+0 (unknown 2298669789 0 0) 0x7f7660045d20 con 0x7f7668138570 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f764c005090 con 0x7f7668138570 2024-04-26T00:00:21.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.735+0000 7f7666ffd640 10 monclient: get_auth_request con 0x7f7648037eb0 auth_method 0 2024-04-26T00:00:21.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.739+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7660015ab0 con 0x7f7668138570 2024-04-26T00:00:21.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.739+0000 7f7664ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:21.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.739+0000 7f7664ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:21.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.907+0000 7f766d9ce640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:21.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.907+0000 7f766d9ce640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:21.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.907+0000 7f766d9ce640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:21.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.907+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f764c005380 con 0x7f7668138570 2024-04-26T00:00:21.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.911+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v162) ==== 83+0+2320 (unknown 1241242665 0 3681347290) 0x7f76600153b0 con 0x7f7668138570 2024-04-26T00:00:21.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.911+0000 7f7664ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:21.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:21.911+0000 7f7664ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.015+0000 7f766d9ce640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.015+0000 7f766d9ce640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.015+0000 7f766d9ce640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:21.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.015+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f764c0010a0 con 0x7f7668138570 2024-04-26T00:00:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.015+0000 7f7664ff9640 1 -- 172.21.15.171:0/2258723659 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v162) ==== 83+0+2320 (unknown 1241242665 0 3681347290) 0x7f766001df60 con 0x7f7668138570 2024-04-26T00:00:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.015+0000 7f7664ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.015+0000 7f7664ff9640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 >> v1:172.21.15.171:6812/722422047 conn(0x7f7648037eb0 legacy=0x7f764803a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 10 monclient: shutdown 2024-04-26T00:00:22.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:22.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 >> v1:172.21.15.171:6789/0 conn(0x7f7668138570 legacy=0x7f76681d4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 shutdown_connections 2024-04-26T00:00:22.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 >> 172.21.15.171:0/2258723659 conn(0x7f76680a6d70 msgr2=0x7f76680a8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:22.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 shutdown_connections 2024-04-26T00:00:22.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.019+0000 7f766d9ce640 1 -- 172.21.15.171:0/2258723659 wait complete. 2024-04-26T00:00:22.016 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 7.50000 8.50000 6.50000 osd.0 2024-04-26T00:00:22.017 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 7.50000 8.50000 6.50000 osd.0 2024-04-26T00:00:22.017 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:22.017 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:22.018 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep globster 2024-04-26T00:00:22.018 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '8\.' 2024-04-26T00:00:22.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 10 monclient: get_monmap_and_config 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 10 monclient: build_initial_monmap 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 10 monclient: monmap: 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:22.149012+0000 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:22.149012+0000 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:22.128 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:22.129 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:22.129 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:22.129 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:22.129 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:22.129 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:22.129 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:22.129 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 1 Processor -- start 2024-04-26T00:00:22.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 1 -- start start 2024-04-26T00:00:22.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 10 monclient: init 2024-04-26T00:00:22.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 10 monclient: _add_conns ranks=[4,0,3,7,5,2,1,6,8] 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.143+0000 7f88f3668640 10 monclient(hunting): picked mon.noname-c con 0x7f88ec135bb0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): picked mon.noname-a con 0x7f88ec1356f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): picked mon.noname-g con 0x7f88ec13c130 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec0a1da0 con 0x7f88ec1356f0 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec0a1fe0 con 0x7f88ec13c130 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec072720 con 0x7f88ec135bb0 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): authenticate will time out at 1272.856146s 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f1c05640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f88ec13c130 0x7f88ec13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:45718/0 (socket says 172.21.15.171:45718) 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f1c05640 1 -- 172.21.15.171:0/2039503556 learned_addr learned my addr 172.21.15.171:0/2039503556 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839021485 0 0) 0x7f88ec0a1fe0 con 0x7f88ec13c130 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient(hunting): my global_id is 6465 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88d4003530 con 0x7f88ec13c130 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 930799337 0 0) 0x7f88d4003530 con 0x7f88ec13c130 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 >> v1:172.21.15.106:6791/0 conn(0x7f88ec135bb0 legacy=0x7f88ec135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 >> v1:172.21.15.106:6789/0 conn(0x7f88ec1356f0 legacy=0x7f88ec13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 monclient: found mon.noname-g 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec0a17f0 con 0x7f88ec13c130 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: _finish_auth 0 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:22.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f88dc0017c0 con 0x7f88ec13c130 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 5 monclient: authenticate success, global_id 6465 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: dump: 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.139 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88dc001a20 con 0x7f88ec13c130 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 1 -- 172.21.15.171:0/2039503556 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f88dc004bf0 con 0x7f88ec13c130 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 4 set_mon_vals no callback set 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:22.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88ebfff640 10 monclient: dump: 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.141 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient: shutdown 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- 172.21.15.171:0/2039503556 >> v1:172.21.15.171:6790/0 conn(0x7f88ec13c130 legacy=0x7f88ec13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- 172.21.15.171:0/2039503556 shutdown_connections 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- 172.21.15.171:0/2039503556 >> 172.21.15.171:0/2039503556 conn(0x7f88ec0a2620 msgr2=0x7f88ec0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- 172.21.15.171:0/2039503556 shutdown_connections 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- 172.21.15.171:0/2039503556 wait complete. 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient: build_initial_monmap 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient: monmap: 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:22.142 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 Processor -- start 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- start start 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient: init 2024-04-26T00:00:22.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient: _add_conns ranks=[3,2,8,7,6,1,4,5,0] 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): picked mon.noname-g con 0x7f88ec1356f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): picked mon.noname-b con 0x7f88ec135bb0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): picked mon.noname-e con 0x7f88ec13c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec12faf0 con 0x7f88ec135bb0 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec0719a0 con 0x7f88ec1356f0 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ec1316a0 con 0x7f88ec13c130 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f3668640 10 monclient(hunting): authenticate will time out at 1272.859317s 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f1c05640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f88ec13c130 legacy=0x7f88ec1d2c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f1404640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f88ec1356f0 0x7f88ec132bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:45734/0 (socket says 172.21.15.171:45734) 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88f1404640 1 -- 172.21.15.171:0/869573771 learned_addr learned my addr 172.21.15.171:0/869573771 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4048433879 0 0) 0x7f88ec072720 con 0x7f88ec1356f0 2024-04-26T00:00:22.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 10 monclient(hunting): my global_id is 6474 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88d8003530 con 0x7f88ec1356f0 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1967944608 0 0) 0x7f88d8003530 con 0x7f88ec1356f0 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88ec072720 con 0x7f88ec1356f0 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f88e4001ea0 con 0x7f88ec1356f0 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:22.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.147+0000 7f88e9ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.146 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308492384 0 0) 0x7f88ec0a1da0 con 0x7f88ec135bb0 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient(hunting): my global_id is 6185 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88d8003530 con 0x7f88ec135bb0 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3262592722 0 0) 0x7f88ec072720 con 0x7f88ec1356f0 2024-04-26T00:00:22.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 >> v1:172.21.15.106:6793/0 conn(0x7f88ec13c130 legacy=0x7f88ec1d2c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 >> v1:172.21.15.106:6790/0 conn(0x7f88ec135bb0 legacy=0x7f88ec1cf4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 monclient: found mon.g 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ec12f3b0 con 0x7f88ec1356f0 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 5 monclient: authenticate success, global_id 6474 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 10 monclient: _renew_subs 2024-04-26T00:00:22.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88ec130e00 con 0x7f88ec1356f0 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 10 monclient: _renew_subs 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f88ec1332e0 con 0x7f88ec1356f0 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88e4003cd0 con 0x7f88ec1356f0 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f88e4004240 con 0x7f88ec1356f0 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88eb7fe640 4 set_mon_vals no callback set 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 10 monclient: dump: 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.149 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f88e40043e0 con 0x7f88ec1356f0 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88cc005090 con 0x7f88ec1356f0 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(162..162 src has 29..162) ==== 9023+0+0 (unknown 2298669789 0 0) 0x7f88e4045f00 con 0x7f88ec1356f0 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.151+0000 7f88f0c03640 10 monclient: get_auth_request con 0x7f88d8037850 auth_method 0 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.155+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f88ec0719a0 con 0x7f88ec1356f0 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.155+0000 7f88e9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.155+0000 7f88e9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:22.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.307+0000 7f88f3668640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.307+0000 7f88f3668640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.307+0000 7f88f3668640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:22.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.307+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f88cc005380 con 0x7f88ec1356f0 2024-04-26T00:00:22.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.311+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v162) ==== 83+0+2320 (unknown 1241242665 0 3681347290) 0x7f88e4015c90 con 0x7f88ec1356f0 2024-04-26T00:00:22.293 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.311+0000 7f88e9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.311+0000 7f88e9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:22.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.403+0000 7f88f3668640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.403+0000 7f88f3668640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.403+0000 7f88f3668640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:22.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.403+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7f88cc0065d0 con 0x7f88ec1356f0 2024-04-26T00:00:22.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.403+0000 7f88e9ffb640 1 -- 172.21.15.171:0/869573771 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v162) ==== 83+0+2320 (unknown 1241242665 0 3681347290) 0x7f88e40047b0 con 0x7f88ec1356f0 2024-04-26T00:00:22.387 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.403+0000 7f88e9ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.388 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.403+0000 7f88e9ffb640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 >> v1:172.21.15.171:6812/722422047 conn(0x7f88d8037850 legacy=0x7f88d8039d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 10 monclient: shutdown 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 >> v1:172.21.15.171:6790/0 conn(0x7f88ec1356f0 legacy=0x7f88ec132bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 shutdown_connections 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 >> 172.21.15.171:0/869573771 conn(0x7f88ec0a2620 msgr2=0x7f88ec133ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 shutdown_connections 2024-04-26T00:00:22.390 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.407+0000 7f88f3668640 1 -- 172.21.15.171:0/869573771 wait complete. 2024-04-26T00:00:22.403 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 7.50000 8.50000 6.50000 osd.0 2024-04-26T00:00:22.403 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 7.50000 8.50000 6.50000 osd.0 2024-04-26T00:00:22.404 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush tree --show-shadow 2024-04-26T00:00:22.404 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep 'osd\.0' 2024-04-26T00:00:22.404 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep globster 2024-04-26T00:00:22.404 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep '6\.' 2024-04-26T00:00:22.517 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient: get_monmap_and_config 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient: build_initial_monmap 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient: monmap: 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:22.539335+0000 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:22.539335+0000 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:22.518 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:22.519 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:22.519 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:22.519 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:22.519 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:22.519 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:22.519 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:22.519 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 1 Processor -- start 2024-04-26T00:00:22.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 1 -- start start 2024-04-26T00:00:22.525 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient: init 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient: _add_conns ranks=[5,4,3,7,1,8,6,2,0] 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient(hunting): picked mon.noname-h con 0x7fb34809ff90 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient(hunting): picked mon.noname-c con 0x7fb3481343f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient(hunting): picked mon.noname-g con 0x7fb348134850 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34809f240 con 0x7fb348134850 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34809f4b0 con 0x7fb3481343f0 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34809f790 con 0x7fb34809ff90 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient(hunting): authenticate will time out at 1273.246989s 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb346ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb34809ff90 0x7fb348133ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47432/0 (socket says 172.21.15.171:47432) 2024-04-26T00:00:22.526 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb346ffd640 1 -- 172.21.15.171:0/3848883578 learned_addr learned my addr 172.21.15.171:0/3848883578 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296367940 0 0) 0x7fb34809f240 con 0x7fb348134850 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): my global_id is 6483 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb330003530 con 0x7fb348134850 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2827515826 0 0) 0x7fb34809f790 con 0x7fb34809ff90 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient(hunting): my global_id is 6125 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34809f240 con 0x7fb34809ff90 2024-04-26T00:00:22.527 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2091277202 0 0) 0x7fb34809f240 con 0x7fb34809ff90 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 >> v1:172.21.15.106:6791/0 conn(0x7fb3481343f0 legacy=0x7fb348139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 >> v1:172.21.15.171:6790/0 conn(0x7fb348134850 legacy=0x7fb34813c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 monclient: found mon.noname-h 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34809fa70 con 0x7fb34809ff90 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3380016b0 con 0x7fb34809ff90 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: dump: 2024-04-26T00:00:22.528 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.529 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 5 monclient: authenticate success, global_id 6125 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb338001850 con 0x7fb34809ff90 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 1 -- 172.21.15.171:0/3848883578 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3380048b0 con 0x7fb34809ff90 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb34d950640 4 set_mon_vals no callback set 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.535+0000 7fb345ffb640 10 monclient: dump: 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.530 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: shutdown 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:22.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3848883578 >> v1:172.21.15.171:6791/0 conn(0x7fb34809ff90 legacy=0x7fb348133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3848883578 shutdown_connections 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3848883578 >> 172.21.15.171:0/3848883578 conn(0x7fb3480a6850 msgr2=0x7fb3480a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3848883578 shutdown_connections 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3848883578 wait complete. 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: build_initial_monmap 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: monmap: 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:22.532 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 Processor -- start 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- start start 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: init 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _add_conns ranks=[8,1,0,3,4,7,6,2,5] 2024-04-26T00:00:22.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient(hunting): picked mon.noname-e con 0x7fb34809ff90 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient(hunting): picked mon.noname-f con 0x7fb3481343f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient(hunting): picked mon.noname-a con 0x7fb348134850 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3480716c0 con 0x7fb348134850 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3480a2370 con 0x7fb3481343f0 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb348073110 con 0x7fb34809ff90 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient(hunting): authenticate will time out at 1273.250050s 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb346ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb34809ff90 legacy=0x7fb348130d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb3467fc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb3481343f0 0x7fb3481cd560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60174/0 (socket says 172.21.15.171:60174) 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb3467fc640 1 -- 172.21.15.171:0/3820472914 learned_addr learned my addr 172.21.15.171:0/3820472914 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1318042503 0 0) 0x7fb34809f4b0 con 0x7fb3481343f0 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): my global_id is 144721 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb334003530 con 0x7fb3481343f0 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 811277629 0 0) 0x7fb334003530 con 0x7fb3481343f0 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb34809f4b0 con 0x7fb3481343f0 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb33c001ae0 con 0x7fb3481343f0 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): dump: 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.535 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2342635185 0 0) 0x7fb3480716c0 con 0x7fb348134850 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.536 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient(hunting): my global_id is 6345 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb334003530 con 0x7fb348134850 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1619447109 0 0) 0x7fb34809f4b0 con 0x7fb3481343f0 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 >> v1:172.21.15.106:6793/0 conn(0x7fb34809ff90 legacy=0x7fb348130d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 >> v1:172.21.15.106:6789/0 conn(0x7fb348134850 legacy=0x7fb3481d0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 monclient: found mon.f 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3480733f0 con 0x7fb3481343f0 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: _finish_auth 0 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 5 monclient: authenticate success, global_id 144721 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _renew_subs 2024-04-26T00:00:22.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb3481c56f0 con 0x7fb3481343f0 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _renew_subs 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb348131640 con 0x7fb3481343f0 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb33c003950 con 0x7fb3481343f0 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb33c003ec0 con 0x7fb3481343f0 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb3457fa640 4 set_mon_vals no callback set 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 10 monclient: dump: 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.538 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.539 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb328005090 con 0x7fb3481343f0 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.539+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb33c004060 con 0x7fb3481343f0 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.543+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(162..162 src has 29..162) ==== 9023+0+0 (unknown 2298669789 0 0) 0x7fb33c045b50 con 0x7fb3481343f0 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.543+0000 7fb346ffd640 10 monclient: get_auth_request con 0x7fb334037800 auth_method 0 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.547+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb3480a2370 con 0x7fb3481343f0 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.547+0000 7fb32ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.547+0000 7fb32ffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:22.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.719+0000 7fb34d950640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.719+0000 7fb34d950640 10 monclient: _send_command 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.719+0000 7fb34d950640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:22.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.719+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7fb328005380 con 0x7fb3481343f0 2024-04-26T00:00:22.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.719+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v162) ==== 83+0+2320 (unknown 1241242665 0 3681347290) 0x7fb33c0158a0 con 0x7fb3481343f0 2024-04-26T00:00:22.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.719+0000 7fb32ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.703 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.719+0000 7fb32ffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:22.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.819+0000 7fb34d950640 10 start_mon_command cmd=[{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.819+0000 7fb34d950640 10 monclient: _send_command 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.819+0000 7fb34d950640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:22.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.819+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush tree", "show_shadow": true} v 0) -- 0x7fb328005ac0 con 0x7fb3481343f0 2024-04-26T00:00:22.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb32ffff640 1 -- 172.21.15.171:0/3820472914 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush tree", "show_shadow": true}]=0 v162) ==== 83+0+2320 (unknown 1241242665 0 3681347290) 0x7fb33c0151a0 con 0x7fb3481343f0 2024-04-26T00:00:22.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb32ffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush tree", "show_shadow": true}] 2024-04-26T00:00:22.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb32ffff640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 >> v1:172.21.15.171:6812/722422047 conn(0x7fb334037800 legacy=0x7fb334039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 10 monclient: shutdown 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 >> v1:172.21.15.171:6789/0 conn(0x7fb3481343f0 legacy=0x7fb3481cd560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 shutdown_connections 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 >> 172.21.15.171:0/3820472914 conn(0x7fb3480a6850 msgr2=0x7fb3480a55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 shutdown_connections 2024-04-26T00:00:22.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.823+0000 7fb34d950640 1 -- 172.21.15.171:0/3820472914 wait complete. 2024-04-26T00:00:22.822 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 7.50000 8.50000 6.50000 osd.0 2024-04-26T00:00:22.822 INFO:tasks.workunit.client.0.smithi171.stdout: 0 globster 0.08789 7.50000 8.50000 6.50000 osd.0 2024-04-26T00:00:22.822 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm-device-class osd.0 2024-04-26T00:00:22.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient: get_monmap_and_config 2024-04-26T00:00:22.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient: build_initial_monmap 2024-04-26T00:00:22.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient: monmap: 2024-04-26T00:00:22.935 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:22.935 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.935 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:22.956828+0000 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:22.956828+0000 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:22.936 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 1 Processor -- start 2024-04-26T00:00:22.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 1 -- start start 2024-04-26T00:00:22.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient: init 2024-04-26T00:00:22.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:22.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient: _add_conns ranks=[2,8,5,3,4,0,1,7,6] 2024-04-26T00:00:22.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient(hunting): picked mon.noname-b con 0x7f7aa8135bb0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:22.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient(hunting): picked mon.noname-e con 0x7f7aa81356f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient(hunting): picked mon.noname-h con 0x7f7aa813c130 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa80a1da0 con 0x7f7aa8135bb0 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa80a1fe0 con 0x7f7aa813c130 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa8072720 con 0x7f7aa81356f0 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aaf87a640 10 monclient(hunting): authenticate will time out at 1273.663672s 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aade17640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7aa813c130 0x7f7aa813e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47436/0 (socket says 172.21.15.171:47436) 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aace15640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f7aa81356f0 legacy=0x7f7aa813aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.951+0000 7f7aade17640 1 -- 172.21.15.171:0/3662093549 learned_addr learned my addr 172.21.15.171:0/3662093549 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2939277099 0 0) 0x7f7aa80a1fe0 con 0x7f7aa813c130 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient(hunting): my global_id is 6134 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a94003530 con 0x7f7aa813c130 2024-04-26T00:00:22.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3599611235 0 0) 0x7f7a94003530 con 0x7f7aa813c130 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 >> v1:172.21.15.106:6793/0 conn(0x7f7aa81356f0 legacy=0x7f7aa813aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 >> v1:172.21.15.106:6790/0 conn(0x7f7aa8135bb0 legacy=0x7f7aa8135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 monclient: found mon.noname-h 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa80a17f0 con 0x7f7aa813c130 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: _finish_auth 0 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7aa0001b40 con 0x7f7aa813c130 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:22.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: dump: 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.942 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 5 monclient: authenticate success, global_id 6134 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7aa0001ea0 con 0x7f7aa813c130 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 1 -- 172.21.15.171:0/3662093549 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7aa00020d0 con 0x7f7aa813c130 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9ffff640 10 monclient: dump: 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.943 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 4 set_mon_vals no callback set 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient: shutdown 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- 172.21.15.171:0/3662093549 >> v1:172.21.15.171:6791/0 conn(0x7f7aa813c130 legacy=0x7f7aa813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- 172.21.15.171:0/3662093549 shutdown_connections 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- 172.21.15.171:0/3662093549 >> 172.21.15.171:0/3662093549 conn(0x7f7aa80a2620 msgr2=0x7f7aa80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- 172.21.15.171:0/3662093549 shutdown_connections 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- 172.21.15.171:0/3662093549 wait complete. 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient: build_initial_monmap 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient: monmap: 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:22.945 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 Processor -- start 2024-04-26T00:00:22.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- start start 2024-04-26T00:00:22.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient: init 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient: _add_conns ranks=[6,7,5,4,1,2,8,3,0] 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient(hunting): picked mon.noname-d con 0x7f7aa81356f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient(hunting): picked mon.noname-i con 0x7f7aa8135bb0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient(hunting): picked mon.noname-h con 0x7f7aa813c130 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa81c79f0 con 0x7f7aa813c130 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa80719a0 con 0x7f7aa81356f0 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa8139500 con 0x7f7aa8135bb0 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aade17640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7aa813c130 0x7f7aa81d2470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47446/0 (socket says 172.21.15.171:47446) 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aade17640 1 -- 172.21.15.171:0/2534292451 learned_addr learned my addr 172.21.15.171:0/2534292451 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:22.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7aaf87a640 10 monclient(hunting): authenticate will time out at 1273.667154s 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1271664788 0 0) 0x7f7aa81c79f0 con 0x7f7aa813c130 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): my global_id is 6143 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a8c003530 con 0x7f7aa813c130 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625737920 0 0) 0x7f7aa8139500 con 0x7f7aa8135bb0 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): my global_id is 144628 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa81c79f0 con 0x7f7aa8135bb0 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3042297846 0 0) 0x7f7a8c003530 con 0x7f7aa813c130 2024-04-26T00:00:22.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7aa8139500 con 0x7f7aa813c130 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7aa0001b00 con 0x7f7aa813c130 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.953 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1375355694 0 0) 0x7f7aa81c79f0 con 0x7f7aa8135bb0 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7a8c003530 con 0x7f7aa8135bb0 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7a98004220 con 0x7f7aa8135bb0 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.954 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3606326660 0 0) 0x7f7aa80719a0 con 0x7f7aa81356f0 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 10 monclient(hunting): my global_id is 6279 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.955+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7aa81c79f0 con 0x7f7aa81356f0 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 31657427 0 0) 0x7f7aa8139500 con 0x7f7aa813c130 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 >> v1:172.21.15.171:6792/0 conn(0x7f7aa8135bb0 legacy=0x7f7aa81c72e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 >> v1:172.21.15.106:6792/0 conn(0x7f7aa81356f0 legacy=0x7f7aa81c6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 monclient: found mon.h 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa813b7f0 con 0x7f7aa813c130 2024-04-26T00:00:22.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 5 monclient: authenticate success, global_id 6143 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 10 monclient: _renew_subs 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa813af50 con 0x7f7aa813c130 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 10 monclient: _renew_subs 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f7aa813bc10 con 0x7f7aa813c130 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7aa0001ea0 con 0x7f7aa813c130 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7aa00052f0 con 0x7f7aa813c130 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:22.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9effd640 4 set_mon_vals no callback set 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 10 monclient: dump: 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:22.958 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a88005090 con 0x7f7aa813c130 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7aa0010090 con 0x7f7aa813c130 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(162..162 src has 29..162) ==== 9023+0+0 (unknown 2298669789 0 0) 0x7f7aa0045e30 con 0x7f7aa813c130 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.959+0000 7f7aad616640 10 monclient: get_auth_request con 0x7f7a8c037db0 auth_method 0 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.963+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7aa0015c40 con 0x7f7aa813c130 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.963+0000 7f7a9dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:22.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:22.963+0000 7f7a9dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:23.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.127+0000 7f7aaf87a640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:23.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.127+0000 7f7aaf87a640 10 monclient: _send_command 2 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:23.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.127+0000 7f7aaf87a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:23.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.127+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["osd.0"]} v 0) -- 0x7f7a88005b90 con 0x7f7aa813c130 2024-04-26T00:00:23.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.623+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}]=0 done removing class of osd(s): 0 v163) ==== 123+0+0 (unknown 1240177617 0 0) 0x7f7aa0015540 con 0x7f7aa813c130 2024-04-26T00:00:23.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.623+0000 7f7a9dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:23.606 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.623+0000 7f7a9dffb640 10 monclient: _finish_command 2 = system:0 done removing class of osd(s): 0 2024-04-26T00:00:23.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.723+0000 7f7aaf87a640 10 start_mon_command cmd=[{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:23.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.723+0000 7f7aaf87a640 10 monclient: _send_command 3 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:23.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.723+0000 7f7aaf87a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:23.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:23.723+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm-device-class", "ids": ["osd.0"]} v 0) -- 0x7f7a880010a0 con 0x7f7aa813c130 2024-04-26T00:00:24.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.651+0000 7f7a9dffb640 1 -- 172.21.15.171:0/2534292451 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}]=0 osd.0 belongs to no class, done removing class of osd(s): v164) ==== 149+0+0 (unknown 812831640 0 0) 0x7f7aa001e090 con 0x7f7aa813c130 2024-04-26T00:00:24.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.651+0000 7f7a9dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm-device-class", "ids": ["osd.0"]}] 2024-04-26T00:00:24.634 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.651+0000 7f7a9dffb640 10 monclient: _finish_command 3 = system:0 osd.0 belongs to no class, done removing class of osd(s): 2024-04-26T00:00:24.635 INFO:tasks.workunit.client.0.smithi171.stderr:osd.0 belongs to no class, done removing class of osd(s): 2024-04-26T00:00:24.638 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 >> v1:172.21.15.171:6812/722422047 conn(0x7f7a8c037db0 legacy=0x7f7a8c03a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:24.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 10 monclient: shutdown 2024-04-26T00:00:24.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:24.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 >> v1:172.21.15.171:6791/0 conn(0x7f7aa813c130 legacy=0x7f7aa81d2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:24.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 shutdown_connections 2024-04-26T00:00:24.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 >> 172.21.15.171:0/2534292451 conn(0x7f7aa80a2620 msgr2=0x7f7aa813e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:24.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 shutdown_connections 2024-04-26T00:00:24.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.655+0000 7f7aaf87a640 1 -- 172.21.15.171:0/2534292451 wait complete. 2024-04-26T00:00:24.656 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool rm cool cool --yes-i-really-really-mean-it 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: get_monmap_and_config 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: build_initial_monmap 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: monmap: 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:24.798638+0000 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:24.798638+0000 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:24.777 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:24.778 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:24.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 Processor -- start 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- start start 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: init 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: _add_conns ranks=[5,6,1,3,4,2,0,7,8] 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient(hunting): picked mon.noname-h con 0x7fbd1c0a26b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient(hunting): picked mon.noname-d con 0x7fbd1c134be0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient(hunting): picked mon.noname-f con 0x7fbd1c134fc0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c09f220 con 0x7fbd1c134fc0 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c0a0020 con 0x7fbd1c0a26b0 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c0a06b0 con 0x7fbd1c134be0 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient(hunting): authenticate will time out at 1275.505546s 2024-04-26T00:00:24.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2173b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fbd1c0a26b0 0x7fbd1c1344d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47452/0 (socket says 172.21.15.171:47452) 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2173b640 1 -- 172.21.15.171:0/2410681429 learned_addr learned my addr 172.21.15.171:0/2410681429 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd21f3c640 1 --1- 172.21.15.171:0/2410681429 >> v1:172.21.15.171:6789/0 conn(0x7fbd1c134fc0 0x7fbd1c13cf20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60180/0 (socket says 172.21.15.171:60180) 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577683296 0 0) 0x7fbd1c0a0020 con 0x7fbd1c0a26b0 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): my global_id is 6152 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd08003530 con 0x7fbd1c0a26b0 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940187411 0 0) 0x7fbd1c09f220 con 0x7fbd1c134fc0 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:24.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient(hunting): my global_id is 144730 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd1c0a0020 con 0x7fbd1c134fc0 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3766939273 0 0) 0x7fbd1c0a0020 con 0x7fbd1c134fc0 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 >> v1:172.21.15.106:6792/0 conn(0x7fbd1c134be0 legacy=0x7fbd1c1397f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 >> v1:172.21.15.171:6791/0 conn(0x7fbd1c0a26b0 legacy=0x7fbd1c1344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 monclient: found mon.noname-f 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c0a0990 con 0x7fbd1c134fc0 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:24.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd180017e0 con 0x7fbd1c134fc0 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 5 monclient: authenticate success, global_id 144730 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: dump: 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:24.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd180019d0 con 0x7fbd1c134fc0 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 4 set_mon_vals no callback set 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 1 -- 172.21.15.171:0/2410681429 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd18004b30 con 0x7fbd1c134fc0 2024-04-26T00:00:24.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd13fff640 10 monclient: dump: 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:24.790 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: shutdown 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- 172.21.15.171:0/2410681429 >> v1:172.21.15.171:6789/0 conn(0x7fbd1c134fc0 legacy=0x7fbd1c13cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- 172.21.15.171:0/2410681429 shutdown_connections 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- 172.21.15.171:0/2410681429 >> 172.21.15.171:0/2410681429 conn(0x7fbd1c0a3970 msgr2=0x7fbd1c0a3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- 172.21.15.171:0/2410681429 shutdown_connections 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 1 -- 172.21.15.171:0/2410681429 wait complete. 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: build_initial_monmap 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.795+0000 7fbd2399f640 10 monclient: monmap: 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:24.791 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:24.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 Processor -- start 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 -- start start 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: init 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _add_conns ranks=[8,7,0,6,2,4,3,5,1] 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient(hunting): picked mon.noname-e con 0x7fbd1c0a26b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient(hunting): picked mon.noname-i con 0x7fbd1c134be0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient(hunting): picked mon.noname-a con 0x7fbd1c134fc0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c11fbb0 con 0x7fbd1c134fc0 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c121a00 con 0x7fbd1c134be0 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd1c09cf20 con 0x7fbd1c0a26b0 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient(hunting): authenticate will time out at 1275.508792s 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd20f3a640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fbd1c134be0 0x7fbd1c1cd5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:41600/0 (socket says 172.21.15.171:41600) 2024-04-26T00:00:24.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2173b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fbd1c0a26b0 legacy=0x7fbd1c1c8a90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd20f3a640 1 -- 172.21.15.171:0/2771657528 learned_addr learned my addr 172.21.15.171:0/2771657528 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354342654 0 0) 0x7fbd1c121a00 con 0x7fbd1c134be0 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): my global_id is 144637 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd00003530 con 0x7fbd1c134be0 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3124859043 0 0) 0x7fbd00003530 con 0x7fbd1c134be0 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd1c121a00 con 0x7fbd1c134be0 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd0c001ae0 con 0x7fbd1c134be0 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:24.794 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:24.795 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479136740 0 0) 0x7fbd1c11fbb0 con 0x7fbd1c134fc0 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient(hunting): my global_id is 6354 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd00003530 con 0x7fbd1c134fc0 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2434122274 0 0) 0x7fbd1c121a00 con 0x7fbd1c134be0 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 >> v1:172.21.15.106:6793/0 conn(0x7fbd1c0a26b0 legacy=0x7fbd1c1c8a90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 >> v1:172.21.15.106:6789/0 conn(0x7fbd1c134fc0 legacy=0x7fbd1c1d0d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 monclient: found mon.i 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:24.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd1c09fe10 con 0x7fbd1c134be0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 5 monclient: authenticate success, global_id 144637 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _renew_subs 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd1c1c91a0 con 0x7fbd1c134be0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _renew_subs 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd1c121720 con 0x7fbd1c134be0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd0c003950 con 0x7fbd1c134be0 2024-04-26T00:00:24.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd0c003ec0 con 0x7fbd1c134be0 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd137fe640 4 set_mon_vals no callback set 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 10 monclient: dump: 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:24.798 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbcfc005090 con 0x7fbd1c134be0 2024-04-26T00:00:24.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbd0c0040e0 con 0x7fbd1c134be0 2024-04-26T00:00:24.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(164..164 src has 29..164) ==== 8334+0+0 (unknown 978953479 0 0) 0x7fbd0c0459b0 con 0x7fbd1c134be0 2024-04-26T00:00:24.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.799+0000 7fbd2173b640 10 monclient: get_auth_request con 0x7fbd000377c0 auth_method 0 2024-04-26T00:00:24.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.803+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbd0c0159f0 con 0x7fbd1c134be0 2024-04-26T00:00:24.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.803+0000 7fbd11ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:24.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.803+0000 7fbd11ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:24.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.967+0000 7fbd2399f640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:24.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.967+0000 7fbd2399f640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:24.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.967+0000 7fbd2399f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:24.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:24.967+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbcfc005380 con 0x7fbd1c134be0 2024-04-26T00:00:25.643 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.659+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}]=0 pool 'cool' removed v165) ==== 148+0+0 (unknown 2138234143 0 0) 0x7fbd0c0152f0 con 0x7fbd1c134be0 2024-04-26T00:00:25.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.659+0000 7fbd11ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:25.644 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.659+0000 7fbd11ffb640 10 monclient: _finish_command 2 = system:0 pool 'cool' removed 2024-04-26T00:00:25.744 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.759+0000 7fbd2399f640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:25.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.759+0000 7fbd2399f640 10 monclient: _send_command 3 [{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:25.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.759+0000 7fbd2399f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:25.745 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.759+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true} v 0) -- 0x7fbcfc001180 con 0x7fbd1c134be0 2024-04-26T00:00:25.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd11ffb640 1 -- 172.21.15.171:0/2771657528 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}]=0 pool 'cool' does not exist v165) ==== 155+0+0 (unknown 2816977075 0 0) 0x7fbcfc001180 con 0x7fbd1c134be0 2024-04-26T00:00:25.746 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd11ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool rm", "pool": "cool", "pool2": "cool", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:25.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd11ffb640 10 monclient: _finish_command 3 = system:0 pool 'cool' does not exist 2024-04-26T00:00:25.747 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'cool' does not exist 2024-04-26T00:00:25.748 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 >> v1:172.21.15.171:6812/722422047 conn(0x7fbd000377c0 legacy=0x7fbd00039c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:25.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd2399f640 10 monclient: shutdown 2024-04-26T00:00:25.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd2399f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:25.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 >> v1:172.21.15.171:6792/0 conn(0x7fbd1c134be0 legacy=0x7fbd1c1cd5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:25.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 shutdown_connections 2024-04-26T00:00:25.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.763+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 >> 172.21.15.171:0/2771657528 conn(0x7fbd1c0a3970 msgr2=0x7fbd1c133d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:25.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.767+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 shutdown_connections 2024-04-26T00:00:25.749 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.767+0000 7fbd2399f640 1 -- 172.21.15.171:0/2771657528 wait complete. 2024-04-26T00:00:25.763 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd pool rm cold cold --yes-i-really-really-mean-it 2024-04-26T00:00:25.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient: get_monmap_and_config 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient: build_initial_monmap 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient: monmap: 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:25.904194+0000 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:25.904194+0000 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:25.883 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:25.884 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:25.884 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:25.884 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:25.884 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:25.884 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:25.891 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 1 Processor -- start 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 1 -- start start 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient: init 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient: _add_conns ranks=[8,5,2,0,4,1,6,7,3] 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient(hunting): picked mon.noname-e con 0x7f5f58135a00 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient(hunting): picked mon.noname-h con 0x7f5f580a1790 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient(hunting): picked mon.noname-b con 0x7f5f5813c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f580a1d80 con 0x7f5f5813c130 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f58072f70 con 0x7f5f580a1790 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f58072640 con 0x7f5f58135a00 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient(hunting): authenticate will time out at 1276.611114s 2024-04-26T00:00:25.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f577fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5f580a1790 0x7f5f5813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47466/0 (socket says 172.21.15.171:47466) 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f57fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5f58135a00 legacy=0x7f5f58135de0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f577fe640 1 -- 172.21.15.171:0/1647462265 learned_addr learned my addr 172.21.15.171:0/1647462265 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1708984229 0 0) 0x7f5f58072f70 con 0x7f5f580a1790 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient(hunting): my global_id is 6161 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f44003530 con 0x7f5f580a1790 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3938483972 0 0) 0x7f5f44003530 con 0x7f5f580a1790 2024-04-26T00:00:25.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 >> v1:172.21.15.106:6793/0 conn(0x7f5f58135a00 legacy=0x7f5f58135de0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 >> v1:172.21.15.106:6790/0 conn(0x7f5f5813c130 legacy=0x7f5f5813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 monclient: found mon.noname-h 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f58072920 con 0x7f5f580a1790 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 5 monclient: authenticate success, global_id 6161 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f480017c0 con 0x7f5f580a1790 2024-04-26T00:00:25.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: dump: 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:25.895 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f48001ab0 con 0x7f5f580a1790 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f56ffd640 1 -- 172.21.15.171:0/1647462265 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f48004bf0 con 0x7f5f580a1790 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.899+0000 7f5f5ea3f640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 4 set_mon_vals no callback set 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:25.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f56ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f56ffd640 10 monclient: dump: 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:25.897 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: shutdown 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/1647462265 >> v1:172.21.15.171:6791/0 conn(0x7f5f580a1790 legacy=0x7f5f5813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/1647462265 shutdown_connections 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/1647462265 >> 172.21.15.171:0/1647462265 conn(0x7f5f580a2690 msgr2=0x7f5f580a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/1647462265 shutdown_connections 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/1647462265 wait complete. 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: build_initial_monmap 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: monmap: 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:25.898 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:25.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 Processor -- start 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- start start 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: init 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _add_conns ranks=[2,8,1,7,5,4,0,6,3] 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient(hunting): picked mon.noname-b con 0x7f5f580a1790 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient(hunting): picked mon.noname-e con 0x7f5f58135a00 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient(hunting): picked mon.noname-f con 0x7f5f5813c130 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f58133b70 con 0x7f5f5813c130 2024-04-26T00:00:25.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f58134620 con 0x7f5f580a1790 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f5809b4a0 con 0x7f5f58135a00 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient(hunting): authenticate will time out at 1276.614092s 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f577fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5f58135a00 legacy=0x7f5f58133460 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5cfdc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5f5813c130 0x7f5f581d4740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60194/0 (socket says 172.21.15.171:60194) 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5cfdc640 1 -- 172.21.15.171:0/2085227458 learned_addr learned my addr 172.21.15.171:0/2085227458 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1838143159 0 0) 0x7f5f58133b70 con 0x7f5f5813c130 2024-04-26T00:00:25.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): my global_id is 144739 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f38003530 con 0x7f5f5813c130 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1097553282 0 0) 0x7f5f38003530 con 0x7f5f5813c130 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f58133b70 con 0x7f5f5813c130 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f50001d40 con 0x7f5f5813c130 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:25.902 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:25.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1960667393 0 0) 0x7f5f58134620 con 0x7f5f580a1790 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient(hunting): my global_id is 6212 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f38003530 con 0x7f5f580a1790 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1013284324 0 0) 0x7f5f58133b70 con 0x7f5f5813c130 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 >> v1:172.21.15.106:6793/0 conn(0x7f5f58135a00 legacy=0x7f5f58133460 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 >> v1:172.21.15.106:6790/0 conn(0x7f5f580a1790 legacy=0x7f5f58132d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 monclient: found mon.f 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:25.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f5809fc40 con 0x7f5f5813c130 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 5 monclient: authenticate success, global_id 144739 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _renew_subs 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f5809b1c0 con 0x7f5f5813c130 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _renew_subs 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f58130da0 con 0x7f5f5813c130 2024-04-26T00:00:25.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f50003cd0 con 0x7f5f5813c130 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f50004240 con 0x7f5f5813c130 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f567fc640 4 set_mon_vals no callback set 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 10 monclient: dump: 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.906 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:25.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5f500043e0 con 0x7f5f5813c130 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.903+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f3c005090 con 0x7f5f5813c130 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.907+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(165..165 src has 29..165) ==== 7663+0+0 (unknown 140381883 0 0) 0x7f5f50045810 con 0x7f5f5813c130 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.907+0000 7f5f57fff640 10 monclient: get_auth_request con 0x7f5f38037890 auth_method 0 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.911+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5f50015b00 con 0x7f5f5813c130 2024-04-26T00:00:25.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.911+0000 7f5f54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:25.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:25.911+0000 7f5f54ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:26.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.071+0000 7f5f5ea3f640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:26.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.071+0000 7f5f5ea3f640 10 monclient: _send_command 2 [{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:26.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.071+0000 7f5f5ea3f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:26.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.071+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5f3c005380 con 0x7f5f5813c130 2024-04-26T00:00:26.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.687+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}]=0 pool 'cold' removed v166) ==== 148+0+0 (unknown 2937935409 0 0) 0x7f5f50015400 con 0x7f5f5813c130 2024-04-26T00:00:26.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.687+0000 7f5f54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:26.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.687+0000 7f5f54ff9640 10 monclient: _finish_command 2 = system:0 pool 'cold' removed 2024-04-26T00:00:26.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.791+0000 7f5f5ea3f640 10 start_mon_command cmd=[{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:26.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.791+0000 7f5f5ea3f640 10 monclient: _send_command 3 [{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:26.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.791+0000 7f5f5ea3f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:26.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.791+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5f3c001150 con 0x7f5f5813c130 2024-04-26T00:00:26.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.791+0000 7f5f54ff9640 1 -- 172.21.15.171:0/2085227458 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}]=0 pool 'cold' does not exist v166) ==== 155+0+0 (unknown 1197512267 0 0) 0x7f5f50019750 con 0x7f5f5813c130 2024-04-26T00:00:26.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.791+0000 7f5f54ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd pool rm", "pool": "cold", "pool2": "cold", "yes_i_really_really_mean_it": true}] 2024-04-26T00:00:26.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.791+0000 7f5f54ff9640 10 monclient: _finish_command 3 = system:0 pool 'cold' does not exist 2024-04-26T00:00:26.776 INFO:tasks.workunit.client.0.smithi171.stderr:pool 'cold' does not exist 2024-04-26T00:00:26.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 >> v1:172.21.15.171:6812/722422047 conn(0x7f5f38037890 legacy=0x7f5f38039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 10 monclient: shutdown 2024-04-26T00:00:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 >> v1:172.21.15.171:6789/0 conn(0x7f5f5813c130 legacy=0x7f5f581d4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 shutdown_connections 2024-04-26T00:00:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 >> 172.21.15.171:0/2085227458 conn(0x7f5f580a2690 msgr2=0x7f5f58131a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 shutdown_connections 2024-04-26T00:00:26.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.795+0000 7f5f5ea3f640 1 -- 172.21.15.171:0/2085227458 wait complete. 2024-04-26T00:00:26.793 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set rm-compat 2024-04-26T00:00:26.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient: get_monmap_and_config 2024-04-26T00:00:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient: build_initial_monmap 2024-04-26T00:00:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient: monmap: 2024-04-26T00:00:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:26.931887+0000 2024-04-26T00:00:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:26.931887+0000 2024-04-26T00:00:26.911 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:26.912 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:26.913 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:26.913 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:26.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 1 Processor -- start 2024-04-26T00:00:26.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 1 -- start start 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient: init 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient: _add_conns ranks=[5,8,7,1,2,4,3,0,6] 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient(hunting): picked mon.noname-h con 0x7f594c135bb0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient(hunting): picked mon.noname-e con 0x7f594c1356f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient(hunting): picked mon.noname-i con 0x7f594c13c130 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c0a1da0 con 0x7f594c135bb0 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c0a1fe0 con 0x7f594c13c130 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c072720 con 0x7f594c1356f0 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient(hunting): authenticate will time out at 1277.638843s 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f59518a1640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f594c135bb0 0x7f594c135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47482/0 (socket says 172.21.15.171:47482) 2024-04-26T00:00:26.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f59518a1640 1 -- 172.21.15.171:0/4000156748 learned_addr learned my addr 172.21.15.171:0/4000156748 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f59520a2640 1 --1- 172.21.15.171:0/4000156748 >> v1:172.21.15.171:6792/0 conn(0x7f594c13c130 0x7f594c13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:41616/0 (socket says 172.21.15.171:41616) 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f59510a0640 1 -- 172.21.15.171:0/4000156748 >> v1:172.21.15.106:6793/0 conn(0x7f594c1356f0 legacy=0x7f594c13aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232690295 0 0) 0x7f594c0a1da0 con 0x7f594c135bb0 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): _negotiate 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): my global_id is 6170 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5938003530 con 0x7f594c135bb0 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1233038194 0 0) 0x7f594c0a1fe0 con 0x7f594c13c130 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): _negotiate 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient(hunting): my global_id is 144646 2024-04-26T00:00:26.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f594c0a1da0 con 0x7f594c13c130 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 430300238 0 0) 0x7f5938003530 con 0x7f594c135bb0 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 >> v1:172.21.15.106:6793/0 conn(0x7f594c1356f0 legacy=0x7f594c13aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 >> v1:172.21.15.171:6792/0 conn(0x7f594c13c130 legacy=0x7f594c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: _finish_hunting 0 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 monclient: found mon.noname-h 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c0a17f0 con 0x7f594c135bb0 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: _finish_auth 0 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: _check_auth_tickets 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 5 monclient: authenticate success, global_id 6170 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59480017c0 con 0x7f594c135bb0 2024-04-26T00:00:26.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: dump: 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:26.930 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5948001ae0 con 0x7f594c135bb0 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f595089f640 1 -- 172.21.15.171:0/4000156748 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5948004bf0 con 0x7f594c135bb0 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:26.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.927+0000 7f5953b05640 4 set_mon_vals no callback set 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f595089f640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f595089f640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f595089f640 10 monclient: dump: 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:26.932 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: shutdown 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:26.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- 172.21.15.171:0/4000156748 >> v1:172.21.15.171:6791/0 conn(0x7f594c135bb0 legacy=0x7f594c135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- 172.21.15.171:0/4000156748 shutdown_connections 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- 172.21.15.171:0/4000156748 >> 172.21.15.171:0/4000156748 conn(0x7f594c0a2620 msgr2=0x7f594c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- 172.21.15.171:0/4000156748 shutdown_connections 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- 172.21.15.171:0/4000156748 wait complete. 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: build_initial_monmap 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: monmap: 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 Processor -- start 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- start start 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: init 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:26.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: _add_conns ranks=[8,1,5,2,6,0,4,3,7] 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient(hunting): picked mon.noname-e con 0x7f594c1356f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient(hunting): picked mon.noname-f con 0x7f594c135bb0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient(hunting): picked mon.noname-h con 0x7f594c13c130 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c071ef0 con 0x7f594c135bb0 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c11cb60 con 0x7f594c13c130 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f594c070c10 con 0x7f594c1356f0 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient(hunting): authenticate will time out at 1277.642125s 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59520a2640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f594c13c130 0x7f594c1d4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47492/0 (socket says 172.21.15.171:47492) 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59520a2640 1 -- 172.21.15.171:0/2392165973 learned_addr learned my addr 172.21.15.171:0/2392165973 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59510a0640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f594c135bb0 0x7f594c1d1350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60208/0 (socket says 172.21.15.171:60208) 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59518a1640 1 -- 172.21.15.171:0/2392165973 >> v1:172.21.15.106:6793/0 conn(0x7f594c1356f0 legacy=0x7f594c1cc7d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207048267 0 0) 0x7f594c071ef0 con 0x7f594c135bb0 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:26.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): my global_id is 144748 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5930003530 con 0x7f594c135bb0 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068067210 0 0) 0x7f594c11cb60 con 0x7f594c13c130 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): my global_id is 6179 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f594c071ef0 con 0x7f594c13c130 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1116086369 0 0) 0x7f5930003530 con 0x7f594c135bb0 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f594c11cb60 con 0x7f594c135bb0 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3979226630 0 0) 0x7f594c071ef0 con 0x7f594c13c130 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5930003530 con 0x7f594c13c130 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f593c0042a0 con 0x7f594c135bb0 2024-04-26T00:00:26.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): dump: 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:26.938 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5944001c80 con 0x7f594c13c130 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient(hunting): dump: 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:26.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1876061862 0 0) 0x7f594c11cb60 con 0x7f594c135bb0 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 >> v1:172.21.15.106:6793/0 conn(0x7f594c1356f0 legacy=0x7f594c1cc7d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 >> v1:172.21.15.171:6791/0 conn(0x7f594c13c130 legacy=0x7f594c1d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:26.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 monclient: found mon.f 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c1ccee0 con 0x7f594c135bb0 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 5 monclient: authenticate success, global_id 144748 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: _renew_subs 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f594c11d5e0 con 0x7f594c135bb0 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: _renew_subs 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:26.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f594c1cc010 con 0x7f594c135bb0 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f593c004540 con 0x7f594c135bb0 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f593c004ab0 con 0x7f594c135bb0 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f5943fff640 4 set_mon_vals no callback set 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.931+0000 7f59427fc640 10 monclient: dump: 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:26.942 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:26.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.935+0000 7f5953b05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.935+0000 7f5953b05640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.935+0000 7f5953b05640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.935+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f593c004cd0 con 0x7f594c135bb0 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.935+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5934005090 con 0x7f594c135bb0 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.935+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(166..166 src has 29..166) ==== 6856+0+0 (unknown 826451783 0 0) 0x7f593c045110 con 0x7f594c135bb0 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.935+0000 7f59518a1640 10 monclient: get_auth_request con 0x7f5930037d00 auth_method 0 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.939+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f593c015760 con 0x7f594c135bb0 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.939+0000 7f59427fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:26.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:26.939+0000 7f59427fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:27.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.107+0000 7f5953b05640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:27.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.107+0000 7f5953b05640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:27.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.107+0000 7f5953b05640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:27.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.107+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f5934005380 con 0x7f594c135bb0 2024-04-26T00:00:27.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.707+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v167) ==== 78+0+0 (unknown 453549401 0 0) 0x7f593c015060 con 0x7f594c135bb0 2024-04-26T00:00:27.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.707+0000 7f59427fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:27.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.707+0000 7f59427fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:27.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.823+0000 7f5953b05640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:27.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.823+0000 7f5953b05640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:27.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.823+0000 7f5953b05640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:27.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:27.823+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f5934002220 con 0x7f594c135bb0 2024-04-26T00:00:28.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.703+0000 7f59427fc640 1 -- 172.21.15.171:0/2392165973 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v168) ==== 78+0+0 (unknown 3731923353 0 0) 0x7f593c042270 con 0x7f594c135bb0 2024-04-26T00:00:28.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.703+0000 7f59427fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:28.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.703+0000 7f59427fc640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:28.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.707+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 >> v1:172.21.15.171:6812/722422047 conn(0x7f5930037d00 legacy=0x7f593003a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:28.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.707+0000 7f5953b05640 10 monclient: shutdown 2024-04-26T00:00:28.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.707+0000 7f5953b05640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:28.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.707+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 >> v1:172.21.15.171:6789/0 conn(0x7f594c135bb0 legacy=0x7f594c1d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:28.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.711+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 shutdown_connections 2024-04-26T00:00:28.693 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.711+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 >> 172.21.15.171:0/2392165973 conn(0x7f594c0a2620 msgr2=0x7f594c13e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:28.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.711+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 shutdown_connections 2024-04-26T00:00:28.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.711+0000 7f5953b05640 1 -- 172.21.15.171:0/2392165973 wait complete. 2024-04-26T00:00:28.719 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create-compat 2024-04-26T00:00:28.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient: get_monmap_and_config 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient: build_initial_monmap 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient: monmap: 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:28.861095+0000 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:28.861095+0000 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:28.840 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:28.841 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:28.841 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:28.841 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:28.841 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 1 Processor -- start 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 1 -- start start 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient: init 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient: _add_conns ranks=[8,3,4,5,2,6,1,0,7] 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient(hunting): picked mon.noname-e con 0x7f6a10135bb0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient(hunting): picked mon.noname-g con 0x7f6a101356f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient(hunting): picked mon.noname-c con 0x7f6a1013c130 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:28.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a100a1da0 con 0x7f6a101356f0 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a100a1fe0 con 0x7f6a1013c130 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a10072720 con 0x7f6a10135bb0 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.855+0000 7f6a16ae6640 10 monclient(hunting): authenticate will time out at 1279.567958s 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a14882640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f6a10135bb0 legacy=0x7f6a10135f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0ffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6a101356f0 0x7f6a1013aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:45764/0 (socket says 172.21.15.171:45764) 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0ffff640 1 -- 172.21.15.171:0/3928642668 learned_addr learned my addr 172.21.15.171:0/3928642668 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786202519 0 0) 0x7f6a100a1da0 con 0x7f6a101356f0 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:28.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient(hunting): my global_id is 6492 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f8003530 con 0x7f6a101356f0 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1139064942 0 0) 0x7f69f8003530 con 0x7f6a101356f0 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 >> v1:172.21.15.106:6793/0 conn(0x7f6a10135bb0 legacy=0x7f6a10135f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 >> v1:172.21.15.106:6791/0 conn(0x7f6a1013c130 legacy=0x7f6a1013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 monclient: found mon.noname-g 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a100a17f0 con 0x7f6a101356f0 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:28.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a040017c0 con 0x7f6a101356f0 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: dump: 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:28.851 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 5 monclient: authenticate success, global_id 6492 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:28.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a04001b20 con 0x7f6a101356f0 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 1 -- 172.21.15.171:0/3928642668 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a04004bf0 con 0x7f6a101356f0 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 4 set_mon_vals no callback set 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0f7fe640 10 monclient: dump: 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:28.853 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient: shutdown 2024-04-26T00:00:28.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3928642668 >> v1:172.21.15.171:6790/0 conn(0x7f6a101356f0 legacy=0x7f6a1013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3928642668 shutdown_connections 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3928642668 >> 172.21.15.171:0/3928642668 conn(0x7f6a100a2620 msgr2=0x7f6a100a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3928642668 shutdown_connections 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3928642668 wait complete. 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient: build_initial_monmap 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient: monmap: 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:28.855 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 Processor -- start 2024-04-26T00:00:28.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- start start 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient: init 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient: _add_conns ranks=[5,6,4,3,0,8,2,1,7] 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient(hunting): picked mon.noname-h con 0x7f6a101356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient(hunting): picked mon.noname-d con 0x7f6a10135bb0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient(hunting): picked mon.noname-c con 0x7f6a1013c130 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a101cabc0 con 0x7f6a1013c130 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a10139ad0 con 0x7f6a101356f0 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a10071ef0 con 0x7f6a10135bb0 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a16ae6640 10 monclient(hunting): authenticate will time out at 1279.571202s 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a14882640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6a101356f0 0x7f6a101c9da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47494/0 (socket says 172.21.15.171:47494) 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a14882640 1 -- 172.21.15.171:0/3600211226 learned_addr learned my addr 172.21.15.171:0/3600211226 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 433262640 0 0) 0x7f6a10139ad0 con 0x7f6a101356f0 2024-04-26T00:00:28.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): my global_id is 6188 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69fc003530 con 0x7f6a101356f0 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 88405615 0 0) 0x7f69fc003530 con 0x7f6a101356f0 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a10139ad0 con 0x7f6a101356f0 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a00004380 con 0x7f6a101356f0 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): dump: 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:28.858 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334701570 0 0) 0x7f6a101cabc0 con 0x7f6a1013c130 2024-04-26T00:00:28.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.859+0000 7f6a0d7fa640 10 monclient(hunting): my global_id is 144796 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69fc003530 con 0x7f6a1013c130 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746949015 0 0) 0x7f6a10071ef0 con 0x7f6a10135bb0 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient(hunting): my global_id is 6297 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a101cabc0 con 0x7f6a10135bb0 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2714692254 0 0) 0x7f6a10139ad0 con 0x7f6a101356f0 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 >> v1:172.21.15.106:6792/0 conn(0x7f6a10135bb0 legacy=0x7f6a101ca4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 >> v1:172.21.15.106:6791/0 conn(0x7f6a1013c130 legacy=0x7f6a101d2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:28.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 monclient: found mon.h 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1013aca0 con 0x7f6a101356f0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 5 monclient: authenticate success, global_id 6188 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 10 monclient: _renew_subs 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1013af80 con 0x7f6a101356f0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 10 monclient: _renew_subs 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a1013b9e0 con 0x7f6a101356f0 2024-04-26T00:00:28.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a00004670 con 0x7f6a101356f0 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a00004be0 con 0x7f6a101356f0 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0effd640 4 set_mon_vals no callback set 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 10 monclient: dump: 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:28.862 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69f0005090 con 0x7f6a101356f0 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6a00004d80 con 0x7f6a101356f0 2024-04-26T00:00:28.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(168..168 src has 29..168) ==== 6458+0+0 (unknown 3233866530 0 0) 0x7f6a000450a0 con 0x7f6a101356f0 2024-04-26T00:00:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.863+0000 7f6a0ffff640 10 monclient: get_auth_request con 0x7f69fc037a30 auth_method 0 2024-04-26T00:00:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.867+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6a00015780 con 0x7f6a101356f0 2024-04-26T00:00:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.867+0000 7f6a0d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:28.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:28.867+0000 7f6a0d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:29.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.035+0000 7f6a16ae6640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:29.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.035+0000 7f6a16ae6640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:29.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.035+0000 7f6a16ae6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:29.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.035+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7f69f0005380 con 0x7f6a101356f0 2024-04-26T00:00:29.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.711+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 v169) ==== 82+0+0 (unknown 1113079410 0 0) 0x7f6a00019430 con 0x7f6a101356f0 2024-04-26T00:00:29.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.711+0000 7f6a0d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:29.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.711+0000 7f6a0d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:29.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:29.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:29.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:29.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7f69f0002220 con 0x7f6a101356f0 2024-04-26T00:00:29.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a0d7fa640 1 -- 172.21.15.171:0/3600211226 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 compat weight-set already created v169) ==== 115+0+0 (unknown 1256835640 0 0) 0x7f6a0001dcf0 con 0x7f6a101356f0 2024-04-26T00:00:29.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a0d7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:29.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a0d7fa640 10 monclient: _finish_command 3 = system:0 compat weight-set already created 2024-04-26T00:00:29.811 INFO:tasks.workunit.client.0.smithi171.stderr:compat weight-set already created 2024-04-26T00:00:29.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 >> v1:172.21.15.171:6812/722422047 conn(0x7f69fc037a30 legacy=0x7f69fc039ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:29.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 10 monclient: shutdown 2024-04-26T00:00:29.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:29.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 >> v1:172.21.15.171:6791/0 conn(0x7f6a101356f0 legacy=0x7f6a101c9da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:29.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 shutdown_connections 2024-04-26T00:00:29.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.827+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 >> 172.21.15.171:0/3600211226 conn(0x7f6a100a2620 msgr2=0x7f6a100a42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:29.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.831+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 shutdown_connections 2024-04-26T00:00:29.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.831+0000 7f6a16ae6640 1 -- 172.21.15.171:0/3600211226 wait complete. 2024-04-26T00:00:29.827 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket fooo host 2024-04-26T00:00:29.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.963+0000 7f961b907640 10 monclient: get_monmap_and_config 2024-04-26T00:00:29.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.963+0000 7f961b907640 10 monclient: build_initial_monmap 2024-04-26T00:00:29.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.963+0000 7f961b907640 10 monclient: monmap: 2024-04-26T00:00:29.947 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:29.947 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:29.968806+0000 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:29.968806+0000 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:29.948 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:29.949 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:29.949 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:29.949 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:29.949 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:29.949 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.963+0000 7f961b907640 1 Processor -- start 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.963+0000 7f961b907640 1 -- start start 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.963+0000 7f961b907640 10 monclient: init 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: _add_conns ranks=[2,7,3,8,6,0,4,5,1] 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): picked mon.noname-b con 0x7f96140a52a0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): picked mon.noname-i con 0x7f96140a49c0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): picked mon.noname-g con 0x7f961413e2a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:29.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96140a5d90 con 0x7f96140a52a0 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96140a18e0 con 0x7f961413e2a0 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96140a28f0 con 0x7f96140a49c0 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): authenticate will time out at 1280.676475s 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9618ea2640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f96140a49c0 0x7f961413cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:41624/0 (socket says 172.21.15.171:41624) 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9618ea2640 1 -- 172.21.15.171:0/3235443285 learned_addr learned my addr 172.21.15.171:0/3235443285 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9619ea4640 1 --1- 172.21.15.171:0/3235443285 >> v1:172.21.15.171:6790/0 conn(0x7f961413e2a0 0x7f9614140690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:45768/0 (socket says 172.21.15.171:45768) 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910152938 0 0) 0x7f96140a28f0 con 0x7f96140a49c0 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:29.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): my global_id is 144655 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9600003530 con 0x7f96140a49c0 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924518524 0 0) 0x7f96140a18e0 con 0x7f961413e2a0 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient(hunting): my global_id is 6501 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96140a28f0 con 0x7f961413e2a0 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2636770108 0 0) 0x7f96140a28f0 con 0x7f961413e2a0 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 >> v1:172.21.15.171:6792/0 conn(0x7f96140a49c0 legacy=0x7f961413cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 >> v1:172.21.15.106:6790/0 conn(0x7f96140a52a0 legacy=0x7f96140a5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 monclient: found mon.noname-g 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:29.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96140a2bd0 con 0x7f961413e2a0 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: _finish_auth 0 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c001b20 con 0x7f961413e2a0 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 5 monclient: authenticate success, global_id 6501 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: dump: 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.960 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:29.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f960c001e10 con 0x7f961413e2a0 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 4 set_mon_vals no callback set 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 1 -- 172.21.15.171:0/3235443285 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c004eb0 con 0x7f961413e2a0 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f960bfff640 10 monclient: dump: 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:29.962 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:29.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: shutdown 2024-04-26T00:00:29.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:29.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- 172.21.15.171:0/3235443285 >> v1:172.21.15.171:6790/0 conn(0x7f961413e2a0 legacy=0x7f9614140690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:29.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- 172.21.15.171:0/3235443285 shutdown_connections 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- 172.21.15.171:0/3235443285 >> 172.21.15.171:0/3235443285 conn(0x7f96140a6c90 msgr2=0x7f96140a70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- 172.21.15.171:0/3235443285 shutdown_connections 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- 172.21.15.171:0/3235443285 wait complete. 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: build_initial_monmap 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: monmap: 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:29.966 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 Processor -- start 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- start start 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: init 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:29.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient: _add_conns ranks=[6,0,1,2,3,5,8,4,7] 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): picked mon.noname-d con 0x7f96140a49c0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): picked mon.noname-a con 0x7f96140a52a0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): picked mon.noname-f con 0x7f961413e2a0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961413b950 con 0x7f96140a52a0 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961412e500 con 0x7f961413e2a0 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9614139b00 con 0x7f96140a49c0 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f961b907640 10 monclient(hunting): authenticate will time out at 1280.679497s 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9619ea4640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f961413e2a0 0x7f96141d4900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:60218/0 (socket says 172.21.15.171:60218) 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9619ea4640 1 -- 172.21.15.171:0/3305762779 learned_addr learned my addr 172.21.15.171:0/3305762779 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4263785295 0 0) 0x7f961412e500 con 0x7f961413e2a0 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9609ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9609ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:29.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9609ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9609ffb640 10 monclient(hunting): my global_id is 144757 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.967+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95f8003530 con 0x7f961413e2a0 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1060159831 0 0) 0x7f95f8003530 con 0x7f961413e2a0 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f961412e500 con 0x7f961413e2a0 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c001ae0 con 0x7f961413e2a0 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:29.969 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2702318933 0 0) 0x7f9614139b00 con 0x7f96140a49c0 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:29.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient(hunting): my global_id is 6306 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95f8003530 con 0x7f96140a49c0 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3110638582 0 0) 0x7f961412e500 con 0x7f961413e2a0 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 >> v1:172.21.15.106:6792/0 conn(0x7f96140a49c0 legacy=0x7f961412d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 >> v1:172.21.15.106:6789/0 conn(0x7f96140a52a0 legacy=0x7f961412ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 monclient: found mon.f 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96140a5070 con 0x7f961413e2a0 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:29.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 5 monclient: authenticate success, global_id 144757 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 10 monclient: _renew_subs 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f96140a43c0 con 0x7f961413e2a0 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 10 monclient: _renew_subs 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f961413c100 con 0x7f961413e2a0 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f960c001e10 con 0x7f961413e2a0 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c0053e0 con 0x7f961413e2a0 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f960b7fe640 4 set_mon_vals no callback set 2024-04-26T00:00:29.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 10 monclient: dump: 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:29.973 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95f4005090 con 0x7f961413e2a0 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f960c010180 con 0x7f961413e2a0 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(169..169 src has 29..169) ==== 6786+0+0 (unknown 37415688 0 0) 0x7f960c045630 con 0x7f961413e2a0 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.971+0000 7f96196a3640 10 monclient: get_auth_request con 0x7f95f80378e0 auth_method 0 2024-04-26T00:00:29.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.975+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f960c015c80 con 0x7f961413e2a0 2024-04-26T00:00:29.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.975+0000 7f9609ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:29.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:29.975+0000 7f9609ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:30.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.139+0000 7f961b907640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}] 2024-04-26T00:00:30.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.139+0000 7f961b907640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}] 2024-04-26T00:00:30.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.139+0000 7f961b907640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:30.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.139+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"} v 0) -- 0x7f95f4005b90 con 0x7f961413e2a0 2024-04-26T00:00:30.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.747+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}]=0 added bucket fooo type host to crush map v170) ==== 140+0+0 (unknown 3114934269 0 0) 0x7f960c015580 con 0x7f961413e2a0 2024-04-26T00:00:30.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.747+0000 7f9609ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}] 2024-04-26T00:00:30.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.747+0000 7f9609ffb640 10 monclient: _finish_command 2 = system:0 added bucket fooo type host to crush map 2024-04-26T00:00:30.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.855+0000 7f961b907640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}] 2024-04-26T00:00:30.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.855+0000 7f961b907640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}] 2024-04-26T00:00:30.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.855+0000 7f961b907640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:30.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.855+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"} v 0) -- 0x7f95f40010a0 con 0x7f961413e2a0 2024-04-26T00:00:30.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.855+0000 7f9609ffb640 1 -- 172.21.15.171:0/3305762779 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}]=0 bucket 'fooo' already exists v170) ==== 128+0+0 (unknown 232819945 0 0) 0x7f960c01e130 con 0x7f961413e2a0 2024-04-26T00:00:30.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.855+0000 7f9609ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "fooo", "type": "host"}] 2024-04-26T00:00:30.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.855+0000 7f9609ffb640 10 monclient: _finish_command 3 = system:0 bucket 'fooo' already exists 2024-04-26T00:00:30.840 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'fooo' already exists 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 >> v1:172.21.15.171:6812/722422047 conn(0x7f95f80378e0 legacy=0x7f95f8039da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 10 monclient: shutdown 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 >> v1:172.21.15.171:6789/0 conn(0x7f961413e2a0 legacy=0x7f96141d4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 shutdown_connections 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 >> 172.21.15.171:0/3305762779 conn(0x7f96140a6c90 msgr2=0x7f96140a7ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 shutdown_connections 2024-04-26T00:00:30.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.859+0000 7f961b907640 1 -- 172.21.15.171:0/3305762779 wait complete. 2024-04-26T00:00:30.856 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush move fooo root=default 2024-04-26T00:00:30.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient: get_monmap_and_config 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient: build_initial_monmap 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient: monmap: 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:30.996840+0000 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:30.996840+0000 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:30.976 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 1 Processor -- start 2024-04-26T00:00:30.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 1 -- start start 2024-04-26T00:00:30.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient: init 2024-04-26T00:00:30.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:30.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient: _add_conns ranks=[3,8,5,7,2,1,0,6,4] 2024-04-26T00:00:30.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient(hunting): picked mon.noname-g con 0x7fdab40a1530 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:30.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient(hunting): picked mon.noname-e con 0x7fdab40a2020 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:30.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient(hunting): picked mon.noname-h con 0x7fdab4072540 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab406ff90 con 0x7fdab40a1530 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab4071270 con 0x7fdab4072540 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab406fb20 con 0x7fdab40a2020 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdabaa77640 10 monclient(hunting): authenticate will time out at 1281.703698s 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdab9014640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fdab4072540 0x7fdab413d240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50792/0 (socket says 172.21.15.171:50792) 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdab9014640 1 -- 172.21.15.171:0/2029720303 learned_addr learned my addr 172.21.15.171:0/2029720303 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.991+0000 7fdab3fff640 1 -- 172.21.15.171:0/2029720303 >> v1:172.21.15.106:6793/0 conn(0x7fdab40a2020 legacy=0x7fdab4139b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2568831489 0 0) 0x7fdab406ff90 con 0x7fdab40a1530 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:30.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): my global_id is 6510 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa0003530 con 0x7fdab40a1530 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1288557977 0 0) 0x7fdab4071270 con 0x7fdab4072540 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient(hunting): my global_id is 6197 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdab406ff90 con 0x7fdab4072540 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 444756167 0 0) 0x7fdaa0003530 con 0x7fdab40a1530 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 >> v1:172.21.15.106:6793/0 conn(0x7fdab40a2020 legacy=0x7fdab4139b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 >> v1:172.21.15.171:6791/0 conn(0x7fdab4072540 legacy=0x7fdab413d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:30.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 monclient: found mon.noname-g 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab40a3100 con 0x7fdab40a1530 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda9c0017c0 con 0x7fdab40a1530 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 5 monclient: authenticate success, global_id 6510 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:30.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: dump: 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:30.993 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda9c001a60 con 0x7fdab40a1530 2024-04-26T00:00:30.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:30.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 1 -- 172.21.15.171:0/2029720303 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda9c003960 con 0x7fdab40a1530 2024-04-26T00:00:30.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:30.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 4 set_mon_vals no callback set 2024-04-26T00:00:30.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:30.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:30.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab37fe640 10 monclient: dump: 2024-04-26T00:00:30.995 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:30.996 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:30.997 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:30.997 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:30.997 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:30.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: shutdown 2024-04-26T00:00:30.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:30.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- 172.21.15.171:0/2029720303 >> v1:172.21.15.171:6790/0 conn(0x7fdab40a1530 legacy=0x7fdab40a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- 172.21.15.171:0/2029720303 shutdown_connections 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- 172.21.15.171:0/2029720303 >> 172.21.15.171:0/2029720303 conn(0x7fdab40a62d0 msgr2=0x7fdab40a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- 172.21.15.171:0/2029720303 shutdown_connections 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- 172.21.15.171:0/2029720303 wait complete. 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: build_initial_monmap 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: monmap: 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:30.998 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:30.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 Processor -- start 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- start start 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: init 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: _add_conns ranks=[8,2,1,7,3,0,5,6,4] 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient(hunting): picked mon.noname-e con 0x7fdab4072540 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient(hunting): picked mon.noname-b con 0x7fdab40a1530 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient(hunting): picked mon.noname-f con 0x7fdab40a2020 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab4130a30 con 0x7fdab40a2020 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab40704f0 con 0x7fdab40a1530 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab40708b0 con 0x7fdab4072540 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient(hunting): authenticate will time out at 1281.706808s 2024-04-26T00:00:31.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab9014640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fdab40a2020 0x7fdab41d2000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:38796/0 (socket says 172.21.15.171:38796) 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab9014640 1 -- 172.21.15.171:0/2105572361 learned_addr learned my addr 172.21.15.171:0/2105572361 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab8813640 1 -- 172.21.15.171:0/2105572361 >> v1:172.21.15.106:6793/0 conn(0x7fdab4072540 legacy=0x7fdab41c9c60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375237795 0 0) 0x7fdab4130a30 con 0x7fdab40a2020 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): my global_id is 144766 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda94003530 con 0x7fdab40a2020 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2814128084 0 0) 0x7fda94003530 con 0x7fdab40a2020 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdab4130a30 con 0x7fdab40a2020 2024-04-26T00:00:31.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaac001960 con 0x7fdab40a2020 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): dump: 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.002 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1962037563 0 0) 0x7fdab4130a30 con 0x7fdab40a2020 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 >> v1:172.21.15.106:6793/0 conn(0x7fdab4072540 legacy=0x7fdab41c9c60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 >> v1:172.21.15.106:6790/0 conn(0x7fdab40a1530 legacy=0x7fdab413dae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 monclient: found mon.f 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab4131290 con 0x7fdab40a2020 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 5 monclient: authenticate success, global_id 144766 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: _renew_subs 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdab412f300 con 0x7fdab40a2020 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: _renew_subs 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fdab413e3c0 con 0x7fdab40a2020 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaac004e20 con 0x7fdab40a2020 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaac005310 con 0x7fdab40a2020 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab2ffd640 4 set_mon_vals no callback set 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.995+0000 7fdab17fa640 10 monclient: dump: 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.005 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.006 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:31.006 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.006 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:31.006 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:31.006 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:31.006 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:31.006 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.999+0000 7fdabaa77640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.999+0000 7fdabaa77640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.999+0000 7fdabaa77640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.999+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdaac0100b0 con 0x7fdab40a2020 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.999+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda98005090 con 0x7fdab40a2020 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.999+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(170..170 src has 29..170) ==== 6789+0+0 (unknown 161126213 0 0) 0x7fdaac045610 con 0x7fdab40a2020 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:30.999+0000 7fdab8813640 10 monclient: get_auth_request con 0x7fda94037710 auth_method 0 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.003+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdaac015c00 con 0x7fdab40a2020 2024-04-26T00:00:31.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.003+0000 7fdab17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:31.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.003+0000 7fdab17fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:31.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.167+0000 7fdabaa77640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}] 2024-04-26T00:00:31.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.167+0000 7fdabaa77640 10 monclient: _send_command 2 [{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}] 2024-04-26T00:00:31.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.167+0000 7fdabaa77640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.167+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]} v 0) -- 0x7fda98005b90 con 0x7fdab40a2020 2024-04-26T00:00:31.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.547+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}]=0 moved item id -16 name 'fooo' to location {root=default} in crush map v171) ==== 173+0+0 (unknown 1440174107 0 0) 0x7fdaac0198b0 con 0x7fdab40a2020 2024-04-26T00:00:31.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.547+0000 7fdab17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}] 2024-04-26T00:00:31.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.547+0000 7fdab17fa640 10 monclient: _finish_command 2 = system:0 moved item id -16 name 'fooo' to location {root=default} in crush map 2024-04-26T00:00:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.667+0000 7fdabaa77640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}] 2024-04-26T00:00:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.667+0000 7fdabaa77640 10 monclient: _send_command 3 [{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}] 2024-04-26T00:00:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.667+0000 7fdabaa77640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.667+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]} v 0) -- 0x7fda980010a0 con 0x7fdab40a2020 2024-04-26T00:00:31.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.667+0000 7fdab17fa640 1 -- 172.21.15.171:0/2105572361 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}]=0 no need to move item id -16 name 'fooo' to location {root=default} in crush map v171) ==== 183+0+0 (unknown 55984617 0 0) 0x7fdaac01e170 con 0x7fdab40a2020 2024-04-26T00:00:31.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.667+0000 7fdab17fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush move", "name": "fooo", "args": ["root=default"]}] 2024-04-26T00:00:31.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.667+0000 7fdab17fa640 10 monclient: _finish_command 3 = system:0 no need to move item id -16 name 'fooo' to location {root=default} in crush map 2024-04-26T00:00:31.652 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -16 name 'fooo' to location {root=default} in crush map 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 >> v1:172.21.15.171:6812/722422047 conn(0x7fda94037710 legacy=0x7fda94039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 10 monclient: shutdown 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 >> v1:172.21.15.171:6789/0 conn(0x7fdab40a2020 legacy=0x7fdab41d2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 shutdown_connections 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 >> 172.21.15.171:0/2105572361 conn(0x7fdab40a62d0 msgr2=0x7fdab406eca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 shutdown_connections 2024-04-26T00:00:31.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.671+0000 7fdabaa77640 1 -- 172.21.15.171:0/2105572361 wait complete. 2024-04-26T00:00:31.669 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket barr rack 2024-04-26T00:00:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient: get_monmap_and_config 2024-04-26T00:00:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient: build_initial_monmap 2024-04-26T00:00:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient: monmap: 2024-04-26T00:00:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:31.812765+0000 2024-04-26T00:00:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:31.812765+0000 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:31.792 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 1 Processor -- start 2024-04-26T00:00:31.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 1 -- start start 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient: init 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient: _add_conns ranks=[3,7,0,8,4,6,2,1,5] 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient(hunting): picked mon.noname-g con 0x7f9b580a1530 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient(hunting): picked mon.noname-i con 0x7f9b58071c00 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient(hunting): picked mon.noname-a con 0x7f9b58071730 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b5806ea70 con 0x7f9b58071730 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b580723d0 con 0x7f9b580a1530 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b58072990 con 0x7f9b58071c00 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b5d9c2640 10 monclient(hunting): authenticate will time out at 1282.519752s 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b56ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f9b580a1530 0x7f9b580a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60588/0 (socket says 172.21.15.171:60588) 2024-04-26T00:00:31.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.807+0000 7f9b56ffd640 1 -- 172.21.15.171:0/4050915563 learned_addr learned my addr 172.21.15.171:0/4050915563 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602100520 0 0) 0x7f9b58072990 con 0x7f9b58071c00 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): my global_id is 144664 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b40003530 con 0x7f9b58071c00 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3586753493 0 0) 0x7f9b580723d0 con 0x7f9b580a1530 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient(hunting): my global_id is 6519 2024-04-26T00:00:31.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b58072990 con 0x7f9b580a1530 2024-04-26T00:00:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3610851495 0 0) 0x7f9b40003530 con 0x7f9b58071c00 2024-04-26T00:00:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 >> v1:172.21.15.171:6790/0 conn(0x7f9b580a1530 legacy=0x7f9b580a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 >> v1:172.21.15.106:6789/0 conn(0x7f9b58071730 legacy=0x7f9b5813e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:31.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 monclient: found mon.noname-i 2024-04-26T00:00:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580a3100 con 0x7f9b58071c00 2024-04-26T00:00:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:31.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b4c0017c0 con 0x7f9b58071c00 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 5 monclient: authenticate success, global_id 144664 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: dump: 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:31.807 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b4c001a20 con 0x7f9b58071c00 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:31.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 1 -- 172.21.15.171:0/4050915563 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b4c003960 con 0x7f9b58071c00 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 4 set_mon_vals no callback set 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b55ffb640 10 monclient: dump: 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:31.809 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: shutdown 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/4050915563 >> v1:172.21.15.171:6792/0 conn(0x7f9b58071c00 legacy=0x7f9b5813ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/4050915563 shutdown_connections 2024-04-26T00:00:31.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/4050915563 >> 172.21.15.171:0/4050915563 conn(0x7f9b580a62d0 msgr2=0x7f9b580a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/4050915563 shutdown_connections 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/4050915563 wait complete. 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: build_initial_monmap 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: monmap: 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:31.811 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 Processor -- start 2024-04-26T00:00:31.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- start start 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: init 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: _add_conns ranks=[1,6,4,2,0,5,8,7,3] 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient(hunting): picked mon.noname-f con 0x7f9b58071730 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient(hunting): picked mon.noname-d con 0x7f9b58071c00 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient(hunting): picked mon.noname-c con 0x7f9b580a1530 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b5809fb20 con 0x7f9b58071730 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b581222b0 con 0x7f9b580a1530 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b581206a0 con 0x7f9b58071c00 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient(hunting): authenticate will time out at 1282.522696s 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b56ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9b58071730 0x7f9b581328b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:38800/0 (socket says 172.21.15.171:38800) 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b56ffd640 1 -- 172.21.15.171:0/259087125 learned_addr learned my addr 172.21.15.171:0/259087125 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:31.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2210398092 0 0) 0x7f9b5809fb20 con 0x7f9b58071730 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): my global_id is 144775 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b44003530 con 0x7f9b58071730 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2543040349 0 0) 0x7f9b44003530 con 0x7f9b58071730 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b5809fb20 con 0x7f9b58071730 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b48001a80 con 0x7f9b58071730 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:31.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): dump: 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:31.815 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 24205932 0 0) 0x7f9b5809fb20 con 0x7f9b58071730 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 >> v1:172.21.15.106:6792/0 conn(0x7f9b58071c00 legacy=0x7f9b581d1730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 >> v1:172.21.15.106:6791/0 conn(0x7f9b580a1530 legacy=0x7f9b581d4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:31.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 monclient: found mon.f 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b58120870 con 0x7f9b58071730 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: _finish_auth 0 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 5 monclient: authenticate success, global_id 144775 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: _renew_subs 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b58132fc0 con 0x7f9b58071730 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: _renew_subs 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b581cc640 con 0x7f9b58071730 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b48004aa0 con 0x7f9b58071730 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b48005010 con 0x7f9b58071730 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b557fa640 4 set_mon_vals no callback set 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.811+0000 7f9b3ffff640 10 monclient: dump: 2024-04-26T00:00:31.818 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:31.819 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:31.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.815+0000 7f9b5d9c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:31.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.815+0000 7f9b5d9c2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:31.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.815+0000 7f9b5d9c2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.815+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b38005090 con 0x7f9b58071730 2024-04-26T00:00:31.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.815+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9b48005230 con 0x7f9b58071730 2024-04-26T00:00:31.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.815+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(171..171 src has 29..171) ==== 6977+0+0 (unknown 3251337281 0 0) 0x7f9b48045310 con 0x7f9b58071730 2024-04-26T00:00:31.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.815+0000 7f9b567fc640 10 monclient: get_auth_request con 0x7f9b440377e0 auth_method 0 2024-04-26T00:00:31.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.819+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9b480159e0 con 0x7f9b58071730 2024-04-26T00:00:31.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.819+0000 7f9b3ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:31.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.819+0000 7f9b3ffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.983+0000 7f9b5d9c2640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}] 2024-04-26T00:00:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.983+0000 7f9b5d9c2640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}] 2024-04-26T00:00:31.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.983+0000 7f9b5d9c2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:31.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:31.983+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"} v 0) -- 0x7f9b38005b90 con 0x7f9b58071730 2024-04-26T00:00:32.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.767+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}]=0 added bucket barr type rack to crush map v172) ==== 140+0+0 (unknown 303277315 0 0) 0x7f9b480152e0 con 0x7f9b58071730 2024-04-26T00:00:32.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.767+0000 7f9b3ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}] 2024-04-26T00:00:32.752 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.767+0000 7f9b3ffff640 10 monclient: _finish_command 2 = system:0 added bucket barr type rack to crush map 2024-04-26T00:00:32.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.875+0000 7f9b5d9c2640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}] 2024-04-26T00:00:32.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.875+0000 7f9b5d9c2640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}] 2024-04-26T00:00:32.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.875+0000 7f9b5d9c2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:32.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.875+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"} v 0) -- 0x7f9b380010a0 con 0x7f9b58071730 2024-04-26T00:00:32.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b3ffff640 1 -- 172.21.15.171:0/259087125 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}]=0 bucket 'barr' already exists v172) ==== 128+0+0 (unknown 4115255821 0 0) 0x7f9b4801de90 con 0x7f9b58071730 2024-04-26T00:00:32.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b3ffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "barr", "type": "rack"}] 2024-04-26T00:00:32.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b3ffff640 10 monclient: _finish_command 3 = system:0 bucket 'barr' already exists 2024-04-26T00:00:32.861 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'barr' already exists 2024-04-26T00:00:32.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 >> v1:172.21.15.171:6812/722422047 conn(0x7f9b440377e0 legacy=0x7f9b44039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:32.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 10 monclient: shutdown 2024-04-26T00:00:32.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:32.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 >> v1:172.21.15.171:6789/0 conn(0x7f9b58071730 legacy=0x7f9b581328b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:32.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 shutdown_connections 2024-04-26T00:00:32.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 >> 172.21.15.171:0/259087125 conn(0x7f9b580a62d0 msgr2=0x7f9b581bdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:32.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 shutdown_connections 2024-04-26T00:00:32.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:32.879+0000 7f9b5d9c2640 1 -- 172.21.15.171:0/259087125 wait complete. 2024-04-26T00:00:32.878 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush move barr root=default 2024-04-26T00:00:32.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.011+0000 7fe2779e9640 10 monclient: get_monmap_and_config 2024-04-26T00:00:32.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.011+0000 7fe2779e9640 10 monclient: build_initial_monmap 2024-04-26T00:00:32.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.011+0000 7fe2779e9640 10 monclient: monmap: 2024-04-26T00:00:32.996 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:32.996 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:32.996 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:33.017315+0000 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:33.017315+0000 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:32.997 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:32.998 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:32.998 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:32.998 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:32.998 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:32.998 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.011+0000 7fe2779e9640 1 Processor -- start 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.011+0000 7fe2779e9640 1 -- start start 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.011+0000 7fe2779e9640 10 monclient: init 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: _add_conns ranks=[4,7,2,6,1,5,3,0,8] 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): picked mon.noname-c con 0x7fe2700a1530 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): picked mon.noname-i con 0x7fe270071c00 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): picked mon.noname-b con 0x7fe270071730 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:33.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe27006ea70 con 0x7fe270071730 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2700723d0 con 0x7fe2700a1530 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe270072990 con 0x7fe270071c00 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): authenticate will time out at 1283.724283s 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe274f84640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fe270071c00 0x7fe27013ab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54208/0 (socket says 172.21.15.171:54208) 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe274f84640 1 -- 172.21.15.171:0/3723059640 learned_addr learned my addr 172.21.15.171:0/3723059640 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 357557954 0 0) 0x7fe270072990 con 0x7fe270071c00 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient(hunting): my global_id is 144673 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe25c003530 con 0x7fe270071c00 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1962645380 0 0) 0x7fe25c003530 con 0x7fe270071c00 2024-04-26T00:00:33.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 >> v1:172.21.15.106:6791/0 conn(0x7fe2700a1530 legacy=0x7fe2700a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 >> v1:172.21.15.106:6790/0 conn(0x7fe270071730 legacy=0x7fe27013e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 monclient: found mon.noname-i 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2700a3100 con 0x7fe270071c00 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 5 monclient: authenticate success, global_id 144673 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe2640017c0 con 0x7fe270071c00 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:33.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: dump: 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:33.012 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:33.013 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:33.014 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:33.014 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:33.014 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:33.014 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:33.014 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:33.014 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:33.015 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:33.015 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:33.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:33.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe264001b20 con 0x7fe270071c00 2024-04-26T00:00:33.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:33.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:33.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 1 -- 172.21.15.171:0/3723059640 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe264001d50 con 0x7fe270071c00 2024-04-26T00:00:33.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 4 set_mon_vals no callback set 2024-04-26T00:00:33.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:33.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:33.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe263fff640 10 monclient: dump: 2024-04-26T00:00:33.016 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:33.016 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:33.017 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.017 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.017 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:33.017 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:33.017 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:33.017 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:33.017 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:33.018 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:33.018 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:33.018 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:33.018 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:33.018 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:33.018 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:33.019 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:33.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: shutdown 2024-04-26T00:00:33.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:33.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- 172.21.15.171:0/3723059640 >> v1:172.21.15.171:6792/0 conn(0x7fe270071c00 legacy=0x7fe27013ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:33.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- 172.21.15.171:0/3723059640 shutdown_connections 2024-04-26T00:00:33.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- 172.21.15.171:0/3723059640 >> 172.21.15.171:0/3723059640 conn(0x7fe2700a62d0 msgr2=0x7fe2700a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:33.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- 172.21.15.171:0/3723059640 shutdown_connections 2024-04-26T00:00:33.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- 172.21.15.171:0/3723059640 wait complete. 2024-04-26T00:00:33.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: build_initial_monmap 2024-04-26T00:00:33.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: monmap: 2024-04-26T00:00:33.020 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:33.020 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:33.020 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:33.020 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:33.021 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:33.021 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:33.021 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:33.021 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:33.021 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:33.021 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:33.022 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:33.022 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:33.022 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:33.022 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:33.022 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:33.022 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:33.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 Processor -- start 2024-04-26T00:00:33.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- start start 2024-04-26T00:00:33.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: init 2024-04-26T00:00:33.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:33.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient: _add_conns ranks=[1,8,0,4,6,7,3,2,5] 2024-04-26T00:00:33.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): picked mon.noname-f con 0x7fe270071730 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:33.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): picked mon.noname-e con 0x7fe270071c00 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:33.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): picked mon.noname-a con 0x7fe2700a1530 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:33.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe270120360 con 0x7fe2700a1530 2024-04-26T00:00:33.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe27011db20 con 0x7fe270071730 2024-04-26T00:00:33.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe270120080 con 0x7fe270071c00 2024-04-26T00:00:33.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:33.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe2779e9640 10 monclient(hunting): authenticate will time out at 1283.727374s 2024-04-26T00:00:33.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe274f84640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fe270071c00 legacy=0x7fe2701329a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:33.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe275785640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe270071730 0x7fe2701c9f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:38804/0 (socket says 172.21.15.171:38804) 2024-04-26T00:00:33.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe275785640 1 -- 172.21.15.171:0/1120698440 learned_addr learned my addr 172.21.15.171:0/1120698440 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:33.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081862292 0 0) 0x7fe27011db20 con 0x7fe270071730 2024-04-26T00:00:33.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:33.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:33.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:33.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): my global_id is 144784 2024-04-26T00:00:33.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe254003530 con 0x7fe270071730 2024-04-26T00:00:33.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 337071361 0 0) 0x7fe254003530 con 0x7fe270071730 2024-04-26T00:00:33.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe27011db20 con 0x7fe270071730 2024-04-26T00:00:33.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe26c001ac0 con 0x7fe270071730 2024-04-26T00:00:33.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:33.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:33.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:33.027 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:33.027 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:33.027 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.027 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.028 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:33.028 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:33.028 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:33.028 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:33.028 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:33.028 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:33.029 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:33.029 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:33.029 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:33.029 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:33.029 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:33.029 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:33.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.015+0000 7fe261ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:33.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211145070 0 0) 0x7fe270120360 con 0x7fe2700a1530 2024-04-26T00:00:33.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:33.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:33.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:33.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient(hunting): my global_id is 6381 2024-04-26T00:00:33.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe254003530 con 0x7fe2700a1530 2024-04-26T00:00:33.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2014497580 0 0) 0x7fe27011db20 con 0x7fe270071730 2024-04-26T00:00:33.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 >> v1:172.21.15.106:6793/0 conn(0x7fe270071c00 legacy=0x7fe2701329a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:33.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 >> v1:172.21.15.106:6789/0 conn(0x7fe2700a1530 legacy=0x7fe2701d22a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:33.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:33.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 monclient: found mon.f 2024-04-26T00:00:33.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:33.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:33.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2701330b0 con 0x7fe270071730 2024-04-26T00:00:33.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:33.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:33.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:33.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 5 monclient: authenticate success, global_id 144784 2024-04-26T00:00:33.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 10 monclient: _renew_subs 2024-04-26T00:00:33.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:33.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe270133340 con 0x7fe270071730 2024-04-26T00:00:33.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 10 monclient: _renew_subs 2024-04-26T00:00:33.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:33.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2701d3b90 con 0x7fe270071730 2024-04-26T00:00:33.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe26c003950 con 0x7fe270071730 2024-04-26T00:00:33.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:33.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe26c003ec0 con 0x7fe270071730 2024-04-26T00:00:33.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:33.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2637fe640 4 set_mon_vals no callback set 2024-04-26T00:00:33.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:33.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 10 monclient: dump: 2024-04-26T00:00:33.038 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:33.038 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:33.038 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.038 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:33.039 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:33.039 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:33.039 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:33.039 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:33.039 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:33.039 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:33.040 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:33.040 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:33.040 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:33.040 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:33.040 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:33.040 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:33.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe26c0040e0 con 0x7fe270071730 2024-04-26T00:00:33.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:33.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:33.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:33.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe250005090 con 0x7fe270071730 2024-04-26T00:00:33.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(172..172 src has 29..172) ==== 7005+0+0 (unknown 80879145 0 0) 0x7fe26c045420 con 0x7fe270071730 2024-04-26T00:00:33.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.019+0000 7fe274f84640 10 monclient: get_auth_request con 0x7fe254037800 auth_method 0 2024-04-26T00:00:33.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.023+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe26c0159a0 con 0x7fe270071730 2024-04-26T00:00:33.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.023+0000 7fe261ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:33.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.023+0000 7fe261ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:33.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.191+0000 7fe2779e9640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}] 2024-04-26T00:00:33.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.191+0000 7fe2779e9640 10 monclient: _send_command 2 [{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}] 2024-04-26T00:00:33.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.191+0000 7fe2779e9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:33.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.191+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush move", "name": "barr", "args": ["root=default"]} v 0) -- 0x7fe250005b90 con 0x7fe270071730 2024-04-26T00:00:33.777 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.795+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}]=0 moved item id -19 name 'barr' to location {root=default} in crush map v173) ==== 173+0+0 (unknown 2778383656 0 0) 0x7fe26c0152a0 con 0x7fe270071730 2024-04-26T00:00:33.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.795+0000 7fe261ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}] 2024-04-26T00:00:33.778 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.795+0000 7fe261ffb640 10 monclient: _finish_command 2 = system:0 moved item id -19 name 'barr' to location {root=default} in crush map 2024-04-26T00:00:33.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.895+0000 7fe2779e9640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}] 2024-04-26T00:00:34.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.895+0000 7fe2779e9640 10 monclient: _send_command 3 [{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}] 2024-04-26T00:00:34.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.895+0000 7fe2779e9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:34.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.895+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush move", "name": "barr", "args": ["root=default"]} v 0) -- 0x7fe2500010a0 con 0x7fe270071730 2024-04-26T00:00:34.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe261ffb640 1 -- 172.21.15.171:0/1120698440 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}]=0 no need to move item id -19 name 'barr' to location {root=default} in crush map v173) ==== 183+0+0 (unknown 2804475583 0 0) 0x7fe26c01de50 con 0x7fe270071730 2024-04-26T00:00:34.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe261ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush move", "name": "barr", "args": ["root=default"]}] 2024-04-26T00:00:34.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe261ffb640 10 monclient: _finish_command 3 = system:0 no need to move item id -19 name 'barr' to location {root=default} in crush map 2024-04-26T00:00:34.011 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -19 name 'barr' to location {root=default} in crush map 2024-04-26T00:00:34.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 >> v1:172.21.15.171:6812/722422047 conn(0x7fe254037800 legacy=0x7fe254039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 10 monclient: shutdown 2024-04-26T00:00:34.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:34.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 >> v1:172.21.15.171:6789/0 conn(0x7fe270071730 legacy=0x7fe2701c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 shutdown_connections 2024-04-26T00:00:34.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 >> 172.21.15.171:0/1120698440 conn(0x7fe2700a62d0 msgr2=0x7fe2701bd640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:34.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 shutdown_connections 2024-04-26T00:00:34.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:33.899+0000 7fe2779e9640 1 -- 172.21.15.171:0/1120698440 wait complete. 2024-04-26T00:00:34.013 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush move fooo rack=barr 2024-04-26T00:00:34.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.031+0000 7f87ea8fc640 10 monclient: get_monmap_and_config 2024-04-26T00:00:34.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: build_initial_monmap 2024-04-26T00:00:34.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: monmap: 2024-04-26T00:00:34.017 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:34.017 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:34.017 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:34.038561+0000 2024-04-26T00:00:34.018 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:34.038561+0000 2024-04-26T00:00:34.018 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:34.018 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:34.018 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:34.018 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:34.019 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:34.019 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:34.019 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:34.019 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:34.019 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:34.020 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:34.020 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:34.020 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:34.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 Processor -- start 2024-04-26T00:00:34.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- start start 2024-04-26T00:00:34.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: init 2024-04-26T00:00:34.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:34.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: _add_conns ranks=[5,6,0,4,3,8,7,2,1] 2024-04-26T00:00:34.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient(hunting): picked mon.noname-h con 0x7f87e40a1530 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:34.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient(hunting): picked mon.noname-d con 0x7f87e4071c00 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:34.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient(hunting): picked mon.noname-a con 0x7f87e4071730 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:34.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e406ea70 con 0x7f87e4071730 2024-04-26T00:00:34.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e40723d0 con 0x7f87e40a1530 2024-04-26T00:00:34.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e4072990 con 0x7f87e4071c00 2024-04-26T00:00:34.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:34.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient(hunting): authenticate will time out at 1284.745471s 2024-04-26T00:00:34.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e3fff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f87e40a1530 0x7f87e40a1910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50794/0 (socket says 172.21.15.171:50794) 2024-04-26T00:00:34.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e3fff640 1 -- 172.21.15.171:0/2689716792 learned_addr learned my addr 172.21.15.171:0/2689716792 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:34.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1456256058 0 0) 0x7f87e40723d0 con 0x7f87e40a1530 2024-04-26T00:00:34.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:34.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:34.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:34.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient(hunting): my global_id is 6206 2024-04-26T00:00:34.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87cc003530 con 0x7f87e40a1530 2024-04-26T00:00:34.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1575486006 0 0) 0x7f87cc003530 con 0x7f87e40a1530 2024-04-26T00:00:34.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 >> v1:172.21.15.106:6792/0 conn(0x7f87e4071c00 legacy=0x7f87e413ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 >> v1:172.21.15.106:6789/0 conn(0x7f87e4071730 legacy=0x7f87e413e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:34.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 monclient: found mon.noname-h 2024-04-26T00:00:34.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:34.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:34.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e40a3100 con 0x7f87e40a1530 2024-04-26T00:00:34.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:34.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:34.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:34.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d4001b40 con 0x7f87e40a1530 2024-04-26T00:00:34.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:34.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:34.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: dump: 2024-04-26T00:00:34.039 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:34.039 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:34.039 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.039 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.039 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:34.039 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:34.040 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:34.040 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:34.040 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:34.040 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:34.040 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:34.040 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:34.041 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:34.041 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:34.041 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:34.041 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:34.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 5 monclient: authenticate success, global_id 6206 2024-04-26T00:00:34.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:34.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87d4001ea0 con 0x7f87e40a1530 2024-04-26T00:00:34.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:34.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 1 -- 172.21.15.171:0/2689716792 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87d40020d0 con 0x7f87e40a1530 2024-04-26T00:00:34.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:34.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:34.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87e2ffd640 10 monclient: dump: 2024-04-26T00:00:34.043 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:34.043 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:34.043 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.043 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.043 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:34.044 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:34.044 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:34.044 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:34.044 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:34.044 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:34.044 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:34.045 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:34.045 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:34.045 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:34.045 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:34.045 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:34.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:34.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 4 set_mon_vals no callback set 2024-04-26T00:00:34.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: shutdown 2024-04-26T00:00:34.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:34.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- 172.21.15.171:0/2689716792 >> v1:172.21.15.171:6791/0 conn(0x7f87e40a1530 legacy=0x7f87e40a1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- 172.21.15.171:0/2689716792 shutdown_connections 2024-04-26T00:00:34.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- 172.21.15.171:0/2689716792 >> 172.21.15.171:0/2689716792 conn(0x7f87e40a62d0 msgr2=0x7f87e40a2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:34.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- 172.21.15.171:0/2689716792 shutdown_connections 2024-04-26T00:00:34.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 1 -- 172.21.15.171:0/2689716792 wait complete. 2024-04-26T00:00:34.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: build_initial_monmap 2024-04-26T00:00:34.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.035+0000 7f87ea8fc640 10 monclient: monmap: 2024-04-26T00:00:34.047 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:34.048 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:34.048 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:34.048 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:34.048 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:34.048 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:34.048 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:34.049 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:34.049 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:34.049 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:34.049 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:34.049 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:34.049 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:34.050 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:34.050 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:34.050 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:34.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 Processor -- start 2024-04-26T00:00:34.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 -- start start 2024-04-26T00:00:34.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: init 2024-04-26T00:00:34.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:34.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _add_conns ranks=[4,8,7,3,1,2,6,0,5] 2024-04-26T00:00:34.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient(hunting): picked mon.noname-c con 0x7f87e4071730 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:34.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient(hunting): picked mon.noname-e con 0x7f87e4071c00 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:34.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient(hunting): picked mon.noname-i con 0x7f87e40a1530 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:34.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e41221c0 con 0x7f87e4071730 2024-04-26T00:00:34.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e4120a30 con 0x7f87e40a1530 2024-04-26T00:00:34.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87e409f660 con 0x7f87e4071c00 2024-04-26T00:00:34.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:34.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient(hunting): authenticate will time out at 1284.748744s 2024-04-26T00:00:34.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e37fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f87e4071c00 legacy=0x7f87e41327e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e8e99640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f87e40a1530 0x7f87e41d4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:54224/0 (socket says 172.21.15.171:54224) 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e8e99640 1 -- 172.21.15.171:0/4173234868 learned_addr learned my addr 172.21.15.171:0/4173234868 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722683990 0 0) 0x7f87e4120a30 con 0x7f87e40a1530 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): my global_id is 144682 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87d0003530 con 0x7f87e40a1530 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 272837353 0 0) 0x7f87d0003530 con 0x7f87e40a1530 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87e4120a30 con 0x7f87e40a1530 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4147513430 0 0) 0x7f87e41221c0 con 0x7f87e4071730 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:34.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): my global_id is 144823 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87d0003530 con 0x7f87e4071730 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87dc0019a0 con 0x7f87e40a1530 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:34.054 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:34.055 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:34.055 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1462449288 0 0) 0x7f87e4120a30 con 0x7f87e40a1530 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 >> v1:172.21.15.106:6793/0 conn(0x7f87e4071c00 legacy=0x7f87e41327e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 >> v1:172.21.15.106:6791/0 conn(0x7f87e4071730 legacy=0x7f87e41cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 monclient: found mon.i 2024-04-26T00:00:34.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e4070fc0 con 0x7f87e40a1530 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 5 monclient: authenticate success, global_id 144682 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _renew_subs 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f87e4121920 con 0x7f87e40a1530 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _renew_subs 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f87e4132ef0 con 0x7f87e40a1530 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87dc0038d0 con 0x7f87e40a1530 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:34.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f87dc003e40 con 0x7f87e40a1530 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e27fc640 4 set_mon_vals no callback set 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 10 monclient: dump: 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:34.060 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f87dc003fe0 con 0x7f87e40a1530 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c4005090 con 0x7f87e40a1530 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(173..173 src has 29..173) ==== 7193+0+0 (unknown 4180315599 0 0) 0x7f87dc045120 con 0x7f87e40a1530 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.039+0000 7f87e3fff640 10 monclient: get_auth_request con 0x7f87d0037920 auth_method 0 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.043+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f87dc015640 con 0x7f87e40a1530 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.043+0000 7f87e0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:34.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.043+0000 7f87e0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:34.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.207+0000 7f87ea8fc640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}] 2024-04-26T00:00:34.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.207+0000 7f87ea8fc640 10 monclient: _send_command 2 [{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}] 2024-04-26T00:00:34.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.207+0000 7f87ea8fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:34.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.207+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]} v 0) -- 0x7f87c4005b90 con 0x7f87e40a1530 2024-04-26T00:00:34.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.795+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}]=0 moved item id -16 name 'fooo' to location {rack=barr} in crush map v174) ==== 167+0+0 (unknown 2412139287 0 0) 0x7f87dc01daf0 con 0x7f87e40a1530 2024-04-26T00:00:34.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.795+0000 7f87e0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}] 2024-04-26T00:00:34.780 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.795+0000 7f87e0ff9640 10 monclient: _finish_command 2 = system:0 moved item id -16 name 'fooo' to location {rack=barr} in crush map 2024-04-26T00:00:34.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.899+0000 7f87ea8fc640 10 start_mon_command cmd=[{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}] 2024-04-26T00:00:34.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.899+0000 7f87ea8fc640 10 monclient: _send_command 3 [{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}] 2024-04-26T00:00:34.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.899+0000 7f87ea8fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:34.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.899+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]} v 0) -- 0x7f87c40010a0 con 0x7f87e40a1530 2024-04-26T00:00:34.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87e0ff9640 1 -- 172.21.15.171:0/4173234868 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}]=0 no need to move item id -16 name 'fooo' to location {rack=barr} in crush map v174) ==== 177+0+0 (unknown 2914266566 0 0) 0x7f87dc042150 con 0x7f87e40a1530 2024-04-26T00:00:34.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87e0ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush move", "name": "fooo", "args": ["rack=barr"]}] 2024-04-26T00:00:34.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87e0ff9640 10 monclient: _finish_command 3 = system:0 no need to move item id -16 name 'fooo' to location {rack=barr} in crush map 2024-04-26T00:00:34.886 INFO:tasks.workunit.client.0.smithi171.stderr:no need to move item id -16 name 'fooo' to location {rack=barr} in crush map 2024-04-26T00:00:34.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 >> v1:172.21.15.171:6812/722422047 conn(0x7f87d0037920 legacy=0x7f87d0039de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 10 monclient: shutdown 2024-04-26T00:00:34.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:34.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 >> v1:172.21.15.171:6792/0 conn(0x7f87e40a1530 legacy=0x7f87e41d4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:34.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 shutdown_connections 2024-04-26T00:00:34.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 >> 172.21.15.171:0/4173234868 conn(0x7f87e40a62d0 msgr2=0x7f87e41bda10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:34.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 shutdown_connections 2024-04-26T00:00:34.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:34.903+0000 7f87ea8fc640 1 -- 172.21.15.171:0/4173234868 wait complete. 2024-04-26T00:00:34.903 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm fooo 2024-04-26T00:00:35.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.035+0000 7f9620b03640 10 monclient: get_monmap_and_config 2024-04-26T00:00:35.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.035+0000 7f9620b03640 10 monclient: build_initial_monmap 2024-04-26T00:00:35.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.035+0000 7f9620b03640 10 monclient: monmap: 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:35.041285+0000 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:35.041285+0000 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:35.020 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:35.021 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:35.021 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.035+0000 7f9620b03640 1 Processor -- start 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.035+0000 7f9620b03640 1 -- start start 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.035+0000 7f9620b03640 10 monclient: init 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: _add_conns ranks=[5,8,3,2,7,0,6,1,4] 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): picked mon.noname-h con 0x7f961c0a52c0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): picked mon.noname-e con 0x7f961c0a4a30 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): picked mon.noname-g con 0x7f961c13e3a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c0a2fe0 con 0x7f961c13e3a0 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c0a5db0 con 0x7f961c0a52c0 2024-04-26T00:00:35.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c0a2a20 con 0x7f961c0a4a30 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): authenticate will time out at 1285.748179s 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961a59c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f961c0a52c0 0x7f961c0a56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50802/0 (socket says 172.21.15.171:50802) 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961ad9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f961c13e3a0 0x7f961c140790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60594/0 (socket says 172.21.15.171:60594) 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961a59c640 1 -- 172.21.15.171:0/3101407614 learned_addr learned my addr 172.21.15.171:0/3101407614 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9619d9b640 1 -- 172.21.15.171:0/3101407614 >> v1:172.21.15.106:6793/0 conn(0x7f961c0a4a30 legacy=0x7f961c13cc80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362185790 0 0) 0x7f961c0a5db0 con 0x7f961c0a52c0 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): my global_id is 6215 2024-04-26T00:00:35.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9604003530 con 0x7f961c0a52c0 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3089741073 0 0) 0x7f96140014a0 con 0x7f961c13e3a0 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient(hunting): my global_id is 6528 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f961c0a5db0 con 0x7f961c13e3a0 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2720697822 0 0) 0x7f9604003530 con 0x7f961c0a52c0 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 >> v1:172.21.15.106:6793/0 conn(0x7f961c0a4a30 legacy=0x7f961c13cc80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 >> v1:172.21.15.171:6790/0 conn(0x7f961c13e3a0 legacy=0x7f961c140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: _finish_hunting 0 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 monclient: found mon.noname-h 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:35.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c0a2d00 con 0x7f961c0a52c0 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: _finish_auth 0 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: _check_auth_tickets 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c0017c0 con 0x7f961c0a52c0 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: dump: 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.031 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:35.032 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 5 monclient: authenticate success, global_id 6215 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f960c001a60 con 0x7f961c0a52c0 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 1 -- 172.21.15.171:0/3101407614 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c004bf0 con 0x7f961c0a52c0 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 4 set_mon_vals no callback set 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961959a640 10 monclient: dump: 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.033 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: shutdown 2024-04-26T00:00:35.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- 172.21.15.171:0/3101407614 >> v1:172.21.15.171:6791/0 conn(0x7f961c0a52c0 legacy=0x7f961c0a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- 172.21.15.171:0/3101407614 shutdown_connections 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- 172.21.15.171:0/3101407614 >> 172.21.15.171:0/3101407614 conn(0x7f961c0aa030 msgr2=0x7f961c0aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- 172.21.15.171:0/3101407614 shutdown_connections 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- 172.21.15.171:0/3101407614 wait complete. 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: build_initial_monmap 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: monmap: 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:35.035 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 Processor -- start 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- start start 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: init 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:35.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient: _add_conns ranks=[3,5,4,8,7,0,1,6,2] 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): picked mon.noname-g con 0x7f961c0a4a30 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): picked mon.noname-h con 0x7f961c0a52c0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): picked mon.noname-c con 0x7f961c13e3a0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c09af50 con 0x7f961c0a4a30 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c09d240 con 0x7f961c13e3a0 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961c0a1f50 con 0x7f961c0a52c0 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9620b03640 10 monclient(hunting): authenticate will time out at 1285.751244s 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961a59c640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f961c0a4a30 0x7f961c1cc820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60604/0 (socket says 172.21.15.171:60604) 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f9619d9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f961c0a52c0 0x7f961c1d1840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50814/0 (socket says 172.21.15.171:50814) 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f961a59c640 1 -- 172.21.15.171:0/360311850 learned_addr learned my addr 172.21.15.171:0/360311850 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1227042359 0 0) 0x7f961c09af50 con 0x7f961c0a4a30 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:35.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): my global_id is 6537 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95fc003530 con 0x7f961c0a4a30 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194558148 0 0) 0x7f961c0a1f50 con 0x7f961c0a52c0 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): my global_id is 6224 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f961c09af50 con 0x7f961c0a52c0 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4229404100 0 0) 0x7f95fc003530 con 0x7f961c0a4a30 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f961c0a1f50 con 0x7f961c0a4a30 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 888403890 0 0) 0x7f961c09af50 con 0x7f961c0a52c0 2024-04-26T00:00:35.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95fc003530 con 0x7f961c0a52c0 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c004b30 con 0x7f961c0a4a30 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): dump: 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:35.039 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9610004220 con 0x7f961c0a52c0 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.039+0000 7f960affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient(hunting): dump: 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.040 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854697667 0 0) 0x7f961c09d240 con 0x7f961c13e3a0 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:35.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient(hunting): my global_id is 144832 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f961c09af50 con 0x7f961c13e3a0 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1144116505 0 0) 0x7f961c0a1f50 con 0x7f961c0a4a30 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 >> v1:172.21.15.171:6791/0 conn(0x7f961c0a52c0 legacy=0x7f961c1d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 >> v1:172.21.15.106:6791/0 conn(0x7f961c13e3a0 legacy=0x7f961c1d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 monclient: found mon.g 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961c0a0f80 con 0x7f961c0a4a30 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: _finish_auth 0 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:35.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 5 monclient: authenticate success, global_id 6537 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 10 monclient: _renew_subs 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f961c09cf60 con 0x7f961c0a4a30 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 10 monclient: _renew_subs 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f961c09bcd0 con 0x7f961c0a4a30 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f960c001a60 con 0x7f961c0a4a30 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:35.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f960c001180 con 0x7f961c0a4a30 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9618d99640 4 set_mon_vals no callback set 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 10 monclient: dump: 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:35.044 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f960c00fe40 con 0x7f961c0a4a30 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9600005090 con 0x7f961c0a4a30 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(174..174 src has 29..174) ==== 7193+0+0 (unknown 1315710926 0 0) 0x7f960c0453c0 con 0x7f961c0a4a30 2024-04-26T00:00:35.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.043+0000 7f9619d9b640 10 monclient: get_auth_request con 0x7f95fc037f40 auth_method 0 2024-04-26T00:00:35.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.047+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f960c015880 con 0x7f961c0a4a30 2024-04-26T00:00:35.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.047+0000 7f960affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:35.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.047+0000 7f960affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:35.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.215+0000 7f9620b03640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "fooo"}] 2024-04-26T00:00:35.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.215+0000 7f9620b03640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "fooo"}] 2024-04-26T00:00:35.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.215+0000 7f9620b03640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:35.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.215+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "fooo"} v 0) -- 0x7f9600005380 con 0x7f961c0a4a30 2024-04-26T00:00:35.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.823+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "fooo"}]=0 removed item id -16 name 'fooo' from crush map v175) ==== 122+0+0 (unknown 3580952743 0 0) 0x7f960c01dd30 con 0x7f961c0a4a30 2024-04-26T00:00:35.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.823+0000 7f960affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "fooo"}] 2024-04-26T00:00:35.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.823+0000 7f960affd640 10 monclient: _finish_command 2 = system:0 removed item id -16 name 'fooo' from crush map 2024-04-26T00:00:35.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.923+0000 7f9620b03640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "fooo"}] 2024-04-26T00:00:35.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.923+0000 7f9620b03640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "fooo"}] 2024-04-26T00:00:35.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.923+0000 7f9620b03640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:35.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.923+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "fooo"} v 0) -- 0x7f9600002220 con 0x7f961c0a4a30 2024-04-26T00:00:35.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f960affd640 1 -- 172.21.15.171:0/360311850 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "fooo"}]=0 device 'fooo' does not appear in the crush map v175) ==== 122+0+0 (unknown 4258338422 0 0) 0x7f960c013550 con 0x7f961c0a4a30 2024-04-26T00:00:35.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f960affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "fooo"}] 2024-04-26T00:00:35.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f960affd640 10 monclient: _finish_command 3 = system:0 device 'fooo' does not appear in the crush map 2024-04-26T00:00:35.910 INFO:tasks.workunit.client.0.smithi171.stderr:device 'fooo' does not appear in the crush map 2024-04-26T00:00:35.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 >> v1:172.21.15.171:6812/722422047 conn(0x7f95fc037f40 legacy=0x7f95fc03a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:35.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 10 monclient: shutdown 2024-04-26T00:00:35.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:35.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 >> v1:172.21.15.171:6790/0 conn(0x7f961c0a4a30 legacy=0x7f961c1cc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:35.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 shutdown_connections 2024-04-26T00:00:35.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 >> 172.21.15.171:0/360311850 conn(0x7f961c0aa030 msgr2=0x7f961c0a7f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:35.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 shutdown_connections 2024-04-26T00:00:35.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:35.927+0000 7f9620b03640 1 -- 172.21.15.171:0/360311850 wait complete. 2024-04-26T00:00:35.925 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm barr 2024-04-26T00:00:36.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient: get_monmap_and_config 2024-04-26T00:00:36.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient: build_initial_monmap 2024-04-26T00:00:36.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient: monmap: 2024-04-26T00:00:36.042 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:36.042 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:36.042 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:36.063568+0000 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:36.063568+0000 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:36.043 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:36.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 1 Processor -- start 2024-04-26T00:00:36.051 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 1 -- start start 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient: init 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient: _add_conns ranks=[6,8,2,0,7,1,3,4,5] 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient(hunting): picked mon.noname-d con 0x7f8bdc135bb0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient(hunting): picked mon.noname-e con 0x7f8bdc1356f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient(hunting): picked mon.noname-b con 0x7f8bdc13c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc0a1da0 con 0x7f8bdc13c130 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc0a1fe0 con 0x7f8bdc135bb0 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc072720 con 0x7f8bdc1356f0 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be2afe640 10 monclient(hunting): authenticate will time out at 1286.770750s 2024-04-26T00:00:36.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdbfff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8bdc1356f0 legacy=0x7f8bdc13aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be109b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f8bdc13c130 0x7f8bdc13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:43608/0 (socket says 172.21.15.171:43608) 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be109b640 1 -- 172.21.15.171:0/1645149007 learned_addr learned my addr 172.21.15.171:0/1645149007 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8be089a640 1 --1- 172.21.15.171:0/1645149007 >> v1:172.21.15.106:6792/0 conn(0x7f8bdc135bb0 0x7f8bdc135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:42062/0 (socket says 172.21.15.171:42062) 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088701226 0 0) 0x7f8bdc0a1da0 con 0x7f8bdc13c130 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): my global_id is 6248 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc4003530 con 0x7f8bdc13c130 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173139325 0 0) 0x7f8bdc0a1fe0 con 0x7f8bdc135bb0 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:36.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 10 monclient(hunting): my global_id is 6333 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.059+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bdc0a1da0 con 0x7f8bdc135bb0 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2898673722 0 0) 0x7f8bc4003530 con 0x7f8bdc13c130 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 >> v1:172.21.15.106:6793/0 conn(0x7f8bdc1356f0 legacy=0x7f8bdc13aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 >> v1:172.21.15.106:6792/0 conn(0x7f8bdc135bb0 legacy=0x7f8bdc135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 monclient: found mon.noname-b 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc0a17f0 con 0x7f8bdc13c130 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bd4001b40 con 0x7f8bdc13c130 2024-04-26T00:00:36.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: dump: 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:36.055 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 5 monclient: authenticate success, global_id 6248 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bd4001e60 con 0x7f8bdc13c130 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 4 set_mon_vals no callback set 2024-04-26T00:00:36.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 1 -- 172.21.15.171:0/1645149007 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bd4004f70 con 0x7f8bdc13c130 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdb7fe640 10 monclient: dump: 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:36.057 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: shutdown 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- 172.21.15.171:0/1645149007 >> v1:172.21.15.106:6790/0 conn(0x7f8bdc13c130 legacy=0x7f8bdc13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- 172.21.15.171:0/1645149007 shutdown_connections 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- 172.21.15.171:0/1645149007 >> 172.21.15.171:0/1645149007 conn(0x7f8bdc0a2620 msgr2=0x7f8bdc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- 172.21.15.171:0/1645149007 shutdown_connections 2024-04-26T00:00:36.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- 172.21.15.171:0/1645149007 wait complete. 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: build_initial_monmap 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: monmap: 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:36.059 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 Processor -- start 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- start start 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: init 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: _add_conns ranks=[1,8,3,2,7,0,5,6,4] 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient(hunting): picked mon.noname-f con 0x7f8bdc1356f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:36.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient(hunting): picked mon.noname-e con 0x7f8bdc135bb0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient(hunting): picked mon.noname-g con 0x7f8bdc13c130 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc13a400 con 0x7f8bdc1356f0 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc0719a0 con 0x7f8bdc13c130 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bdc138110 con 0x7f8bdc135bb0 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient(hunting): authenticate will time out at 1286.774249s 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bdbfff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f8bdc135bb0 legacy=0x7f8bdc1ceb50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be089a640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8bdc1356f0 0x7f8bdc13a820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:38814/0 (socket says 172.21.15.171:38814) 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be089a640 1 -- 172.21.15.171:0/2060386096 learned_addr learned my addr 172.21.15.171:0/2060386096 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567176271 0 0) 0x7f8bdc0719a0 con 0x7f8bdc13c130 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:36.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): my global_id is 6546 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc8003530 con 0x7f8bdc13c130 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 894200753 0 0) 0x7f8bdc13a400 con 0x7f8bdc1356f0 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): my global_id is 144793 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bdc0719a0 con 0x7f8bdc1356f0 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 623417637 0 0) 0x7f8bdc0719a0 con 0x7f8bdc1356f0 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bdc13a400 con 0x7f8bdc1356f0 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1105208887 0 0) 0x7f8bc8003530 con 0x7f8bdc13c130 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bdc0719a0 con 0x7f8bdc13c130 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bd00019f0 con 0x7f8bdc1356f0 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:36.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): dump: 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:36.063 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bd4004eb0 con 0x7f8bdc13c130 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient(hunting): dump: 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.064 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:36.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 466099505 0 0) 0x7f8bdc13a400 con 0x7f8bdc1356f0 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 >> v1:172.21.15.106:6793/0 conn(0x7f8bdc135bb0 legacy=0x7f8bdc1ceb50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 >> v1:172.21.15.171:6790/0 conn(0x7f8bdc13c130 legacy=0x7f8bdc1d2280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 monclient: found mon.f 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bdc13a120 con 0x7f8bdc1356f0 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 5 monclient: authenticate success, global_id 144793 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: _renew_subs 2024-04-26T00:00:36.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8bdc13af30 con 0x7f8bdc1356f0 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: _renew_subs 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8bdc1d3b70 con 0x7f8bdc1356f0 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bd0004aa0 con 0x7f8bdc1356f0 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bd0001c10 con 0x7f8bdc1356f0 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bda7fc640 4 set_mon_vals no callback set 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.063+0000 7f8bd97fa640 10 monclient: dump: 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.067 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.067+0000 7f8be2afe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:36.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.067+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8bd000fb90 con 0x7f8bdc1356f0 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.067+0000 7f8be2afe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.067+0000 7f8be2afe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.067+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bbc005090 con 0x7f8bdc1356f0 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.067+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(175..175 src has 29..175) ==== 6977+0+0 (unknown 910165204 0 0) 0x7f8bd0045290 con 0x7f8bdc1356f0 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.067+0000 7f8bdbfff640 10 monclient: get_auth_request con 0x7f8bc8037d00 auth_method 0 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.071+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8bd00157c0 con 0x7f8bdc1356f0 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.071+0000 7f8bd97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:36.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.071+0000 7f8bd97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.239+0000 7f8be2afe640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "barr"}] 2024-04-26T00:00:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.239+0000 7f8be2afe640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "barr"}] 2024-04-26T00:00:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.239+0000 7f8be2afe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.239+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "barr"} v 0) -- 0x7f8bbc005380 con 0x7f8bdc1356f0 2024-04-26T00:00:36.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.827+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "barr"}]=0 removed item id -19 name 'barr' from crush map v176) ==== 122+0+0 (unknown 4087820613 0 0) 0x7f8bd00150c0 con 0x7f8bdc1356f0 2024-04-26T00:00:36.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.827+0000 7f8bd97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "barr"}] 2024-04-26T00:00:36.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.827+0000 7f8bd97fa640 10 monclient: _finish_command 2 = system:0 removed item id -19 name 'barr' from crush map 2024-04-26T00:00:36.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.935+0000 7f8be2afe640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "barr"}] 2024-04-26T00:00:36.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.935+0000 7f8be2afe640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "barr"}] 2024-04-26T00:00:36.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.935+0000 7f8be2afe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:36.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.935+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "barr"} v 0) -- 0x7f8bbc002220 con 0x7f8bdc1356f0 2024-04-26T00:00:36.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.935+0000 7f8bd97fa640 1 -- 172.21.15.171:0/2060386096 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "barr"}]=0 device 'barr' does not appear in the crush map v176) ==== 122+0+0 (unknown 3094893786 0 0) 0x7f8bd0019410 con 0x7f8bdc1356f0 2024-04-26T00:00:36.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.935+0000 7f8bd97fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "barr"}] 2024-04-26T00:00:36.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.935+0000 7f8bd97fa640 10 monclient: _finish_command 3 = system:0 device 'barr' does not appear in the crush map 2024-04-26T00:00:36.920 INFO:tasks.workunit.client.0.smithi171.stderr:device 'barr' does not appear in the crush map 2024-04-26T00:00:36.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 >> v1:172.21.15.171:6812/722422047 conn(0x7f8bc8037d00 legacy=0x7f8bc803a1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:36.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 10 monclient: shutdown 2024-04-26T00:00:36.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:36.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 >> v1:172.21.15.171:6789/0 conn(0x7f8bdc1356f0 legacy=0x7f8bdc13a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:36.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 shutdown_connections 2024-04-26T00:00:36.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 >> 172.21.15.171:0/2060386096 conn(0x7f8bdc0a2620 msgr2=0x7f8bdc133970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:36.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 shutdown_connections 2024-04-26T00:00:36.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:36.939+0000 7f8be2afe640 1 -- 172.21.15.171:0/2060386096 wait complete. 2024-04-26T00:00:36.937 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set rm-compat 2024-04-26T00:00:37.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient: get_monmap_and_config 2024-04-26T00:00:37.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient: build_initial_monmap 2024-04-26T00:00:37.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient: monmap: 2024-04-26T00:00:37.054 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:37.076097+0000 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:37.076097+0000 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:37.055 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:37.056 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:37.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 1 Processor -- start 2024-04-26T00:00:37.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 1 -- start start 2024-04-26T00:00:37.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient: init 2024-04-26T00:00:37.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient: _add_conns ranks=[0,1,3,6,7,4,2,8,5] 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient(hunting): picked mon.noname-a con 0x7f6f6c072210 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient(hunting): picked mon.noname-f con 0x7f6f6c137e20 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient(hunting): picked mon.noname-g con 0x7f6f6c13e3a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c072d00 con 0x7f6f6c072210 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c06faa0 con 0x7f6f6c137e20 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c072f20 con 0x7f6f6c13e3a0 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 10 monclient(hunting): authenticate will time out at 1287.783005s 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f724b9640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6f6c13e3a0 0x7f6f6c140790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60628/0 (socket says 172.21.15.171:60628) 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f724b9640 1 -- 172.21.15.171:0/2153890746 learned_addr learned my addr 172.21.15.171:0/2153890746 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f714b7640 1 --1- 172.21.15.171:0/2153890746 >> v1:172.21.15.171:6789/0 conn(0x7f6f6c137e20 0x7f6f6c13cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:38822/0 (socket says 172.21.15.171:38822) 2024-04-26T00:00:37.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624012816 0 0) 0x7f6f6c06faa0 con 0x7f6f6c137e20 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): _negotiate 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): my global_id is 144802 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f58003530 con 0x7f6f6c137e20 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121215906 0 0) 0x7f6f6c072f20 con 0x7f6f6c13e3a0 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): _negotiate 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient(hunting): my global_id is 6555 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f6c06faa0 con 0x7f6f6c13e3a0 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3631449837 0 0) 0x7f6f58003530 con 0x7f6f6c137e20 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 >> v1:172.21.15.171:6790/0 conn(0x7f6f6c13e3a0 legacy=0x7f6f6c140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:37.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 >> v1:172.21.15.106:6789/0 conn(0x7f6f6c072210 legacy=0x7f6f6c0725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient: _finish_hunting 0 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 monclient: found mon.noname-f 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c06f200 con 0x7f6f6c137e20 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient: _finish_auth 0 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient: _check_auth_tickets 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f680017c0 con 0x7f6f6c137e20 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f70cb6640 10 monclient: dump: 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:37.065 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:37.066 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 5 monclient: authenticate success, global_id 144802 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.071+0000 7f6f73f1c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f680019b0 con 0x7f6f6c137e20 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f70cb6640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f70cb6640 1 -- 172.21.15.171:0/2153890746 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f68004b30 con 0x7f6f6c137e20 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f70cb6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f70cb6640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f70cb6640 10 monclient: dump: 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.067 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 4 set_mon_vals no callback set 2024-04-26T00:00:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: shutdown 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- 172.21.15.171:0/2153890746 >> v1:172.21.15.171:6789/0 conn(0x7f6f6c137e20 legacy=0x7f6f6c13cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- 172.21.15.171:0/2153890746 shutdown_connections 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- 172.21.15.171:0/2153890746 >> 172.21.15.171:0/2153890746 conn(0x7f6f6c0a2620 msgr2=0x7f6f6c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- 172.21.15.171:0/2153890746 shutdown_connections 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- 172.21.15.171:0/2153890746 wait complete. 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: build_initial_monmap 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: monmap: 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 Processor -- start 2024-04-26T00:00:37.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- start start 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: init 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: _add_conns ranks=[3,5,8,7,2,6,1,0,4] 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient(hunting): picked mon.noname-g con 0x7f6f6c072210 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient(hunting): picked mon.noname-h con 0x7f6f6c137e20 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient(hunting): picked mon.noname-e con 0x7f6f6c13e3a0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c11ca10 con 0x7f6f6c072210 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c06ec60 con 0x7f6f6c137e20 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f6c06e710 con 0x7f6f6c13e3a0 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient(hunting): authenticate will time out at 1287.786238s 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f714b7640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6f6c137e20 0x7f6f6c1d1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50830/0 (socket says 172.21.15.171:50830) 2024-04-26T00:00:37.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f71cb8640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f6f6c072210 0x7f6f6c130da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60640/0 (socket says 172.21.15.171:60640) 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f714b7640 1 -- 172.21.15.171:0/1177201694 learned_addr learned my addr 172.21.15.171:0/1177201694 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f724b9640 1 -- 172.21.15.171:0/1177201694 >> v1:172.21.15.106:6793/0 conn(0x7f6f6c13e3a0 legacy=0x7f6f6c1d4eb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1362235806 0 0) 0x7f6f6c11ca10 con 0x7f6f6c072210 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): my global_id is 6564 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f50003530 con 0x7f6f6c072210 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 542390081 0 0) 0x7f6f6c06ec60 con 0x7f6f6c137e20 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): my global_id is 6233 2024-04-26T00:00:37.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f6c11ca10 con 0x7f6f6c137e20 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2594254279 0 0) 0x7f6f50003530 con 0x7f6f6c072210 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f6c06ec60 con 0x7f6f6c072210 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f5c001a60 con 0x7f6f6c072210 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): dump: 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:37.073 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3408705790 0 0) 0x7f6f6c11ca10 con 0x7f6f6c137e20 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f50003530 con 0x7f6f6c137e20 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f68001780 con 0x7f6f6c137e20 2024-04-26T00:00:37.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient(hunting): dump: 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:37.075 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2077722354 0 0) 0x7f6f6c06ec60 con 0x7f6f6c072210 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 >> v1:172.21.15.106:6793/0 conn(0x7f6f6c13e3a0 legacy=0x7f6f6c1d4eb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 >> v1:172.21.15.171:6791/0 conn(0x7f6f6c137e20 legacy=0x7f6f6c1d1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 monclient: found mon.g 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f6c13c0b0 con 0x7f6f6c072210 2024-04-26T00:00:37.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 5 monclient: authenticate success, global_id 6564 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: _renew_subs 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f6c11c730 con 0x7f6f6c072210 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: _renew_subs 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f6c11d1c0 con 0x7f6f6c072210 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f5c001d40 con 0x7f6f6c072210 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f5c003c10 con 0x7f6f6c072210 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:37.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f63fff640 4 set_mon_vals no callback set 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.075+0000 7f6f627fc640 10 monclient: dump: 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:37.078 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.079+0000 7f6f73f1c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.079+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6f5c003e30 con 0x7f6f6c072210 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.079+0000 7f6f73f1c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.079+0000 7f6f73f1c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.079+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f54005090 con 0x7f6f6c072210 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.079+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(176..176 src has 29..176) ==== 6761+0+0 (unknown 2209237014 0 0) 0x7f6f5c0450e0 con 0x7f6f6c072210 2024-04-26T00:00:37.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.079+0000 7f6f714b7640 10 monclient: get_auth_request con 0x7f6f50037e10 auth_method 0 2024-04-26T00:00:37.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.083+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6f5c015770 con 0x7f6f6c072210 2024-04-26T00:00:37.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.083+0000 7f6f627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:37.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.083+0000 7f6f627fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:37.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.251+0000 7f6f73f1c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:37.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.251+0000 7f6f73f1c640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:37.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.251+0000 7f6f73f1c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:37.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.251+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f6f54005380 con 0x7f6f6c072210 2024-04-26T00:00:37.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.855+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v177) ==== 78+0+0 (unknown 2445684450 0 0) 0x7f6f5c015070 con 0x7f6f6c072210 2024-04-26T00:00:37.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.855+0000 7f6f627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:37.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.855+0000 7f6f627fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.959+0000 7f6f73f1c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.959+0000 7f6f73f1c640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.959+0000 7f6f73f1c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:37.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:37.959+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f6f54002220 con 0x7f6f6c072210 2024-04-26T00:00:38.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.867+0000 7f6f627fc640 1 -- 172.21.15.171:0/1177201694 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v178) ==== 78+0+0 (unknown 1401286797 0 0) 0x7f6f5c0193c0 con 0x7f6f6c072210 2024-04-26T00:00:38.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.867+0000 7f6f627fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:00:38.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.867+0000 7f6f627fc640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:00:38.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 >> v1:172.21.15.171:6812/722422047 conn(0x7f6f50037e10 legacy=0x7f6f5003a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:38.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 10 monclient: shutdown 2024-04-26T00:00:38.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:38.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 >> v1:172.21.15.171:6790/0 conn(0x7f6f6c072210 legacy=0x7f6f6c130da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:38.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 shutdown_connections 2024-04-26T00:00:38.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 >> 172.21.15.171:0/1177201694 conn(0x7f6f6c0a2620 msgr2=0x7f6f6c1323d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:38.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 shutdown_connections 2024-04-26T00:00:38.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:38.875+0000 7f6f73f1c640 1 -- 172.21.15.171:0/1177201694 wait complete. 2024-04-26T00:00:38.877 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set create-compat 2024-04-26T00:00:38.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.011+0000 7ff61bc0c640 10 monclient: get_monmap_and_config 2024-04-26T00:00:38.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.011+0000 7ff61bc0c640 10 monclient: build_initial_monmap 2024-04-26T00:00:38.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.011+0000 7ff61bc0c640 10 monclient: monmap: 2024-04-26T00:00:38.995 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:38.995 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:38.995 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:39.016919+0000 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:39.016919+0000 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:38.996 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:38.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.011+0000 7ff61bc0c640 1 Processor -- start 2024-04-26T00:00:38.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.011+0000 7ff61bc0c640 1 -- start start 2024-04-26T00:00:38.997 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.011+0000 7ff61bc0c640 10 monclient: init 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: _add_conns ranks=[6,5,2,4,7,1,8,3,0] 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): picked mon.noname-d con 0x7ff6140a3fc0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): picked mon.noname-h con 0x7ff61409d550 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): picked mon.noname-b con 0x7ff61413b920 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61406c0b0 con 0x7ff61413b920 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6140a0e00 con 0x7ff61409d550 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61406bdd0 con 0x7ff6140a3fc0 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:38.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): authenticate will time out at 1289.724804s 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6191a7640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7ff61409d550 0x7ff61409d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50838/0 (socket says 172.21.15.171:50838) 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6191a7640 1 -- 172.21.15.171:0/1962963321 learned_addr learned my addr 172.21.15.171:0/1962963321 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555133475 0 0) 0x7ff6140a0e00 con 0x7ff61409d550 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient(hunting): _negotiate 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient(hunting): my global_id is 6242 2024-04-26T00:00:38.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff600003530 con 0x7ff61409d550 2024-04-26T00:00:39.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2596447619 0 0) 0x7ff600003530 con 0x7ff61409d550 2024-04-26T00:00:39.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 >> v1:172.21.15.106:6792/0 conn(0x7ff6140a3fc0 legacy=0x7ff614135b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:39.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 >> v1:172.21.15.106:6790/0 conn(0x7ff61413b920 legacy=0x7ff61413dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: _finish_hunting 0 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 monclient: found mon.noname-h 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff61409ab00 con 0x7ff61409d550 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: _finish_auth 0 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: _check_auth_tickets 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff6080017c0 con 0x7ff61409d550 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: dump: 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:39.005 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:39.006 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 5 monclient: authenticate success, global_id 6242 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff608001ab0 con 0x7ff61409d550 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 1 -- 172.21.15.171:0/1962963321 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff608004bf0 con 0x7ff61409d550 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff6189a6640 10 monclient: dump: 2024-04-26T00:00:39.007 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:39.008 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 4 set_mon_vals no callback set 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: shutdown 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- 172.21.15.171:0/1962963321 >> v1:172.21.15.171:6791/0 conn(0x7ff61409d550 legacy=0x7ff61409d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- 172.21.15.171:0/1962963321 shutdown_connections 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- 172.21.15.171:0/1962963321 >> 172.21.15.171:0/1962963321 conn(0x7ff6140a73b0 msgr2=0x7ff6140a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- 172.21.15.171:0/1962963321 shutdown_connections 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- 172.21.15.171:0/1962963321 wait complete. 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: build_initial_monmap 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: monmap: 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:39.009 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:39.010 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 Processor -- start 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- start start 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: init 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient: _add_conns ranks=[3,0,4,7,6,1,8,5,2] 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): picked mon.noname-g con 0x7ff61409d550 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): picked mon.noname-a con 0x7ff6140a3fc0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): picked mon.noname-c con 0x7ff61413b920 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61406fd50 con 0x7ff6140a3fc0 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6140705c0 con 0x7ff61409d550 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff61413e840 con 0x7ff61413b920 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.015+0000 7ff61bc0c640 10 monclient(hunting): authenticate will time out at 1289.727884s 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6199a8640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff61409d550 0x7ff614128770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60646/0 (socket says 172.21.15.171:60646) 2024-04-26T00:00:39.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6199a8640 1 -- 172.21.15.171:0/2764149904 learned_addr learned my addr 172.21.15.171:0/2764149904 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243928820 0 0) 0x7ff6140705c0 con 0x7ff61409d550 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): my global_id is 6573 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5f8003530 con 0x7ff61409d550 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 279215141 0 0) 0x7ff5f8003530 con 0x7ff61409d550 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff6140705c0 con 0x7ff61409d550 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff610001a60 con 0x7ff61409d550 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): dump: 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:39.012 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:39.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968893078 0 0) 0x7ff61413e840 con 0x7ff61413b920 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): my global_id is 144841 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5f8003530 con 0x7ff61413b920 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3085362764 0 0) 0x7ff61409ab00 con 0x7ff6140a3fc0 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient(hunting): my global_id is 6408 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff61413e840 con 0x7ff6140a3fc0 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3237233445 0 0) 0x7ff6140705c0 con 0x7ff61409d550 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 >> v1:172.21.15.106:6791/0 conn(0x7ff61413b920 legacy=0x7ff6141d2ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:39.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 >> v1:172.21.15.106:6789/0 conn(0x7ff6140a3fc0 legacy=0x7ff6141cf770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 monclient: found mon.g 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff614072ad0 con 0x7ff61409d550 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 5 monclient: authenticate success, global_id 6573 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 10 monclient: _renew_subs 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff61409d320 con 0x7ff61409d550 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 10 monclient: _renew_subs 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:39.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff61413ea60 con 0x7ff61409d550 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff610003950 con 0x7ff61409d550 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff610003ec0 con 0x7ff61409d550 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff607fff640 4 set_mon_vals no callback set 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 10 monclient: dump: 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:39.016 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff6100040e0 con 0x7ff61409d550 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5fc005090 con 0x7ff61409d550 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.019+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(178..178 src has 29..178) ==== 6433+0+0 (unknown 1281522790 0 0) 0x7ff610044fc0 con 0x7ff61409d550 2024-04-26T00:00:39.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.023+0000 7ff6191a7640 10 monclient: get_auth_request con 0x7ff5f80379f0 auth_method 0 2024-04-26T00:00:39.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.023+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff610015850 con 0x7ff61409d550 2024-04-26T00:00:39.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.023+0000 7ff6067fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:39.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.023+0000 7ff6067fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:39.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.191+0000 7ff61bc0c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:39.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.191+0000 7ff61bc0c640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:39.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.191+0000 7ff61bc0c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:39.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.191+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7ff5fc005380 con 0x7ff61409d550 2024-04-26T00:00:39.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.887+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 v179) ==== 82+0+0 (unknown 3874779631 0 0) 0x7ff610015150 con 0x7ff61409d550 2024-04-26T00:00:39.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.887+0000 7ff6067fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:39.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.887+0000 7ff6067fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:39.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.995+0000 7ff61bc0c640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:39.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.995+0000 7ff61bc0c640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:39.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.995+0000 7ff61bc0c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:39.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.995+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush weight-set create-compat"} v 0) -- 0x7ff5fc002220 con 0x7ff61409d550 2024-04-26T00:00:39.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.995+0000 7ff6067fc640 1 -- 172.21.15.171:0/2764149904 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set create-compat"}]=0 compat weight-set already created v179) ==== 115+0+0 (unknown 415417582 0 0) 0x7ff6100194a0 con 0x7ff61409d550 2024-04-26T00:00:39.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.995+0000 7ff6067fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set create-compat"}] 2024-04-26T00:00:39.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.995+0000 7ff6067fc640 10 monclient: _finish_command 3 = system:0 compat weight-set already created 2024-04-26T00:00:39.980 INFO:tasks.workunit.client.0.smithi171.stderr:compat weight-set already created 2024-04-26T00:00:39.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 >> v1:172.21.15.171:6812/722422047 conn(0x7ff5f80379f0 legacy=0x7ff5f8039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:39.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 10 monclient: shutdown 2024-04-26T00:00:39.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:39.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 >> v1:172.21.15.171:6790/0 conn(0x7ff61409d550 legacy=0x7ff614128770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:39.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 shutdown_connections 2024-04-26T00:00:39.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 >> 172.21.15.171:0/2764149904 conn(0x7ff6140a73b0 msgr2=0x7ff61409c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:39.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 shutdown_connections 2024-04-26T00:00:39.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:39.999+0000 7ff61bc0c640 1 -- 172.21.15.171:0/2764149904 wait complete. 2024-04-26T00:00:39.998 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket r1 rack root=default 2024-04-26T00:00:40.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient: get_monmap_and_config 2024-04-26T00:00:40.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient: build_initial_monmap 2024-04-26T00:00:40.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient: monmap: 2024-04-26T00:00:40.118 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:40.140011+0000 2024-04-26T00:00:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:40.140011+0000 2024-04-26T00:00:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:40.119 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:40.120 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:40.121 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:40.121 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:40.121 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 1 Processor -- start 2024-04-26T00:00:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 1 -- start start 2024-04-26T00:00:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient: init 2024-04-26T00:00:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient: _add_conns ranks=[5,2,1,7,3,6,0,4,8] 2024-04-26T00:00:40.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient(hunting): picked mon.noname-h con 0x7fe194137960 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient(hunting): picked mon.noname-b con 0x7fe1940a4220 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient(hunting): picked mon.noname-f con 0x7fe194138450 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1940a48c0 con 0x7fe194138450 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1940a2f70 con 0x7fe1940a4220 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1940a0d00 con 0x7fe194137960 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19bf60640 10 monclient(hunting): authenticate will time out at 1290.847501s 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe199cfc640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe194137960 0x7fe194137d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:50854/0 (socket says 172.21.15.171:50854) 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe199cfc640 1 -- 172.21.15.171:0/2504894169 learned_addr learned my addr 172.21.15.171:0/2504894169 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe19a4fd640 1 --1- 172.21.15.171:0/2504894169 >> v1:172.21.15.171:6789/0 conn(0x7fe194138450 0x7fe1941405c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:38824/0 (socket says 172.21.15.171:38824) 2024-04-26T00:00:40.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1306112107 0 0) 0x7fe1940a48c0 con 0x7fe194138450 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe198cfa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe198cfa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.135+0000 7fe198cfa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient(hunting): my global_id is 144811 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe180003530 con 0x7fe194138450 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2092862437 0 0) 0x7fe1940a0d00 con 0x7fe194137960 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient(hunting): my global_id is 6251 2024-04-26T00:00:40.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1940a48c0 con 0x7fe194137960 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2002180222 0 0) 0x7fe180003530 con 0x7fe194138450 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 >> v1:172.21.15.171:6791/0 conn(0x7fe194137960 legacy=0x7fe194137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 >> v1:172.21.15.106:6790/0 conn(0x7fe1940a4220 legacy=0x7fe19413ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 monclient: found mon.noname-f 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1940a29b0 con 0x7fe194138450 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: _finish_auth 0 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:40.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe18c001b40 con 0x7fe194138450 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: dump: 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:40.136 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 5 monclient: authenticate success, global_id 144811 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:40.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe18c001d30 con 0x7fe194138450 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 4 set_mon_vals no callback set 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 1 -- 172.21.15.171:0/2504894169 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe18c004eb0 con 0x7fe194138450 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe198cfa640 10 monclient: dump: 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:40.138 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:40.139 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: shutdown 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- 172.21.15.171:0/2504894169 >> v1:172.21.15.171:6789/0 conn(0x7fe194138450 legacy=0x7fe1941405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- 172.21.15.171:0/2504894169 shutdown_connections 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- 172.21.15.171:0/2504894169 >> 172.21.15.171:0/2504894169 conn(0x7fe1940a9fc0 msgr2=0x7fe1940aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- 172.21.15.171:0/2504894169 shutdown_connections 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- 172.21.15.171:0/2504894169 wait complete. 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: build_initial_monmap 2024-04-26T00:00:40.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: monmap: 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:40.141 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 Processor -- start 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- start start 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: init 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: _add_conns ranks=[3,2,6,5,7,4,1,0,8] 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient(hunting): picked mon.noname-g con 0x7fe1940a4220 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient(hunting): picked mon.noname-b con 0x7fe194137960 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient(hunting): picked mon.noname-d con 0x7fe194138450 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1941245a0 con 0x7fe194137960 2024-04-26T00:00:40.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1941222b0 con 0x7fe1940a4220 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe194123d00 con 0x7fe194138450 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient(hunting): authenticate will time out at 1290.850613s 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe199cfc640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fe1940a4220 0x7fe194136bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:60652/0 (socket says 172.21.15.171:60652) 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe199cfc640 1 -- 172.21.15.171:0/2309944643 learned_addr learned my addr 172.21.15.171:0/2309944643 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228240668 0 0) 0x7fe1941222b0 con 0x7fe1940a4220 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): my global_id is 6582 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe178003530 con 0x7fe1940a4220 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 899282001 0 0) 0x7fe178003530 con 0x7fe1940a4220 2024-04-26T00:00:40.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1941222b0 con 0x7fe1940a4220 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe190001560 con 0x7fe1940a4220 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): dump: 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:40.144 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1859059540 0 0) 0x7fe1941222b0 con 0x7fe1940a4220 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 >> v1:172.21.15.106:6792/0 conn(0x7fe194138450 legacy=0x7fe1941d48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 >> v1:172.21.15.106:6790/0 conn(0x7fe194137960 legacy=0x7fe1941d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:40.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 monclient: found mon.g 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe194123fe0 con 0x7fe1940a4220 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 5 monclient: authenticate success, global_id 6582 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: _renew_subs 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1941372d0 con 0x7fe1940a4220 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: _renew_subs 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:40.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe194122e10 con 0x7fe1940a4220 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe190004aa0 con 0x7fe1940a4220 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe190004f90 con 0x7fe1940a4220 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18bfff640 4 set_mon_vals no callback set 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.139+0000 7fe18a7fc640 10 monclient: dump: 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:40.147 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.143+0000 7fe19bf60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.143+0000 7fe19bf60640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.143+0000 7fe19bf60640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.143+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe19000fd30 con 0x7fe1940a4220 2024-04-26T00:00:40.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.143+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe17c005090 con 0x7fe1940a4220 2024-04-26T00:00:40.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.143+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(179..179 src has 29..179) ==== 6761+0+0 (unknown 204834034 0 0) 0x7fe190045240 con 0x7fe1940a4220 2024-04-26T00:00:40.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.143+0000 7fe1994fb640 10 monclient: get_auth_request con 0x7fe1780377e0 auth_method 0 2024-04-26T00:00:40.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.147+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe190015850 con 0x7fe1940a4220 2024-04-26T00:00:40.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.147+0000 7fe18a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:40.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.147+0000 7fe18a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:40.298 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.315+0000 7fe19bf60640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}] 2024-04-26T00:00:40.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.315+0000 7fe19bf60640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}] 2024-04-26T00:00:40.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.315+0000 7fe19bf60640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:40.299 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.315+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]} v 0) -- 0x7fe17c005380 con 0x7fe1940a4220 2024-04-26T00:00:40.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.887+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}]=0 added bucket r1 type rack to location {root=default} v180) ==== 176+0+0 (unknown 3138766781 0 0) 0x7fe190015150 con 0x7fe1940a4220 2024-04-26T00:00:40.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.887+0000 7fe18a7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}] 2024-04-26T00:00:40.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.887+0000 7fe18a7fc640 10 monclient: _finish_command 2 = system:0 added bucket r1 type rack to location {root=default} 2024-04-26T00:00:40.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.987+0000 7fe19bf60640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}] 2024-04-26T00:00:40.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.987+0000 7fe19bf60640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}] 2024-04-26T00:00:40.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.987+0000 7fe19bf60640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:40.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.987+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]} v 0) -- 0x7fe17c001180 con 0x7fe1940a4220 2024-04-26T00:00:40.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.987+0000 7fe18a7fc640 1 -- 172.21.15.171:0/2309944643 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}]=0 bucket 'r1' already exists v180) ==== 150+0+0 (unknown 3641107673 0 0) 0x7fe17c001180 con 0x7fe1940a4220 2024-04-26T00:00:40.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.987+0000 7fe18a7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "r1", "type": "rack", "args": ["root=default"]}] 2024-04-26T00:00:40.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.987+0000 7fe18a7fc640 10 monclient: _finish_command 3 = system:0 bucket 'r1' already exists 2024-04-26T00:00:40.972 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'r1' already exists 2024-04-26T00:00:40.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 >> v1:172.21.15.171:6812/722422047 conn(0x7fe1780377e0 legacy=0x7fe178039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:40.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 10 monclient: shutdown 2024-04-26T00:00:40.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:40.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 >> v1:172.21.15.171:6790/0 conn(0x7fe1940a4220 legacy=0x7fe194136bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:40.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 shutdown_connections 2024-04-26T00:00:40.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 >> 172.21.15.171:0/2309944643 conn(0x7fe1940a9fc0 msgr2=0x7fe1941bf670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:40.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 shutdown_connections 2024-04-26T00:00:40.975 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:40.991+0000 7fe19bf60640 1 -- 172.21.15.171:0/2309944643 wait complete. 2024-04-26T00:00:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:++ seq 1 32 2024-04-26T00:00:41.005 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:41.005 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h1 host rack=r1 2024-04-26T00:00:41.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.135+0000 7fbbd5ff7640 10 monclient: get_monmap_and_config 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.135+0000 7fbbd5ff7640 10 monclient: build_initial_monmap 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.135+0000 7fbbd5ff7640 10 monclient: monmap: 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:41.142423+0000 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:41.142423+0000 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:41.121 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:41.122 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:41.122 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:41.122 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:41.122 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:41.122 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:41.122 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 Processor -- start 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- start start 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient: init 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient: _add_conns ranks=[2,8,0,7,5,4,6,3,1] 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient(hunting): picked mon.noname-b con 0x7fbbd006f950 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient(hunting): picked mon.noname-e con 0x7fbbd01378f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient(hunting): picked mon.noname-a con 0x7fbbd013b400 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:41.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd00a1e70 con 0x7fbbd013b400 2024-04-26T00:00:41.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd00714e0 con 0x7fbbd006f950 2024-04-26T00:00:41.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd00717c0 con 0x7fbbd01378f0 2024-04-26T00:00:41.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:41.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient(hunting): authenticate will time out at 1291.849318s 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbceffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fbbd01378f0 legacy=0x7fbbd0139ce0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbcf7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fbbd006f950 0x7fbbd006fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:60476/0 (socket says 172.21.15.171:60476) 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbcffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbbd013b400 0x7fbbd013d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:43324/0 (socket says 172.21.15.171:43324) 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbcf7fe640 1 -- 172.21.15.171:0/2460657013 learned_addr learned my addr 172.21.15.171:0/2460657013 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2500405577 0 0) 0x7fbbd00a1e70 con 0x7fbbd013b400 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): my global_id is 6417 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbb8003530 con 0x7fbbd013b400 2024-04-26T00:00:41.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065173003 0 0) 0x7fbbd00714e0 con 0x7fbbd006f950 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient(hunting): my global_id is 6284 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbd00a1e70 con 0x7fbbd006f950 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2767909337 0 0) 0x7fbbb8003530 con 0x7fbbd013b400 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 >> v1:172.21.15.106:6793/0 conn(0x7fbbd01378f0 legacy=0x7fbbd0139ce0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 >> v1:172.21.15.106:6790/0 conn(0x7fbbd006f950 legacy=0x7fbbd006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 monclient: found mon.noname-a 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd0071aa0 con 0x7fbbd013b400 2024-04-26T00:00:41.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbbc8001b60 con 0x7fbbd013b400 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: dump: 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.135 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 5 monclient: authenticate success, global_id 6417 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbc8001e10 con 0x7fbbd013b400 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:41.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 4 set_mon_vals no callback set 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 1 -- 172.21.15.171:0/2460657013 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbbc8004eb0 con 0x7fbbd013b400 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbce7fc640 10 monclient: dump: 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.137 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient: shutdown 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/2460657013 >> v1:172.21.15.106:6789/0 conn(0x7fbbd013b400 legacy=0x7fbbd013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/2460657013 shutdown_connections 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/2460657013 >> 172.21.15.171:0/2460657013 conn(0x7fbbd00a2690 msgr2=0x7fbbd00a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/2460657013 shutdown_connections 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/2460657013 wait complete. 2024-04-26T00:00:41.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient: build_initial_monmap 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.139+0000 7fbbd5ff7640 10 monclient: monmap: 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:41.139 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 Processor -- start 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 -- start start 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: init 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _add_conns ranks=[8,4,3,5,2,7,0,1,6] 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient(hunting): picked mon.noname-e con 0x7fbbd006f950 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient(hunting): picked mon.noname-c con 0x7fbbd01378f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient(hunting): picked mon.noname-g con 0x7fbbd013b400 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd0133d80 con 0x7fbbd013b400 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd0070b40 con 0x7fbbd01378f0 2024-04-26T00:00:41.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbbd0136570 con 0x7fbbd006f950 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient(hunting): authenticate will time out at 1291.852851s 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbcf7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fbbd006f950 legacy=0x7fbbd0132920 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbcffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbbd013b400 0x7fbbd01d4810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:34866/0 (socket says 172.21.15.171:34866) 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbcffff640 1 -- 172.21.15.171:0/1257783615 learned_addr learned my addr 172.21.15.171:0/1257783615 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880640556 0 0) 0x7fbbd0071aa0 con 0x7fbbd013b400 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): my global_id is 6591 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbbc003530 con 0x7fbbd013b400 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1393181562 0 0) 0x7fbbbc003530 con 0x7fbbd013b400 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbbd0071aa0 con 0x7fbbd013b400 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbbc8001b20 con 0x7fbbd013b400 2024-04-26T00:00:41.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): dump: 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.142 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558977298 0 0) 0x7fbbc4003a00 con 0x7fbbd01378f0 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient(hunting): my global_id is 144850 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbbc003530 con 0x7fbbd01378f0 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2417029162 0 0) 0x7fbbd0071aa0 con 0x7fbbd013b400 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 >> v1:172.21.15.106:6793/0 conn(0x7fbbd006f950 legacy=0x7fbbd0132920 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:41.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 >> v1:172.21.15.106:6791/0 conn(0x7fbbd01378f0 legacy=0x7fbbd0133030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 monclient: found mon.g 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbd0136850 con 0x7fbbd013b400 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 5 monclient: authenticate success, global_id 6591 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _renew_subs 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbbd0133740 con 0x7fbbd013b400 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _renew_subs 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbbd0134560 con 0x7fbbd013b400 2024-04-26T00:00:41.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbc8001e10 con 0x7fbbd013b400 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbbc8002000 con 0x7fbbd013b400 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbcdffb640 4 set_mon_vals no callback set 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 10 monclient: dump: 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.145 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbbc8010310 con 0x7fbbd013b400 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbb0005090 con 0x7fbbd013b400 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(180..180 src has 29..180) ==== 6971+0+0 (unknown 1322567685 0 0) 0x7fbbc80456a0 con 0x7fbbd013b400 2024-04-26T00:00:41.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.143+0000 7fbbcf7fe640 10 monclient: get_auth_request con 0x7fbbbc037770 auth_method 0 2024-04-26T00:00:41.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.147+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbbd0133d80 con 0x7fbbd013b400 2024-04-26T00:00:41.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.147+0000 7fbbb7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:41.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.147+0000 7fbbb7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:41.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.311+0000 7fbbd5ff7640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.311+0000 7fbbd5ff7640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.311+0000 7fbbd5ff7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:41.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.311+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fbbb0005380 con 0x7fbbd013b400 2024-04-26T00:00:41.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.547+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}]=0 added bucket h1 type host to location {rack=r1} v181) ==== 166+0+0 (unknown 3424550558 0 0) 0x7fbbc8015c40 con 0x7fbbd013b400 2024-04-26T00:00:41.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.547+0000 7fbbb7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.547+0000 7fbbb7fff640 10 monclient: _finish_command 2 = system:0 added bucket h1 type host to location {rack=r1} 2024-04-26T00:00:41.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.655+0000 7fbbd5ff7640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.655+0000 7fbbd5ff7640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.655+0000 7fbbd5ff7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:41.637 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.655+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fbbb0005ac0 con 0x7fbbd013b400 2024-04-26T00:00:41.639 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.655+0000 7fbbb7fff640 1 -- 172.21.15.171:0/1257783615 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h1' already exists v181) ==== 145+0+0 (unknown 600772936 0 0) 0x7fbbc8040cf0 con 0x7fbbd013b400 2024-04-26T00:00:41.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.655+0000 7fbbb7fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h1", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.640 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.655+0000 7fbbb7fff640 10 monclient: _finish_command 3 = system:0 bucket 'h1' already exists 2024-04-26T00:00:41.640 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h1' already exists 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 >> v1:172.21.15.171:6812/722422047 conn(0x7fbbbc037770 legacy=0x7fbbbc039c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 10 monclient: shutdown 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 >> v1:172.21.15.171:6790/0 conn(0x7fbbd013b400 legacy=0x7fbbd01d4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 shutdown_connections 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 >> 172.21.15.171:0/1257783615 conn(0x7fbbd00a2690 msgr2=0x7fbbd0139de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 shutdown_connections 2024-04-26T00:00:41.642 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.659+0000 7fbbd5ff7640 1 -- 172.21.15.171:0/1257783615 wait complete. 2024-04-26T00:00:41.655 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:41.656 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h2 host rack=r1 2024-04-26T00:00:41.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient: get_monmap_and_config 2024-04-26T00:00:41.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient: build_initial_monmap 2024-04-26T00:00:41.774 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient: monmap: 2024-04-26T00:00:41.774 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:41.774 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.774 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:41.795885+0000 2024-04-26T00:00:41.774 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:41.795885+0000 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:41.775 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 1 Processor -- start 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 1 -- start start 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient: init 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient: _add_conns ranks=[1,6,7,8,0,3,5,2,4] 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient(hunting): picked mon.noname-f con 0x7f7e7806bae0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient(hunting): picked mon.noname-d con 0x7f7e78070f20 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient(hunting): picked mon.noname-i con 0x7f7e780a1b70 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e780723d0 con 0x7f7e7806bae0 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e780a0000 con 0x7f7e78070f20 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e780726b0 con 0x7f7e780a1b70 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 10 monclient(hunting): authenticate will time out at 1292.503252s 2024-04-26T00:00:41.782 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7e28b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f7e7806bae0 0x7f7e780a1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47852/0 (socket says 172.21.15.171:47852) 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7e28b640 1 -- 172.21.15.171:0/3412799851 learned_addr learned my addr 172.21.15.171:0/3412799851 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2726399762 0 0) 0x7f7e740014a0 con 0x7f7e7806bae0 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): my global_id is 144820 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e64003530 con 0x7f7e7806bae0 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 892780621 0 0) 0x7f7e780726b0 con 0x7f7e780a1b70 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient(hunting): my global_id is 144691 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e740014a0 con 0x7f7e780a1b70 2024-04-26T00:00:41.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1375502894 0 0) 0x7f7e740014a0 con 0x7f7e780a1b70 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 >> v1:172.21.15.106:6792/0 conn(0x7f7e78070f20 legacy=0x7f7e7813a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 >> v1:172.21.15.171:6789/0 conn(0x7f7e7806bae0 legacy=0x7f7e780a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient: _finish_hunting 0 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 monclient: found mon.noname-i 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e7809f940 con 0x7f7e780a1b70 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient: _finish_auth 0 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient: _check_auth_tickets 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e70001740 con 0x7f7e780a1b70 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:41.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e7d289640 10 monclient: dump: 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.785 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 5 monclient: authenticate success, global_id 144691 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.791+0000 7f7e804ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e70001930 con 0x7f7e780a1b70 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7d289640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7d289640 1 -- 172.21.15.171:0/3412799851 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e70003620 con 0x7f7e780a1b70 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7d289640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7d289640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7d289640 10 monclient: dump: 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.786 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 4 set_mon_vals no callback set 2024-04-26T00:00:41.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: shutdown 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3412799851 >> v1:172.21.15.171:6792/0 conn(0x7f7e780a1b70 legacy=0x7f7e7813dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3412799851 shutdown_connections 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3412799851 >> 172.21.15.171:0/3412799851 conn(0x7f7e780a5140 msgr2=0x7f7e7806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3412799851 shutdown_connections 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3412799851 wait complete. 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: build_initial_monmap 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: monmap: 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:41.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 Processor -- start 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- start start 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: init 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:41.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _add_conns ranks=[5,4,7,8,2,1,0,3,6] 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient(hunting): picked mon.noname-h con 0x7f7e7806bae0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient(hunting): picked mon.noname-c con 0x7f7e78070f20 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient(hunting): picked mon.noname-i con 0x7f7e780a1b70 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e780a1230 con 0x7f7e78070f20 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7806ee30 con 0x7f7e7806bae0 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e7806df80 con 0x7f7e780a1b70 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient(hunting): authenticate will time out at 1292.506267s 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7e28b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7e7806bae0 0x7f7e7806d160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33484/0 (socket says 172.21.15.171:33484) 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7e28b640 1 -- 172.21.15.171:0/3630015844 learned_addr learned my addr 172.21.15.171:0/3630015844 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3418243740 0 0) 0x7f7e7806ee30 con 0x7f7e7806bae0 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): my global_id is 6260 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e5c003530 con 0x7f7e7806bae0 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3273168677 0 0) 0x7f7e7806df80 con 0x7f7e780a1b70 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): my global_id is 144700 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e7806ee30 con 0x7f7e780a1b70 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4177187295 0 0) 0x7f7e5c003530 con 0x7f7e7806bae0 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e7806df80 con 0x7f7e7806bae0 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e74001cb0 con 0x7f7e7806bae0 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:41.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): dump: 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.792 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.793 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.793 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.793 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2663403209 0 0) 0x7f7e7806ee30 con 0x7f7e780a1b70 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e5c003530 con 0x7f7e780a1b70 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e70001700 con 0x7f7e780a1b70 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): dump: 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.794 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903980512 0 0) 0x7f7e780a1230 con 0x7f7e78070f20 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:41.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient(hunting): my global_id is 144859 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e7806ee30 con 0x7f7e78070f20 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 237882794 0 0) 0x7f7e7806df80 con 0x7f7e7806bae0 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 >> v1:172.21.15.171:6792/0 conn(0x7f7e780a1b70 legacy=0x7f7e781d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 >> v1:172.21.15.106:6791/0 conn(0x7f7e78070f20 legacy=0x7f7e7806d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 monclient: found mon.h 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e78126160 con 0x7f7e7806bae0 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: _finish_auth 0 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 5 monclient: authenticate success, global_id 6260 2024-04-26T00:00:41.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _renew_subs 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7e781258c0 con 0x7f7e7806bae0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _renew_subs 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f7e781330b0 con 0x7f7e7806bae0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e780689c0 con 0x7f7e7806bae0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e74002060 con 0x7f7e7806bae0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e74005160 con 0x7f7e7806bae0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:41.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e7ca88640 4 set_mon_vals no callback set 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.795+0000 7f7e6effd640 10 monclient: dump: 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:41.798 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.799+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7e7400ff00 con 0x7f7e7806bae0 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.799+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(181..181 src has 29..181) ==== 7181+0+0 (unknown 1984147153 0 0) 0x7f7e74045480 con 0x7f7e7806bae0 2024-04-26T00:00:41.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.799+0000 7f7e7da8a640 10 monclient: get_auth_request con 0x7f7e5c037ee0 auth_method 0 2024-04-26T00:00:41.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.803+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7e780723d0 con 0x7f7e7806bae0 2024-04-26T00:00:41.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.803+0000 7f7e6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:41.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.803+0000 7f7e6effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.971+0000 7f7e804ef640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.971+0000 7f7e804ef640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:41.953 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.971+0000 7f7e804ef640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:41.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:41.971+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f7e780757c0 con 0x7f7e7806bae0 2024-04-26T00:00:42.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:42.915+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}]=0 added bucket h2 type host to location {rack=r1} v182) ==== 166+0+0 (unknown 1716079443 0 0) 0x7f7e74015890 con 0x7f7e7806bae0 2024-04-26T00:00:42.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:42.915+0000 7f7e6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:42.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:42.915+0000 7f7e6effd640 10 monclient: _finish_command 2 = system:0 added bucket h2 type host to location {rack=r1} 2024-04-26T00:00:43.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.019+0000 7f7e804ef640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:43.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.019+0000 7f7e804ef640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:43.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.019+0000 7f7e804ef640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:43.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.019+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f7e7809fbd0 con 0x7f7e7806bae0 2024-04-26T00:00:43.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.019+0000 7f7e6effd640 1 -- 172.21.15.171:0/3630015844 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h2' already exists v182) ==== 145+0+0 (unknown 3760509427 0 0) 0x7f7e74019540 con 0x7f7e7806bae0 2024-04-26T00:00:43.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.019+0000 7f7e6effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h2", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:43.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.019+0000 7f7e6effd640 10 monclient: _finish_command 3 = system:0 bucket 'h2' already exists 2024-04-26T00:00:43.004 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h2' already exists 2024-04-26T00:00:43.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 >> v1:172.21.15.171:6812/722422047 conn(0x7f7e5c037ee0 legacy=0x7f7e5c03a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:43.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 10 monclient: shutdown 2024-04-26T00:00:43.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:43.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 >> v1:172.21.15.171:6791/0 conn(0x7f7e7806bae0 legacy=0x7f7e7806d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:43.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 shutdown_connections 2024-04-26T00:00:43.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 >> 172.21.15.171:0/3630015844 conn(0x7f7e780a5140 msgr2=0x7f7e780a6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:43.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 shutdown_connections 2024-04-26T00:00:43.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.023+0000 7f7e804ef640 1 -- 172.21.15.171:0/3630015844 wait complete. 2024-04-26T00:00:43.021 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:43.021 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h3 host rack=r1 2024-04-26T00:00:43.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.155+0000 7f56f5082640 10 monclient: get_monmap_and_config 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.155+0000 7f56f5082640 10 monclient: build_initial_monmap 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.155+0000 7f56f5082640 10 monclient: monmap: 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:43.162391+0000 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:43.162391+0000 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:43.141 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:43.142 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:43.142 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:43.142 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:43.142 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:43.142 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:43.142 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:43.142 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 Processor -- start 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- start start 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient: init 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient: _add_conns ranks=[5,8,1,7,6,4,0,2,3] 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient(hunting): picked mon.noname-h con 0x7f56f0135a00 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient(hunting): picked mon.noname-e con 0x7f56f00a1790 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient(hunting): picked mon.noname-f con 0x7f56f013c130 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f00a1d80 con 0x7f56f013c130 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f0072f70 con 0x7f56f0135a00 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f0072640 con 0x7f56f00a1790 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient(hunting): authenticate will time out at 1293.869302s 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56ee59c640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f56f00a1790 legacy=0x7f56f013aa10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56ef59e640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f56f013c130 0x7f56f013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47858/0 (socket says 172.21.15.171:47858) 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56ef59e640 1 -- 172.21.15.171:0/532695322 learned_addr learned my addr 172.21.15.171:0/532695322 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56eed9d640 1 --1- 172.21.15.171:0/532695322 >> v1:172.21.15.171:6791/0 conn(0x7f56f0135a00 0x7f56f0135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33494/0 (socket says 172.21.15.171:33494) 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1614385012 0 0) 0x7f56f00a1d80 con 0x7f56f013c130 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:43.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): my global_id is 144829 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56dc003530 con 0x7f56f013c130 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 705521514 0 0) 0x7f56f0072f70 con 0x7f56f0135a00 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient(hunting): my global_id is 6269 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f00a1d80 con 0x7f56f0135a00 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 414799061 0 0) 0x7f56dc003530 con 0x7f56f013c130 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 >> v1:172.21.15.106:6793/0 conn(0x7f56f00a1790 legacy=0x7f56f013aa10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 >> v1:172.21.15.171:6791/0 conn(0x7f56f0135a00 legacy=0x7f56f0135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: _finish_hunting 0 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 monclient: found mon.noname-f 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:43.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f0072920 con 0x7f56f013c130 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: _finish_auth 0 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: _check_auth_tickets 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e8001b40 con 0x7f56f013c130 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 5 monclient: authenticate success, global_id 144829 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: dump: 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.152 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56e8001d70 con 0x7f56f013c130 2024-04-26T00:00:43.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 1 -- 172.21.15.171:0/532695322 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e8004f70 con 0x7f56f013c130 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 4 set_mon_vals no callback set 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56edd9b640 10 monclient: dump: 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:43.154 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient: shutdown 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- 172.21.15.171:0/532695322 >> v1:172.21.15.171:6789/0 conn(0x7f56f013c130 legacy=0x7f56f013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- 172.21.15.171:0/532695322 shutdown_connections 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- 172.21.15.171:0/532695322 >> 172.21.15.171:0/532695322 conn(0x7f56f00a2690 msgr2=0x7f56f00a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- 172.21.15.171:0/532695322 shutdown_connections 2024-04-26T00:00:43.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 1 -- 172.21.15.171:0/532695322 wait complete. 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient: build_initial_monmap 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.159+0000 7f56f5082640 10 monclient: monmap: 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:43.156 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 Processor -- start 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 -- start start 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: init 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _add_conns ranks=[6,0,8,4,3,5,1,2,7] 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient(hunting): picked mon.noname-d con 0x7f56f00a1790 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient(hunting): picked mon.noname-a con 0x7f56f0135a00 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient(hunting): picked mon.noname-e con 0x7f56f013c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f0136b10 con 0x7f56f0135a00 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f013b480 con 0x7f56f00a1790 2024-04-26T00:00:43.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f009eb70 con 0x7f56f013c130 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient(hunting): authenticate will time out at 1293.872799s 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56ef59e640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f56f013c130 legacy=0x7f56f01d2300 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56eed9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f56f00a1790 0x7f56f009b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:41116/0 (socket says 172.21.15.171:41116) 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56eed9d640 1 -- 172.21.15.171:0/40354343 learned_addr learned my addr 172.21.15.171:0/40354343 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920558406 0 0) 0x7f56f0136b10 con 0x7f56f0135a00 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): my global_id is 6426 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56d0003530 con 0x7f56f0135a00 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 802721984 0 0) 0x7f56f013b480 con 0x7f56f00a1790 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:43.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): my global_id is 6369 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f0136b10 con 0x7f56f00a1790 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2619783067 0 0) 0x7f56d0003530 con 0x7f56f0135a00 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56f013b480 con 0x7f56f0135a00 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56d80042a0 con 0x7f56f0135a00 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): dump: 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.159 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3527550983 0 0) 0x7f56f0136b10 con 0x7f56f00a1790 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56d0003530 con 0x7f56f00a1790 2024-04-26T00:00:43.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e0001460 con 0x7f56f00a1790 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient(hunting): dump: 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:43.161 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 71772258 0 0) 0x7f56f013b480 con 0x7f56f0135a00 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 >> v1:172.21.15.106:6793/0 conn(0x7f56f013c130 legacy=0x7f56f01d2300 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 >> v1:172.21.15.106:6792/0 conn(0x7f56f00a1790 legacy=0x7f56f009b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 monclient: found mon.a 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:43.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f009fc40 con 0x7f56f0135a00 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 5 monclient: authenticate success, global_id 6426 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _renew_subs 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56f009f6f0 con 0x7f56f0135a00 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _renew_subs 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56f009c2f0 con 0x7f56f0135a00 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56d8004550 con 0x7f56f0135a00 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:43.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56d8004ac0 con 0x7f56f0135a00 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56ed59a640 4 set_mon_vals no callback set 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56e77fe640 10 monclient: dump: 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:43.164 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.163+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56d4005090 con 0x7f56f0135a00 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.167+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f56d8004d60 con 0x7f56f0135a00 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.167+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(182..182 src has 29..182) ==== 7391+0+0 (unknown 2980730963 0 0) 0x7f56d8045190 con 0x7f56f0135a00 2024-04-26T00:00:43.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.167+0000 7f56eed9d640 10 monclient: get_auth_request con 0x7f56d0037d70 auth_method 0 2024-04-26T00:00:43.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.179+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f56d80156f0 con 0x7f56f0135a00 2024-04-26T00:00:43.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.179+0000 7f56e77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:43.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.179+0000 7f56e77fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:43.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.339+0000 7f56f5082640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:43.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.339+0000 7f56f5082640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:43.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.339+0000 7f56f5082640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:43.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.339+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f56d4005380 con 0x7f56f0135a00 2024-04-26T00:00:43.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.915+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}]=0 added bucket h3 type host to location {rack=r1} v183) ==== 166+0+0 (unknown 4242508359 0 0) 0x7f56d8014ff0 con 0x7f56f0135a00 2024-04-26T00:00:43.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.915+0000 7f56e77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:43.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:43.915+0000 7f56e77fe640 10 monclient: _finish_command 2 = system:0 added bucket h3 type host to location {rack=r1} 2024-04-26T00:00:44.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.027+0000 7f56f5082640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:44.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.027+0000 7f56f5082640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:44.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.027+0000 7f56f5082640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:44.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.027+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f56d4005ac0 con 0x7f56f0135a00 2024-04-26T00:00:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.027+0000 7f56e77fe640 1 -- 172.21.15.171:0/40354343 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h3' already exists v183) ==== 145+0+0 (unknown 2709361050 0 0) 0x7f56d8014b50 con 0x7f56f0135a00 2024-04-26T00:00:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.027+0000 7f56e77fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h3", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.027+0000 7f56e77fe640 10 monclient: _finish_command 3 = system:0 bucket 'h3' already exists 2024-04-26T00:00:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h3' already exists 2024-04-26T00:00:44.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 >> v1:172.21.15.171:6812/722422047 conn(0x7f56d0037d70 legacy=0x7f56d003a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:44.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 10 monclient: shutdown 2024-04-26T00:00:44.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:44.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 >> v1:172.21.15.106:6789/0 conn(0x7f56f0135a00 legacy=0x7f56f009bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:44.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 shutdown_connections 2024-04-26T00:00:44.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 >> 172.21.15.171:0/40354343 conn(0x7f56f00a2690 msgr2=0x7f56f012f640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:44.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 shutdown_connections 2024-04-26T00:00:44.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.031+0000 7f56f5082640 1 -- 172.21.15.171:0/40354343 wait complete. 2024-04-26T00:00:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h4 host rack=r1 2024-04-26T00:00:44.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.163+0000 7f15268af640 10 monclient: get_monmap_and_config 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.163+0000 7f15268af640 10 monclient: build_initial_monmap 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: monmap: 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:44.170518+0000 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:44.170518+0000 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:44.149 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:44.150 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:44.150 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:44.150 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:44.150 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:44.150 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:44.150 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:44.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 Processor -- start 2024-04-26T00:00:44.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- start start 2024-04-26T00:00:44.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: init 2024-04-26T00:00:44.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:44.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: _add_conns ranks=[4,0,1,5,8,6,7,2,3] 2024-04-26T00:00:44.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient(hunting): picked mon.noname-c con 0x7f152006f950 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:44.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient(hunting): picked mon.noname-a con 0x7f15201378f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:44.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient(hunting): picked mon.noname-f con 0x7f152013b400 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:44.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15200a1e70 con 0x7f15201378f0 2024-04-26T00:00:44.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15200714e0 con 0x7f152013b400 2024-04-26T00:00:44.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15200717c0 con 0x7f152006f950 2024-04-26T00:00:44.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:44.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient(hunting): authenticate will time out at 1294.877424s 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f1524e4c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f152013b400 0x7f152013d7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47886/0 (socket says 172.21.15.171:47886) 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f1524e4c640 1 -- 172.21.15.171:0/2813835039 learned_addr learned my addr 172.21.15.171:0/2813835039 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2352623523 0 0) 0x7f15200714e0 con 0x7f152013b400 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): my global_id is 144838 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f150c003530 con 0x7f152013b400 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465608370 0 0) 0x7f15200717c0 con 0x7f152006f950 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient(hunting): my global_id is 144868 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15200714e0 con 0x7f152006f950 2024-04-26T00:00:44.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1790817585 0 0) 0x7f150c003530 con 0x7f152013b400 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 >> v1:172.21.15.106:6791/0 conn(0x7f152006f950 legacy=0x7f152006fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 >> v1:172.21.15.106:6789/0 conn(0x7f15201378f0 legacy=0x7f1520139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 monclient: found mon.noname-f 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520071aa0 con 0x7f152013b400 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1518001b40 con 0x7f152013b400 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: dump: 2024-04-26T00:00:44.161 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:44.162 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 5 monclient: authenticate success, global_id 144838 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1518001df0 con 0x7f152013b400 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 4 set_mon_vals no callback set 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 1 -- 172.21.15.171:0/2813835039 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1518004f70 con 0x7f152013b400 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f151f7fe640 10 monclient: dump: 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.163 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: shutdown 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- 172.21.15.171:0/2813835039 >> v1:172.21.15.171:6789/0 conn(0x7f152013b400 legacy=0x7f152013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:44.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- 172.21.15.171:0/2813835039 shutdown_connections 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- 172.21.15.171:0/2813835039 >> 172.21.15.171:0/2813835039 conn(0x7f15200a2690 msgr2=0x7f15200a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- 172.21.15.171:0/2813835039 shutdown_connections 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 1 -- 172.21.15.171:0/2813835039 wait complete. 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: build_initial_monmap 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.167+0000 7f15268af640 10 monclient: monmap: 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:44.165 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 Processor -- start 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 -- start start 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: init 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _add_conns ranks=[4,8,5,0,3,1,6,2,7] 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient(hunting): picked mon.noname-c con 0x7f152006f950 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient(hunting): picked mon.noname-e con 0x7f15201378f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient(hunting): picked mon.noname-h con 0x7f152013b400 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:44.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1520130750 con 0x7f152006f950 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15201c8bd0 con 0x7f152013b400 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15201310a0 con 0x7f15201378f0 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient(hunting): authenticate will time out at 1294.880654s 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f1524e4c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f152013b400 0x7f15201d00f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33508/0 (socket says 172.21.15.171:33508) 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f1517fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f15201378f0 legacy=0x7f15201c84c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f1524e4c640 1 -- 172.21.15.171:0/3290423359 learned_addr learned my addr 172.21.15.171:0/3290423359 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1582572405 0 0) 0x7f15201c8bd0 con 0x7f152013b400 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): my global_id is 6278 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1500003530 con 0x7f152013b400 2024-04-26T00:00:44.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1018430039 0 0) 0x7f1500003530 con 0x7f152013b400 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15201c8bd0 con 0x7f152013b400 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1518004eb0 con 0x7f152013b400 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): dump: 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:44.168 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379964378 0 0) 0x7f1520130750 con 0x7f152006f950 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient(hunting): my global_id is 144877 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1500003530 con 0x7f152006f950 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3754558416 0 0) 0x7f15201c8bd0 con 0x7f152013b400 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 >> v1:172.21.15.106:6793/0 conn(0x7f15201378f0 legacy=0x7f15201c84c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:44.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 >> v1:172.21.15.106:6791/0 conn(0x7f152006f950 legacy=0x7f15201c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 monclient: found mon.h 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1520131380 con 0x7f152013b400 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 5 monclient: authenticate success, global_id 6278 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _renew_subs 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1520131660 con 0x7f152013b400 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _renew_subs 2024-04-26T00:00:44.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f152009f080 con 0x7f152013b400 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1518001df0 con 0x7f152013b400 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1518005520 con 0x7f152013b400 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151effd640 4 set_mon_vals no callback set 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 10 monclient: dump: 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:44.171 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1504005090 con 0x7f152013b400 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f15180102c0 con 0x7f152013b400 2024-04-26T00:00:44.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(183..183 src has 29..183) ==== 7601+0+0 (unknown 3878026266 0 0) 0x7f1518045940 con 0x7f152013b400 2024-04-26T00:00:44.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.171+0000 7f151ffff640 10 monclient: get_auth_request con 0x7f15000377b0 auth_method 0 2024-04-26T00:00:44.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.175+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f151801e150 con 0x7f152013b400 2024-04-26T00:00:44.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.175+0000 7f151d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:44.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.175+0000 7f151d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:44.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.339+0000 7f15268af640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:44.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.339+0000 7f15268af640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:44.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.339+0000 7f15268af640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:44.324 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.339+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f1504005380 con 0x7f152013b400 2024-04-26T00:00:44.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.927+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}]=0 added bucket h4 type host to location {rack=r1} v184) ==== 166+0+0 (unknown 85014838 0 0) 0x7f15180139e0 con 0x7f152013b400 2024-04-26T00:00:44.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.931+0000 7f151d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:44.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:44.931+0000 7f151d7fa640 10 monclient: _finish_command 2 = system:0 added bucket h4 type host to location {rack=r1} 2024-04-26T00:00:45.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.031+0000 7f15268af640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:45.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.031+0000 7f15268af640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:45.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.031+0000 7f15268af640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:45.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.031+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f1504005be0 con 0x7f152013b400 2024-04-26T00:00:45.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.035+0000 7f151d7fa640 1 -- 172.21.15.171:0/3290423359 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h4' already exists v184) ==== 145+0+0 (unknown 546357194 0 0) 0x7f15180427b0 con 0x7f152013b400 2024-04-26T00:00:45.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.035+0000 7f151d7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h4", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:45.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.035+0000 7f151d7fa640 10 monclient: _finish_command 3 = system:0 bucket 'h4' already exists 2024-04-26T00:00:45.019 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h4' already exists 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 >> v1:172.21.15.171:6812/722422047 conn(0x7f15000377b0 legacy=0x7f1500039c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 10 monclient: shutdown 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 >> v1:172.21.15.171:6791/0 conn(0x7f152013b400 legacy=0x7f15201d00f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 shutdown_connections 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 >> 172.21.15.171:0/3290423359 conn(0x7f15200a2690 msgr2=0x7f152013a430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 shutdown_connections 2024-04-26T00:00:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.039+0000 7f15268af640 1 -- 172.21.15.171:0/3290423359 wait complete. 2024-04-26T00:00:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h5 host rack=r1 2024-04-26T00:00:45.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient: get_monmap_and_config 2024-04-26T00:00:45.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient: build_initial_monmap 2024-04-26T00:00:45.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient: monmap: 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:45.175251+0000 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:45.175251+0000 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:45.154 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:45.155 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:45.155 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:45.155 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 1 Processor -- start 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 1 -- start start 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient: init 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient: _add_conns ranks=[0,6,4,3,7,1,2,5,8] 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient(hunting): picked mon.noname-a con 0x7f2c581379d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient(hunting): picked mon.noname-d con 0x7f2c581384c0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient(hunting): picked mon.noname-c con 0x7f2c5813e620 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c580a2b00 con 0x7f2c581379d0 2024-04-26T00:00:45.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c580a2de0 con 0x7f2c5813e620 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c580a17a0 con 0x7f2c581384c0 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c5da91640 10 monclient(hunting): authenticate will time out at 1295.883091s 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c577fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2c581379d0 0x7f2c58137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:43344/0 (socket says 172.21.15.171:43344) 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c577fe640 1 -- 172.21.15.171:0/3958891369 learned_addr learned my addr 172.21.15.171:0/3958891369 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.171+0000 7f2c57fff640 1 --1- 172.21.15.171:0/3958891369 >> v1:172.21.15.106:6791/0 conn(0x7f2c5813e620 0x7f2c58140a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:54922/0 (socket says 172.21.15.171:54922) 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 255993357 0 0) 0x7f2c580a2b00 con 0x7f2c581379d0 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:45.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): my global_id is 6444 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c44003530 con 0x7f2c581379d0 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 570910337 0 0) 0x7f2c580a2de0 con 0x7f2c5813e620 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): my global_id is 144886 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c580a2b00 con 0x7f2c5813e620 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127161349 0 0) 0x7f2c580a17a0 con 0x7f2c581384c0 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:45.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient(hunting): my global_id is 6378 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c580a2de0 con 0x7f2c581384c0 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3769049934 0 0) 0x7f2c44003530 con 0x7f2c581379d0 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 >> v1:172.21.15.106:6792/0 conn(0x7f2c581384c0 legacy=0x7f2c5813cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 >> v1:172.21.15.106:6791/0 conn(0x7f2c5813e620 legacy=0x7f2c58140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 monclient: found mon.noname-a 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c580a3b20 con 0x7f2c581379d0 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:45.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2c480016f0 con 0x7f2c581379d0 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: dump: 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:45.163 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 5 monclient: authenticate success, global_id 6444 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c48001950 con 0x7f2c581379d0 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 4 set_mon_vals no callback set 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 1 -- 172.21.15.171:0/3958891369 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2c48004bf0 con 0x7f2c581379d0 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:45.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c56ffd640 10 monclient: dump: 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:45.165 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient: shutdown 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- 172.21.15.171:0/3958891369 >> v1:172.21.15.106:6789/0 conn(0x7f2c581379d0 legacy=0x7f2c58137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- 172.21.15.171:0/3958891369 shutdown_connections 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- 172.21.15.171:0/3958891369 >> 172.21.15.171:0/3958891369 conn(0x7f2c580a6b30 msgr2=0x7f2c580a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- 172.21.15.171:0/3958891369 shutdown_connections 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- 172.21.15.171:0/3958891369 wait complete. 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient: build_initial_monmap 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient: monmap: 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:45.166 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 Processor -- start 2024-04-26T00:00:45.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- start start 2024-04-26T00:00:45.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient: init 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient: _add_conns ranks=[0,7,1,4,2,3,8,5,6] 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient(hunting): picked mon.noname-a con 0x7f2c581379d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient(hunting): picked mon.noname-i con 0x7f2c581384c0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient(hunting): picked mon.noname-f con 0x7f2c5813e620 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c58138cd0 con 0x7f2c581379d0 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5809ab00 con 0x7f2c5813e620 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5809ade0 con 0x7f2c581384c0 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:45.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c5da91640 10 monclient(hunting): authenticate will time out at 1295.887310s 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c57fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2c5813e620 0x7f2c581d5400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47892/0 (socket says 172.21.15.171:47892) 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c57fff640 1 -- 172.21.15.171:0/828842555 learned_addr learned my addr 172.21.15.171:0/828842555 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c4ffff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f2c581384c0 0x7f2c581d1cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:45830/0 (socket says 172.21.15.171:45830) 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1910373973 0 0) 0x7f2c5809ade0 con 0x7f2c581384c0 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): my global_id is 144709 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c38003530 con 0x7f2c581384c0 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257905415 0 0) 0x7f2c5809ab00 con 0x7f2c5813e620 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:45.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 10 monclient(hunting): my global_id is 144847 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.175+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c5809ade0 con 0x7f2c5813e620 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2167051449 0 0) 0x7f2c5809ade0 con 0x7f2c5813e620 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c5809ab00 con 0x7f2c5813e620 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 856916718 0 0) 0x7f2c38003530 con 0x7f2c581384c0 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c5809ade0 con 0x7f2c581384c0 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2c50001d00 con 0x7f2c5813e620 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.174 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739037124 0 0) 0x7f2c58138cd0 con 0x7f2c581379d0 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:45.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): my global_id is 6453 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c38003530 con 0x7f2c581379d0 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2c40001ae0 con 0x7f2c581384c0 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:45.176 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 343212292 0 0) 0x7f2c5809ab00 con 0x7f2c5813e620 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 >> v1:172.21.15.171:6792/0 conn(0x7f2c581384c0 legacy=0x7f2c581d1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 >> v1:172.21.15.106:6789/0 conn(0x7f2c581379d0 legacy=0x7f2c5812fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 monclient: found mon.f 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:45.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5813c400 con 0x7f2c5813e620 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 5 monclient: authenticate success, global_id 144847 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 10 monclient: _renew_subs 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5813cda0 con 0x7f2c5813e620 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 10 monclient: _renew_subs 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f2c580a0540 con 0x7f2c5813e620 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c500020b0 con 0x7f2c5813e620 2024-04-26T00:00:45.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2c50001ef0 con 0x7f2c5813e620 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c567fc640 4 set_mon_vals no callback set 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 10 monclient: dump: 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:45.179 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c3c005090 con 0x7f2c5813e620 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2c5000fe20 con 0x7f2c5813e620 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(184..184 src has 29..184) ==== 7811+0+0 (unknown 3582607985 0 0) 0x7f2c500458d0 con 0x7f2c5813e620 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.179+0000 7f2c577fe640 10 monclient: get_auth_request con 0x7f2c38037e50 auth_method 0 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.183+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2c50015ac0 con 0x7f2c5813e620 2024-04-26T00:00:45.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.183+0000 7f2c54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:45.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.183+0000 7f2c54ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:45.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.343+0000 7f2c5da91640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:45.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.343+0000 7f2c5da91640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:45.328 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.343+0000 7f2c5da91640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:45.329 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.343+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f2c3c005380 con 0x7f2c5813e620 2024-04-26T00:00:45.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.955+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}]=0 added bucket h5 type host to location {rack=r1} v185) ==== 166+0+0 (unknown 2676488226 0 0) 0x7f2c500153c0 con 0x7f2c5813e620 2024-04-26T00:00:45.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.955+0000 7f2c54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:45.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:45.955+0000 7f2c54ff9640 10 monclient: _finish_command 2 = system:0 added bucket h5 type host to location {rack=r1} 2024-04-26T00:00:46.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.055+0000 7f2c5da91640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:46.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.055+0000 7f2c5da91640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:46.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.055+0000 7f2c5da91640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:46.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.055+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f2c3c005be0 con 0x7f2c5813e620 2024-04-26T00:00:46.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.055+0000 7f2c54ff9640 1 -- 172.21.15.171:0/828842555 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h5' already exists v185) ==== 145+0+0 (unknown 1640628131 0 0) 0x7f2c50019710 con 0x7f2c5813e620 2024-04-26T00:00:46.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.055+0000 7f2c54ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h5", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:46.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.055+0000 7f2c54ff9640 10 monclient: _finish_command 3 = system:0 bucket 'h5' already exists 2024-04-26T00:00:46.040 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h5' already exists 2024-04-26T00:00:46.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 >> v1:172.21.15.171:6812/722422047 conn(0x7f2c38037e50 legacy=0x7f2c3803a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:46.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 10 monclient: shutdown 2024-04-26T00:00:46.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:46.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 >> v1:172.21.15.171:6789/0 conn(0x7f2c5813e620 legacy=0x7f2c581d5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:46.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 shutdown_connections 2024-04-26T00:00:46.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 >> 172.21.15.171:0/828842555 conn(0x7f2c580a6b30 msgr2=0x7f2c58133e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:46.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 shutdown_connections 2024-04-26T00:00:46.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.059+0000 7f2c5da91640 1 -- 172.21.15.171:0/828842555 wait complete. 2024-04-26T00:00:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h6 host rack=r1 2024-04-26T00:00:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient: get_monmap_and_config 2024-04-26T00:00:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient: build_initial_monmap 2024-04-26T00:00:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient: monmap: 2024-04-26T00:00:46.178 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:46.179 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:46.179 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:46.199964+0000 2024-04-26T00:00:46.179 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:46.199964+0000 2024-04-26T00:00:46.179 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:46.179 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:46.179 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:46.180 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:46.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 1 Processor -- start 2024-04-26T00:00:46.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 1 -- start start 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient: init 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient: _add_conns ranks=[6,3,2,1,5,7,4,8,0] 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient(hunting): picked mon.noname-d con 0x7fe55406f950 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient(hunting): picked mon.noname-g con 0x7fe5541378f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient(hunting): picked mon.noname-b con 0x7fe55413b400 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5540a1e70 con 0x7fe55413b400 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5540714e0 con 0x7fe5541378f0 2024-04-26T00:00:46.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5540717c0 con 0x7fe55406f950 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient(hunting): authenticate will time out at 1296.907000s 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe5537fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fe5541378f0 0x7fe554139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:34874/0 (socket says 172.21.15.171:34874) 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe5537fe640 1 -- 172.21.15.171:0/1428677145 learned_addr learned my addr 172.21.15.171:0/1428677145 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 147334237 0 0) 0x7fe5540714e0 con 0x7fe5541378f0 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient(hunting): my global_id is 6600 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe53c003530 con 0x7fe5541378f0 2024-04-26T00:00:46.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3125003447 0 0) 0x7fe53c003530 con 0x7fe5541378f0 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 >> v1:172.21.15.106:6792/0 conn(0x7fe55406f950 legacy=0x7fe55406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 >> v1:172.21.15.106:6790/0 conn(0x7fe55413b400 legacy=0x7fe55413d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 monclient: found mon.noname-g 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe554071aa0 con 0x7fe5541378f0 2024-04-26T00:00:46.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe5480017c0 con 0x7fe5541378f0 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 5 monclient: authenticate success, global_id 6600 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: dump: 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:46.194 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:46.195 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe548001ab0 con 0x7fe5541378f0 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:46.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe55a78c640 4 set_mon_vals no callback set 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 1 -- 172.21.15.171:0/1428677145 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe548004bf0 con 0x7fe5541378f0 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.195+0000 7fe552ffd640 10 monclient: dump: 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.197 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:46.198 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: shutdown 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/1428677145 >> v1:172.21.15.171:6790/0 conn(0x7fe5541378f0 legacy=0x7fe554139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/1428677145 shutdown_connections 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/1428677145 >> 172.21.15.171:0/1428677145 conn(0x7fe5540a2690 msgr2=0x7fe5540a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/1428677145 shutdown_connections 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/1428677145 wait complete. 2024-04-26T00:00:46.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: build_initial_monmap 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: monmap: 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:46.200 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 Processor -- start 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- start start 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: init 2024-04-26T00:00:46.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _add_conns ranks=[7,0,5,6,1,2,4,3,8] 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient(hunting): picked mon.noname-i con 0x7fe55406f950 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient(hunting): picked mon.noname-a con 0x7fe5541378f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient(hunting): picked mon.noname-h con 0x7fe55413b400 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe554070b40 con 0x7fe5541378f0 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe554131aa0 con 0x7fe55413b400 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe5541ca3a0 con 0x7fe55406f950 2024-04-26T00:00:46.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:46.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient(hunting): authenticate will time out at 1296.910061s 2024-04-26T00:00:46.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe553fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fe55406f950 0x7fe5541c9580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:45846/0 (socket says 172.21.15.171:45846) 2024-04-26T00:00:46.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe553fff640 1 -- 172.21.15.171:0/4041415396 learned_addr learned my addr 172.21.15.171:0/4041415396 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:46.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1742932242 0 0) 0x7fe554131aa0 con 0x7fe55413b400 2024-04-26T00:00:46.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:46.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:46.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): my global_id is 6287 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe540003530 con 0x7fe55413b400 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105776642 0 0) 0x7fe5541ca3a0 con 0x7fe55406f950 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): my global_id is 144718 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe554131aa0 con 0x7fe55406f950 2024-04-26T00:00:46.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2989641935 0 0) 0x7fe540003530 con 0x7fe55413b400 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe5541ca3a0 con 0x7fe55413b400 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe54c001c80 con 0x7fe55413b400 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:46.205 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:46.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2233693705 0 0) 0x7fe554131aa0 con 0x7fe55406f950 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe540003530 con 0x7fe55406f950 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe5440019d0 con 0x7fe55406f950 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.207 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:46.208 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1006045993 0 0) 0x7fe554071aa0 con 0x7fe5541378f0 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient(hunting): my global_id is 6462 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe554131aa0 con 0x7fe5541378f0 2024-04-26T00:00:46.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3403979155 0 0) 0x7fe5541ca3a0 con 0x7fe55413b400 2024-04-26T00:00:46.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 >> v1:172.21.15.171:6792/0 conn(0x7fe55406f950 legacy=0x7fe5541c9580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:46.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 >> v1:172.21.15.106:6789/0 conn(0x7fe5541378f0 legacy=0x7fe5541c9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:46.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:46.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 monclient: found mon.h 2024-04-26T00:00:46.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe554130310 con 0x7fe55413b400 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 5 monclient: authenticate success, global_id 6287 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _renew_subs 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe55412f7b0 con 0x7fe55413b400 2024-04-26T00:00:46.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _renew_subs 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe554131200 con 0x7fe55413b400 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe54c002010 con 0x7fe55413b400 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe54c003ff0 con 0x7fe55413b400 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe5527fc640 4 set_mon_vals no callback set 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe550ff9640 10 monclient: dump: 2024-04-26T00:00:46.212 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:46.213 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:46.213 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.213 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:46.213 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:46.213 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:46.213 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:46.213 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:46.214 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:46.214 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:46.214 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:46.214 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:46.214 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:46.214 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:46.214 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.199+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe534005090 con 0x7fe55413b400 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.203+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe54c00ed90 con 0x7fe55413b400 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.203+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(185..185 src has 29..185) ==== 8149+0+0 (unknown 1537583031 0 0) 0x7fe54c0446f0 con 0x7fe55413b400 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.203+0000 7fe553fff640 10 monclient: get_auth_request con 0x7fe54003a0f0 auth_method 0 2024-04-26T00:00:46.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.207+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe54c014880 con 0x7fe55413b400 2024-04-26T00:00:46.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.207+0000 7fe550ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:46.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.207+0000 7fe550ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:46.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.371+0000 7fe55a78c640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:46.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.371+0000 7fe55a78c640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:46.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.371+0000 7fe55a78c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:46.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.371+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fe534005380 con 0x7fe55413b400 2024-04-26T00:00:46.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.955+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}]=0 added bucket h6 type host to location {rack=r1} v186) ==== 166+0+0 (unknown 902876655 0 0) 0x7fe54c014180 con 0x7fe55413b400 2024-04-26T00:00:46.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.955+0000 7fe550ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:46.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:46.955+0000 7fe550ff9640 10 monclient: _finish_command 2 = system:0 added bucket h6 type host to location {rack=r1} 2024-04-26T00:00:47.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.063+0000 7fe55a78c640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:47.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.063+0000 7fe55a78c640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.063+0000 7fe55a78c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.063+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fe534005be0 con 0x7fe55413b400 2024-04-26T00:00:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe550ff9640 1 -- 172.21.15.171:0/4041415396 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h6' already exists v186) ==== 145+0+0 (unknown 2720153368 0 0) 0x7fe54c01cca0 con 0x7fe55413b400 2024-04-26T00:00:47.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe550ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h6", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:47.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe550ff9640 10 monclient: _finish_command 3 = system:0 bucket 'h6' already exists 2024-04-26T00:00:47.050 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h6' already exists 2024-04-26T00:00:47.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 >> v1:172.21.15.171:6812/722422047 conn(0x7fe54003a0f0 legacy=0x7fe54003c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:47.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 10 monclient: shutdown 2024-04-26T00:00:47.052 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:47.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 >> v1:172.21.15.171:6791/0 conn(0x7fe55413b400 legacy=0x7fe5541d17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:47.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 shutdown_connections 2024-04-26T00:00:47.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 >> 172.21.15.171:0/4041415396 conn(0x7fe5540a2690 msgr2=0x7fe5540a5040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:47.053 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 shutdown_connections 2024-04-26T00:00:47.054 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.067+0000 7fe55a78c640 1 -- 172.21.15.171:0/4041415396 wait complete. 2024-04-26T00:00:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h7 host rack=r1 2024-04-26T00:00:47.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient: get_monmap_and_config 2024-04-26T00:00:47.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient: build_initial_monmap 2024-04-26T00:00:47.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient: monmap: 2024-04-26T00:00:47.186 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:47.186 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:47.186 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:47.208049+0000 2024-04-26T00:00:47.186 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:47.208049+0000 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:47.187 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:47.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 1 Processor -- start 2024-04-26T00:00:47.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 1 -- start start 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient: init 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient: _add_conns ranks=[8,3,2,7,0,1,6,5,4] 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient(hunting): picked mon.noname-e con 0x7fd14006f950 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient(hunting): picked mon.noname-g con 0x7fd1401378f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient(hunting): picked mon.noname-b con 0x7fd14013b400 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1400a1e70 con 0x7fd14013b400 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1400714e0 con 0x7fd1401378f0 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1400717c0 con 0x7fd14006f950 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd147023640 10 monclient(hunting): authenticate will time out at 1297.915458s 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd144dbf640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fd14006f950 legacy=0x7fd14006fd30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:47.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13ffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd1401378f0 0x7fd140139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:34886/0 (socket says 172.21.15.171:34886) 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13ffff640 1 -- 172.21.15.171:0/1559723268 learned_addr learned my addr 172.21.15.171:0/1559723268 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2104988272 0 0) 0x7fd1400714e0 con 0x7fd1401378f0 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13f7fe640 10 monclient(hunting): my global_id is 6609 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.203+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd130003530 con 0x7fd1401378f0 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3641720973 0 0) 0x7fd130003530 con 0x7fd1401378f0 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 >> v1:172.21.15.106:6793/0 conn(0x7fd14006f950 legacy=0x7fd14006fd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 >> v1:172.21.15.106:6790/0 conn(0x7fd14013b400 legacy=0x7fd14013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:47.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 monclient: found mon.noname-g 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd140071aa0 con 0x7fd1401378f0 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd12c0017c0 con 0x7fd1401378f0 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 5 monclient: authenticate success, global_id 6609 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: dump: 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:47.195 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:47.196 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd12c001ab0 con 0x7fd1401378f0 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 1 -- 172.21.15.171:0/1559723268 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd12c004bf0 con 0x7fd1401378f0 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 4 set_mon_vals no callback set 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13f7fe640 10 monclient: dump: 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.197 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: shutdown 2024-04-26T00:00:47.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- 172.21.15.171:0/1559723268 >> v1:172.21.15.171:6790/0 conn(0x7fd1401378f0 legacy=0x7fd140139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- 172.21.15.171:0/1559723268 shutdown_connections 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- 172.21.15.171:0/1559723268 >> 172.21.15.171:0/1559723268 conn(0x7fd1400a2690 msgr2=0x7fd1400a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- 172.21.15.171:0/1559723268 shutdown_connections 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- 172.21.15.171:0/1559723268 wait complete. 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: build_initial_monmap 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: monmap: 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:47.199 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 Processor -- start 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- start start 2024-04-26T00:00:47.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: init 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: _add_conns ranks=[5,4,0,8,3,1,7,6,2] 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient(hunting): picked mon.noname-h con 0x7fd14006f950 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient(hunting): picked mon.noname-c con 0x7fd1401378f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient(hunting): picked mon.noname-a con 0x7fd14013b400 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd140136840 con 0x7fd14013b400 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd140070760 con 0x7fd1401378f0 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd140070b40 con 0x7fd14006f950 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient(hunting): authenticate will time out at 1297.918563s 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd144dbf640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fd14006f950 0x7fd1401ca240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33522/0 (socket says 172.21.15.171:33522) 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd144dbf640 1 -- 172.21.15.171:0/398173955 learned_addr learned my addr 172.21.15.171:0/398173955 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589476502 0 0) 0x7fd140070b40 con 0x7fd14006f950 2024-04-26T00:00:47.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): my global_id is 6296 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd124003530 con 0x7fd14006f950 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4282452791 0 0) 0x7fd124003530 con 0x7fd14006f950 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd140070b40 con 0x7fd14006f950 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd134004380 con 0x7fd14006f950 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): dump: 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:47.202 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:47.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4214036020 0 0) 0x7fd140070b40 con 0x7fd14006f950 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 >> v1:172.21.15.106:6791/0 conn(0x7fd1401378f0 legacy=0x7fd1401cf170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 >> v1:172.21.15.106:6789/0 conn(0x7fd14013b400 legacy=0x7fd1401d28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 monclient: found mon.h 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1401c9df0 con 0x7fd14006f950 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 5 monclient: authenticate success, global_id 6296 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: _renew_subs 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:47.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd140134550 con 0x7fd14006f950 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: _renew_subs 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1401ca950 con 0x7fd14006f950 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1340046e0 con 0x7fd14006f950 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd134004c50 con 0x7fd14006f950 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13e7fc640 4 set_mon_vals no callback set 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.207+0000 7fd13d7fa640 10 monclient: dump: 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.205 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.211+0000 7fd147023640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:47.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.211+0000 7fd147023640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:47.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.211+0000 7fd147023640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:47.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.211+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd120005090 con 0x7fd14006f950 2024-04-26T00:00:47.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.211+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd134004df0 con 0x7fd14006f950 2024-04-26T00:00:47.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.211+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(186..186 src has 29..186) ==== 8359+0+0 (unknown 1373139685 0 0) 0x7fd134045800 con 0x7fd14006f950 2024-04-26T00:00:47.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.211+0000 7fd13ffff640 10 monclient: get_auth_request con 0x7fd124037830 auth_method 0 2024-04-26T00:00:47.207 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.215+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd134015850 con 0x7fd14006f950 2024-04-26T00:00:47.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.215+0000 7fd13d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:47.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.215+0000 7fd13d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:47.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.379+0000 7fd147023640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:47.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.379+0000 7fd147023640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:47.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.379+0000 7fd147023640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:47.361 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.379+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fd120005380 con 0x7fd14006f950 2024-04-26T00:00:47.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.975+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}]=0 added bucket h7 type host to location {rack=r1} v187) ==== 166+0+0 (unknown 2940603643 0 0) 0x7fd134015150 con 0x7fd14006f950 2024-04-26T00:00:47.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.975+0000 7fd13d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:47.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:47.975+0000 7fd13d7fa640 10 monclient: _finish_command 2 = system:0 added bucket h7 type host to location {rack=r1} 2024-04-26T00:00:48.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.079+0000 7fd147023640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:48.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.079+0000 7fd147023640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:48.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.079+0000 7fd147023640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:48.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.079+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fd120005ac0 con 0x7fd14006f950 2024-04-26T00:00:48.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.079+0000 7fd13d7fa640 1 -- 172.21.15.171:0/398173955 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h7' already exists v187) ==== 145+0+0 (unknown 3816521585 0 0) 0x7fd13401dd00 con 0x7fd14006f950 2024-04-26T00:00:48.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.079+0000 7fd13d7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h7", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:48.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.079+0000 7fd13d7fa640 10 monclient: _finish_command 3 = system:0 bucket 'h7' already exists 2024-04-26T00:00:48.064 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h7' already exists 2024-04-26T00:00:48.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 >> v1:172.21.15.171:6812/722422047 conn(0x7fd124037830 legacy=0x7fd124039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:48.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 10 monclient: shutdown 2024-04-26T00:00:48.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:48.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 >> v1:172.21.15.171:6791/0 conn(0x7fd14006f950 legacy=0x7fd1401ca240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:48.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 shutdown_connections 2024-04-26T00:00:48.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 >> 172.21.15.171:0/398173955 conn(0x7fd1400a2690 msgr2=0x7fd1400a3c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:48.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 shutdown_connections 2024-04-26T00:00:48.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.083+0000 7fd147023640 1 -- 172.21.15.171:0/398173955 wait complete. 2024-04-26T00:00:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h8 host rack=r1 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: get_monmap_and_config 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: build_initial_monmap 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: monmap: 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:48.222650+0000 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:48.222650+0000 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:48.201 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:48.202 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:48.202 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:48.202 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:48.202 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:48.202 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:48.202 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:48.202 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 Processor -- start 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- start start 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: init 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: _add_conns ranks=[3,4,0,5,1,6,2,7,8] 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient(hunting): picked mon.noname-g con 0x7f8ed01379d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient(hunting): picked mon.noname-c con 0x7f8ed01384c0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient(hunting): picked mon.noname-a con 0x7f8ed013e620 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:48.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed00a2b00 con 0x7f8ed013e620 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed00a2de0 con 0x7f8ed01379d0 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed00a17a0 con 0x7f8ed01384c0 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient(hunting): authenticate will time out at 1298.929623s 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed591f640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f8ed01379d0 0x7f8ed0137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:34898/0 (socket says 172.21.15.171:34898) 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed591f640 1 -- 172.21.15.171:0/314310638 learned_addr learned my addr 172.21.15.171:0/314310638 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2260234325 0 0) 0x7f8ed00a2de0 con 0x7f8ed01379d0 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient(hunting): _negotiate 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient(hunting): my global_id is 6618 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ebc003530 con 0x7f8ed01379d0 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3977059349 0 0) 0x7f8ebc003530 con 0x7f8ed01379d0 2024-04-26T00:00:48.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 >> v1:172.21.15.106:6791/0 conn(0x7f8ed01384c0 legacy=0x7f8ed013cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 >> v1:172.21.15.106:6789/0 conn(0x7f8ed013e620 legacy=0x7f8ed0140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: _finish_hunting 0 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 monclient: found mon.noname-g 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed00a3b20 con 0x7f8ed01379d0 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: _finish_auth 0 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: _check_auth_tickets 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ecc0017c0 con 0x7f8ed01379d0 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: dump: 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:48.211 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:48.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 5 monclient: authenticate success, global_id 6618 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ecc001ab0 con 0x7f8ed01379d0 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 1 -- 172.21.15.171:0/314310638 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ecc004bf0 con 0x7f8ed01379d0 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed491d640 10 monclient: dump: 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:48.213 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 4 set_mon_vals no callback set 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: shutdown 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- 172.21.15.171:0/314310638 >> v1:172.21.15.171:6790/0 conn(0x7f8ed01379d0 legacy=0x7f8ed0137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:48.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- 172.21.15.171:0/314310638 shutdown_connections 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- 172.21.15.171:0/314310638 >> 172.21.15.171:0/314310638 conn(0x7f8ed00a6b30 msgr2=0x7f8ed00a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- 172.21.15.171:0/314310638 shutdown_connections 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 1 -- 172.21.15.171:0/314310638 wait complete. 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: build_initial_monmap 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.219+0000 7f8ed7b83640 10 monclient: monmap: 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:48.215 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 Processor -- start 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 -- start start 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: init 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _add_conns ranks=[7,8,3,2,0,5,6,1,4] 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient(hunting): picked mon.noname-i con 0x7f8ed01379d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient(hunting): picked mon.noname-e con 0x7f8ed01384c0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient(hunting): picked mon.noname-g con 0x7f8ed013e620 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:48.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed00a19d0 con 0x7f8ed013e620 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed009e650 con 0x7f8ed01379d0 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ed0138cd0 con 0x7f8ed01384c0 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient(hunting): authenticate will time out at 1298.932793s 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed6120640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f8ed013e620 0x7f8ed01d53f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:34910/0 (socket says 172.21.15.171:34910) 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed6120640 1 -- 172.21.15.171:0/728562248 learned_addr learned my addr 172.21.15.171:0/728562248 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed511e640 1 -- 172.21.15.171:0/728562248 >> v1:172.21.15.106:6793/0 conn(0x7f8ed01384c0 legacy=0x7f8ed01d1cc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942105328 0 0) 0x7f8ed00a19d0 con 0x7f8ed013e620 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:48.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): my global_id is 6627 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8eb4003530 con 0x7f8ed013e620 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1429731603 0 0) 0x7f8ed009e650 con 0x7f8ed01379d0 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): my global_id is 144727 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ed00a19d0 con 0x7f8ed01379d0 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4066790214 0 0) 0x7f8eb4003530 con 0x7f8ed013e620 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ed009e650 con 0x7f8ed013e620 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 903920318 0 0) 0x7f8ed00a19d0 con 0x7f8ed01379d0 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8eb4003530 con 0x7f8ed01379d0 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ec8001d50 con 0x7f8ed013e620 2024-04-26T00:00:48.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): dump: 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:48.219 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ecc001780 con 0x7f8ed01379d0 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient(hunting): dump: 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:48.220 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1595961919 0 0) 0x7f8ed009e650 con 0x7f8ed013e620 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 >> v1:172.21.15.106:6793/0 conn(0x7f8ed01384c0 legacy=0x7f8ed01d1cc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 >> v1:172.21.15.171:6792/0 conn(0x7f8ed01379d0 legacy=0x7f8ed009fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 monclient: found mon.g 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:48.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ed00a0fa0 con 0x7f8ed013e620 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 5 monclient: authenticate success, global_id 6627 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _renew_subs 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ed01cd0a0 con 0x7f8ed013e620 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _renew_subs 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ed009cc10 con 0x7f8ed013e620 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ec8003c50 con 0x7f8ed013e620 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:48.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ec80041c0 con 0x7f8ed013e620 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec7fff640 4 set_mon_vals no callback set 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 10 monclient: dump: 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:48.223 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb8005090 con 0x7f8ed013e620 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8ec8004360 con 0x7f8ed013e620 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(187..187 src has 29..187) ==== 8569+0+0 (unknown 1069081767 0 0) 0x7f8ec8045ab0 con 0x7f8ed013e620 2024-04-26T00:00:48.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.223+0000 7f8ed591f640 10 monclient: get_auth_request con 0x7f8eb4037dd0 auth_method 0 2024-04-26T00:00:48.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.227+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8ec8015a90 con 0x7f8ed013e620 2024-04-26T00:00:48.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.227+0000 7f8ec67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:48.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.227+0000 7f8ec67fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:48.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.391+0000 7f8ed7b83640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:48.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.391+0000 7f8ed7b83640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:48.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.391+0000 7f8ed7b83640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:48.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.391+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f8eb8005380 con 0x7f8ed013e620 2024-04-26T00:00:48.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.987+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}]=0 added bucket h8 type host to location {rack=r1} v188) ==== 166+0+0 (unknown 2509204718 0 0) 0x7f8ec8015390 con 0x7f8ed013e620 2024-04-26T00:00:48.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.987+0000 7f8ec67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:48.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:48.987+0000 7f8ec67fc640 10 monclient: _finish_command 2 = system:0 added bucket h8 type host to location {rack=r1} 2024-04-26T00:00:49.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.083+0000 7f8ed7b83640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:49.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.083+0000 7f8ed7b83640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:49.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.083+0000 7f8ed7b83640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:49.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.083+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f8eb8005be0 con 0x7f8ed013e620 2024-04-26T00:00:49.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.087+0000 7f8ec67fc640 1 -- 172.21.15.171:0/728562248 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h8' already exists v188) ==== 145+0+0 (unknown 1669644171 0 0) 0x7f8ec801deb0 con 0x7f8ed013e620 2024-04-26T00:00:49.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.087+0000 7f8ec67fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h8", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:49.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.087+0000 7f8ec67fc640 10 monclient: _finish_command 3 = system:0 bucket 'h8' already exists 2024-04-26T00:00:49.070 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h8' already exists 2024-04-26T00:00:49.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 >> v1:172.21.15.171:6812/722422047 conn(0x7f8eb4037dd0 legacy=0x7f8eb403a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:49.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 10 monclient: shutdown 2024-04-26T00:00:49.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:49.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 >> v1:172.21.15.171:6790/0 conn(0x7f8ed013e620 legacy=0x7f8ed01d53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:49.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 shutdown_connections 2024-04-26T00:00:49.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 >> 172.21.15.171:0/728562248 conn(0x7f8ed00a6b30 msgr2=0x7f8ed01359d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:49.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 shutdown_connections 2024-04-26T00:00:49.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.091+0000 7f8ed7b83640 1 -- 172.21.15.171:0/728562248 wait complete. 2024-04-26T00:00:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h9 host rack=r1 2024-04-26T00:00:49.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.223+0000 7fa26a8bd640 10 monclient: get_monmap_and_config 2024-04-26T00:00:49.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.223+0000 7fa26a8bd640 10 monclient: build_initial_monmap 2024-04-26T00:00:49.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.223+0000 7fa26a8bd640 10 monclient: monmap: 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:49.230184+0000 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:49.230184+0000 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:49.209 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:49.210 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:49.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 Processor -- start 2024-04-26T00:00:49.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- start start 2024-04-26T00:00:49.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient: init 2024-04-26T00:00:49.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:49.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient: _add_conns ranks=[0,7,2,1,4,3,5,6,8] 2024-04-26T00:00:49.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient(hunting): picked mon.noname-a con 0x7fa26406f950 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient(hunting): picked mon.noname-i con 0x7fa2641378f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient(hunting): picked mon.noname-b con 0x7fa26413b400 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2640a1e70 con 0x7fa26406f950 2024-04-26T00:00:49.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2640714e0 con 0x7fa26413b400 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2640717c0 con 0x7fa2641378f0 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient(hunting): authenticate will time out at 1299.937161s 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa25b7fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fa2641378f0 0x7fa264139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:45864/0 (socket says 172.21.15.171:45864) 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa25b7fe640 1 -- 172.21.15.171:0/1009407889 learned_addr learned my addr 172.21.15.171:0/1009407889 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521944444 0 0) 0x7fa2640717c0 con 0x7fa2641378f0 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:49.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient(hunting): my global_id is 144736 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa250003530 con 0x7fa2641378f0 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 637174571 0 0) 0x7fa250003530 con 0x7fa2641378f0 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 >> v1:172.21.15.106:6790/0 conn(0x7fa26413b400 legacy=0x7fa26413d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 >> v1:172.21.15.106:6789/0 conn(0x7fa26406f950 legacy=0x7fa26406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 monclient: found mon.noname-i 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa264071aa0 con 0x7fa2641378f0 2024-04-26T00:00:49.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa24c0017c0 con 0x7fa2641378f0 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 5 monclient: authenticate success, global_id 144736 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: dump: 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:49.222 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.223 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.223 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:49.223 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:49.223 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:49.223 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:49.223 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:49.223 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:49.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:49.224 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:49.224 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:49.224 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:49.224 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:49.224 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:49.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa24c001ab0 con 0x7fa2641378f0 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 4 set_mon_vals no callback set 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 1 -- 172.21.15.171:0/1009407889 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa24c004bf0 con 0x7fa2641378f0 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa2637fe640 10 monclient: dump: 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.225 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient: shutdown 2024-04-26T00:00:49.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- 172.21.15.171:0/1009407889 >> v1:172.21.15.171:6792/0 conn(0x7fa2641378f0 legacy=0x7fa264139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- 172.21.15.171:0/1009407889 shutdown_connections 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- 172.21.15.171:0/1009407889 >> 172.21.15.171:0/1009407889 conn(0x7fa2640a2690 msgr2=0x7fa2640a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- 172.21.15.171:0/1009407889 shutdown_connections 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 -- 172.21.15.171:0/1009407889 wait complete. 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient: build_initial_monmap 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 10 monclient: monmap: 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:49.227 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.227+0000 7fa26a8bd640 1 Processor -- start 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 1 -- start start 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: init 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:49.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _add_conns ranks=[1,4,0,7,2,3,8,5,6] 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient(hunting): picked mon.noname-f con 0x7fa26406f950 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient(hunting): picked mon.noname-c con 0x7fa2641378f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient(hunting): picked mon.noname-a con 0x7fa26413b400 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa264133380 con 0x7fa26413b400 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa264132850 con 0x7fa26406f950 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa264131370 con 0x7fa2641378f0 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient(hunting): authenticate will time out at 1299.940610s 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa263fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa26406f950 0x7fa264136bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47904/0 (socket says 172.21.15.171:47904) 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa263fff640 1 -- 172.21.15.171:0/2961476771 learned_addr learned my addr 172.21.15.171:0/2961476771 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4102003584 0 0) 0x7fa264132850 con 0x7fa26406f950 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:49.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): my global_id is 144856 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa244003530 con 0x7fa26406f950 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4143976470 0 0) 0x7fa244003530 con 0x7fa26406f950 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa264132850 con 0x7fa26406f950 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa254001ae0 con 0x7fa26406f950 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): dump: 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:49.230 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2150993449 0 0) 0x7fa264132850 con 0x7fa26406f950 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 >> v1:172.21.15.106:6791/0 conn(0x7fa2641378f0 legacy=0x7fa2641ce060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 >> v1:172.21.15.106:6789/0 conn(0x7fa26413b400 legacy=0x7fa2641d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 monclient: found mon.f 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2641372c0 con 0x7fa26406f950 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 5 monclient: authenticate success, global_id 144856 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _renew_subs 2024-04-26T00:00:49.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa264131ed0 con 0x7fa26406f950 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _renew_subs 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2641c91a0 con 0x7fa26406f950 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2540038d0 con 0x7fa26406f950 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa254003e40 con 0x7fa26406f950 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa262ffd640 4 set_mon_vals no callback set 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 10 monclient: dump: 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:49.233 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:49.234 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248005090 con 0x7fa26406f950 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa254004060 con 0x7fa26406f950 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(188..188 src has 29..188) ==== 8779+0+0 (unknown 650474653 0 0) 0x7fa254045a70 con 0x7fa26406f950 2024-04-26T00:00:49.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.231+0000 7fa25b7fe640 10 monclient: get_auth_request con 0x7fa2440378b0 auth_method 0 2024-04-26T00:00:49.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.235+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa254015950 con 0x7fa26406f950 2024-04-26T00:00:49.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.235+0000 7fa2617fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:49.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.235+0000 7fa2617fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:49.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.399+0000 7fa26a8bd640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:49.382 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.399+0000 7fa26a8bd640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:49.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.399+0000 7fa26a8bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:49.383 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:49.399+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fa248005380 con 0x7fa26406f950 2024-04-26T00:00:49.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.007+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}]=0 added bucket h9 type host to location {rack=r1} v189) ==== 166+0+0 (unknown 253341178 0 0) 0x7fa254015250 con 0x7fa26406f950 2024-04-26T00:00:49.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.007+0000 7fa2617fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:49.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.007+0000 7fa2617fa640 10 monclient: _finish_command 2 = system:0 added bucket h9 type host to location {rack=r1} 2024-04-26T00:00:50.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.103+0000 7fa26a8bd640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:50.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.103+0000 7fa26a8bd640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:50.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.103+0000 7fa26a8bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:50.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.103+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fa248005be0 con 0x7fa26406f950 2024-04-26T00:00:50.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.103+0000 7fa2617fa640 1 -- 172.21.15.171:0/2961476771 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h9' already exists v189) ==== 145+0+0 (unknown 584974306 0 0) 0x7fa25401de00 con 0x7fa26406f950 2024-04-26T00:00:50.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa2617fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h9", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:50.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa2617fa640 10 monclient: _finish_command 3 = system:0 bucket 'h9' already exists 2024-04-26T00:00:50.088 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h9' already exists 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 >> v1:172.21.15.171:6812/722422047 conn(0x7fa2440378b0 legacy=0x7fa244039d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 10 monclient: shutdown 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 >> v1:172.21.15.171:6789/0 conn(0x7fa26406f950 legacy=0x7fa264136bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 shutdown_connections 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 >> 172.21.15.171:0/2961476771 conn(0x7fa2640a2690 msgr2=0x7fa2640a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 shutdown_connections 2024-04-26T00:00:50.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.107+0000 7fa26a8bd640 1 -- 172.21.15.171:0/2961476771 wait complete. 2024-04-26T00:00:50.105 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:50.106 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h10 host rack=r1 2024-04-26T00:00:50.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient: get_monmap_and_config 2024-04-26T00:00:50.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient: build_initial_monmap 2024-04-26T00:00:50.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient: monmap: 2024-04-26T00:00:50.221 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:50.243220+0000 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:50.243220+0000 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:50.222 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:50.223 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:50.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 1 Processor -- start 2024-04-26T00:00:50.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 1 -- start start 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient: init 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient: _add_conns ranks=[4,6,2,1,8,3,0,7,5] 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient(hunting): picked mon.noname-c con 0x7f3940135a00 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient(hunting): picked mon.noname-d con 0x7f39400a1790 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient(hunting): picked mon.noname-b con 0x7f394013c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f39400a1d80 con 0x7f394013c130 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3940072f70 con 0x7f3940135a00 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3940072640 con 0x7f39400a1790 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:50.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient(hunting): authenticate will time out at 1300.950127s 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f3940135a00 0x7f3940135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:54950/0 (socket says 172.21.15.171:54950) 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393ffff640 1 -- 172.21.15.171:0/2415181692 learned_addr learned my addr 172.21.15.171:0/2415181692 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3944d00640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f394013c130 0x7f394013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:60512/0 (socket says 172.21.15.171:60512) 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3937fff640 1 --1- 172.21.15.171:0/2415181692 >> v1:172.21.15.106:6792/0 conn(0x7f39400a1790 0x7f394013aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:41152/0 (socket says 172.21.15.171:41152) 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056286898 0 0) 0x7f39400a1d80 con 0x7f394013c130 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): my global_id is 6320 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f392c003530 con 0x7f394013c130 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2756853502 0 0) 0x7f3940072640 con 0x7f39400a1790 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:50.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): my global_id is 6396 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f39400a1d80 con 0x7f39400a1790 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997471356 0 0) 0x7f3940072f70 con 0x7f3940135a00 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient(hunting): my global_id is 144922 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3940072640 con 0x7f3940135a00 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3547890503 0 0) 0x7f3940072640 con 0x7f3940135a00 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 >> v1:172.21.15.106:6792/0 conn(0x7f39400a1790 legacy=0x7f394013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 >> v1:172.21.15.106:6790/0 conn(0x7f394013c130 legacy=0x7f394013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 monclient: found mon.noname-c 2024-04-26T00:00:50.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3940072920 con 0x7f3940135a00 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f39300016e0 con 0x7f3940135a00 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: dump: 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:50.229 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 5 monclient: authenticate success, global_id 144922 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3930001910 con 0x7f3940135a00 2024-04-26T00:00:50.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f393f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.239+0000 7f3946763640 4 set_mon_vals no callback set 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393f7fe640 1 -- 172.21.15.171:0/2415181692 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f39300048b0 con 0x7f3940135a00 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393f7fe640 10 monclient: dump: 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:50.231 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: shutdown 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- 172.21.15.171:0/2415181692 >> v1:172.21.15.106:6791/0 conn(0x7f3940135a00 legacy=0x7f3940135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- 172.21.15.171:0/2415181692 shutdown_connections 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- 172.21.15.171:0/2415181692 >> 172.21.15.171:0/2415181692 conn(0x7f39400a2690 msgr2=0x7f39400a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- 172.21.15.171:0/2415181692 shutdown_connections 2024-04-26T00:00:50.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- 172.21.15.171:0/2415181692 wait complete. 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: build_initial_monmap 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: monmap: 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:50.233 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:50.234 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:50.234 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:50.234 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:50.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 Processor -- start 2024-04-26T00:00:50.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- start start 2024-04-26T00:00:50.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: init 2024-04-26T00:00:50.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:50.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: _add_conns ranks=[1,0,8,4,5,7,2,3,6] 2024-04-26T00:00:50.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient(hunting): picked mon.noname-f con 0x7f39400a1790 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient(hunting): picked mon.noname-a con 0x7f3940135a00 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient(hunting): picked mon.noname-e con 0x7f394013c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394012f5c0 con 0x7f3940135a00 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394013a610 con 0x7f39400a1790 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f394012f2e0 con 0x7f394013c130 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient(hunting): authenticate will time out at 1300.954410s 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f39400a1790 0x7f39401389e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47918/0 (socket says 172.21.15.171:47918) 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393ffff640 1 -- 172.21.15.171:0/356305978 learned_addr learned my addr 172.21.15.171:0/356305978 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3944d00640 1 -- 172.21.15.171:0/356305978 >> v1:172.21.15.106:6793/0 conn(0x7f394013c130 legacy=0x7f3940139800 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517992470 0 0) 0x7f394013a610 con 0x7f39400a1790 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:50.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): my global_id is 144865 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3920003530 con 0x7f39400a1790 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1518272073 0 0) 0x7f3920003530 con 0x7f39400a1790 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f394013a610 con 0x7f39400a1790 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f39300016a0 con 0x7f39400a1790 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): dump: 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:50.239 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2869179923 0 0) 0x7f394012f5c0 con 0x7f3940135a00 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:50.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient(hunting): my global_id is 6507 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3920003530 con 0x7f3940135a00 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2077708171 0 0) 0x7f394013a610 con 0x7f39400a1790 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 >> v1:172.21.15.106:6793/0 conn(0x7f394013c130 legacy=0x7f3940139800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 >> v1:172.21.15.106:6789/0 conn(0x7f3940135a00 legacy=0x7f39401390f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 monclient: found mon.f 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f394012f8a0 con 0x7f39400a1790 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 5 monclient: authenticate success, global_id 144865 2024-04-26T00:00:50.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: _renew_subs 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f394013aec0 con 0x7f39400a1790 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: _renew_subs 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f39401d12f0 con 0x7f39400a1790 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3930001910 con 0x7f39400a1790 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3930005230 con 0x7f39400a1790 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393effd640 4 set_mon_vals no callback set 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.243+0000 7f393d7fa640 10 monclient: dump: 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:50.242 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:50.243 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.247+0000 7f3946763640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.247+0000 7f3946763640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.247+0000 7f3946763640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.247+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3924005090 con 0x7f39400a1790 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.247+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f39300053d0 con 0x7f39400a1790 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.247+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(189..189 src has 29..189) ==== 8989+0+0 (unknown 3283719767 0 0) 0x7f3930045c80 con 0x7f39400a1790 2024-04-26T00:00:50.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.247+0000 7f3937fff640 10 monclient: get_auth_request con 0x7f3920037720 auth_method 0 2024-04-26T00:00:50.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.251+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f39300159d0 con 0x7f39400a1790 2024-04-26T00:00:50.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.251+0000 7f393d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:50.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.251+0000 7f393d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:50.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.403+0000 7f3946763640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:50.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.403+0000 7f3946763640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:50.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.403+0000 7f3946763640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:50.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:50.403+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f3924005380 con 0x7f39400a1790 2024-04-26T00:00:50.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.007+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}]=0 added bucket h10 type host to location {rack=r1} v190) ==== 168+0+0 (unknown 4039178125 0 0) 0x7f3930019620 con 0x7f39400a1790 2024-04-26T00:00:50.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.007+0000 7f393d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:50.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.007+0000 7f393d7fa640 10 monclient: _finish_command 2 = system:0 added bucket h10 type host to location {rack=r1} 2024-04-26T00:00:51.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.111+0000 7f3946763640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.111+0000 7f3946763640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.111+0000 7f3946763640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:00:51.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.111+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f3924005be0 con 0x7f39400a1790 2024-04-26T00:00:51.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.111+0000 7f393d7fa640 1 -- 172.21.15.171:0/356305978 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h10' already exists v190) ==== 147+0+0 (unknown 4042308476 0 0) 0x7f3930042540 con 0x7f39400a1790 2024-04-26T00:00:51.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.111+0000 7f393d7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h10", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.111+0000 7f393d7fa640 10 monclient: _finish_command 3 = system:0 bucket 'h10' already exists 2024-04-26T00:00:51.096 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h10' already exists 2024-04-26T00:00:51.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 >> v1:172.21.15.171:6812/722422047 conn(0x7f3920037720 legacy=0x7f3920039be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 10 monclient: shutdown 2024-04-26T00:00:51.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:51.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 >> v1:172.21.15.171:6789/0 conn(0x7f39400a1790 legacy=0x7f39401389e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 shutdown_connections 2024-04-26T00:00:51.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 >> 172.21.15.171:0/356305978 conn(0x7f39400a2690 msgr2=0x7f39400a5260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:51.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 shutdown_connections 2024-04-26T00:00:51.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.115+0000 7f3946763640 1 -- 172.21.15.171:0/356305978 wait complete. 2024-04-26T00:00:51.112 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:51.112 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h11 host rack=r1 2024-04-26T00:00:51.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: get_monmap_and_config 2024-04-26T00:00:51.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: build_initial_monmap 2024-04-26T00:00:51.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: monmap: 2024-04-26T00:00:51.221 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:51.221 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.221 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:51.243079+0000 2024-04-26T00:00:51.221 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:51.243079+0000 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:51.222 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:51.223 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 1 Processor -- start 2024-04-26T00:00:51.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 1 -- start start 2024-04-26T00:00:51.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: init 2024-04-26T00:00:51.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:51.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: _add_conns ranks=[2,4,8,1,3,5,6,0,7] 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient(hunting): picked mon.noname-b con 0x7f7dcc06f950 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient(hunting): picked mon.noname-c con 0x7f7dcc1378f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient(hunting): picked mon.noname-e con 0x7f7dcc13b400 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0a1e70 con 0x7f7dcc06f950 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0714e0 con 0x7f7dcc1378f0 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc0717c0 con 0x7f7dcc13b400 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient(hunting): authenticate will time out at 1301.950012s 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd1de2640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f7dcc13b400 legacy=0x7f7dcc13d7f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd0de0640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f7dcc1378f0 0x7f7dcc139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:37584/0 (socket says 172.21.15.171:37584) 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd0de0640 1 -- 172.21.15.171:0/657138378 learned_addr learned my addr 172.21.15.171:0/657138378 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769543809 0 0) 0x7f7dcc0714e0 con 0x7f7dcc1378f0 2024-04-26T00:00:51.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): my global_id is 144931 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db8003530 con 0x7f7dcc1378f0 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2640345577 0 0) 0x7f7dcc0a1e70 con 0x7f7dcc06f950 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient(hunting): my global_id is 6329 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dcc0714e0 con 0x7f7dcc06f950 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2362748008 0 0) 0x7f7db8003530 con 0x7f7dcc1378f0 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 >> v1:172.21.15.106:6793/0 conn(0x7f7dcc13b400 legacy=0x7f7dcc13d7f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 >> v1:172.21.15.106:6790/0 conn(0x7f7dcc06f950 legacy=0x7f7dcc06fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 monclient: found mon.noname-c 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc071aa0 con 0x7f7dcc1378f0 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7dc80017c0 con 0x7f7dcc1378f0 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: dump: 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.234 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 5 monclient: authenticate success, global_id 144931 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7dc8001a70 con 0x7f7dcc1378f0 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 1 -- 172.21.15.171:0/657138378 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7dc8004bf0 con 0x7f7dcc1378f0 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 4 set_mon_vals no callback set 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dc3fff640 10 monclient: dump: 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.236 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 10 monclient: shutdown 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.239+0000 7f7dd3845640 1 -- 172.21.15.171:0/657138378 >> v1:172.21.15.106:6791/0 conn(0x7f7dcc1378f0 legacy=0x7f7dcc139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- 172.21.15.171:0/657138378 shutdown_connections 2024-04-26T00:00:51.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- 172.21.15.171:0/657138378 >> 172.21.15.171:0/657138378 conn(0x7f7dcc0a2690 msgr2=0x7f7dcc0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- 172.21.15.171:0/657138378 shutdown_connections 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- 172.21.15.171:0/657138378 wait complete. 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: build_initial_monmap 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: monmap: 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:51.238 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:51.241 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.241 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:51.241 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:51.241 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 Processor -- start 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- start start 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: init 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _add_conns ranks=[5,6,3,2,1,8,4,0,7] 2024-04-26T00:00:51.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient(hunting): picked mon.noname-h con 0x7f7dcc06f950 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient(hunting): picked mon.noname-d con 0x7f7dcc1378f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient(hunting): picked mon.noname-g con 0x7f7dcc13b400 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc070760 con 0x7f7dcc13b400 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc1303f0 con 0x7f7dcc06f950 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dcc1326e0 con 0x7f7dcc1378f0 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient(hunting): authenticate will time out at 1301.953624s 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd15e1640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7dcc06f950 0x7f7dcc136c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47504/0 (socket says 172.21.15.171:47504) 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd15e1640 1 -- 172.21.15.171:0/3224085280 learned_addr learned my addr 172.21.15.171:0/3224085280 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381216510 0 0) 0x7f7dcc1303f0 con 0x7f7dcc06f950 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): my global_id is 6305 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db0003530 con 0x7f7dcc06f950 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770108028 0 0) 0x7f7dcc070760 con 0x7f7dcc13b400 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): my global_id is 6636 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dcc1303f0 con 0x7f7dcc13b400 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 699446990 0 0) 0x7f7db0003530 con 0x7f7dcc06f950 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7dcc070760 con 0x7f7dcc06f950 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7dbc001b20 con 0x7f7dcc06f950 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:51.244 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.245 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630310923 0 0) 0x7f7dcc1326e0 con 0x7f7dcc1378f0 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): my global_id is 6405 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7db0003530 con 0x7f7dcc1378f0 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2898914799 0 0) 0x7f7dcc1303f0 con 0x7f7dcc13b400 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7dcc1326e0 con 0x7f7dcc13b400 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7dc4004560 con 0x7f7dcc13b400 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:51.246 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.247 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2747074001 0 0) 0x7f7dcc070760 con 0x7f7dcc06f950 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 >> v1:172.21.15.106:6792/0 conn(0x7f7dcc1378f0 legacy=0x7f7dcc1ccf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 >> v1:172.21.15.171:6790/0 conn(0x7f7dcc13b400 legacy=0x7f7dcc1d0680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 monclient: found mon.h 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dcc131e40 con 0x7f7dcc06f950 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 5 monclient: authenticate success, global_id 6305 2024-04-26T00:00:51.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _renew_subs 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7dcc1c8670 con 0x7f7dcc06f950 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _renew_subs 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f7dcc1310e0 con 0x7f7dcc06f950 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7dbc0038d0 con 0x7f7dcc06f950 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7dbc003e40 con 0x7f7dcc06f950 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc37fe640 4 set_mon_vals no callback set 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 10 monclient: dump: 2024-04-26T00:00:51.249 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.250 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7dbc003fe0 con 0x7f7dcc06f950 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dac005090 con 0x7f7dcc06f950 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(190..190 src has 29..190) ==== 9202+0+0 (unknown 3971534940 0 0) 0x7f7dbc045aa0 con 0x7f7dcc06f950 2024-04-26T00:00:51.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.243+0000 7f7dd0de0640 10 monclient: get_auth_request con 0x7f7db0037f90 auth_method 0 2024-04-26T00:00:51.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.247+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7dbc0156e0 con 0x7f7dcc06f950 2024-04-26T00:00:51.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.247+0000 7f7dc1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:51.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.247+0000 7f7dc1ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:51.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.411+0000 7f7dd3845640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.411+0000 7f7dd3845640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.411+0000 7f7dd3845640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:51.395 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.411+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f7dac005380 con 0x7f7dcc06f950 2024-04-26T00:00:51.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.551+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}]=0 added bucket h11 type host to location {rack=r1} v191) ==== 168+0+0 (unknown 2362602096 0 0) 0x7f7dbc019390 con 0x7f7dcc06f950 2024-04-26T00:00:51.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.551+0000 7f7dc1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.551+0000 7f7dc1ffb640 10 monclient: _finish_command 2 = system:0 added bucket h11 type host to location {rack=r1} 2024-04-26T00:00:51.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.671+0000 7f7dd3845640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.671+0000 7f7dd3845640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.671+0000 7f7dd3845640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:51.654 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.671+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f7dac005be0 con 0x7f7dcc06f950 2024-04-26T00:00:51.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.671+0000 7f7dc1ffb640 1 -- 172.21.15.171:0/3224085280 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h11' already exists v191) ==== 147+0+0 (unknown 4215710353 0 0) 0x7f7dbc01dc50 con 0x7f7dcc06f950 2024-04-26T00:00:51.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.671+0000 7f7dc1ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h11", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.671+0000 7f7dc1ffb640 10 monclient: _finish_command 3 = system:0 bucket 'h11' already exists 2024-04-26T00:00:51.656 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h11' already exists 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 >> v1:172.21.15.171:6812/722422047 conn(0x7f7db0037f90 legacy=0x7f7db003a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 10 monclient: shutdown 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 >> v1:172.21.15.171:6791/0 conn(0x7f7dcc06f950 legacy=0x7f7dcc136c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 shutdown_connections 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 >> 172.21.15.171:0/3224085280 conn(0x7f7dcc0a2690 msgr2=0x7f7dcc13a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 shutdown_connections 2024-04-26T00:00:51.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.675+0000 7f7dd3845640 1 -- 172.21.15.171:0/3224085280 wait complete. 2024-04-26T00:00:51.672 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:51.672 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h12 host rack=r1 2024-04-26T00:00:51.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.791+0000 7f86c8c08640 10 monclient: get_monmap_and_config 2024-04-26T00:00:51.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.791+0000 7f86c8c08640 10 monclient: build_initial_monmap 2024-04-26T00:00:51.775 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.791+0000 7f86c8c08640 10 monclient: monmap: 2024-04-26T00:00:51.775 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:51.775 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:51.797306+0000 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:51.797306+0000 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:51.776 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.791+0000 7f86c8c08640 1 Processor -- start 2024-04-26T00:00:51.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.791+0000 7f86c8c08640 1 -- start start 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.791+0000 7f86c8c08640 10 monclient: init 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: _add_conns ranks=[1,4,0,7,8,5,6,2,3] 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): picked mon.noname-f con 0x7f86c40a1530 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): picked mon.noname-c con 0x7f86c409f580 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): picked mon.noname-a con 0x7f86c409f980 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c406f0b0 con 0x7f86c409f980 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c406f390 con 0x7f86c40a1530 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c406f670 con 0x7f86c409f580 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): authenticate will time out at 1302.504209s 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c259c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f86c40a1530 0x7f86c409ee70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:46722/0 (socket says 172.21.15.171:46722) 2024-04-26T00:00:51.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c259c640 1 -- 172.21.15.171:0/2416798505 learned_addr learned my addr 172.21.15.171:0/2416798505 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2905728207 0 0) 0x7f86c406f390 con 0x7f86c40a1530 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient(hunting): my global_id is 144874 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86b0003530 con 0x7f86c40a1530 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1750029105 0 0) 0x7f86b0003530 con 0x7f86c40a1530 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 >> v1:172.21.15.106:6791/0 conn(0x7f86c409f580 legacy=0x7f86c413cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 >> v1:172.21.15.106:6789/0 conn(0x7f86c409f980 legacy=0x7f86c41402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: _finish_hunting 0 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 monclient: found mon.noname-f 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c40a1f00 con 0x7f86c40a1530 2024-04-26T00:00:51.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: _finish_auth 0 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: _check_auth_tickets 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f86ac0017c0 con 0x7f86c40a1530 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: dump: 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.786 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 5 monclient: authenticate success, global_id 144874 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86ac001aa0 con 0x7f86c40a1530 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 1 -- 172.21.15.171:0/2416798505 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f86ac004bf0 con 0x7f86c40a1530 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:51.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c159a640 10 monclient: dump: 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 4 set_mon_vals no callback set 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: shutdown 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- 172.21.15.171:0/2416798505 >> v1:172.21.15.171:6789/0 conn(0x7f86c40a1530 legacy=0x7f86c409ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- 172.21.15.171:0/2416798505 shutdown_connections 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- 172.21.15.171:0/2416798505 >> 172.21.15.171:0/2416798505 conn(0x7f86c40a2690 msgr2=0x7f86c40a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- 172.21.15.171:0/2416798505 shutdown_connections 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- 172.21.15.171:0/2416798505 wait complete. 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: build_initial_monmap 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: monmap: 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:51.790 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 Processor -- start 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- start start 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: init 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: _add_conns ranks=[1,8,3,4,5,7,0,2,6] 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): picked mon.noname-f con 0x7f86c409f580 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): picked mon.noname-e con 0x7f86c409f980 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): picked mon.noname-g con 0x7f86c40a1530 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c41cce20 con 0x7f86c409f580 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c4072d30 con 0x7f86c40a1530 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f86c4072800 con 0x7f86c409f980 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient(hunting): authenticate will time out at 1302.506986s 2024-04-26T00:00:51.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c259c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f86c409f580 0x7f86c41cc000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:46732/0 (socket says 172.21.15.171:46732) 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c259c640 1 -- 172.21.15.171:0/1068381268 learned_addr learned my addr 172.21.15.171:0/1068381268 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c1d9b640 1 -- 172.21.15.171:0/1068381268 >> v1:172.21.15.106:6793/0 conn(0x7f86c409f980 legacy=0x7f86c41cc710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 650840319 0 0) 0x7f86c4072d30 con 0x7f86c40a1530 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): my global_id is 6645 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86a4003530 con 0x7f86c40a1530 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2765993655 0 0) 0x7f86c41cce20 con 0x7f86c409f580 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): my global_id is 144883 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f86c4072d30 con 0x7f86c409f580 2024-04-26T00:00:51.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3939543219 0 0) 0x7f86a4003530 con 0x7f86c40a1530 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86c41cce20 con 0x7f86c40a1530 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f86b4001910 con 0x7f86c40a1530 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): dump: 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.793 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3165288295 0 0) 0x7f86c4072d30 con 0x7f86c409f580 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f86a4003530 con 0x7f86c409f580 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f86ac001820 con 0x7f86c409f580 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient(hunting): dump: 2024-04-26T00:00:51.794 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2786649573 0 0) 0x7f86c41cce20 con 0x7f86c40a1530 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 >> v1:172.21.15.106:6793/0 conn(0x7f86c409f980 legacy=0x7f86c41cc710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 >> v1:172.21.15.171:6789/0 conn(0x7f86c409f580 legacy=0x7f86c41cc000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 monclient: found mon.g 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86c413bb30 con 0x7f86c40a1530 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 5 monclient: authenticate success, global_id 6645 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: _renew_subs 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f86c413a0f0 con 0x7f86c40a1530 2024-04-26T00:00:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f86b4001d20 con 0x7f86c40a1530 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f86b4003c10 con 0x7f86c40a1530 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86baffd640 10 monclient: dump: 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.795+0000 7f86c0d99640 4 set_mon_vals no callback set 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c8c08640 10 monclient: _renew_subs 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c8c08640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f86c4134890 con 0x7f86c40a1530 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f86b4003e30 con 0x7f86c40a1530 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(191..191 src has 29..191) ==== 9415+0+0 (unknown 4187354258 0 0) 0x7f86b4044a20 con 0x7f86c40a1530 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c259c640 10 monclient: get_auth_request con 0x7f86a4037d90 auth_method 0 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c8c08640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c8c08640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c8c08640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.799+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86c404f5b0 con 0x7f86c40a1530 2024-04-26T00:00:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.803+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f86b40145a0 con 0x7f86c40a1530 2024-04-26T00:00:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.803+0000 7f86baffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.803+0000 7f86baffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.959+0000 7f86c8c08640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.959+0000 7f86c8c08640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.959+0000 7f86c8c08640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:51.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:51.959+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f86c4134b20 con 0x7f86c40a1530 2024-04-26T00:00:52.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.571+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}]=0 added bucket h12 type host to location {rack=r1} v192) ==== 168+0+0 (unknown 1401516490 0 0) 0x7f86b4013ea0 con 0x7f86c40a1530 2024-04-26T00:00:52.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.571+0000 7f86baffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:52.555 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.571+0000 7f86baffd640 10 monclient: _finish_command 2 = system:0 added bucket h12 type host to location {rack=r1} 2024-04-26T00:00:52.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.675+0000 7f86c8c08640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:52.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.675+0000 7f86c8c08640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:52.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.675+0000 7f86c8c08640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:52.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.675+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f86c4130d30 con 0x7f86c40a1530 2024-04-26T00:00:52.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.675+0000 7f86baffd640 1 -- 172.21.15.171:0/1068381268 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h12' already exists v192) ==== 147+0+0 (unknown 4191621646 0 0) 0x7f86b4018250 con 0x7f86c40a1530 2024-04-26T00:00:52.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.675+0000 7f86baffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h12", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:52.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.675+0000 7f86baffd640 10 monclient: _finish_command 3 = system:0 bucket 'h12' already exists 2024-04-26T00:00:52.659 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h12' already exists 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 >> v1:172.21.15.171:6812/722422047 conn(0x7f86a4037d90 legacy=0x7f86a403a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 10 monclient: shutdown 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 >> v1:172.21.15.171:6790/0 conn(0x7f86c40a1530 legacy=0x7f86c41d4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 shutdown_connections 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 >> 172.21.15.171:0/1068381268 conn(0x7f86c40a2690 msgr2=0x7f86c4137440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 shutdown_connections 2024-04-26T00:00:52.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.679+0000 7f86c8c08640 1 -- 172.21.15.171:0/1068381268 wait complete. 2024-04-26T00:00:52.675 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:52.676 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h13 host rack=r1 2024-04-26T00:00:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.811+0000 7f668ee9e640 10 monclient: get_monmap_and_config 2024-04-26T00:00:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.811+0000 7f668ee9e640 10 monclient: build_initial_monmap 2024-04-26T00:00:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.811+0000 7f668ee9e640 10 monclient: monmap: 2024-04-26T00:00:52.796 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:52.818330+0000 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:52.818330+0000 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:52.797 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 Processor -- start 2024-04-26T00:00:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- start start 2024-04-26T00:00:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: init 2024-04-26T00:00:52.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: _add_conns ranks=[8,3,4,2,1,7,0,5,6] 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient(hunting): picked mon.noname-e con 0x7f6688137960 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient(hunting): picked mon.noname-g con 0x7f66880a4220 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient(hunting): picked mon.noname-c con 0x7f6688138450 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66880a48c0 con 0x7f66880a4220 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66880a2f70 con 0x7f6688138450 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66880a0d00 con 0x7f6688137960 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient(hunting): authenticate will time out at 1303.525224s 2024-04-26T00:00:52.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f6687fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f66880a4220 0x7f668813ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58702/0 (socket says 172.21.15.171:58702) 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f6687fff640 1 -- 172.21.15.171:0/1574333553 learned_addr learned my addr 172.21.15.171:0/1574333553 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668cc3a640 1 -- 172.21.15.171:0/1574333553 >> v1:172.21.15.106:6793/0 conn(0x7f6688137960 legacy=0x7f6688137d40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116397394 0 0) 0x7f66880a48c0 con 0x7f66880a4220 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient(hunting): my global_id is 6654 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6670003530 con 0x7f66880a4220 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2982521138 0 0) 0x7f6670003530 con 0x7f66880a4220 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 >> v1:172.21.15.106:6793/0 conn(0x7f6688137960 legacy=0x7f6688137d40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 >> v1:172.21.15.106:6791/0 conn(0x7f6688138450 legacy=0x7f66881405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:52.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 monclient: found mon.noname-g 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66880a29b0 con 0x7f66880a4220 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f667c0017c0 con 0x7f66880a4220 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 5 monclient: authenticate success, global_id 6654 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: dump: 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:52.806 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:52.807 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f667c001ab0 con 0x7f66880a4220 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 1 -- 172.21.15.171:0/1574333553 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f667c004bf0 con 0x7f66880a4220 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f66877fe640 10 monclient: dump: 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:52.808 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 4 set_mon_vals no callback set 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: shutdown 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:52.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- 172.21.15.171:0/1574333553 >> v1:172.21.15.171:6790/0 conn(0x7f66880a4220 legacy=0x7f668813ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- 172.21.15.171:0/1574333553 shutdown_connections 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- 172.21.15.171:0/1574333553 >> 172.21.15.171:0/1574333553 conn(0x7f66880a9fc0 msgr2=0x7f66880aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- 172.21.15.171:0/1574333553 shutdown_connections 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- 172.21.15.171:0/1574333553 wait complete. 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: build_initial_monmap 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: monmap: 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:52.810 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 Processor -- start 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 1 -- start start 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.815+0000 7f668ee9e640 10 monclient: init 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:52.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _add_conns ranks=[8,7,2,6,1,3,0,5,4] 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient(hunting): picked mon.noname-e con 0x7f66880a4220 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient(hunting): picked mon.noname-i con 0x7f6688137960 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient(hunting): picked mon.noname-b con 0x7f6688138450 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66880a0fa0 con 0x7f6688138450 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6688122400 con 0x7f6688137960 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66881246f0 con 0x7f66880a4220 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient(hunting): authenticate will time out at 1303.528443s 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668cc3a640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f66880a4220 legacy=0x7f6688136d30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f6687fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f6688137960 0x7f66881d1690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:39082/0 (socket says 172.21.15.171:39082) 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f6687fff640 1 -- 172.21.15.171:0/2245850815 learned_addr learned my addr 172.21.15.171:0/2245850815 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3524602870 0 0) 0x7f6688122400 con 0x7f6688137960 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:52.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): my global_id is 144745 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6674003530 con 0x7f6688137960 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 480644969 0 0) 0x7f6674003530 con 0x7f6688137960 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6688122400 con 0x7f6688137960 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f667c001780 con 0x7f6688137960 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): dump: 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:52.813 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966947970 0 0) 0x7f66880a0fa0 con 0x7f6688138450 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:52.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient(hunting): my global_id is 6338 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6674003530 con 0x7f6688138450 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1530393458 0 0) 0x7f6688122400 con 0x7f6688137960 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 >> v1:172.21.15.106:6793/0 conn(0x7f66880a4220 legacy=0x7f6688136d30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 >> v1:172.21.15.106:6790/0 conn(0x7f6688138450 legacy=0x7f66881d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 monclient: found mon.i 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6688123e50 con 0x7f6688137960 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:52.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 5 monclient: authenticate success, global_id 144745 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _renew_subs 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6688123180 con 0x7f6688137960 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _renew_subs 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6688137440 con 0x7f6688137960 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f667c001180 con 0x7f6688137960 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f667c0051b0 con 0x7f6688137960 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f6686ffd640 4 set_mon_vals no callback set 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 10 monclient: dump: 2024-04-26T00:00:52.816 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:52.817 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f667c00ff50 con 0x7f6688137960 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(192..192 src has 29..192) ==== 9628+0+0 (unknown 3825424311 0 0) 0x7f667c045e80 con 0x7f6688137960 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6668005090 con 0x7f6688137960 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.819+0000 7f668cc3a640 10 monclient: get_auth_request con 0x7f6674037800 auth_method 0 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.823+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f667c0159b0 con 0x7f6688137960 2024-04-26T00:00:52.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.823+0000 7f66857fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:52.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.823+0000 7f66857fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:52.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.987+0000 7f668ee9e640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:52.972 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.987+0000 7f668ee9e640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:52.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.987+0000 7f668ee9e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:52.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:52.987+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f6668005380 con 0x7f6688137960 2024-04-26T00:00:53.156 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-26T00:00:53.156 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-04-26T00:00:53.156 INFO:tasks.ceph.mon.e:Restarting daemon 2024-04-26T00:00:53.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-04-26T00:00:53.159 INFO:tasks.ceph.mon.e:Started 2024-04-26T00:00:53.159 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:00:53.160 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient: get_monmap_and_config 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient: monmap: 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:53.312663+0000 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:53.312663+0000 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.290 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.291 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 1 Processor -- start 2024-04-26T00:00:53.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 1 -- start start 2024-04-26T00:00:53.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient: init 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient: _add_conns ranks=[2,1,5,6,0,8,4,7,3] 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient(hunting): picked mon.noname-b con 0x7f99b40a1290 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient(hunting): picked mon.noname-f con 0x7f99b409f770 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient(hunting): picked mon.noname-h con 0x7f99b409fb70 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b40727a0 con 0x7f99b409f770 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b40724c0 con 0x7f99b40a1290 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b4072a80 con 0x7f99b409fb70 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99bb90d640 10 monclient(hunting): authenticate will time out at 1308.839618s 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99b96a9640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f99b40a1290 0x7f99b40a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59454/0 (socket says 172.21.15.106:59454) 2024-04-26T00:00:53.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.308+0000 7f99b96a9640 1 -- 172.21.15.106:0/97343331 learned_addr learned my addr 172.21.15.106:0/97343331 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2969465290 0 0) 0x7f99b40724c0 con 0x7f99b40a1290 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient(hunting): my global_id is 6347 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99a0003530 con 0x7f99b40a1290 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1076272664 0 0) 0x7f99a0003530 con 0x7f99b40a1290 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 >> v1:172.21.15.171:6791/0 conn(0x7f99b409fb70 legacy=0x7f99b413de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 >> v1:172.21.15.171:6789/0 conn(0x7f99b409f770 legacy=0x7f99b413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 monclient: found mon.noname-b 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b406bfc0 con 0x7f99b40a1290 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99b00017c0 con 0x7f99b40a1290 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 5 monclient: authenticate success, global_id 6347 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: dump: 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.311 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99b0001ab0 con 0x7f99b40a1290 2024-04-26T00:00:53.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 1 -- 172.21.15.106:0/97343331 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99b0004bf0 con 0x7f99b40a1290 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99abfff640 10 monclient: dump: 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.313 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.314 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.314 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.314 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.314 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:53.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 4 set_mon_vals no callback set 2024-04-26T00:00:53.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 10 monclient: shutdown 2024-04-26T00:00:53.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 1 -- 172.21.15.106:0/97343331 >> v1:172.21.15.106:6790/0 conn(0x7f99b40a1290 legacy=0x7f99b40a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 1 -- 172.21.15.106:0/97343331 shutdown_connections 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 1 -- 172.21.15.106:0/97343331 >> 172.21.15.106:0/97343331 conn(0x7f99b406b210 msgr2=0x7f99b406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 1 -- 172.21.15.106:0/97343331 shutdown_connections 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 1 -- 172.21.15.106:0/97343331 wait complete. 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.328+0000 7f99bb90d640 10 monclient: monmap: 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.316 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 1 Processor -- start 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 1 -- start start 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient: init 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient: _add_conns ranks=[6,4,0,3,5,8,2,7,1] 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient(hunting): picked mon.noname-d con 0x7f99b409f770 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient(hunting): picked mon.noname-c con 0x7f99b409fb70 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:53.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient(hunting): picked mon.noname-a con 0x7f99b40a1290 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:53.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b411f160 con 0x7f99b40a1290 2024-04-26T00:00:53.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b411f440 con 0x7f99b409fb70 2024-04-26T00:00:53.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99b4071860 con 0x7f99b409f770 2024-04-26T00:00:53.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99bb90d640 10 monclient(hunting): authenticate will time out at 1308.860796s 2024-04-26T00:00:53.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99b9eaa640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f99b40a1290 0x7f99b41d4ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60330/0 (socket says 172.21.15.106:60330) 2024-04-26T00:00:53.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.332+0000 7f99b9eaa640 1 -- 172.21.15.106:0/393730116 learned_addr learned my addr 172.21.15.106:0/393730116 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:53.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673845002 0 0) 0x7f99b411f440 con 0x7f99b409fb70 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): my global_id is 144958 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9998003530 con 0x7f99b409fb70 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347194957 0 0) 0x7f99b4071860 con 0x7f99b409f770 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): my global_id is 6414 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b411f440 con 0x7f99b409f770 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 206576336 0 0) 0x7f9998003530 con 0x7f99b409fb70 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9998003b50 con 0x7f99b409fb70 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99a4001990 con 0x7f99b409fb70 2024-04-26T00:00:53.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.322 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2389426372 0 0) 0x7f99b411f440 con 0x7f99b409f770 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9998003530 con 0x7f99b409f770 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99b0001780 con 0x7f99b409f770 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.323 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558985458 0 0) 0x7f99b411f160 con 0x7f99b40a1290 2024-04-26T00:00:53.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient(hunting): my global_id is 6525 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f99b411f440 con 0x7f99b40a1290 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1831440918 0 0) 0x7f9998003b50 con 0x7f99b409fb70 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 >> v1:172.21.15.106:6792/0 conn(0x7f99b409f770 legacy=0x7f99b41ccb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 >> v1:172.21.15.106:6789/0 conn(0x7f99b40a1290 legacy=0x7f99b41d4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 monclient: found mon.c 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99b40a1f00 con 0x7f99b409fb70 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 5 monclient: authenticate success, global_id 144958 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 10 monclient: _renew_subs 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f99b411f720 con 0x7f99b409fb70 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 10 monclient: _renew_subs 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f99b41c44d0 con 0x7f99b409fb70 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f99a4003950 con 0x7f99b409fb70 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99a4001d50 con 0x7f99b409fb70 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99ab7fe640 4 set_mon_vals no callback set 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 10 monclient: dump: 2024-04-26T00:00:53.326 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.327 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f99a4003ec0 con 0x7f99b409fb70 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(192..192 src has 29..192) ==== 9628+0+0 (unknown 3825424311 0 0) 0x7f99a4044ab0 con 0x7f99b409fb70 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9994005090 con 0x7f99b409fb70 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.336+0000 7f99b96a9640 10 monclient: get_auth_request con 0x7f9998038110 auth_method 0 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.340+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f99b40727a0 con 0x7f99b409fb70 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.340+0000 7f99a9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.340+0000 7f99a9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:53.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.556+0000 7f99bb90d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:00:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.556+0000 7f99bb90d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:00:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.556+0000 7f99bb90d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.556+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9994005380 con 0x7f99b409fb70 2024-04-26T00:00:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.556+0000 7f99a9ffb640 1 -- 172.21.15.106:0/393730116 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2778220486) 0x7f99a40145e0 con 0x7f99b409fb70 2024-04-26T00:00:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.556+0000 7f99a9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:00:53.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.556+0000 7f99a9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:53.540 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":40,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:00:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 >> v1:172.21.15.171:6812/722422047 conn(0x7f9998038110 legacy=0x7f999803a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 10 monclient: shutdown 2024-04-26T00:00:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 >> v1:172.21.15.106:6791/0 conn(0x7f99b409fb70 legacy=0x7f99b41d1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 shutdown_connections 2024-04-26T00:00:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 >> 172.21.15.106:0/393730116 conn(0x7f99b406b210 msgr2=0x7f99b40a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 shutdown_connections 2024-04-26T00:00:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.560+0000 7f99bb90d640 1 -- 172.21.15.106:0/393730116 wait complete. 2024-04-26T00:00:53.559 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:00:53.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:00:53.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:00:53.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.575+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}]=0 added bucket h13 type host to location {rack=r1} v193) ==== 168+0+0 (unknown 798749751 0 0) 0x7f667c01de60 con 0x7f6688137960 2024-04-26T00:00:53.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.575+0000 7f66857fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:53.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.575+0000 7f66857fa640 10 monclient: _finish_command 2 = system:0 added bucket h13 type host to location {rack=r1} 2024-04-26T00:00:53.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.679+0000 7f668ee9e640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:53.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.679+0000 7f668ee9e640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:53.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.679+0000 7f668ee9e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:53.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.679+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f6668005ac0 con 0x7f6688137960 2024-04-26T00:00:53.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f66857fa640 1 -- 172.21.15.171:0/2245850815 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h13' already exists v193) ==== 147+0+0 (unknown 4066446307 0 0) 0x7f667c043500 con 0x7f6688137960 2024-04-26T00:00:53.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f66857fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h13", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:53.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f66857fa640 10 monclient: _finish_command 3 = system:0 bucket 'h13' already exists 2024-04-26T00:00:53.665 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h13' already exists 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 >> v1:172.21.15.171:6812/722422047 conn(0x7f6674037800 legacy=0x7f6674039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 10 monclient: shutdown 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 >> v1:172.21.15.171:6792/0 conn(0x7f6688137960 legacy=0x7f66881d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 shutdown_connections 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 >> 172.21.15.171:0/2245850815 conn(0x7f66880a9fc0 msgr2=0x7f66880a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 shutdown_connections 2024-04-26T00:00:53.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.683+0000 7f668ee9e640 1 -- 172.21.15.171:0/2245850815 wait complete. 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: get_monmap_and_config 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: monmap: 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:53.702832+0000 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:53.702832+0000 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.681 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.686 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:53.687 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h14 host rack=r1 2024-04-26T00:00:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 Processor -- start 2024-04-26T00:00:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- start start 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: init 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: _add_conns ranks=[5,7,6,4,0,2,1,3,8] 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient(hunting): picked mon.noname-h con 0x7fc7dc135870 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient(hunting): picked mon.noname-i con 0x7fc7dc1353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient(hunting): picked mon.noname-d con 0x7fc7dc13bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc06f2d0 con 0x7fc7dc135870 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc072330 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc072610 con 0x7fc7dc1353b0 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient(hunting): authenticate will time out at 1309.230026s 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e1649640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc7dc13bdf0 0x7fc7dc13e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:54770/0 (socket says 172.21.15.106:54770) 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e1649640 1 -- 172.21.15.106:0/1338827029 learned_addr learned my addr 172.21.15.106:0/1338827029 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7229002 0 0) 0x7fc7dc072330 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): my global_id is 6423 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7c8003530 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479991402 0 0) 0x7fc7dc072610 con 0x7fc7dc1353b0 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): my global_id is 144754 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7dc072330 con 0x7fc7dc1353b0 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363270579 0 0) 0x7fc7dc06f2d0 con 0x7fc7dc135870 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient(hunting): my global_id is 6314 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7dc072610 con 0x7fc7dc135870 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2776497533 0 0) 0x7fc7c8003530 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 >> v1:172.21.15.171:6792/0 conn(0x7fc7dc1353b0 legacy=0x7fc7dc13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 >> v1:172.21.15.171:6791/0 conn(0x7fc7dc135870 legacy=0x7fc7dc135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 monclient: found mon.noname-d 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc0a3260 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7c40017c0 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 5 monclient: authenticate success, global_id 6423 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: dump: 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7c4001ae0 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 4 set_mon_vals no callback set 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 1 -- 172.21.15.106:0/1338827029 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7c4004bf0 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7db7fe640 10 monclient: dump: 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 10 monclient: shutdown 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1338827029 >> v1:172.21.15.106:6792/0 conn(0x7fc7dc13bdf0 legacy=0x7fc7dc13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1338827029 shutdown_connections 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1338827029 >> 172.21.15.106:0/1338827029 conn(0x7fc7dc0a64e0 msgr2=0x7fc7dc0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1338827029 shutdown_connections 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.700+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1338827029 wait complete. 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: monmap: 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 Processor -- start 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 -- start start 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: init 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: _add_conns ranks=[5,6,8,0,2,7,1,3,4] 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient(hunting): picked mon.noname-h con 0x7fc7dc1353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient(hunting): picked mon.noname-d con 0x7fc7dc135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient(hunting): picked mon.noname-e con 0x7fc7dc13bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc0700c0 con 0x7fc7dc1353b0 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc0703a0 con 0x7fc7dc135870 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7dc06f4f0 con 0x7fc7dc13bdf0 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient(hunting): authenticate will time out at 1309.232879s 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7dbfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc7dc135870 0x7fc7dc1d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:54780/0 (socket says 172.21.15.106:54780) 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7dbfff640 1 -- 172.21.15.106:0/1788719637 learned_addr learned my addr 172.21.15.106:0/1788719637 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043913252 0 0) 0x7fc7dc0703a0 con 0x7fc7dc135870 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): my global_id is 6432 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7bc003530 con 0x7fc7dc135870 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3079787915 0 0) 0x7fc7dc0700c0 con 0x7fc7dc1353b0 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): my global_id is 6323 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7dc0703a0 con 0x7fc7dc1353b0 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1258142524 0 0) 0x7fc7bc003530 con 0x7fc7dc135870 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7dc0700c0 con 0x7fc7dc135870 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7cc001e20 con 0x7fc7dc135870 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): dump: 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2007238560 0 0) 0x7fc7dc0703a0 con 0x7fc7dc1353b0 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7bc003530 con 0x7fc7dc1353b0 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7d4001a60 con 0x7fc7dc1353b0 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient(hunting): dump: 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3395404109 0 0) 0x7fc7dc0700c0 con 0x7fc7dc135870 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.106:6793/0 conn(0x7fc7dc13bdf0 legacy=0x7fc7dc1d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.171:6791/0 conn(0x7fc7dc1353b0 legacy=0x7fc7dc12b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 monclient: found mon.d 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7dc06fc90 con 0x7fc7dc135870 2024-04-26T00:00:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 5 monclient: authenticate success, global_id 6432 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: _renew_subs 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc7dc09d9e0 con 0x7fc7dc135870 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: _renew_subs 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7dc12bb90 con 0x7fc7dc135870 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7cc003c50 con 0x7fc7dc135870 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7cc0041c0 con 0x7fc7dc135870 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:53.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 10 monclient: dump: 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.704 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7daffd640 4 set_mon_vals no callback set 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc7c00065d0 con 0x7fc7c0002870 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc7cc0043e0 con 0x7fc7dc135870 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(193..193 src has 29..193) ==== 9841+0+0 (unknown 3055653133 0 0) 0x7fc7cc046070 con 0x7fc7dc135870 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.704+0000 7fc7e1649640 10 monclient: get_auth_request con 0x7fc7bc037cb0 auth_method 0 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039887668 0 0) 0x7fc7c00065d0 con 0x7fc7c0002870 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient(hunting): my global_id is 6534 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7dc0700c0 con 0x7fc7c0002870 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1317046661 0 0) 0x7fc7dc0700c0 con 0x7fc7c0002870 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7c00065d0 con 0x7fc7c0002870 2024-04-26T00:00:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7d4003b50 con 0x7fc7c0002870 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient: dump: 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 937602545 0 0) 0x7fc7c00065d0 con 0x7fc7c0002870 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc7c000a160 con 0x7fc7c0002870 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc7d4003dc0 con 0x7fc7c0002870 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.106:6789/0 conn(0x7fc7c0002870 legacy=0x7fc7c0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.708+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.106:6789/0 conn(0x7fc7c0002870 legacy=0x7fc7c0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc7c0009e50 con 0x7fc7c0009110 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1588483292 0 0) 0x7fc7c0009e50 con 0x7fc7c0009110 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient(hunting): my global_id is 6543 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7c00065d0 con 0x7fc7c0009110 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4146945362 0 0) 0x7fc7c00065d0 con 0x7fc7c0009110 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7c0009e50 con 0x7fc7c0009110 2024-04-26T00:00:53.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7d4004650 con 0x7fc7c0009110 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient: dump: 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.710 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1514744662 0 0) 0x7fc7c0009e50 con 0x7fc7c0009110 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc7c000c3e0 con 0x7fc7c0009110 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 307655550) 0x7fc7d4006980 con 0x7fc7c0009110 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.106:6789/0 conn(0x7fc7c0009110 legacy=0x7fc7c00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7d97fa640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.106:6789/0 conn(0x7fc7c0009110 legacy=0x7fc7c00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 372275, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:53.723 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.724 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:53.725 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:53.727 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.728 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:53.729 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.171:6812/722422047 conn(0x7fc7bc037cb0 legacy=0x7fc7bc03a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 10 monclient: shutdown 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 >> v1:172.21.15.106:6792/0 conn(0x7fc7dc135870 legacy=0x7fc7dc1d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e1649640 1 -- 172.21.15.106:0/1788719637 reap_dead start 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e1649640 1 -- 172.21.15.106:0/1788719637 reap_dead start 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 shutdown_connections 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 >> 172.21.15.106:0/1788719637 conn(0x7fc7dc0a64e0 msgr2=0x7fc7dc12e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 shutdown_connections 2024-04-26T00:00:53.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.716+0000 7fc7e30ac640 1 -- 172.21.15.106:0/1788719637 wait complete. 2024-04-26T00:00:53.732 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:53.732 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:00:53.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient: get_monmap_and_config 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient: monmap: 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:53.819964+0000 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:53.819964+0000 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.798 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.799 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 1 Processor -- start 2024-04-26T00:00:53.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 1 -- start start 2024-04-26T00:00:53.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient: init 2024-04-26T00:00:53.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient: _add_conns ranks=[8,1,5,3,0,2,7,4,6] 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient(hunting): picked mon.noname-e con 0x7f44d80a1340 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient(hunting): picked mon.noname-f con 0x7f44d80a1720 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient(hunting): picked mon.noname-h con 0x7f44d80a1b60 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d8136320 con 0x7f44d80a1720 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d8072a00 con 0x7f44d80a1b60 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d8072440 con 0x7f44d80a1340 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44dc91f640 10 monclient(hunting): authenticate will time out at 1304.527764s 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44cdd9b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f44d80a1720 0x7f44d813a870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:46742/0 (socket says 172.21.15.171:46742) 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44d6d9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f44d80a1b60 0x7f44d813dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47532/0 (socket says 172.21.15.171:47532) 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.815+0000 7f44cdd9b640 1 -- 172.21.15.171:0/3174625500 learned_addr learned my addr 172.21.15.171:0/3174625500 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2713262079 0 0) 0x7f44d8136320 con 0x7f44d80a1720 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): my global_id is 144892 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44c4003530 con 0x7f44d80a1720 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3572915482 0 0) 0x7f44d8072a00 con 0x7f44d80a1b60 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): my global_id is 6332 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d8136320 con 0x7f44d80a1b60 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4077958650 0 0) 0x7f44d8072440 con 0x7f44d80a1340 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient(hunting): my global_id is 204110 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d8072a00 con 0x7f44d80a1340 2024-04-26T00:00:53.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 940934398 0 0) 0x7f44d8136320 con 0x7f44d80a1b60 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 >> v1:172.21.15.106:6793/0 conn(0x7f44d80a1340 legacy=0x7f44d8135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 >> v1:172.21.15.171:6789/0 conn(0x7f44d80a1720 legacy=0x7f44d813a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 monclient: found mon.noname-h 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d8072720 con 0x7f44d80a1b60 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f44d0001b20 con 0x7f44d80a1b60 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:53.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: dump: 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.810 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 5 monclient: authenticate success, global_id 6332 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44d0001d90 con 0x7f44d80a1b60 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 1 -- 172.21.15.171:0/3174625500 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f44d0004eb0 con 0x7f44d80a1b60 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d5d9b640 10 monclient: dump: 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.811 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 4 set_mon_vals no callback set 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: shutdown 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/3174625500 >> v1:172.21.15.171:6791/0 conn(0x7f44d80a1b60 legacy=0x7f44d813dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/3174625500 shutdown_connections 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/3174625500 >> 172.21.15.171:0/3174625500 conn(0x7f44d80a8400 msgr2=0x7f44d80a4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/3174625500 shutdown_connections 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/3174625500 wait complete. 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: monmap: 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.813 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 Processor -- start 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- start start 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: init 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: _add_conns ranks=[5,4,3,0,2,1,6,7,8] 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient(hunting): picked mon.noname-h con 0x7f44d80a1340 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:53.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient(hunting): picked mon.noname-c con 0x7f44d80a1720 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient(hunting): picked mon.noname-g con 0x7f44d80a1b60 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d8071870 con 0x7f44d80a1b60 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d80a2070 con 0x7f44d80a1720 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44d806ede0 con 0x7f44d80a1340 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient(hunting): authenticate will time out at 1304.530893s 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d659c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f44d80a1340 0x7f44d8134b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47540/0 (socket says 172.21.15.171:47540) 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d659c640 1 -- 172.21.15.171:0/1618444977 learned_addr learned my addr 172.21.15.171:0/1618444977 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2653729506 0 0) 0x7f44d8071870 con 0x7f44d80a1b60 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): my global_id is 6663 2024-04-26T00:00:53.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44b8003530 con 0x7f44d80a1b60 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010481490 0 0) 0x7f44d806ede0 con 0x7f44d80a1340 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): my global_id is 6341 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d8071870 con 0x7f44d80a1340 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465828444 0 0) 0x7f44d80a2070 con 0x7f44d80a1720 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): my global_id is 144967 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44d806ede0 con 0x7f44d80a1720 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1973665663 0 0) 0x7f44b8003530 con 0x7f44d80a1b60 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44d80a2070 con 0x7f44d80a1b60 2024-04-26T00:00:53.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f44d0001a20 con 0x7f44d80a1b60 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): dump: 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.817 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1414597707 0 0) 0x7f44d8071870 con 0x7f44d80a1340 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44b8003530 con 0x7f44d80a1340 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f44c8001b20 con 0x7f44d80a1340 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): dump: 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.818 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1291373259 0 0) 0x7f44d806ede0 con 0x7f44d80a1720 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44d8071870 con 0x7f44d80a1720 2024-04-26T00:00:53.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f44c0001410 con 0x7f44d80a1720 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient(hunting): dump: 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.820 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1217823502 0 0) 0x7f44d80a2070 con 0x7f44d80a1b60 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 >> v1:172.21.15.171:6791/0 conn(0x7f44d80a1340 legacy=0x7f44d8134b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 >> v1:172.21.15.106:6791/0 conn(0x7f44d80a1720 legacy=0x7f44d81d12f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 monclient: found mon.g 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44d8124520 con 0x7f44d80a1b60 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 5 monclient: authenticate success, global_id 6663 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: _renew_subs 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44d8135230 con 0x7f44d80a1b60 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: _renew_subs 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f44d8123130 con 0x7f44d80a1b60 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44d0001d90 con 0x7f44d80a1b60 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f44d0005460 con 0x7f44d80a1b60 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44d559a640 4 set_mon_vals no callback set 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.819+0000 7f44cf7fe640 10 monclient: dump: 2024-04-26T00:00:53.822 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.823 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.823+0000 7f44dc91f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.823+0000 7f44dc91f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.823+0000 7f44dc91f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.823+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44bc005090 con 0x7f44d80a1b60 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.823+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f44d0010200 con 0x7f44d80a1b60 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.823+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(193..193 src has 29..193) ==== 9841+0+0 (unknown 3055653133 0 0) 0x7f44d0046070 con 0x7f44d80a1b60 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.823+0000 7f44d659c640 10 monclient: get_auth_request con 0x7f44b8038140 auth_method 0 2024-04-26T00:00:53.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.827+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f44d0015a90 con 0x7f44d80a1b60 2024-04-26T00:00:53.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.827+0000 7f44cf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.827+0000 7f44cf7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: get_monmap_and_config 2024-04-26T00:00:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: monmap: 2024-04-26T00:00:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:53.859322+0000 2024-04-26T00:00:53.836 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:53.859322+0000 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.837 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 Processor -- start 2024-04-26T00:00:53.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- start start 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: init 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: _add_conns ranks=[4,7,8,3,1,5,6,0,2] 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient(hunting): picked mon.noname-c con 0x7f762c134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient(hunting): picked mon.noname-i con 0x7f762c0a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient(hunting): picked mon.noname-e con 0x7f762c13e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c06dd40 con 0x7f762c134970 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c0a2b10 con 0x7f762c0a4820 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c0a2df0 con 0x7f762c13e200 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient(hunting): authenticate will time out at 1309.386162s 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f763218b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f762c134970 0x7f762c134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47590/0 (socket says 172.21.15.106:47590) 2024-04-26T00:00:53.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f763218b640 1 -- 172.21.15.106:0/380237300 learned_addr learned my addr 172.21.15.106:0/380237300 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f763298c640 1 --1- 172.21.15.106:0/380237300 >> v1:172.21.15.106:6793/0 conn(0x7f762c13e200 0x7f762c1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:47168/0 (socket says 172.21.15.106:47168) 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396727499 0 0) 0x7f762c0a2df0 con 0x7f762c13e200 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): my global_id is 204119 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7618003530 con 0x7f762c13e200 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2668048615 0 0) 0x7f762c06dd40 con 0x7f762c134970 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): my global_id is 144976 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f762c0a2df0 con 0x7f762c134970 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125642772 0 0) 0x7f762c0a2b10 con 0x7f762c0a4820 2024-04-26T00:00:53.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient(hunting): my global_id is 144763 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f762c06dd40 con 0x7f762c0a4820 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1285460747 0 0) 0x7f762c0a2df0 con 0x7f762c134970 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 >> v1:172.21.15.106:6793/0 conn(0x7f762c13e200 legacy=0x7f762c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 >> v1:172.21.15.171:6792/0 conn(0x7f762c0a4820 legacy=0x7f762c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 monclient: found mon.noname-c 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c0a30d0 con 0x7f762c134970 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76280017a0 con 0x7f762c134970 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 5 monclient: authenticate success, global_id 144976 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: dump: 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.849 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7628001a00 con 0x7f762c134970 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 1 -- 172.21.15.106:0/380237300 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7628004bf0 con 0x7f762c134970 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 4 set_mon_vals no callback set 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f7631189640 10 monclient: dump: 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 10 monclient: shutdown 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- 172.21.15.106:0/380237300 >> v1:172.21.15.106:6791/0 conn(0x7f762c134970 legacy=0x7f762c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- 172.21.15.106:0/380237300 shutdown_connections 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- 172.21.15.106:0/380237300 >> 172.21.15.106:0/380237300 conn(0x7f762c0a9e20 msgr2=0x7f762c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- 172.21.15.106:0/380237300 shutdown_connections 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.856+0000 7f76343ef640 1 -- 172.21.15.106:0/380237300 wait complete. 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: monmap: 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 Processor -- start 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 -- start start 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: init 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: _add_conns ranks=[8,1,4,0,3,5,2,6,7] 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient(hunting): picked mon.noname-e con 0x7f762c0a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient(hunting): picked mon.noname-f con 0x7f762c134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient(hunting): picked mon.noname-c con 0x7f762c13e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c1332c0 con 0x7f762c134970 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c138260 con 0x7f762c13e200 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f762c132e20 con 0x7f762c0a4820 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient(hunting): authenticate will time out at 1309.389010s 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f763218b640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f762c0a4820 0x7f762c132000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:47180/0 (socket says 172.21.15.106:47180) 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f763218b640 1 -- 172.21.15.106:0/3767116506 learned_addr learned my addr 172.21.15.106:0/3767116506 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019773760 0 0) 0x7f762c132e20 con 0x7f762c0a4820 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): my global_id is 204128 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7610003530 con 0x7f762c0a4820 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2081137820 0 0) 0x7f762c138260 con 0x7f762c13e200 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): my global_id is 144985 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f762c132e20 con 0x7f762c13e200 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3918771377 0 0) 0x7f762c1332c0 con 0x7f762c134970 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): my global_id is 144901 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f762c138260 con 0x7f762c134970 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1466118776 0 0) 0x7f7610003530 con 0x7f762c0a4820 2024-04-26T00:00:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f762c1332c0 con 0x7f762c0a4820 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1288286710 0 0) 0x7f762c132e20 con 0x7f762c13e200 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7610003530 con 0x7f762c13e200 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f76280016a0 con 0x7f762c0a4820 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7624001bc0 con 0x7f762c13e200 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 983678155 0 0) 0x7f7610003530 con 0x7f762c13e200 2024-04-26T00:00:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.106:6793/0 conn(0x7f762c0a4820 legacy=0x7f762c132000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.171:6789/0 conn(0x7f762c134970 legacy=0x7f762c132710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 monclient: found mon.c 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f762c13d700 con 0x7f762c13e200 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 5 monclient: authenticate success, global_id 144985 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: _renew_subs 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f762c138e70 con 0x7f762c13e200 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: _renew_subs 2024-04-26T00:00:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f762c137910 con 0x7f762c13e200 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7624004b70 con 0x7f762c13e200 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7624005060 con 0x7f762c13e200 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7630988640 4 set_mon_vals no callback set 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: dump: 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f76140065d0 con 0x7f7614002870 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f762400fe00 con 0x7f762c13e200 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(193..193 src has 29..193) ==== 9841+0+0 (unknown 3055653133 0 0) 0x7f7624045e80 con 0x7f762c13e200 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1010540034 0 0) 0x7f76140065d0 con 0x7f7614002870 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient(hunting): my global_id is 6356 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7610003530 con 0x7f7614002870 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f763198a640 10 monclient: get_auth_request con 0x7f7610037f20 auth_method 0 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3892831621 0 0) 0x7f7610003530 con 0x7f7614002870 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f76140065d0 con 0x7f7614002870 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7628001c70 con 0x7f7614002870 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: dump: 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1288182727 0 0) 0x7f76140065d0 con 0x7f7614002870 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f761400a160 con 0x7f7614002870 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f76280054f0 con 0x7f7614002870 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.106:6790/0 conn(0x7f7614002870 legacy=0x7f7614004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.860+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.106:6790/0 conn(0x7f7614002870 legacy=0x7f7614004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7614009e30 con 0x7f76140090f0 2024-04-26T00:00:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641627957 0 0) 0x7f7614009e30 con 0x7f76140090f0 2024-04-26T00:00:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient(hunting): my global_id is 6365 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76140065d0 con 0x7f76140090f0 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1423621856 0 0) 0x7f76140065d0 con 0x7f76140090f0 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7614009e30 con 0x7f76140090f0 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7628005bd0 con 0x7f76140090f0 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient: dump: 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3801350046 0 0) 0x7f7614009e30 con 0x7f76140090f0 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f761400c3a0 con 0x7f76140090f0 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1927344628) 0x7f7628005eb0 con 0x7f76140090f0 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.106:6790/0 conn(0x7f76140090f0 legacy=0x7f7614009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f7622ffd640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.106:6790/0 conn(0x7f76140090f0 legacy=0x7f7614009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 372431, 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:53.868 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:53.869 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:53.870 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:53.871 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:53.872 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:53.874 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:53.886 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.171:6812/722422047 conn(0x7f7610037f20 legacy=0x7f761003a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 10 monclient: shutdown 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 >> v1:172.21.15.106:6791/0 conn(0x7f762c13e200 legacy=0x7f762c1d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f763298c640 1 -- 172.21.15.106:0/3767116506 reap_dead start 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f763298c640 1 -- 172.21.15.106:0/3767116506 reap_dead start 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 shutdown_connections 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 >> 172.21.15.106:0/3767116506 conn(0x7f762c0a9e20 msgr2=0x7f762c134f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 shutdown_connections 2024-04-26T00:00:53.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:53.868+0000 7f76343ef640 1 -- 172.21.15.106:0/3767116506 wait complete. 2024-04-26T00:00:53.888 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:53.888 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:00:53.888 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:00:53.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.979+0000 7f44dc91f640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:53.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.979+0000 7f44dc91f640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:53.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.979+0000 7f44dc91f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:53.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:53.979+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f44bc005380 con 0x7f44d80a1b60 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: get_monmap_and_config 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: build_initial_monmap 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: monmap: 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:54.018926+0000 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:54.018926+0000 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:53.996 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:53.997 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 Processor -- start 2024-04-26T00:00:54.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- start start 2024-04-26T00:00:54.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: init 2024-04-26T00:00:54.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: _add_conns ranks=[4,7,5,1,8,2,0,3,6] 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient(hunting): picked mon.noname-c con 0x7f0224134760 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient(hunting): picked mon.noname-i con 0x7f02240a0d70 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient(hunting): picked mon.noname-h con 0x7f022413df70 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022406b910 con 0x7f0224134760 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f022409fac0 con 0x7f022413df70 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02240a0080 con 0x7f02240a0d70 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient(hunting): authenticate will time out at 1309.546034s 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022900a640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f0224134760 0x7f0224134b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47602/0 (socket says 172.21.15.106:47602) 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022900a640 1 -- 172.21.15.106:0/2962254693 learned_addr learned my addr 172.21.15.106:0/2962254693 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3991104270 0 0) 0x7f022406b910 con 0x7f0224134760 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient(hunting): my global_id is 144994 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0210003530 con 0x7f0224134760 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3354118294 0 0) 0x7f0210003530 con 0x7f0224134760 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 >> v1:172.21.15.171:6792/0 conn(0x7f02240a0d70 legacy=0x7f022413c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 >> v1:172.21.15.171:6791/0 conn(0x7f022413df70 legacy=0x7f0224140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 monclient: found mon.noname-c 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f022409f280 con 0x7f0224134760 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f021c001b40 con 0x7f0224134760 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: dump: 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 5 monclient: authenticate success, global_id 144994 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f021c001e30 con 0x7f0224134760 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 4 set_mon_vals no callback set 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 1 -- 172.21.15.106:0/2962254693 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f021c004f70 con 0x7f0224134760 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f0217fff640 10 monclient: dump: 2024-04-26T00:00:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.009 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: shutdown 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- 172.21.15.106:0/2962254693 >> v1:172.21.15.106:6791/0 conn(0x7f0224134760 legacy=0x7f0224134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- 172.21.15.106:0/2962254693 shutdown_connections 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- 172.21.15.106:0/2962254693 >> 172.21.15.106:0/2962254693 conn(0x7f02240a7240 msgr2=0x7f02240a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- 172.21.15.106:0/2962254693 shutdown_connections 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 1 -- 172.21.15.106:0/2962254693 wait complete. 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.016+0000 7f022b26e640 10 monclient: monmap: 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:54.010 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 Processor -- start 2024-04-26T00:00:54.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 -- start start 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient: init 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient: _add_conns ranks=[8,0,3,6,5,7,4,1,2] 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient(hunting): picked mon.noname-e con 0x7f02240a0d70 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient(hunting): picked mon.noname-a con 0x7f0224134760 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient(hunting): picked mon.noname-g con 0x7f022413df70 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0224072930 con 0x7f0224134760 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0224139380 con 0x7f022413df70 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0224072500 con 0x7f02240a0d70 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient(hunting): authenticate will time out at 1309.548809s 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022900a640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f02240a0d70 0x7f02241359d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:47196/0 (socket says 172.21.15.106:47196) 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022900a640 1 -- 172.21.15.106:0/845967696 learned_addr learned my addr 172.21.15.106:0/845967696 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3465554057 0 0) 0x7f02240a0080 con 0x7f0224134760 2024-04-26T00:00:54.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): my global_id is 6552 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0208003530 con 0x7f0224134760 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3808322215 0 0) 0x7f0224072500 con 0x7f02240a0d70 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): my global_id is 204137 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02240a0080 con 0x7f02240a0d70 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022900a640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6793/0 conn(0x7f02240a0d70 legacy=0x7f02241359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022900a640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6793/0 conn(0x7f02240a0d70 legacy=0x7f02241359d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022900a640 1 --1- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6793/0 conn(0x7f02240a0d70 0x7f02241359d0 :-1 s=OPENED pgs=79 cs=1 l=1).handle_message read tag failed 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022900a640 1 --1- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6793/0 conn(0x7f02240a0d70 0x7f02241359d0 :-1 s=OPENED pgs=79 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:00:54.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6793/0 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 256809648 0 0) 0x7f0208003530 con 0x7f0224134760 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0224072500 con 0x7f0224134760 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02180018d0 con 0x7f0224134760 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.014 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782056169 0 0) 0x7f0224139380 con 0x7f022413df70 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): my global_id is 6672 2024-04-26T00:00:54.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0208003530 con 0x7f022413df70 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3998502650 0 0) 0x7f0224072500 con 0x7f0224134760 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6793/0 conn(0x7f02240a0d70 legacy=0x7f02241359d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.171:6790/0 conn(0x7f022413df70 legacy=0x7f02241d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 monclient: found mon.a 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0224139660 con 0x7f0224134760 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 5 monclient: authenticate success, global_id 6552 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient: _renew_subs 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f022413cf30 con 0x7f0224134760 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient: _renew_subs 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f02241369c0 con 0x7f0224134760 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02180036a0 con 0x7f0224134760 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0218003b90 con 0x7f0224134760 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f02177fe640 4 set_mon_vals no callback set 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: dump: 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0218003d30 con 0x7f0224134760 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02040065d0 con 0x7f0204002870 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(193..193 src has 29..193) ==== 9841+0+0 (unknown 3055653133 0 0) 0x7f0218044a30 con 0x7f0224134760 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885993609 0 0) 0x7f02040065d0 con 0x7f0204002870 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient(hunting): my global_id is 145003 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0224072500 con 0x7f0204002870 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f022980b640 10 monclient: get_auth_request con 0x7f0208037a50 auth_method 0 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3270561678 0 0) 0x7f0224072500 con 0x7f0204002870 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02040065d0 con 0x7f0204002870 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f021c001b00 con 0x7f0204002870 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: dump: 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2290790755 0 0) 0x7f02040065d0 con 0x7f0204002870 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f020400a160 con 0x7f0204002870 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f021c0020b0 con 0x7f0204002870 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6791/0 conn(0x7f0204002870 legacy=0x7f0204004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.020+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6791/0 conn(0x7f0204002870 legacy=0x7f0204004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0204009e50 con 0x7f0204009110 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066447671 0 0) 0x7f0204009e50 con 0x7f0204009110 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient(hunting): my global_id is 145012 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02040065d0 con 0x7f0204009110 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 225879996 0 0) 0x7f02040065d0 con 0x7f0204009110 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0204009e50 con 0x7f0204009110 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f021c0055c0 con 0x7f0204009110 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient: dump: 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3687847550 0 0) 0x7f0204009e50 con 0x7f0204009110 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f020400c3e0 con 0x7f0204009110 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1088091170) 0x7f021c008730 con 0x7f0204009110 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6791/0 conn(0x7f0204009110 legacy=0x7f02040095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f0215ffb640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6791/0 conn(0x7f0204009110 legacy=0x7f02040095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:54.025 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 117558, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:54.026 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.027 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.028 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.029 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.030 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.031 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.032 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:54.035 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.037 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:54.044 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.171:6812/722422047 conn(0x7f0208037a50 legacy=0x7f0208039f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 10 monclient: shutdown 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 >> v1:172.21.15.106:6789/0 conn(0x7f0224134760 legacy=0x7f02241360e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022980b640 1 -- 172.21.15.106:0/845967696 reap_dead start 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022980b640 1 -- 172.21.15.106:0/845967696 reap_dead start 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 shutdown_connections 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 >> 172.21.15.106:0/845967696 conn(0x7f02240a7240 msgr2=0x7f02240a5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 shutdown_connections 2024-04-26T00:00:54.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.028+0000 7f022b26e640 1 -- 172.21.15.106:0/845967696 wait complete. 2024-04-26T00:00:54.047 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:54.047 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:00:54.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:00:54.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient: get_monmap_and_config 2024-04-26T00:00:54.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient: monmap: 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:54.179315+0000 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:54.179315+0000 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.157 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.158 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.158 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 1 Processor -- start 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 1 -- start start 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient: init 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient: _add_conns ranks=[2,4,0,7,5,8,6,3,1] 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient(hunting): picked mon.noname-b con 0x7fe7dc0a1c30 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient(hunting): picked mon.noname-c con 0x7fe7dc0a2010 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient(hunting): picked mon.noname-a con 0x7fe7dc13dc40 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7dc09c5b0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7dc09c2d0 con 0x7fe7dc0a1c30 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7dc0a3a70 con 0x7fe7dc0a2010 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient(hunting): authenticate will time out at 1309.706439s 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7dbfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fe7dc0a2010 0x7fe7dc0a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47636/0 (socket says 172.21.15.106:47636) 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7dbfff640 1 -- 172.21.15.106:0/3562961918 learned_addr learned my addr 172.21.15.106:0/3562961918 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e09b1640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fe7dc0a1c30 0x7fe7dc09aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59480/0 (socket says 172.21.15.106:59480) 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1525258943 0 0) 0x7fe7dc0a3a70 con 0x7fe7dc0a2010 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): my global_id is 145021 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7cc003530 con 0x7fe7dc0a2010 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3674254855 0 0) 0x7fe7dc09c2d0 con 0x7fe7dc0a1c30 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): my global_id is 6374 2024-04-26T00:00:54.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7dc0a3a70 con 0x7fe7dc0a1c30 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382290309 0 0) 0x7fe7d40014a0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient(hunting): my global_id is 6561 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7dc09c2d0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1576765475 0 0) 0x7fe7cc003530 con 0x7fe7dc0a2010 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 >> v1:172.21.15.106:6790/0 conn(0x7fe7dc0a1c30 legacy=0x7fe7dc09aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 >> v1:172.21.15.106:6789/0 conn(0x7fe7dc13dc40 legacy=0x7fe7dc140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 monclient: found mon.noname-c 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc144780 con 0x7fe7dc0a2010 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 5 monclient: authenticate success, global_id 145021 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7d00017c0 con 0x7fe7dc0a2010 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: dump: 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.169 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7d0001a60 con 0x7fe7dc0a2010 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7e2c15640 4 set_mon_vals no callback set 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 1 -- 172.21.15.106:0/3562961918 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7d0004bf0 con 0x7fe7dc0a2010 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.176+0000 7fe7db7fe640 10 monclient: dump: 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.171 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: shutdown 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3562961918 >> v1:172.21.15.106:6791/0 conn(0x7fe7dc0a2010 legacy=0x7fe7dc0a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3562961918 shutdown_connections 2024-04-26T00:00:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3562961918 >> 172.21.15.106:0/3562961918 conn(0x7fe7dc0a2d20 msgr2=0x7fe7dc0a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3562961918 shutdown_connections 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3562961918 wait complete. 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: monmap: 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 Processor -- start 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- start start 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: init 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: _add_conns ranks=[5,7,2,0,6,1,3,4,8] 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient(hunting): picked mon.noname-h con 0x7fe7dc0a1c30 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient(hunting): picked mon.noname-i con 0x7fe7dc0a2010 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient(hunting): picked mon.noname-b con 0x7fe7dc13dc40 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7dc1316b0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7dc12fe90 con 0x7fe7dc0a1c30 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7dc130570 con 0x7fe7dc0a2010 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient(hunting): authenticate will time out at 1309.709740s 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e11b2640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fe7dc13dc40 0x7fe7dc1d4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59490/0 (socket says 172.21.15.106:59490) 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e11b2640 1 -- 172.21.15.106:0/3762837151 learned_addr learned my addr 172.21.15.106:0/3762837151 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261346026 0 0) 0x7fe7dc1316b0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): my global_id is 6383 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7c0003530 con 0x7fe7dc13dc40 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3699410613 0 0) 0x7fe7c0003530 con 0x7fe7dc13dc40 2024-04-26T00:00:54.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7dc1316b0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7d4001f10 con 0x7fe7dc13dc40 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): dump: 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.176 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 363959600 0 0) 0x7fe7dc12fe90 con 0x7fe7dc0a1c30 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): my global_id is 6359 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7c0003530 con 0x7fe7dc0a1c30 2024-04-26T00:00:54.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 608422990 0 0) 0x7fe7dc130570 con 0x7fe7dc0a2010 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): my global_id is 144781 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7dc12fe90 con 0x7fe7dc0a2010 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1605905500 0 0) 0x7fe7dc1316b0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.171:6792/0 conn(0x7fe7dc0a2010 legacy=0x7fe7dc1d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.171:6791/0 conn(0x7fe7dc0a1c30 legacy=0x7fe7dc134580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 monclient: found mon.b 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7dc131950 con 0x7fe7dc13dc40 2024-04-26T00:00:54.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 5 monclient: authenticate success, global_id 6383 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: _renew_subs 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe7dc0a00f0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: _renew_subs 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe7dc131ef0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe7d4003cd0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7d40041c0 con 0x7fe7dc13dc40 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7daffd640 4 set_mon_vals no callback set 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient: dump: 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.180 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe7bc0065d0 con 0x7fe7bc002870 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe7d4004360 con 0x7fe7dc13dc40 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(193..193 src has 29..193) ==== 9841+0+0 (unknown 3055653133 0 0) 0x7fe7d4046080 con 0x7fe7dc13dc40 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 9634765 0 0) 0x7fe7bc0065d0 con 0x7fe7bc002870 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.180+0000 7fe7d97fa640 10 monclient(hunting): my global_id is 6441 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7dc1316b0 con 0x7fe7bc002870 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7dbfff640 10 monclient: get_auth_request con 0x7fe7c0037a90 auth_method 0 2024-04-26T00:00:54.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1746988941 0 0) 0x7fe7dc1316b0 con 0x7fe7bc002870 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7bc0065d0 con 0x7fe7bc002870 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7c8001520 con 0x7fe7bc002870 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 10 monclient: dump: 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2418514781 0 0) 0x7fe7bc0065d0 con 0x7fe7bc002870 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe7bc00a160 con 0x7fe7bc002870 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe7c80047f0 con 0x7fe7bc002870 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.106:6792/0 conn(0x7fe7bc002870 legacy=0x7fe7bc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.184+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.106:6792/0 conn(0x7fe7bc002870 legacy=0x7fe7bc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7e2c15640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe7bc009e50 con 0x7fe7bc009110 2024-04-26T00:00:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3232567587 0 0) 0x7fe7bc009e50 con 0x7fe7bc009110 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient(hunting): my global_id is 6450 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7bc0065d0 con 0x7fe7bc009110 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3585143163 0 0) 0x7fe7bc0065d0 con 0x7fe7bc009110 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7bc009e50 con 0x7fe7bc009110 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7c8004ed0 con 0x7fe7bc009110 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient: dump: 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 259267406 0 0) 0x7fe7bc009e50 con 0x7fe7bc009110 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe7bc00c3e0 con 0x7fe7bc009110 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2703514013) 0x7fe7c8007280 con 0x7fe7bc009110 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.106:6792/0 conn(0x7fe7bc009110 legacy=0x7fe7bc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.188+0000 7fe7d97fa640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.106:6792/0 conn(0x7fe7bc009110 legacy=0x7fe7bc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:54.188 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 372727, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:54.189 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.190 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.191 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:54.192 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.193 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.194 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.195 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.196 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.198 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.199 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.200 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:54.201 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.202 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.203 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:54.208 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.171:6812/722422047 conn(0x7fe7c0037a90 legacy=0x7fe7c0039f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 10 monclient: shutdown 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 >> v1:172.21.15.106:6790/0 conn(0x7fe7dc13dc40 legacy=0x7fe7dc1d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e11b2640 1 -- 172.21.15.106:0/3762837151 reap_dead start 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e11b2640 1 -- 172.21.15.106:0/3762837151 reap_dead start 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 shutdown_connections 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 >> 172.21.15.106:0/3762837151 conn(0x7fe7dc0a2d20 msgr2=0x7fe7dc0a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 shutdown_connections 2024-04-26T00:00:54.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.192+0000 7fe7e2c15640 1 -- 172.21.15.106:0/3762837151 wait complete. 2024-04-26T00:00:54.210 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:54.210 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:00:54.210 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: get_monmap_and_config 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: monmap: 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:54.346759+0000 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:54.346759+0000 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.324 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.325 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 Processor -- start 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- start start 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: init 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: _add_conns ranks=[0,7,4,6,8,1,2,3,5] 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient(hunting): picked mon.noname-a con 0x7f2e50135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient(hunting): picked mon.noname-i con 0x7f2e501353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient(hunting): picked mon.noname-c con 0x7f2e5013bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:54.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e5006f2d0 con 0x7f2e50135870 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e50072330 con 0x7f2e5013bdf0 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e50072610 con 0x7f2e501353b0 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient(hunting): authenticate will time out at 1309.873947s 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4f7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f2e5013bdf0 0x7f2e5013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47640/0 (socket says 172.21.15.106:47640) 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4f7fe640 1 -- 172.21.15.106:0/2458999563 learned_addr learned my addr 172.21.15.106:0/2458999563 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4effd640 1 --1- 172.21.15.106:0/2458999563 >> v1:172.21.15.106:6789/0 conn(0x7f2e50135870 0x7f2e50135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60382/0 (socket says 172.21.15.106:60382) 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1789721461 0 0) 0x7f2e50072330 con 0x7f2e5013bdf0 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): my global_id is 145030 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e38003530 con 0x7f2e5013bdf0 2024-04-26T00:00:54.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3889762254 0 0) 0x7f2e5006f2d0 con 0x7f2e50135870 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient(hunting): my global_id is 6570 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e50072330 con 0x7f2e50135870 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1482565018 0 0) 0x7f2e38003530 con 0x7f2e5013bdf0 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 >> v1:172.21.15.171:6792/0 conn(0x7f2e501353b0 legacy=0x7f2e5013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 >> v1:172.21.15.106:6789/0 conn(0x7f2e50135870 legacy=0x7f2e50135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 monclient: found mon.noname-c 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e500a3260 con 0x7f2e5013bdf0 2024-04-26T00:00:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e48001b40 con 0x7f2e5013bdf0 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 5 monclient: authenticate success, global_id 145030 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: dump: 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e48001e20 con 0x7f2e5013bdf0 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 4 set_mon_vals no callback set 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 1 -- 172.21.15.106:0/2458999563 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e48004f70 con 0x7f2e5013bdf0 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e4dffb640 10 monclient: dump: 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.340 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.341 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.342 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.342 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 10 monclient: shutdown 2024-04-26T00:00:54.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- 172.21.15.106:0/2458999563 >> v1:172.21.15.106:6791/0 conn(0x7f2e5013bdf0 legacy=0x7f2e5013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- 172.21.15.106:0/2458999563 shutdown_connections 2024-04-26T00:00:54.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- 172.21.15.106:0/2458999563 >> 172.21.15.106:0/2458999563 conn(0x7f2e500a64e0 msgr2=0x7f2e500a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- 172.21.15.106:0/2458999563 shutdown_connections 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.344+0000 7f2e559ea640 1 -- 172.21.15.106:0/2458999563 wait complete. 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: monmap: 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.343 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 Processor -- start 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 -- start start 2024-04-26T00:00:54.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: init 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: _add_conns ranks=[8,4,0,6,2,5,1,7,3] 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient(hunting): picked mon.noname-e con 0x7f2e501353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient(hunting): picked mon.noname-c con 0x7f2e50135870 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient(hunting): picked mon.noname-a con 0x7f2e5013bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e50135040 con 0x7f2e5013bdf0 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e50133b90 con 0x7f2e50135870 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e501ca540 con 0x7f2e501353b0 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient(hunting): authenticate will time out at 1309.877074s 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4e7fc640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f2e50135870 0x7f2e501cf1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47642/0 (socket says 172.21.15.106:47642) 2024-04-26T00:00:54.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4e7fc640 1 -- 172.21.15.106:0/4270004414 learned_addr learned my addr 172.21.15.106:0/4270004414 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4effd640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e501353b0 legacy=0x7f2e5013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4effd640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e501353b0 legacy=0x7f2e5013b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4effd640 1 --1- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e501353b0 0x7f2e5013b110 :-1 s=OPENED pgs=80 cs=1 l=1).handle_message read tag failed 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4effd640 1 --1- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e501353b0 0x7f2e5013b110 :-1 s=OPENED pgs=80 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6793/0 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780111285 0 0) 0x7f2e50135040 con 0x7f2e5013bdf0 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): my global_id is 6579 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e3c003530 con 0x7f2e5013bdf0 2024-04-26T00:00:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420280053 0 0) 0x7f2e50133b90 con 0x7f2e50135870 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): my global_id is 145039 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e50135040 con 0x7f2e50135870 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 346996046 0 0) 0x7f2e50135040 con 0x7f2e50135870 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e50133b90 con 0x7f2e50135870 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2768078240 0 0) 0x7f2e3c003530 con 0x7f2e5013bdf0 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e50135040 con 0x7f2e5013bdf0 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e44001a60 con 0x7f2e50135870 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): dump: 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.350 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e48004eb0 con 0x7f2e5013bdf0 2024-04-26T00:00:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): dump: 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.351 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1980927449 0 0) 0x7f2e50133b90 con 0x7f2e50135870 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e501353b0 legacy=0x7f2e5013b110 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6789/0 conn(0x7f2e5013bdf0 legacy=0x7f2e501d28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 monclient: found mon.c 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e50134d60 con 0x7f2e50135870 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 5 monclient: authenticate success, global_id 145039 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: _renew_subs 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e501338e0 con 0x7f2e50135870 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: _renew_subs 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e5013b9f0 con 0x7f2e50135870 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e440038d0 con 0x7f2e50135870 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e44003dc0 con 0x7f2e50135870 2024-04-26T00:00:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4d7fa640 4 set_mon_vals no callback set 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: dump: 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.357 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2e300065d0 con 0x7f2e30002870 2024-04-26T00:00:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2e44003f60 con 0x7f2e50135870 2024-04-26T00:00:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(193..193 src has 29..193) ==== 9841+0+0 (unknown 3055653133 0 0) 0x7f2e44045c40 con 0x7f2e50135870 2024-04-26T00:00:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966882006 0 0) 0x7f2e300065d0 con 0x7f2e30002870 2024-04-26T00:00:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient(hunting): my global_id is 204155 2024-04-26T00:00:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e50133b90 con 0x7f2e30002870 2024-04-26T00:00:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e4f7fe640 10 monclient: get_auth_request con 0x7f2e3c037d10 auth_method 0 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3985836657 0 0) 0x7f2e50133b90 con 0x7f2e30002870 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e300065d0 con 0x7f2e30002870 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e400012f0 con 0x7f2e30002870 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 10 monclient: dump: 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3630434964 0 0) 0x7f2e300065d0 con 0x7f2e30002870 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.348+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e3000a160 con 0x7f2e30002870 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.352+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2e40001640 con 0x7f2e30002870 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.352+0000 7f2e37fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.352+0000 7f2e37fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.352+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e30002870 legacy=0x7f2e30004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.352+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e30002870 legacy=0x7f2e30004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2e30009e30 con 0x7f2e300090f0 2024-04-26T00:00:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757521774 0 0) 0x7f2e30009e30 con 0x7f2e300090f0 2024-04-26T00:00:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient(hunting): my global_id is 204164 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e300065d0 con 0x7f2e300090f0 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1461204039 0 0) 0x7f2e300065d0 con 0x7f2e300090f0 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e30009e30 con 0x7f2e300090f0 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e40004da0 con 0x7f2e300090f0 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient: dump: 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1277657524 0 0) 0x7f2e30009e30 con 0x7f2e300090f0 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2e3000c3a0 con 0x7f2e300090f0 2024-04-26T00:00:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2135791632) 0x7f2e400071c0 con 0x7f2e300090f0 2024-04-26T00:00:54.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:54.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:54.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e300090f0 legacy=0x7f2e30009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e37fff640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6793/0 conn(0x7f2e300090f0 legacy=0x7f2e30009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.368 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 1095, 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:54.369 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:54.370 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:54.370 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:54.370 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:54.370 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:54.370 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:54.370 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:54.370 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.390 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:54.394 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.395 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:54.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.397 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.398 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.398 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:54.398 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:54.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.171:6812/722422047 conn(0x7f2e3c037d10 legacy=0x7f2e3c03a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 10 monclient: shutdown 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 >> v1:172.21.15.106:6791/0 conn(0x7f2e50135870 legacy=0x7f2e501cf1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e4f7fe640 1 -- 172.21.15.106:0/4270004414 reap_dead start 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e4f7fe640 1 -- 172.21.15.106:0/4270004414 reap_dead start 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 shutdown_connections 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 >> 172.21.15.106:0/4270004414 conn(0x7f2e500a64e0 msgr2=0x7f2e500a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 shutdown_connections 2024-04-26T00:00:54.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.356+0000 7f2e559ea640 1 -- 172.21.15.106:0/4270004414 wait complete. 2024-04-26T00:00:54.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:54.401 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:00:54.402 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:00:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.544+0000 7f9ec4f07640 10 monclient: get_monmap_and_config 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: monmap: 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:54.550460+0000 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:54.550460+0000 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.529 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 Processor -- start 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- start start 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: init 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: _add_conns ranks=[3,1,4,2,7,8,0,5,6] 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient(hunting): picked mon.noname-g con 0x7f9ec0134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient(hunting): picked mon.noname-f con 0x7f9ec00a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient(hunting): picked mon.noname-c con 0x7f9ec013e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec006dd40 con 0x7f9ec00a4820 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec00a2b10 con 0x7f9ec0134970 2024-04-26T00:00:54.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec00a2df0 con 0x7f9ec013e200 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient(hunting): authenticate will time out at 1310.077775s 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebed9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9ec013e200 0x7f9ec01405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47644/0 (socket says 172.21.15.106:47644) 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebed9d640 1 -- 172.21.15.106:0/2364383341 learned_addr learned my addr 172.21.15.106:0/2364383341 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3580145919 0 0) 0x7f9ec00a2df0 con 0x7f9ec013e200 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient(hunting): my global_id is 145048 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ea8003530 con 0x7f9ec013e200 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2970288545 0 0) 0x7f9ea8003530 con 0x7f9ec013e200 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 >> v1:172.21.15.171:6790/0 conn(0x7f9ec0134970 legacy=0x7f9ec0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 >> v1:172.21.15.171:6789/0 conn(0x7f9ec00a4820 legacy=0x7f9ec013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 monclient: found mon.noname-c 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec00a30d0 con 0x7f9ec013e200 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb8001b40 con 0x7f9ec013e200 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: dump: 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 5 monclient: authenticate success, global_id 145048 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9eb8001db0 con 0x7f9ec013e200 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 4 set_mon_vals no callback set 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 1 -- 172.21.15.106:0/2364383341 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb8004f70 con 0x7f9ec013e200 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ebd59a640 10 monclient: dump: 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.539 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: shutdown 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2364383341 >> v1:172.21.15.106:6791/0 conn(0x7f9ec013e200 legacy=0x7f9ec01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2364383341 shutdown_connections 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2364383341 >> 172.21.15.106:0/2364383341 conn(0x7f9ec00a9e20 msgr2=0x7f9ec00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2364383341 shutdown_connections 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2364383341 wait complete. 2024-04-26T00:00:54.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.548+0000 7f9ec4f07640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: monmap: 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.541 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 Processor -- start 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 -- start start 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: init 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: _add_conns ranks=[8,2,6,0,1,4,3,5,7] 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient(hunting): picked mon.noname-e con 0x7f9ec00a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient(hunting): picked mon.noname-b con 0x7f9ec0134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient(hunting): picked mon.noname-d con 0x7f9ec013e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec00a1e00 con 0x7f9ec0134970 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec013c260 con 0x7f9ec013e200 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9ec013a2e0 con 0x7f9ec00a4820 2024-04-26T00:00:54.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient(hunting): authenticate will time out at 1310.080893s 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ebdd9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f9ec0134970 0x7f9ec01ccb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59498/0 (socket says 172.21.15.106:59498) 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ebdd9b640 1 -- 172.21.15.106:0/2365690006 learned_addr learned my addr 172.21.15.106:0/2365690006 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ebe59c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f9ec00a4820 0x7f9ec01cc460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:47220/0 (socket says 172.21.15.106:47220) 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163486103 0 0) 0x7f9ec013a2e0 con 0x7f9ec00a4820 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): my global_id is 204173 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ea0003530 con 0x7f9ec00a4820 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665824829 0 0) 0x7f9ec006dd40 con 0x7f9ec0134970 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): my global_id is 6392 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec013a2e0 con 0x7f9ec0134970 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3379997282 0 0) 0x7f9ec013c260 con 0x7f9ec013e200 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): my global_id is 6459 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec006dd40 con 0x7f9ec013e200 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2344225859 0 0) 0x7f9ea0003530 con 0x7f9ec00a4820 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ec013c260 con 0x7f9ec00a4820 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb0001a60 con 0x7f9ec00a4820 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): dump: 2024-04-26T00:00:54.544 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2617722923 0 0) 0x7f9ec006dd40 con 0x7f9ec013e200 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ea0003530 con 0x7f9ec013e200 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2130462519 0 0) 0x7f9ec013a2e0 con 0x7f9ec0134970 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ec006dd40 con 0x7f9ec0134970 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb8004eb0 con 0x7f9ec013e200 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): dump: 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.546 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb4001a20 con 0x7f9ec0134970 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): dump: 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.547 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.548 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3059442217 0 0) 0x7f9ec013c260 con 0x7f9ec00a4820 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.106:6792/0 conn(0x7f9ec013e200 legacy=0x7f9ec01d49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.106:6790/0 conn(0x7f9ec0134970 legacy=0x7f9ec01ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 monclient: found mon.e 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ec01cd280 con 0x7f9ec00a4820 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 5 monclient: authenticate success, global_id 204173 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: _renew_subs 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:00:54.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9ec013aff0 con 0x7f9ec00a4820 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: _renew_subs 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f9ec013adb0 con 0x7f9ec00a4820 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9eb0001d40 con 0x7f9ec00a4820 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb0003c10 con 0x7f9ec00a4820 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ebcd99640 4 set_mon_vals no callback set 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: dump: 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.550 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9ea40065d0 con 0x7f9ea4002870 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9eb0003e30 con 0x7f9ec00a4820 2024-04-26T00:00:54.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(193..193 src has 29..193) ==== 9841+0+0 (unknown 3055653133 0 0) 0x7f9eb0045cf0 con 0x7f9ec00a4820 2024-04-26T00:00:54.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9ebed9d640 10 monclient: get_auth_request con 0x7f9ea0038110 auth_method 0 2024-04-26T00:00:54.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322373021 0 0) 0x7f9ea40065d0 con 0x7f9ea4002870 2024-04-26T00:00:54.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient(hunting): my global_id is 144919 2024-04-26T00:00:54.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec013c260 con 0x7f9ea4002870 2024-04-26T00:00:54.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 474626884 0 0) 0x7f9ec013c260 con 0x7f9ea4002870 2024-04-26T00:00:54.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ea40065d0 con 0x7f9ea4002870 2024-04-26T00:00:54.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb40039e0 con 0x7f9ea4002870 2024-04-26T00:00:54.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.552+0000 7f9eaeffd640 10 monclient: dump: 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.555 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.556+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3056675257 0 0) 0x7f9ea40065d0 con 0x7f9ea4002870 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.556+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ea400a160 con 0x7f9ea4002870 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.556+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9eb40057d0 con 0x7f9ea4002870 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.556+0000 7f9eaeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.556+0000 7f9eaeffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.556+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.171:6789/0 conn(0x7f9ea4002870 legacy=0x7f9ea4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.556+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.171:6789/0 conn(0x7f9ea4002870 legacy=0x7f9ea4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9ec4f07640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9ea4009e10 con 0x7f9ea40090f0 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 455013187 0 0) 0x7f9ea4009e10 con 0x7f9ea40090f0 2024-04-26T00:00:54.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 10 monclient(hunting): my global_id is 144928 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ea40065d0 con 0x7f9ea40090f0 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1103577030 0 0) 0x7f9ea40065d0 con 0x7f9ea40090f0 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ea4009e10 con 0x7f9ea40090f0 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9eb4004320 con 0x7f9ea40090f0 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.560+0000 7f9eaeffd640 10 monclient: dump: 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.557 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3472644885 0 0) 0x7f9ea4009e10 con 0x7f9ea40090f0 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9ea400c390 con 0x7f9ea40090f0 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2471042668) 0x7f9eb4007ac0 con 0x7f9ea40090f0 2024-04-26T00:00:54.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9eaeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9eaeffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.171:6789/0 conn(0x7f9ea40090f0 legacy=0x7f9ea4009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9eaeffd640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.171:6789/0 conn(0x7f9ea40090f0 legacy=0x7f9ea4009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 118090, 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:54.562 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.563 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.564 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.565 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.566 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:54.568 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.570 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.572 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.573 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.575 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.576 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:54.577 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.171:6812/722422047 conn(0x7f9ea0038110 legacy=0x7f9ea003a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 10 monclient: shutdown 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 >> v1:172.21.15.106:6793/0 conn(0x7f9ec00a4820 legacy=0x7f9ec01cc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ebed9d640 1 -- 172.21.15.106:0/2365690006 reap_dead start 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ebed9d640 1 -- 172.21.15.106:0/2365690006 reap_dead start 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 shutdown_connections 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 >> 172.21.15.106:0/2365690006 conn(0x7f9ec00a9e20 msgr2=0x7f9ec0133e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 shutdown_connections 2024-04-26T00:00:54.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.564+0000 7f9ec4f07640 1 -- 172.21.15.106:0/2365690006 wait complete. 2024-04-26T00:00:54.580 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:54.580 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:00:54.580 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient: get_monmap_and_config 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient: monmap: 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:54.714906+0000 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:54.714906+0000 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.693 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 1 Processor -- start 2024-04-26T00:00:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 1 -- start start 2024-04-26T00:00:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient: init 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient: _add_conns ranks=[7,0,2,4,8,6,5,3,1] 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient(hunting): picked mon.noname-i con 0x7fc3ec134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient(hunting): picked mon.noname-a con 0x7fc3ec0a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient(hunting): picked mon.noname-b con 0x7fc3ec13e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec06dd40 con 0x7fc3ec0a4820 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec0a2b10 con 0x7fc3ec13e200 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f240f640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fc3ec134970 0x7fc3ec134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:53926/0 (socket says 172.21.15.106:53926) 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f240f640 1 -- 172.21.15.106:0/2644223445 learned_addr learned my addr 172.21.15.106:0/2644223445 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec0a2df0 con 0x7fc3ec134970 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f4673640 10 monclient(hunting): authenticate will time out at 1310.243015s 2024-04-26T00:00:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778166582 0 0) 0x7fc3ec06dd40 con 0x7fc3ec0a4820 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f140d640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f140d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f140d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f140d640 10 monclient(hunting): my global_id is 6588 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.712+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d8003530 con 0x7fc3ec0a4820 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 240872430 0 0) 0x7fc3d8003530 con 0x7fc3ec0a4820 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 >> v1:172.21.15.171:6792/0 conn(0x7fc3ec134970 legacy=0x7fc3ec134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 >> v1:172.21.15.106:6790/0 conn(0x7fc3ec13e200 legacy=0x7fc3ec1405f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 monclient: found mon.noname-a 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:00:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec0a30d0 con 0x7fc3ec0a4820 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e80017c0 con 0x7fc3ec0a4820 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 5 monclient: authenticate success, global_id 6588 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: dump: 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3e8001a20 con 0x7fc3ec0a4820 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 4 set_mon_vals no callback set 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 1 -- 172.21.15.106:0/2644223445 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e8003960 con 0x7fc3ec0a4820 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f140d640 10 monclient: dump: 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: shutdown 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- 172.21.15.106:0/2644223445 >> v1:172.21.15.106:6789/0 conn(0x7fc3ec0a4820 legacy=0x7fc3ec13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- 172.21.15.106:0/2644223445 shutdown_connections 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- 172.21.15.106:0/2644223445 >> 172.21.15.106:0/2644223445 conn(0x7fc3ec0a9e20 msgr2=0x7fc3ec0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- 172.21.15.106:0/2644223445 shutdown_connections 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- 172.21.15.106:0/2644223445 wait complete. 2024-04-26T00:00:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: monmap: 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.704 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 Processor -- start 2024-04-26T00:00:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- start start 2024-04-26T00:00:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: init 2024-04-26T00:00:54.704 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.715+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}]=0 added bucket h14 type host to location {rack=r1} v194) ==== 168+0+0 (unknown 999103710 0 0) 0x7f44d00196e0 con 0x7f44d80a1b60 2024-04-26T00:00:54.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.715+0000 7f44cf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:54.705 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.715+0000 7f44cf7fe640 10 monclient: _finish_command 2 = system:0 added bucket h14 type host to location {rack=r1} 2024-04-26T00:00:54.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: _add_conns ranks=[2,4,0,6,3,8,7,1,5] 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient(hunting): picked mon.noname-b con 0x7fc3ec0a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient(hunting): picked mon.noname-c con 0x7fc3ec134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient(hunting): picked mon.noname-a con 0x7fc3ec13e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec1392f0 con 0x7fc3ec13e200 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec1395d0 con 0x7fc3ec0a4820 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec0a1e00 con 0x7fc3ec134970 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient(hunting): authenticate will time out at 1310.246898s 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f240f640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc3ec0a4820 0x7fc3ec13ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59534/0 (socket says 172.21.15.106:59534) 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f240f640 1 -- 172.21.15.106:0/3920550235 learned_addr learned my addr 172.21.15.106:0/3920550235 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1876837974 0 0) 0x7fc3ec0a1e00 con 0x7fc3ec134970 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): my global_id is 145057 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d0003530 con 0x7fc3ec134970 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 843327990 0 0) 0x7fc3ec1392f0 con 0x7fc3ec13e200 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): my global_id is 6597 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec0a1e00 con 0x7fc3ec13e200 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799196912 0 0) 0x7fc3ec1395d0 con 0x7fc3ec0a4820 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): my global_id is 6401 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec1392f0 con 0x7fc3ec0a4820 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1051493234 0 0) 0x7fc3d0003530 con 0x7fc3ec134970 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ec1395d0 con 0x7fc3ec134970 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e80016c0 con 0x7fc3ec134970 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 511119389 0 0) 0x7fc3ec0a1e00 con 0x7fc3ec13e200 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3d0003530 con 0x7fc3ec13e200 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3905071810 0 0) 0x7fc3ec1392f0 con 0x7fc3ec0a4820 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ec0a1e00 con 0x7fc3ec0a4820 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e4001b40 con 0x7fc3ec13e200 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.716 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.717 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3dc001960 con 0x7fc3ec0a4820 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient(hunting): dump: 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.718 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1701193727 0 0) 0x7fc3ec1395d0 con 0x7fc3ec134970 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.106:6790/0 conn(0x7fc3ec0a4820 legacy=0x7fc3ec13ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.106:6789/0 conn(0x7fc3ec13e200 legacy=0x7fc3ec1d5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 monclient: found mon.c 2024-04-26T00:00:54.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec1ca9b0 con 0x7fc3ec134970 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 5 monclient: authenticate success, global_id 145057 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: _renew_subs 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.716+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec1cb200 con 0x7fc3ec134970 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3f4673640 10 monclient: _renew_subs 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3f4673640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3ec13d6e0 con 0x7fc3ec134970 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3e8001a20 con 0x7fc3ec134970 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e8003fb0 con 0x7fc3ec134970 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3f0c0c640 4 set_mon_vals no callback set 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: dump: 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.721 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3f4673640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3d40065d0 con 0x7fc3d4002870 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc3e800ed50 con 0x7fc3ec134970 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(194..194 src has 29..194) ==== 10054+0+0 (unknown 4167869887 0 0) 0x7fc3e8044da0 con 0x7fc3ec134970 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3f2c10640 10 monclient: get_auth_request con 0x7fc3d0038190 auth_method 0 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1658424301 0 0) 0x7fc3d40065d0 con 0x7fc3d4002870 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient(hunting): my global_id is 6690 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec1395d0 con 0x7fc3d4002870 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3211076303 0 0) 0x7fc3ec1395d0 con 0x7fc3d4002870 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3d40065d0 con 0x7fc3d4002870 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3dc004b30 con 0x7fc3d4002870 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: dump: 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.723 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3616005018 0 0) 0x7fc3d40065d0 con 0x7fc3d4002870 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3d400a160 con 0x7fc3d4002870 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc3dc006050 con 0x7fc3d4002870 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:54.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.171:6790/0 conn(0x7fc3d4002870 legacy=0x7fc3d4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.720+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.171:6790/0 conn(0x7fc3d4002870 legacy=0x7fc3d4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3d4009e30 con 0x7fc3d40090f0 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2499270242 0 0) 0x7fc3d4009e30 con 0x7fc3d40090f0 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient(hunting): my global_id is 6699 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d40065d0 con 0x7fc3d40090f0 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2872271999 0 0) 0x7fc3d40065d0 con 0x7fc3d40090f0 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3d4009e30 con 0x7fc3d40090f0 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3dc0067f0 con 0x7fc3d40090f0 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:54.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient: dump: 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.726 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.727 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 185043463 0 0) 0x7fc3d4009e30 con 0x7fc3d40090f0 2024-04-26T00:00:54.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3d400c3a0 con 0x7fc3d40090f0 2024-04-26T00:00:54.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1946171672) 0x7fc3dc006a20 con 0x7fc3d40090f0 2024-04-26T00:00:54.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:54.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:54.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.171:6790/0 conn(0x7fc3d40090f0 legacy=0x7fc3d4009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3e2ffd640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.171:6790/0 conn(0x7fc3d40090f0 legacy=0x7fc3d4009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 373248, 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.740 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.741 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.742 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.743 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.744 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:54.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:54.747 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.171:6812/722422047 conn(0x7fc3d0038190 legacy=0x7fc3d003a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 10 monclient: shutdown 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 >> v1:172.21.15.106:6791/0 conn(0x7fc3ec134970 legacy=0x7fc3ec1d1be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f2c10640 1 -- 172.21.15.106:0/3920550235 reap_dead start 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f2c10640 1 -- 172.21.15.106:0/3920550235 reap_dead start 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 shutdown_connections 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 >> 172.21.15.106:0/3920550235 conn(0x7fc3ec0a9e20 msgr2=0x7fc3ec130c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 shutdown_connections 2024-04-26T00:00:54.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.728+0000 7fc3f4673640 1 -- 172.21.15.106:0/3920550235 wait complete. 2024-04-26T00:00:54.750 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:54.750 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:00:54.750 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:00:54.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.819+0000 7f44dc91f640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:54.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.819+0000 7f44dc91f640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:54.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.819+0000 7f44dc91f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:00:54.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.819+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f44bc005ac0 con 0x7f44d80a1b60 2024-04-26T00:00:54.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.819+0000 7f44cf7fe640 1 -- 172.21.15.171:0/1618444977 <== mon.3 v1:172.21.15.171:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h14' already exists v194) ==== 147+0+0 (unknown 2462402994 0 0) 0x7f44d001dfa0 con 0x7f44d80a1b60 2024-04-26T00:00:54.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.819+0000 7f44cf7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h14", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:54.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.819+0000 7f44cf7fe640 10 monclient: _finish_command 3 = system:0 bucket 'h14' already exists 2024-04-26T00:00:54.804 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h14' already exists 2024-04-26T00:00:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 >> v1:172.21.15.171:6812/722422047 conn(0x7f44b8038140 legacy=0x7f44b803a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 10 monclient: shutdown 2024-04-26T00:00:54.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 >> v1:172.21.15.171:6790/0 conn(0x7f44d80a1b60 legacy=0x7f44d81d4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 shutdown_connections 2024-04-26T00:00:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 >> 172.21.15.171:0/1618444977 conn(0x7f44d80a8400 msgr2=0x7f44d80a0980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 shutdown_connections 2024-04-26T00:00:54.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.823+0000 7f44dc91f640 1 -- 172.21.15.171:0/1618444977 wait complete. 2024-04-26T00:00:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:54.821 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h15 host rack=r1 2024-04-26T00:00:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.888+0000 7fc11ee49640 10 monclient: get_monmap_and_config 2024-04-26T00:00:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.888+0000 7fc11ee49640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.888+0000 7fc11ee49640 10 monclient: monmap: 2024-04-26T00:00:54.871 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:54.894110+0000 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:54.894110+0000 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.872 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 Processor -- start 2024-04-26T00:00:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- start start 2024-04-26T00:00:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: init 2024-04-26T00:00:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: _add_conns ranks=[0,8,7,5,6,2,3,4,1] 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient(hunting): picked mon.noname-a con 0x7fc11806b210 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient(hunting): picked mon.noname-e con 0x7fc11806bd00 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient(hunting): picked mon.noname-i con 0x7fc1180a0860 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1180a0160 con 0x7fc11806b210 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11809fba0 con 0x7fc1180a0860 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc11809fe80 con 0x7fc11806bd00 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient(hunting): authenticate will time out at 1310.421304s 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc117fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc11806bd00 0x7fc11813cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:47222/0 (socket says 172.21.15.106:47222) 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc117fff640 1 -- 172.21.15.106:0/1264136279 learned_addr learned my addr 172.21.15.106:0/1264136279 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051400936 0 0) 0x7fc11809fe80 con 0x7fc11806bd00 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): my global_id is 204182 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc104003530 con 0x7fc11806bd00 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516447216 0 0) 0x7fc108001120 con 0x7fc11806b210 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient(hunting): my global_id is 6606 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc11809fe80 con 0x7fc11806b210 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3466944772 0 0) 0x7fc104003530 con 0x7fc11806bd00 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 >> v1:172.21.15.171:6792/0 conn(0x7fc1180a0860 legacy=0x7fc118140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 >> v1:172.21.15.106:6789/0 conn(0x7fc11806b210 legacy=0x7fc11806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 monclient: found mon.noname-e 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc11809f010 con 0x7fc11806bd00 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 5 monclient: authenticate success, global_id 204182 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc100001800 con 0x7fc11806bd00 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: dump: 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc100001a90 con 0x7fc11806bd00 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 4 set_mon_vals no callback set 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 1 -- 172.21.15.106:0/1264136279 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc100004bf0 con 0x7fc11806bd00 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc1177fe640 10 monclient: dump: 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: shutdown 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- 172.21.15.106:0/1264136279 >> v1:172.21.15.106:6793/0 conn(0x7fc11806bd00 legacy=0x7fc11813cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- 172.21.15.106:0/1264136279 shutdown_connections 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- 172.21.15.106:0/1264136279 >> 172.21.15.106:0/1264136279 conn(0x7fc1180a35e0 msgr2=0x7fc1180a39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- 172.21.15.106:0/1264136279 shutdown_connections 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- 172.21.15.106:0/1264136279 wait complete. 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: monmap: 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 Processor -- start 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 1 -- start start 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.892+0000 7fc11ee49640 10 monclient: init 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient: _add_conns ranks=[5,2,0,1,3,8,7,4,6] 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient(hunting): picked mon.noname-h con 0x7fc11806b210 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient(hunting): picked mon.noname-b con 0x7fc11806bd00 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient(hunting): picked mon.noname-a con 0x7fc1180a0860 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1181413f0 con 0x7fc1180a0860 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1180725e0 con 0x7fc11806bd00 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc118138470 con 0x7fc11806b210 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient(hunting): authenticate will time out at 1310.424502s 2024-04-26T00:00:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11d3e6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc1180a0860 0x7fc1181d4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60448/0 (socket says 172.21.15.106:60448) 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11d3e6640 1 -- 172.21.15.106:0/3418316190 learned_addr learned my addr 172.21.15.106:0/3418316190 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1556991794 0 0) 0x7fc1180725e0 con 0x7fc11806bd00 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): my global_id is 6410 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0f8003530 con 0x7fc11806bd00 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391737059 0 0) 0x7fc1181413f0 con 0x7fc1180a0860 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): my global_id is 6615 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1180725e0 con 0x7fc1180a0860 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 418585755 0 0) 0x7fc0f8003530 con 0x7fc11806bd00 2024-04-26T00:00:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1181413f0 con 0x7fc11806bd00 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc100004b30 con 0x7fc11806bd00 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): dump: 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2765214596 0 0) 0x7fc1180725e0 con 0x7fc1180a0860 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0f8003530 con 0x7fc1180a0860 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc110001d00 con 0x7fc1180a0860 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): dump: 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308469267 0 0) 0x7fc118138470 con 0x7fc11806b210 2024-04-26T00:00:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): my global_id is 6368 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1180725e0 con 0x7fc11806b210 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 81365885 0 0) 0x7fc1181413f0 con 0x7fc11806bd00 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.171:6791/0 conn(0x7fc11806b210 legacy=0x7fc118140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.106:6789/0 conn(0x7fc1180a0860 legacy=0x7fc1181d4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 monclient: found mon.b 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc118139ec0 con 0x7fc11806bd00 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 5 monclient: authenticate success, global_id 6410 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient: _renew_subs 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc118138fd0 con 0x7fc11806bd00 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient: _renew_subs 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1181394e0 con 0x7fc11806bd00 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1000018a0 con 0x7fc11806bd00 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc100001a50 con 0x7fc11806bd00 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc116ffd640 4 set_mon_vals no callback set 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: dump: 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc0fc0065d0 con 0x7fc0fc002870 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc10000fe80 con 0x7fc11806bd00 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(194..194 src has 29..194) ==== 10054+0+0 (unknown 4167869887 0 0) 0x7fc100045e60 con 0x7fc11806bd00 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc11d3e6640 10 monclient: get_auth_request con 0x7fc0f8037d20 auth_method 0 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665041860 0 0) 0x7fc0fc0065d0 con 0x7fc0fc002870 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient(hunting): my global_id is 6377 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1181413f0 con 0x7fc0fc002870 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2380170218 0 0) 0x7fc1181413f0 con 0x7fc0fc002870 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0fc0065d0 con 0x7fc0fc002870 2024-04-26T00:00:54.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc108001590 con 0x7fc0fc002870 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 10 monclient: dump: 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2661488470 0 0) 0x7fc0fc0065d0 con 0x7fc0fc002870 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.896+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc0fc00a160 con 0x7fc0fc002870 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.900+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc108001940 con 0x7fc0fc002870 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.900+0000 7fc1157fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.900+0000 7fc1157fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.900+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.171:6791/0 conn(0x7fc0fc002870 legacy=0x7fc0fc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.900+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.171:6791/0 conn(0x7fc0fc002870 legacy=0x7fc0fc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc11ee49640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:54.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc0fc009e50 con 0x7fc0fc009110 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2189590650 0 0) 0x7fc0fc009e50 con 0x7fc0fc009110 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 10 monclient(hunting): my global_id is 6386 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0fc0065d0 con 0x7fc0fc009110 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 73308074 0 0) 0x7fc0fc0065d0 con 0x7fc0fc009110 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc0fc009e50 con 0x7fc0fc009110 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc108003b30 con 0x7fc0fc009110 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.904+0000 7fc1157fa640 10 monclient: dump: 2024-04-26T00:00:54.900 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.901 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 388863204 0 0) 0x7fc0fc009e50 con 0x7fc0fc009110 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc0fc00c3e0 con 0x7fc0fc009110 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1111114565) 0x7fc108003e10 con 0x7fc0fc009110 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc1157fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc1157fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.171:6791/0 conn(0x7fc0fc009110 legacy=0x7fc0fc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc1157fa640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.171:6791/0 conn(0x7fc0fc009110 legacy=0x7fc0fc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:54.902 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 373404, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:54.903 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.904 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.905 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:54.906 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:54.907 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:54.908 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:54.909 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.911 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.912 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.913 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:54.914 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.916 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:54.918 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.919 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.921 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:54.922 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:54.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.171:6812/722422047 conn(0x7fc0f8037d20 legacy=0x7fc0f803a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 10 monclient: shutdown 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 >> v1:172.21.15.106:6790/0 conn(0x7fc11806bd00 legacy=0x7fc1181d17f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11d3e6640 1 -- 172.21.15.106:0/3418316190 reap_dead start 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11d3e6640 1 -- 172.21.15.106:0/3418316190 reap_dead start 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 shutdown_connections 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 >> 172.21.15.106:0/3418316190 conn(0x7fc1180a35e0 msgr2=0x7fc1180702c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 shutdown_connections 2024-04-26T00:00:54.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:54.908+0000 7fc11ee49640 1 -- 172.21.15.106:0/3418316190 wait complete. 2024-04-26T00:00:54.924 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:54.924 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:00:54.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:00:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient: get_monmap_and_config 2024-04-26T00:00:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient: monmap: 2024-04-26T00:00:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:54.959566+0000 2024-04-26T00:00:54.937 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:54.959566+0000 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.938 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 1 Processor -- start 2024-04-26T00:00:54.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 1 -- start start 2024-04-26T00:00:54.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient: init 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient: _add_conns ranks=[7,3,6,4,8,1,0,5,2] 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient(hunting): picked mon.noname-i con 0x7f56081379d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient(hunting): picked mon.noname-g con 0x7f56081384c0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient(hunting): picked mon.noname-d con 0x7f560813e620 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56080a2b00 con 0x7f56081384c0 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56080a2de0 con 0x7f560813e620 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56080a17a0 con 0x7f56081379d0 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f560da28640 10 monclient(hunting): authenticate will time out at 1305.667201s 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5606ffd640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f56081379d0 0x7f5608137db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:39084/0 (socket says 172.21.15.171:39084) 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5606ffd640 1 -- 172.21.15.171:0/2613510480 learned_addr learned my addr 172.21.15.171:0/2613510480 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f56067fc640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f56081384c0 0x7f560813cf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58724/0 (socket says 172.21.15.171:58724) 2024-04-26T00:00:54.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062960839 0 0) 0x7f56080a17a0 con 0x7f56081379d0 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): my global_id is 144808 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f0003530 con 0x7f56081379d0 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364453019 0 0) 0x7f56080a2b00 con 0x7f56081384c0 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): my global_id is 6708 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56080a17a0 con 0x7f56081384c0 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897035061 0 0) 0x7f56080a2de0 con 0x7f560813e620 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 10 monclient(hunting): my global_id is 6468 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56080a2b00 con 0x7f560813e620 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.955+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 367015612 0 0) 0x7f56080a17a0 con 0x7f56081384c0 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 >> v1:172.21.15.171:6792/0 conn(0x7f56081379d0 legacy=0x7f5608137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 >> v1:172.21.15.106:6792/0 conn(0x7f560813e620 legacy=0x7f5608140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 1 monclient: found mon.noname-g 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56080a3b20 con 0x7f56081384c0 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55fc0017a0 con 0x7f56081384c0 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 5 monclient: authenticate success, global_id 6708 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: dump: 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.951 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55fc001a80 con 0x7f56081384c0 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 4 set_mon_vals no callback set 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 1 -- 172.21.15.171:0/2613510480 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55fc004b30 con 0x7f56081384c0 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:54.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5605ffb640 10 monclient: dump: 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: shutdown 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- 172.21.15.171:0/2613510480 >> v1:172.21.15.171:6790/0 conn(0x7f56081384c0 legacy=0x7f560813cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- 172.21.15.171:0/2613510480 shutdown_connections 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- 172.21.15.171:0/2613510480 >> 172.21.15.171:0/2613510480 conn(0x7f56080a6b30 msgr2=0x7f56080a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- 172.21.15.171:0/2613510480 shutdown_connections 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- 172.21.15.171:0/2613510480 wait complete. 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: build_initial_monmap 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: monmap: 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:54.954 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 Processor -- start 2024-04-26T00:00:54.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- start start 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: init 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: _add_conns ranks=[0,4,8,1,7,3,5,6,2] 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient(hunting): picked mon.noname-a con 0x7f56081379d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient(hunting): picked mon.noname-c con 0x7f56081384c0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient(hunting): picked mon.noname-e con 0x7f560813e620 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560812e570 con 0x7f56081379d0 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560813c140 con 0x7f56081384c0 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f560813c420 con 0x7f560813e620 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient(hunting): authenticate will time out at 1305.670321s 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f56067fc640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f56081384c0 0x7f560812de60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:37612/0 (socket says 172.21.15.171:37612) 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f56067fc640 1 -- 172.21.15.171:0/3746162228 learned_addr learned my addr 172.21.15.171:0/3746162228 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:54.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184404898 0 0) 0x7f560813c140 con 0x7f56081384c0 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): my global_id is 145066 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f4003530 con 0x7f56081384c0 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997651607 0 0) 0x7f560812e570 con 0x7f56081379d0 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): my global_id is 6624 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f560813c140 con 0x7f56081379d0 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009145825 0 0) 0x7f560813c420 con 0x7f560813e620 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): my global_id is 204191 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f560812e570 con 0x7f560813e620 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 172341801 0 0) 0x7f560813c140 con 0x7f56081379d0 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f560813c420 con 0x7f56081379d0 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2864780958 0 0) 0x7f55f4003530 con 0x7f56081384c0 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f560813c140 con 0x7f56081384c0 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55f8001430 con 0x7f56081379d0 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): dump: 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.958 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:54.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55fc0016a0 con 0x7f56081384c0 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): dump: 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.960 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 855982064 0 0) 0x7f560812e570 con 0x7f560813e620 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55f4003530 con 0x7f560813e620 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5600001c80 con 0x7f560813e620 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient(hunting): dump: 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.961 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 802261133 0 0) 0x7f560813c420 con 0x7f56081379d0 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.106:6793/0 conn(0x7f560813e620 legacy=0x7f56081d4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.106:6791/0 conn(0x7f56081384c0 legacy=0x7f560812de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 monclient: found mon.a 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f560813b870 con 0x7f56081379d0 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 5 monclient: authenticate success, global_id 6624 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: _renew_subs 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5608130af0 con 0x7f56081379d0 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: _renew_subs 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:54.963 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f56081318c0 con 0x7f56081379d0 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5606ffd640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.106:6789/0 conn(0x7f56081379d0 legacy=0x7f560812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55f8004aa0 con 0x7f56081379d0 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5606ffd640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.106:6789/0 conn(0x7f56081379d0 legacy=0x7f560812d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5606ffd640 1 --1- 172.21.15.171:0/3746162228 >> v1:172.21.15.106:6789/0 conn(0x7f56081379d0 0x7f560812d750 :-1 s=OPENED pgs=565 cs=1 l=1).handle_message read tag failed 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f5606ffd640 1 --1- 172.21.15.171:0/3746162228 >> v1:172.21.15.106:6789/0 conn(0x7f56081379d0 0x7f560812d750 :-1 s=OPENED pgs=565 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient: ms_handle_reset current mon v1:172.21.15.106:6789/0 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.106:6789/0 conn(0x7f56081379d0 legacy=0x7f560812d750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.959+0000 7f56057fa640 4 set_mon_vals no callback set 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _add_conns ranks=[7,5,3,2,1,0,8,4,6] 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): picked mon.i con 0x7f55f40062c0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): picked mon.h con 0x7f55f4009e80 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:54.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): picked mon.g con 0x7f55f400dd40 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f560813c420 con 0x7f55f400dd40 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f560812e570 con 0x7f55f4009e80 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f55f4013e30 con 0x7f55f40062c0 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f560da28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f560da28640 10 monclient(hunting): _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 83023615 0 0) 0x7f55f4013e30 con 0x7f55f40062c0 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6792/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f55f4012e00 con 0x7f55f40062c0 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2932553685 0 0) 0x7f560812e570 con 0x7f55f4009e80 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6791/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f55f4013e30 con 0x7f55f4009e80 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624881349 0 0) 0x7f560813c420 con 0x7f55f400dd40 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f560812e570 con 0x7f55f400dd40 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 2915711736 0 0) 0x7f55f4012e00 con 0x7f55f40062c0 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.171:6791/0 conn(0x7f55f4009e80 legacy=0x7f55f400c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.171:6790/0 conn(0x7f55f400dd40 legacy=0x7f55f4010200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 monclient: found mon.i 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:54.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f56077fe640 1 -- 172.21.15.171:0/3746162228 reap_dead start 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f55f40151b0 con 0x7f55f40062c0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e8005090 con 0x7f55f40062c0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f560813c420 con 0x7f55f40062c0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _finish_auth 0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55f80050e0 con 0x7f55f40062c0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: dump: 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:54.967 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:54.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55f8005340 con 0x7f55f40062c0 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f5604ff9640 4 set_mon_vals no callback set 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f55f8010170 con 0x7f55f40062c0 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 6 ==== osd_map(194..194 src has 29..194) ==== 10054+0+0 (unknown 4167869887 0 0) 0x7f55f8046210 con 0x7f55f40062c0 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.963+0000 7f56067fc640 10 monclient: get_auth_request con 0x7f55f403d790 auth_method 0 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.967+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f55f8015ce0 con 0x7f55f40062c0 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.967+0000 7f55effff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:54.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.967+0000 7f55effff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:54.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.971+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 8 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f55f80155e0 con 0x7f55f40062c0 2024-04-26T00:00:54.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:54.971+0000 7f55effff640 10 monclient: handle_mon_command_ack 1 not found 2024-04-26T00:00:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.056+0000 7fb8362e1640 10 monclient: get_monmap_and_config 2024-04-26T00:00:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.056+0000 7fb8362e1640 10 monclient: build_initial_monmap 2024-04-26T00:00:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.056+0000 7fb8362e1640 10 monclient: monmap: 2024-04-26T00:00:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:55.062232+0000 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:55.062232+0000 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:55.040 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 Processor -- start 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- start start 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: init 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: _add_conns ranks=[0,2,1,8,3,7,5,4,6] 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient(hunting): picked mon.noname-a con 0x7fb830134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient(hunting): picked mon.noname-b con 0x7fb8300a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient(hunting): picked mon.noname-f con 0x7fb83013e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83006dd40 con 0x7fb830134970 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8300a2b10 con 0x7fb83013e200 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8300a2df0 con 0x7fb8300a4820 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient(hunting): authenticate will time out at 1310.589581s 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82f7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb8300a4820 0x7fb83013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59544/0 (socket says 172.21.15.106:59544) 2024-04-26T00:00:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82f7fe640 1 -- 172.21.15.106:0/3209267731 learned_addr learned my addr 172.21.15.106:0/3209267731 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2980305995 0 0) 0x7fb8300a2df0 con 0x7fb8300a4820 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): my global_id is 6419 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb818003530 con 0x7fb8300a4820 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1420947420 0 0) 0x7fb83006dd40 con 0x7fb830134970 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient(hunting): my global_id is 6633 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8300a2df0 con 0x7fb830134970 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3841820917 0 0) 0x7fb818003530 con 0x7fb8300a4820 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 >> v1:172.21.15.171:6789/0 conn(0x7fb83013e200 legacy=0x7fb8301405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 >> v1:172.21.15.106:6789/0 conn(0x7fb830134970 legacy=0x7fb830134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 monclient: found mon.noname-b 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8300a30d0 con 0x7fb8300a4820 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: _finish_auth 0 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8240017c0 con 0x7fb8300a4820 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 5 monclient: authenticate success, global_id 6419 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: dump: 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb824001a70 con 0x7fb8300a4820 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 1 -- 172.21.15.106:0/3209267731 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb824004bf0 con 0x7fb8300a4820 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 4 set_mon_vals no callback set 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb82effd640 10 monclient: dump: 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: shutdown 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- 172.21.15.106:0/3209267731 >> v1:172.21.15.106:6790/0 conn(0x7fb8300a4820 legacy=0x7fb83013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- 172.21.15.106:0/3209267731 shutdown_connections 2024-04-26T00:00:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- 172.21.15.106:0/3209267731 >> 172.21.15.106:0/3209267731 conn(0x7fb8300a9e20 msgr2=0x7fb8300aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- 172.21.15.106:0/3209267731 shutdown_connections 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- 172.21.15.106:0/3209267731 wait complete. 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: build_initial_monmap 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: monmap: 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 Processor -- start 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 1 -- start start 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.060+0000 7fb8362e1640 10 monclient: init 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient: _add_conns ranks=[3,2,7,4,8,5,6,0,1] 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient(hunting): picked mon.noname-g con 0x7fb8300a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient(hunting): picked mon.noname-b con 0x7fb830134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient(hunting): picked mon.noname-i con 0x7fb83013e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb83013bc00 con 0x7fb830134970 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8301396d0 con 0x7fb8300a4820 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8300a1a40 con 0x7fb83013e200 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient(hunting): authenticate will time out at 1310.592403s 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82f7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb830134970 0x7fb830138fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59548/0 (socket says 172.21.15.106:59548) 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82f7fe640 1 -- 172.21.15.106:0/3936806230 learned_addr learned my addr 172.21.15.106:0/3936806230 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1911271340 0 0) 0x7fb83013bc00 con 0x7fb830134970 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): my global_id is 6428 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb81c003530 con 0x7fb830134970 2024-04-26T00:00:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2504602266 0 0) 0x7fb81c003530 con 0x7fb830134970 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb83013bc00 con 0x7fb830134970 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb824004b30 con 0x7fb830134970 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): dump: 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.057 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 869828367 0 0) 0x7fb8301396d0 con 0x7fb8300a4820 2024-04-26T00:00:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): my global_id is 6717 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb81c003530 con 0x7fb8300a4820 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 297651265 0 0) 0x7fb8300a1a40 con 0x7fb83013e200 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): my global_id is 144817 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8301396d0 con 0x7fb83013e200 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3251960283 0 0) 0x7fb83013bc00 con 0x7fb830134970 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.171:6792/0 conn(0x7fb83013e200 legacy=0x7fb8301d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.171:6790/0 conn(0x7fb8300a4820 legacy=0x7fb8301388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 monclient: found mon.b 2024-04-26T00:00:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb83013b920 con 0x7fb830134970 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 5 monclient: authenticate success, global_id 6428 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient: _renew_subs 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb83013ac10 con 0x7fb830134970 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient: _renew_subs 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb83013c370 con 0x7fb830134970 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb824001a70 con 0x7fb830134970 2024-04-26T00:00:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb824005230 con 0x7fb830134970 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82e7fc640 4 set_mon_vals no callback set 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: dump: 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb8100065d0 con 0x7fb810002870 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb82400ffd0 con 0x7fb830134970 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(194..194 src has 29..194) ==== 10054+0+0 (unknown 4167869887 0 0) 0x7fb824045fc0 con 0x7fb830134970 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3543329558 0 0) 0x7fb8100065d0 con 0x7fb810002870 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient(hunting): my global_id is 144826 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb83013bc00 con 0x7fb810002870 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb83487e640 10 monclient: get_auth_request con 0x7fb81c0379f0 auth_method 0 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2873593466 0 0) 0x7fb83013bc00 con 0x7fb810002870 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8100065d0 con 0x7fb810002870 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb820001520 con 0x7fb810002870 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 10 monclient: dump: 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3623096037 0 0) 0x7fb8100065d0 con 0x7fb810002870 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.064+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb81000a160 con 0x7fb810002870 2024-04-26T00:00:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.068+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb820003600 con 0x7fb810002870 2024-04-26T00:00:55.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.068+0000 7fb82cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:55.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.068+0000 7fb82cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:55.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.068+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.171:6792/0 conn(0x7fb810002870 legacy=0x7fb810004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.068+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.171:6792/0 conn(0x7fb810002870 legacy=0x7fb810004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:55.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb8362e1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:55.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb810009e50 con 0x7fb810009110 2024-04-26T00:00:55.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013972232 0 0) 0x7fb810009e50 con 0x7fb810009110 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 10 monclient(hunting): my global_id is 144835 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8100065d0 con 0x7fb810009110 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 743314615 0 0) 0x7fb8100065d0 con 0x7fb810009110 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb810009e50 con 0x7fb810009110 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb820003d20 con 0x7fb810009110 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 10 monclient: dump: 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.068 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3273280258 0 0) 0x7fb810009e50 con 0x7fb810009110 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.072+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb81000c3e0 con 0x7fb810009110 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 131234350) 0x7fb820005170 con 0x7fb810009110 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb82cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:55.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb82cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.171:6792/0 conn(0x7fb810009110 legacy=0x7fb8100095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb82cff9640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.171:6792/0 conn(0x7fb810009110 legacy=0x7fb8100095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:55.070 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 118602, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:00:55.071 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:55.072 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:55.073 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:55.074 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:55.075 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.076 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:55.077 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.078 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.080 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:55.081 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.085 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:55.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:55.087 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:55.088 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:00:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:55.089 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:55.089 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:55.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.171:6812/722422047 conn(0x7fb81c0379f0 legacy=0x7fb81c039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 10 monclient: shutdown 2024-04-26T00:00:55.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:55.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 >> v1:172.21.15.106:6790/0 conn(0x7fb830134970 legacy=0x7fb830138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb83487e640 1 -- 172.21.15.106:0/3936806230 reap_dead start 2024-04-26T00:00:55.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb83487e640 1 -- 172.21.15.106:0/3936806230 reap_dead start 2024-04-26T00:00:55.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 shutdown_connections 2024-04-26T00:00:55.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 >> 172.21.15.106:0/3936806230 conn(0x7fb8300a9e20 msgr2=0x7fb830067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:55.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 shutdown_connections 2024-04-26T00:00:55.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.076+0000 7fb8362e1640 1 -- 172.21.15.106:0/3936806230 wait complete. 2024-04-26T00:00:55.091 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:55.091 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:00:55.092 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:00:55.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.119+0000 7f560da28640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:55.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.119+0000 7f560da28640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:55.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.119+0000 7f560da28640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:55.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.119+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f55e8000ed0 con 0x7f55f40062c0 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient: get_monmap_and_config 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient: build_initial_monmap 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient: monmap: 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:55.232927+0000 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:55.232927+0000 2024-04-26T00:00:55.210 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:55.211 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 1 Processor -- start 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 1 -- start start 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient: init 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient: _add_conns ranks=[7,0,5,4,8,3,1,2,6] 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient(hunting): picked mon.noname-i con 0x7f2028134760 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient(hunting): picked mon.noname-a con 0x7f20280a0d70 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:55.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.228+0000 7f202f9ba640 10 monclient(hunting): picked mon.noname-h con 0x7f202813df70 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202806b910 con 0x7f20280a0d70 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202809fac0 con 0x7f202813df70 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20280a0080 con 0x7f2028134760 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient(hunting): authenticate will time out at 1310.760044s 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202cf55640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f20280a0d70 0x7f202813c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:60462/0 (socket says 172.21.15.106:60462) 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202cf55640 1 -- 172.21.15.106:0/1671390075 learned_addr learned my addr 172.21.15.106:0/1671390075 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391738165 0 0) 0x7f202806b910 con 0x7f20280a0d70 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient(hunting): my global_id is 6642 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2014003530 con 0x7f20280a0d70 2024-04-26T00:00:55.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1329254804 0 0) 0x7f2014003530 con 0x7f20280a0d70 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 >> v1:172.21.15.171:6792/0 conn(0x7f2028134760 legacy=0x7f2028134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 >> v1:172.21.15.171:6791/0 conn(0x7f202813df70 legacy=0x7f2028140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 monclient: found mon.noname-a 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202809f280 con 0x7f20280a0d70 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: _finish_auth 0 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 5 monclient: authenticate success, global_id 6642 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:55.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20180017c0 con 0x7f20280a0d70 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: dump: 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.220 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2018001b20 con 0x7f20280a0d70 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 1 -- 172.21.15.106:0/1671390075 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2018004bf0 con 0x7f20280a0d70 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 4 set_mon_vals no callback set 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201ffff640 10 monclient: dump: 2024-04-26T00:00:55.221 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.222 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient: shutdown 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- 172.21.15.106:0/1671390075 >> v1:172.21.15.106:6789/0 conn(0x7f20280a0d70 legacy=0x7f202813c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- 172.21.15.106:0/1671390075 shutdown_connections 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- 172.21.15.106:0/1671390075 >> 172.21.15.106:0/1671390075 conn(0x7f20280a7240 msgr2=0x7f20280a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- 172.21.15.106:0/1671390075 shutdown_connections 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- 172.21.15.106:0/1671390075 wait complete. 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient: build_initial_monmap 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient: monmap: 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.223 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 Processor -- start 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- start start 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient: init 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:55.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient: _add_conns ranks=[6,4,0,1,2,8,3,7,5] 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient(hunting): picked mon.noname-d con 0x7f20280a0d70 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient(hunting): picked mon.noname-c con 0x7f2028134760 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient(hunting): picked mon.noname-a con 0x7f202813df70 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2028072930 con 0x7f202813df70 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202812d240 con 0x7f2028134760 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202812d520 con 0x7f20280a0d70 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202f9ba640 10 monclient(hunting): authenticate will time out at 1310.763145s 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202d756640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f20280a0d70 0x7f2028131a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:54808/0 (socket says 172.21.15.106:54808) 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f202d756640 1 -- 172.21.15.106:0/1192886883 learned_addr learned my addr 172.21.15.106:0/1192886883 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684182219 0 0) 0x7f202812d240 con 0x7f2028134760 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): my global_id is 145075 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200c003530 con 0x7f2028134760 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184358657 0 0) 0x7f2020001340 con 0x7f202813df70 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): my global_id is 6651 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f202812d240 con 0x7f202813df70 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 657814623 0 0) 0x7f202812d520 con 0x7f20280a0d70 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:55.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): my global_id is 6477 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2020001340 con 0x7f20280a0d70 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1839690259 0 0) 0x7f202812d240 con 0x7f202813df70 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f202812d520 con 0x7f202813df70 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 9490384 0 0) 0x7f200c003530 con 0x7f2028134760 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f202812d240 con 0x7f2028134760 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2020001cb0 con 0x7f202813df70 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.227 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2018001780 con 0x7f2028134760 2024-04-26T00:00:55.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.232+0000 7f201dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.229 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3050590791 0 0) 0x7f202812d520 con 0x7f202813df70 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 >> v1:172.21.15.106:6792/0 conn(0x7f20280a0d70 legacy=0x7f2028131a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 >> v1:172.21.15.106:6791/0 conn(0x7f2028134760 legacy=0x7f20281d1620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 monclient: found mon.a 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2028132170 con 0x7f202813df70 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:55.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 5 monclient: authenticate success, global_id 6651 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 10 monclient: _renew_subs 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2028140090 con 0x7f202813df70 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 10 monclient: _renew_subs 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f20280724b0 con 0x7f202813df70 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2020003c50 con 0x7f202813df70 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2020001f20 con 0x7f202813df70 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:55.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201f7fe640 4 set_mon_vals no callback set 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 10 monclient: dump: 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:55.232 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2008005090 con 0x7f202813df70 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f202000ed40 con 0x7f202813df70 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(194..194 src has 29..194) ==== 10054+0+0 (unknown 4167869887 0 0) 0x7f2020044e20 con 0x7f202813df70 2024-04-26T00:00:55.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.236+0000 7f202d756640 10 monclient: get_auth_request con 0x7f200c037d90 auth_method 0 2024-04-26T00:00:55.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.240+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2028072930 con 0x7f202813df70 2024-04-26T00:00:55.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.240+0000 7f201dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:55.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.240+0000 7f201dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:55.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f202f9ba640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:00:55.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f202f9ba640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:00:55.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f202f9ba640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:55.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f2008005b90 con 0x7f202813df70 2024-04-26T00:00:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f201dffb640 1 -- 172.21.15.106:0/1192886883 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f20200147d0 con 0x7f202813df70 2024-04-26T00:00:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f201dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:00:55.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f201dffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=27,config=1,health=12,kv=10,logm=50} crc {auth=665867375,config=3678701417,health=3245091846,kv=3875002534,logm=4208629573}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=28,config=2,health=12,kv=9,logm=49} crc {auth=394747849,config=692619927,health=3245091846,kv=3875002534,logm=2715977454}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.460+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=26,config=2,health=11,kv=8,logm=53} crc {auth=1034802330,config=692619927,health=2256599861,kv=2481505442,logm=3525631560}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=26,config=1,health=11,kv=9,logm=53} crc {auth=1855444978,config=3678701417,health=2256599861,kv=3211854586,logm=2975246372}) 2024-04-26T00:00:55.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=28,config=2,health=11,kv=9,logm=50} crc {auth=394747849,config=692619927,health=1605123571,kv=4062637107,logm=2770475713}) 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=28,config=2,health=11,kv=9,logm=50} crc {auth=394747849,config=692619927,health=2256599861,kv=3875002534,logm=3862539416}) 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=25,config=2,health=11,kv=10,logm=52} crc {auth=3940353086,config=692619927,health=2256599861,kv=3875002534,logm=445718308}) 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=11,kv=9,logm=51} crc {auth=1772057136,config=692619927,health=1605123571,kv=3908964268,logm=110037717}) 2024-04-26T00:00:55.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=28,config=2,health=12,kv=8,logm=50} crc {auth=394747849,config=692619927,health=472483518,kv=150852868,logm=718203347}) 2024-04-26T00:00:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 >> v1:172.21.15.171:6812/722422047 conn(0x7f200c037d90 legacy=0x7f200c03a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f202f9ba640 10 monclient: shutdown 2024-04-26T00:00:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f202f9ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.464+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 >> v1:172.21.15.106:6789/0 conn(0x7f202813df70 legacy=0x7f20281d4d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 shutdown_connections 2024-04-26T00:00:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 >> 172.21.15.106:0/1192886883 conn(0x7f20280a7240 msgr2=0x7f2028133210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:55.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 shutdown_connections 2024-04-26T00:00:55.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f202f9ba640 1 -- 172.21.15.106:0/1192886883 wait complete. 2024-04-26T00:00:55.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1924874089}) 2024-04-26T00:00:55.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1377820590}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3919987423}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3227133789}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=125727603}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4172981820}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1151759368}) 2024-04-26T00:00:55.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=508910842}) 2024-04-26T00:00:55.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.468+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4074823484}) 2024-04-26T00:00:55.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3145816857}) 2024-04-26T00:00:55.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2825573290}) 2024-04-26T00:00:55.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3560962268}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=359392061}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=674831539}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1100603665}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4016851762}) 2024-04-26T00:00:55.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1892072282}) 2024-04-26T00:00:55.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.472+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=202176604}) 2024-04-26T00:00:55.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1006850558}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3635022585}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2147371286}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=376967733}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=533154944}) 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2116066287}) 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1515815080}) 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3933708381}) 2024-04-26T00:00:55.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1111987474}) 2024-04-26T00:00:55.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2415866263}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2802837836}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3587218840}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2037244872}) 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.476+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3823206978}) 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4241527063}) 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=840652797}) 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105777415}) 2024-04-26T00:00:55.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1489931853}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2572624380}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1817521047}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2730784522}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1542233290}) 2024-04-26T00:00:55.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2573867627}) 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=75184900}) 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1888613640}) 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3060304817}) 2024-04-26T00:00:55.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.480+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=957069593}) 2024-04-26T00:00:55.466 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:00:55.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3573233508}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=241507647}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=580740344}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2114812963}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1038833874}) 2024-04-26T00:00:55.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=353537888}) 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=431701030}) 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954685852}) 2024-04-26T00:00:55.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.484+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2386090698}) 2024-04-26T00:00:55.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1300245175}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4122272824}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3565491918}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4073191880}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2376032311}) 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1626024964}) 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3057096569}) 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726699581}) 2024-04-26T00:00:55.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.488+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3929630918}) 2024-04-26T00:00:55.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1026978383}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3815967249}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=623051386}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2537970853}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=307444444}) 2024-04-26T00:00:55.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3176877873}) 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=639091087}) 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=405763457}) 2024-04-26T00:00:55.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.492+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=14945022}) 2024-04-26T00:00:55.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1561823786}) 2024-04-26T00:00:55.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3736120086}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=509402359}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=705565843}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3419766364}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2675635056}) 2024-04-26T00:00:55.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3002374527}) 2024-04-26T00:00:55.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3702349863}) 2024-04-26T00:00:55.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.496+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2517021256}) 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2289920825}) 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3180555782}) 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=149760146}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2771612922}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3310131157}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4289445326}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1392650441}) 2024-04-26T00:00:55.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518331292}) 2024-04-26T00:00:55.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2508602406}) 2024-04-26T00:00:55.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1900158011}) 2024-04-26T00:00:55.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3536488266}) 2024-04-26T00:00:55.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1472581145}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1608573596}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1186620344}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1800423903}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.500+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1241585249}) 2024-04-26T00:00:55.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=82094710}) 2024-04-26T00:00:55.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1969597898}) 2024-04-26T00:00:55.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=853705036}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1850080497}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1935849583}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1162177690}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3780232106}) 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3144135177}) 2024-04-26T00:00:55.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=741440566}) 2024-04-26T00:00:55.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2954968097}) 2024-04-26T00:00:55.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.504+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3672958094}) 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4111981569}) 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4224556377}) 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2111830015}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2507768885}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4242099407}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=92575766}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3232113284}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668410874}) 2024-04-26T00:00:55.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.508+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=722011258}) 2024-04-26T00:00:55.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2730712903}) 2024-04-26T00:00:55.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2368835884}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2665684077}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2981171448}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2753960174}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2466609959}) 2024-04-26T00:00:55.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3124456006}) 2024-04-26T00:00:55.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1939879621}) 2024-04-26T00:00:55.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.512+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=795046032}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2892920477}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2813856884}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3172389226}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4272862704}) 2024-04-26T00:00:55.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3060791873}) 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3749742479}) 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4281105705}) 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166063302}) 2024-04-26T00:00:55.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.516+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2734683976}) 2024-04-26T00:00:55.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1419358786}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=259298224}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3478113587}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3532566556}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2506448091}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2587997620}) 2024-04-26T00:00:55.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=313305415}) 2024-04-26T00:00:55.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4076857672}) 2024-04-26T00:00:55.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4145444282}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2454005095}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3612433398}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1233833169}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2392627968}) 2024-04-26T00:00:55.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=54384329}) 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=77633082}) 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3489847591}) 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3398722774}) 2024-04-26T00:00:55.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.520+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=395930856}) 2024-04-26T00:00:55.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2444077272}) 2024-04-26T00:00:55.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3698428223}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1612657768}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=879327834}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=56828603}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=604469976}) 2024-04-26T00:00:55.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=442593684}) 2024-04-26T00:00:55.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2127840800}) 2024-04-26T00:00:55.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.524+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3102649420}) 2024-04-26T00:00:55.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1068411130}) 2024-04-26T00:00:55.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1282805511}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3675521965}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=273440806}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3469621794}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2940862598}) 2024-04-26T00:00:55.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1253177488}) 2024-04-26T00:00:55.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3288021121}) 2024-04-26T00:00:55.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.528+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1906619801}) 2024-04-26T00:00:55.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1754076707}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1309184208}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=630093029}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2967748073}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3869792444}) 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1039565243}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1905089202}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3011390438}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3125641751}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4240551893}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3894007235}) 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1739037881}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3017391627}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1312384708}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=769888855}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3003463831}) 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3907528649}) 2024-04-26T00:00:55.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.532+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1394301813}) 2024-04-26T00:00:55.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1262530578}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3125203384}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3069084505}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1080259131}) 2024-04-26T00:00:55.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4067118760}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=425374235}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1097171718}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=43906488}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.536+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3392815614}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=190040571}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1599776226}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2858198659}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2211706228}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=485579018}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1607964925}) 2024-04-26T00:00:55.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3186827655}) 2024-04-26T00:00:55.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2058845507}) 2024-04-26T00:00:55.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1408232559}) 2024-04-26T00:00:55.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=353308512}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=803760571}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1511356355}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3538732931}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=543350745}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3196022720}) 2024-04-26T00:00:55.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1951217364}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801715052}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.540+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2163744366}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=34457407}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3590177305}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2783501121}) 2024-04-26T00:00:55.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1440273230}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=959455326}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3134046042}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=44827612}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2728195702}) 2024-04-26T00:00:55.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.544+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1764578888}) 2024-04-26T00:00:55.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3340463623}) 2024-04-26T00:00:55.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=106485773}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2060174497}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=869348427}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=948671395}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=927884068}) 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2943526634}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=820003831}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.548+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=952960727}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1375911004}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1486151401}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2528933644}) 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1434878533}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1131903546}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2317914513}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3394904649}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1213957296}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3910042684}) 2024-04-26T00:00:55.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2849054416}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3221102471}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=927653081}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1557885050}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=666852428}) 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1973902237}) 2024-04-26T00:00:55.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=490794082}) 2024-04-26T00:00:55.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733686202}) 2024-04-26T00:00:55.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.552+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3444717390}) 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=601729905}) 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1296070660}) 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4163961637}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3539965488}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=350142658}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1919874189}) 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2461255976}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2950058916}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.556+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3643037861}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3407919565}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1733365352}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4035217072}) 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1121523509}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1307349628}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=742562215}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=593373766}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3171290397}) 2024-04-26T00:00:55.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2624005297}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1374135346}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=905857834}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2438283909}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1009316251}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.560+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=771784225}) 2024-04-26T00:00:55.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=831151553}) 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2018406599}) 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=949961412}) 2024-04-26T00:00:55.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1840460508}) 2024-04-26T00:00:55.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2261895037}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3648981429}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=691360711}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1464606337}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=318572966}) 2024-04-26T00:00:55.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1286520104}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3238351885}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3059875561}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.564+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1644420253}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2421941188}) 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=926807303}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2259707389}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2932095274}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4262694847}) 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1455035882}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2446955400}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3484148180}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.568+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1945164079}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3956581502}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3658360079}) 2024-04-26T00:00:55.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=118155456}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1033109912}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2036301178}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3638410827}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=834249217}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2582411996}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3007671502}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1759859793}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3213296685}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1380270940}) 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2706101425}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2401591618}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2563929500}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2515777127}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1686339023}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.572+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3746786632}) 2024-04-26T00:00:55.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2578133136}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3499967140}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1119526824}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3545140882}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3549064511}) 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=359195760}) 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1345266542}) 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=658910980}) 2024-04-26T00:00:55.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.576+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=172525505}) 2024-04-26T00:00:55.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2248922006}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4032466656}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2650551223}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2478551373}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3281965773}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2711281312}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=313051657}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=698253255}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.580+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2902885998}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=708093772}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2526293362}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2017526174}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=906980772}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=940212186}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2499454013}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3645654803}) 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1103150360}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.584+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=500533048}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=30,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=28} crc {logm=4104122907,mdsmap=2840952586,mgr=119571008,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=268893920,mon_config_key=809949667,monmap=828017138,osd_metadata=3222539275,osd_pg_creating=933646749,osdmap=3485114370}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=29,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=3714098238,mdsmap=3140514009,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=268893920,mon_config_key=2083130969,monmap=828017138,osd_metadata=857068958,osd_pg_creating=933646749,osdmap=1153708475}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=11,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=29} crc {logm=2011601820,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1544513867,mon_config_key=809949667,monmap=828017138,osd_metadata=3222539275,osd_pg_creating=933646749,osdmap=1782445243}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=1502444100,mdsmap=2840952586,mgr=4272407599,mgr_command_descs=3057339439,mgr_metadata=177654402,mgrstat=3412997559,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=933646749,osdmap=2519864502}) 2024-04-26T00:00:55.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=29,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=31} crc {logm=2989695131,mdsmap=2840952586,mgr=3116468164,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=4140873819,mon_config_key=2083130969,monmap=828017138,osd_metadata=224540228,osd_pg_creating=933646749,osdmap=803100224}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=27} crc {logm=1611815262,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=268893920,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=933646749,osdmap=1205390792}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=28,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=30} crc {logm=3229303377,mdsmap=2840952586,mgr=3261276571,mgr_metadata=177654402,mgrstat=268893920,mon_config_key=2027163604,monmap=828017138,osd_metadata=857068958,osd_pg_creating=933646749,osdmap=133751808}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=29,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=28} crc {logm=1176662062,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3792368414,mon_config_key=3610483653,monmap=828017138,osd_metadata=3508034596,osd_pg_creating=933646749,osdmap=1272570725}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.588+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=28,mdsmap=3,mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=9,monmap=2,osd_metadata=5,osd_pg_creating=1,osdmap=36} crc {logm=3889359134,mdsmap=2840952586,mgr=331648069,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1557323987,mon_config_key=1478288380,monmap=375078350,osd_metadata=224540228,osd_pg_creating=933646749,osdmap=269441498}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=4242604387}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2101649137}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2953037580}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1077506704}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=73631297}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3743433552}) 2024-04-26T00:00:55.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=180946551}) 2024-04-26T00:00:55.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2178073062}) 2024-04-26T00:00:55.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.592+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1433389024}) 2024-04-26T00:00:55.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=711734296}) 2024-04-26T00:00:55.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=3262552722}) 2024-04-26T00:00:55.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=822954068}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1656435316}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=1861141335}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=1417962571}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2770851050}) 2024-04-26T00:00:55.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3941531680}) 2024-04-26T00:00:55.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.596+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2266146261}) 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=26} crc {osdmap=1832756385}) 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=26} crc {osdmap=1062852387}) 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=26} crc {osdmap=1832756385}) 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=24} crc {osdmap=3443531127}) 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=26} crc {osdmap=1832756385}) 2024-04-26T00:00:55.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=23} crc {osdmap=261352850}) 2024-04-26T00:00:55.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=26} crc {osdmap=1832756385}) 2024-04-26T00:00:55.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=25} crc {osdmap=3206952917}) 2024-04-26T00:00:55.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:00:55.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=26} crc {osdmap=1832756385}) 2024-04-26T00:00:55.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:00:55.608+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=21} crc {osdmap=3148918327}) 2024-04-26T00:00:55.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.795+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}]=0 added bucket h15 type host to location {rack=r1} v195) ==== 168+0+0 (unknown 1201641763 0 0) 0x7f55f8040e30 con 0x7f55f40062c0 2024-04-26T00:00:55.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.795+0000 7f55effff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:55.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.795+0000 7f55effff640 10 monclient: _finish_command 2 = system:0 added bucket h15 type host to location {rack=r1} 2024-04-26T00:00:55.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.899+0000 7f560da28640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:55.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.899+0000 7f560da28640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:55.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.899+0000 7f560da28640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:00:55.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.899+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f55e8004660 con 0x7f55f40062c0 2024-04-26T00:00:55.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.899+0000 7f55effff640 1 -- 172.21.15.171:0/3746162228 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h15' already exists v195) ==== 147+0+0 (unknown 2574471263 0 0) 0x7f55f8013940 con 0x7f55f40062c0 2024-04-26T00:00:55.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.899+0000 7f55effff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h15", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:55.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.899+0000 7f55effff640 10 monclient: _finish_command 3 = system:0 bucket 'h15' already exists 2024-04-26T00:00:55.882 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h15' already exists 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.171:6812/722422047 conn(0x7f55f403d790 legacy=0x7f55f403fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 10 monclient: shutdown 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 >> v1:172.21.15.171:6792/0 conn(0x7f55f40062c0 legacy=0x7f55f40086b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 shutdown_connections 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 >> 172.21.15.171:0/3746162228 conn(0x7f56080a6b30 msgr2=0x7f5608133f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 shutdown_connections 2024-04-26T00:00:55.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:55.903+0000 7f560da28640 1 -- 172.21.15.171:0/3746162228 wait complete. 2024-04-26T00:00:55.900 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:55.901 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h16 host rack=r1 2024-04-26T00:00:56.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.035+0000 7fc1a6eff640 10 monclient: get_monmap_and_config 2024-04-26T00:00:56.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.035+0000 7fc1a6eff640 10 monclient: build_initial_monmap 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient: monmap: 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:56.042547+0000 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:56.042547+0000 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:56.021 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:56.022 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:56.022 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:56.022 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:56.022 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:56.022 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 Processor -- start 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- start start 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient: init 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient: _add_conns ranks=[1,0,7,6,4,2,3,8,5] 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient(hunting): picked mon.noname-f con 0x7fc1a0072200 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient(hunting): picked mon.noname-a con 0x7fc1a00725e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:56.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient(hunting): picked mon.noname-i con 0x7fc1a00729c0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a006d9f0 con 0x7fc1a00725e0 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a00707a0 con 0x7fc1a0072200 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a0070a80 con 0x7fc1a00729c0 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient(hunting): authenticate will time out at 1306.749651s 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a549c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fc1a00729c0 0x7fc1a0144640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:39104/0 (socket says 172.21.15.171:39104) 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a549c640 1 -- 172.21.15.171:0/49745026 learned_addr learned my addr 172.21.15.171:0/49745026 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3798666340 0 0) 0x7fc1a0070a80 con 0x7fc1a00729c0 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): my global_id is 144853 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc18c003530 con 0x7fc1a00729c0 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132062072 0 0) 0x7fc1a00707a0 con 0x7fc1a0072200 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): my global_id is 144946 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1a0070a80 con 0x7fc1a0072200 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539197965 0 0) 0x7fc1a006d9f0 con 0x7fc1a00725e0 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient(hunting): my global_id is 6660 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1a00707a0 con 0x7fc1a00725e0 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2607400300 0 0) 0x7fc18c003530 con 0x7fc1a00729c0 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 >> v1:172.21.15.171:6789/0 conn(0x7fc1a0072200 legacy=0x7fc1a0071740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 >> v1:172.21.15.106:6789/0 conn(0x7fc1a00725e0 legacy=0x7fc1a0140f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 monclient: found mon.noname-i 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a006c0b0 con 0x7fc1a00729c0 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:56.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc190001b40 con 0x7fc1a00729c0 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: dump: 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.034 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 5 monclient: authenticate success, global_id 144853 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc190001da0 con 0x7fc1a00729c0 2024-04-26T00:00:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 1 -- 172.21.15.171:0/49745026 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc190004f70 con 0x7fc1a00729c0 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 4 set_mon_vals no callback set 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc19f7fe640 10 monclient: dump: 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 10 monclient: shutdown 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- 172.21.15.171:0/49745026 >> v1:172.21.15.171:6792/0 conn(0x7fc1a00729c0 legacy=0x7fc1a0144640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- 172.21.15.171:0/49745026 shutdown_connections 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- 172.21.15.171:0/49745026 >> 172.21.15.171:0/49745026 conn(0x7fc1a00a53f0 msgr2=0x7fc1a006b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- 172.21.15.171:0/49745026 shutdown_connections 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.039+0000 7fc1a6eff640 1 -- 172.21.15.171:0/49745026 wait complete. 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: build_initial_monmap 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: monmap: 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:56.038 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 Processor -- start 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 -- start start 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: init 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _add_conns ranks=[5,7,6,2,0,1,3,4,8] 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient(hunting): picked mon.noname-h con 0x7fc1a0072200 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient(hunting): picked mon.noname-i con 0x7fc1a00725e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient(hunting): picked mon.noname-d con 0x7fc1a00729c0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a0141290 con 0x7fc1a0072200 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a009e750 con 0x7fc1a00729c0 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc1a0072e30 con 0x7fc1a00725e0 2024-04-26T00:00:56.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient(hunting): authenticate will time out at 1306.753278s 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19ffff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fc1a00725e0 0x7fc1a0140b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:39118/0 (socket says 172.21.15.171:39118) 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19ffff640 1 -- 172.21.15.171:0/3383276986 learned_addr learned my addr 172.21.15.171:0/3383276986 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3412022724 0 0) 0x7fc1a0141290 con 0x7fc1a0072200 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): my global_id is 6404 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc180003530 con 0x7fc1a0072200 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2697791724 0 0) 0x7fc1a0072e30 con 0x7fc1a00725e0 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): my global_id is 144862 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1a0141290 con 0x7fc1a00725e0 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 286185928 0 0) 0x7fc180003530 con 0x7fc1a0072200 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc1a0072e30 con 0x7fc1a0072200 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3587020168 0 0) 0x7fc1a0141290 con 0x7fc1a00725e0 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc180003530 con 0x7fc1a00725e0 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc198001a60 con 0x7fc1a0072200 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): dump: 2024-04-26T00:00:56.042 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.043 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc188001aa0 con 0x7fc1a00725e0 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): dump: 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.044 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.045 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760986427 0 0) 0x7fc1a009e750 con 0x7fc1a00729c0 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient(hunting): my global_id is 6486 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc1a0141290 con 0x7fc1a00729c0 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2522852666 0 0) 0x7fc1a0072e30 con 0x7fc1a0072200 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 >> v1:172.21.15.171:6792/0 conn(0x7fc1a00725e0 legacy=0x7fc1a0140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 >> v1:172.21.15.106:6792/0 conn(0x7fc1a00729c0 legacy=0x7fc1a01d8fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 monclient: found mon.h 2024-04-26T00:00:56.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a0142b00 con 0x7fc1a0072200 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 5 monclient: authenticate success, global_id 6404 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _renew_subs 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a0142de0 con 0x7fc1a0072200 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _renew_subs 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc1a009da20 con 0x7fc1a0072200 2024-04-26T00:00:56.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a0068570 con 0x7fc1a0072200 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc1980038d0 con 0x7fc1a0072200 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc198003dc0 con 0x7fc1a0072200 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19effd640 4 set_mon_vals no callback set 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 10 monclient: dump: 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:56.048 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.049 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:56.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc19800eb60 con 0x7fc1a0072200 2024-04-26T00:00:56.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(195..195 src has 29..195) ==== 10267+0+0 (unknown 1664025750 0 0) 0x7fc198044ba0 con 0x7fc1a0072200 2024-04-26T00:00:56.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.043+0000 7fc19ffff640 10 monclient: get_auth_request con 0x7fc180037ea0 auth_method 0 2024-04-26T00:00:56.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.051+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc1980143b0 con 0x7fc1a0072200 2024-04-26T00:00:56.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.051+0000 7fc19d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.050 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.051+0000 7fc19d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:56.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.215+0000 7fc1a6eff640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:56.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.215+0000 7fc1a6eff640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:56.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.215+0000 7fc1a6eff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:56.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.215+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fc1a00689c0 con 0x7fc1a0072200 2024-04-26T00:00:56.467 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:00:56.467 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:00:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient: get_monmap_and_config 2024-04-26T00:00:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient: build_initial_monmap 2024-04-26T00:00:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient: monmap: 2024-04-26T00:00:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:56.611707+0000 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:56.611707+0000 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:56.591 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 1 Processor -- start 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 1 -- start start 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient: init 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient: _add_conns ranks=[0,5,2,8,4,6,7,3,1] 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient(hunting): picked mon.noname-a con 0x7f2470134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient(hunting): picked mon.noname-h con 0x7f24700a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient(hunting): picked mon.noname-b con 0x7f247013e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247006dd40 con 0x7f2470134970 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24700a2b10 con 0x7f247013e200 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24700a2df0 con 0x7f24700a4820 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:56.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 10 monclient(hunting): authenticate will time out at 1312.138967s 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2476228640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f247013e200 0x7f24701405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:41776/0 (socket says 172.21.15.106:41776) 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2476228640 1 -- 172.21.15.106:0/1270997361 learned_addr learned my addr 172.21.15.106:0/1270997361 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321620569 0 0) 0x7f24700a2b10 con 0x7f247013e200 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): my global_id is 6437 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f245c003530 con 0x7f247013e200 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873283063 0 0) 0x7f247006dd40 con 0x7f2470134970 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient(hunting): my global_id is 6669 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24700a2b10 con 0x7f2470134970 2024-04-26T00:00:56.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2909357990 0 0) 0x7f245c003530 con 0x7f247013e200 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 >> v1:172.21.15.171:6791/0 conn(0x7f24700a4820 legacy=0x7f247013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 >> v1:172.21.15.106:6789/0 conn(0x7f2470134970 legacy=0x7f2470134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient: _finish_hunting 0 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 monclient: found mon.noname-b 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24700a30d0 con 0x7f247013e200 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient: _finish_auth 0 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient: _check_auth_tickets 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2468001b40 con 0x7f247013e200 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 5 monclient: authenticate success, global_id 6437 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2474a25640 10 monclient: dump: 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.601 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.608+0000 7f2477c8b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2468001d30 con 0x7f247013e200 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2474a25640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 4 set_mon_vals no callback set 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2474a25640 1 -- 172.21.15.106:0/1270997361 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2468004f70 con 0x7f247013e200 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2474a25640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2474a25640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2474a25640 10 monclient: dump: 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.602 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: shutdown 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- 172.21.15.106:0/1270997361 >> v1:172.21.15.106:6790/0 conn(0x7f247013e200 legacy=0x7f24701405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- 172.21.15.106:0/1270997361 shutdown_connections 2024-04-26T00:00:56.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- 172.21.15.106:0/1270997361 >> 172.21.15.106:0/1270997361 conn(0x7f24700a9e20 msgr2=0x7f24700aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- 172.21.15.106:0/1270997361 shutdown_connections 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- 172.21.15.106:0/1270997361 wait complete. 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: build_initial_monmap 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: monmap: 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:56.604 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 Processor -- start 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- start start 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: init 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: _add_conns ranks=[6,2,8,5,3,7,4,1,0] 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient(hunting): picked mon.noname-d con 0x7f24700a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient(hunting): picked mon.noname-b con 0x7f2470134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient(hunting): picked mon.noname-e con 0x7f247013e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24701396d0 con 0x7f2470134970 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247013adf0 con 0x7f24700a4820 2024-04-26T00:00:56.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2470139c20 con 0x7f247013e200 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient(hunting): authenticate will time out at 1312.142084s 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2475a27640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f24700a4820 0x7f24701388b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60070/0 (socket says 172.21.15.106:60070) 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2475a27640 1 -- 172.21.15.106:0/1432358850 learned_addr learned my addr 172.21.15.106:0/1432358850 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59321797 0 0) 0x7f24701396d0 con 0x7f2470134970 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): my global_id is 6446 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2454003530 con 0x7f2470134970 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 887559288 0 0) 0x7f2470139c20 con 0x7f247013e200 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): my global_id is 204200 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24701396d0 con 0x7f247013e200 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608966458 0 0) 0x7f247013adf0 con 0x7f24700a4820 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): my global_id is 6495 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2470139c20 con 0x7f24700a4820 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3234749509 0 0) 0x7f2454003530 con 0x7f2470134970 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f247013adf0 con 0x7f2470134970 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f246c0019e0 con 0x7f2470134970 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): dump: 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.607 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:56.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3339446423 0 0) 0x7f24701396d0 con 0x7f247013e200 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2454003530 con 0x7f247013e200 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2778327823 0 0) 0x7f2470139c20 con 0x7f24700a4820 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24701396d0 con 0x7f24700a4820 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2468001a40 con 0x7f247013e200 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): dump: 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.609 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2464001580 con 0x7f24700a4820 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient(hunting): dump: 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.610 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 822741842 0 0) 0x7f247013adf0 con 0x7f2470134970 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 >> v1:172.21.15.106:6793/0 conn(0x7f247013e200 legacy=0x7f24701d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 >> v1:172.21.15.106:6792/0 conn(0x7f24700a4820 legacy=0x7f24701388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 monclient: found mon.b 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247013ab10 con 0x7f2470134970 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 5 monclient: authenticate success, global_id 6446 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: _renew_subs 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2470138340 con 0x7f2470134970 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: _renew_subs 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2470137690 con 0x7f2470134970 2024-04-26T00:00:56.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f246c0038d0 con 0x7f2470134970 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f246c003dc0 con 0x7f2470134970 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f2463fff640 4 set_mon_vals no callback set 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 10 monclient: dump: 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.613 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.612+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f246c003f60 con 0x7f2470134970 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.616+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(195..195 src has 29..195) ==== 10267+0+0 (unknown 1664025750 0 0) 0x7f246c044ce0 con 0x7f2470134970 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.616+0000 7f2477c8b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.616+0000 7f2477c8b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.616+0000 7f2477c8b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.616+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2458005090 con 0x7f2470134970 2024-04-26T00:00:56.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.616+0000 7f2475a27640 10 monclient: get_auth_request con 0x7f24540381c0 auth_method 0 2024-04-26T00:00:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.620+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f246c014530 con 0x7f2470134970 2024-04-26T00:00:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.620+0000 7f24627fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.620+0000 7f24627fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:56.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.763+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}]=0 added bucket h16 type host to location {rack=r1} v196) ==== 168+0+0 (unknown 2788102351 0 0) 0x7fc198018060 con 0x7fc1a0072200 2024-04-26T00:00:56.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.763+0000 7fc19d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:56.747 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.763+0000 7fc19d7fa640 10 monclient: _finish_command 2 = system:0 added bucket h16 type host to location {rack=r1} 2024-04-26T00:00:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.848+0000 7f2477c8b640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:00:56.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.848+0000 7f2477c8b640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:00:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.848+0000 7f2477c8b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.848+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2458005380 con 0x7f2470134970 2024-04-26T00:00:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.848+0000 7f24627fc640 1 -- 172.21.15.106:0/1432358850 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 4247185910) 0x7f246c013e30 con 0x7f2470134970 2024-04-26T00:00:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.848+0000 7f24627fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:00:56.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.848+0000 7f24627fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:56.832 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":40,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 >> v1:172.21.15.171:6812/722422047 conn(0x7f24540381c0 legacy=0x7f245403a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 10 monclient: shutdown 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 >> v1:172.21.15.106:6790/0 conn(0x7f2470134970 legacy=0x7f2470138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 shutdown_connections 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 >> 172.21.15.106:0/1432358850 conn(0x7f24700a9e20 msgr2=0x7f2470130bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 shutdown_connections 2024-04-26T00:00:56.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.852+0000 7f2477c8b640 1 -- 172.21.15.106:0/1432358850 wait complete. 2024-04-26T00:00:56.849 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:00:56.849 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T00:00:56.850 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:00:56.850 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:00:56.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.867+0000 7fc1a6eff640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:56.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.867+0000 7fc1a6eff640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:56.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.867+0000 7fc1a6eff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:56.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.867+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fc1a00008e0 con 0x7fc1a0072200 2024-04-26T00:00:56.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc19d7fa640 1 -- 172.21.15.171:0/3383276986 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h16' already exists v196) ==== 147+0+0 (unknown 3608114618 0 0) 0x7fc19801c920 con 0x7fc1a0072200 2024-04-26T00:00:56.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc19d7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h16", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:56.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc19d7fa640 10 monclient: _finish_command 3 = system:0 bucket 'h16' already exists 2024-04-26T00:00:56.854 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h16' already exists 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 >> v1:172.21.15.171:6812/722422047 conn(0x7fc180037ea0 legacy=0x7fc18003a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 10 monclient: shutdown 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 >> v1:172.21.15.171:6791/0 conn(0x7fc1a0072200 legacy=0x7fc1a0140470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 shutdown_connections 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 >> 172.21.15.171:0/3383276986 conn(0x7fc1a00a53f0 msgr2=0x7fc1a00a2fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 shutdown_connections 2024-04-26T00:00:56.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:56.871+0000 7fc1a6eff640 1 -- 172.21.15.171:0/3383276986 wait complete. 2024-04-26T00:00:56.871 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:56.871 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h17 host rack=r1 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: get_monmap_and_config 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: build_initial_monmap 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: monmap: 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:56.986598+0000 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:56.986598+0000 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:56.964 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:56.965 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 Processor -- start 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- start start 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: init 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: _add_conns ranks=[4,1,2,8,7,3,0,5,6] 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient(hunting): picked mon.noname-c con 0x7fa728134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient(hunting): picked mon.noname-f con 0x7fa7280a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient(hunting): picked mon.noname-b con 0x7fa72813e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72806dd40 con 0x7fa7280a4820 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7280a2b10 con 0x7fa72813e200 2024-04-26T00:00:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7280a2df0 con 0x7fa728134970 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient(hunting): authenticate will time out at 1312.513710s 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72d086640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fa728134970 0x7fa728134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:35478/0 (socket says 172.21.15.106:35478) 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72d086640 1 -- 172.21.15.106:0/2016657523 learned_addr learned my addr 172.21.15.106:0/2016657523 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4117346500 0 0) 0x7fa7280a2df0 con 0x7fa728134970 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): my global_id is 145084 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa714003530 con 0x7fa728134970 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229689453 0 0) 0x7fa7280a2b10 con 0x7fa72813e200 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient(hunting): my global_id is 6455 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7280a2df0 con 0x7fa72813e200 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 734193197 0 0) 0x7fa714003530 con 0x7fa728134970 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 >> v1:172.21.15.106:6790/0 conn(0x7fa72813e200 legacy=0x7fa7281405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 >> v1:172.21.15.171:6789/0 conn(0x7fa7280a4820 legacy=0x7fa72813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:56.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 monclient: found mon.noname-c 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280a30d0 con 0x7fa728134970 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: _finish_auth 0 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa7180017c0 con 0x7fa728134970 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: dump: 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.976 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 5 monclient: authenticate success, global_id 145084 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:56.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa718001a30 con 0x7fa728134970 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 1 -- 172.21.15.106:0/2016657523 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa718004bf0 con 0x7fa728134970 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa71ffff640 10 monclient: dump: 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.978 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 4 set_mon_vals no callback set 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: shutdown 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- 172.21.15.106:0/2016657523 >> v1:172.21.15.106:6791/0 conn(0x7fa728134970 legacy=0x7fa728134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- 172.21.15.106:0/2016657523 shutdown_connections 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- 172.21.15.106:0/2016657523 >> 172.21.15.106:0/2016657523 conn(0x7fa7280a9e20 msgr2=0x7fa7280aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- 172.21.15.106:0/2016657523 shutdown_connections 2024-04-26T00:00:56.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 1 -- 172.21.15.106:0/2016657523 wait complete. 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: build_initial_monmap 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.984+0000 7fa72f2ea640 10 monclient: monmap: 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:56.980 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 Processor -- start 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 -- start start 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient: init 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient: _add_conns ranks=[2,8,0,6,1,7,3,4,5] 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient(hunting): picked mon.noname-b con 0x7fa7280a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient(hunting): picked mon.noname-e con 0x7fa728134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient(hunting): picked mon.noname-a con 0x7fa72813e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7281cd6b0 con 0x7fa72813e200 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72813b8b0 con 0x7fa7280a4820 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa7280a1a40 con 0x7fa728134970 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:56.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient(hunting): authenticate will time out at 1312.516828s 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72d086640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fa7280a4820 0x7fa7281cc890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:41798/0 (socket says 172.21.15.106:41798) 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72d086640 1 -- 172.21.15.106:0/1882133681 learned_addr learned my addr 172.21.15.106:0/1882133681 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72d887640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa72813e200 0x7fa7281d4e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41864/0 (socket says 172.21.15.106:41864) 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 558016750 0 0) 0x7fa72813b8b0 con 0x7fa7280a4820 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): my global_id is 6464 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa70c003530 con 0x7fa7280a4820 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960704768 0 0) 0x7fa7280a1a40 con 0x7fa728134970 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): my global_id is 204209 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa72813b8b0 con 0x7fa728134970 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 944303858 0 0) 0x7fa7281cd6b0 con 0x7fa72813e200 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): my global_id is 6678 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7280a1a40 con 0x7fa72813e200 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1588815062 0 0) 0x7fa70c003530 con 0x7fa7280a4820 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7281cd6b0 con 0x7fa7280a4820 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa718004b30 con 0x7fa7280a4820 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.983 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1643730008 0 0) 0x7fa7280a1a40 con 0x7fa72813e200 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa70c003530 con 0x7fa72813e200 2024-04-26T00:00:56.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3462529020 0 0) 0x7fa72813b8b0 con 0x7fa728134970 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7280a1a40 con 0x7fa728134970 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa720001ce0 con 0x7fa72813e200 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.985 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa724001960 con 0x7fa728134970 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): dump: 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2688792394 0 0) 0x7fa7281cd6b0 con 0x7fa7280a4820 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.106:6793/0 conn(0x7fa728134970 legacy=0x7fa7281ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.106:6789/0 conn(0x7fa72813e200 legacy=0x7fa7281d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 monclient: found mon.b 2024-04-26T00:00:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa728138b40 con 0x7fa7280a4820 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 5 monclient: authenticate success, global_id 6464 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient: _renew_subs 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa72813a650 con 0x7fa7280a4820 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient: _renew_subs 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa72813d0f0 con 0x7fa7280a4820 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa718001a30 con 0x7fa7280a4820 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa7180011c0 con 0x7fa7280a4820 2024-04-26T00:00:56.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71f7fe640 4 set_mon_vals no callback set 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: dump: 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa71800fe80 con 0x7fa7280a4820 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa7080065d0 con 0x7fa708002870 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(196..196 src has 29..196) ==== 10736+0+0 (unknown 889589031 0 0) 0x7fa718046310 con 0x7fa7280a4820 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892023720 0 0) 0x7fa7080065d0 con 0x7fa708002870 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient(hunting): my global_id is 6687 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7281cd6b0 con 0x7fa708002870 2024-04-26T00:00:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa72d887640 10 monclient: get_auth_request con 0x7fa70c0381f0 auth_method 0 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1389656774 0 0) 0x7fa7281cd6b0 con 0x7fa708002870 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa7080065d0 con 0x7fa708002870 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa724003960 con 0x7fa708002870 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: dump: 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2008175060 0 0) 0x7fa7080065d0 con 0x7fa708002870 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa70800a160 con 0x7fa708002870 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa724004650 con 0x7fa708002870 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.106:6789/0 conn(0x7fa708002870 legacy=0x7fa708004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.988+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.106:6789/0 conn(0x7fa708002870 legacy=0x7fa708004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa708009e50 con 0x7fa708009110 2024-04-26T00:00:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438494574 0 0) 0x7fa708009e50 con 0x7fa708009110 2024-04-26T00:00:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient(hunting): my global_id is 6696 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7080065d0 con 0x7fa708009110 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1698157923 0 0) 0x7fa7080065d0 con 0x7fa708009110 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa708009e50 con 0x7fa708009110 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa724004240 con 0x7fa708009110 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient: dump: 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3081079980 0 0) 0x7fa708009e50 con 0x7fa708009110 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa70800c3e0 con 0x7fa708009110 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 440144877) 0x7fa724004800 con 0x7fa708009110 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:56.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.106:6789/0 conn(0x7fa708009110 legacy=0x7fa7080095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa71dffb640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.106:6789/0 conn(0x7fa708009110 legacy=0x7fa7080095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 375555, 2024-04-26T00:00:56.998 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:56.999 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:57.000 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:57.001 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:57.002 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:57.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:57.004 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.006 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.007 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:57.009 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:57.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.011 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.012 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:57.014 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.015 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:57.016 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.171:6812/722422047 conn(0x7fa70c0381f0 legacy=0x7fa70c03a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 10 monclient: shutdown 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 >> v1:172.21.15.106:6790/0 conn(0x7fa7280a4820 legacy=0x7fa7281cc890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72d887640 1 -- 172.21.15.106:0/1882133681 reap_dead start 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72d887640 1 -- 172.21.15.106:0/1882133681 reap_dead start 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 shutdown_connections 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 >> 172.21.15.106:0/1882133681 conn(0x7fa7280a9e20 msgr2=0x7fa728130a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 shutdown_connections 2024-04-26T00:00:57.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:56.996+0000 7fa72f2ea640 1 -- 172.21.15.106:0/1882133681 wait complete. 2024-04-26T00:00:57.020 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:57.020 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:00:57.020 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient: get_monmap_and_config 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient: monmap: 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:57.011948+0000 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:57.011948+0000 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.025 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 1 Processor -- start 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 1 -- start start 2024-04-26T00:00:57.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient: init 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient: _add_conns ranks=[6,2,3,7,5,4,8,1,0] 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient(hunting): picked mon.noname-d con 0x7fbae8135a00 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient(hunting): picked mon.noname-b con 0x7fbae80a1790 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient(hunting): picked mon.noname-g con 0x7fbae813c130 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae80a1d80 con 0x7fbae80a1790 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae8072f70 con 0x7fbae813c130 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae8072640 con 0x7fbae8135a00 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient(hunting): authenticate will time out at 1307.718983s 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaee1da640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbae813c130 0x7fbae813e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58742/0 (socket says 172.21.15.171:58742) 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaee1da640 1 -- 172.21.15.171:0/1889006382 learned_addr learned my addr 172.21.15.171:0/1889006382 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893008445 0 0) 0x7fbae8072f70 con 0x7fbae813c130 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): my global_id is 6726 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbad4003530 con 0x7fbae813c130 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3276923587 0 0) 0x7fbae8072640 con 0x7fbae8135a00 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): my global_id is 6504 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae8072f70 con 0x7fbae8135a00 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969666915 0 0) 0x7fbae80a1d80 con 0x7fbae80a1790 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient(hunting): my global_id is 6473 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae8072640 con 0x7fbae80a1790 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3921888645 0 0) 0x7fbad4003530 con 0x7fbae813c130 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 >> v1:172.21.15.106:6792/0 conn(0x7fbae8135a00 legacy=0x7fbae8135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 >> v1:172.21.15.106:6790/0 conn(0x7fbae80a1790 legacy=0x7fbae813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 monclient: found mon.noname-g 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae8072920 con 0x7fbae813c130 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbae0001b40 con 0x7fbae813c130 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: dump: 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.030 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 5 monclient: authenticate success, global_id 6726 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbae0001df0 con 0x7fbae813c130 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 1 -- 172.21.15.171:0/1889006382 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbae0004f70 con 0x7fbae813c130 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaefc3d640 4 set_mon_vals no callback set 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.006+0000 7fbaec9d7640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaec9d7640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaec9d7640 10 monclient: dump: 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.032 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: shutdown 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/1889006382 >> v1:172.21.15.171:6790/0 conn(0x7fbae813c130 legacy=0x7fbae813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/1889006382 shutdown_connections 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/1889006382 >> 172.21.15.171:0/1889006382 conn(0x7fbae80a2690 msgr2=0x7fbae80a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/1889006382 shutdown_connections 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/1889006382 wait complete. 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: monmap: 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:57.033 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.034 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 Processor -- start 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- start start 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: init 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _add_conns ranks=[7,6,3,2,8,1,4,5,0] 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient(hunting): picked mon.noname-i con 0x7fbae80a1790 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient(hunting): picked mon.noname-d con 0x7fbae8135a00 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient(hunting): picked mon.noname-g con 0x7fbae813c130 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae8136fa0 con 0x7fbae813c130 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae809f6f0 con 0x7fbae8135a00 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbae8136cc0 con 0x7fbae80a1790 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient(hunting): authenticate will time out at 1307.722122s 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaee1da640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fbae813c130 0x7fbae81d2e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58750/0 (socket says 172.21.15.171:58750) 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaee1da640 1 -- 172.21.15.171:0/3458193342 learned_addr learned my addr 172.21.15.171:0/3458193342 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2918789811 0 0) 0x7fbae8136fa0 con 0x7fbae813c130 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): my global_id is 6735 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbacc003530 con 0x7fbae813c130 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707509653 0 0) 0x7fbae8136cc0 con 0x7fbae80a1790 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): my global_id is 144871 2024-04-26T00:00:57.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae8136fa0 con 0x7fbae80a1790 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2150224043 0 0) 0x7fbae809f6f0 con 0x7fbae8135a00 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): my global_id is 6513 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae8136cc0 con 0x7fbae8135a00 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3508703365 0 0) 0x7fbae8136cc0 con 0x7fbae8135a00 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbae809f6f0 con 0x7fbae8135a00 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4085526478 0 0) 0x7fbacc003530 con 0x7fbae813c130 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbae8136cc0 con 0x7fbae813c130 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1914471417 0 0) 0x7fbae8136fa0 con 0x7fbae80a1790 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbacc003530 con 0x7fbae80a1790 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbae4001910 con 0x7fbae8135a00 2024-04-26T00:00:57.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): dump: 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.038 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbae0004eb0 con 0x7fbae813c130 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): dump: 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.039 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbadc0019e0 con 0x7fbae80a1790 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:57.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient(hunting): dump: 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.041 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1200372875 0 0) 0x7fbae809f6f0 con 0x7fbae8135a00 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 >> v1:172.21.15.171:6792/0 conn(0x7fbae80a1790 legacy=0x7fbae812c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 >> v1:172.21.15.171:6790/0 conn(0x7fbae813c130 legacy=0x7fbae81d2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 monclient: found mon.d 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbae809de60 con 0x7fbae8135a00 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 5 monclient: authenticate success, global_id 6513 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _renew_subs 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbae809dba0 con 0x7fbae8135a00 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _renew_subs 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbae809c8a0 con 0x7fbae8135a00 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbae4001cb0 con 0x7fbae8135a00 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbae4003c10 con 0x7fbae8135a00 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbadbfff640 4 set_mon_vals no callback set 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbada7fc640 10 monclient: dump: 2024-04-26T00:00:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.010+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad0005090 con 0x7fbae8135a00 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.014+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbae400e9b0 con 0x7fbae8135a00 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.014+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(196..196 src has 29..196) ==== 10736+0+0 (unknown 889589031 0 0) 0x7fbae4044e60 con 0x7fbae8135a00 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.014+0000 7fbaed9d9640 10 monclient: get_auth_request con 0x7fbacc038290 auth_method 0 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.018+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbae40145c0 con 0x7fbae8135a00 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.018+0000 7fbada7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.018+0000 7fbada7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:57.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.182+0000 7fbaefc3d640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:57.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.182+0000 7fbaefc3d640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:57.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.182+0000 7fbaefc3d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.182+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fbad0005380 con 0x7fbae8135a00 2024-04-26T00:00:57.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.184+0000 7f4a60c94640 10 monclient: get_monmap_and_config 2024-04-26T00:00:57.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.184+0000 7f4a60c94640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: monmap: 2024-04-26T00:00:57.167 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.167 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.167 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:57.190419+0000 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:57.190419+0000 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.168 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 Processor -- start 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- start start 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: init 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: _add_conns ranks=[8,5,3,4,0,1,2,7,6] 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient(hunting): picked mon.noname-e con 0x7f4a5c0a13c0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient(hunting): picked mon.noname-h con 0x7f4a5c0a17a0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient(hunting): picked mon.noname-g con 0x7f4a5c13c040 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c068070 con 0x7f4a5c13c040 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c0a1fb0 con 0x7f4a5c0a17a0 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c072660 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient(hunting): authenticate will time out at 1312.717612s 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5a59c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f4a5c0a13c0 0x7f4a5c135c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:56116/0 (socket says 172.21.15.106:56116) 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5a59c640 1 -- 172.21.15.106:0/3720914144 learned_addr learned my addr 172.21.15.106:0/3720914144 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411335336 0 0) 0x7f4a5c072660 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient(hunting): my global_id is 204218 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a44003530 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3798929566 0 0) 0x7f4a44003530 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 >> v1:172.21.15.171:6791/0 conn(0x7f4a5c0a17a0 legacy=0x7f4a5c13a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 >> v1:172.21.15.171:6790/0 conn(0x7f4a5c13c040 legacy=0x7f4a5c13e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 monclient: found mon.noname-e 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c072940 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4a4c0017c0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: dump: 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.180 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 5 monclient: authenticate success, global_id 204218 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a4c001ab0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 1 -- 172.21.15.106:0/3720914144 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4a4c004bf0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 4 set_mon_vals no callback set 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a5959a640 10 monclient: dump: 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.182 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: shutdown 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- 172.21.15.106:0/3720914144 >> v1:172.21.15.106:6793/0 conn(0x7f4a5c0a13c0 legacy=0x7f4a5c135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- 172.21.15.106:0/3720914144 shutdown_connections 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- 172.21.15.106:0/3720914144 >> 172.21.15.106:0/3720914144 conn(0x7f4a5c06b210 msgr2=0x7f4a5c06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- 172.21.15.106:0/3720914144 shutdown_connections 2024-04-26T00:00:57.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 -- 172.21.15.106:0/3720914144 wait complete. 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 10 monclient: monmap: 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.184 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.188+0000 7f4a60c94640 1 Processor -- start 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 1 -- start start 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient: init 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient: _add_conns ranks=[2,1,7,4,5,8,3,0,6] 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient(hunting): picked mon.noname-b con 0x7f4a5c0a13c0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient(hunting): picked mon.noname-f con 0x7f4a5c0a17a0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient(hunting): picked mon.noname-i con 0x7f4a5c13c040 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c09bea0 con 0x7f4a5c0a17a0 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c09da40 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4a5c09b7c0 con 0x7f4a5c13c040 2024-04-26T00:00:57.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient(hunting): authenticate will time out at 1312.720496s 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a5a59c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f4a5c0a13c0 0x7f4a5c09a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:41804/0 (socket says 172.21.15.106:41804) 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a5a59c640 1 -- 172.21.15.106:0/2894676987 learned_addr learned my addr 172.21.15.106:0/2894676987 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322636427 0 0) 0x7f4a5c09da40 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): my global_id is 6482 2024-04-26T00:00:57.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a3c003530 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881781119 0 0) 0x7f4a5c09b7c0 con 0x7f4a5c13c040 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): my global_id is 144880 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a5c09da40 con 0x7f4a5c13c040 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3739035426 0 0) 0x7f4a3c003530 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a5c09b7c0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193114289 0 0) 0x7f4a5c09bea0 con 0x7f4a5c0a17a0 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): my global_id is 144964 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a3c003530 con 0x7f4a5c0a17a0 2024-04-26T00:00:57.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4a4c001780 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): dump: 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.188 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1938850639 0 0) 0x7f4a5c09b7c0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.171:6792/0 conn(0x7f4a5c13c040 legacy=0x7f4a5c1d2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.171:6789/0 conn(0x7f4a5c0a17a0 legacy=0x7f4a5c09b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 monclient: found mon.b 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a5c071870 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 5 monclient: authenticate success, global_id 6482 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient: _renew_subs 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4a5c0a1d30 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient: _renew_subs 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4a5c13e6d0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4a4c001180 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4a4c0051b0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a58d99640 4 set_mon_vals no callback set 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: dump: 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.191 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4a400065d0 con 0x7f4a40002870 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4a4c00ff50 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(196..196 src has 29..196) ==== 10736+0+0 (unknown 889589031 0 0) 0x7f4a4c0461e0 con 0x7f4a5c0a13c0 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 881906597 0 0) 0x7f4a400065d0 con 0x7f4a40002870 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient(hunting): my global_id is 6491 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a5c09b7c0 con 0x7f4a40002870 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a5ad9d640 10 monclient: get_auth_request con 0x7f4a3c037840 auth_method 0 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1670034328 0 0) 0x7f4a5c09b7c0 con 0x7f4a40002870 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a400065d0 con 0x7f4a40002870 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4a50001940 con 0x7f4a40002870 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: dump: 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.193 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2258177326 0 0) 0x7f4a400065d0 con 0x7f4a40002870 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4a4000a160 con 0x7f4a40002870 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4a50004650 con 0x7f4a40002870 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:57.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.106:6790/0 conn(0x7f4a40002870 legacy=0x7f4a40004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.192+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.106:6790/0 conn(0x7f4a40002870 legacy=0x7f4a40004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:57.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4a40009e30 con 0x7f4a400090f0 2024-04-26T00:00:57.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2484163131 0 0) 0x7f4a40009e30 con 0x7f4a400090f0 2024-04-26T00:00:57.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient(hunting): my global_id is 6500 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4a400065d0 con 0x7f4a400090f0 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2388873167 0 0) 0x7f4a400065d0 con 0x7f4a400090f0 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4a40009e30 con 0x7f4a400090f0 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4a50003b90 con 0x7f4a400090f0 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient: dump: 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.197 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3259151268 0 0) 0x7f4a40009e30 con 0x7f4a400090f0 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4a4000c3a0 con 0x7f4a400090f0 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2960465203) 0x7f4a50004800 con 0x7f4a400090f0 2024-04-26T00:00:57.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.106:6790/0 conn(0x7f4a400090f0 legacy=0x7f4a40009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a4affd640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.106:6790/0 conn(0x7f4a400090f0 legacy=0x7f4a40009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 375763, 2024-04-26T00:00:57.199 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:57.200 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.201 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:57.202 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.203 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.204 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:57.205 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.206 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.208 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:57.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.211 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.216 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:57.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.218 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:57.219 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.171:6812/722422047 conn(0x7f4a3c037840 legacy=0x7f4a3c039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 10 monclient: shutdown 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 >> v1:172.21.15.106:6790/0 conn(0x7f4a5c0a13c0 legacy=0x7f4a5c09a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a5ad9d640 1 -- 172.21.15.106:0/2894676987 reap_dead start 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a5ad9d640 1 -- 172.21.15.106:0/2894676987 reap_dead start 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 shutdown_connections 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 >> 172.21.15.106:0/2894676987 conn(0x7f4a5c06b210 msgr2=0x7f4a5c12ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 shutdown_connections 2024-04-26T00:00:57.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.200+0000 7f4a60c94640 1 -- 172.21.15.106:0/2894676987 wait complete. 2024-04-26T00:00:57.221 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:57.221 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:00:57.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:00:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: get_monmap_and_config 2024-04-26T00:00:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: monmap: 2024-04-26T00:00:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:57.359060+0000 2024-04-26T00:00:57.336 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:57.359060+0000 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.337 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 Processor -- start 2024-04-26T00:00:57.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- start start 2024-04-26T00:00:57.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: init 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: _add_conns ranks=[2,0,5,6,3,1,8,7,4] 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient(hunting): picked mon.noname-b con 0x7f453c1357a0 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient(hunting): picked mon.noname-a con 0x7f453c135390 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient(hunting): picked mon.noname-h con 0x7f453c071d30 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c136290 con 0x7f453c135390 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c0724c0 con 0x7f453c1357a0 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c0a5110 con 0x7f453c071d30 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient(hunting): authenticate will time out at 1312.886271s 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4541259640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f453c135390 0x7f453c13a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41894/0 (socket says 172.21.15.106:41894) 2024-04-26T00:00:57.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4541259640 1 -- 172.21.15.106:0/1669789683 learned_addr learned my addr 172.21.15.106:0/1669789683 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4541a5a640 1 --1- 172.21.15.106:0/1669789683 >> v1:172.21.15.106:6790/0 conn(0x7f453c1357a0 0x7f453c135b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:41826/0 (socket says 172.21.15.106:41826) 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581055017 0 0) 0x7f453c136290 con 0x7f453c135390 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): my global_id is 6705 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4524003530 con 0x7f453c135390 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796343375 0 0) 0x7f453c0724c0 con 0x7f453c1357a0 2024-04-26T00:00:57.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient(hunting): my global_id is 6509 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f453c136290 con 0x7f453c1357a0 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1415032580 0 0) 0x7f453c136290 con 0x7f453c1357a0 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 >> v1:172.21.15.171:6791/0 conn(0x7f453c071d30 legacy=0x7f453c13dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 >> v1:172.21.15.106:6789/0 conn(0x7f453c135390 legacy=0x7f453c13a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 monclient: found mon.noname-b 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c070fa0 con 0x7f453c1357a0 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4534001b40 con 0x7f453c1357a0 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 5 monclient: authenticate success, global_id 6509 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: dump: 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.348 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4534001db0 con 0x7f453c1357a0 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 1 -- 172.21.15.106:0/1669789683 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4534004eb0 con 0x7f453c1357a0 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 4 set_mon_vals no callback set 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:57.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4540a58640 10 monclient: dump: 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.350 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 10 monclient: shutdown 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- 172.21.15.106:0/1669789683 >> v1:172.21.15.106:6790/0 conn(0x7f453c1357a0 legacy=0x7f453c135b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- 172.21.15.106:0/1669789683 shutdown_connections 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- 172.21.15.106:0/1669789683 >> 172.21.15.106:0/1669789683 conn(0x7f453c0a8370 msgr2=0x7f453c0a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- 172.21.15.106:0/1669789683 shutdown_connections 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.356+0000 7f4543cbe640 1 -- 172.21.15.106:0/1669789683 wait complete. 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: monmap: 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.351 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.352 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 Processor -- start 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 -- start start 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: init 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: _add_conns ranks=[0,4,5,6,3,8,1,7,2] 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient(hunting): picked mon.noname-a con 0x7f453c071d30 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient(hunting): picked mon.noname-c con 0x7f453c135390 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient(hunting): picked mon.noname-h con 0x7f453c1357a0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c137fa0 con 0x7f453c071d30 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c0a1910 con 0x7f453c135390 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f453c0a1450 con 0x7f453c1357a0 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient(hunting): authenticate will time out at 1312.889440s 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4541259640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f453c135390 0x7f453c1341b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:35490/0 (socket says 172.21.15.106:35490) 2024-04-26T00:00:57.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4541259640 1 -- 172.21.15.106:0/1857797078 learned_addr learned my addr 172.21.15.106:0/1857797078 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4541a5a640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f453c071d30 0x7f453c133aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41898/0 (socket says 172.21.15.106:41898) 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723428371 0 0) 0x7f453c137fa0 con 0x7f453c071d30 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): my global_id is 6714 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4528003530 con 0x7f453c071d30 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981935380 0 0) 0x7f453c0a1910 con 0x7f453c135390 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): my global_id is 145093 2024-04-26T00:00:57.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f453c137fa0 con 0x7f453c135390 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 406911087 0 0) 0x7f453c137fa0 con 0x7f453c135390 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f453c0a1910 con 0x7f453c135390 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f45300014e0 con 0x7f453c135390 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): dump: 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.355 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3735883001 0 0) 0x7f4528003530 con 0x7f453c071d30 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f453c137fa0 con 0x7f453c071d30 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4534001b00 con 0x7f453c071d30 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:57.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): dump: 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.357 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 754309273 0 0) 0x7f453c0a1450 con 0x7f453c1357a0 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): my global_id is 6440 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4528003530 con 0x7f453c1357a0 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1921470861 0 0) 0x7f453c0a1910 con 0x7f453c135390 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.171:6791/0 conn(0x7f453c1357a0 legacy=0x7f453c1d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.106:6789/0 conn(0x7f453c071d30 legacy=0x7f453c133aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 monclient: found mon.c 2024-04-26T00:00:57.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c137cc0 con 0x7f453c135390 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 5 monclient: authenticate success, global_id 145093 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: _renew_subs 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f453c136500 con 0x7f453c135390 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: _renew_subs 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f453c1348c0 con 0x7f453c135390 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4530004aa0 con 0x7f453c135390 2024-04-26T00:00:57.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4530004f90 con 0x7f453c135390 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453bfff640 4 set_mon_vals no callback set 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient: dump: 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.360 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f451c0065d0 con 0x7f451c002870 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f453000fd30 con 0x7f453c135390 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(196..196 src has 29..196) ==== 10736+0+0 (unknown 889589031 0 0) 0x7f4530046060 con 0x7f453c135390 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3401176198 0 0) 0x7f451c0065d0 con 0x7f451c002870 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 10 monclient(hunting): my global_id is 145102 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.360+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f453c0a1910 con 0x7f451c002870 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f454225b640 10 monclient: get_auth_request con 0x7f4528037e10 auth_method 0 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 674472924 0 0) 0x7f453c0a1910 con 0x7f451c002870 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f451c0065d0 con 0x7f451c002870 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4534002020 con 0x7f451c002870 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 10 monclient: dump: 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.362 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3644957327 0 0) 0x7f451c0065d0 con 0x7f451c002870 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f451c00a160 con 0x7f451c002870 2024-04-26T00:00:57.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4534005510 con 0x7f451c002870 2024-04-26T00:00:57.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:57.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.106:6791/0 conn(0x7f451c002870 legacy=0x7f451c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.364+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.106:6791/0 conn(0x7f451c002870 legacy=0x7f451c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f4543cbe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f451c009e50 con 0x7f451c009110 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1682071364 0 0) 0x7f451c009e50 con 0x7f451c009110 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient(hunting): my global_id is 145111 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f451c0065d0 con 0x7f451c009110 2024-04-26T00:00:57.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3462979934 0 0) 0x7f451c0065d0 con 0x7f451c009110 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f451c009e50 con 0x7f451c009110 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4534005c30 con 0x7f451c009110 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient: dump: 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.366 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2699260831 0 0) 0x7f451c009e50 con 0x7f451c009110 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f451c00c3e0 con 0x7f451c009110 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3304061872) 0x7f4534005f10 con 0x7f451c009110 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:57.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.106:6791/0 conn(0x7f451c009110 legacy=0x7f451c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.368+0000 7f453a7fc640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.106:6791/0 conn(0x7f451c009110 legacy=0x7f451c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 120898, 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:57.368 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.369 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.370 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:57.371 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.372 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.373 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.374 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:57.377 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.378 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:57.381 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.382 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:57.384 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:57.388 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.171:6812/722422047 conn(0x7f4528037e10 legacy=0x7f452803a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 10 monclient: shutdown 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 >> v1:172.21.15.106:6791/0 conn(0x7f453c135390 legacy=0x7f453c1341b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f454225b640 1 -- 172.21.15.106:0/1857797078 reap_dead start 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f454225b640 1 -- 172.21.15.106:0/1857797078 reap_dead start 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 shutdown_connections 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 >> 172.21.15.106:0/1857797078 conn(0x7f453c0a8370 msgr2=0x7f453c130600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 shutdown_connections 2024-04-26T00:00:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.372+0000 7f4543cbe640 1 -- 172.21.15.106:0/1857797078 wait complete. 2024-04-26T00:00:57.390 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:57.391 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:00:57.391 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:00:57.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.524+0000 7fdddaf5e640 10 monclient: get_monmap_and_config 2024-04-26T00:00:57.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.524+0000 7fdddaf5e640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.524+0000 7fdddaf5e640 10 monclient: monmap: 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:57.530179+0000 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:57.530179+0000 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.508 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.509 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 Processor -- start 2024-04-26T00:00:57.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- start start 2024-04-26T00:00:57.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient: init 2024-04-26T00:00:57.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient: _add_conns ranks=[3,5,2,8,7,1,6,4,0] 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient(hunting): picked mon.noname-g con 0x7fddd409d360 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient(hunting): picked mon.noname-h con 0x7fddd409d740 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient(hunting): picked mon.noname-b con 0x7fddd409db20 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd4136140 con 0x7fddd409db20 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd40a2200 con 0x7fddd409d360 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd40a3020 con 0x7fddd409d740 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient(hunting): authenticate will time out at 1313.057495s 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd94fb640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fddd409db20 0x7fddd413de70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:41834/0 (socket says 172.21.15.106:41834) 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd94fb640 1 -- 172.21.15.106:0/448459557 learned_addr learned my addr 172.21.15.106:0/448459557 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470382602 0 0) 0x7fddd4136140 con 0x7fddd409db20 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient(hunting): my global_id is 6518 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddc0003530 con 0x7fddd409db20 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2493555328 0 0) 0x7fddc0003530 con 0x7fddd409db20 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 >> v1:172.21.15.171:6791/0 conn(0x7fddd409d740 legacy=0x7fddd413a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 >> v1:172.21.15.171:6790/0 conn(0x7fddd409d360 legacy=0x7fddd4135a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 monclient: found mon.noname-b 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd40a3300 con 0x7fddd409db20 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fddc4001b40 con 0x7fddd409db20 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: dump: 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.514 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 5 monclient: authenticate success, global_id 6518 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fddc4001e30 con 0x7fddd409db20 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 1 -- 172.21.15.106:0/448459557 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fddc4004f70 con 0x7fddd409db20 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 4 set_mon_vals no callback set 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:57.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fddd37fe640 10 monclient: dump: 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.516 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient: shutdown 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- 172.21.15.106:0/448459557 >> v1:172.21.15.106:6790/0 conn(0x7fddd409db20 legacy=0x7fddd413de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- 172.21.15.106:0/448459557 shutdown_connections 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- 172.21.15.106:0/448459557 >> 172.21.15.106:0/448459557 conn(0x7fddd40a6fe0 msgr2=0x7fddd40a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- 172.21.15.106:0/448459557 shutdown_connections 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 1 -- 172.21.15.106:0/448459557 wait complete. 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.528+0000 7fdddaf5e640 10 monclient: monmap: 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:57.517 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 Processor -- start 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 -- start start 2024-04-26T00:00:57.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient: init 2024-04-26T00:00:57.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient: _add_conns ranks=[1,6,3,0,7,2,5,4,8] 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient(hunting): picked mon.noname-f con 0x7fddd409d360 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient(hunting): picked mon.noname-d con 0x7fddd409d740 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient(hunting): picked mon.noname-g con 0x7fddd409db20 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd4072ac0 con 0x7fddd409d360 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd409f870 con 0x7fddd409db20 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fddd4137c30 con 0x7fddd409d740 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient(hunting): authenticate will time out at 1313.060680s 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd3fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fddd409d740 0x7fddd41d1bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60078/0 (socket says 172.21.15.106:60078) 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd3fff640 1 -- 172.21.15.106:0/3178173497 learned_addr learned my addr 172.21.15.106:0/3178173497 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2412472518 0 0) 0x7fddd4137c30 con 0x7fddd409d740 2024-04-26T00:00:57.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): my global_id is 6522 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddb4003530 con 0x7fddd409d740 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1809728359 0 0) 0x7fddb4003530 con 0x7fddd409d740 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddd4137c30 con 0x7fddd409d740 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fddbc001b00 con 0x7fddd409d740 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): dump: 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.525 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300876099 0 0) 0x7fddd4072ac0 con 0x7fddd409d360 2024-04-26T00:00:57.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): my global_id is 144973 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddb4003530 con 0x7fddd409d360 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1984191183 0 0) 0x7fddd409f870 con 0x7fddd409db20 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): my global_id is 6762 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddd4072ac0 con 0x7fddd409db20 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4172942694 0 0) 0x7fddd4137c30 con 0x7fddd409d740 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.171:6790/0 conn(0x7fddd409db20 legacy=0x7fddd41d5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.171:6789/0 conn(0x7fddd409d360 legacy=0x7fddd412b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 monclient: found mon.d 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd4137390 con 0x7fddd409d740 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 5 monclient: authenticate success, global_id 6522 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient: _renew_subs 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fddd4137080 con 0x7fddd409d740 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient: _renew_subs 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fddd409f160 con 0x7fddd409d740 2024-04-26T00:00:57.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fddbc003950 con 0x7fddd409d740 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fddbc003ec0 con 0x7fddd409d740 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd2ffd640 4 set_mon_vals no callback set 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: dump: 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.529 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fddb80065d0 con 0x7fddb8002870 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2586971180 0 0) 0x7fddb80065d0 con 0x7fddb8002870 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient(hunting): my global_id is 6531 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddd4137c30 con 0x7fddb8002870 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fddbc0040e0 con 0x7fddd409d740 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(196..196 src has 29..196) ==== 10736+0+0 (unknown 889589031 0 0) 0x7fddbc046180 con 0x7fddd409d740 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2537289086 0 0) 0x7fddd4137c30 con 0x7fddb8002870 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddb80065d0 con 0x7fddb8002870 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fddcc0017c0 con 0x7fddb8002870 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: dump: 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.531 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd94fb640 10 monclient: get_auth_request con 0x7fddb4037a70 auth_method 0 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 257607391 0 0) 0x7fddb80065d0 con 0x7fddb8002870 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fddb800a160 con 0x7fddb8002870 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fddcc001c40 con 0x7fddb8002870 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.106:6792/0 conn(0x7fddb8002870 legacy=0x7fddb8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.532+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.106:6792/0 conn(0x7fddb8002870 legacy=0x7fddb8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fddb8009e30 con 0x7fddb80090f0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201412146 0 0) 0x7fddb8009e30 con 0x7fddb80090f0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient(hunting): my global_id is 6540 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fddb80065d0 con 0x7fddb80090f0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 331595971 0 0) 0x7fddb80065d0 con 0x7fddb80090f0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fddb8009e30 con 0x7fddb80090f0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fddcc003b30 con 0x7fddb80090f0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient: dump: 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.534 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4136247218 0 0) 0x7fddb8009e30 con 0x7fddb80090f0 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fddb800c3a0 con 0x7fddb80090f0 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 871568106) 0x7fddcc003e10 con 0x7fddb80090f0 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.106:6792/0 conn(0x7fddb80090f0 legacy=0x7fddb8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd17fa640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.106:6792/0 conn(0x7fddb80090f0 legacy=0x7fddb8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.535 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 376079, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:57.536 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.537 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.538 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:57.539 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.540 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:57.542 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.544 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.545 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.546 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.547 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:57.549 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.551 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.552 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:57.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.554 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:57.555 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:57.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.171:6812/722422047 conn(0x7fddb4037a70 legacy=0x7fddb4039f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 10 monclient: shutdown 2024-04-26T00:00:57.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 >> v1:172.21.15.106:6792/0 conn(0x7fddd409d740 legacy=0x7fddd41d1bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd94fb640 1 -- 172.21.15.106:0/3178173497 reap_dead start 2024-04-26T00:00:57.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fddd94fb640 1 -- 172.21.15.106:0/3178173497 reap_dead start 2024-04-26T00:00:57.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 shutdown_connections 2024-04-26T00:00:57.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 >> 172.21.15.106:0/3178173497 conn(0x7fddd40a6fe0 msgr2=0x7fddd40a36e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 shutdown_connections 2024-04-26T00:00:57.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.540+0000 7fdddaf5e640 1 -- 172.21.15.106:0/3178173497 wait complete. 2024-04-26T00:00:57.557 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:57.557 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:00:57.557 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:00:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.688+0000 7f56fa675640 10 monclient: get_monmap_and_config 2024-04-26T00:00:57.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.688+0000 7f56fa675640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.688+0000 7f56fa675640 10 monclient: monmap: 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:57.694315+0000 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:57.694315+0000 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.672 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.673 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.673 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 Processor -- start 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- start start 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient: init 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient: _add_conns ranks=[7,4,5,0,2,6,3,8,1] 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient(hunting): picked mon.noname-i con 0x7f56f4134820 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient(hunting): picked mon.noname-c con 0x7f56f40725d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient(hunting): picked mon.noname-h con 0x7f56f413ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f4071270 con 0x7f56f40725d0 2024-04-26T00:00:57.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f40714e0 con 0x7f56f413ace0 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f40729f0 con 0x7f56f4134820 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient(hunting): authenticate will time out at 1313.221593s 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f37fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f56f40725d0 0x7f56f41395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:35514/0 (socket says 172.21.15.106:35514) 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f37fe640 1 -- 172.21.15.106:0/2799239054 learned_addr learned my addr 172.21.15.106:0/2799239054 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812735077 0 0) 0x7f56f4071270 con 0x7f56f40725d0 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient(hunting): my global_id is 145120 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56dc003530 con 0x7f56f40725d0 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1935366804 0 0) 0x7f56dc003530 con 0x7f56f40725d0 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 >> v1:172.21.15.171:6792/0 conn(0x7f56f4134820 legacy=0x7f56f4134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 >> v1:172.21.15.171:6791/0 conn(0x7f56f413ace0 legacy=0x7f56f413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 monclient: found mon.noname-c 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f40717c0 con 0x7f56f40725d0 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e80017c0 con 0x7f56f40725d0 2024-04-26T00:00:57.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: dump: 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.683 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 5 monclient: authenticate success, global_id 145120 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56e8001ab0 con 0x7f56f40725d0 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 4 set_mon_vals no callback set 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 1 -- 172.21.15.106:0/2799239054 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e8004bf0 con 0x7f56f40725d0 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56f2ffd640 10 monclient: dump: 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.684 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient: shutdown 2024-04-26T00:00:57.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- 172.21.15.106:0/2799239054 >> v1:172.21.15.106:6791/0 conn(0x7f56f40725d0 legacy=0x7f56f41395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- 172.21.15.106:0/2799239054 shutdown_connections 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- 172.21.15.106:0/2799239054 >> 172.21.15.106:0/2799239054 conn(0x7f56f40a64e0 msgr2=0x7f56f40a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- 172.21.15.106:0/2799239054 shutdown_connections 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 1 -- 172.21.15.106:0/2799239054 wait complete. 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.692+0000 7f56fa675640 10 monclient: monmap: 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 Processor -- start 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 -- start start 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient: init 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient: _add_conns ranks=[6,2,7,4,8,1,3,5,0] 2024-04-26T00:00:57.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient(hunting): picked mon.noname-d con 0x7f56f40725d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient(hunting): picked mon.noname-b con 0x7f56f4134820 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient(hunting): picked mon.noname-i con 0x7f56f413ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f41cd530 con 0x7f56f4134820 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f4072c60 con 0x7f56f40725d0 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56f40706a0 con 0x7f56f413ace0 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient(hunting): authenticate will time out at 1313.224572s 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f37fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f56f4134820 0x7f56f41cce20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:41846/0 (socket says 172.21.15.106:41846) 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f3fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f56f40725d0 0x7f56f41cc710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60104/0 (socket says 172.21.15.106:60104) 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f37fe640 1 -- 172.21.15.106:0/1690884331 learned_addr learned my addr 172.21.15.106:0/1690884331 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 94984215 0 0) 0x7f56f41cd530 con 0x7f56f4134820 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): my global_id is 6527 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e0003530 con 0x7f56f4134820 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454261068 0 0) 0x7f56f4072c60 con 0x7f56f40725d0 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): my global_id is 6549 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f41cd530 con 0x7f56f40725d0 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1628591261 0 0) 0x7f56f41cd530 con 0x7f56f40725d0 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56f4072c60 con 0x7f56f40725d0 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e4001a40 con 0x7f56f40725d0 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.689 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:57.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1290176698 0 0) 0x7f56e0003530 con 0x7f56f4134820 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56f41cd530 con 0x7f56f4134820 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e8001780 con 0x7f56f4134820 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): dump: 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.691 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2035574872 0 0) 0x7f56f40706a0 con 0x7f56f413ace0 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): my global_id is 144898 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56e0003530 con 0x7f56f413ace0 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 921804753 0 0) 0x7f56f4072c60 con 0x7f56f40725d0 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.171:6792/0 conn(0x7f56f413ace0 legacy=0x7f56f41d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.106:6790/0 conn(0x7f56f4134820 legacy=0x7f56f41cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 monclient: found mon.d 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56f4133fc0 con 0x7f56f40725d0 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 5 monclient: authenticate success, global_id 6549 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient: _renew_subs 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f56f4139760 con 0x7f56f40725d0 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f56e4003950 con 0x7f56f40725d0 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e4003ec0 con 0x7f56f40725d0 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f27fc640 4 set_mon_vals no callback set 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: dump: 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.694 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient: _renew_subs 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f56f413cfa0 con 0x7f56f40725d0 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f56e4004060 con 0x7f56f40725d0 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56f4075890 con 0x7f56f413be80 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(196..196 src has 29..196) ==== 10736+0+0 (unknown 889589031 0 0) 0x7f56e4046040 con 0x7f56f40725d0 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050346311 0 0) 0x7f56f4075890 con 0x7f56f413be80 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient(hunting): my global_id is 204227 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f4072c60 con 0x7f56f413be80 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f8c12640 10 monclient: get_auth_request con 0x7f56e0037fa0 auth_method 0 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4087401908 0 0) 0x7f56f4072c60 con 0x7f56f413be80 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56f4075890 con 0x7f56f413be80 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e8001cd0 con 0x7f56f413be80 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: dump: 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.696 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3122535694 0 0) 0x7f56f4075890 con 0x7f56f413be80 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f56f4062e50 con 0x7f56f413be80 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f56e8005240 con 0x7f56f413be80 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.106:6793/0 conn(0x7f56f413be80 legacy=0x7f56f40a02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.696+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.106:6793/0 conn(0x7f56f413be80 legacy=0x7f56f40a02f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f56f406c310 con 0x7f56f402d010 2024-04-26T00:00:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 231656116 0 0) 0x7f56f406c310 con 0x7f56f402d010 2024-04-26T00:00:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient(hunting): my global_id is 204236 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f56f4075890 con 0x7f56f402d010 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3618267663 0 0) 0x7f56f4075890 con 0x7f56f402d010 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f56f406c310 con 0x7f56f402d010 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f56e80059a0 con 0x7f56f402d010 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient: dump: 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.700 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3958999849 0 0) 0x7f56f406c310 con 0x7f56f402d010 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f56f40a3260 con 0x7f56f402d010 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 4052156754) 0x7f56e80086f0 con 0x7f56f402d010 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:57.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.106:6793/0 conn(0x7f56f402d010 legacy=0x7f56f40a0a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f0ff9640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.106:6793/0 conn(0x7f56f402d010 legacy=0x7f56f40a0a00 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 4443, 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:57.702 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.704 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:57.705 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.706 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:57.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.708 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.709 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.710 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.711 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:57.712 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.713 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:57.715 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:57.717 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.718 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.719 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.720 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.720 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:57.720 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.171:6812/722422047 conn(0x7f56e0037fa0 legacy=0x7f56e003a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 10 monclient: shutdown 2024-04-26T00:00:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 >> v1:172.21.15.106:6792/0 conn(0x7f56f40725d0 legacy=0x7f56f41cc710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f8c12640 1 -- 172.21.15.106:0/1690884331 reap_dead start 2024-04-26T00:00:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56f8c12640 1 -- 172.21.15.106:0/1690884331 reap_dead start 2024-04-26T00:00:57.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 shutdown_connections 2024-04-26T00:00:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 >> 172.21.15.106:0/1690884331 conn(0x7f56f40a64e0 msgr2=0x7f56f406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 shutdown_connections 2024-04-26T00:00:57.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.704+0000 7f56fa675640 1 -- 172.21.15.106:0/1690884331 wait complete. 2024-04-26T00:00:57.722 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:57.722 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:00:57.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:00:57.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.766+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}]=0 added bucket h17 type host to location {rack=r1} v197) ==== 168+0+0 (unknown 3661468978 0 0) 0x7fbae4013ec0 con 0x7fbae8135a00 2024-04-26T00:00:57.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.766+0000 7fbada7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:57.751 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.766+0000 7fbada7fc640 10 monclient: _finish_command 2 = system:0 added bucket h17 type host to location {rack=r1} 2024-04-26T00:00:57.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: get_monmap_and_config 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: monmap: 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:57.866584+0000 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:57.866584+0000 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.844 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.845 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.845 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.845 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.845 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.845 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.845 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.845 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 Processor -- start 2024-04-26T00:00:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- start start 2024-04-26T00:00:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: init 2024-04-26T00:00:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: _add_conns ranks=[1,8,4,5,6,7,0,3,2] 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient(hunting): picked mon.noname-f con 0x7fea6c0a1bc0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient(hunting): picked mon.noname-e con 0x7fea6c09e7f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient(hunting): picked mon.noname-c con 0x7fea6c0a26b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6c09ca20 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6c09c4a0 con 0x7fea6c0a26b0 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6c0a05a0 con 0x7fea6c09e7f0 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient(hunting): authenticate will time out at 1313.393711s 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6affd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fea6c09e7f0 0x7fea6c1399b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:56140/0 (socket says 172.21.15.106:56140) 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6affd640 1 -- 172.21.15.106:0/1098685101 learned_addr learned my addr 172.21.15.106:0/1098685101 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2605667176 0 0) 0x7fea6c0a05a0 con 0x7fea6c09e7f0 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): my global_id is 204245 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea58003530 con 0x7fea6c09e7f0 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2925997938 0 0) 0x7fea6c09c4a0 con 0x7fea6c0a26b0 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient(hunting): my global_id is 145129 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea6c0a05a0 con 0x7fea6c0a26b0 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3919899781 0 0) 0x7fea58003530 con 0x7fea6c09e7f0 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 >> v1:172.21.15.106:6791/0 conn(0x7fea6c0a26b0 legacy=0x7fea6c13d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 >> v1:172.21.15.171:6789/0 conn(0x7fea6c0a1bc0 legacy=0x7fea6c0a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 monclient: found mon.noname-e 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c06c420 con 0x7fea6c09e7f0 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 5 monclient: authenticate success, global_id 204245 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea54001b40 con 0x7fea6c09e7f0 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: dump: 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.856 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea54001da0 con 0x7fea6c09e7f0 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:57.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 4 set_mon_vals no callback set 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 1 -- 172.21.15.106:0/1098685101 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea54004f70 con 0x7fea6c09e7f0 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea6a7fc640 10 monclient: dump: 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.858 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: shutdown 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- 172.21.15.106:0/1098685101 >> v1:172.21.15.106:6793/0 conn(0x7fea6c09e7f0 legacy=0x7fea6c1399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- 172.21.15.106:0/1098685101 shutdown_connections 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- 172.21.15.106:0/1098685101 >> 172.21.15.106:0/1098685101 conn(0x7fea6c06b210 msgr2=0x7fea6c06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- 172.21.15.106:0/1098685101 shutdown_connections 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 1 -- 172.21.15.106:0/1098685101 wait complete. 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.864+0000 7fea71aef640 10 monclient: monmap: 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.860 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 Processor -- start 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 -- start start 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient: init 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient: _add_conns ranks=[5,0,1,8,4,6,2,7,3] 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient(hunting): picked mon.noname-h con 0x7fea6c09e7f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient(hunting): picked mon.noname-a con 0x7fea6c0a1bc0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient(hunting): picked mon.noname-f con 0x7fea6c0a26b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6c13d740 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6c120f80 con 0x7fea6c0a26b0 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea6c121260 con 0x7fea6c09e7f0 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient(hunting): authenticate will time out at 1313.396718s 2024-04-26T00:00:57.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea6affd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fea6c0a1bc0 0x7fea6c1d13e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41914/0 (socket says 172.21.15.106:41914) 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea6affd640 1 -- 172.21.15.106:0/2573449249 learned_addr learned my addr 172.21.15.106:0/2573449249 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003717362 0 0) 0x7fea6c13d740 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): my global_id is 6723 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea4c003530 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2213759631 0 0) 0x7fea4c003530 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea6c13d740 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea54004eb0 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): dump: 2024-04-26T00:00:57.862 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.863 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4145004518 0 0) 0x7fea6c13d740 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.171:6791/0 conn(0x7fea6c09e7f0 legacy=0x7fea6c136e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.171:6789/0 conn(0x7fea6c0a26b0 legacy=0x7fea6c1d4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 monclient: found mon.a 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea6c1375a0 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 5 monclient: authenticate success, global_id 6723 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient: _renew_subs 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:57.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea6c120c10 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient: _renew_subs 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fea6c0703a0 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea54001da0 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea54005600 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea69ffb640 4 set_mon_vals no callback set 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: dump: 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.865 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fea500065d0 con 0x7fea50002870 2024-04-26T00:00:57.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fea540103a0 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7fea540466c0 con 0x7fea6c0a1bc0 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552506700 0 0) 0x7fea500065d0 con 0x7fea50002870 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient(hunting): my global_id is 145000 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea6c13d740 con 0x7fea50002870 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea6bfff640 10 monclient: get_auth_request con 0x7fea4c037780 auth_method 0 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2559181772 0 0) 0x7fea6c13d740 con 0x7fea50002870 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea500065d0 con 0x7fea50002870 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea5c0017f0 con 0x7fea50002870 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 10 monclient: dump: 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.867 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.868 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1426725929 0 0) 0x7fea500065d0 con 0x7fea50002870 2024-04-26T00:00:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.868+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fea5000a160 con 0x7fea50002870 2024-04-26T00:00:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.872+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fea5c001c30 con 0x7fea50002870 2024-04-26T00:00:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.872+0000 7fea63fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.872+0000 7fea63fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.872+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.171:6789/0 conn(0x7fea50002870 legacy=0x7fea50004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.872+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.171:6789/0 conn(0x7fea50002870 legacy=0x7fea50004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.870+0000 7fbaefc3d640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:57.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.870+0000 7fbaefc3d640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:57.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.870+0000 7fbaefc3d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:57.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.870+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fbad0005be0 con 0x7fbae8135a00 2024-04-26T00:00:57.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbada7fc640 1 -- 172.21.15.171:0/3458193342 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h17' already exists v197) ==== 147+0+0 (unknown 3703139415 0 0) 0x7fbae401ca70 con 0x7fbae8135a00 2024-04-26T00:00:57.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbada7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h17", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:57.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbada7fc640 10 monclient: _finish_command 3 = system:0 bucket 'h17' already exists 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h17' already exists 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 >> v1:172.21.15.171:6812/722422047 conn(0x7fbacc038290 legacy=0x7fbacc03a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 10 monclient: shutdown 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 >> v1:172.21.15.106:6792/0 conn(0x7fbae8135a00 legacy=0x7fbae81cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 shutdown_connections 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 >> 172.21.15.171:0/3458193342 conn(0x7fbae80a2690 msgr2=0x7fbae80a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 shutdown_connections 2024-04-26T00:00:57.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:57.874+0000 7fbaefc3d640 1 -- 172.21.15.171:0/3458193342 wait complete. 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea71aef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fea50009e50 con 0x7fea50009110 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291630914 0 0) 0x7fea50009e50 con 0x7fea50009110 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 10 monclient(hunting): my global_id is 145009 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea500065d0 con 0x7fea50009110 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1664428626 0 0) 0x7fea500065d0 con 0x7fea50009110 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea50009e50 con 0x7fea50009110 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea5c003bb0 con 0x7fea50009110 2024-04-26T00:00:57.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 10 monclient: dump: 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:57.874 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 939516714 0 0) 0x7fea50009e50 con 0x7fea50009110 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.876+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fea5000c3e0 con 0x7fea50009110 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2767326123) 0x7fea5c003e60 con 0x7fea50009110 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea63fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea63fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.171:6789/0 conn(0x7fea50009110 legacy=0x7fea500095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea63fff640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.171:6789/0 conn(0x7fea50009110 legacy=0x7fea500095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:57.875 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 121406, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:57.876 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.877 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.878 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:57.879 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:57.880 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:57.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.883 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.884 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:57.885 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:57.887 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:57.889 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.891 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:57.892 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.893 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:57.894 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:57.895 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:00:57.895 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h18 host rack=r1 2024-04-26T00:00:57.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.171:6812/722422047 conn(0x7fea4c037780 legacy=0x7fea4c039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 10 monclient: shutdown 2024-04-26T00:00:57.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:57.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 >> v1:172.21.15.106:6789/0 conn(0x7fea6c0a1bc0 legacy=0x7fea6c1d13e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:57.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea6bfff640 1 -- 172.21.15.106:0/2573449249 reap_dead start 2024-04-26T00:00:57.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea6bfff640 1 -- 172.21.15.106:0/2573449249 reap_dead start 2024-04-26T00:00:57.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 shutdown_connections 2024-04-26T00:00:57.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 >> 172.21.15.106:0/2573449249 conn(0x7fea6c06b210 msgr2=0x7fea6c070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:57.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 shutdown_connections 2024-04-26T00:00:57.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:57.880+0000 7fea71aef640 1 -- 172.21.15.106:0/2573449249 wait complete. 2024-04-26T00:00:57.897 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:57.897 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:00:57.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:00:57.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient: get_monmap_and_config 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient: build_initial_monmap 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient: monmap: 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:00:58.015864+0000 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:00:58.015864+0000 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:57.994 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:57.995 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:57.995 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:57.995 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:57.995 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:58.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 1 Processor -- start 2024-04-26T00:00:58.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 1 -- start start 2024-04-26T00:00:58.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient: init 2024-04-26T00:00:58.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient: _add_conns ranks=[7,0,3,5,1,8,6,2,4] 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient(hunting): picked mon.noname-i con 0x7fb290135a00 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient(hunting): picked mon.noname-a con 0x7fb2900a1790 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient(hunting): picked mon.noname-g con 0x7fb29013c130 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2900a1d80 con 0x7fb2900a1790 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290072f70 con 0x7fb29013c130 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb290072640 con 0x7fb290135a00 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient(hunting): authenticate will time out at 1308.722845s 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28e59c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fb290135a00 0x7fb290135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:39144/0 (socket says 172.21.15.171:39144) 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28e59c640 1 -- 172.21.15.171:0/164934000 learned_addr learned my addr 172.21.15.171:0/164934000 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28ed9d640 1 --1- 172.21.15.171:0/164934000 >> v1:172.21.15.171:6790/0 conn(0x7fb29013c130 0x7fb29013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:58766/0 (socket says 172.21.15.171:58766) 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 545163591 0 0) 0x7fb290072640 con 0x7fb290135a00 2024-04-26T00:00:58.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): my global_id is 144907 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb278003530 con 0x7fb290135a00 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2705593228 0 0) 0x7fb290072f70 con 0x7fb29013c130 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient(hunting): my global_id is 6771 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb290072640 con 0x7fb29013c130 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3027384983 0 0) 0x7fb290072640 con 0x7fb29013c130 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 >> v1:172.21.15.171:6792/0 conn(0x7fb290135a00 legacy=0x7fb290135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 >> v1:172.21.15.106:6789/0 conn(0x7fb2900a1790 legacy=0x7fb29013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 monclient: found mon.noname-g 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb290072920 con 0x7fb29013c130 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 5 monclient: authenticate success, global_id 6771 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb288001b40 con 0x7fb29013c130 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: dump: 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.004 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:58.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb288001da0 con 0x7fb29013c130 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb294be8640 4 set_mon_vals no callback set 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 1 -- 172.21.15.171:0/164934000 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb288004eb0 con 0x7fb29013c130 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.010+0000 7fb28d59a640 10 monclient: dump: 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.006 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: shutdown 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/164934000 >> v1:172.21.15.171:6790/0 conn(0x7fb29013c130 legacy=0x7fb29013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/164934000 shutdown_connections 2024-04-26T00:00:58.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/164934000 >> 172.21.15.171:0/164934000 conn(0x7fb2900a2690 msgr2=0x7fb2900a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/164934000 shutdown_connections 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/164934000 wait complete. 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: monmap: 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.008 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 Processor -- start 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- start start 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: init 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _add_conns ranks=[8,5,2,4,0,3,6,1,7] 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient(hunting): picked mon.noname-e con 0x7fb2900a1790 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient(hunting): picked mon.noname-h con 0x7fb290135a00 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient(hunting): picked mon.noname-b con 0x7fb29013c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:58.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29009fc40 con 0x7fb29013c130 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2901337e0 con 0x7fb290135a00 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb29009f6f0 con 0x7fb2900a1790 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient(hunting): authenticate will time out at 1308.726107s 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb28dd9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb290135a00 0x7fb290131a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:47574/0 (socket says 172.21.15.171:47574) 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb28dd9b640 1 -- 172.21.15.171:0/881472706 learned_addr learned my addr 172.21.15.171:0/881472706 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165368509 0 0) 0x7fb2901337e0 con 0x7fb290135a00 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): my global_id is 6467 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb270003530 con 0x7fb290135a00 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2220330720 0 0) 0x7fb270003530 con 0x7fb290135a00 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2901337e0 con 0x7fb290135a00 2024-04-26T00:00:58.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb284001b90 con 0x7fb290135a00 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): dump: 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.011 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201909297 0 0) 0x7fb290072920 con 0x7fb29013c130 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): my global_id is 6536 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb270003530 con 0x7fb29013c130 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 292496404 0 0) 0x7fb29009f6f0 con 0x7fb2900a1790 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.012 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient(hunting): my global_id is 204254 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb290072920 con 0x7fb2900a1790 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2194426402 0 0) 0x7fb2901337e0 con 0x7fb290135a00 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 >> v1:172.21.15.106:6793/0 conn(0x7fb2900a1790 legacy=0x7fb290131300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 >> v1:172.21.15.106:6790/0 conn(0x7fb29013c130 legacy=0x7fb2901d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 monclient: found mon.h 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb290132c80 con 0x7fb290135a00 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 5 monclient: authenticate success, global_id 6467 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _renew_subs 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb29013b4f0 con 0x7fb290135a00 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _renew_subs 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb290136a80 con 0x7fb290135a00 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb284003950 con 0x7fb290135a00 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb284003ec0 con 0x7fb290135a00 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb28cd99640 4 set_mon_vals no callback set 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:58.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 10 monclient: dump: 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.015 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb274005090 con 0x7fb290135a00 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.014+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb284004060 con 0x7fb290135a00 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.018+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7fb2840462b0 con 0x7fb290135a00 2024-04-26T00:00:58.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.018+0000 7fb28e59c640 10 monclient: get_auth_request con 0x7fb270037a40 auth_method 0 2024-04-26T00:00:58.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.022+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb284015930 con 0x7fb290135a00 2024-04-26T00:00:58.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.022+0000 7fb27effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.022+0000 7fb27effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient: get_monmap_and_config 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient: monmap: 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:58.035480+0000 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:58.035480+0000 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.024 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 1 Processor -- start 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 1 -- start start 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient: init 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient: _add_conns ranks=[8,4,6,0,5,1,7,2,3] 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient(hunting): picked mon.noname-e con 0x7f2000134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient(hunting): picked mon.noname-c con 0x7f20000a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient(hunting): picked mon.noname-d con 0x7f200013e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200006dd40 con 0x7f20000a4820 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20000a2b10 con 0x7f200013e200 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20000a2df0 con 0x7f2000134970 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f2005a05640 10 monclient(hunting): authenticate will time out at 1313.563263s 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffeffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f2000134970 0x7f2000134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:56156/0 (socket says 172.21.15.106:56156) 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1fff7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f200013e200 0x7f20001405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60114/0 (socket says 172.21.15.106:60114) 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffeffd640 1 -- 172.21.15.106:0/721451208 learned_addr learned my addr 172.21.15.106:0/721451208 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891459559 0 0) 0x7f200006dd40 con 0x7f20000a4820 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): my global_id is 145138 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe8003530 con 0x7f20000a4820 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 306122471 0 0) 0x7f20000a2b10 con 0x7f200013e200 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): my global_id is 6558 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200006dd40 con 0x7f200013e200 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793465782 0 0) 0x7f20000a2df0 con 0x7f2000134970 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 10 monclient(hunting): my global_id is 204263 2024-04-26T00:00:58.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.032+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20000a2b10 con 0x7f2000134970 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 432991811 0 0) 0x7f1fe8003530 con 0x7f20000a4820 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 >> v1:172.21.15.106:6793/0 conn(0x7f2000134970 legacy=0x7f2000134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 >> v1:172.21.15.106:6792/0 conn(0x7f200013e200 legacy=0x7f20001405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 monclient: found mon.noname-c 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20000a30d0 con 0x7f20000a4820 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ff40017c0 con 0x7f20000a4820 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:58.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: dump: 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.029 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 5 monclient: authenticate success, global_id 145138 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ff4001a20 con 0x7f20000a4820 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 1 -- 172.21.15.106:0/721451208 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ff4003960 con 0x7f20000a4820 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 4 set_mon_vals no callback set 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffdffb640 10 monclient: dump: 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.030 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: shutdown 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- 172.21.15.106:0/721451208 >> v1:172.21.15.106:6791/0 conn(0x7f20000a4820 legacy=0x7f200013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- 172.21.15.106:0/721451208 shutdown_connections 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- 172.21.15.106:0/721451208 >> 172.21.15.106:0/721451208 conn(0x7f20000a9e20 msgr2=0x7f20000aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- 172.21.15.106:0/721451208 shutdown_connections 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- 172.21.15.106:0/721451208 wait complete. 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: monmap: 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.032 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 Processor -- start 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- start start 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: init 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: _add_conns ranks=[3,5,4,8,1,0,7,6,2] 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient(hunting): picked mon.noname-g con 0x7f20000a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:58.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient(hunting): picked mon.noname-h con 0x7f2000134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient(hunting): picked mon.noname-c con 0x7f200013e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200013bc10 con 0x7f20000a4820 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20001396d0 con 0x7f200013e200 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f200013a0a0 con 0x7f2000134970 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient(hunting): authenticate will time out at 1313.566528s 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fff7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f200013e200 0x7f20001d45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:35534/0 (socket says 172.21.15.106:35534) 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fff7fe640 1 -- 172.21.15.106:0/1387203024 learned_addr learned my addr 172.21.15.106:0/1387203024 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1215136775 0 0) 0x7f20001396d0 con 0x7f200013e200 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): my global_id is 145147 2024-04-26T00:00:58.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fec003530 con 0x7f200013e200 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2842319581 0 0) 0x7f200013a0a0 con 0x7f2000134970 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): my global_id is 6476 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20001396d0 con 0x7f2000134970 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1484270108 0 0) 0x7f200013bc10 con 0x7f20000a4820 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): my global_id is 6780 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200013a0a0 con 0x7f20000a4820 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 908822999 0 0) 0x7f1fec003530 con 0x7f200013e200 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f200013bc10 con 0x7f200013e200 2024-04-26T00:00:58.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ff8001d40 con 0x7f200013e200 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): dump: 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.036 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2375378614 0 0) 0x7f20001396d0 con 0x7f2000134970 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fec003530 con 0x7f2000134970 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3004536185 0 0) 0x7f200013bc10 con 0x7f200013e200 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.171:6791/0 conn(0x7f2000134970 legacy=0x7f2000138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.171:6790/0 conn(0x7f20000a4820 legacy=0x7f20001388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 monclient: found mon.c 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:58.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20000a1a40 con 0x7f200013e200 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 5 monclient: authenticate success, global_id 145147 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: _renew_subs 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f200013b120 con 0x7f200013e200 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: _renew_subs 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2000134080 con 0x7f200013e200 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1ff8002060 con 0x7f200013e200 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ff80051e0 con 0x7f200013e200 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1ffd7fa640 4 set_mon_vals no callback set 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.036+0000 7f1fe7fff640 10 monclient: dump: 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.039 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f2005a05640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1fe00065d0 con 0x7f1fe0002870 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1ff800ff80 con 0x7f200013e200 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7f1ff8046500 con 0x7f200013e200 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1ffe7fc640 10 monclient: get_auth_request con 0x7f1fec0378f0 auth_method 0 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1769529142 0 0) 0x7f1fe00065d0 con 0x7f1fe0002870 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient(hunting): my global_id is 6789 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f200013bc10 con 0x7f1fe0002870 2024-04-26T00:00:58.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1958063984 0 0) 0x7f200013bc10 con 0x7f1fe0002870 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fe00065d0 con 0x7f1fe0002870 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ff0004b30 con 0x7f1fe0002870 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient: dump: 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.041 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4151470906 0 0) 0x7f1fe00065d0 con 0x7f1fe0002870 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1fe000a160 con 0x7f1fe0002870 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1ff0005ff0 con 0x7f1fe0002870 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.171:6790/0 conn(0x7f1fe0002870 legacy=0x7f1fe0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.040+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.171:6790/0 conn(0x7f1fe0002870 legacy=0x7f1fe0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.044+0000 7f2005a05640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.044+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1fe0009e30 con 0x7f1fe00090f0 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938302112 0 0) 0x7f1fe0009e30 con 0x7f1fe00090f0 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient(hunting): my global_id is 6798 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fe00065d0 con 0x7f1fe00090f0 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 114343962 0 0) 0x7f1fe00065d0 con 0x7f1fe00090f0 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fe0009e30 con 0x7f1fe00090f0 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1ff00067d0 con 0x7f1fe00090f0 2024-04-26T00:00:58.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:00:58.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient: dump: 2024-04-26T00:00:58.045 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.045 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.046 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1131949797 0 0) 0x7f1fe0009e30 con 0x7f1fe00090f0 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1fe000c3a0 con 0x7f1fe00090f0 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1091243818) 0x7f1ff0006aa0 con 0x7f1fe00090f0 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.171:6790/0 conn(0x7f1fe00090f0 legacy=0x7f1fe0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fe7fff640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.171:6790/0 conn(0x7f1fe00090f0 legacy=0x7f1fe0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 376564, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:58.048 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.049 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.050 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:58.051 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.052 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.053 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.054 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.055 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:58.057 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.058 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.059 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.060 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.061 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:58.062 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.063 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.064 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.065 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.066 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:58.066 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:58.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.171:6812/722422047 conn(0x7f1fec0378f0 legacy=0x7f1fec039db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 10 monclient: shutdown 2024-04-26T00:00:58.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 >> v1:172.21.15.106:6791/0 conn(0x7f200013e200 legacy=0x7f20001d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fff7fe640 1 -- 172.21.15.106:0/1387203024 reap_dead start 2024-04-26T00:00:58.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f1fff7fe640 1 -- 172.21.15.106:0/1387203024 reap_dead start 2024-04-26T00:00:58.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 shutdown_connections 2024-04-26T00:00:58.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 >> 172.21.15.106:0/1387203024 conn(0x7f20000a9e20 msgr2=0x7f2000067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 shutdown_connections 2024-04-26T00:00:58.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.048+0000 7f2005a05640 1 -- 172.21.15.106:0/1387203024 wait complete. 2024-04-26T00:00:58.068 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:58.068 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:00:58.068 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:00:58.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.186+0000 7fb294be8640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:58.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.186+0000 7fb294be8640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:00:58.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.186+0000 7fb294be8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:00:58.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:00:58.186+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fb274005380 con 0x7fb290135a00 2024-04-26T00:00:58.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: get_monmap_and_config 2024-04-26T00:00:58.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: monmap: 2024-04-26T00:00:58.187 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:58.210494+0000 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:58.210494+0000 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.188 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 Processor -- start 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- start start 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: init 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: _add_conns ranks=[0,3,2,5,4,8,1,6,7] 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient(hunting): picked mon.noname-a con 0x7fa8c00a13c0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient(hunting): picked mon.noname-g con 0x7fa8c00a17a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient(hunting): picked mon.noname-b con 0x7fa8c013c040 addr v1:172.21.15.106:6790/0 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c0068070 con 0x7fa8c00a13c0 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c00a1fb0 con 0x7fa8c013c040 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c0072660 con 0x7fa8c00a17a0 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient(hunting): authenticate will time out at 1313.737489s 2024-04-26T00:00:58.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c4af5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa8c00a13c0 0x7fa8c0135c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41930/0 (socket says 172.21.15.106:41930) 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c4af5640 1 -- 172.21.15.106:0/3781019998 learned_addr learned my addr 172.21.15.106:0/3781019998 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297246610 0 0) 0x7fa8c0068070 con 0x7fa8c00a13c0 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): my global_id is 6741 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a8003530 con 0x7fa8c00a13c0 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1453497929 0 0) 0x7fa8c00a1fb0 con 0x7fa8c013c040 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient(hunting): my global_id is 6545 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c0068070 con 0x7fa8c013c040 2024-04-26T00:00:58.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4145609003 0 0) 0x7fa8a8003530 con 0x7fa8c00a13c0 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 >> v1:172.21.15.171:6790/0 conn(0x7fa8c00a17a0 legacy=0x7fa8c013a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 >> v1:172.21.15.106:6790/0 conn(0x7fa8c013c040 legacy=0x7fa8c013e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 monclient: found mon.noname-a 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c0072940 con 0x7fa8c00a13c0 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa8b8001b40 con 0x7fa8c00a13c0 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: dump: 2024-04-26T00:00:58.200 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 5 monclient: authenticate success, global_id 6741 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8b8001d30 con 0x7fa8c00a13c0 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 1 -- 172.21.15.106:0/3781019998 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa8b8004f70 con 0x7fa8c00a13c0 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8bf7fe640 10 monclient: dump: 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.202 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 4 set_mon_vals no callback set 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: shutdown 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3781019998 >> v1:172.21.15.106:6789/0 conn(0x7fa8c00a13c0 legacy=0x7fa8c0135c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3781019998 shutdown_connections 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3781019998 >> 172.21.15.106:0/3781019998 conn(0x7fa8c006b210 msgr2=0x7fa8c006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3781019998 shutdown_connections 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3781019998 wait complete. 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.208+0000 7fa8c6d59640 10 monclient: monmap: 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.204 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 Processor -- start 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 -- start start 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient: init 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient: _add_conns ranks=[6,1,7,3,5,2,8,4,0] 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient(hunting): picked mon.noname-d con 0x7fa8c00a13c0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient(hunting): picked mon.noname-f con 0x7fa8c00a17a0 addr v1:172.21.15.171:6789/0 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient(hunting): picked mon.noname-i con 0x7fa8c013c040 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c0134a20 con 0x7fa8c00a17a0 2024-04-26T00:00:58.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c013af40 con 0x7fa8c00a13c0 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8c00a1d30 con 0x7fa8c013c040 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient(hunting): authenticate will time out at 1313.740562s 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c4af5640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fa8c00a13c0 0x7fa8c0134310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60120/0 (socket says 172.21.15.106:60120) 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c4af5640 1 -- 172.21.15.106:0/3028703120 learned_addr learned my addr 172.21.15.106:0/3028703120 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 549745033 0 0) 0x7fa8c013af40 con 0x7fa8c00a13c0 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): my global_id is 6567 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8ac003560 con 0x7fa8c00a13c0 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1725744643 0 0) 0x7fa8ac003560 con 0x7fa8c00a13c0 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8c013af40 con 0x7fa8c00a13c0 2024-04-26T00:00:58.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa8b8004b70 con 0x7fa8c00a13c0 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): dump: 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.207 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 998783386 0 0) 0x7fa8c00a1d30 con 0x7fa8c013c040 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): my global_id is 144916 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8ac003560 con 0x7fa8c013c040 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2055659759 0 0) 0x7fa8c013af40 con 0x7fa8c00a13c0 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.171:6792/0 conn(0x7fa8c013c040 legacy=0x7fa8c01d52e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.171:6789/0 conn(0x7fa8c00a17a0 legacy=0x7fa8c01d1bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 monclient: found mon.d 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8c011e420 con 0x7fa8c00a13c0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 5 monclient: authenticate success, global_id 6567 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient: _renew_subs 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8c011e9e0 con 0x7fa8c00a13c0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient: _renew_subs 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa8c006d7b0 con 0x7fa8c00a13c0 2024-04-26T00:00:58.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa8b8001d30 con 0x7fa8c00a13c0 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa8b8001500 con 0x7fa8c00a13c0 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8beffd640 4 set_mon_vals no callback set 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: dump: 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.210 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa8a00065d0 con 0x7fa8a0002870 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa8b8010280 con 0x7fa8c00a13c0 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7fa8b80467c0 con 0x7fa8c00a13c0 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709559653 0 0) 0x7fa8a00065d0 con 0x7fa8a0002870 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient(hunting): my global_id is 6485 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8c013af40 con 0x7fa8a0002870 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8c52f6640 10 monclient: get_auth_request con 0x7fa8ac0377c0 auth_method 0 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2400241614 0 0) 0x7fa8c013af40 con 0x7fa8a0002870 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8a00065d0 con 0x7fa8a0002870 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa8b40017f0 con 0x7fa8a0002870 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: dump: 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.212 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3647208044 0 0) 0x7fa8a00065d0 con 0x7fa8a0002870 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa8a000a160 con 0x7fa8a0002870 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa8b4001c80 con 0x7fa8a0002870 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:58.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.171:6791/0 conn(0x7fa8a0002870 legacy=0x7fa8a0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.212+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.171:6791/0 conn(0x7fa8a0002870 legacy=0x7fa8a0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8c6d59640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa8a0009e50 con 0x7fa8a0009110 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1593051656 0 0) 0x7fa8a0009e50 con 0x7fa8a0009110 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient(hunting): my global_id is 6494 2024-04-26T00:00:58.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa8a00065d0 con 0x7fa8a0009110 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3162013945 0 0) 0x7fa8a00065d0 con 0x7fa8a0009110 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8a0009e50 con 0x7fa8a0009110 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa8b4003b90 con 0x7fa8a0009110 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient: dump: 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.216 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4008396861 0 0) 0x7fa8a0009e50 con 0x7fa8a0009110 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa8a000c3e0 con 0x7fa8a0009110 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1691494923) 0x7fa8b4003e60 con 0x7fa8a0009110 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.171:6791/0 conn(0x7fa8a0009110 legacy=0x7fa8a00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.220+0000 7fa8bd7fa640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.171:6791/0 conn(0x7fa8a0009110 legacy=0x7fa8a00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 376720, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:58.218 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.219 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.220 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:58.221 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.222 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.223 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.224 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.225 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.226 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.227 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:58.228 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:58.230 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.231 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.232 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:58.233 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.234 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:58.235 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:58.236 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:58.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.171:6812/722422047 conn(0x7fa8ac0377c0 legacy=0x7fa8ac039c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 10 monclient: shutdown 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 >> v1:172.21.15.106:6792/0 conn(0x7fa8c00a13c0 legacy=0x7fa8c0134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c52f6640 1 -- 172.21.15.106:0/3028703120 reap_dead start 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c52f6640 1 -- 172.21.15.106:0/3028703120 reap_dead start 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 shutdown_connections 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 >> 172.21.15.106:0/3028703120 conn(0x7fa8c006b210 msgr2=0x7fa8c0070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 shutdown_connections 2024-04-26T00:00:58.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.224+0000 7fa8c6d59640 1 -- 172.21.15.106:0/3028703120 wait complete. 2024-04-26T00:00:58.238 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:58.238 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:00:58.239 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:00:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.372+0000 7f87833b9640 10 monclient: get_monmap_and_config 2024-04-26T00:00:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.372+0000 7f87833b9640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.372+0000 7f87833b9640 10 monclient: monmap: 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:58.378285+0000 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:58.378285+0000 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.356 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 Processor -- start 2024-04-26T00:00:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- start start 2024-04-26T00:00:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient: init 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient: _add_conns ranks=[6,4,3,0,7,2,5,8,1] 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient(hunting): picked mon.noname-d con 0x7f877c135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient(hunting): picked mon.noname-c con 0x7f877c1353b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient(hunting): picked mon.noname-g con 0x7f877c13bdf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877c06f2d0 con 0x7f877c13bdf0 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877c072330 con 0x7f877c1353b0 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877c072610 con 0x7f877c135870 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient(hunting): authenticate will time out at 1313.905567s 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8780954640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f877c1353b0 0x7f877c13a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:35548/0 (socket says 172.21.15.106:35548) 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8780954640 1 -- 172.21.15.106:0/1445596523 learned_addr learned my addr 172.21.15.106:0/1445596523 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8781155640 1 --1- 172.21.15.106:0/1445596523 >> v1:172.21.15.106:6792/0 conn(0x7f877c135870 0x7f877c135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60130/0 (socket says 172.21.15.106:60130) 2024-04-26T00:00:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1965377168 0 0) 0x7f877c072330 con 0x7f877c1353b0 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): my global_id is 145156 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8768003530 con 0x7f877c1353b0 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2002178732 0 0) 0x7f877c072610 con 0x7f877c135870 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient(hunting): my global_id is 6576 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f877c072330 con 0x7f877c135870 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 825460254 0 0) 0x7f877c072330 con 0x7f877c135870 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 >> v1:172.21.15.106:6791/0 conn(0x7f877c1353b0 legacy=0x7f877c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 >> v1:172.21.15.171:6790/0 conn(0x7f877c13bdf0 legacy=0x7f877c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 monclient: found mon.noname-d 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c0a3260 con 0x7f877c135870 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8778001800 con 0x7f877c135870 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: dump: 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 5 monclient: authenticate success, global_id 6576 2024-04-26T00:00:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8778001a10 con 0x7f877c135870 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 1 -- 172.21.15.106:0/1445596523 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8778004b30 con 0x7f877c135870 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 4 set_mon_vals no callback set 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f8773fff640 10 monclient: dump: 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient: shutdown 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- 172.21.15.106:0/1445596523 >> v1:172.21.15.106:6792/0 conn(0x7f877c135870 legacy=0x7f877c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- 172.21.15.106:0/1445596523 shutdown_connections 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- 172.21.15.106:0/1445596523 >> 172.21.15.106:0/1445596523 conn(0x7f877c0a64e0 msgr2=0x7f877c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- 172.21.15.106:0/1445596523 shutdown_connections 2024-04-26T00:00:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 1 -- 172.21.15.106:0/1445596523 wait complete. 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.376+0000 7f87833b9640 10 monclient: monmap: 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 Processor -- start 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 -- start start 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient: init 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient: _add_conns ranks=[7,0,4,6,3,2,5,1,8] 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient(hunting): picked mon.noname-i con 0x7f877c1353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient(hunting): picked mon.noname-a con 0x7f877c135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient(hunting): picked mon.noname-c con 0x7f877c13bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877c13bc20 con 0x7f877c135870 2024-04-26T00:00:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877c09f470 con 0x7f877c13bdf0 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f877c0706b0 con 0x7f877c1353b0 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient(hunting): authenticate will time out at 1313.908729s 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8781956640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f877c13bdf0 0x7f877c1d4bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:35564/0 (socket says 172.21.15.106:35564) 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8780954640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f877c135870 0x7f877c1d14a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41940/0 (socket says 172.21.15.106:41940) 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8781956640 1 -- 172.21.15.106:0/3704381091 learned_addr learned my addr 172.21.15.106:0/3704381091 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3871024892 0 0) 0x7f877c13bc20 con 0x7f877c135870 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): my global_id is 6750 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8760003530 con 0x7f877c135870 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3468024269 0 0) 0x7f877c09f470 con 0x7f877c13bdf0 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): my global_id is 145165 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f877c13bc20 con 0x7f877c13bdf0 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 322056489 0 0) 0x7f877c13bc20 con 0x7f877c13bdf0 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f877c09f470 con 0x7f877c13bdf0 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4010971147 0 0) 0x7f8760003530 con 0x7f877c135870 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f877c13bc20 con 0x7f877c135870 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8774001cd0 con 0x7f877c13bdf0 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.373 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f876c001580 con 0x7f877c135870 2024-04-26T00:00:58.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): dump: 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.375 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 434669920 0 0) 0x7f877c0706b0 con 0x7f877c1353b0 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): my global_id is 144925 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8760003530 con 0x7f877c1353b0 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2216606586 0 0) 0x7f877c09f470 con 0x7f877c13bdf0 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.171:6792/0 conn(0x7f877c1353b0 legacy=0x7f877c1cc610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.106:6789/0 conn(0x7f877c135870 legacy=0x7f877c1d14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 monclient: found mon.c 2024-04-26T00:00:58.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f877c136f00 con 0x7f877c13bdf0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 5 monclient: authenticate success, global_id 145165 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient: _renew_subs 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f877c136660 con 0x7f877c13bdf0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient: _renew_subs 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f877c135c50 con 0x7f877c13bdf0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8774002010 con 0x7f877c13bdf0 2024-04-26T00:00:58.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8774003f90 con 0x7f877c13bdf0 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87737fe640 4 set_mon_vals no callback set 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: dump: 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.378 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f875c0065d0 con 0x7f875c002870 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f87740041b0 con 0x7f877c13bdf0 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7f87740463d0 con 0x7f877c13bdf0 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8780954640 10 monclient: get_auth_request con 0x7f8760037f40 auth_method 0 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3477353372 0 0) 0x7f875c0065d0 con 0x7f875c002870 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient(hunting): my global_id is 144934 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f877c09f470 con 0x7f875c002870 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4291432002 0 0) 0x7f877c09f470 con 0x7f875c002870 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f875c0065d0 con 0x7f875c002870 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8778004bf0 con 0x7f875c002870 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.380+0000 7f8771ffb640 10 monclient: dump: 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.380 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.384+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 198261908 0 0) 0x7f875c0065d0 con 0x7f875c002870 2024-04-26T00:00:58.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.384+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f875c00a160 con 0x7f875c002870 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.384+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8778001680 con 0x7f875c002870 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.384+0000 7f8771ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.384+0000 7f8771ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.384+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.171:6792/0 conn(0x7f875c002870 legacy=0x7f875c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.384+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.171:6792/0 conn(0x7f875c002870 legacy=0x7f875c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f87833b9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f875c009e50 con 0x7f875c009110 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 97659450 0 0) 0x7f875c009e50 con 0x7f875c009110 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f8771ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f8771ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f8771ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f8771ffb640 10 monclient(hunting): my global_id is 144943 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.388+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f875c0065d0 con 0x7f875c009110 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2634069284 0 0) 0x7f875c0065d0 con 0x7f875c009110 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f875c009e50 con 0x7f875c009110 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8778005000 con 0x7f875c009110 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 10 monclient: dump: 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.384 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 586650113 0 0) 0x7f875c009e50 con 0x7f875c009110 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f875c00c3e0 con 0x7f875c009110 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2543486361) 0x7f87780051a0 con 0x7f875c009110 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.171:6792/0 conn(0x7f875c009110 legacy=0x7f875c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8771ffb640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.171:6792/0 conn(0x7f875c009110 legacy=0x7f875c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 40, 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 121918, 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:00:58.386 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.387 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.388 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:58.389 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:00:58.390 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.391 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.392 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.393 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.394 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:00:58.395 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:00:58.397 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:00:58.399 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:00:58.401 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:00:58.402 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:00:58.403 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.171:6812/722422047 conn(0x7f8760037f40 legacy=0x7f876003a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 10 monclient: shutdown 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 >> v1:172.21.15.106:6791/0 conn(0x7f877c13bdf0 legacy=0x7f877c1d4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8781956640 1 -- 172.21.15.106:0/3704381091 reap_dead start 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f8781956640 1 -- 172.21.15.106:0/3704381091 reap_dead start 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 shutdown_connections 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 >> 172.21.15.106:0/3704381091 conn(0x7f877c0a64e0 msgr2=0x7f877c12e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 shutdown_connections 2024-04-26T00:00:58.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.392+0000 7f87833b9640 1 -- 172.21.15.106:0/3704381091 wait complete. 2024-04-26T00:00:58.406 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:00:58.406 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['g'] 2024-04-26T00:00:58.406 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T00:00:58.406 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-04-26T00:00:58.406 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-04-26T00:00:58.406 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-04-26T00:00:58.406 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:00:58.431 INFO:tasks.ceph.mon.g:Stopped 2024-04-26T00:00:58.431 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-04-26T00:00:58.431 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:00:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient: get_monmap_and_config 2024-04-26T00:00:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient: monmap: 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:00:58.576302+0000 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:00:58.576302+0000 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.554 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.555 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 1 Processor -- start 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 1 -- start start 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient: init 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient: _add_conns ranks=[8,3,6,0,7,4,5,2,1] 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient(hunting): picked mon.noname-e con 0x7f9980135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient(hunting): picked mon.noname-g con 0x7f99801353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient(hunting): picked mon.noname-d con 0x7f998013bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998006f2d0 con 0x7f99801353b0 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980072330 con 0x7f998013bdf0 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980072610 con 0x7f9980135870 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f99861a0640 10 monclient(hunting): authenticate will time out at 1314.103411s 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997effd640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f99801353b0 legacy=0x7f998013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:00:58.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997f7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f9980135870 0x7f9980135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:56160/0 (socket says 172.21.15.106:56160) 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f998013bdf0 0x7f998013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60134/0 (socket says 172.21.15.106:60134) 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997f7fe640 1 -- 172.21.15.106:0/3268885475 learned_addr learned my addr 172.21.15.106:0/3268885475 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 593533236 0 0) 0x7f9980072610 con 0x7f9980135870 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): my global_id is 204272 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f996c003530 con 0x7f9980135870 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056650559 0 0) 0x7f9980072330 con 0x7f998013bdf0 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 10 monclient(hunting): my global_id is 6585 2024-04-26T00:00:58.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.572+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9980072610 con 0x7f998013bdf0 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2433187930 0 0) 0x7f996c003530 con 0x7f9980135870 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 >> v1:172.21.15.106:6792/0 conn(0x7f998013bdf0 legacy=0x7f998013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 >> v1:172.21.15.171:6790/0 conn(0x7f99801353b0 legacy=0x7f998013a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 monclient: found mon.noname-e 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99800a3260 con 0x7f9980135870 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9968001800 con 0x7f9980135870 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 5 monclient: authenticate success, global_id 204272 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: dump: 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.564 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9968001ad0 con 0x7f9980135870 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: get_monmap_and_config success 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 4 set_mon_vals no callback set 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 1 -- 172.21.15.106:0/3268885475 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9968004bf0 con 0x7f9980135870 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997e7fc640 10 monclient: dump: 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.566 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: shutdown 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- 172.21.15.106:0/3268885475 >> v1:172.21.15.106:6793/0 conn(0x7f9980135870 legacy=0x7f9980135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- 172.21.15.106:0/3268885475 shutdown_connections 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- 172.21.15.106:0/3268885475 >> 172.21.15.106:0/3268885475 conn(0x7f99800a64e0 msgr2=0x7f99800a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- 172.21.15.106:0/3268885475 shutdown_connections 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- 172.21.15.106:0/3268885475 wait complete. 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: build_initial_monmap 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: monmap: 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:00:58.567 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 Processor -- start 2024-04-26T00:00:58.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- start start 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: init 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: _reopen_session rank -1 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: _add_conns ranks=[6,7,0,5,4,2,3,8,1] 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient(hunting): picked mon.noname-d con 0x7f99801353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient(hunting): picked mon.noname-i con 0x7f9980135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient(hunting): picked mon.noname-a con 0x7f998013bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998009f930 con 0x7f998013bdf0 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9980139a40 con 0x7f99801353b0 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f998013a320 con 0x7f9980135870 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient(hunting): _renew_subs 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient(hunting): authenticate will time out at 1314.106434s 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997f7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f99801353b0 0x7f99801ca4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:60144/0 (socket says 172.21.15.106:60144) 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f998013bdf0 0x7f99801d2810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41944/0 (socket says 172.21.15.106:41944) 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997f7fe640 1 -- 172.21.15.106:0/1298892990 learned_addr learned my addr 172.21.15.106:0/1298892990 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:00:58.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3509064491 0 0) 0x7f9980139a40 con 0x7f99801353b0 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): my global_id is 6594 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9960003560 con 0x7f99801353b0 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469508802 0 0) 0x7f998009f930 con 0x7f998013bdf0 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): _negotiate 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): my global_id is 6759 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9980139a40 con 0x7f998013bdf0 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3575019794 0 0) 0x7f9960003560 con 0x7f99801353b0 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f998009f930 con 0x7f99801353b0 2024-04-26T00:00:58.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99680017c0 con 0x7f99801353b0 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): dump: 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.571 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4126373205 0 0) 0x7f9980139a40 con 0x7f998013bdf0 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9960003560 con 0x7f998013bdf0 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9978001d00 con 0x7f998013bdf0 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient(hunting): dump: 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.572 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1898518330 0 0) 0x7f998009f930 con 0x7f99801353b0 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 >> v1:172.21.15.171:6792/0 conn(0x7f9980135870 legacy=0x7f99801cf0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 >> v1:172.21.15.106:6789/0 conn(0x7f998013bdf0 legacy=0x7f99801d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient: _finish_hunting 0 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 monclient: found mon.d 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9980134cd0 con 0x7f99801353b0 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient: _finish_auth 0 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient: _check_auth_tickets 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 5 monclient: authenticate success, global_id 6594 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: _renew_subs 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f998013a5a0 con 0x7f99801353b0 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9968004f00 con 0x7f99801353b0 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:00:58.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: _renew_subs 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f998013a8e0 con 0x7f99801353b0 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f997dffb640 4 set_mon_vals no callback set 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f99680053f0 con 0x7f99801353b0 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.576+0000 7f9977fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f9977fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f9977fff640 10 monclient: dump: 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:00:58.575 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f99861a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f99861a0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f99861a0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9968010190 con 0x7f99801353b0 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9980075890 con 0x7f99801353b0 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7f9968046340 con 0x7f99801353b0 2024-04-26T00:00:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.580+0000 7f997effd640 10 monclient: get_auth_request con 0x7f9960037e10 auth_method 0 2024-04-26T00:00:58.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.584+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9968015a30 con 0x7f99801353b0 2024-04-26T00:00:58.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.584+0000 7f9977fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:00:58.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.584+0000 7f9977fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:00:58.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:00:58.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:00:58.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:00:58.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9980062e50 con 0x7f99801353b0 2024-04-26T00:00:58.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f9977fff640 1 -- 172.21.15.106:0/1298892990 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1281078678) 0x7f9968015330 con 0x7f99801353b0 2024-04-26T00:00:58.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f9977fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:00:58.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f9977fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:00:58.789 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":40,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:00:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 >> v1:172.21.15.171:6812/722422047 conn(0x7f9960037e10 legacy=0x7f996003a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 10 monclient: shutdown 2024-04-26T00:00:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:00:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 >> v1:172.21.15.106:6792/0 conn(0x7f99801353b0 legacy=0x7f99801ca4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:00:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 shutdown_connections 2024-04-26T00:00:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 >> 172.21.15.106:0/1298892990 conn(0x7f99800a64e0 msgr2=0x7f99800a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:00:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 shutdown_connections 2024-04-26T00:00:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:00:58.808+0000 7f99861a0640 1 -- 172.21.15.106:0/1298892990 wait complete. 2024-04-26T00:01:00.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:01.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:00.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:01.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:00.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:01.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:00.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:01.014+0000 7fb27dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:01.807 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:01:01.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.952+0000 7feb555c3640 10 monclient: get_monmap_and_config 2024-04-26T00:01:01.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.952+0000 7feb555c3640 10 monclient: build_initial_monmap 2024-04-26T00:01:01.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.952+0000 7feb555c3640 10 monclient: monmap: 2024-04-26T00:01:01.934 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:01.934 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:01.934 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:01.957042+0000 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:01.957042+0000 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:01.935 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.952+0000 7feb555c3640 1 Processor -- start 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.952+0000 7feb555c3640 1 -- start start 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.952+0000 7feb555c3640 10 monclient: init 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 10 monclient: _add_conns ranks=[1,3,7,0,6,8,2,4,5] 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 10 monclient(hunting): picked mon.noname-f con 0x7feb501357a0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 10 monclient(hunting): picked mon.noname-g con 0x7feb50135390 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 10 monclient(hunting): picked mon.noname-i con 0x7feb50071d30 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb50136290 con 0x7feb501357a0 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb500724c0 con 0x7feb50135390 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb500a5110 con 0x7feb50071d30 2024-04-26T00:01:01.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:01.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb555c3640 10 monclient(hunting): authenticate will time out at 1317.484467s 2024-04-26T00:01:01.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb4e7fc640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7feb50135390 legacy=0x7feb5013a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:01.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb4effd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7feb501357a0 0x7feb50135b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:43420/0 (socket says 172.21.15.106:43420) 2024-04-26T00:01:01.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:01.956+0000 7feb4effd640 1 -- 172.21.15.106:0/1222900838 learned_addr learned my addr 172.21.15.106:0/1222900838 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:01.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:02.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:01.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:02.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:01.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:02.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:02.160+0000 7feb4e7fc640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb50135390 legacy=0x7feb5013a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:02.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:02.564+0000 7feb4e7fc640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb50135390 legacy=0x7feb5013a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:02.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:03.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:02.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:03.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:02.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:03.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:03.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:03.368+0000 7feb4e7fc640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb50135390 legacy=0x7feb5013a6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:03.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:04.018+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:03.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:04.018+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:03.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:04.018+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient(hunting): tick 2024-04-26T00:01:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:01:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 1 monclient(hunting): continuing hunt 2024-04-26T00:01:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:01:04.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6792/0 conn(0x7feb50071d30 legacy=0x7feb5013dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb50135390 legacy=0x7feb5013a6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6789/0 conn(0x7feb501357a0 legacy=0x7feb50135b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient: _add_conns ranks=[2,0,5,4,6,8] 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-b con 0x7feb300037d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-a con 0x7feb300073c0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-h con 0x7feb3000b150 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb50070fa0 con 0x7feb300073c0 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb500724c0 con 0x7feb300037d0 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb30011000 con 0x7feb3000b150 2024-04-26T00:01:04.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:04.956+0000 7feb4cff9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:04.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:05.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:04.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:05.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:04.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:05.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:05.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:06.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:05.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:06.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:05.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:06.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:06.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:07.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:06.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:07.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:06.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:07.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:07.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient(hunting): tick 2024-04-26T00:01:07.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 1 monclient(hunting): continuing hunt 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6791/0 conn(0x7feb3000b150 legacy=0x7feb3000d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6790/0 conn(0x7feb300037d0 legacy=0x7feb30005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6789/0 conn(0x7feb300073c0 legacy=0x7feb30009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient: _add_conns ranks=[4,6,8] 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-c con 0x7feb3000f070 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-d con 0x7feb3000ff40 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-e con 0x7feb30010b30 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb30012290 con 0x7feb3000f070 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4f7fe640 1 -- 172.21.15.106:0/1222900838 reap_dead start 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3001bf90 con 0x7feb3000ff40 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3001d170 con 0x7feb30010b30 2024-04-26T00:01:07.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:07.955+0000 7feb4cff9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:07.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:08.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:07.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:08.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:07.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:08.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:09.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:09.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:09.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:09.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:09.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:09.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:10.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:10.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:10.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:10.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:10.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:10.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient(hunting): tick 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 1 monclient(hunting): continuing hunt 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6793/0 conn(0x7feb30010b30 legacy=0x7feb300196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6792/0 conn(0x7feb3000ff40 legacy=0x7feb300103f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6791/0 conn(0x7feb3000f070 legacy=0x7feb3000f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient: _add_conns ranks=[5,0,7,8,3,6,1,2,4] 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-h con 0x7feb3000e0d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-a con 0x7feb3000e510 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:10.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-i con 0x7feb30006350 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:10.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3000de10 con 0x7feb3000e510 2024-04-26T00:01:10.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3000eb90 con 0x7feb3000e0d0 2024-04-26T00:01:10.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb30006760 con 0x7feb30006350 2024-04-26T00:01:10.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:10.955+0000 7feb4cff9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:11.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:11.018+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:11.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:11.018+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:11.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:11.018+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:11.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:11.018+0000 7fb27dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:12.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:12.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:12.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:12.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:12.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:12.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:13.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:13.014+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:13.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:13.014+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:13.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:13.014+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:13.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient(hunting): tick 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 1 monclient(hunting): continuing hunt 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6792/0 conn(0x7feb30006350 legacy=0x7feb3000d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6791/0 conn(0x7feb3000e0d0 legacy=0x7feb30005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6789/0 conn(0x7feb3000e510 legacy=0x7feb30009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient: _add_conns ranks=[1,2,3,8,4,6] 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-f con 0x7feb30006d20 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4f7fe640 1 -- 172.21.15.106:0/1222900838 reap_dead start 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-b con 0x7feb30020a70 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:13.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-g con 0x7feb30006350 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:13.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb30006980 con 0x7feb30006d20 2024-04-26T00:01:13.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300103f0 con 0x7feb30020a70 2024-04-26T00:01:13.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300105c0 con 0x7feb30006350 2024-04-26T00:01:13.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4cff9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:13.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:13.959+0000 7feb4f7fe640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb30006350 legacy=0x7feb3000d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:14.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:14.018+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:14.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:14.018+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:14.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:14.018+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:14.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:14.163+0000 7feb4f7fe640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb30006350 legacy=0x7feb3000d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:14.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:14.567+0000 7feb4f7fe640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb30006350 legacy=0x7feb3000d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:15.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:15.018+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:15.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:15.018+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:15.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:15.018+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:15.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:15.371+0000 7feb4f7fe640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb30006350 legacy=0x7feb3000d5c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:16.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:16.018+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:16.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:16.018+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:16.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:16.018+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient(hunting): tick 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 1 monclient(hunting): continuing hunt 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6790/0 conn(0x7feb30006350 legacy=0x7feb3000d5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6790/0 conn(0x7feb30020a70 legacy=0x7feb30022e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.171:6789/0 conn(0x7feb30006d20 legacy=0x7feb3001f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient: _add_conns ranks=[8,4,6] 2024-04-26T00:01:16.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-e con 0x7feb3000e0d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:16.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-c con 0x7feb3000e510 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:16.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient(hunting): picked mon.noname-d con 0x7feb3000f070 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:16.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb30010790 con 0x7feb3000e510 2024-04-26T00:01:16.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb300105c0 con 0x7feb3000f070 2024-04-26T00:01:16.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb3000f4b0 con 0x7feb3000e0d0 2024-04-26T00:01:16.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:16.955+0000 7feb4cff9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:17.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:17.018+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:17.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:17.018+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:17.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:17.018+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:17.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078243049 0 0) 0x7feb30010790 con 0x7feb3000e510 2024-04-26T00:01:17.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:17.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:17.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:17.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): my global_id is 145174 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb3c003530 con 0x7feb3000e510 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757925225 0 0) 0x7feb3000f4b0 con 0x7feb3000e0d0 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): my global_id is 204281 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb30010790 con 0x7feb3000e0d0 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4040484988 0 0) 0x7feb300105c0 con 0x7feb3000f070 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:17.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 10 monclient(hunting): my global_id is 6603 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb3000f4b0 con 0x7feb3000f070 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 373593706 0 0) 0x7feb30010790 con 0x7feb3000e0d0 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.827+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6792/0 conn(0x7feb3000f070 legacy=0x7feb30009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6791/0 conn(0x7feb3000e510 legacy=0x7feb300196a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 1 monclient: found mon.noname-e 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3000f680 con 0x7feb3000e0d0 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:17.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4f7fe640 1 -- 172.21.15.106:0/1222900838 reap_dead start 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feb48001bc0 con 0x7feb3000e0d0 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: dump: 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:17.814 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:17.815 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:17.816 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:17.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 5 monclient: authenticate success, global_id 204281 2024-04-26T00:01:17.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb48001df0 con 0x7feb3000e0d0 2024-04-26T00:01:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 1 -- 172.21.15.106:0/1222900838 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feb48004f70 con 0x7feb3000e0d0 2024-04-26T00:01:17.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb4dffb640 10 monclient: dump: 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:17.819 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 4 set_mon_vals no callback set 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 10 monclient: shutdown 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:17.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 1 -- 172.21.15.106:0/1222900838 >> v1:172.21.15.106:6793/0 conn(0x7feb3000e0d0 legacy=0x7feb30005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 1 -- 172.21.15.106:0/1222900838 shutdown_connections 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 1 -- 172.21.15.106:0/1222900838 >> 172.21.15.106:0/1222900838 conn(0x7feb500a8370 msgr2=0x7feb500a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 1 -- 172.21.15.106:0/1222900838 shutdown_connections 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 1 -- 172.21.15.106:0/1222900838 wait complete. 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 10 monclient: build_initial_monmap 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.831+0000 7feb555c3640 10 monclient: monmap: 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:17.821 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 1 Processor -- start 2024-04-26T00:01:17.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 1 -- start start 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient: init 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient: _add_conns ranks=[2,5,1,4,0,3,7,8,6] 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient(hunting): picked mon.noname-b con 0x7feb3000e0d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient(hunting): picked mon.noname-h con 0x7feb5011e850 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient(hunting): picked mon.noname-f con 0x7feb5011ec50 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb50121570 con 0x7feb5011ec50 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb500a1910 con 0x7feb3000e0d0 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb50121290 con 0x7feb5011e850 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb555c3640 10 monclient(hunting): authenticate will time out at 1333.365447s 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb4effd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7feb3000e0d0 0x7feb5011e140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42250/0 (socket says 172.21.15.106:42250) 2024-04-26T00:01:17.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.835+0000 7feb4effd640 1 -- 172.21.15.106:0/2953834344 learned_addr learned my addr 172.21.15.106:0/2953834344 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:17.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3995418400 0 0) 0x7feb50121570 con 0x7feb5011ec50 2024-04-26T00:01:17.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:17.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:17.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:17.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): my global_id is 145027 2024-04-26T00:01:17.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb3000e960 con 0x7feb5011ec50 2024-04-26T00:01:17.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722785183 0 0) 0x7feb500a1910 con 0x7feb3000e0d0 2024-04-26T00:01:17.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:17.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:17.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:17.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): my global_id is 6554 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb50121570 con 0x7feb3000e0d0 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3974649148 0 0) 0x7feb3000e960 con 0x7feb5011ec50 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb500a1910 con 0x7feb5011ec50 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feb400018a0 con 0x7feb5011ec50 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): dump: 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:17.849 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 616270826 0 0) 0x7feb50121570 con 0x7feb3000e0d0 2024-04-26T00:01:17.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7feb3000e960 con 0x7feb3000e0d0 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feb48001ac0 con 0x7feb3000e0d0 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient(hunting): dump: 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:17.851 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3067765766 0 0) 0x7feb3000e960 con 0x7feb3000e0d0 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 >> v1:172.21.15.171:6791/0 conn(0x7feb5011e850 legacy=0x7feb501cd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 >> v1:172.21.15.171:6789/0 conn(0x7feb5011ec50 legacy=0x7feb501d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 monclient: found mon.b 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:17.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb50133020 con 0x7feb3000e0d0 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb555c3640 5 monclient: authenticate success, global_id 6554 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb555c3640 10 monclient: _renew_subs 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb555c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7feb5011fb30 con 0x7feb3000e0d0 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb555c3640 10 monclient: _renew_subs 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb555c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7feb5011fb30 con 0x7feb3000e0d0 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7feb480051e0 con 0x7feb3000e0d0 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:17.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feb480056d0 con 0x7feb3000e0d0 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb477fe640 10 monclient: dump: 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:17.854 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.863+0000 7feb4d7fa640 4 set_mon_vals no callback set 2024-04-26T00:01:17.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.867+0000 7feb555c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.867+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7feb480058f0 con 0x7feb3000e0d0 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.867+0000 7feb555c3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.867+0000 7feb555c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.867+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb34005090 con 0x7feb3000e0d0 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.867+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7feb48046720 con 0x7feb3000e0d0 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.867+0000 7feb4e7fc640 10 monclient: get_auth_request con 0x7feb3003ae80 auth_method 0 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.871+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7feb48015e50 con 0x7feb3000e0d0 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.871+0000 7feb477fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:17.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:17.871+0000 7feb477fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:18.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.018+0000 7fb27dffb640 10 monclient: tick 2024-04-26T00:01:18.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.018+0000 7fb27dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.018+0000 7fb27dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.091+0000 7feb555c3640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:01:18.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.091+0000 7feb555c3640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:01:18.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.091+0000 7feb555c3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.091+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7feb34005380 con 0x7feb3000e0d0 2024-04-26T00:01:18.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.091+0000 7feb477fe640 1 -- 172.21.15.106:0/2953834344 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2738 (unknown 254746657 0 3364655033) 0x7feb48015750 con 0x7feb3000e0d0 2024-04-26T00:01:18.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.091+0000 7feb477fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:01:18.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.091+0000 7feb477fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:18.075 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":46,"quorum":[0,1,2,4,5,6,7,8],"quorum_names":["a","f","b","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 >> v1:172.21.15.171:6812/722422047 conn(0x7feb3003ae80 legacy=0x7feb3003d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 10 monclient: shutdown 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 >> v1:172.21.15.106:6790/0 conn(0x7feb3000e0d0 legacy=0x7feb5011e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 shutdown_connections 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 >> 172.21.15.106:0/2953834344 conn(0x7feb500a8370 msgr2=0x7feb5006c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 shutdown_connections 2024-04-26T00:01:18.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.095+0000 7feb555c3640 1 -- 172.21.15.106:0/2953834344 wait complete. 2024-04-26T00:01:18.092 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-04-26T00:01:18.093 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-04-26T00:01:18.093 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:01:18.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: get_monmap_and_config 2024-04-26T00:01:18.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: monmap: 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:18.234587+0000 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:18.234587+0000 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.212 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.213 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.213 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.213 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 Processor -- start 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- start start 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: init 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: _add_conns ranks=[8,7,1,5,0,3,6,4,2] 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient(hunting): picked mon.noname-e con 0x7f72e0135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient(hunting): picked mon.noname-i con 0x7f72e01353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient(hunting): picked mon.noname-f con 0x7f72e013bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e006f2d0 con 0x7f72e013bdf0 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e0072330 con 0x7f72e01353b0 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e0072610 con 0x7f72e0135870 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient(hunting): authenticate will time out at 1333.761796s 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e5cd5640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f72e0135870 0x7f72e0135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:37428/0 (socket says 172.21.15.106:37428) 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e5cd5640 1 -- 172.21.15.106:0/3920308887 learned_addr learned my addr 172.21.15.106:0/3920308887 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1027056546 0 0) 0x7f72e0072610 con 0x7f72e0135870 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient(hunting): my global_id is 204290 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72cc003530 con 0x7f72e0135870 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3330976084 0 0) 0x7f72cc003530 con 0x7f72e0135870 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 >> v1:172.21.15.171:6792/0 conn(0x7f72e01353b0 legacy=0x7f72e013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 >> v1:172.21.15.171:6789/0 conn(0x7f72e013bdf0 legacy=0x7f72e013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 monclient: found mon.noname-e 2024-04-26T00:01:18.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e00a3260 con 0x7f72e0135870 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 5 monclient: authenticate success, global_id 204290 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72dc001800 con 0x7f72e0135870 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: dump: 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.223 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72dc001b10 con 0x7f72e0135870 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 4 set_mon_vals no callback set 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 1 -- 172.21.15.106:0/3920308887 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72dc004bf0 con 0x7f72e0135870 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e4cd3640 10 monclient: dump: 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.225 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: shutdown 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- 172.21.15.106:0/3920308887 >> v1:172.21.15.106:6793/0 conn(0x7f72e0135870 legacy=0x7f72e0135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- 172.21.15.106:0/3920308887 shutdown_connections 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- 172.21.15.106:0/3920308887 >> 172.21.15.106:0/3920308887 conn(0x7f72e00a64e0 msgr2=0x7f72e00a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- 172.21.15.106:0/3920308887 shutdown_connections 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 1 -- 172.21.15.106:0/3920308887 wait complete. 2024-04-26T00:01:18.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.231+0000 7f72e7f39640 10 monclient: monmap: 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.227 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.228 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 Processor -- start 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 -- start start 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient: init 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient: _add_conns ranks=[7,1,4,8,5,3,6,0,2] 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient(hunting): picked mon.noname-i con 0x7f72e01353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient(hunting): picked mon.noname-f con 0x7f72e0135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient(hunting): picked mon.noname-c con 0x7f72e013bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e0132660 con 0x7f72e0135870 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e01305f0 con 0x7f72e013bdf0 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f72e009f470 con 0x7f72e01353b0 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient(hunting): authenticate will time out at 1333.764690s 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e64d6640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f72e013bdf0 0x7f72e01d29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:54668/0 (socket says 172.21.15.106:54668) 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e64d6640 1 -- 172.21.15.106:0/10930866 learned_addr learned my addr 172.21.15.106:0/10930866 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1117160741 0 0) 0x7f72e01305f0 con 0x7f72e013bdf0 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): my global_id is 145183 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72c4003530 con 0x7f72e013bdf0 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 888095787 0 0) 0x7f72c4003530 con 0x7f72e013bdf0 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72e01305f0 con 0x7f72e013bdf0 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72d8001cc0 con 0x7f72e013bdf0 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:01:18.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): dump: 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322961364 0 0) 0x7f72e009f470 con 0x7f72e01353b0 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): my global_id is 144970 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72c4003530 con 0x7f72e01353b0 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3333760159 0 0) 0x7f72e0132660 con 0x7f72e0135870 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): my global_id is 145045 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e009f470 con 0x7f72e0135870 2024-04-26T00:01:18.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1870772105 0 0) 0x7f72e01305f0 con 0x7f72e013bdf0 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.171:6792/0 conn(0x7f72e01353b0 legacy=0x7f72e012f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.171:6789/0 conn(0x7f72e0135870 legacy=0x7f72e012fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 monclient: found mon.c 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e009f930 con 0x7f72e013bdf0 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 5 monclient: authenticate success, global_id 145183 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient: _renew_subs 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:18.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f72e009e5c0 con 0x7f72e013bdf0 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient: _renew_subs 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f72e0130bb0 con 0x7f72e013bdf0 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f72d8003cd0 con 0x7f72e013bdf0 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72d80020d0 con 0x7f72e013bdf0 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d7fff640 4 set_mon_vals no callback set 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: dump: 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.235 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f72c80065d0 con 0x7f72c8002870 2024-04-26T00:01:18.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f72d80042c0 con 0x7f72e013bdf0 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7f72d80464b0 con 0x7f72e013bdf0 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3074135697 0 0) 0x7f72c80065d0 con 0x7f72c8002870 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient(hunting): my global_id is 6768 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72e01305f0 con 0x7f72c8002870 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72e54d4640 10 monclient: get_auth_request con 0x7f72c40379f0 auth_method 0 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1994190969 0 0) 0x7f72e01305f0 con 0x7f72c8002870 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72c80065d0 con 0x7f72c8002870 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72dc0017c0 con 0x7f72c8002870 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:18.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: dump: 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.238 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2245855282 0 0) 0x7f72c80065d0 con 0x7f72c8002870 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f72c800a160 con 0x7f72c8002870 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f72dc004aa0 con 0x7f72c8002870 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.106:6789/0 conn(0x7f72c8002870 legacy=0x7f72c8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.235+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.106:6789/0 conn(0x7f72c8002870 legacy=0x7f72c8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:18.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f72c8009e50 con 0x7f72c8009110 2024-04-26T00:01:18.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3847579741 0 0) 0x7f72c8009e50 con 0x7f72c8009110 2024-04-26T00:01:18.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient(hunting): my global_id is 6777 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f72c80065d0 con 0x7f72c8009110 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4024811294 0 0) 0x7f72c80065d0 con 0x7f72c8009110 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f72c8009e50 con 0x7f72c8009110 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f72dc004c50 con 0x7f72c8009110 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient: dump: 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.242 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3602390376 0 0) 0x7f72c8009e50 con 0x7f72c8009110 2024-04-26T00:01:18.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f72c800c3e0 con 0x7f72c8009110 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7556 (unknown 0 0 331777921) 0x7f72dc0053b0 con 0x7f72c8009110 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.106:6789/0 conn(0x7f72c8009110 legacy=0x7f72c80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72d67fc640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.106:6789/0 conn(0x7f72c8009110 legacy=0x7f72c80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:18.244 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 396803, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.246 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.247 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:18.248 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.249 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.250 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.251 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.253 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.255 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:18.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.259 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.261 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:18.262 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.171:6812/722422047 conn(0x7f72c40379f0 legacy=0x7f72c4039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 10 monclient: shutdown 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 >> v1:172.21.15.106:6791/0 conn(0x7f72e013bdf0 legacy=0x7f72e01d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e64d6640 1 -- 172.21.15.106:0/10930866 reap_dead start 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e64d6640 1 -- 172.21.15.106:0/10930866 reap_dead start 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 shutdown_connections 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 >> 172.21.15.106:0/10930866 conn(0x7f72e00a64e0 msgr2=0x7f72e012e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 shutdown_connections 2024-04-26T00:01:18.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.243+0000 7f72e7f39640 1 -- 172.21.15.106:0/10930866 wait complete. 2024-04-26T00:01:18.265 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:18.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-04-26T00:01:18.265 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.395+0000 7fe916d1a640 10 monclient: get_monmap_and_config 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.395+0000 7fe916d1a640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.395+0000 7fe916d1a640 10 monclient: monmap: 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:18.402146+0000 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:18.402146+0000 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.379 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.380 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 Processor -- start 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- start start 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient: init 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient: _add_conns ranks=[1,4,3,0,8,5,7,6,2] 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient(hunting): picked mon.noname-f con 0x7fe910134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient(hunting): picked mon.noname-c con 0x7fe9100a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient(hunting): picked mon.noname-g con 0x7fe91013e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91006dd40 con 0x7fe910134970 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9100a2b10 con 0x7fe91013e200 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9100a2df0 con 0x7fe9100a4820 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient(hunting): authenticate will time out at 1333.929534s 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe9152b7640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fe91013e200 legacy=0x7fe9101405f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fe9100a4820 0x7fe91013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:54676/0 (socket says 172.21.15.106:54676) 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90ffff640 1 -- 172.21.15.106:0/498447453 learned_addr learned my addr 172.21.15.106:0/498447453 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059960342 0 0) 0x7fe9100a2df0 con 0x7fe9100a4820 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient(hunting): my global_id is 145192 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f8003530 con 0x7fe9100a4820 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3641100896 0 0) 0x7fe8f8003530 con 0x7fe9100a4820 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 >> v1:172.21.15.171:6790/0 conn(0x7fe91013e200 legacy=0x7fe9101405f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 >> v1:172.21.15.171:6789/0 conn(0x7fe910134970 legacy=0x7fe910134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 monclient: found mon.noname-c 2024-04-26T00:01:18.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9100a30d0 con 0x7fe9100a4820 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe9040017c0 con 0x7fe9100a4820 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: dump: 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.389 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 5 monclient: authenticate success, global_id 145192 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe904001ab0 con 0x7fe9100a4820 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 1 -- 172.21.15.106:0/498447453 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe904004bf0 con 0x7fe9100a4820 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe90f7fe640 10 monclient: dump: 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.391 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 4 set_mon_vals no callback set 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient: shutdown 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- 172.21.15.106:0/498447453 >> v1:172.21.15.106:6791/0 conn(0x7fe9100a4820 legacy=0x7fe91013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- 172.21.15.106:0/498447453 shutdown_connections 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- 172.21.15.106:0/498447453 >> 172.21.15.106:0/498447453 conn(0x7fe9100a9e20 msgr2=0x7fe9100aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- 172.21.15.106:0/498447453 shutdown_connections 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 -- 172.21.15.106:0/498447453 wait complete. 2024-04-26T00:01:18.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 10 monclient: monmap: 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.393 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.399+0000 7fe916d1a640 1 Processor -- start 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 1 -- start start 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient: init 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient: _add_conns ranks=[7,3,0,4,6,8,2,1,5] 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient(hunting): picked mon.noname-i con 0x7fe9100a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient(hunting): picked mon.noname-g con 0x7fe910134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient(hunting): picked mon.noname-a con 0x7fe91013e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91013ae20 con 0x7fe91013e200 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9101396d0 con 0x7fe910134970 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe91013d5e0 con 0x7fe9100a4820 2024-04-26T00:01:18.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient(hunting): authenticate will time out at 1333.932501s 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90ffff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fe910134970 legacy=0x7fe910138fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe9152b7640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe91013e200 0x7fe9101d47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56016/0 (socket says 172.21.15.106:56016) 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe9152b7640 1 -- 172.21.15.106:0/2300386068 learned_addr learned my addr 172.21.15.106:0/2300386068 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559307796 0 0) 0x7fe91013ae20 con 0x7fe91013e200 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): my global_id is 6786 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8fc003530 con 0x7fe91013e200 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 115564903 0 0) 0x7fe8fc003530 con 0x7fe91013e200 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe91013ae20 con 0x7fe91013e200 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe908004570 con 0x7fe91013e200 2024-04-26T00:01:18.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): dump: 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.396 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1400300381 0 0) 0x7fe91013ae20 con 0x7fe91013e200 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.171:6792/0 conn(0x7fe9100a4820 legacy=0x7fe9101388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.171:6790/0 conn(0x7fe910134970 legacy=0x7fe910138fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 monclient: found mon.a 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe910137af0 con 0x7fe91013e200 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 5 monclient: authenticate success, global_id 6786 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient: _renew_subs 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe91013a5c0 con 0x7fe91013e200 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient: _renew_subs 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe91013ab40 con 0x7fe91013e200 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe9080048d0 con 0x7fe91013e200 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe908004e40 con 0x7fe91013e200 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90effd640 4 set_mon_vals no callback set 2024-04-26T00:01:18.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: dump: 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.399 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe8f00065d0 con 0x7fe8f0002870 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe908004fe0 con 0x7fe91013e200 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7fe9080464a0 con 0x7fe91013e200 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1701005912 0 0) 0x7fe8f00065d0 con 0x7fe8f0002870 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient(hunting): my global_id is 6563 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe91013ae20 con 0x7fe8f0002870 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90ffff640 10 monclient: get_auth_request con 0x7fe8fc0377e0 auth_method 0 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 382313508 0 0) 0x7fe91013ae20 con 0x7fe8f0002870 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8f00065d0 con 0x7fe8f0002870 2024-04-26T00:01:18.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe900001980 con 0x7fe8f0002870 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: dump: 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.401 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 224415133 0 0) 0x7fe8f00065d0 con 0x7fe8f0002870 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe8f000a160 con 0x7fe8f0002870 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe900004650 con 0x7fe8f0002870 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.106:6790/0 conn(0x7fe8f0002870 legacy=0x7fe8f0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.403+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.106:6790/0 conn(0x7fe8f0002870 legacy=0x7fe8f0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe8f0009e30 con 0x7fe8f00090f0 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209431694 0 0) 0x7fe8f0009e30 con 0x7fe8f00090f0 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient(hunting): my global_id is 6572 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8f00065d0 con 0x7fe8f00090f0 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1166092021 0 0) 0x7fe8f00065d0 con 0x7fe8f00090f0 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8f0009e30 con 0x7fe8f00090f0 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe900003bb0 con 0x7fe8f00090f0 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient: dump: 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.404 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2880803912 0 0) 0x7fe8f0009e30 con 0x7fe8f00090f0 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe8f000c3a0 con 0x7fe8f00090f0 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 4135297148) 0x7fe900003ef0 con 0x7fe8f00090f0 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.106:6790/0 conn(0x7fe8f00090f0 legacy=0x7fe8f0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe90d7fa640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.106:6790/0 conn(0x7fe8f00090f0 legacy=0x7fe8f0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:18.406 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 396975, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:01:18.407 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.408 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.409 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:18.410 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.411 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:18.414 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.415 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.416 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:18.417 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.418 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.419 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.420 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.421 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.422 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.423 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.424 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:01:18.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.425 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.425 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:18.425 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.171:6812/722422047 conn(0x7fe8fc0377e0 legacy=0x7fe8fc039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 10 monclient: shutdown 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 >> v1:172.21.15.106:6789/0 conn(0x7fe91013e200 legacy=0x7fe9101d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe9152b7640 1 -- 172.21.15.106:0/2300386068 reap_dead start 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe9152b7640 1 -- 172.21.15.106:0/2300386068 reap_dead start 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 shutdown_connections 2024-04-26T00:01:18.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 >> 172.21.15.106:0/2300386068 conn(0x7fe9100a9e20 msgr2=0x7fe910130bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 shutdown_connections 2024-04-26T00:01:18.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.411+0000 7fe916d1a640 1 -- 172.21.15.106:0/2300386068 wait complete. 2024-04-26T00:01:18.427 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:18.427 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-04-26T00:01:18.427 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:01:18.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: get_monmap_and_config 2024-04-26T00:01:18.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: monmap: 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:18.562511+0000 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:18.562511+0000 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.540 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.541 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.541 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 Processor -- start 2024-04-26T00:01:18.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- start start 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: init 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: _add_conns ranks=[7,2,6,3,0,8,1,4,5] 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient(hunting): picked mon.noname-i con 0x7f316006bd00 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient(hunting): picked mon.noname-b con 0x7f316006c7f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient(hunting): picked mon.noname-d con 0x7f31600715e0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316006e2e0 con 0x7f316006c7f0 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316006ce30 con 0x7f31600715e0 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31600705f0 con 0x7f316006bd00 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient(hunting): authenticate will time out at 1334.089630s 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315effd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f316006c7f0 0x7f3160141060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42286/0 (socket says 172.21.15.106:42286) 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f31600715e0 0x7f3160144790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35266/0 (socket says 172.21.15.106:35266) 2024-04-26T00:01:18.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315effd640 1 -- 172.21.15.106:0/3154140838 learned_addr learned my addr 172.21.15.106:0/3154140838 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516806292 0 0) 0x7f316006e2e0 con 0x7f316006c7f0 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): my global_id is 6581 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3148003530 con 0x7f316006c7f0 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 837757062 0 0) 0x7f316006ce30 con 0x7f31600715e0 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient(hunting): my global_id is 6612 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f316006e2e0 con 0x7f31600715e0 2024-04-26T00:01:18.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2569347990 0 0) 0x7f3148003530 con 0x7f316006c7f0 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 >> v1:172.21.15.171:6792/0 conn(0x7f316006bd00 legacy=0x7f316006c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 >> v1:172.21.15.106:6792/0 conn(0x7f31600715e0 legacy=0x7f3160144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 monclient: found mon.noname-b 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3160072f90 con 0x7f316006c7f0 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f31540017c0 con 0x7f316006c7f0 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 5 monclient: authenticate success, global_id 6581 2024-04-26T00:01:18.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: dump: 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.552 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31540019b0 con 0x7f316006c7f0 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 4 set_mon_vals no callback set 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 1 -- 172.21.15.106:0/3154140838 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3154004bf0 con 0x7f316006c7f0 2024-04-26T00:01:18.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f315e7fc640 10 monclient: dump: 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.554 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: shutdown 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- 172.21.15.106:0/3154140838 >> v1:172.21.15.106:6790/0 conn(0x7f316006c7f0 legacy=0x7f3160141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- 172.21.15.106:0/3154140838 shutdown_connections 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- 172.21.15.106:0/3154140838 >> 172.21.15.106:0/3154140838 conn(0x7f316006b210 msgr2=0x7f316006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- 172.21.15.106:0/3154140838 shutdown_connections 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 1 -- 172.21.15.106:0/3154140838 wait complete. 2024-04-26T00:01:18.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.559+0000 7f31661e2640 10 monclient: monmap: 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.556 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 Processor -- start 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 -- start start 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient: init 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient: _add_conns ranks=[5,1,3,0,4,8,6,2,7] 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient(hunting): picked mon.noname-h con 0x7f316006bd00 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient(hunting): picked mon.noname-f con 0x7f316006c7f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient(hunting): picked mon.noname-g con 0x7f31600715e0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3160072c60 con 0x7f316006c7f0 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31601421c0 con 0x7f31600715e0 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f316006d560 con 0x7f316006bd00 2024-04-26T00:01:18.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient(hunting): authenticate will time out at 1334.092608s 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f315ffff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f31600715e0 legacy=0x7f31601d90f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f315effd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f316006c7f0 0x7f316013ec30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:58980/0 (socket says 172.21.15.106:58980) 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f315effd640 1 -- 172.21.15.106:0/2301807546 learned_addr learned my addr 172.21.15.106:0/2301807546 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389444115 0 0) 0x7f3160072f90 con 0x7f316006c7f0 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): my global_id is 145063 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f314c003530 con 0x7f316006c7f0 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242921706 0 0) 0x7f316006d560 con 0x7f316006bd00 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): my global_id is 6503 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3160072f90 con 0x7f316006bd00 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2347485411 0 0) 0x7f314c003530 con 0x7f316006c7f0 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f316006d560 con 0x7f316006c7f0 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f31540017c0 con 0x7f316006c7f0 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): dump: 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.559 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4190620574 0 0) 0x7f3160072f90 con 0x7f316006bd00 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f314c003530 con 0x7f316006bd00 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3158001ce0 con 0x7f316006bd00 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:18.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): dump: 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.561 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 514115650 0 0) 0x7f316006d560 con 0x7f316006c7f0 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.171:6791/0 conn(0x7f316006bd00 legacy=0x7f316013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.171:6790/0 conn(0x7f31600715e0 legacy=0x7f31601d90f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 monclient: found mon.f 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31601424a0 con 0x7f316006c7f0 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 5 monclient: authenticate success, global_id 145063 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient: _renew_subs 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f316013f340 con 0x7f316006c7f0 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient: _renew_subs 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3160143e60 con 0x7f316006c7f0 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31540019b0 con 0x7f316006c7f0 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f315dffb640 4 set_mon_vals no callback set 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3154005280 con 0x7f316006c7f0 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: dump: 2024-04-26T00:01:18.563 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.564 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f31400065d0 con 0x7f3140002870 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 858442091 0 0) 0x7f31400065d0 con 0x7f3140002870 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient(hunting): my global_id is 145201 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f316006d560 con 0x7f3140002870 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 76923678 0 0) 0x7f316006d560 con 0x7f3140002870 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31400065d0 con 0x7f3140002870 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3158003ce0 con 0x7f3140002870 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 10 monclient: dump: 2024-04-26T00:01:18.565 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.566 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3154010020 con 0x7f316006c7f0 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.563+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7f3154046270 con 0x7f316006c7f0 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3058340633 0 0) 0x7f31400065d0 con 0x7f3140002870 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f314000a160 con 0x7f3140002870 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f315ffff640 10 monclient: get_auth_request con 0x7f314c037ef0 auth_method 0 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3158004200 con 0x7f3140002870 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f3147fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f3147fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.106:6791/0 conn(0x7f3140002870 legacy=0x7f3140004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.567+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.106:6791/0 conn(0x7f3140002870 legacy=0x7f3140004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3140009e60 con 0x7f3140009120 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2464500637 0 0) 0x7f3140009e60 con 0x7f3140009120 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient(hunting): my global_id is 145210 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31400065d0 con 0x7f3140009120 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2862469999 0 0) 0x7f31400065d0 con 0x7f3140009120 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3140009e60 con 0x7f3140009120 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f31580049e0 con 0x7f3140009120 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:18.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient: dump: 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.570 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4252283648 0 0) 0x7f3140009e60 con 0x7f3140009120 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f314000c3e0 con 0x7f3140009120 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 4069828420) 0x7f3158004c60 con 0x7f3140009120 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.106:6791/0 conn(0x7f3140009120 legacy=0x7f31400095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f3147fff640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.106:6791/0 conn(0x7f3140009120 legacy=0x7f31400095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.571 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 142102, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:18.572 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.573 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.574 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:18.575 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.576 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.578 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:18.579 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.581 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.582 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.583 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:18.584 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.586 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.587 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.588 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.589 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.590 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.590 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:18.590 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:18.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.171:6812/722422047 conn(0x7f314c037ef0 legacy=0x7f314c03a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 10 monclient: shutdown 2024-04-26T00:01:18.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 >> v1:172.21.15.171:6789/0 conn(0x7f316006c7f0 legacy=0x7f316013ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f315ffff640 1 -- 172.21.15.106:0/2301807546 reap_dead start 2024-04-26T00:01:18.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f315ffff640 1 -- 172.21.15.106:0/2301807546 reap_dead start 2024-04-26T00:01:18.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 shutdown_connections 2024-04-26T00:01:18.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 >> 172.21.15.106:0/2301807546 conn(0x7f316006b210 msgr2=0x7f316013d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 shutdown_connections 2024-04-26T00:01:18.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.571+0000 7f31661e2640 1 -- 172.21.15.106:0/2301807546 wait complete. 2024-04-26T00:01:18.592 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:18.592 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-04-26T00:01:18.592 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:01:18.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient: get_monmap_and_config 2024-04-26T00:01:18.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient: monmap: 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:18.732719+0000 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:18.732719+0000 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.710 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.711 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.711 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.711 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 1 Processor -- start 2024-04-26T00:01:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 1 -- start start 2024-04-26T00:01:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient: init 2024-04-26T00:01:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient: _add_conns ranks=[2,1,0,7,3,5,8,6,4] 2024-04-26T00:01:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient(hunting): picked mon.noname-b con 0x7f32d8135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient(hunting): picked mon.noname-f con 0x7f32d81353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient(hunting): picked mon.noname-a con 0x7f32d813bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d806f2d0 con 0x7f32d813bdf0 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d8072330 con 0x7f32d81353b0 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d8072610 con 0x7f32d8135870 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.727+0000 7f32dfd06640 10 monclient(hunting): authenticate will time out at 1334.259864s 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ddaa2640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f32d8135870 0x7f32d8135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42298/0 (socket says 172.21.15.106:42298) 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ddaa2640 1 -- 172.21.15.106:0/3733909505 learned_addr learned my addr 172.21.15.106:0/3733909505 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32de2a3640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f32d813bdf0 0x7f32d813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56024/0 (socket says 172.21.15.106:56024) 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1610158861 0 0) 0x7f32d806f2d0 con 0x7f32d813bdf0 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): my global_id is 6795 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32c4003530 con 0x7f32d813bdf0 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 198568260 0 0) 0x7f32d8072610 con 0x7f32d8135870 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): my global_id is 6590 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d806f2d0 con 0x7f32d8135870 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3587743817 0 0) 0x7f32d8072330 con 0x7f32d81353b0 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient(hunting): my global_id is 145072 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d8072610 con 0x7f32d81353b0 2024-04-26T00:01:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2510076165 0 0) 0x7f32d806f2d0 con 0x7f32d8135870 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 >> v1:172.21.15.171:6789/0 conn(0x7f32d81353b0 legacy=0x7f32d813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 >> v1:172.21.15.106:6789/0 conn(0x7f32d813bdf0 legacy=0x7f32d813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 monclient: found mon.noname-b 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d80a3260 con 0x7f32d8135870 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32c8001710 con 0x7f32d8135870 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 5 monclient: authenticate success, global_id 6590 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: dump: 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32c8001960 con 0x7f32d8135870 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 1 -- 172.21.15.106:0/3733909505 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32c8004bf0 con 0x7f32d8135870 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 4 set_mon_vals no callback set 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dcaa0640 10 monclient: dump: 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: shutdown 2024-04-26T00:01:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- 172.21.15.106:0/3733909505 >> v1:172.21.15.106:6790/0 conn(0x7f32d8135870 legacy=0x7f32d8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- 172.21.15.106:0/3733909505 shutdown_connections 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- 172.21.15.106:0/3733909505 >> 172.21.15.106:0/3733909505 conn(0x7f32d80a64e0 msgr2=0x7f32d80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- 172.21.15.106:0/3733909505 shutdown_connections 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- 172.21.15.106:0/3733909505 wait complete. 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: monmap: 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 Processor -- start 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- start start 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: init 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: _add_conns ranks=[3,2,5,1,7,4,8,6,0] 2024-04-26T00:01:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient(hunting): picked mon.noname-g con 0x7f32d81353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient(hunting): picked mon.noname-b con 0x7f32d8135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient(hunting): picked mon.noname-h con 0x7f32d813bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d809f930 con 0x7f32d8135870 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d809f470 con 0x7f32d81353b0 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32d8135100 con 0x7f32d813bdf0 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient(hunting): authenticate will time out at 1334.263132s 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ddaa2640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f32d81353b0 legacy=0x7f32d813a060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dd2a1640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f32d8135870 0x7f32d813a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42306/0 (socket says 172.21.15.106:42306) 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dd2a1640 1 -- 172.21.15.106:0/3143384251 learned_addr learned my addr 172.21.15.106:0/3143384251 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3553529393 0 0) 0x7f32d809f930 con 0x7f32d8135870 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): my global_id is 6599 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32bc003560 con 0x7f32d8135870 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 605411167 0 0) 0x7f32bc003560 con 0x7f32d8135870 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32d809f930 con 0x7f32d8135870 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32d4001ae0 con 0x7f32d8135870 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): dump: 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4256562972 0 0) 0x7f32d8135100 con 0x7f32d813bdf0 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient(hunting): my global_id is 6512 2024-04-26T00:01:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32bc003560 con 0x7f32d813bdf0 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1071774882 0 0) 0x7f32d809f930 con 0x7f32d8135870 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.171:6791/0 conn(0x7f32d813bdf0 legacy=0x7f32d81d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.171:6790/0 conn(0x7f32d81353b0 legacy=0x7f32d813a060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 monclient: found mon.b 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32d813ae80 con 0x7f32d8135870 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32ce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 5 monclient: authenticate success, global_id 6599 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: _renew_subs 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f32d8071150 con 0x7f32d8135870 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: _renew_subs 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.731+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f32d806fb00 con 0x7f32d8135870 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f32d4003950 con 0x7f32d8135870 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32d4003ec0 con 0x7f32d8135870 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32cffff640 4 set_mon_vals no callback set 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: dump: 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32dfd06640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f32c00065d0 con 0x7f32c0002870 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f32d4004060 con 0x7f32d8135870 2024-04-26T00:01:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(197..197 src has 29..197) ==== 10949+0+0 (unknown 1282303247 0 0) 0x7f32d4046290 con 0x7f32d8135870 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3585952403 0 0) 0x7f32c00065d0 con 0x7f32c0002870 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient(hunting): my global_id is 6621 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32d809f930 con 0x7f32c0002870 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32de2a3640 10 monclient: get_auth_request con 0x7f32bc037890 auth_method 0 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3677467089 0 0) 0x7f32d809f930 con 0x7f32c0002870 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32c00065d0 con 0x7f32c0002870 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32c80016a0 con 0x7f32c0002870 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: dump: 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2182179784 0 0) 0x7f32c00065d0 con 0x7f32c0002870 2024-04-26T00:01:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f32c000a160 con 0x7f32c0002870 2024-04-26T00:01:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f32c8001b80 con 0x7f32c0002870 2024-04-26T00:01:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.106:6792/0 conn(0x7f32c0002870 legacy=0x7f32c0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.735+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.106:6792/0 conn(0x7f32c0002870 legacy=0x7f32c0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f32c0009e30 con 0x7f32c00090f0 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 976568678 0 0) 0x7f32c0009e30 con 0x7f32c00090f0 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient(hunting): my global_id is 6630 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32c00065d0 con 0x7f32c00090f0 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 827683039 0 0) 0x7f32c00065d0 con 0x7f32c00090f0 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f32c0009e30 con 0x7f32c00090f0 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f32c8004ba0 con 0x7f32c00090f0 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient: dump: 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.736 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2268389160 0 0) 0x7f32c0009e30 con 0x7f32c00090f0 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f32c000c3a0 con 0x7f32c00090f0 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 2619097912) 0x7f32c8005340 con 0x7f32c00090f0 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.106:6792/0 conn(0x7f32c00090f0 legacy=0x7f32c0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32ce7fc640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.106:6792/0 conn(0x7f32c00090f0 legacy=0x7f32c0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:18.738 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 397283, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:01:18.739 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.740 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.741 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:18.742 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.743 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.744 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.745 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.746 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:18.747 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.748 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.749 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:18.751 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.753 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.754 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.755 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:18.756 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.171:6812/722422047 conn(0x7f32bc037890 legacy=0x7f32bc039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 10 monclient: shutdown 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 >> v1:172.21.15.106:6790/0 conn(0x7f32d8135870 legacy=0x7f32d813a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32de2a3640 1 -- 172.21.15.106:0/3143384251 reap_dead start 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32de2a3640 1 -- 172.21.15.106:0/3143384251 reap_dead start 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 shutdown_connections 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 >> 172.21.15.106:0/3143384251 conn(0x7f32d80a64e0 msgr2=0x7f32d80a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 shutdown_connections 2024-04-26T00:01:18.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.743+0000 7f32dfd06640 1 -- 172.21.15.106:0/3143384251 wait complete. 2024-04-26T00:01:18.759 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:18.759 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-04-26T00:01:18.759 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:01:18.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.846+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}]=0 added bucket h18 type host to location {rack=r1} v198) ==== 168+0+0 (unknown 3951412982 0 0) 0x7fb284015230 con 0x7fb290135a00 2024-04-26T00:01:18.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.846+0000 7fb27effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:18.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.846+0000 7fb27effd640 10 monclient: _finish_command 2 = system:0 added bucket h18 type host to location {rack=r1} 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.891+0000 7fc3f116a640 10 monclient: get_monmap_and_config 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.891+0000 7fc3f116a640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.891+0000 7fc3f116a640 10 monclient: monmap: 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:18.897676+0000 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:18.897676+0000 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.875 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.891+0000 7fc3f116a640 1 Processor -- start 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- start start 2024-04-26T00:01:18.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: init 2024-04-26T00:01:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: _add_conns ranks=[0,7,6,1,8,3,2,5,4] 2024-04-26T00:01:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): picked mon.noname-a con 0x7fc3ec135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:18.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): picked mon.noname-i con 0x7fc3ec1353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): picked mon.noname-d con 0x7fc3ec13bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec06f2d0 con 0x7fc3ec135870 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec072330 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec072610 con 0x7fc3ec1353b0 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): authenticate will time out at 1334.424607s 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3ead9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc3ec135870 0x7fc3ec135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:56038/0 (socket says 172.21.15.106:56038) 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3eb59e640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc3ec13bdf0 0x7fc3ec13e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35300/0 (socket says 172.21.15.106:35300) 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3ead9d640 1 -- 172.21.15.106:0/3474148822 learned_addr learned my addr 172.21.15.106:0/3474148822 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 798210721 0 0) 0x7fc3ec072330 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): my global_id is 6639 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d4003530 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163427442 0 0) 0x7fc3ec06f2d0 con 0x7fc3ec135870 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient(hunting): my global_id is 6804 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec072330 con 0x7fc3ec135870 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1275398734 0 0) 0x7fc3d4003530 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 >> v1:172.21.15.171:6792/0 conn(0x7fc3ec1353b0 legacy=0x7fc3ec13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 >> v1:172.21.15.106:6789/0 conn(0x7fc3ec135870 legacy=0x7fc3ec135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 monclient: found mon.noname-d 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:01:18.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec0a3260 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e00017c0 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 5 monclient: authenticate success, global_id 6639 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: dump: 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.886 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3e0001a60 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 4 set_mon_vals no callback set 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 1 -- 172.21.15.106:0/3474148822 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e0004b30 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3e9d9b640 10 monclient: dump: 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.888 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: shutdown 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- 172.21.15.106:0/3474148822 >> v1:172.21.15.106:6792/0 conn(0x7fc3ec13bdf0 legacy=0x7fc3ec13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- 172.21.15.106:0/3474148822 shutdown_connections 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- 172.21.15.106:0/3474148822 >> 172.21.15.106:0/3474148822 conn(0x7fc3ec0a64e0 msgr2=0x7fc3ec0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- 172.21.15.106:0/3474148822 shutdown_connections 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- 172.21.15.106:0/3474148822 wait complete. 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: build_initial_monmap 2024-04-26T00:01:18.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: monmap: 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:18.890 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 Processor -- start 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- start start 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: init 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient: _add_conns ranks=[2,1,7,8,3,0,5,6,4] 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): picked mon.noname-b con 0x7fc3ec1353b0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): picked mon.noname-f con 0x7fc3ec135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): picked mon.noname-i con 0x7fc3ec13bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec133650 con 0x7fc3ec135870 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec09f930 con 0x7fc3ec1353b0 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3ec09f470 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:18.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3f116a640 10 monclient(hunting): authenticate will time out at 1334.427733s 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3ead9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc3ec1353b0 0x7fc3ec13b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42320/0 (socket says 172.21.15.106:42320) 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.895+0000 7fc3ead9d640 1 -- 172.21.15.106:0/3999635001 learned_addr learned my addr 172.21.15.106:0/3999635001 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566449396 0 0) 0x7fc3ec09f930 con 0x7fc3ec1353b0 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): my global_id is 6608 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d8003530 con 0x7fc3ec1353b0 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3894657642 0 0) 0x7fc3d8003530 con 0x7fc3ec1353b0 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3ec09f930 con 0x7fc3ec1353b0 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e40015e0 con 0x7fc3ec1353b0 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): dump: 2024-04-26T00:01:18.892 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.893 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1062742899 0 0) 0x7fc3ec09f470 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): my global_id is 145006 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3d8003530 con 0x7fc3ec13bdf0 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2026444901 0 0) 0x7fc3ec133650 con 0x7fc3ec135870 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): my global_id is 145081 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec09f470 con 0x7fc3ec135870 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2356252317 0 0) 0x7fc3ec09f930 con 0x7fc3ec1353b0 2024-04-26T00:01:18.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.171:6792/0 conn(0x7fc3ec13bdf0 legacy=0x7fc3ec1d29e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.171:6789/0 conn(0x7fc3ec135870 legacy=0x7fc3ec1cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 monclient: found mon.b 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3ec134ee0 con 0x7fc3ec1353b0 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 5 monclient: authenticate success, global_id 6608 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 10 monclient: _renew_subs 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3ec133a60 con 0x7fc3ec1353b0 2024-04-26T00:01:18.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 10 monclient: _renew_subs 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3ec1c7450 con 0x7fc3ec1353b0 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3e4004aa0 con 0x7fc3ec1353b0 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3e4004f90 con 0x7fc3ec1353b0 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3e959a640 4 set_mon_vals no callback set 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: dump: 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.896 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3cc0065d0 con 0x7fc3cc002870 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc3e400fd30 con 0x7fc3ec1353b0 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(198..198 src has 29..198) ==== 11162+0+0 (unknown 2107524863 0 0) 0x7fc3e4046330 con 0x7fc3ec1353b0 2024-04-26T00:01:18.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699393191 0 0) 0x7fc3cc0065d0 con 0x7fc3cc002870 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient(hunting): my global_id is 204299 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3ec09f930 con 0x7fc3cc002870 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3eb59e640 10 monclient: get_auth_request con 0x7fc3d8037a70 auth_method 0 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3699049376 0 0) 0x7fc3ec09f930 con 0x7fc3cc002870 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3cc0065d0 con 0x7fc3cc002870 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3dc001cf0 con 0x7fc3cc002870 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: dump: 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.898 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 77423928 0 0) 0x7fc3cc0065d0 con 0x7fc3cc002870 2024-04-26T00:01:18.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3cc00a160 con 0x7fc3cc002870 2024-04-26T00:01:18.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc3dc0049b0 con 0x7fc3cc002870 2024-04-26T00:01:18.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:18.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:18.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.106:6793/0 conn(0x7fc3cc002870 legacy=0x7fc3cc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.899+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.106:6793/0 conn(0x7fc3cc002870 legacy=0x7fc3cc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:18.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3cc009e30 con 0x7fc3cc0090f0 2024-04-26T00:01:18.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938855478 0 0) 0x7fc3cc009e30 con 0x7fc3cc0090f0 2024-04-26T00:01:18.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient(hunting): my global_id is 204308 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3cc0065d0 con 0x7fc3cc0090f0 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2203617376 0 0) 0x7fc3cc0065d0 con 0x7fc3cc0090f0 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3cc009e30 con 0x7fc3cc0090f0 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3dc003f30 con 0x7fc3cc0090f0 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient: dump: 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.902 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1055123585 0 0) 0x7fc3cc009e30 con 0x7fc3cc0090f0 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3cc00c3a0 con 0x7fc3cc0090f0 2024-04-26T00:01:18.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7553 (unknown 0 0 1142850521) 0x7fc3dc004b60 con 0x7fc3cc0090f0 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.106:6793/0 conn(0x7fc3cc0090f0 legacy=0x7fc3cc009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3d37fe640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.106:6793/0 conn(0x7fc3cc0090f0 legacy=0x7fc3cc009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 25647, 2024-04-26T00:01:18.904 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.905 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:18.906 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:18.907 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:18.908 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:18.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:18.910 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:18.912 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.914 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.915 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:18.917 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.919 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:18.920 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:18.921 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:18.922 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:18.922 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:18.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.171:6812/722422047 conn(0x7fc3d8037a70 legacy=0x7fc3d8039f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 10 monclient: shutdown 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 >> v1:172.21.15.106:6790/0 conn(0x7fc3ec1353b0 legacy=0x7fc3ec13b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3eb59e640 1 -- 172.21.15.106:0/3999635001 reap_dead start 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3eb59e640 1 -- 172.21.15.106:0/3999635001 reap_dead start 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 shutdown_connections 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 >> 172.21.15.106:0/3999635001 conn(0x7fc3ec0a64e0 msgr2=0x7fc3ec0a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 shutdown_connections 2024-04-26T00:01:18.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:18.907+0000 7fc3f116a640 1 -- 172.21.15.106:0/3999635001 wait complete. 2024-04-26T00:01:18.924 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:18.924 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-04-26T00:01:18.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:01:18.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:18.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:18.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:18.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fb274005be0 con 0x7fb290135a00 2024-04-26T00:01:18.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb27effd640 1 -- 172.21.15.171:0/881472706 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h18' already exists v198) ==== 147+0+0 (unknown 1155661514 0 0) 0x7fb284004400 con 0x7fb290135a00 2024-04-26T00:01:18.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb27effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h18", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:18.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb27effd640 10 monclient: _finish_command 3 = system:0 bucket 'h18' already exists 2024-04-26T00:01:18.934 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h18' already exists 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 >> v1:172.21.15.171:6812/722422047 conn(0x7fb270037a40 legacy=0x7fb270039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 10 monclient: shutdown 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.950+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 >> v1:172.21.15.171:6791/0 conn(0x7fb290135a00 legacy=0x7fb290131a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.954+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 shutdown_connections 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.954+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 >> 172.21.15.171:0/881472706 conn(0x7fb2900a2690 msgr2=0x7fb2900a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.954+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 shutdown_connections 2024-04-26T00:01:18.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:18.954+0000 7fb294be8640 1 -- 172.21.15.171:0/881472706 wait complete. 2024-04-26T00:01:18.951 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:18.951 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h19 host rack=r1 2024-04-26T00:01:19.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient: get_monmap_and_config 2024-04-26T00:01:19.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient: monmap: 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:19.063612+0000 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:19.063612+0000 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.041 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.042 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.042 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 1 Processor -- start 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 1 -- start start 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient: init 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient: _add_conns ranks=[6,1,3,7,5,8,2,4,0] 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient(hunting): picked mon.noname-d con 0x7f5eec06e3e0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient(hunting): picked mon.noname-f con 0x7f5eec072ba0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient(hunting): picked mon.noname-g con 0x7f5eec071bf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec070950 con 0x7f5eec072ba0 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec070c30 con 0x7f5eec071bf0 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec070f10 con 0x7f5eec06e3e0 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient(hunting): authenticate will time out at 1334.590866s 2024-04-26T00:01:19.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef17fd640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f5eec071bf0 legacy=0x7f5eec13c920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef0ffc640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5eec06e3e0 0x7f5eec06e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35314/0 (socket says 172.21.15.106:35314) 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef0ffc640 1 -- 172.21.15.106:0/316908570 learned_addr learned my addr 172.21.15.106:0/316908570 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941198530 0 0) 0x7f5eec070f10 con 0x7f5eec06e3e0 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient(hunting): my global_id is 6648 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed4004640 con 0x7f5eec06e3e0 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3497623472 0 0) 0x7f5ed4004640 con 0x7f5eec06e3e0 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 >> v1:172.21.15.171:6790/0 conn(0x7f5eec071bf0 legacy=0x7f5eec13c920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 >> v1:172.21.15.171:6789/0 conn(0x7f5eec072ba0 legacy=0x7f5eec1391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 monclient: found mon.noname-d 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec06f5f0 con 0x7f5eec06e3e0 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 5 monclient: authenticate success, global_id 6648 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5edc0017c0 con 0x7f5eec06e3e0 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: dump: 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.054 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:19.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5edc001b20 con 0x7f5eec06e3e0 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 1 -- 172.21.15.106:0/316908570 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5edc001d50 con 0x7f5eec06e3e0 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5ef3260640 4 set_mon_vals no callback set 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.059+0000 7f5eeb7fe640 10 monclient: dump: 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.056 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: shutdown 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/316908570 >> v1:172.21.15.106:6792/0 conn(0x7f5eec06e3e0 legacy=0x7f5eec06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/316908570 shutdown_connections 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/316908570 >> 172.21.15.106:0/316908570 conn(0x7f5eec0a64e0 msgr2=0x7f5eec0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/316908570 shutdown_connections 2024-04-26T00:01:19.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/316908570 wait complete. 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: monmap: 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.058 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 Processor -- start 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- start start 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: init 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: _add_conns ranks=[2,3,0,7,1,8,6,5,4] 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient(hunting): picked mon.noname-b con 0x7f5eec06e3e0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient(hunting): picked mon.noname-g con 0x7f5eec071bf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:19.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient(hunting): picked mon.noname-a con 0x7f5eec1c7cd0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec09e530 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec1a2a80 con 0x7f5eec06e3e0 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5eec1a21e0 con 0x7f5eec071bf0 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient(hunting): authenticate will time out at 1334.593750s 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef0ffc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f5eec06e3e0 0x7f5eec1b50c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42334/0 (socket says 172.21.15.106:42334) 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef0ffc640 1 -- 172.21.15.106:0/1916413816 learned_addr learned my addr 172.21.15.106:0/1916413816 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5eebfff640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.171:6790/0 conn(0x7f5eec071bf0 legacy=0x7f5eec1cd030 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274466845 0 0) 0x7f5eec1a2a80 con 0x7f5eec06e3e0 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): my global_id is 6617 2024-04-26T00:01:19.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ed8003530 con 0x7f5eec06e3e0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349668534 0 0) 0x7f5eec09e530 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): my global_id is 6813 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eec1a2a80 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 941073246 0 0) 0x7f5eec1a2a80 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5eec09e530 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1289119579 0 0) 0x7f5ed8003530 con 0x7f5eec06e3e0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5eec1a2a80 con 0x7f5eec06e3e0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ee4004560 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:01:19.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): dump: 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.062 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5edc001780 con 0x7f5eec06e3e0 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient(hunting): dump: 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.063 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2409886116 0 0) 0x7f5eec09e530 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.171:6790/0 conn(0x7f5eec071bf0 legacy=0x7f5eec1cd030 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.106:6790/0 conn(0x7f5eec06e3e0 legacy=0x7f5eec1b50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 monclient: found mon.a 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec1b57d0 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 5 monclient: authenticate success, global_id 6813 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: _renew_subs 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec1c8b80 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: _renew_subs 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5eec1b5a30 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5ee4004790 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5ee4004d00 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5eeaffd640 4 set_mon_vals no callback set 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 10 monclient: dump: 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.066 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ecc0065d0 con 0x7f5ecc002870 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5ee4004f20 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.063+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(198..198 src has 29..198) ==== 11162+0+0 (unknown 2107524863 0 0) 0x7f5ee4046540 con 0x7f5eec1c7cd0 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5eebfff640 10 monclient: get_auth_request con 0x7f5ed8037d30 auth_method 0 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4125580302 0 0) 0x7f5ecc0065d0 con 0x7f5ecc002870 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient(hunting): my global_id is 145099 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5eec09e530 con 0x7f5ecc002870 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 891719836 0 0) 0x7f5eec09e530 con 0x7f5ecc002870 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ecc0065d0 con 0x7f5ecc002870 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5edc005350 con 0x7f5ecc002870 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient: dump: 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.068 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4205214948 0 0) 0x7f5ecc0065d0 con 0x7f5ecc002870 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ecc00a160 con 0x7f5ecc002870 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5edc005510 con 0x7f5ecc002870 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:19.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.171:6789/0 conn(0x7f5ecc002870 legacy=0x7f5ecc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.067+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.171:6789/0 conn(0x7f5ecc002870 legacy=0x7f5ecc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:19.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.071+0000 7f5ef3260640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:19.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.071+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ecc009e30 con 0x7f5ecc0090f0 2024-04-26T00:01:19.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2572657362 0 0) 0x7f5ecc009e30 con 0x7f5ecc0090f0 2024-04-26T00:01:19.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient(hunting): my global_id is 145108 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ecc0065d0 con 0x7f5ecc0090f0 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1204788603 0 0) 0x7f5ecc0065d0 con 0x7f5ecc0090f0 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ecc009e30 con 0x7f5ecc0090f0 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5edc005c70 con 0x7f5ecc0090f0 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient: dump: 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.072 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 76338421 0 0) 0x7f5ecc009e30 con 0x7f5ecc0090f0 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ecc00c3a0 con 0x7f5ecc0090f0 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 1374104888) 0x7f5edc005f10 con 0x7f5ecc0090f0 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:19.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.171:6789/0 conn(0x7f5ecc0090f0 legacy=0x7f5ecc009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ee97fa640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.171:6789/0 conn(0x7f5ecc0090f0 legacy=0x7f5ecc009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 142606, 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:19.074 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.075 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.076 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:19.077 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.078 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:19.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:19.080 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.081 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.083 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.084 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:19.086 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:19.089 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.091 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:19.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.093 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.093 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:19.093 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.171:6812/722422047 conn(0x7f5ed8037d30 legacy=0x7f5ed803a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 10 monclient: shutdown 2024-04-26T00:01:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 >> v1:172.21.15.106:6789/0 conn(0x7f5eec1c7cd0 legacy=0x7f5eec1d0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef17fd640 1 -- 172.21.15.106:0/1916413816 reap_dead start 2024-04-26T00:01:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef17fd640 1 -- 172.21.15.106:0/1916413816 reap_dead start 2024-04-26T00:01:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 shutdown_connections 2024-04-26T00:01:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 >> 172.21.15.106:0/1916413816 conn(0x7f5eec0a64e0 msgr2=0x7f5eec0a4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 shutdown_connections 2024-04-26T00:01:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.075+0000 7f5ef3260640 1 -- 172.21.15.106:0/1916413816 wait complete. 2024-04-26T00:01:19.095 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:19.095 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-04-26T00:01:19.095 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.086+0000 7f2e0e146640 10 monclient: get_monmap_and_config 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.086+0000 7f2e0e146640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.086+0000 7f2e0e146640 10 monclient: monmap: 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:19.094326+0000 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:19.094326+0000 2024-04-26T00:01:19.103 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 Processor -- start 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- start start 2024-04-26T00:01:19.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: init 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: _add_conns ranks=[7,1,3,0,2,5,6,4,8] 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient(hunting): picked mon.noname-i con 0x7f2e08137960 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient(hunting): picked mon.noname-f con 0x7f2e080a4220 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient(hunting): picked mon.noname-g con 0x7f2e08138450 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080a48c0 con 0x7f2e080a4220 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080a2f70 con 0x7f2e08138450 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080a0d00 con 0x7f2e08137960 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient(hunting): authenticate will time out at 1329.801241s 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e07fff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f2e08138450 legacy=0x7f2e081405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e06ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2e080a4220 0x7f2e0813ce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:51644/0 (socket says 172.21.15.171:51644) 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e06ffd640 1 -- 172.21.15.171:0/1111601696 learned_addr learned my addr 172.21.15.171:0/1111601696 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:19.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e077fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f2e08137960 0x7f2e08137d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:35054/0 (socket says 172.21.15.171:35054) 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2251625124 0 0) 0x7f2e080a0d00 con 0x7f2e08137960 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): my global_id is 145015 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df0003530 con 0x7f2e08137960 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3934274549 0 0) 0x7f2e080a48c0 con 0x7f2e080a4220 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient(hunting): my global_id is 145117 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e080a0d00 con 0x7f2e080a4220 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2412675973 0 0) 0x7f2df0003530 con 0x7f2e08137960 2024-04-26T00:01:19.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 >> v1:172.21.15.171:6790/0 conn(0x7f2e08138450 legacy=0x7f2e081405c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 >> v1:172.21.15.171:6789/0 conn(0x7f2e080a4220 legacy=0x7f2e0813ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 monclient: found mon.noname-i 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e080a29b0 con 0x7f2e08137960 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df80017c0 con 0x7f2e08137960 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: dump: 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:19.107 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 5 monclient: authenticate success, global_id 145015 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2df8001a70 con 0x7f2e08137960 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 1 -- 172.21.15.171:0/1111601696 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df8004b30 con 0x7f2e08137960 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 4 set_mon_vals no callback set 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e067fc640 10 monclient: dump: 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.109 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.110 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: shutdown 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- 172.21.15.171:0/1111601696 >> v1:172.21.15.171:6792/0 conn(0x7f2e08137960 legacy=0x7f2e08137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- 172.21.15.171:0/1111601696 shutdown_connections 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- 172.21.15.171:0/1111601696 >> 172.21.15.171:0/1111601696 conn(0x7f2e080a9fc0 msgr2=0x7f2e080aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- 172.21.15.171:0/1111601696 shutdown_connections 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- 172.21.15.171:0/1111601696 wait complete. 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: monmap: 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:19.111 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 Processor -- start 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 1 -- start start 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.090+0000 7f2e0e146640 10 monclient: init 2024-04-26T00:01:19.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _add_conns ranks=[6,2,0,5,7,3,1,8,4] 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient(hunting): picked mon.noname-d con 0x7f2e080a4220 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient(hunting): picked mon.noname-b con 0x7f2e08137960 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient(hunting): picked mon.noname-a con 0x7f2e08138450 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080a1f50 con 0x7f2e08138450 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e08124440 con 0x7f2e08137960 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e080a0fa0 con 0x7f2e080a4220 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient(hunting): authenticate will time out at 1329.804451s 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e077fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f2e080a4220 0x7f2e08136a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:40154/0 (socket says 172.21.15.171:40154) 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e077fe640 1 -- 172.21.15.171:0/172122682 learned_addr learned my addr 172.21.15.171:0/172122682 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e06ffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f2e08137960 0x7f2e081d13b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:34544/0 (socket says 172.21.15.171:34544) 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e07fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2e08138450 0x7f2e081d4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:52502/0 (socket says 172.21.15.171:52502) 2024-04-26T00:01:19.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1461670904 0 0) 0x7f2e080a0fa0 con 0x7f2e080a4220 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): my global_id is 6657 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2df4003530 con 0x7f2e080a4220 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3312895186 0 0) 0x7f2e08124440 con 0x7f2e08137960 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): my global_id is 6626 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e080a0fa0 con 0x7f2e08137960 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846472371 0 0) 0x7f2e00003d40 con 0x7f2e08138450 2024-04-26T00:01:19.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): my global_id is 6822 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e08124440 con 0x7f2e08138450 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1591001576 0 0) 0x7f2df4003530 con 0x7f2e080a4220 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e00003d40 con 0x7f2e080a4220 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1082148479 0 0) 0x7f2e08124440 con 0x7f2e08138450 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2df4003530 con 0x7f2e08138450 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df8001780 con 0x7f2e080a4220 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): dump: 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:19.115 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.116 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 849996298 0 0) 0x7f2e080a0fa0 con 0x7f2e08137960 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e08124440 con 0x7f2e08137960 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2e00004630 con 0x7f2e08138450 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): dump: 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.117 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2dfc0019e0 con 0x7f2e08137960 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient(hunting): dump: 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:19.118 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3573746795 0 0) 0x7f2e00003d40 con 0x7f2e080a4220 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 >> v1:172.21.15.106:6790/0 conn(0x7f2e08137960 legacy=0x7f2e081d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 >> v1:172.21.15.106:6789/0 conn(0x7f2e08138450 legacy=0x7f2e081d4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 monclient: found mon.d 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e08124160 con 0x7f2e080a4220 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 5 monclient: authenticate success, global_id 6657 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _renew_subs 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e08137190 con 0x7f2e080a4220 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _renew_subs 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e081cc2c0 con 0x7f2e080a4220 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2df80011c0 con 0x7f2e080a4220 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df8001a70 con 0x7f2e080a4220 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e05ffb640 4 set_mon_vals no callback set 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 10 monclient: dump: 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.121 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2df8010030 con 0x7f2e080a4220 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de8005090 con 0x7f2e080a4220 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(198..198 src has 29..198) ==== 11162+0+0 (unknown 2107524863 0 0) 0x7f2df8046440 con 0x7f2e080a4220 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.094+0000 7f2e06ffd640 10 monclient: get_auth_request con 0x7f2df40380c0 auth_method 0 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.098+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2df80159d0 con 0x7f2e080a4220 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.098+0000 7f2deffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.098+0000 7f2deffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.255+0000 7f4c6ae3e640 10 monclient: get_monmap_and_config 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.255+0000 7f4c6ae3e640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.255+0000 7f4c6ae3e640 10 monclient: monmap: 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:19.262189+0000 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:19.262189+0000 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.239 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.240 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.240 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.240 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.240 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.240 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.240 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.240 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 Processor -- start 2024-04-26T00:01:19.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- start start 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient: init 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient: _add_conns ranks=[8,1,6,3,4,7,2,0,5] 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient(hunting): picked mon.noname-e con 0x7f4c64134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient(hunting): picked mon.noname-f con 0x7f4c640a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient(hunting): picked mon.noname-d con 0x7f4c6413e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c6406dd40 con 0x7f4c640a4820 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c640a2b10 con 0x7f4c6413e200 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c640a2df0 con 0x7f4c64134970 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient(hunting): authenticate will time out at 1334.789566s 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c693db640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4c6413e200 0x7f4c641405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35324/0 (socket says 172.21.15.106:35324) 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c693db640 1 -- 172.21.15.106:0/952100907 learned_addr learned my addr 172.21.15.106:0/952100907 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:19.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c68bda640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f4c64134970 0x7f4c64134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:37458/0 (socket says 172.21.15.106:37458) 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 443849676 0 0) 0x7f4c640a2b10 con 0x7f4c6413e200 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): my global_id is 6666 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c50003530 con 0x7f4c6413e200 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 871257597 0 0) 0x7f4c640a2df0 con 0x7f4c64134970 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient(hunting): my global_id is 204317 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c640a2b10 con 0x7f4c64134970 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1651245711 0 0) 0x7f4c50003530 con 0x7f4c6413e200 2024-04-26T00:01:19.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 >> v1:172.21.15.106:6793/0 conn(0x7f4c64134970 legacy=0x7f4c64134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 >> v1:172.21.15.171:6789/0 conn(0x7f4c640a4820 legacy=0x7f4c6413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 monclient: found mon.noname-d 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c640a30d0 con 0x7f4c6413e200 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 5 monclient: authenticate success, global_id 6666 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c5c0017c0 con 0x7f4c6413e200 2024-04-26T00:01:19.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: dump: 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c5c0019b0 con 0x7f4c6413e200 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 1 -- 172.21.15.106:0/952100907 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c5c001c20 con 0x7f4c6413e200 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 4 set_mon_vals no callback set 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c637fe640 10 monclient: dump: 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient: shutdown 2024-04-26T00:01:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/952100907 >> v1:172.21.15.106:6792/0 conn(0x7f4c6413e200 legacy=0x7f4c641405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/952100907 shutdown_connections 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/952100907 >> 172.21.15.106:0/952100907 conn(0x7f4c640a9e20 msgr2=0x7f4c640aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/952100907 shutdown_connections 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/952100907 wait complete. 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 10 monclient: monmap: 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.254 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.259+0000 7f4c6ae3e640 1 Processor -- start 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 1 -- start start 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient: init 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient: _add_conns ranks=[5,6,7,2,1,4,3,8,0] 2024-04-26T00:01:19.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient(hunting): picked mon.noname-h con 0x7f4c640a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient(hunting): picked mon.noname-d con 0x7f4c64134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient(hunting): picked mon.noname-i con 0x7f4c6413e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c641396d0 con 0x7f4c640a4820 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c640a1e00 con 0x7f4c64134970 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c640a1a40 con 0x7f4c6413e200 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient(hunting): authenticate will time out at 1334.792553s 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c63fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4c64134970 0x7f4c64138fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35330/0 (socket says 172.21.15.106:35330) 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c63fff640 1 -- 172.21.15.106:0/85609747 learned_addr learned my addr 172.21.15.106:0/85609747 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 368264663 0 0) 0x7f4c640a1e00 con 0x7f4c64134970 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): my global_id is 6675 2024-04-26T00:01:19.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c44003530 con 0x7f4c64134970 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2245225521 0 0) 0x7f4c44003530 con 0x7f4c64134970 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c640a1e00 con 0x7f4c64134970 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c4c001ae0 con 0x7f4c64134970 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): dump: 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.257 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353700004 0 0) 0x7f4c640a1a40 con 0x7f4c6413e200 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): my global_id is 145024 2024-04-26T00:01:19.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c44003530 con 0x7f4c6413e200 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3841907946 0 0) 0x7f4c641396d0 con 0x7f4c640a4820 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): my global_id is 6521 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c640a1a40 con 0x7f4c640a4820 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 929737554 0 0) 0x7f4c640a1e00 con 0x7f4c64134970 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.171:6792/0 conn(0x7f4c6413e200 legacy=0x7f4c641d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.171:6791/0 conn(0x7f4c640a4820 legacy=0x7f4c641388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 monclient: found mon.d 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c6413afb0 con 0x7f4c64134970 2024-04-26T00:01:19.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 5 monclient: authenticate success, global_id 6675 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient: _renew_subs 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c64138320 con 0x7f4c64134970 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient: _renew_subs 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c641372b0 con 0x7f4c64134970 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c4c003950 con 0x7f4c64134970 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c4c003ec0 con 0x7f4c64134970 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c62ffd640 4 set_mon_vals no callback set 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: dump: 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.261 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4c4c0040e0 con 0x7f4c64134970 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4c480065d0 con 0x7f4c48002870 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(198..198 src has 29..198) ==== 11162+0+0 (unknown 2107524863 0 0) 0x7f4c4c046400 con 0x7f4c64134970 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c693db640 10 monclient: get_auth_request con 0x7f4c440379f0 auth_method 0 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1841168710 0 0) 0x7f4c480065d0 con 0x7f4c48002870 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient(hunting): my global_id is 6530 2024-04-26T00:01:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c640a1e00 con 0x7f4c48002870 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1996225774 0 0) 0x7f4c640a1e00 con 0x7f4c48002870 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c480065d0 con 0x7f4c48002870 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c54001780 con 0x7f4c48002870 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.263+0000 7f4c617fa640 10 monclient: dump: 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.267+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2472418066 0 0) 0x7f4c480065d0 con 0x7f4c48002870 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.267+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c4800a160 con 0x7f4c48002870 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.267+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4c54001b10 con 0x7f4c48002870 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.267+0000 7f4c617fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.267+0000 7f4c617fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.267+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.171:6791/0 conn(0x7f4c48002870 legacy=0x7f4c48004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.267+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.171:6791/0 conn(0x7f4c48002870 legacy=0x7f4c48004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:19.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.266+0000 7f2e0e146640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.266+0000 7f2e0e146640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.266+0000 7f2e0e146640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.266+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f2de8005380 con 0x7f2e080a4220 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c6ae3e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4c48009e50 con 0x7f4c48009110 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944664017 0 0) 0x7f4c48009e50 con 0x7f4c48009110 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c617fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c617fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c617fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c617fa640 10 monclient(hunting): my global_id is 6539 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.271+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c480065d0 con 0x7f4c48009110 2024-04-26T00:01:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1505657315 0 0) 0x7f4c480065d0 con 0x7f4c48009110 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c48009e50 con 0x7f4c48009110 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c540050a0 con 0x7f4c48009110 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 10 monclient: dump: 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2260103419 0 0) 0x7f4c48009e50 con 0x7f4c48009110 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4c4800c3e0 con 0x7f4c48009110 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 2287486470) 0x7f4c54007380 con 0x7f4c48009110 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.171:6791/0 conn(0x7f4c48009110 legacy=0x7f4c480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c617fa640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.171:6791/0 conn(0x7f4c48009110 legacy=0x7f4c480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 397772, 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:19.270 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:19.271 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:19.272 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:19.274 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.275 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:19.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.278 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:19.281 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.282 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:19.283 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:01:19.288 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:19.289 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.171:6812/722422047 conn(0x7f4c440379f0 legacy=0x7f4c44039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 10 monclient: shutdown 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 >> v1:172.21.15.106:6792/0 conn(0x7f4c64134970 legacy=0x7f4c64138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c693db640 1 -- 172.21.15.106:0/85609747 reap_dead start 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c693db640 1 -- 172.21.15.106:0/85609747 reap_dead start 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 shutdown_connections 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 >> 172.21.15.106:0/85609747 conn(0x7f4c640a9e20 msgr2=0x7f4c64130b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 shutdown_connections 2024-04-26T00:01:19.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.275+0000 7f4c6ae3e640 1 -- 172.21.15.106:0/85609747 wait complete. 2024-04-26T00:01:19.292 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:19.292 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-04-26T00:01:19.292 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:01:19.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: get_monmap_and_config 2024-04-26T00:01:19.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: monmap: 2024-04-26T00:01:19.407 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:01:19.430535+0000 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:01:19.430535+0000 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.408 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.409 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.409 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 Processor -- start 2024-04-26T00:01:19.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- start start 2024-04-26T00:01:19.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: init 2024-04-26T00:01:19.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: _add_conns ranks=[8,7,6,0,4,2,3,5,1] 2024-04-26T00:01:19.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient(hunting): picked mon.noname-e con 0x7fc5bc134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient(hunting): picked mon.noname-i con 0x7fc5bc0a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient(hunting): picked mon.noname-d con 0x7fc5bc13e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5bc06dd40 con 0x7fc5bc13e200 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5bc0a2b10 con 0x7fc5bc0a4820 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5bc0a2df0 con 0x7fc5bc134970 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient(hunting): authenticate will time out at 1334.957626s 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5baffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc5bc134970 0x7fc5bc134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:37470/0 (socket says 172.21.15.106:37470) 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5baffd640 1 -- 172.21.15.106:0/817839271 learned_addr learned my addr 172.21.15.106:0/817839271 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475522977 0 0) 0x7fc5bc0a2df0 con 0x7fc5bc134970 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): my global_id is 204326 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a4003530 con 0x7fc5bc134970 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 345461541 0 0) 0x7fc5bc06dd40 con 0x7fc5bc13e200 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient(hunting): my global_id is 6684 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5bc0a2df0 con 0x7fc5bc13e200 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 57860198 0 0) 0x7fc5a4003530 con 0x7fc5bc134970 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 >> v1:172.21.15.171:6792/0 conn(0x7fc5bc0a4820 legacy=0x7fc5bc13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 >> v1:172.21.15.106:6792/0 conn(0x7fc5bc13e200 legacy=0x7fc5bc1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 monclient: found mon.noname-e 2024-04-26T00:01:19.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5bc0a30d0 con 0x7fc5bc134970 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5ac0017c0 con 0x7fc5bc134970 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 5 monclient: authenticate success, global_id 204326 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: dump: 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.419 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:19.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5ac0019f0 con 0x7fc5bc134970 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 4 set_mon_vals no callback set 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 1 -- 172.21.15.106:0/817839271 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5ac004bf0 con 0x7fc5bc134970 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5b9ffb640 10 monclient: dump: 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.421 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: shutdown 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- 172.21.15.106:0/817839271 >> v1:172.21.15.106:6793/0 conn(0x7fc5bc134970 legacy=0x7fc5bc134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- 172.21.15.106:0/817839271 shutdown_connections 2024-04-26T00:01:19.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- 172.21.15.106:0/817839271 >> 172.21.15.106:0/817839271 conn(0x7fc5bc0a9e20 msgr2=0x7fc5bc0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- 172.21.15.106:0/817839271 shutdown_connections 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 1 -- 172.21.15.106:0/817839271 wait complete. 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: build_initial_monmap 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.427+0000 7fc5c18f4640 10 monclient: monmap: 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:19.423 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 Processor -- start 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 -- start start 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient: init 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient: _add_conns ranks=[6,5,2,0,8,7,4,1,3] 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient(hunting): picked mon.noname-d con 0x7fc5bc0a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient(hunting): picked mon.noname-h con 0x7fc5bc134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:19.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient(hunting): picked mon.noname-b con 0x7fc5bc13e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5bc13ae70 con 0x7fc5bc13e200 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5bc0a1a40 con 0x7fc5bc134970 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5bc13d6e0 con 0x7fc5bc0a4820 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient(hunting): authenticate will time out at 1334.960839s 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5baffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc5bc0a4820 0x7fc5bc12c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35346/0 (socket says 172.21.15.106:35346) 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5baffd640 1 -- 172.21.15.106:0/2388218237 learned_addr learned my addr 172.21.15.106:0/2388218237 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941132186 0 0) 0x7fc5bc13d6e0 con 0x7fc5bc0a4820 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): my global_id is 6693 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5a8003530 con 0x7fc5bc0a4820 2024-04-26T00:01:19.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4113051871 0 0) 0x7fc5bc13ae70 con 0x7fc5bc13e200 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): my global_id is 6635 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5bc13d6e0 con 0x7fc5bc13e200 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 907451584 0 0) 0x7fc5a8003530 con 0x7fc5bc0a4820 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5bc13ae70 con 0x7fc5bc0a4820 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5ac0047f0 con 0x7fc5bc0a4820 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): dump: 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.426 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3335564133 0 0) 0x7fc5bc13d6e0 con 0x7fc5bc13e200 2024-04-26T00:01:19.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5a8003530 con 0x7fc5bc13e200 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5b4001d00 con 0x7fc5bc13e200 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): dump: 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.428 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385308729 0 0) 0x7fc5bc0a1a40 con 0x7fc5bc134970 2024-04-26T00:01:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): my global_id is 6548 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5bc13d6e0 con 0x7fc5bc134970 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3346124500 0 0) 0x7fc5bc13ae70 con 0x7fc5bc0a4820 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.171:6791/0 conn(0x7fc5bc134970 legacy=0x7fc5bc1d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.106:6790/0 conn(0x7fc5bc13e200 legacy=0x7fc5bc1d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 monclient: found mon.d 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5bc138e60 con 0x7fc5bc0a4820 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 5 monclient: authenticate success, global_id 6693 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient: _renew_subs 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5bc1399c0 con 0x7fc5bc0a4820 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient: _renew_subs 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5bc13bc90 con 0x7fc5bc0a4820 2024-04-26T00:01:19.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5ac0019f0 con 0x7fc5bc0a4820 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5ac001180 con 0x7fc5bc0a4820 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5b97fa640 4 set_mon_vals no callback set 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: dump: 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.432 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc59c0065d0 con 0x7fc59c002870 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc5ac00fe40 con 0x7fc5bc0a4820 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(198..198 src has 29..198) ==== 11162+0+0 (unknown 2107524863 0 0) 0x7fc5ac046410 con 0x7fc5bc0a4820 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5bb7fe640 10 monclient: get_auth_request con 0x7fc5a8037f00 auth_method 0 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612022884 0 0) 0x7fc59c0065d0 con 0x7fc59c002870 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient(hunting): my global_id is 145042 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5bc13ae70 con 0x7fc59c002870 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2235915917 0 0) 0x7fc5bc13ae70 con 0x7fc59c002870 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc59c0065d0 con 0x7fc59c002870 2024-04-26T00:01:19.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5b0001930 con 0x7fc59c002870 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 10 monclient: dump: 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.435 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2970590818 0 0) 0x7fc59c0065d0 con 0x7fc59c002870 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.431+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc59c00a160 con 0x7fc59c002870 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.435+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc5b0001cd0 con 0x7fc59c002870 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.435+0000 7fc5a3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.435+0000 7fc5a3fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.435+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.171:6792/0 conn(0x7fc59c002870 legacy=0x7fc59c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.435+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.171:6792/0 conn(0x7fc59c002870 legacy=0x7fc59c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5c18f4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc59c009e10 con 0x7fc59c0090f0 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1814367064 0 0) 0x7fc59c009e10 con 0x7fc59c0090f0 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5a3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5a3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5a3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5a3fff640 10 monclient(hunting): my global_id is 145051 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.439+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc59c0065d0 con 0x7fc59c0090f0 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 261755574 0 0) 0x7fc59c0065d0 con 0x7fc59c0090f0 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc59c009e10 con 0x7fc59c0090f0 2024-04-26T00:01:19.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5b0003b30 con 0x7fc59c0090f0 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 10 monclient: dump: 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:19.439 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 357091330 0 0) 0x7fc59c009e10 con 0x7fc59c0090f0 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc59c00c390 con 0x7fc59c0090f0 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7554 (unknown 0 0 1945327083) 0x7fc5b0003e60 con 0x7fc59c0090f0 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.171:6792/0 conn(0x7fc59c0090f0 legacy=0x7fc59c009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5a3fff640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.171:6792/0 conn(0x7fc59c0090f0 legacy=0x7fc59c009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 46, 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 142970, 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:01:19.441 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.442 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.443 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:01:19.444 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:01:19.445 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.446 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.452 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.454 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.458 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:01:19.459 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:01:19.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:01:19.461 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:01:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.171:6812/722422047 conn(0x7fc5a8037f00 legacy=0x7fc5a803a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 10 monclient: shutdown 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 >> v1:172.21.15.106:6792/0 conn(0x7fc5bc0a4820 legacy=0x7fc5bc12c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5bb7fe640 1 -- 172.21.15.106:0/2388218237 reap_dead start 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5bb7fe640 1 -- 172.21.15.106:0/2388218237 reap_dead start 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 shutdown_connections 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 >> 172.21.15.106:0/2388218237 conn(0x7fc5bc0a9e20 msgr2=0x7fc5bc130b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 shutdown_connections 2024-04-26T00:01:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:01:19.443+0000 7fc5c18f4640 1 -- 172.21.15.106:0/2388218237 wait complete. 2024-04-26T00:01:19.463 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:01:19.463 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-26T00:01:19.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.846+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}]=0 added bucket h19 type host to location {rack=r1} v199) ==== 168+0+0 (unknown 2543272715 0 0) 0x7f2df80152d0 con 0x7f2e080a4220 2024-04-26T00:01:19.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.846+0000 7f2deffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:19.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.846+0000 7f2deffff640 10 monclient: _finish_command 2 = system:0 added bucket h19 type host to location {rack=r1} 2024-04-26T00:01:19.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.946+0000 7f2e0e146640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:19.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.946+0000 7f2e0e146640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:19.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.946+0000 7f2e0e146640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:19.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.946+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f2de8005be0 con 0x7f2e080a4220 2024-04-26T00:01:19.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.946+0000 7f2deffff640 1 -- 172.21.15.171:0/172122682 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h19' already exists v199) ==== 147+0+0 (unknown 1331160871 0 0) 0x7f2df801de20 con 0x7f2e080a4220 2024-04-26T00:01:19.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.946+0000 7f2deffff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h19", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:19.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.946+0000 7f2deffff640 10 monclient: _finish_command 3 = system:0 bucket 'h19' already exists 2024-04-26T00:01:19.930 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h19' already exists 2024-04-26T00:01:19.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 >> v1:172.21.15.171:6812/722422047 conn(0x7f2df40380c0 legacy=0x7f2df403a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 10 monclient: shutdown 2024-04-26T00:01:19.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:19.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 >> v1:172.21.15.106:6792/0 conn(0x7f2e080a4220 legacy=0x7f2e08136a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:19.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 shutdown_connections 2024-04-26T00:01:19.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 >> 172.21.15.171:0/172122682 conn(0x7f2e080a9fc0 msgr2=0x7f2e081bf880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:19.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 shutdown_connections 2024-04-26T00:01:19.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:19.950+0000 7f2e0e146640 1 -- 172.21.15.171:0/172122682 wait complete. 2024-04-26T00:01:19.946 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:19.946 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h20 host rack=r1 2024-04-26T00:01:20.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient: get_monmap_and_config 2024-04-26T00:01:20.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient: build_initial_monmap 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient: monmap: 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:20.087768+0000 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:20.087768+0000 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:20.066 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:20.067 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:20.067 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:20.067 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:20.067 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:20.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 1 Processor -- start 2024-04-26T00:01:20.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 1 -- start start 2024-04-26T00:01:20.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient: init 2024-04-26T00:01:20.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:20.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient: _add_conns ranks=[3,0,8,4,1,7,2,5,6] 2024-04-26T00:01:20.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient(hunting): picked mon.noname-g con 0x7f7e0006f950 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient(hunting): picked mon.noname-a con 0x7f7e001378f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient(hunting): picked mon.noname-e con 0x7f7e0013b400 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e000a1e70 con 0x7f7e001378f0 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e000714e0 con 0x7f7e0006f950 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e000717c0 con 0x7f7e0013b400 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e04e8d640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f7e0006f950 legacy=0x7f7e0006fd30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7e070f1640 10 monclient(hunting): authenticate will time out at 1330.795386s 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7dfffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7e001378f0 0x7f7e00139ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:52508/0 (socket says 172.21.15.171:52508) 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.082+0000 7f7dfffff640 1 -- 172.21.15.171:0/3678408785 learned_addr learned my addr 172.21.15.171:0/3678408785 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436308146 0 0) 0x7f7e000717c0 con 0x7f7e0013b400 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:20.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): my global_id is 204335 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7df0003530 con 0x7f7e0013b400 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1423628630 0 0) 0x7f7e000a1e70 con 0x7f7e001378f0 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient(hunting): my global_id is 6831 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e000717c0 con 0x7f7e001378f0 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2077203935 0 0) 0x7f7df0003530 con 0x7f7e0013b400 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 >> v1:172.21.15.171:6790/0 conn(0x7f7e0006f950 legacy=0x7f7e0006fd30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 >> v1:172.21.15.106:6789/0 conn(0x7f7e001378f0 legacy=0x7f7e00139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:20.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 monclient: found mon.noname-e 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e00071aa0 con 0x7f7e0013b400 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7df8001b40 con 0x7f7e0013b400 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: dump: 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.080 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 5 monclient: authenticate success, global_id 204335 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7df8001da0 con 0x7f7e0013b400 2024-04-26T00:01:20.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 1 -- 172.21.15.171:0/3678408785 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7df8003ce0 con 0x7f7e0013b400 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dff7fe640 10 monclient: dump: 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:20.082 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 4 set_mon_vals no callback set 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient: shutdown 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- 172.21.15.171:0/3678408785 >> v1:172.21.15.106:6793/0 conn(0x7f7e0013b400 legacy=0x7f7e0013d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- 172.21.15.171:0/3678408785 shutdown_connections 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- 172.21.15.171:0/3678408785 >> 172.21.15.171:0/3678408785 conn(0x7f7e000a2690 msgr2=0x7f7e000a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:20.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- 172.21.15.171:0/3678408785 shutdown_connections 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- 172.21.15.171:0/3678408785 wait complete. 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient: build_initial_monmap 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient: monmap: 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:20.084 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 Processor -- start 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- start start 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient: init 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient: _add_conns ranks=[7,8,2,4,6,5,0,3,1] 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient(hunting): picked mon.noname-i con 0x7f7e0006f950 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient(hunting): picked mon.noname-e con 0x7f7e001378f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient(hunting): picked mon.noname-b con 0x7f7e0013b400 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e001338d0 con 0x7f7e0013b400 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e00133be0 con 0x7f7e0006f950 2024-04-26T00:01:20.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e00135990 con 0x7f7e001378f0 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e070f1640 10 monclient(hunting): authenticate will time out at 1330.799176s 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e04e8d640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f7e0006f950 0x7f7e00132ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:35064/0 (socket says 172.21.15.171:35064) 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7e04e8d640 1 -- 172.21.15.171:0/4006621349 learned_addr learned my addr 172.21.15.171:0/4006621349 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2134177911 0 0) 0x7f7e00133be0 con 0x7f7e0006f950 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): my global_id is 145060 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7de4003530 con 0x7f7e0006f950 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4092567636 0 0) 0x7f7de4003530 con 0x7f7e0006f950 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e00133be0 con 0x7f7e0006f950 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7df40040e0 con 0x7f7e0006f950 2024-04-26T00:01:20.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): dump: 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:20.087 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 938025093 0 0) 0x7f7e00135990 con 0x7f7e001378f0 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 10 monclient(hunting): my global_id is 204344 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.086+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7de4003530 con 0x7f7e001378f0 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 69928375 0 0) 0x7f7e001338d0 con 0x7f7e0013b400 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:20.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient(hunting): my global_id is 6644 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e00135990 con 0x7f7e0013b400 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 192110173 0 0) 0x7f7e00133be0 con 0x7f7e0006f950 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 >> v1:172.21.15.106:6793/0 conn(0x7f7e001378f0 legacy=0x7f7e001331c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 >> v1:172.21.15.106:6790/0 conn(0x7f7e0013b400 legacy=0x7f7e001d4810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 monclient: found mon.i 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e00135030 con 0x7f7e0006f950 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 5 monclient: authenticate success, global_id 145060 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 10 monclient: _renew_subs 2024-04-26T00:01:20.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7e0009f090 con 0x7f7e0006f950 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 10 monclient: _renew_subs 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7e00136260 con 0x7f7e0006f950 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7df40048d0 con 0x7f7e0006f950 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7df4004e40 con 0x7f7e0006f950 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfeffd640 4 set_mon_vals no callback set 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 10 monclient: dump: 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:20.090 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:20.091 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7df4005060 con 0x7f7e0006f950 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7de0005090 con 0x7f7e0006f950 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(199..199 src has 29..199) ==== 11375+0+0 (unknown 2649306333 0 0) 0x7f7df40464c0 con 0x7f7e0006f950 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.090+0000 7f7dfffff640 10 monclient: get_auth_request con 0x7f7de40379f0 auth_method 0 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.094+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7df4015920 con 0x7f7e0006f950 2024-04-26T00:01:20.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.094+0000 7f7dfd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:20.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.094+0000 7f7dfd7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:20.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.246+0000 7f7e070f1640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:20.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.246+0000 7f7e070f1640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:20.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.246+0000 7f7e070f1640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:20.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.246+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f7de0005380 con 0x7f7e0006f950 2024-04-26T00:01:20.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.866+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}]=0 added bucket h20 type host to location {rack=r1} v200) ==== 168+0+0 (unknown 2784413292 0 0) 0x7f7df4015220 con 0x7f7e0006f950 2024-04-26T00:01:20.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.866+0000 7f7dfd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:20.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.866+0000 7f7dfd7fa640 10 monclient: _finish_command 2 = system:0 added bucket h20 type host to location {rack=r1} 2024-04-26T00:01:20.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.974+0000 7f7e070f1640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:20.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.974+0000 7f7e070f1640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:20.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.974+0000 7f7e070f1640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:20.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.974+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f7de0005be0 con 0x7f7e0006f950 2024-04-26T00:01:20.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.974+0000 7f7dfd7fa640 1 -- 172.21.15.171:0/4006621349 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h20' already exists v200) ==== 147+0+0 (unknown 3524871464 0 0) 0x7f7df401ddd0 con 0x7f7e0006f950 2024-04-26T00:01:20.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.974+0000 7f7dfd7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h20", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:20.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.974+0000 7f7dfd7fa640 10 monclient: _finish_command 3 = system:0 bucket 'h20' already exists 2024-04-26T00:01:20.958 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h20' already exists 2024-04-26T00:01:20.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 >> v1:172.21.15.171:6812/722422047 conn(0x7f7de40379f0 legacy=0x7f7de4039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:20.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 10 monclient: shutdown 2024-04-26T00:01:20.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:20.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 >> v1:172.21.15.171:6792/0 conn(0x7f7e0006f950 legacy=0x7f7e00132ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:20.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 shutdown_connections 2024-04-26T00:01:20.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 >> 172.21.15.171:0/4006621349 conn(0x7f7e000a2690 msgr2=0x7f7e0013a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:20.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 shutdown_connections 2024-04-26T00:01:20.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:20.978+0000 7f7e070f1640 1 -- 172.21.15.171:0/4006621349 wait complete. 2024-04-26T00:01:20.976 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:20.976 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h21 host rack=r1 2024-04-26T00:01:21.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: get_monmap_and_config 2024-04-26T00:01:21.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: build_initial_monmap 2024-04-26T00:01:21.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: monmap: 2024-04-26T00:01:21.092 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:21.114805+0000 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:21.114805+0000 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:21.093 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:21.094 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 Processor -- start 2024-04-26T00:01:21.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 -- start start 2024-04-26T00:01:21.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: init 2024-04-26T00:01:21.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:21.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: _add_conns ranks=[2,6,3,5,7,8,0,1,4] 2024-04-26T00:01:21.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient(hunting): picked mon.noname-b con 0x7f61d8137960 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:21.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient(hunting): picked mon.noname-d con 0x7f61d80a4220 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:21.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient(hunting): picked mon.noname-g con 0x7f61d8138450 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80a48c0 con 0x7f61d8137960 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80a2f70 con 0x7f61d8138450 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80a0d00 con 0x7f61d80a4220 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d6d9d640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f61d8138450 legacy=0x7f61d81405c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient(hunting): authenticate will time out at 1331.821849s 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d659c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f61d8137960 0x7f61d8137d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:50334/0 (socket says 172.21.15.171:50334) 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d659c640 1 -- 172.21.15.171:0/2662841150 learned_addr learned my addr 172.21.15.171:0/2662841150 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2011354527 0 0) 0x7f61d80a48c0 con 0x7f61d8137960 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:21.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): my global_id is 6653 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61c4003530 con 0x7f61d8137960 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793230424 0 0) 0x7f61d80a0d00 con 0x7f61d80a4220 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient(hunting): my global_id is 6702 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61d80a48c0 con 0x7f61d80a4220 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1446353749 0 0) 0x7f61c4003530 con 0x7f61d8137960 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 >> v1:172.21.15.106:6792/0 conn(0x7f61d80a4220 legacy=0x7f61d813ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 >> v1:172.21.15.171:6790/0 conn(0x7f61d8138450 legacy=0x7f61d81405c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 monclient: found mon.noname-b 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d80a29b0 con 0x7f61d8137960 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: _finish_auth 0 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 5 monclient: authenticate success, global_id 6653 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61c80017c0 con 0x7f61d8137960 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:21.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: dump: 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.106 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61c8001a70 con 0x7f61d8137960 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 1 -- 172.21.15.171:0/2662841150 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61c8004bf0 con 0x7f61d8137960 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 4 set_mon_vals no callback set 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61d5d9b640 10 monclient: dump: 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.107 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.108 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 10 monclient: shutdown 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 -- 172.21.15.171:0/2662841150 >> v1:172.21.15.106:6790/0 conn(0x7f61d8137960 legacy=0x7f61d8137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 -- 172.21.15.171:0/2662841150 shutdown_connections 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.110+0000 7f61dcb24640 1 -- 172.21.15.171:0/2662841150 >> 172.21.15.171:0/2662841150 conn(0x7f61d80a9fc0 msgr2=0x7f61d80aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- 172.21.15.171:0/2662841150 shutdown_connections 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- 172.21.15.171:0/2662841150 wait complete. 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: build_initial_monmap 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: monmap: 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:21.109 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 Processor -- start 2024-04-26T00:01:21.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- start start 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: init 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _add_conns ranks=[7,4,6,3,0,1,5,2,8] 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient(hunting): picked mon.noname-i con 0x7f61d80a4220 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient(hunting): picked mon.noname-c con 0x7f61d8137960 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient(hunting): picked mon.noname-d con 0x7f61d8138450 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80a0fa0 con 0x7f61d8137960 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d80a1f50 con 0x7f61d8138450 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61d8122160 con 0x7f61d80a4220 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient(hunting): authenticate will time out at 1331.825618s 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61d659c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f61d80a4220 0x7f61d8136d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:35466/0 (socket says 172.21.15.171:35466) 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61d659c640 1 -- 172.21.15.171:0/1216143334 learned_addr learned my addr 172.21.15.171:0/1216143334 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:21.111 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 375849686 0 0) 0x7f61d8122160 con 0x7f61d80a4220 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): my global_id is 145069 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61b8003530 con 0x7f61d80a4220 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3689687503 0 0) 0x7f61b8003530 con 0x7f61d80a4220 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61d8122160 con 0x7f61d80a4220 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61c8004b30 con 0x7f61d80a4220 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): dump: 2024-04-26T00:01:21.112 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.113 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2679265491 0 0) 0x7f61d80a0fa0 con 0x7f61d8137960 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient(hunting): my global_id is 145219 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61b8003530 con 0x7f61d8137960 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1570629709 0 0) 0x7f61d8122160 con 0x7f61d80a4220 2024-04-26T00:01:21.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 >> v1:172.21.15.106:6792/0 conn(0x7f61d8138450 legacy=0x7f61d81d4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 >> v1:172.21.15.106:6791/0 conn(0x7f61d8137960 legacy=0x7f61d81d13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 monclient: found mon.i 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d81244c0 con 0x7f61d80a4220 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 5 monclient: authenticate success, global_id 145069 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _renew_subs 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61d81241e0 con 0x7f61d80a4220 2024-04-26T00:01:21.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _renew_subs 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f61d8137440 con 0x7f61d80a4220 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61c8001a70 con 0x7f61d80a4220 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61c80011c0 con 0x7f61d80a4220 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61d559a640 4 set_mon_vals no callback set 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 10 monclient: dump: 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.117 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f61c800fe40 con 0x7f61d80a4220 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:21.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61bc005090 con 0x7f61d80a4220 2024-04-26T00:01:21.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(200..200 src has 29..200) ==== 11588+0+0 (unknown 1952512178 0 0) 0x7f61c80465d0 con 0x7f61d80a4220 2024-04-26T00:01:21.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.114+0000 7f61cffff640 10 monclient: get_auth_request con 0x7f61b80377e0 auth_method 0 2024-04-26T00:01:21.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.122+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f61c8019550 con 0x7f61d80a4220 2024-04-26T00:01:21.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.122+0000 7f61ceffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:21.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.122+0000 7f61ceffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:21.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.286+0000 7f61dcb24640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.286+0000 7f61dcb24640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.286+0000 7f61dcb24640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:21.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.286+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f61bc005380 con 0x7f61d80a4220 2024-04-26T00:01:21.542 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.558+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}]=0 added bucket h21 type host to location {rack=r1} v201) ==== 168+0+0 (unknown 3655615377 0 0) 0x7f61c801de10 con 0x7f61d80a4220 2024-04-26T00:01:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.558+0000 7f61ceffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.558+0000 7f61ceffd640 10 monclient: _finish_command 2 = system:0 added bucket h21 type host to location {rack=r1} 2024-04-26T00:01:21.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.666+0000 7f61dcb24640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.666+0000 7f61dcb24640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.666+0000 7f61dcb24640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:21.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.666+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f61bc005be0 con 0x7f61d80a4220 2024-04-26T00:01:21.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.666+0000 7f61ceffd640 1 -- 172.21.15.171:0/1216143334 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h21' already exists v201) ==== 147+0+0 (unknown 3652148421 0 0) 0x7f61c8013640 con 0x7f61d80a4220 2024-04-26T00:01:21.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.666+0000 7f61ceffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h21", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.666+0000 7f61ceffd640 10 monclient: _finish_command 3 = system:0 bucket 'h21' already exists 2024-04-26T00:01:21.650 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h21' already exists 2024-04-26T00:01:21.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 >> v1:172.21.15.171:6812/722422047 conn(0x7f61b80377e0 legacy=0x7f61b8039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 10 monclient: shutdown 2024-04-26T00:01:21.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:21.652 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 >> v1:172.21.15.171:6792/0 conn(0x7f61d80a4220 legacy=0x7f61d8136d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 shutdown_connections 2024-04-26T00:01:21.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 >> 172.21.15.171:0/1216143334 conn(0x7f61d80a9fc0 msgr2=0x7f61d80a86e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:21.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 shutdown_connections 2024-04-26T00:01:21.653 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.670+0000 7f61dcb24640 1 -- 172.21.15.171:0/1216143334 wait complete. 2024-04-26T00:01:21.667 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:21.667 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h22 host rack=r1 2024-04-26T00:01:21.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient: get_monmap_and_config 2024-04-26T00:01:21.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient: build_initial_monmap 2024-04-26T00:01:21.781 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient: monmap: 2024-04-26T00:01:21.781 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:21.781 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.781 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:21.803713+0000 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:21.803713+0000 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:21.782 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 1 Processor -- start 2024-04-26T00:01:21.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 1 -- start start 2024-04-26T00:01:21.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient: init 2024-04-26T00:01:21.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:21.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient: _add_conns ranks=[1,7,6,5,4,8,3,2,0] 2024-04-26T00:01:21.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient(hunting): picked mon.noname-f con 0x7f43a0137960 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient(hunting): picked mon.noname-i con 0x7f43a00a4220 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient(hunting): picked mon.noname-d con 0x7f43a0138450 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a00a48c0 con 0x7f43a0137960 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a00a2f70 con 0x7f43a0138450 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a00a0d00 con 0x7f43a00a4220 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient(hunting): authenticate will time out at 1332.510707s 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439e59c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f43a0137960 0x7f43a0137d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56898/0 (socket says 172.21.15.171:56898) 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439e59c640 1 -- 172.21.15.171:0/3413582386 learned_addr learned my addr 172.21.15.171:0/3413582386 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1569834024 0 0) 0x7f43a00a48c0 con 0x7f43a0137960 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:21.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): my global_id is 145135 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4380003530 con 0x7f43a0137960 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255207441 0 0) 0x7f43a00a0d00 con 0x7f43a00a4220 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient(hunting): my global_id is 145078 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43a00a48c0 con 0x7f43a00a4220 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 983127569 0 0) 0x7f4380003530 con 0x7f43a0137960 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 >> v1:172.21.15.171:6792/0 conn(0x7f43a00a4220 legacy=0x7f43a013ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 >> v1:172.21.15.106:6792/0 conn(0x7f43a0138450 legacy=0x7f43a01405c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: _finish_hunting 0 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 monclient: found mon.noname-f 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:21.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a00a29b0 con 0x7f43a0137960 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: _finish_auth 0 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: _check_auth_tickets 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f43900017c0 con 0x7f43a0137960 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 5 monclient: authenticate success, global_id 145135 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: dump: 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.792 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43900019b0 con 0x7f43a0137960 2024-04-26T00:01:21.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f43a4e88640 4 set_mon_vals no callback set 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 1 -- 172.21.15.171:0/3413582386 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4390004bf0 con 0x7f43a0137960 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.798+0000 7f439d59a640 10 monclient: dump: 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.794 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: shutdown 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/3413582386 >> v1:172.21.15.171:6789/0 conn(0x7f43a0137960 legacy=0x7f43a0137d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/3413582386 shutdown_connections 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/3413582386 >> 172.21.15.171:0/3413582386 conn(0x7f43a00a9fc0 msgr2=0x7f43a00aa3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/3413582386 shutdown_connections 2024-04-26T00:01:21.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/3413582386 wait complete. 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: build_initial_monmap 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: monmap: 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:21.796 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 Processor -- start 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- start start 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: init 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _add_conns ranks=[8,2,5,1,4,0,6,7,3] 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient(hunting): picked mon.noname-e con 0x7f43a00a4220 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient(hunting): picked mon.noname-b con 0x7f43a0137960 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient(hunting): picked mon.noname-h con 0x7f43a0138450 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a01223b0 con 0x7f43a0137960 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a0123e70 con 0x7f43a0138450 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43a0123130 con 0x7f43a00a4220 2024-04-26T00:01:21.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient(hunting): authenticate will time out at 1332.513779s 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f439ed9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f43a0138450 0x7f43a01d4c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39302/0 (socket says 172.21.15.171:39302) 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f439ed9d640 1 -- 172.21.15.171:0/2842372914 learned_addr learned my addr 172.21.15.171:0/2842372914 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2058325843 0 0) 0x7f43a0123e70 con 0x7f43a0138450 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): my global_id is 6557 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4384003530 con 0x7f43a0138450 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2124548732 0 0) 0x7f4384003530 con 0x7f43a0138450 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43a0123e70 con 0x7f43a0138450 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4388001a00 con 0x7f43a0138450 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:21.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): dump: 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.799 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3755217690 0 0) 0x7f43a0123e70 con 0x7f43a0138450 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 >> v1:172.21.15.106:6793/0 conn(0x7f43a00a4220 legacy=0x7f43a0136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 >> v1:172.21.15.106:6790/0 conn(0x7f43a0137960 legacy=0x7f43a01d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 monclient: found mon.h 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a01ccc30 con 0x7f43a0138450 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:21.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 5 monclient: authenticate success, global_id 6557 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _renew_subs 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f43a0137460 con 0x7f43a0138450 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _renew_subs 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f43a01cc3a0 con 0x7f43a0138450 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43880038d0 con 0x7f43a0138450 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4388003e40 con 0x7f43a0138450 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f439cd99640 4 set_mon_vals no callback set 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:21.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 10 monclient: dump: 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:21.802 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4378005090 con 0x7f43a0138450 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4388004060 con 0x7f43a0138450 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.802+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(201..201 src has 29..201) ==== 11801+0+0 (unknown 963665357 0 0) 0x7f43880465f0 con 0x7f43a0138450 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.806+0000 7f439e59c640 10 monclient: get_auth_request con 0x7f4384037830 auth_method 0 2024-04-26T00:01:21.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.810+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f43880158c0 con 0x7f43a0138450 2024-04-26T00:01:21.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.810+0000 7f4396ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:21.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.810+0000 7f4396ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:21.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.974+0000 7f43a4e88640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.974+0000 7f43a4e88640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:21.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.974+0000 7f43a4e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:21.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:21.974+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f4378005380 con 0x7f43a0138450 2024-04-26T00:01:22.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.894+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}]=0 added bucket h22 type host to location {rack=r1} v202) ==== 168+0+0 (unknown 1574161814 0 0) 0x7f43880151c0 con 0x7f43a0138450 2024-04-26T00:01:22.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.894+0000 7f4396ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:22.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.894+0000 7f4396ffd640 10 monclient: _finish_command 2 = system:0 added bucket h22 type host to location {rack=r1} 2024-04-26T00:01:22.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.998+0000 7f43a4e88640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:22.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.998+0000 7f43a4e88640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:22.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.998+0000 7f43a4e88640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:22.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.998+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f4378005ac0 con 0x7f43a0138450 2024-04-26T00:01:22.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.998+0000 7f4396ffd640 1 -- 172.21.15.171:0/2842372914 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h22' already exists v202) ==== 147+0+0 (unknown 3312809714 0 0) 0x7f438801dd70 con 0x7f43a0138450 2024-04-26T00:01:22.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.998+0000 7f4396ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h22", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:22.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:22.998+0000 7f4396ffd640 10 monclient: _finish_command 3 = system:0 bucket 'h22' already exists 2024-04-26T00:01:22.983 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h22' already exists 2024-04-26T00:01:22.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 >> v1:172.21.15.171:6812/722422047 conn(0x7f4384037830 legacy=0x7f4384039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:22.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 10 monclient: shutdown 2024-04-26T00:01:22.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:22.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 >> v1:172.21.15.171:6791/0 conn(0x7f43a0138450 legacy=0x7f43a01d4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:22.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 shutdown_connections 2024-04-26T00:01:22.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 >> 172.21.15.171:0/2842372914 conn(0x7f43a00a9fc0 msgr2=0x7f43a00a8650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:22.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 shutdown_connections 2024-04-26T00:01:22.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.002+0000 7f43a4e88640 1 -- 172.21.15.171:0/2842372914 wait complete. 2024-04-26T00:01:23.001 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:23.001 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h23 host rack=r1 2024-04-26T00:01:23.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient: get_monmap_and_config 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient: build_initial_monmap 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient: monmap: 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:23.143939+0000 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:23.143939+0000 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:23.122 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:23.123 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:23.123 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:23.123 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:23.123 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:23.123 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:23.123 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 1 Processor -- start 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 1 -- start start 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient: init 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient: _add_conns ranks=[5,0,2,3,6,7,1,8,4] 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient(hunting): picked mon.noname-h con 0x7f42d406f950 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient(hunting): picked mon.noname-a con 0x7f42d41378f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient(hunting): picked mon.noname-b con 0x7f42d413b400 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d40a1e70 con 0x7f42d41378f0 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d40714e0 con 0x7f42d413b400 2024-04-26T00:01:23.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d40717c0 con 0x7f42d406f950 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient(hunting): authenticate will time out at 1333.850783s 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d2d9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f42d406f950 0x7f42d406fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39318/0 (socket says 172.21.15.171:39318) 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d2d9d640 1 -- 172.21.15.171:0/1490802086 learned_addr learned my addr 172.21.15.171:0/1490802086 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3844344858 0 0) 0x7f42d40717c0 con 0x7f42d406f950 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient(hunting): my global_id is 6566 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc003530 con 0x7f42d406f950 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4271996745 0 0) 0x7f42bc003530 con 0x7f42d406f950 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 >> v1:172.21.15.106:6790/0 conn(0x7f42d413b400 legacy=0x7f42d413d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 >> v1:172.21.15.106:6789/0 conn(0x7f42d41378f0 legacy=0x7f42d4139ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:23.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 monclient: found mon.noname-h 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d4071aa0 con 0x7f42d406f950 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: _finish_auth 0 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:23.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42c40017c0 con 0x7f42d406f950 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 5 monclient: authenticate success, global_id 6566 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: dump: 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:23.134 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:23.135 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:23.135 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:23.135 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:23.135 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:23.135 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:23.135 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:23.135 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42c4001ab0 con 0x7f42d406f950 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 1 -- 172.21.15.171:0/1490802086 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42c4004bf0 con 0x7f42d406f950 2024-04-26T00:01:23.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d90b6640 4 set_mon_vals no callback set 2024-04-26T00:01:23.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:23.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:23.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.138+0000 7f42d1d9b640 10 monclient: dump: 2024-04-26T00:01:23.137 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:23.137 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:23.137 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.137 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:23.138 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:23.139 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:23.139 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:23.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: shutdown 2024-04-26T00:01:23.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:23.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- 172.21.15.171:0/1490802086 >> v1:172.21.15.171:6791/0 conn(0x7f42d406f950 legacy=0x7f42d406fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:23.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- 172.21.15.171:0/1490802086 shutdown_connections 2024-04-26T00:01:23.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- 172.21.15.171:0/1490802086 >> 172.21.15.171:0/1490802086 conn(0x7f42d40a2690 msgr2=0x7f42d40a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:23.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- 172.21.15.171:0/1490802086 shutdown_connections 2024-04-26T00:01:23.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- 172.21.15.171:0/1490802086 wait complete. 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: build_initial_monmap 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: monmap: 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:23.142 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 Processor -- start 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- start start 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: init 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: _add_conns ranks=[6,3,0,4,2,7,5,1,8] 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient(hunting): picked mon.noname-d con 0x7f42d406f950 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient(hunting): picked mon.noname-g con 0x7f42d41378f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient(hunting): picked mon.noname-a con 0x7f42d413b400 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d4070760 con 0x7f42d413b400 2024-04-26T00:01:23.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d409e7e0 con 0x7f42d41378f0 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d411d0c0 con 0x7f42d406f950 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d259c640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f42d41378f0 legacy=0x7f42d41cf410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient(hunting): authenticate will time out at 1333.854245s 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d359e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f42d413b400 0x7f42d41d2b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:33012/0 (socket says 172.21.15.171:33012) 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d359e640 1 -- 172.21.15.171:0/4066337829 learned_addr learned my addr 172.21.15.171:0/4066337829 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d359e640 1 -- 172.21.15.171:0/4066337829 >> v1:172.21.15.106:6789/0 conn(0x7f42d413b400 legacy=0x7f42d41d2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d359e640 1 -- 172.21.15.171:0/4066337829 >> v1:172.21.15.106:6789/0 conn(0x7f42d413b400 legacy=0x7f42d41d2b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d359e640 1 --1- 172.21.15.171:0/4066337829 >> v1:172.21.15.106:6789/0 conn(0x7f42d413b400 0x7f42d41d2b40 :-1 s=OPENED pgs=611 cs=1 l=1).handle_message read tag failed 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d359e640 1 --1- 172.21.15.171:0/4066337829 >> v1:172.21.15.106:6789/0 conn(0x7f42d413b400 0x7f42d41d2b40 :-1 s=OPENED pgs=611 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6789/0 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 458335171 0 0) 0x7f42d411d0c0 con 0x7f42d406f950 2024-04-26T00:01:23.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): my global_id is 6729 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c0003530 con 0x7f42d406f950 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1863200441 0 0) 0x7f42c0003530 con 0x7f42d406f950 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42d411d0c0 con 0x7f42d406f950 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42c4001780 con 0x7f42d406f950 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): dump: 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:23.145 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:23.146 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2044309442 0 0) 0x7f42d411d0c0 con 0x7f42d406f950 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 >> v1:172.21.15.171:6790/0 conn(0x7f42d41378f0 legacy=0x7f42d41cf410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 >> v1:172.21.15.106:6789/0 conn(0x7f42d413b400 legacy=0x7f42d41d2b40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 monclient: found mon.d 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d411c820 con 0x7f42d406f950 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 5 monclient: authenticate success, global_id 6729 2024-04-26T00:01:23.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: _renew_subs 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42d409f340 con 0x7f42d406f950 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: _renew_subs 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.142+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f42d4135da0 con 0x7f42d406f950 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42c4001190 con 0x7f42d406f950 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42c4004c10 con 0x7f42d406f950 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42d159a640 4 set_mon_vals no callback set 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 10 monclient: dump: 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:23.148 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42d90b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:23.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42d90b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42d90b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42b4005090 con 0x7f42d406f950 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f42c400fdb0 con 0x7f42d406f950 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(202..202 src has 29..202) ==== 12014+0+0 (unknown 1524112552 0 0) 0x7f42c4046580 con 0x7f42d406f950 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.146+0000 7f42d259c640 10 monclient: get_auth_request con 0x7f42c00377e0 auth_method 0 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.158+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f42c4015780 con 0x7f42d406f950 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.158+0000 7f42bb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:23.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.158+0000 7f42bb7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:23.315 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.330+0000 7f42d90b6640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:23.315 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.330+0000 7f42d90b6640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:23.315 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.330+0000 7f42d90b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:23.315 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.330+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f42b4005380 con 0x7f42d406f950 2024-04-26T00:01:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.918+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}]=0 added bucket h23 type host to location {rack=r1} v203) ==== 168+0+0 (unknown 566315115 0 0) 0x7f42c40193d0 con 0x7f42d406f950 2024-04-26T00:01:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.918+0000 7f42bb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:23.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:23.918+0000 7f42bb7fe640 10 monclient: _finish_command 2 = system:0 added bucket h23 type host to location {rack=r1} 2024-04-26T00:01:24.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.026+0000 7f42d90b6640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:24.008 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.026+0000 7f42d90b6640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:24.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.026+0000 7f42d90b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:01:24.009 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.026+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f42b4005ac0 con 0x7f42d406f950 2024-04-26T00:01:24.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.026+0000 7f42bb7fe640 1 -- 172.21.15.171:0/4066337829 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h23' already exists v203) ==== 147+0+0 (unknown 3468914463 0 0) 0x7f42c40409d0 con 0x7f42d406f950 2024-04-26T00:01:24.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.026+0000 7f42bb7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h23", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:24.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.026+0000 7f42bb7fe640 10 monclient: _finish_command 3 = system:0 bucket 'h23' already exists 2024-04-26T00:01:24.011 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h23' already exists 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 >> v1:172.21.15.171:6812/722422047 conn(0x7f42c00377e0 legacy=0x7f42c0039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 10 monclient: shutdown 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 >> v1:172.21.15.106:6792/0 conn(0x7f42d406f950 legacy=0x7f42d4136a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 shutdown_connections 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 >> 172.21.15.171:0/4066337829 conn(0x7f42d40a2690 msgr2=0x7f42d413a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 shutdown_connections 2024-04-26T00:01:24.013 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.030+0000 7f42d90b6640 1 -- 172.21.15.171:0/4066337829 wait complete. 2024-04-26T00:01:24.028 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:24.028 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h24 host rack=r1 2024-04-26T00:01:24.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient: get_monmap_and_config 2024-04-26T00:01:24.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient: build_initial_monmap 2024-04-26T00:01:24.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient: monmap: 2024-04-26T00:01:24.150 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:24.150 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:24.150 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:24.172247+0000 2024-04-26T00:01:24.150 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:24.172247+0000 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:24.151 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:24.152 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:24.152 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:24.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 1 Processor -- start 2024-04-26T00:01:24.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 1 -- start start 2024-04-26T00:01:24.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient: init 2024-04-26T00:01:24.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:24.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient: _add_conns ranks=[7,1,5,8,2,6,4,0,3] 2024-04-26T00:01:24.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient(hunting): picked mon.noname-i con 0x7f642c135a00 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:24.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient(hunting): picked mon.noname-f con 0x7f642c0a1790 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:24.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient(hunting): picked mon.noname-h con 0x7f642c13c130 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:24.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c0a1d80 con 0x7f642c0a1790 2024-04-26T00:01:24.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c072f70 con 0x7f642c13c130 2024-04-26T00:01:24.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c072640 con 0x7f642c135a00 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6432adc640 10 monclient(hunting): authenticate will time out at 1334.879161s 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642bfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f642c0a1790 0x7f642c13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56914/0 (socket says 172.21.15.171:56914) 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642bfff640 1 -- 172.21.15.171:0/2109678093 learned_addr learned my addr 172.21.15.171:0/2109678093 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6430878640 1 --1- 172.21.15.171:0/2109678093 >> v1:172.21.15.171:6792/0 conn(0x7f642c135a00 0x7f642c135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:35486/0 (socket says 172.21.15.171:35486) 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f6431079640 1 --1- 172.21.15.171:0/2109678093 >> v1:172.21.15.171:6791/0 conn(0x7f642c13c130 0x7f642c13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39330/0 (socket says 172.21.15.171:39330) 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257248427 0 0) 0x7f642c072640 con 0x7f642c135a00 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:24.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): my global_id is 145087 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6414003530 con 0x7f642c135a00 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974240852 0 0) 0x7f642c0a1d80 con 0x7f642c0a1790 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): my global_id is 145144 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642c072640 con 0x7f642c0a1790 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686837445 0 0) 0x7f642c072f70 con 0x7f642c13c130 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:24.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 10 monclient(hunting): my global_id is 6575 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f642c0a1d80 con 0x7f642c13c130 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2660168313 0 0) 0x7f6414003530 con 0x7f642c135a00 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.166+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 >> v1:172.21.15.171:6791/0 conn(0x7f642c13c130 legacy=0x7f642c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 >> v1:172.21.15.171:6789/0 conn(0x7f642c0a1790 legacy=0x7f642c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 1 monclient: found mon.noname-i 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c072920 con 0x7f642c135a00 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:24.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f641c0017c0 con 0x7f642c135a00 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 5 monclient: authenticate success, global_id 145087 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: dump: 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.165 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:24.166 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f641c0019f0 con 0x7f642c135a00 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 4 set_mon_vals no callback set 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 1 -- 172.21.15.171:0/2109678093 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f641c004b30 con 0x7f642c135a00 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642b7fe640 10 monclient: dump: 2024-04-26T00:01:24.167 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:24.168 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: shutdown 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- 172.21.15.171:0/2109678093 >> v1:172.21.15.171:6792/0 conn(0x7f642c135a00 legacy=0x7f642c135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- 172.21.15.171:0/2109678093 shutdown_connections 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- 172.21.15.171:0/2109678093 >> 172.21.15.171:0/2109678093 conn(0x7f642c0a2690 msgr2=0x7f642c0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- 172.21.15.171:0/2109678093 shutdown_connections 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- 172.21.15.171:0/2109678093 wait complete. 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: build_initial_monmap 2024-04-26T00:01:24.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: monmap: 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:24.170 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 Processor -- start 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- start start 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: init 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:24.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: _add_conns ranks=[2,3,5,7,4,6,1,0,8] 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient(hunting): picked mon.noname-b con 0x7f642c0a1790 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient(hunting): picked mon.noname-g con 0x7f642c135a00 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient(hunting): picked mon.noname-h con 0x7f642c13c130 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c136ea0 con 0x7f642c0a1790 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c136a80 con 0x7f642c135a00 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f642c1339b0 con 0x7f642c13c130 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient(hunting): authenticate will time out at 1334.882351s 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642bfff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f642c135a00 legacy=0x7f642c131b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:24.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6431079640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f642c13c130 0x7f642c1d2300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39338/0 (socket says 172.21.15.171:39338) 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6431079640 1 -- 172.21.15.171:0/1980521752 learned_addr learned my addr 172.21.15.171:0/1980521752 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2224952748 0 0) 0x7f642c1339b0 con 0x7f642c13c130 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): my global_id is 6584 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6418003530 con 0x7f642c13c130 2024-04-26T00:01:24.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3274709641 0 0) 0x7f6418003530 con 0x7f642c13c130 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f642c1339b0 con 0x7f642c13c130 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6424001be0 con 0x7f642c13c130 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): dump: 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.174 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:24.175 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2599043471 0 0) 0x7f642c1339b0 con 0x7f642c13c130 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 >> v1:172.21.15.171:6790/0 conn(0x7f642c135a00 legacy=0x7f642c131b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 >> v1:172.21.15.106:6790/0 conn(0x7f642c0a1790 legacy=0x7f642c131410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:24.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 monclient: found mon.h 2024-04-26T00:01:24.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:24.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:24.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642c09fc40 con 0x7f642c13c130 2024-04-26T00:01:24.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 5 monclient: authenticate success, global_id 6584 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: _renew_subs 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f642c1367a0 con 0x7f642c13c130 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: _renew_subs 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f642c13b460 con 0x7f642c13c130 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6424002010 con 0x7f642c13c130 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:24.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6424005220 con 0x7f642c13c130 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f642affd640 4 set_mon_vals no callback set 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.170+0000 7f64297fa640 10 monclient: dump: 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:24.179 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.174+0000 7f6432adc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.174+0000 7f6432adc640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.174+0000 7f6432adc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.174+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f640c005090 con 0x7f642c13c130 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.174+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f642400ffc0 con 0x7f642c13c130 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.174+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(203..203 src has 29..203) ==== 12227+0+0 (unknown 842395971 0 0) 0x7f6424046aa0 con 0x7f642c13c130 2024-04-26T00:01:24.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.174+0000 7f6430878640 10 monclient: get_auth_request con 0x7f6418037800 auth_method 0 2024-04-26T00:01:24.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.178+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6424015bb0 con 0x7f642c13c130 2024-04-26T00:01:24.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.178+0000 7f64297fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:24.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.178+0000 7f64297fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:24.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.338+0000 7f6432adc640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:24.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.338+0000 7f6432adc640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:24.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.338+0000 7f6432adc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:24.323 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.338+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f640c005380 con 0x7f642c13c130 2024-04-26T00:01:24.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.922+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}]=0 added bucket h24 type host to location {rack=r1} v204) ==== 168+0+0 (unknown 1347463017 0 0) 0x7f64240154b0 con 0x7f642c13c130 2024-04-26T00:01:24.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.922+0000 7f64297fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:24.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:24.922+0000 7f64297fa640 10 monclient: _finish_command 2 = system:0 added bucket h24 type host to location {rack=r1} 2024-04-26T00:01:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.022+0000 7f6432adc640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.022+0000 7f6432adc640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:25.005 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.022+0000 7f6432adc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:25.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.022+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f640c005be0 con 0x7f642c13c130 2024-04-26T00:01:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.022+0000 7f64297fa640 1 -- 172.21.15.171:0/1980521752 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h24' already exists v204) ==== 147+0+0 (unknown 4240515740 0 0) 0x7f642401e060 con 0x7f642c13c130 2024-04-26T00:01:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.022+0000 7f64297fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h24", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.022+0000 7f64297fa640 10 monclient: _finish_command 3 = system:0 bucket 'h24' already exists 2024-04-26T00:01:25.007 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h24' already exists 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 >> v1:172.21.15.171:6812/722422047 conn(0x7f6418037800 legacy=0x7f6418039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 10 monclient: shutdown 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 >> v1:172.21.15.171:6791/0 conn(0x7f642c13c130 legacy=0x7f642c1d2300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 shutdown_connections 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 >> 172.21.15.171:0/1980521752 conn(0x7f642c0a2690 msgr2=0x7f642c12f5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 shutdown_connections 2024-04-26T00:01:25.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.026+0000 7f6432adc640 1 -- 172.21.15.171:0/1980521752 wait complete. 2024-04-26T00:01:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:25.024 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h25 host rack=r1 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient: get_monmap_and_config 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient: build_initial_monmap 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient: monmap: 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:25.160241+0000 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:25.160241+0000 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:25.138 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:25.139 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:25.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 1 Processor -- start 2024-04-26T00:01:25.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 1 -- start start 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient: init 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient: _add_conns ranks=[0,6,8,4,5,1,7,2,3] 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient(hunting): picked mon.noname-a con 0x7fc5cc135a00 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient(hunting): picked mon.noname-d con 0x7fc5cc0a1790 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient(hunting): picked mon.noname-e con 0x7fc5cc13c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc0a1d80 con 0x7fc5cc135a00 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc072f70 con 0x7fc5cc0a1790 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc072640 con 0x7fc5cc13c130 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.154+0000 7fc5d40e9640 10 monclient(hunting): authenticate will time out at 1335.867816s 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d1684640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc5cc0a1790 0x7fc5cc13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:33088/0 (socket says 172.21.15.171:33088) 2024-04-26T00:01:25.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d1684640 1 -- 172.21.15.171:0/3790637808 learned_addr learned my addr 172.21.15.171:0/3790637808 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d1e85640 1 --1- 172.21.15.171:0/3790637808 >> v1:172.21.15.106:6789/0 conn(0x7fc5cc135a00 0x7fc5cc135de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:33024/0 (socket says 172.21.15.171:33024) 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947904654 0 0) 0x7fc5cc072640 con 0x7fc5cc13c130 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _negotiate 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): my global_id is 204362 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5b8003530 con 0x7fc5cc13c130 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2093586616 0 0) 0x7fc5cc072f70 con 0x7fc5cc0a1790 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _negotiate 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): my global_id is 6738 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5cc072640 con 0x7fc5cc0a1790 2024-04-26T00:01:25.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285096064 0 0) 0x7fc5cc0a1d80 con 0x7fc5cc135a00 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _negotiate 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient(hunting): my global_id is 6849 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5cc072f70 con 0x7fc5cc135a00 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 880771036 0 0) 0x7fc5b8003530 con 0x7fc5cc13c130 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 >> v1:172.21.15.106:6792/0 conn(0x7fc5cc0a1790 legacy=0x7fc5cc13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 >> v1:172.21.15.106:6789/0 conn(0x7fc5cc135a00 legacy=0x7fc5cc135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: _finish_hunting 0 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 monclient: found mon.noname-e 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc072920 con 0x7fc5cc13c130 2024-04-26T00:01:25.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: _finish_auth 0 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: _check_auth_tickets 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5c40016f0 con 0x7fc5cc13c130 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: dump: 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:25.146 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 5 monclient: authenticate success, global_id 204362 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5c4001920 con 0x7fc5cc13c130 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:25.147 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 1 -- 172.21.15.171:0/3790637808 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5c4003620 con 0x7fc5cc13c130 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 4 set_mon_vals no callback set 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d0e83640 10 monclient: dump: 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:25.148 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient: shutdown 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3790637808 >> v1:172.21.15.106:6793/0 conn(0x7fc5cc13c130 legacy=0x7fc5cc13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3790637808 shutdown_connections 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3790637808 >> 172.21.15.171:0/3790637808 conn(0x7fc5cc0a2690 msgr2=0x7fc5cc0a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3790637808 shutdown_connections 2024-04-26T00:01:25.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3790637808 wait complete. 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient: build_initial_monmap 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient: monmap: 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:25.150 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:25.151 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:25.151 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:25.151 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:25.151 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:25.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 Processor -- start 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- start start 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient: init 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient: _add_conns ranks=[7,5,2,4,8,3,0,6,1] 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient(hunting): picked mon.noname-i con 0x7fc5cc0a1790 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient(hunting): picked mon.noname-h con 0x7fc5cc135a00 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient(hunting): picked mon.noname-b con 0x7fc5cc13c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc1cd160 con 0x7fc5cc13c130 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc09fc40 con 0x7fc5cc135a00 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5cc132330 con 0x7fc5cc0a1790 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d40e9640 10 monclient(hunting): authenticate will time out at 1335.871774s 2024-04-26T00:01:25.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d1684640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc5cc135a00 0x7fc5cc1cca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39354/0 (socket says 172.21.15.171:39354) 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.158+0000 7fc5d1684640 1 -- 172.21.15.171:0/3745956870 learned_addr learned my addr 172.21.15.171:0/3745956870 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 560880952 0 0) 0x7fc5cc132330 con 0x7fc5cc0a1790 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): my global_id is 145096 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5b0003530 con 0x7fc5cc0a1790 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2115458909 0 0) 0x7fc5cc09fc40 con 0x7fc5cc135a00 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): my global_id is 6593 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5cc132330 con 0x7fc5cc135a00 2024-04-26T00:01:25.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1518068332 0 0) 0x7fc5b0003530 con 0x7fc5cc0a1790 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5cc09fc40 con 0x7fc5cc0a1790 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2402640597 0 0) 0x7fc5cc132330 con 0x7fc5cc135a00 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc5b0003530 con 0x7fc5cc135a00 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5c8001d60 con 0x7fc5cc0a1790 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): dump: 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:25.157 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5bc001520 con 0x7fc5cc135a00 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:25.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): dump: 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:25.159 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80987329 0 0) 0x7fc5cc1cd160 con 0x7fc5cc13c130 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient(hunting): my global_id is 6689 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc5cc132330 con 0x7fc5cc13c130 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4197813133 0 0) 0x7fc5cc09fc40 con 0x7fc5cc0a1790 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 >> v1:172.21.15.171:6791/0 conn(0x7fc5cc135a00 legacy=0x7fc5cc1cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 >> v1:172.21.15.106:6790/0 conn(0x7fc5cc13c130 legacy=0x7fc5cc1d4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 monclient: found mon.i 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:25.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5cc09f6a0 con 0x7fc5cc0a1790 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 5 monclient: authenticate success, global_id 145096 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 10 monclient: _renew_subs 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc5cc070db0 con 0x7fc5cc0a1790 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 10 monclient: _renew_subs 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc5cc13ace0 con 0x7fc5cc0a1790 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc5c8004e20 con 0x7fc5cc0a1790 2024-04-26T00:01:25.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5c8005310 con 0x7fc5cc0a1790 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c3fff640 4 set_mon_vals no callback set 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 10 monclient: dump: 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:25.162 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc5c80100b0 con 0x7fc5cc0a1790 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5b4005090 con 0x7fc5cc0a1790 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(204..204 src has 29..204) ==== 12440+0+0 (unknown 3991397908 0 0) 0x7fc5c8046a70 con 0x7fc5cc0a1790 2024-04-26T00:01:25.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.162+0000 7fc5d1684640 10 monclient: get_auth_request con 0x7fc5b0037e00 auth_method 0 2024-04-26T00:01:25.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.166+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc5c8015b60 con 0x7fc5cc0a1790 2024-04-26T00:01:25.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.166+0000 7fc5c27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:25.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.166+0000 7fc5c27fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:25.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.326+0000 7fc5d40e9640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:25.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.326+0000 7fc5d40e9640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:25.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.326+0000 7fc5d40e9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:25.309 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.326+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fc5b4005380 con 0x7fc5cc0a1790 2024-04-26T00:01:25.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.942+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}]=0 added bucket h25 type host to location {rack=r1} v205) ==== 168+0+0 (unknown 742531732 0 0) 0x7fc5c8015460 con 0x7fc5cc0a1790 2024-04-26T00:01:25.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.946+0000 7fc5c27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:25.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:25.946+0000 7fc5c27fc640 10 monclient: _finish_command 2 = system:0 added bucket h25 type host to location {rack=r1} 2024-04-26T00:01:26.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.038+0000 7fc5d40e9640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:26.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:26.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:26.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fc5b4005ac0 con 0x7fc5cc0a1790 2024-04-26T00:01:26.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5c27fc640 1 -- 172.21.15.171:0/3745956870 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h25' already exists v205) ==== 147+0+0 (unknown 4151786353 0 0) 0x7fc5c801e010 con 0x7fc5cc0a1790 2024-04-26T00:01:26.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5c27fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h25", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:26.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5c27fc640 10 monclient: _finish_command 3 = system:0 bucket 'h25' already exists 2024-04-26T00:01:26.025 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h25' already exists 2024-04-26T00:01:26.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 >> v1:172.21.15.171:6812/722422047 conn(0x7fc5b0037e00 legacy=0x7fc5b003a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:26.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 10 monclient: shutdown 2024-04-26T00:01:26.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:26.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 >> v1:172.21.15.171:6792/0 conn(0x7fc5cc0a1790 legacy=0x7fc5cc1cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:26.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 shutdown_connections 2024-04-26T00:01:26.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 >> 172.21.15.171:0/3745956870 conn(0x7fc5cc0a2690 msgr2=0x7fc5cc0a3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:26.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 shutdown_connections 2024-04-26T00:01:26.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.042+0000 7fc5d40e9640 1 -- 172.21.15.171:0/3745956870 wait complete. 2024-04-26T00:01:26.042 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:26.042 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h26 host rack=r1 2024-04-26T00:01:26.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient: get_monmap_and_config 2024-04-26T00:01:26.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient: build_initial_monmap 2024-04-26T00:01:26.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient: monmap: 2024-04-26T00:01:26.162 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:26.184807+0000 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:26.184807+0000 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:26.163 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 1 Processor -- start 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 1 -- start start 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient: init 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient: _add_conns ranks=[4,8,7,3,0,2,5,1,6] 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient(hunting): picked mon.noname-c con 0x7fdab4135a00 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient(hunting): picked mon.noname-e con 0x7fdab40a1790 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient(hunting): picked mon.noname-i con 0x7fdab413c130 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:26.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab40a1d80 con 0x7fdab4135a00 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab4072f70 con 0x7fdab413c130 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab4072640 con 0x7fdab40a1790 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab92b6640 10 monclient(hunting): authenticate will time out at 1336.891751s 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab37fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fdab413c130 0x7fdab413e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:35498/0 (socket says 172.21.15.171:35498) 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.178+0000 7fdab37fe640 1 -- 172.21.15.171:0/3512602380 learned_addr learned my addr 172.21.15.171:0/3512602380 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1090070699 0 0) 0x7fdab4072f70 con 0x7fdab413c130 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient(hunting): my global_id is 145105 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda9c003530 con 0x7fdab413c130 2024-04-26T00:01:26.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 578624347 0 0) 0x7fda9c003530 con 0x7fdab413c130 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 >> v1:172.21.15.106:6793/0 conn(0x7fdab40a1790 legacy=0x7fdab413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 >> v1:172.21.15.106:6791/0 conn(0x7fdab4135a00 legacy=0x7fdab4135de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 monclient: found mon.noname-i 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab4072920 con 0x7fdab413c130 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaac001b40 con 0x7fdab413c130 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:26.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: dump: 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:26.173 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 5 monclient: authenticate success, global_id 145105 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaac001e30 con 0x7fdab413c130 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 1 -- 172.21.15.171:0/3512602380 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaac004f70 con 0x7fdab413c130 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab1ffb640 10 monclient: dump: 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.174 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:26.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 4 set_mon_vals no callback set 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: shutdown 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- 172.21.15.171:0/3512602380 >> v1:172.21.15.171:6792/0 conn(0x7fdab413c130 legacy=0x7fdab413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- 172.21.15.171:0/3512602380 shutdown_connections 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- 172.21.15.171:0/3512602380 >> 172.21.15.171:0/3512602380 conn(0x7fdab40a2690 msgr2=0x7fdab40a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- 172.21.15.171:0/3512602380 shutdown_connections 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- 172.21.15.171:0/3512602380 wait complete. 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: build_initial_monmap 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: monmap: 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:26.176 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 Processor -- start 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- start start 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: init 2024-04-26T00:01:26.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: _add_conns ranks=[5,6,4,0,7,1,3,2,8] 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient(hunting): picked mon.noname-h con 0x7fdab40a1790 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient(hunting): picked mon.noname-d con 0x7fdab4135a00 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient(hunting): picked mon.noname-c con 0x7fdab413c130 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab41310a0 con 0x7fdab413c130 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab409f6f0 con 0x7fdab40a1790 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdab4132f60 con 0x7fdab4135a00 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient(hunting): authenticate will time out at 1336.894713s 2024-04-26T00:01:26.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab2ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fdab40a1790 0x7fdab4129860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39362/0 (socket says 172.21.15.171:39362) 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab2ffd640 1 -- 172.21.15.171:0/1752614186 learned_addr learned my addr 172.21.15.171:0/1752614186 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2178215318 0 0) 0x7fdab409f6f0 con 0x7fdab40a1790 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): my global_id is 6602 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa0003530 con 0x7fdab40a1790 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3171913575 0 0) 0x7fdaa0003530 con 0x7fdab40a1790 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdab409f6f0 con 0x7fdab40a1790 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaa8001ae0 con 0x7fdab40a1790 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): dump: 2024-04-26T00:01:26.179 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:26.180 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2657574644 0 0) 0x7fdab409f6f0 con 0x7fdab40a1790 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 >> v1:172.21.15.106:6792/0 conn(0x7fdab4135a00 legacy=0x7fdab41cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 >> v1:172.21.15.106:6791/0 conn(0x7fdab413c130 legacy=0x7fdab41d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 monclient: found mon.h 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab41312e0 con 0x7fdab40a1790 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 5 monclient: authenticate success, global_id 6602 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: _renew_subs 2024-04-26T00:01:26.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdab4133920 con 0x7fdab40a1790 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: _renew_subs 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fdab409e130 con 0x7fdab40a1790 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaa80038d0 con 0x7fdab40a1790 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaa8003e40 con 0x7fdab40a1790 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fda9b7fe640 10 monclient: dump: 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.182 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.182+0000 7fdab17fa640 4 set_mon_vals no callback set 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.186+0000 7fdab92b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:26.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.186+0000 7fdab92b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.186+0000 7fdab92b6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.186+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda94005090 con 0x7fdab40a1790 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.186+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdaa8003fe0 con 0x7fdab40a1790 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.186+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(205..205 src has 29..205) ==== 12653+0+0 (unknown 123155608 0 0) 0x7fdaa8046930 con 0x7fdab40a1790 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.186+0000 7fdab27fc640 10 monclient: get_auth_request con 0x7fdaa00377d0 auth_method 0 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.190+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdaa8015850 con 0x7fdab40a1790 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.190+0000 7fda9b7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:26.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.190+0000 7fda9b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:26.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.342+0000 7fdab92b6640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:26.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.342+0000 7fdab92b6640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:26.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.342+0000 7fdab92b6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:26.326 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.342+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fda94005380 con 0x7fdab40a1790 2024-04-26T00:01:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.950+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}]=0 added bucket h26 type host to location {rack=r1} v206) ==== 168+0+0 (unknown 2826284179 0 0) 0x7fdaa8015150 con 0x7fdab40a1790 2024-04-26T00:01:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.950+0000 7fda9b7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:26.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:26.950+0000 7fda9b7fe640 10 monclient: _finish_command 2 = system:0 added bucket h26 type host to location {rack=r1} 2024-04-26T00:01:27.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.050+0000 7fdab92b6640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:27.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.050+0000 7fdab92b6640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:27.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.050+0000 7fdab92b6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:27.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.050+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fda94005be0 con 0x7fdab40a1790 2024-04-26T00:01:27.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.050+0000 7fda9b7fe640 1 -- 172.21.15.171:0/1752614186 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h26' already exists v206) ==== 147+0+0 (unknown 3953987910 0 0) 0x7fdaa80194a0 con 0x7fdab40a1790 2024-04-26T00:01:27.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.050+0000 7fda9b7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h26", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:27.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.050+0000 7fda9b7fe640 10 monclient: _finish_command 3 = system:0 bucket 'h26' already exists 2024-04-26T00:01:27.035 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h26' already exists 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 >> v1:172.21.15.171:6812/722422047 conn(0x7fdaa00377d0 legacy=0x7fdaa0039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 10 monclient: shutdown 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 >> v1:172.21.15.171:6791/0 conn(0x7fdab40a1790 legacy=0x7fdab4129860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 shutdown_connections 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 >> 172.21.15.171:0/1752614186 conn(0x7fdab40a2690 msgr2=0x7fdab412f990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 shutdown_connections 2024-04-26T00:01:27.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.054+0000 7fdab92b6640 1 -- 172.21.15.171:0/1752614186 wait complete. 2024-04-26T00:01:27.053 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:27.053 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h27 host rack=r1 2024-04-26T00:01:27.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient: get_monmap_and_config 2024-04-26T00:01:27.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient: build_initial_monmap 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient: monmap: 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:27.195870+0000 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:27.195870+0000 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:27.174 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:27.175 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:27.175 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:27.175 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 1 Processor -- start 2024-04-26T00:01:27.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 1 -- start start 2024-04-26T00:01:27.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient: init 2024-04-26T00:01:27.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:27.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient: _add_conns ranks=[0,2,5,3,6,7,1,4,8] 2024-04-26T00:01:27.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient(hunting): picked mon.noname-a con 0x7fe7981379d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:27.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient(hunting): picked mon.noname-b con 0x7fe7981384c0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient(hunting): picked mon.noname-h con 0x7fe79813e620 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7980a2b00 con 0x7fe7981379d0 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7980a2de0 con 0x7fe7981384c0 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7980a17a0 con 0x7fe79813e620 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79f428640 10 monclient(hunting): authenticate will time out at 1337.903588s 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79d9c5640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe79813e620 0x7fe798140a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39374/0 (socket says 172.21.15.171:39374) 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.190+0000 7fe79d9c5640 1 -- 172.21.15.171:0/3090614683 learned_addr learned my addr 172.21.15.171:0/3090614683 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3189946470 0 0) 0x7fe7980a17a0 con 0x7fe79813e620 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:27.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient(hunting): my global_id is 6611 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe784003530 con 0x7fe79813e620 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 727550524 0 0) 0x7fe784003530 con 0x7fe79813e620 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 >> v1:172.21.15.106:6790/0 conn(0x7fe7981384c0 legacy=0x7fe79813cf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 >> v1:172.21.15.106:6789/0 conn(0x7fe7981379d0 legacy=0x7fe798137db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 monclient: found mon.noname-h 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7980a3b20 con 0x7fe79813e620 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: _finish_auth 0 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe790001b40 con 0x7fe79813e620 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:27.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: dump: 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:27.186 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 5 monclient: authenticate success, global_id 6611 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe790001ea0 con 0x7fe79813e620 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 1 -- 172.21.15.171:0/3090614683 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7900020d0 con 0x7fe79813e620 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 4 set_mon_vals no callback set 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:27.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78ffff640 10 monclient: dump: 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:27.188 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient: shutdown 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- 172.21.15.171:0/3090614683 >> v1:172.21.15.171:6791/0 conn(0x7fe79813e620 legacy=0x7fe798140a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- 172.21.15.171:0/3090614683 shutdown_connections 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- 172.21.15.171:0/3090614683 >> 172.21.15.171:0/3090614683 conn(0x7fe7980a6b30 msgr2=0x7fe7980a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- 172.21.15.171:0/3090614683 shutdown_connections 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- 172.21.15.171:0/3090614683 wait complete. 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient: build_initial_monmap 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient: monmap: 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:27.189 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 Processor -- start 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- start start 2024-04-26T00:01:27.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient: init 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient: _add_conns ranks=[6,8,0,3,7,4,2,5,1] 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient(hunting): picked mon.noname-d con 0x7fe7981379d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient(hunting): picked mon.noname-e con 0x7fe7981384c0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient(hunting): picked mon.noname-a con 0x7fe79813e620 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe79809c290 con 0x7fe79813e620 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe7980a0fa0 con 0x7fe7981379d0 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe798138cd0 con 0x7fe7981384c0 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79f428640 10 monclient(hunting): authenticate will time out at 1337.906726s 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79d1c4640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe7981379d0 0x7fe79809fd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:33100/0 (socket says 172.21.15.171:33100) 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe79d1c4640 1 -- 172.21.15.171:0/610041930 learned_addr learned my addr 172.21.15.171:0/610041930 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2289046108 0 0) 0x7fe79809c290 con 0x7fe79813e620 2024-04-26T00:01:27.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): my global_id is 6867 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe77c003530 con 0x7fe79813e620 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029190592 0 0) 0x7fe7980a0fa0 con 0x7fe7981379d0 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): my global_id is 6756 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe79809c290 con 0x7fe7981379d0 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214185218 0 0) 0x7fe798138cd0 con 0x7fe7981384c0 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:27.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 10 monclient(hunting): my global_id is 204380 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.194+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe7980a0fa0 con 0x7fe7981384c0 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2039323725 0 0) 0x7fe77c003530 con 0x7fe79813e620 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe798138cd0 con 0x7fe79813e620 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7900020b0 con 0x7fe79813e620 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): dump: 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:27.193 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 87154284 0 0) 0x7fe7980a0fa0 con 0x7fe7981384c0 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe77c003530 con 0x7fe7981384c0 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3203984459 0 0) 0x7fe79809c290 con 0x7fe7981379d0 2024-04-26T00:01:27.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe7980a0fa0 con 0x7fe7981379d0 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe7880018d0 con 0x7fe7981384c0 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): dump: 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:27.195 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe794001ae0 con 0x7fe7981379d0 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient(hunting): dump: 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:27.196 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1562813398 0 0) 0x7fe798138cd0 con 0x7fe79813e620 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 >> v1:172.21.15.106:6793/0 conn(0x7fe7981384c0 legacy=0x7fe7981d1c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 >> v1:172.21.15.106:6792/0 conn(0x7fe7981379d0 legacy=0x7fe79809fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:27.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 monclient: found mon.a 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79809e310 con 0x7fe79813e620 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 5 monclient: authenticate success, global_id 6867 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 10 monclient: _renew_subs 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe79809e5f0 con 0x7fe79813e620 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 10 monclient: _renew_subs 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe7980a0440 con 0x7fe79813e620 2024-04-26T00:01:27.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe790001ea0 con 0x7fe79813e620 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe790001410 con 0x7fe79813e620 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78effd640 4 set_mon_vals no callback set 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 10 monclient: dump: 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:27.199 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe778005090 con 0x7fe79813e620 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe7900100a0 con 0x7fe79813e620 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(206..206 src has 29..206) ==== 12866+0+0 (unknown 2196727746 0 0) 0x7fe790046af0 con 0x7fe79813e620 2024-04-26T00:01:27.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.198+0000 7fe79d1c4640 10 monclient: get_auth_request con 0x7fe77c038160 auth_method 0 2024-04-26T00:01:27.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.210+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe7900159a0 con 0x7fe79813e620 2024-04-26T00:01:27.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.210+0000 7fe78dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:27.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.210+0000 7fe78dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:27.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.370+0000 7fe79f428640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:27.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.370+0000 7fe79f428640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:27.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.370+0000 7fe79f428640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:27.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.370+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fe778005380 con 0x7fe79813e620 2024-04-26T00:01:27.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.974+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}]=0 added bucket h27 type host to location {rack=r1} v207) ==== 168+0+0 (unknown 3563530606 0 0) 0x7fe79001de50 con 0x7fe79813e620 2024-04-26T00:01:27.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.974+0000 7fe78dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:27.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:27.974+0000 7fe78dffb640 10 monclient: _finish_command 2 = system:0 added bucket h27 type host to location {rack=r1} 2024-04-26T00:01:28.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.078+0000 7fe79f428640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:28.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.078+0000 7fe79f428640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:28.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.078+0000 7fe79f428640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:28.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.078+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fe778005ac0 con 0x7fe79813e620 2024-04-26T00:01:28.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.078+0000 7fe78dffb640 1 -- 172.21.15.171:0/610041930 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h27' already exists v207) ==== 147+0+0 (unknown 3759868075 0 0) 0x7fe790040c10 con 0x7fe79813e620 2024-04-26T00:01:28.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.078+0000 7fe78dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h27", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:28.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.078+0000 7fe78dffb640 10 monclient: _finish_command 3 = system:0 bucket 'h27' already exists 2024-04-26T00:01:28.063 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h27' already exists 2024-04-26T00:01:28.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 >> v1:172.21.15.171:6812/722422047 conn(0x7fe77c038160 legacy=0x7fe77c03a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:28.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 10 monclient: shutdown 2024-04-26T00:01:28.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:28.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 >> v1:172.21.15.106:6789/0 conn(0x7fe79813e620 legacy=0x7fe7981d5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:28.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 shutdown_connections 2024-04-26T00:01:28.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 >> 172.21.15.171:0/610041930 conn(0x7fe7980a6b30 msgr2=0x7fe798136290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:28.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 shutdown_connections 2024-04-26T00:01:28.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.082+0000 7fe79f428640 1 -- 172.21.15.171:0/610041930 wait complete. 2024-04-26T00:01:28.081 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:28.081 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h28 host rack=r1 2024-04-26T00:01:28.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: get_monmap_and_config 2024-04-26T00:01:28.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: build_initial_monmap 2024-04-26T00:01:28.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: monmap: 2024-04-26T00:01:28.200 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:28.200 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:28.200 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:28.222686+0000 2024-04-26T00:01:28.200 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:28.222686+0000 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:28.201 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:28.202 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:28.202 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:28.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 Processor -- start 2024-04-26T00:01:28.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- start start 2024-04-26T00:01:28.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: init 2024-04-26T00:01:28.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:28.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: _add_conns ranks=[2,3,8,5,0,4,1,7,6] 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient(hunting): picked mon.noname-b con 0x7fb8580a26b0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient(hunting): picked mon.noname-g con 0x7fb858134be0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient(hunting): picked mon.noname-e con 0x7fb858134fc0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85809f220 con 0x7fb8580a26b0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8580a0020 con 0x7fb858134be0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8580a06b0 con 0x7fb858134fc0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient(hunting): authenticate will time out at 1338.929656s 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb8567fc640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fb858134be0 legacy=0x7fb8581397f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb856ffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb8580a26b0 0x7fb8581344d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:50390/0 (socket says 172.21.15.171:50390) 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb856ffd640 1 -- 172.21.15.171:0/3534900771 learned_addr learned my addr 172.21.15.171:0/3534900771 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112323344 0 0) 0x7fb85809f220 con 0x7fb8580a26b0 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:28.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): my global_id is 6707 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb840005740 con 0x7fb8580a26b0 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338579586 0 0) 0x7fb8580a06b0 con 0x7fb858134fc0 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient(hunting): my global_id is 204389 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb85809f220 con 0x7fb858134fc0 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 820669815 0 0) 0x7fb85809f220 con 0x7fb858134fc0 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 >> v1:172.21.15.171:6790/0 conn(0x7fb858134be0 legacy=0x7fb8581397f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 >> v1:172.21.15.106:6790/0 conn(0x7fb8580a26b0 legacy=0x7fb8581344d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 monclient: found mon.noname-e 2024-04-26T00:01:28.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8580a0990 con 0x7fb858134fc0 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8480017a0 con 0x7fb858134fc0 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 5 monclient: authenticate success, global_id 204389 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: dump: 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.212 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb848001a10 con 0x7fb858134fc0 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:28.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 4 set_mon_vals no callback set 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 1 -- 172.21.15.171:0/3534900771 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb848003960 con 0x7fb858134fc0 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb855ffb640 10 monclient: dump: 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:28.214 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 10 monclient: shutdown 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- 172.21.15.171:0/3534900771 >> v1:172.21.15.106:6793/0 conn(0x7fb858134fc0 legacy=0x7fb85813cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- 172.21.15.171:0/3534900771 shutdown_connections 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- 172.21.15.171:0/3534900771 >> 172.21.15.171:0/3534900771 conn(0x7fb8580a3970 msgr2=0x7fb8580a3d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.218+0000 7fb85d33e640 1 -- 172.21.15.171:0/3534900771 shutdown_connections 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- 172.21.15.171:0/3534900771 wait complete. 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: build_initial_monmap 2024-04-26T00:01:28.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: monmap: 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:28.216 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 Processor -- start 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- start start 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: init 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _add_conns ranks=[5,6,7,8,0,2,4,3,1] 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient(hunting): picked mon.noname-h con 0x7fb8580a26b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient(hunting): picked mon.noname-d con 0x7fb858134be0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient(hunting): picked mon.noname-i con 0x7fb858134fc0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb858071780 con 0x7fb8580a26b0 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb858073010 con 0x7fb858134be0 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb858071e40 con 0x7fb858134fc0 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:28.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient(hunting): authenticate will time out at 1338.933390s 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb856ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb8580a26b0 0x7fb858133be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39378/0 (socket says 172.21.15.171:39378) 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb856ffd640 1 -- 172.21.15.171:0/1952580644 learned_addr learned my addr 172.21.15.171:0/1952580644 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481565994 0 0) 0x7fb858071e40 con 0x7fb858134fc0 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): my global_id is 145114 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb844003530 con 0x7fb858134fc0 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24988120 0 0) 0x7fb858071780 con 0x7fb8580a26b0 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): my global_id is 6620 2024-04-26T00:01:28.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb858071e40 con 0x7fb8580a26b0 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1337467998 0 0) 0x7fb844003530 con 0x7fb858134fc0 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb858071780 con 0x7fb858134fc0 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1461773106 0 0) 0x7fb858071e40 con 0x7fb8580a26b0 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb844003530 con 0x7fb8580a26b0 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb848001760 con 0x7fb858134fc0 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): dump: 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:28.219 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8500017d0 con 0x7fb8580a26b0 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:28.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): dump: 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:28.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846112502 0 0) 0x7fb858073010 con 0x7fb858134be0 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient(hunting): my global_id is 6765 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb858071e40 con 0x7fb858134be0 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 68815752 0 0) 0x7fb858071780 con 0x7fb858134fc0 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 >> v1:172.21.15.106:6792/0 conn(0x7fb858134be0 legacy=0x7fb8581d1350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 >> v1:172.21.15.171:6791/0 conn(0x7fb8580a26b0 legacy=0x7fb858133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 monclient: found mon.i 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:28.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb858071b90 con 0x7fb858134fc0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 5 monclient: authenticate success, global_id 145114 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _renew_subs 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8581342f0 con 0x7fb858134fc0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _renew_subs 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8581cc230 con 0x7fb858134fc0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb848001a10 con 0x7fb858134fc0 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:28.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb848003f10 con 0x7fb858134fc0 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb8557fa640 4 set_mon_vals no callback set 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 10 monclient: dump: 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:28.224 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb838005090 con 0x7fb858134fc0 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb84800ecb0 con 0x7fb858134fc0 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(207..207 src has 29..207) ==== 13079+0+0 (unknown 166498625 0 0) 0x7fb848045880 con 0x7fb858134fc0 2024-04-26T00:01:28.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.222+0000 7fb856ffd640 10 monclient: get_auth_request con 0x7fb844037ea0 auth_method 0 2024-04-26T00:01:28.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.230+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb8480146a0 con 0x7fb858134fc0 2024-04-26T00:01:28.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.230+0000 7fb83f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:28.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.230+0000 7fb83f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:28.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.390+0000 7fb85d33e640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:28.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.390+0000 7fb85d33e640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:28.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.390+0000 7fb85d33e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:28.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.390+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fb838005380 con 0x7fb858134fc0 2024-04-26T00:01:28.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.986+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}]=0 added bucket h28 type host to location {rack=r1} v208) ==== 168+0+0 (unknown 3634764746 0 0) 0x7fb848013fa0 con 0x7fb858134fc0 2024-04-26T00:01:28.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.986+0000 7fb83f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:28.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:28.986+0000 7fb83f7fe640 10 monclient: _finish_command 2 = system:0 added bucket h28 type host to location {rack=r1} 2024-04-26T00:01:29.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.094+0000 7fb85d33e640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:29.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.094+0000 7fb85d33e640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:29.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.094+0000 7fb85d33e640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:29.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.094+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fb838005be0 con 0x7fb858134fc0 2024-04-26T00:01:29.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.094+0000 7fb83f7fe640 1 -- 172.21.15.171:0/1952580644 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h28' already exists v208) ==== 147+0+0 (unknown 3235759097 0 0) 0x7fb848013960 con 0x7fb858134fc0 2024-04-26T00:01:29.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.094+0000 7fb83f7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h28", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:29.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.094+0000 7fb83f7fe640 10 monclient: _finish_command 3 = system:0 bucket 'h28' already exists 2024-04-26T00:01:29.079 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h28' already exists 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 >> v1:172.21.15.171:6812/722422047 conn(0x7fb844037ea0 legacy=0x7fb84403a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 10 monclient: shutdown 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 >> v1:172.21.15.171:6792/0 conn(0x7fb858134fc0 legacy=0x7fb8581d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 shutdown_connections 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 >> 172.21.15.171:0/1952580644 conn(0x7fb8580a3970 msgr2=0x7fb85809e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 shutdown_connections 2024-04-26T00:01:29.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.098+0000 7fb85d33e640 1 -- 172.21.15.171:0/1952580644 wait complete. 2024-04-26T00:01:29.095 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:29.096 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h29 host rack=r1 2024-04-26T00:01:29.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient: get_monmap_and_config 2024-04-26T00:01:29.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient: build_initial_monmap 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient: monmap: 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:29.232149+0000 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:29.232149+0000 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:29.210 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:29.211 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:29.211 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:29.211 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:29.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 1 Processor -- start 2024-04-26T00:01:29.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 1 -- start start 2024-04-26T00:01:29.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient: init 2024-04-26T00:01:29.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:29.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient: _add_conns ranks=[6,4,1,7,3,2,5,0,8] 2024-04-26T00:01:29.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient(hunting): picked mon.noname-d con 0x7f9f280a0000 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient(hunting): picked mon.noname-c con 0x7f9f281344d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient(hunting): picked mon.noname-f con 0x7f9f28134940 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2809e720 con 0x7f9f28134940 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2809f800 con 0x7f9f281344d0 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f2809f240 con 0x7f9f280a0000 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2f65f640 10 monclient(hunting): authenticate will time out at 1339.939860s 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.226+0000 7f9f2dbfc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9f28134940 0x7f9f2813c810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56918/0 (socket says 172.21.15.171:56918) 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2dbfc640 1 -- 172.21.15.171:0/3570328794 learned_addr learned my addr 172.21.15.171:0/3570328794 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963068689 0 0) 0x7f9f2809e720 con 0x7f9f28134940 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:29.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient(hunting): my global_id is 145153 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f14003530 con 0x7f9f28134940 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 991486804 0 0) 0x7f9f14003530 con 0x7f9f28134940 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 >> v1:172.21.15.106:6792/0 conn(0x7f9f280a0000 legacy=0x7f9f28133dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 >> v1:172.21.15.106:6791/0 conn(0x7f9f281344d0 legacy=0x7f9f281390e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 monclient: found mon.noname-f 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f2809f520 con 0x7f9f28134940 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: _finish_auth 0 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:29.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f20001b40 con 0x7f9f28134940 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 5 monclient: authenticate success, global_id 145153 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: dump: 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:29.216 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f20001e30 con 0x7f9f28134940 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 1 -- 172.21.15.171:0/3570328794 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f20004f70 con 0x7f9f28134940 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 4 set_mon_vals no callback set 2024-04-26T00:01:29.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1ffff640 10 monclient: dump: 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:29.218 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: shutdown 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3570328794 >> v1:172.21.15.171:6789/0 conn(0x7f9f28134940 legacy=0x7f9f2813c810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3570328794 shutdown_connections 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3570328794 >> 172.21.15.171:0/3570328794 conn(0x7f9f280a66c0 msgr2=0x7f9f280a6ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3570328794 shutdown_connections 2024-04-26T00:01:29.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3570328794 wait complete. 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: build_initial_monmap 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: monmap: 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:29.224 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 Processor -- start 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- start start 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: init 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: _add_conns ranks=[6,1,8,2,0,7,3,4,5] 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient(hunting): picked mon.noname-d con 0x7f9f280a0000 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient(hunting): picked mon.noname-f con 0x7f9f281344d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient(hunting): picked mon.noname-e con 0x7f9f28134940 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f28072d60 con 0x7f9f281344d0 2024-04-26T00:01:29.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f28072a10 con 0x7f9f280a0000 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f281307b0 con 0x7f9f28134940 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient(hunting): authenticate will time out at 1339.943013s 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2cbfa640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f9f281344d0 0x7f9f281300a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:56922/0 (socket says 172.21.15.171:56922) 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2cbfa640 1 -- 172.21.15.171:0/3099542961 learned_addr learned my addr 172.21.15.171:0/3099542961 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 974646223 0 0) 0x7f9f28072d60 con 0x7f9f281344d0 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): my global_id is 145162 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f0c003530 con 0x7f9f281344d0 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1437449249 0 0) 0x7f9f0c003530 con 0x7f9f281344d0 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f28072d60 con 0x7f9f281344d0 2024-04-26T00:01:29.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f18001ab0 con 0x7f9f281344d0 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): dump: 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:29.227 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721093480 0 0) 0x7f9f28072a10 con 0x7f9f280a0000 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): my global_id is 6783 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f0c003530 con 0x7f9f280a0000 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145083081 0 0) 0x7f9f281307b0 con 0x7f9f28134940 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:29.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient(hunting): my global_id is 204398 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f28072a10 con 0x7f9f28134940 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3788794455 0 0) 0x7f9f28072d60 con 0x7f9f281344d0 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 >> v1:172.21.15.106:6793/0 conn(0x7f9f28134940 legacy=0x7f9f281d4f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 >> v1:172.21.15.106:6792/0 conn(0x7f9f280a0000 legacy=0x7f9f2812f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 monclient: found mon.f 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f280a2400 con 0x7f9f281344d0 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:29.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 5 monclient: authenticate success, global_id 145162 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: _renew_subs 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f28071cb0 con 0x7f9f281344d0 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: _renew_subs 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.230+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f28099d30 con 0x7f9f281344d0 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f180039a0 con 0x7f9f281344d0 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f18003f10 con 0x7f9f281344d0 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1f7fe640 4 set_mon_vals no callback set 2024-04-26T00:01:29.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 10 monclient: dump: 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:29.231 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f2f65f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f2f65f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f2f65f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9f180040b0 con 0x7f9f281344d0 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f08005090 con 0x7f9f281344d0 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(208..208 src has 29..208) ==== 13292+0+0 (unknown 78355469 0 0) 0x7f9f18046a80 con 0x7f9f281344d0 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.234+0000 7f9f2d3fb640 10 monclient: get_auth_request con 0x7f9f0c037a30 auth_method 0 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.238+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9f18015850 con 0x7f9f281344d0 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.238+0000 7f9f1dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:29.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.238+0000 7f9f1dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:29.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.394+0000 7f9f2f65f640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:29.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.394+0000 7f9f2f65f640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:29.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.394+0000 7f9f2f65f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:29.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:29.394+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f9f08005380 con 0x7f9f281344d0 2024-04-26T00:01:30.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.018+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}]=0 added bucket h29 type host to location {rack=r1} v209) ==== 168+0+0 (unknown 2763300407 0 0) 0x7f9f18015150 con 0x7f9f281344d0 2024-04-26T00:01:30.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.018+0000 7f9f1dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:30.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.018+0000 7f9f1dffb640 10 monclient: _finish_command 2 = system:0 added bucket h29 type host to location {rack=r1} 2024-04-26T00:01:30.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.118+0000 7f9f2f65f640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:30.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.118+0000 7f9f2f65f640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:30.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.118+0000 7f9f2f65f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:30.101 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.118+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f9f08005ac0 con 0x7f9f281344d0 2024-04-26T00:01:30.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.118+0000 7f9f1dffb640 1 -- 172.21.15.171:0/3099542961 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h29' already exists v209) ==== 147+0+0 (unknown 3412843028 0 0) 0x7f9f1801dca0 con 0x7f9f281344d0 2024-04-26T00:01:30.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.118+0000 7f9f1dffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h29", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:30.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.118+0000 7f9f1dffb640 10 monclient: _finish_command 3 = system:0 bucket 'h29' already exists 2024-04-26T00:01:30.102 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h29' already exists 2024-04-26T00:01:30.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 >> v1:172.21.15.171:6812/722422047 conn(0x7f9f0c037a30 legacy=0x7f9f0c039ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:30.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 10 monclient: shutdown 2024-04-26T00:01:30.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:30.104 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 >> v1:172.21.15.171:6789/0 conn(0x7f9f281344d0 legacy=0x7f9f281300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:30.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 shutdown_connections 2024-04-26T00:01:30.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 >> 172.21.15.171:0/3099542961 conn(0x7f9f280a66c0 msgr2=0x7f9f280a5be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:30.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 shutdown_connections 2024-04-26T00:01:30.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.122+0000 7f9f2f65f640 1 -- 172.21.15.171:0/3099542961 wait complete. 2024-04-26T00:01:30.119 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:30.119 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h30 host rack=r1 2024-04-26T00:01:30.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient: get_monmap_and_config 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient: build_initial_monmap 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient: monmap: 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:30.259152+0000 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:30.259152+0000 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:30.237 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:30.238 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:30.238 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:30.238 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:30.238 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:30.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 1 Processor -- start 2024-04-26T00:01:30.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 1 -- start start 2024-04-26T00:01:30.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient: init 2024-04-26T00:01:30.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:30.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient: _add_conns ranks=[0,5,7,1,3,8,6,2,4] 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient(hunting): picked mon.noname-a con 0x7fe87c06bae0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient(hunting): picked mon.noname-h con 0x7fe87c070f20 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient(hunting): picked mon.noname-i con 0x7fe87c0a1b70 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0723d0 con 0x7fe87c06bae0 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0a0000 con 0x7fe87c070f20 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0726b0 con 0x7fe87c0a1b70 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient(hunting): authenticate will time out at 1340.966874s 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe880850640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fe87c0a1b70 0x7fe87c13dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:35504/0 (socket says 172.21.15.171:35504) 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe880850640 1 -- 172.21.15.171:0/3195803077 learned_addr learned my addr 172.21.15.171:0/3195803077 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972459237 0 0) 0x7fe87c0726b0 con 0x7fe87c0a1b70 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:30.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): my global_id is 145123 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe868003530 con 0x7fe87c0a1b70 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3429535159 0 0) 0x7fe87c0a0000 con 0x7fe87c070f20 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient(hunting): my global_id is 6629 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe87c0726b0 con 0x7fe87c070f20 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4055853498 0 0) 0x7fe87c0726b0 con 0x7fe87c070f20 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 >> v1:172.21.15.171:6792/0 conn(0x7fe87c0a1b70 legacy=0x7fe87c13dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 >> v1:172.21.15.106:6789/0 conn(0x7fe87c06bae0 legacy=0x7fe87c0a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:30.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 monclient: found mon.noname-h 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c09f940 con 0x7fe87c070f20 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe864001740 con 0x7fe87c070f20 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 5 monclient: authenticate success, global_id 6629 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: dump: 2024-04-26T00:01:30.249 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:30.250 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8640019a0 con 0x7fe87c070f20 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 1 -- 172.21.15.171:0/3195803077 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe864003960 con 0x7fe87c070f20 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe87b7fe640 10 monclient: dump: 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:30.251 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.254+0000 7fe8822b3640 4 set_mon_vals no callback set 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: shutdown 2024-04-26T00:01:30.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- 172.21.15.171:0/3195803077 >> v1:172.21.15.171:6791/0 conn(0x7fe87c070f20 legacy=0x7fe87c13a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- 172.21.15.171:0/3195803077 shutdown_connections 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- 172.21.15.171:0/3195803077 >> 172.21.15.171:0/3195803077 conn(0x7fe87c0a5140 msgr2=0x7fe87c06b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- 172.21.15.171:0/3195803077 shutdown_connections 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- 172.21.15.171:0/3195803077 wait complete. 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: build_initial_monmap 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: monmap: 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:30.253 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 Processor -- start 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- start start 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: init 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:30.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: _add_conns ranks=[5,7,4,1,0,2,8,6,3] 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient(hunting): picked mon.noname-h con 0x7fe87c06bae0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient(hunting): picked mon.noname-i con 0x7fe87c070f20 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient(hunting): picked mon.noname-c con 0x7fe87c0a1b70 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c122ab0 con 0x7fe87c0a1b70 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c1222c0 con 0x7fe87c06bae0 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87c0a2080 con 0x7fe87c070f20 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe873fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fe87c070f20 0x7fe87c1cf340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:35520/0 (socket says 172.21.15.171:35520) 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe87bfff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe87c06bae0 0x7fe87c135970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:39398/0 (socket says 172.21.15.171:39398) 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe873fff640 1 -- 172.21.15.171:0/1339215917 learned_addr learned my addr 172.21.15.171:0/1339215917 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient(hunting): authenticate will time out at 1340.970343s 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1247685215 0 0) 0x7fe87c1222c0 con 0x7fe87c06bae0 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:30.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): my global_id is 6638 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe85c003530 con 0x7fe87c06bae0 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573436019 0 0) 0x7fe87c0a2080 con 0x7fe87c070f20 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): my global_id is 145132 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe87c1222c0 con 0x7fe87c070f20 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1921272596 0 0) 0x7fe85c003530 con 0x7fe87c06bae0 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe87c0a2080 con 0x7fe87c06bae0 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe86c0019c0 con 0x7fe87c06bae0 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:30.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): dump: 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:30.257 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 524009884 0 0) 0x7fe87c1222c0 con 0x7fe87c070f20 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe85c003530 con 0x7fe87c070f20 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe864001300 con 0x7fe87c070f20 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): dump: 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:30.258 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 220912877 0 0) 0x7fe874001dc0 con 0x7fe87c0a1b70 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:30.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient(hunting): my global_id is 145255 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe87c1222c0 con 0x7fe87c0a1b70 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2793221285 0 0) 0x7fe87c0a2080 con 0x7fe87c06bae0 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 >> v1:172.21.15.171:6792/0 conn(0x7fe87c070f20 legacy=0x7fe87c1cf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 >> v1:172.21.15.106:6791/0 conn(0x7fe87c0a1b70 legacy=0x7fe87c1d2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 monclient: found mon.h 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe87c0a1230 con 0x7fe87c06bae0 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:30.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 5 monclient: authenticate success, global_id 6638 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: _renew_subs 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe87c121060 con 0x7fe87c06bae0 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: _renew_subs 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe87c1ca250 con 0x7fe87c06bae0 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe86c001d30 con 0x7fe87c06bae0 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe86c003c90 con 0x7fe87c06bae0 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe87affd640 4 set_mon_vals no callback set 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.258+0000 7fe8797fa640 10 monclient: dump: 2024-04-26T00:01:30.261 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:30.262 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:30.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.262+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe86c003e30 con 0x7fe87c06bae0 2024-04-26T00:01:30.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.262+0000 7fe8822b3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:30.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.262+0000 7fe8822b3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:30.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.262+0000 7fe8822b3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:30.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.262+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe860005090 con 0x7fe87c06bae0 2024-04-26T00:01:30.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.262+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(209..209 src has 29..209) ==== 13505+0+0 (unknown 3024591675 0 0) 0x7fe86c046a10 con 0x7fe87c06bae0 2024-04-26T00:01:30.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.262+0000 7fe873fff640 10 monclient: get_auth_request con 0x7fe85c037f30 auth_method 0 2024-04-26T00:01:30.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.266+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe87c0723d0 con 0x7fe87c06bae0 2024-04-26T00:01:30.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.266+0000 7fe8797fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:30.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.266+0000 7fe8797fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:30.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.426+0000 7fe8822b3640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:30.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.426+0000 7fe8822b3640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:30.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.426+0000 7fe8822b3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:30.412 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:30.426+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fe860005380 con 0x7fe87c06bae0 2024-04-26T00:01:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.018+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}]=0 added bucket h30 type host to location {rack=r1} v210) ==== 168+0+0 (unknown 2638623544 0 0) 0x7fe86c0156d0 con 0x7fe87c06bae0 2024-04-26T00:01:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.018+0000 7fe8797fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.018+0000 7fe8797fa640 10 monclient: _finish_command 2 = system:0 added bucket h30 type host to location {rack=r1} 2024-04-26T00:01:31.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.122+0000 7fe8822b3640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.122+0000 7fe8822b3640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.122+0000 7fe8822b3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:31.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.122+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fe860005ac0 con 0x7fe87c06bae0 2024-04-26T00:01:31.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.126+0000 7fe8797fa640 1 -- 172.21.15.171:0/1339215917 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h30' already exists v210) ==== 147+0+0 (unknown 2185424156 0 0) 0x7fe86c014990 con 0x7fe87c06bae0 2024-04-26T00:01:31.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.126+0000 7fe8797fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h30", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.126+0000 7fe8797fa640 10 monclient: _finish_command 3 = system:0 bucket 'h30' already exists 2024-04-26T00:01:31.109 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h30' already exists 2024-04-26T00:01:31.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 >> v1:172.21.15.171:6812/722422047 conn(0x7fe85c037f30 legacy=0x7fe85c03a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 10 monclient: shutdown 2024-04-26T00:01:31.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:31.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 >> v1:172.21.15.171:6791/0 conn(0x7fe87c06bae0 legacy=0x7fe87c135970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 shutdown_connections 2024-04-26T00:01:31.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 >> 172.21.15.171:0/1339215917 conn(0x7fe87c0a5140 msgr2=0x7fe87c0a26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:31.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 shutdown_connections 2024-04-26T00:01:31.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.130+0000 7fe8822b3640 1 -- 172.21.15.171:0/1339215917 wait complete. 2024-04-26T00:01:31.127 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:31.127 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h31 host rack=r1 2024-04-26T00:01:31.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient: get_monmap_and_config 2024-04-26T00:01:31.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient: build_initial_monmap 2024-04-26T00:01:31.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient: monmap: 2024-04-26T00:01:31.241 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:31.241 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.241 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:31.263856+0000 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:31.263856+0000 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:31.242 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 1 Processor -- start 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 1 -- start start 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient: init 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient: _add_conns ranks=[2,8,4,3,1,6,0,7,5] 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient(hunting): picked mon.noname-b con 0x7fbb0806bae0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient(hunting): picked mon.noname-e con 0x7fbb08070f20 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient(hunting): picked mon.noname-c con 0x7fbb080a1b70 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb080723d0 con 0x7fbb0806bae0 2024-04-26T00:01:31.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb080a0000 con 0x7fbb080a1b70 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb080726b0 con 0x7fbb08070f20 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.258+0000 7fbb0d4ca640 10 monclient(hunting): authenticate will time out at 1341.971605s 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb077fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fbb080a1b70 0x7fbb0813dfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:56400/0 (socket says 172.21.15.171:56400) 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb077fe640 1 -- 172.21.15.171:0/3628446552 learned_addr learned my addr 172.21.15.171:0/3628446552 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbafffff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fbb08070f20 0x7fbb0813a8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.171:33436/0 (socket says 172.21.15.171:33436) 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4253995847 0 0) 0x7fbb080a0000 con 0x7fbb080a1b70 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:31.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): my global_id is 145264 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf4003530 con 0x7fbb080a1b70 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2433307451 0 0) 0x7fbaf8001050 con 0x7fbb0806bae0 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): my global_id is 6716 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb080a0000 con 0x7fbb0806bae0 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812142834 0 0) 0x7fbb080726b0 con 0x7fbb08070f20 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient(hunting): my global_id is 204407 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaf8001050 con 0x7fbb08070f20 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3156719931 0 0) 0x7fbaf8001050 con 0x7fbb08070f20 2024-04-26T00:01:31.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 >> v1:172.21.15.106:6791/0 conn(0x7fbb080a1b70 legacy=0x7fbb0813dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 >> v1:172.21.15.106:6790/0 conn(0x7fbb0806bae0 legacy=0x7fbb080a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 monclient: found mon.noname-e 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb0809f940 con 0x7fbb08070f20 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:31.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:31.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbaf0001760 con 0x7fbb08070f20 2024-04-26T00:01:31.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 5 monclient: authenticate success, global_id 204407 2024-04-26T00:01:31.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:31.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:31.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:31.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: dump: 2024-04-26T00:01:31.250 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.251 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbaf00019c0 con 0x7fbb08070f20 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:31.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 4 set_mon_vals no callback set 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 1 -- 172.21.15.171:0/3628446552 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbaf0004b30 con 0x7fbb08070f20 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb067fc640 10 monclient: dump: 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.253 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.254 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 10 monclient: shutdown 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/3628446552 >> v1:172.21.15.106:6793/0 conn(0x7fbb08070f20 legacy=0x7fbb0813a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/3628446552 shutdown_connections 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/3628446552 >> 172.21.15.171:0/3628446552 conn(0x7fbb080a5140 msgr2=0x7fbb0806b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/3628446552 shutdown_connections 2024-04-26T00:01:31.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/3628446552 wait complete. 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 10 monclient: build_initial_monmap 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 10 monclient: monmap: 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:31.261 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 1 Processor -- start 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 1 -- start start 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.262+0000 7fbb0d4ca640 10 monclient: init 2024-04-26T00:01:31.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _add_conns ranks=[7,2,6,8,1,5,0,4,3] 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient(hunting): picked mon.noname-i con 0x7fbb0806bae0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient(hunting): picked mon.noname-b con 0x7fbb08070f20 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient(hunting): picked mon.noname-d con 0x7fbb080a1b70 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb081224f0 con 0x7fbb08070f20 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb080a1230 con 0x7fbb080a1b70 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb080a2080 con 0x7fbb0806bae0 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient(hunting): authenticate will time out at 1341.976226s 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb06ffd640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fbb0806bae0 0x7fbb081caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51338/0 (socket says 172.21.15.171:51338) 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb06ffd640 1 -- 172.21.15.171:0/4180237570 learned_addr learned my addr 172.21.15.171:0/4180237570 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680891544 0 0) 0x7fbb080a2080 con 0x7fbb0806bae0 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:31.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): my global_id is 145141 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae8003530 con 0x7fbb0806bae0 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2249548106 0 0) 0x7fbae8003530 con 0x7fbb0806bae0 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb080a2080 con 0x7fbb0806bae0 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbaf8001a80 con 0x7fbb0806bae0 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): dump: 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.264 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3021439009 0 0) 0x7fbb080a1230 con 0x7fbb080a1b70 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:31.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient(hunting): my global_id is 6792 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbae8003530 con 0x7fbb080a1b70 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3861533122 0 0) 0x7fbb080a2080 con 0x7fbb0806bae0 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 >> v1:172.21.15.106:6792/0 conn(0x7fbb080a1b70 legacy=0x7fbb081d2d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 >> v1:172.21.15.106:6790/0 conn(0x7fbb08070f20 legacy=0x7fbb081cf640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 monclient: found mon.i 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb081239a0 con 0x7fbb0806bae0 2024-04-26T00:01:31.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 5 monclient: authenticate success, global_id 145141 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _renew_subs 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb08123c80 con 0x7fbb0806bae0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _renew_subs 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb081246b0 con 0x7fbb0806bae0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbaf8003950 con 0x7fbb0806bae0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbaf8003ec0 con 0x7fbb0806bae0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb05ffb640 4 set_mon_vals no callback set 2024-04-26T00:01:31.267 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 10 monclient: dump: 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.268 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbaf80040e0 con 0x7fbb0806bae0 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaec005090 con 0x7fbb0806bae0 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(210..210 src has 29..210) ==== 13718+0+0 (unknown 2028551603 0 0) 0x7fbaf8046de0 con 0x7fbb0806bae0 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.266+0000 7fbafffff640 10 monclient: get_auth_request con 0x7fbae8037890 auth_method 0 2024-04-26T00:01:31.269 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.270+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbb080723d0 con 0x7fbb0806bae0 2024-04-26T00:01:31.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.270+0000 7fbaff7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:31.270 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.270+0000 7fbaff7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:31.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.426+0000 7fbb0d4ca640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.426+0000 7fbb0d4ca640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.409 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.426+0000 7fbb0d4ca640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:31.410 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.426+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fbaec005380 con 0x7fbb0806bae0 2024-04-26T00:01:31.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.558+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}]=0 added bucket h31 type host to location {rack=r1} v211) ==== 168+0+0 (unknown 3780425413 0 0) 0x7fbaf8015880 con 0x7fbb0806bae0 2024-04-26T00:01:31.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.558+0000 7fbaff7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.543 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.558+0000 7fbaff7fe640 10 monclient: _finish_command 2 = system:0 added bucket h31 type host to location {rack=r1} 2024-04-26T00:01:31.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.662+0000 7fbb0d4ca640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.662+0000 7fbb0d4ca640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.662+0000 7fbb0d4ca640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:31.646 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.662+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7fbaec005ac0 con 0x7fbb0806bae0 2024-04-26T00:01:31.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.662+0000 7fbaff7fe640 1 -- 172.21.15.171:0/4180237570 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h31' already exists v211) ==== 147+0+0 (unknown 2314532081 0 0) 0x7fbaf8019530 con 0x7fbb0806bae0 2024-04-26T00:01:31.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.662+0000 7fbaff7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h31", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.662+0000 7fbaff7fe640 10 monclient: _finish_command 3 = system:0 bucket 'h31' already exists 2024-04-26T00:01:31.648 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h31' already exists 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 >> v1:172.21.15.171:6812/722422047 conn(0x7fbae8037890 legacy=0x7fbae8039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 10 monclient: shutdown 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 >> v1:172.21.15.171:6792/0 conn(0x7fbb0806bae0 legacy=0x7fbb081caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 shutdown_connections 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 >> 172.21.15.171:0/4180237570 conn(0x7fbb080a5140 msgr2=0x7fbb080a6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 shutdown_connections 2024-04-26T00:01:31.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.666+0000 7fbb0d4ca640 1 -- 172.21.15.171:0/4180237570 wait complete. 2024-04-26T00:01:31.663 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:31.663 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush add-bucket h32 host rack=r1 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.790+0000 7f46fe58e640 10 monclient: get_monmap_and_config 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.790+0000 7f46fe58e640 10 monclient: build_initial_monmap 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.790+0000 7f46fe58e640 10 monclient: monmap: 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:31.798420+0000 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:31.798420+0000 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.776 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:31.777 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 Processor -- start 2024-04-26T00:01:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- start start 2024-04-26T00:01:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: init 2024-04-26T00:01:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: _add_conns ranks=[7,3,6,2,5,0,1,8,4] 2024-04-26T00:01:31.783 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): picked mon.noname-i con 0x7f46f806e480 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): picked mon.noname-g con 0x7f46f806ef70 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): picked mon.noname-d con 0x7f46f813aab0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f8070c60 con 0x7f46f806ef70 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f8070f40 con 0x7f46f813aab0 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f806f980 con 0x7f46f806e480 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): authenticate will time out at 1342.505223s 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f77fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f46f806ef70 legacy=0x7f46f8139390 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f7fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f46f806e480 0x7f46f806e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51350/0 (socket says 172.21.15.171:51350) 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f7fff640 1 -- 172.21.15.171:0/1095390743 learned_addr learned my addr 172.21.15.171:0/1095390743 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3456091229 0 0) 0x7f46f806f980 con 0x7f46f806e480 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:31.784 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient(hunting): my global_id is 145150 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e0003530 con 0x7f46f806e480 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2420326571 0 0) 0x7f46e0003530 con 0x7f46f806e480 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 >> v1:172.21.15.106:6792/0 conn(0x7f46f813aab0 legacy=0x7f46f813cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 >> v1:172.21.15.171:6790/0 conn(0x7f46f806ef70 legacy=0x7f46f8139390 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 monclient: found mon.noname-i 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f8072e40 con 0x7f46f806e480 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:31.785 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46e8001800 con 0x7f46f806e480 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: dump: 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.786 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 5 monclient: authenticate success, global_id 145150 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46e8001b10 con 0x7f46f806e480 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 1 -- 172.21.15.171:0/1095390743 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46e8004bf0 con 0x7f46f806e480 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 4 set_mon_vals no callback set 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:31.787 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46f6ffd640 10 monclient: dump: 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.788 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: shutdown 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- 172.21.15.171:0/1095390743 >> v1:172.21.15.171:6792/0 conn(0x7f46f806e480 legacy=0x7f46f806e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- 172.21.15.171:0/1095390743 shutdown_connections 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- 172.21.15.171:0/1095390743 >> 172.21.15.171:0/1095390743 conn(0x7f46f80a2690 msgr2=0x7f46f80a2aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- 172.21.15.171:0/1095390743 shutdown_connections 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- 172.21.15.171:0/1095390743 wait complete. 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: build_initial_monmap 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: monmap: 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:31.789 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 Processor -- start 2024-04-26T00:01:31.790 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- start start 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: init 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient: _add_conns ranks=[5,4,6,2,7,3,0,1,8] 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): picked mon.noname-h con 0x7f46f806e480 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): picked mon.noname-c con 0x7f46f806ef70 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): picked mon.noname-d con 0x7f46f813aab0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f80702c0 con 0x7f46f806ef70 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f80a53b0 con 0x7f46f806e480 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46f8122a50 con 0x7f46f813aab0 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.794+0000 7f46fe58e640 10 monclient(hunting): authenticate will time out at 1342.507936s 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f7fff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f46f806e480 0x7f46f81c8e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:54008/0 (socket says 172.21.15.171:54008) 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f7fff640 1 -- 172.21.15.171:0/58316790 learned_addr learned my addr 172.21.15.171:0/58316790 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203901034 0 0) 0x7f46f80a53b0 con 0x7f46f806e480 2024-04-26T00:01:31.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): my global_id is 6647 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46e4003530 con 0x7f46f806e480 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1326432816 0 0) 0x7f46e4003530 con 0x7f46f806e480 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46f80a53b0 con 0x7f46f806e480 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46e80017c0 con 0x7f46f806e480 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): dump: 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.792 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2211178353 0 0) 0x7f46f80a53b0 con 0x7f46f806e480 2024-04-26T00:01:31.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 >> v1:172.21.15.106:6792/0 conn(0x7f46f813aab0 legacy=0x7f46f81d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 >> v1:172.21.15.106:6791/0 conn(0x7f46f806ef70 legacy=0x7f46f8134920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 monclient: found mon.h 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46f81c9c70 con 0x7f46f806e480 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: _finish_auth 0 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 5 monclient: authenticate success, global_id 6647 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 10 monclient: _renew_subs 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:31.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46f8135030 con 0x7f46f806e480 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 10 monclient: _renew_subs 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f46f80a4af0 con 0x7f46f806e480 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f46e8001ab0 con 0x7f46f806e480 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46e8005110 con 0x7f46f806e480 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f67fc640 4 set_mon_vals no callback set 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 10 monclient: dump: 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.795 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:31.796 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f46e800feb0 con 0x7f46f806e480 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46d8005090 con 0x7f46f806e480 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(211..211 src has 29..211) ==== 13931+0+0 (unknown 250220107 0 0) 0x7f46e8046dd0 con 0x7f46f806e480 2024-04-26T00:01:31.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.798+0000 7f46f77fe640 10 monclient: get_auth_request con 0x7f46e4037780 auth_method 0 2024-04-26T00:01:31.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.802+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f46e8015970 con 0x7f46f806e480 2024-04-26T00:01:31.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.802+0000 7f46f4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:31.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.802+0000 7f46f4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:31.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.958+0000 7f46fe58e640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.958+0000 7f46fe58e640 10 monclient: _send_command 2 [{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:31.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.958+0000 7f46fe58e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:31.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:31.958+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f46d8005380 con 0x7f46f806e480 2024-04-26T00:01:32.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.594+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}]=0 added bucket h32 type host to location {rack=r1} v212) ==== 168+0+0 (unknown 14958377 0 0) 0x7f46e8040900 con 0x7f46f806e480 2024-04-26T00:01:32.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.594+0000 7f46f4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:32.577 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.594+0000 7f46f4ff9640 10 monclient: _finish_command 2 = system:0 added bucket h32 type host to location {rack=r1} 2024-04-26T00:01:32.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.694+0000 7f46fe58e640 10 start_mon_command cmd=[{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:32.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.694+0000 7f46fe58e640 10 monclient: _send_command 3 [{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:32.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.694+0000 7f46fe58e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:32.677 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.694+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]} v 0) -- 0x7f46d8005ac0 con 0x7f46f806e480 2024-04-26T00:01:32.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.694+0000 7f46f4ff9640 1 -- 172.21.15.171:0/58316790 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}]=0 bucket 'h32' already exists v212) ==== 147+0+0 (unknown 3347632404 0 0) 0x7f46e8015270 con 0x7f46f806e480 2024-04-26T00:01:32.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.694+0000 7f46f4ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush add-bucket", "name": "h32", "type": "host", "args": ["rack=r1"]}] 2024-04-26T00:01:32.679 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.694+0000 7f46f4ff9640 10 monclient: _finish_command 3 = system:0 bucket 'h32' already exists 2024-04-26T00:01:32.680 INFO:tasks.workunit.client.0.smithi171.stderr:bucket 'h32' already exists 2024-04-26T00:01:32.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 >> v1:172.21.15.171:6812/722422047 conn(0x7f46e4037780 legacy=0x7f46e4039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:32.681 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 10 monclient: shutdown 2024-04-26T00:01:32.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:32.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 >> v1:172.21.15.171:6791/0 conn(0x7f46f806e480 legacy=0x7f46f81c8e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:32.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 shutdown_connections 2024-04-26T00:01:32.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 >> 172.21.15.171:0/58316790 conn(0x7f46f80a2690 msgr2=0x7f46f80a1500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:32.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 shutdown_connections 2024-04-26T00:01:32.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.698+0000 7f46fe58e640 1 -- 172.21.15.171:0/58316790 wait complete. 2024-04-26T00:01:32.696 INFO:tasks.workunit.client.0.smithi171.stderr:++ seq 1 32 2024-04-26T00:01:32.697 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:32.697 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h1 2024-04-26T00:01:32.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient: get_monmap_and_config 2024-04-26T00:01:32.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient: build_initial_monmap 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient: monmap: 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:32.835965+0000 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:32.835965+0000 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:32.814 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:32.815 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:32.815 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:32.815 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:32.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 1 Processor -- start 2024-04-26T00:01:32.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 1 -- start start 2024-04-26T00:01:32.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient: init 2024-04-26T00:01:32.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:32.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient: _add_conns ranks=[8,2,7,3,5,1,4,6,0] 2024-04-26T00:01:32.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient(hunting): picked mon.noname-e con 0x7f3424135bb0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient(hunting): picked mon.noname-b con 0x7f34241356f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient(hunting): picked mon.noname-i con 0x7f342413c130 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34240a1da0 con 0x7f34241356f0 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34240a1fe0 con 0x7f342413c130 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3424072720 con 0x7f3424135bb0 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient(hunting): authenticate will time out at 1343.542986s 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3423fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f342413c130 0x7f342413e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51362/0 (socket says 172.21.15.171:51362) 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3423fff640 1 -- 172.21.15.171:0/3222089378 learned_addr learned my addr 172.21.15.171:0/3222089378 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:32.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981588622 0 0) 0x7f34240a1fe0 con 0x7f342413c130 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient(hunting): my global_id is 145159 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3410003530 con 0x7f342413c130 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3533264190 0 0) 0x7f3410003530 con 0x7f342413c130 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 >> v1:172.21.15.106:6793/0 conn(0x7f3424135bb0 legacy=0x7f3424135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 >> v1:172.21.15.106:6790/0 conn(0x7f34241356f0 legacy=0x7f342413aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:32.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 monclient: found mon.noname-i 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34240a17f0 con 0x7f342413c130 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f341c001b40 con 0x7f342413c130 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: dump: 2024-04-26T00:01:32.826 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:32.827 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 5 monclient: authenticate success, global_id 145159 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f341c001ea0 con 0x7f342413c130 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:32.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3429e47640 4 set_mon_vals no callback set 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 1 -- 172.21.15.171:0/3222089378 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f341c0020d0 con 0x7f342413c130 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.830+0000 7f3422ffd640 10 monclient: dump: 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:32.829 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: shutdown 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- 172.21.15.171:0/3222089378 >> v1:172.21.15.171:6792/0 conn(0x7f342413c130 legacy=0x7f342413e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- 172.21.15.171:0/3222089378 shutdown_connections 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- 172.21.15.171:0/3222089378 >> 172.21.15.171:0/3222089378 conn(0x7f34240a2620 msgr2=0x7f34240a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- 172.21.15.171:0/3222089378 shutdown_connections 2024-04-26T00:01:32.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- 172.21.15.171:0/3222089378 wait complete. 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: build_initial_monmap 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: monmap: 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:32.831 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 Processor -- start 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- start start 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: init 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: _add_conns ranks=[2,8,1,5,3,6,7,0,4] 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient(hunting): picked mon.noname-b con 0x7f34241356f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient(hunting): picked mon.noname-e con 0x7f3424135bb0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient(hunting): picked mon.noname-f con 0x7f342413c130 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34241360a0 con 0x7f342413c130 2024-04-26T00:01:32.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3424136380 con 0x7f34241356f0 2024-04-26T00:01:32.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342406fd30 con 0x7f3424135bb0 2024-04-26T00:01:32.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:32.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient(hunting): authenticate will time out at 1343.546626s 2024-04-26T00:01:32.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3423fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f342413c130 0x7f34241d4ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47978/0 (socket says 172.21.15.171:47978) 2024-04-26T00:01:32.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3423fff640 1 -- 172.21.15.171:0/2476936279 learned_addr learned my addr 172.21.15.171:0/2476936279 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:32.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1071257397 0 0) 0x7f34241360a0 con 0x7f342413c130 2024-04-26T00:01:32.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:32.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:32.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:32.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): my global_id is 145171 2024-04-26T00:01:32.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3404003530 con 0x7f342413c130 2024-04-26T00:01:32.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2007073474 0 0) 0x7f3404003530 con 0x7f342413c130 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34241360a0 con 0x7f342413c130 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 35274275 0 0) 0x7f342406fd30 con 0x7f3424135bb0 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): my global_id is 204425 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3404003530 con 0x7f3424135bb0 2024-04-26T00:01:32.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f341c001b00 con 0x7f342413c130 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): dump: 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:32.836 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861507894 0 0) 0x7f3424136380 con 0x7f34241356f0 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient(hunting): my global_id is 6743 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342406fd30 con 0x7f34241356f0 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2466103197 0 0) 0x7f34241360a0 con 0x7f342413c130 2024-04-26T00:01:32.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 >> v1:172.21.15.106:6793/0 conn(0x7f3424135bb0 legacy=0x7f3424132530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 >> v1:172.21.15.106:6790/0 conn(0x7f34241356f0 legacy=0x7f3424131e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 monclient: found mon.f 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3424070160 con 0x7f342413c130 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: _finish_auth 0 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:32.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 5 monclient: authenticate success, global_id 145171 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: _renew_subs 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f342413bce0 con 0x7f342413c130 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: _renew_subs 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3424132e10 con 0x7f342413c130 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f341c001ea0 con 0x7f342413c130 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f341c0020d0 con 0x7f342413c130 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f34227fc640 4 set_mon_vals no callback set 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.834+0000 7f3420ff9640 10 monclient: dump: 2024-04-26T00:01:32.839 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:32.840 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.838+0000 7f3429e47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.838+0000 7f3429e47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.838+0000 7f3429e47640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.838+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3408005090 con 0x7f342413c130 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.838+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f341c010230 con 0x7f342413c130 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.838+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(212..212 src has 29..212) ==== 14144+0+0 (unknown 3537707610 0 0) 0x7f341c0472d0 con 0x7f342413c130 2024-04-26T00:01:32.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.838+0000 7f34237fe640 10 monclient: get_auth_request con 0x7f34040379a0 auth_method 0 2024-04-26T00:01:32.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.842+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f341c015d20 con 0x7f342413c130 2024-04-26T00:01:32.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.842+0000 7f3420ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:32.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:32.842+0000 7f3420ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:32.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.006+0000 7f3429e47640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h1"}] 2024-04-26T00:01:32.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.006+0000 7f3429e47640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h1"}] 2024-04-26T00:01:32.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.006+0000 7f3429e47640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:32.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.006+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h1"} v 0) -- 0x7f3408005380 con 0x7f342413c130 2024-04-26T00:01:33.583 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.598+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h1"}]=0 removed item id -19 name 'h1' from crush map v213) ==== 118+0+0 (unknown 711994448 0 0) 0x7f341c015620 con 0x7f342413c130 2024-04-26T00:01:33.583 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.598+0000 7f3420ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h1"}] 2024-04-26T00:01:33.583 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.598+0000 7f3420ff9640 10 monclient: _finish_command 2 = system:0 removed item id -19 name 'h1' from crush map 2024-04-26T00:01:33.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.702+0000 7f3429e47640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h1"}] 2024-04-26T00:01:33.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.702+0000 7f3429e47640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h1"}] 2024-04-26T00:01:33.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.702+0000 7f3429e47640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:33.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.702+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h1"} v 0) -- 0x7f3408002220 con 0x7f342413c130 2024-04-26T00:01:33.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.702+0000 7f3420ff9640 1 -- 172.21.15.171:0/2476936279 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h1"}]=0 device 'h1' does not appear in the crush map v213) ==== 118+0+0 (unknown 381910933 0 0) 0x7f341c013980 con 0x7f342413c130 2024-04-26T00:01:33.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.702+0000 7f3420ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h1"}] 2024-04-26T00:01:33.688 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.702+0000 7f3420ff9640 10 monclient: _finish_command 3 = system:0 device 'h1' does not appear in the crush map 2024-04-26T00:01:33.688 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h1' does not appear in the crush map 2024-04-26T00:01:33.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 >> v1:172.21.15.171:6812/722422047 conn(0x7f34040379a0 legacy=0x7f3404039e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:33.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 10 monclient: shutdown 2024-04-26T00:01:33.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:33.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 >> v1:172.21.15.171:6789/0 conn(0x7f342413c130 legacy=0x7f34241d4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:33.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 shutdown_connections 2024-04-26T00:01:33.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 >> 172.21.15.171:0/2476936279 conn(0x7f34240a2620 msgr2=0x7f3424134480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:33.690 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 shutdown_connections 2024-04-26T00:01:33.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.706+0000 7f3429e47640 1 -- 172.21.15.171:0/2476936279 wait complete. 2024-04-26T00:01:33.705 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:33.705 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h2 2024-04-26T00:01:33.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.838+0000 7fe2c33d4640 10 monclient: get_monmap_and_config 2024-04-26T00:01:33.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.838+0000 7fe2c33d4640 10 monclient: build_initial_monmap 2024-04-26T00:01:33.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.838+0000 7fe2c33d4640 10 monclient: monmap: 2024-04-26T00:01:33.823 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:33.845306+0000 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:33.845306+0000 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:33.824 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:33.825 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:33.825 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 Processor -- start 2024-04-26T00:01:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- start start 2024-04-26T00:01:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient: init 2024-04-26T00:01:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient: _add_conns ranks=[8,4,1,3,7,2,6,0,5] 2024-04-26T00:01:33.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient(hunting): picked mon.noname-e con 0x7fe2bc06fe00 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient(hunting): picked mon.noname-c con 0x7fe2bc06f600 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient(hunting): picked mon.noname-f con 0x7fe2bc0701e0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc06fa00 con 0x7fe2bc0701e0 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc135400 con 0x7fe2bc06f600 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc071670 con 0x7fe2bc06fe00 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient(hunting): authenticate will time out at 1344.553313s 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c1971640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe2bc0701e0 0x7fe2bc13d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47980/0 (socket says 172.21.15.171:47980) 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c1971640 1 -- 172.21.15.171:0/3437869464 learned_addr learned my addr 172.21.15.171:0/3437869464 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4148413770 0 0) 0x7fe2bc06fa00 con 0x7fe2bc0701e0 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:33.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): my global_id is 145180 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2a8003530 con 0x7fe2bc0701e0 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2466135556 0 0) 0x7fe2bc071670 con 0x7fe2bc06fe00 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient(hunting): my global_id is 204434 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2bc06fa00 con 0x7fe2bc06fe00 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2749853221 0 0) 0x7fe2a8003530 con 0x7fe2bc0701e0 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 >> v1:172.21.15.106:6793/0 conn(0x7fe2bc06fe00 legacy=0x7fe2bc1345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:33.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 >> v1:172.21.15.106:6791/0 conn(0x7fe2bc06f600 legacy=0x7fe2bc134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 monclient: found mon.noname-f 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc070630 con 0x7fe2bc0701e0 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe2b4001b40 con 0x7fe2bc0701e0 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: dump: 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:33.835 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:33.836 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 5 monclient: authenticate success, global_id 145180 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2b4001da0 con 0x7fe2bc0701e0 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 1 -- 172.21.15.171:0/3437869464 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe2b4004f70 con 0x7fe2bc0701e0 2024-04-26T00:01:33.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:33.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:33.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2b3fff640 10 monclient: dump: 2024-04-26T00:01:33.838 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:33.838 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:33.838 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.838 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.838 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:33.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 4 set_mon_vals no callback set 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient: shutdown 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3437869464 >> v1:172.21.15.171:6789/0 conn(0x7fe2bc0701e0 legacy=0x7fe2bc13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3437869464 shutdown_connections 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3437869464 >> 172.21.15.171:0/3437869464 conn(0x7fe2bc0a2620 msgr2=0x7fe2bc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3437869464 shutdown_connections 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3437869464 wait complete. 2024-04-26T00:01:33.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient: build_initial_monmap 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.842+0000 7fe2c33d4640 10 monclient: monmap: 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:33.841 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:33.842 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:33.842 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:33.842 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:33.842 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:33.842 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:33.842 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:33.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 Processor -- start 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 -- start start 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: init 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _add_conns ranks=[6,2,7,0,3,5,4,8,1] 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient(hunting): picked mon.noname-d con 0x7fe2bc06f600 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient(hunting): picked mon.noname-b con 0x7fe2bc06fe00 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient(hunting): picked mon.noname-i con 0x7fe2bc0701e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc11c200 con 0x7fe2bc06fe00 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc122ce0 con 0x7fe2bc06f600 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2bc06f310 con 0x7fe2bc0701e0 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:33.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient(hunting): authenticate will time out at 1344.556892s 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c1971640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fe2bc0701e0 0x7fe2bc1d4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51372/0 (socket says 172.21.15.171:51372) 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c1971640 1 -- 172.21.15.171:0/3599410988 learned_addr learned my addr 172.21.15.171:0/3599410988 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517542847 0 0) 0x7fe2bc06f310 con 0x7fe2bc0701e0 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): my global_id is 145168 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2a0003530 con 0x7fe2bc0701e0 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2111916764 0 0) 0x7fe2a0003530 con 0x7fe2bc0701e0 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2bc06f310 con 0x7fe2bc0701e0 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe2b4001b60 con 0x7fe2bc0701e0 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:33.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): dump: 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:33.845 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750655959 0 0) 0x7fe2bc06fa00 con 0x7fe2bc06f600 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): my global_id is 6810 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2a0003530 con 0x7fe2bc06f600 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 621880731 0 0) 0x7fe2bc11c200 con 0x7fe2bc06fe00 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:33.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient(hunting): my global_id is 6752 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2bc06fa00 con 0x7fe2bc06fe00 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2054226493 0 0) 0x7fe2bc06f310 con 0x7fe2bc0701e0 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 >> v1:172.21.15.106:6792/0 conn(0x7fe2bc06f600 legacy=0x7fe2bc06e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 >> v1:172.21.15.106:6790/0 conn(0x7fe2bc06fe00 legacy=0x7fe2bc06ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 monclient: found mon.i 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2bc070d60 con 0x7fe2bc0701e0 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 5 monclient: authenticate success, global_id 145168 2024-04-26T00:01:33.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _renew_subs 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe2bc070880 con 0x7fe2bc0701e0 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _renew_subs 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe2bc1323e0 con 0x7fe2bc0701e0 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe2b4005160 con 0x7fe2bc0701e0 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe2b4005650 con 0x7fe2bc0701e0 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b37fe640 4 set_mon_vals no callback set 2024-04-26T00:01:33.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 10 monclient: dump: 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:33.849 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe2b40103f0 con 0x7fe2bc0701e0 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(213..213 src has 29..213) ==== 13934+0+0 (unknown 88192761 0 0) 0x7fe2b4047120 con 0x7fe2bc0701e0 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe29c005090 con 0x7fe2bc0701e0 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.846+0000 7fe2c1170640 10 monclient: get_auth_request con 0x7fe2a0037940 auth_method 0 2024-04-26T00:01:33.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.850+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe2b4015be0 con 0x7fe2bc0701e0 2024-04-26T00:01:33.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.850+0000 7fe2b1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:33.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:33.850+0000 7fe2b1ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:33.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.014+0000 7fe2c33d4640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h2"}] 2024-04-26T00:01:33.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.014+0000 7fe2c33d4640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h2"}] 2024-04-26T00:01:33.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.014+0000 7fe2c33d4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:33.999 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.014+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h2"} v 0) -- 0x7fe29c005380 con 0x7fe2bc0701e0 2024-04-26T00:01:34.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.630+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h2"}]=0 removed item id -22 name 'h2' from crush map v214) ==== 118+0+0 (unknown 1404782099 0 0) 0x7fe2b40154e0 con 0x7fe2bc0701e0 2024-04-26T00:01:34.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.630+0000 7fe2b1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h2"}] 2024-04-26T00:01:34.614 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.630+0000 7fe2b1ffb640 10 monclient: _finish_command 2 = system:0 removed item id -22 name 'h2' from crush map 2024-04-26T00:01:34.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.730+0000 7fe2c33d4640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h2"}] 2024-04-26T00:01:34.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.730+0000 7fe2c33d4640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h2"}] 2024-04-26T00:01:34.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.730+0000 7fe2c33d4640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:34.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.730+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h2"} v 0) -- 0x7fe29c002220 con 0x7fe2bc0701e0 2024-04-26T00:01:34.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2b1ffb640 1 -- 172.21.15.171:0/3599410988 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h2"}]=0 device 'h2' does not appear in the crush map v214) ==== 118+0+0 (unknown 1453253224 0 0) 0x7fe2b401e030 con 0x7fe2bc0701e0 2024-04-26T00:01:34.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2b1ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h2"}] 2024-04-26T00:01:34.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2b1ffb640 10 monclient: _finish_command 3 = system:0 device 'h2' does not appear in the crush map 2024-04-26T00:01:34.717 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h2' does not appear in the crush map 2024-04-26T00:01:34.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 >> v1:172.21.15.171:6812/722422047 conn(0x7fe2a0037940 legacy=0x7fe2a0039e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:34.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 10 monclient: shutdown 2024-04-26T00:01:34.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:34.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 >> v1:172.21.15.171:6792/0 conn(0x7fe2bc0701e0 legacy=0x7fe2bc1d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:34.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 shutdown_connections 2024-04-26T00:01:34.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 >> 172.21.15.171:0/3599410988 conn(0x7fe2bc0a2620 msgr2=0x7fe2bc1bc860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:34.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 shutdown_connections 2024-04-26T00:01:34.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.734+0000 7fe2c33d4640 1 -- 172.21.15.171:0/3599410988 wait complete. 2024-04-26T00:01:34.734 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:34.734 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h3 2024-04-26T00:01:34.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.866+0000 7f24e05eb640 10 monclient: get_monmap_and_config 2024-04-26T00:01:34.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.866+0000 7f24e05eb640 10 monclient: build_initial_monmap 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.866+0000 7f24e05eb640 10 monclient: monmap: 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:34.873210+0000 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:34.873210+0000 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:34.851 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:34.852 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:34.852 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.866+0000 7f24e05eb640 1 Processor -- start 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.866+0000 7f24e05eb640 1 -- start start 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.866+0000 7f24e05eb640 10 monclient: init 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: _add_conns ranks=[4,8,7,6,3,1,5,2,0] 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): picked mon.noname-c con 0x7f24d806fe00 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): picked mon.noname-e con 0x7f24d806f600 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): picked mon.noname-i con 0x7f24d80701e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:34.859 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d806fa00 con 0x7f24d806fe00 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d8135400 con 0x7f24d80701e0 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d8071670 con 0x7f24d806f600 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): authenticate will time out at 1345.580319s 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24deb88640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f24d80701e0 0x7f24d813d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51374/0 (socket says 172.21.15.171:51374) 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24deb88640 1 -- 172.21.15.171:0/3916355799 learned_addr learned my addr 172.21.15.171:0/3916355799 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 86216479 0 0) 0x7f24d8135400 con 0x7f24d80701e0 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient(hunting): _negotiate 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient(hunting): my global_id is 145177 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c0003530 con 0x7f24d80701e0 2024-04-26T00:01:34.860 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1109118883 0 0) 0x7f24c0003530 con 0x7f24d80701e0 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 >> v1:172.21.15.106:6793/0 conn(0x7f24d806f600 legacy=0x7f24d8134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 >> v1:172.21.15.106:6791/0 conn(0x7f24d806fe00 legacy=0x7f24d81345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: _finish_hunting 0 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 monclient: found mon.noname-i 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d8070630 con 0x7f24d80701e0 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: _finish_auth 0 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: _check_auth_tickets 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24c80017c0 con 0x7f24d80701e0 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 5 monclient: authenticate success, global_id 145177 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:34.861 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: dump: 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:34.862 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f24c8001ab0 con 0x7f24d80701e0 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 1 -- 172.21.15.171:0/3916355799 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24c8004bf0 con 0x7f24d80701e0 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24dd385640 10 monclient: dump: 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:34.863 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:34.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 4 set_mon_vals no callback set 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: shutdown 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- 172.21.15.171:0/3916355799 >> v1:172.21.15.171:6792/0 conn(0x7f24d80701e0 legacy=0x7f24d813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- 172.21.15.171:0/3916355799 shutdown_connections 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- 172.21.15.171:0/3916355799 >> 172.21.15.171:0/3916355799 conn(0x7f24d80a2620 msgr2=0x7f24d80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- 172.21.15.171:0/3916355799 shutdown_connections 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- 172.21.15.171:0/3916355799 wait complete. 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: build_initial_monmap 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: monmap: 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:34.865 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 Processor -- start 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- start start 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: init 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:34.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient: _add_conns ranks=[5,2,7,1,4,6,0,3,8] 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): picked mon.noname-h con 0x7f24d806f600 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): picked mon.noname-b con 0x7f24d806fe00 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): picked mon.noname-i con 0x7f24d80701e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d811d8a0 con 0x7f24d806fe00 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d8070880 con 0x7f24d806f600 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24d809f180 con 0x7f24d80701e0 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24e05eb640 10 monclient(hunting): authenticate will time out at 1345.583350s 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24de387640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f24d806f600 0x7f24d812d190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:54018/0 (socket says 172.21.15.171:54018) 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24de387640 1 -- 172.21.15.171:0/2671677190 learned_addr learned my addr 172.21.15.171:0/2671677190 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24deb88640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f24d80701e0 0x7f24d81d0f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51388/0 (socket says 172.21.15.171:51388) 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1412927491 0 0) 0x7f24d809f180 con 0x7f24d80701e0 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:34.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): my global_id is 145186 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c4003530 con 0x7f24d80701e0 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577747274 0 0) 0x7f24d8070880 con 0x7f24d806f600 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 10 monclient(hunting): my global_id is 6656 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24d809f180 con 0x7f24d806f600 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1995493964 0 0) 0x7f24d809f180 con 0x7f24d806f600 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24d8070880 con 0x7f24d806f600 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.870+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4271718910 0 0) 0x7f24c4003530 con 0x7f24d80701e0 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f24d809f180 con 0x7f24d80701e0 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24d0001b20 con 0x7f24d806f600 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:34.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): dump: 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:34.869 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24c8001780 con 0x7f24d80701e0 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): dump: 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:34.870 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3207710567 0 0) 0x7f24d811d8a0 con 0x7f24d806fe00 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient(hunting): my global_id is 6761 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24c4003530 con 0x7f24d806fe00 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1365383388 0 0) 0x7f24d8070880 con 0x7f24d806f600 2024-04-26T00:01:34.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 >> v1:172.21.15.171:6792/0 conn(0x7f24d80701e0 legacy=0x7f24d81d0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 >> v1:172.21.15.106:6790/0 conn(0x7f24d806fe00 legacy=0x7f24d81cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 monclient: found mon.h 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24d811d2e0 con 0x7f24d806f600 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 5 monclient: authenticate success, global_id 6656 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 10 monclient: _renew_subs 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f24d809f860 con 0x7f24d806f600 2024-04-26T00:01:34.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 10 monclient: _renew_subs 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f24d811c5c0 con 0x7f24d806f600 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f24d00038d0 con 0x7f24d806f600 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24d0003e40 con 0x7f24d806f600 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24dcb84640 4 set_mon_vals no callback set 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 10 monclient: dump: 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:34.873 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:34.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f24d0003fe0 con 0x7f24d806f600 2024-04-26T00:01:34.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:34.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24b8005090 con 0x7f24d806f600 2024-04-26T00:01:34.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(214..214 src has 29..214) ==== 13724+0+0 (unknown 42456240 0 0) 0x7f24d0046d60 con 0x7f24d806f600 2024-04-26T00:01:34.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.874+0000 7f24ddb86640 10 monclient: get_auth_request con 0x7f24c4037e50 auth_method 0 2024-04-26T00:01:34.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.878+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f24d0015830 con 0x7f24d806f600 2024-04-26T00:01:34.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.878+0000 7f24d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:34.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:34.878+0000 7f24d6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.050+0000 7f24e05eb640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h3"}] 2024-04-26T00:01:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.050+0000 7f24e05eb640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h3"}] 2024-04-26T00:01:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.050+0000 7f24e05eb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:35.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.050+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h3"} v 0) -- 0x7f24b8005380 con 0x7f24d806f600 2024-04-26T00:01:35.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.630+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h3"}]=0 removed item id -25 name 'h3' from crush map v215) ==== 118+0+0 (unknown 2788747460 0 0) 0x7f24d0015130 con 0x7f24d806f600 2024-04-26T00:01:35.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.630+0000 7f24d6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h3"}] 2024-04-26T00:01:35.615 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.630+0000 7f24d6ffd640 10 monclient: _finish_command 2 = system:0 removed item id -25 name 'h3' from crush map 2024-04-26T00:01:35.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.738+0000 7f24e05eb640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h3"}] 2024-04-26T00:01:35.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.738+0000 7f24e05eb640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h3"}] 2024-04-26T00:01:35.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.738+0000 7f24e05eb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:35.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.738+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h3"} v 0) -- 0x7f24b8002220 con 0x7f24d806f600 2024-04-26T00:01:35.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24d6ffd640 1 -- 172.21.15.171:0/2671677190 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h3"}]=0 device 'h3' does not appear in the crush map v215) ==== 118+0+0 (unknown 2515647340 0 0) 0x7f24d0019480 con 0x7f24d806f600 2024-04-26T00:01:35.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24d6ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h3"}] 2024-04-26T00:01:35.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24d6ffd640 10 monclient: _finish_command 3 = system:0 device 'h3' does not appear in the crush map 2024-04-26T00:01:35.724 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h3' does not appear in the crush map 2024-04-26T00:01:35.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 >> v1:172.21.15.171:6812/722422047 conn(0x7f24c4037e50 legacy=0x7f24c403a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:35.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 10 monclient: shutdown 2024-04-26T00:01:35.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:35.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 >> v1:172.21.15.171:6791/0 conn(0x7f24d806f600 legacy=0x7f24d812d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:35.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 shutdown_connections 2024-04-26T00:01:35.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 >> 172.21.15.171:0/2671677190 conn(0x7f24d80a2620 msgr2=0x7f24d8131d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:35.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 shutdown_connections 2024-04-26T00:01:35.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.742+0000 7f24e05eb640 1 -- 172.21.15.171:0/2671677190 wait complete. 2024-04-26T00:01:35.741 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:35.741 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h4 2024-04-26T00:01:35.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.870+0000 7f0a0fe0a640 10 monclient: get_monmap_and_config 2024-04-26T00:01:35.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.870+0000 7f0a0fe0a640 10 monclient: build_initial_monmap 2024-04-26T00:01:35.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.870+0000 7f0a0fe0a640 10 monclient: monmap: 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:35.877152+0000 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:35.877152+0000 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:35.855 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:35.856 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:35.856 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:35.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.870+0000 7f0a0fe0a640 1 Processor -- start 2024-04-26T00:01:35.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.870+0000 7f0a0fe0a640 1 -- start start 2024-04-26T00:01:35.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.870+0000 7f0a0fe0a640 10 monclient: init 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: _add_conns ranks=[5,1,7,3,4,6,2,8,0] 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): picked mon.noname-h con 0x7f0a08135bb0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): picked mon.noname-f con 0x7f0a081356f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): picked mon.noname-i con 0x7f0a0813c130 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080a1da0 con 0x7f0a081356f0 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080a1fe0 con 0x7f0a08135bb0 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08072720 con 0x7f0a0813c130 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): authenticate will time out at 1346.584301s 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0e3a7640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f0a0813c130 0x7f0a0813e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51404/0 (socket says 172.21.15.171:51404) 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0e3a7640 1 -- 172.21.15.171:0/3582634219 learned_addr learned my addr 172.21.15.171:0/3582634219 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:35.864 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0dba6640 1 --1- 172.21.15.171:0/3582634219 >> v1:172.21.15.171:6791/0 conn(0x7f0a08135bb0 0x7f0a08135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:54024/0 (socket says 172.21.15.171:54024) 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0d3a5640 1 --1- 172.21.15.171:0/3582634219 >> v1:172.21.15.171:6789/0 conn(0x7f0a081356f0 0x7f0a0813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47986/0 (socket says 172.21.15.171:47986) 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722391298 0 0) 0x7f0a08072720 con 0x7f0a0813c130 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _negotiate 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): my global_id is 145195 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f0003530 con 0x7f0a0813c130 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 846660737 0 0) 0x7f0a080a1fe0 con 0x7f0a08135bb0 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _negotiate 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:35.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): my global_id is 6665 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a08072720 con 0x7f0a08135bb0 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828928101 0 0) 0x7f0a080a1da0 con 0x7f0a081356f0 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _negotiate 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient(hunting): my global_id is 145189 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a080a1fe0 con 0x7f0a081356f0 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4242326182 0 0) 0x7f0a08072720 con 0x7f0a08135bb0 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 >> v1:172.21.15.171:6792/0 conn(0x7f0a0813c130 legacy=0x7f0a0813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 >> v1:172.21.15.171:6789/0 conn(0x7f0a081356f0 legacy=0x7f0a0813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:35.866 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: _finish_hunting 0 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 monclient: found mon.noname-h 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a080a17f0 con 0x7f0a08135bb0 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: _finish_auth 0 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: _check_auth_tickets 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a00001b20 con 0x7f0a08135bb0 2024-04-26T00:01:35.867 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: dump: 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:35.868 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:35.869 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 5 monclient: authenticate success, global_id 6665 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a00001e80 con 0x7f0a08135bb0 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 4 set_mon_vals no callback set 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 1 -- 172.21.15.171:0/3582634219 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a00004eb0 con 0x7f0a08135bb0 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:35.870 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0cba4640 10 monclient: dump: 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:35.871 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:35.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: shutdown 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/3582634219 >> v1:172.21.15.171:6791/0 conn(0x7f0a08135bb0 legacy=0x7f0a08135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/3582634219 shutdown_connections 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/3582634219 >> 172.21.15.171:0/3582634219 conn(0x7f0a080a2620 msgr2=0x7f0a080a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/3582634219 shutdown_connections 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/3582634219 wait complete. 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: build_initial_monmap 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: monmap: 2024-04-26T00:01:35.873 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:35.874 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 Processor -- start 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- start start 2024-04-26T00:01:35.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: init 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: _add_conns ranks=[3,5,7,2,8,1,4,0,6] 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): picked mon.noname-g con 0x7f0a081356f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): picked mon.noname-h con 0x7f0a08135bb0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): picked mon.noname-i con 0x7f0a0813c130 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a081cada0 con 0x7f0a081356f0 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a080719a0 con 0x7f0a08135bb0 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a08071ef0 con 0x7f0a0813c130 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient(hunting): authenticate will time out at 1346.587130s 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0dba6640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f0a081356f0 legacy=0x7f0a081c9f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:35.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0e3a7640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f0a0813c130 0x7f0a081d24d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51420/0 (socket says 172.21.15.171:51420) 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0e3a7640 1 -- 172.21.15.171:0/568570092 learned_addr learned my addr 172.21.15.171:0/568570092 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3742532409 0 0) 0x7f0a08071ef0 con 0x7f0a0813c130 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): my global_id is 145204 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09f4003560 con 0x7f0a0813c130 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2046012701 0 0) 0x7f0a080719a0 con 0x7f0a08135bb0 2024-04-26T00:01:35.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): my global_id is 6674 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a08071ef0 con 0x7f0a08135bb0 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3018207227 0 0) 0x7f0a08071ef0 con 0x7f0a08135bb0 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a080719a0 con 0x7f0a08135bb0 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3002309154 0 0) 0x7f09f4003560 con 0x7f0a0813c130 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a08071ef0 con 0x7f0a0813c130 2024-04-26T00:01:35.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09fc001320 con 0x7f0a08135bb0 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): dump: 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:35.879 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09f8001870 con 0x7f0a0813c130 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:35.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient(hunting): dump: 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:35.881 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 498840593 0 0) 0x7f0a080719a0 con 0x7f0a08135bb0 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 >> v1:172.21.15.171:6792/0 conn(0x7f0a0813c130 legacy=0x7f0a081d24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 >> v1:172.21.15.171:6790/0 conn(0x7f0a081356f0 legacy=0x7f0a081c9f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 monclient: found mon.h 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a08139030 con 0x7f0a08135bb0 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:35.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 5 monclient: authenticate success, global_id 6674 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: _renew_subs 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.874+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a0813aaf0 con 0x7f0a08135bb0 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0fe0a640 10 monclient: _renew_subs 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0fe0a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a0813a750 con 0x7f0a08135bb0 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09fc001710 con 0x7f0a08135bb0 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09fc004de0 con 0x7f0a08135bb0 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a07fff640 4 set_mon_vals no callback set 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:35.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 10 monclient: dump: 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:35.884 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0fe0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0fe0a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0fe0a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09e8005090 con 0x7f0a08135bb0 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f09fc00fb80 con 0x7f0a08135bb0 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(215..215 src has 29..215) ==== 13514+0+0 (unknown 3316000936 0 0) 0x7f09fc046a50 con 0x7f0a08135bb0 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.878+0000 7f0a0dba6640 10 monclient: get_auth_request con 0x7f09f4037d60 auth_method 0 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.882+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f09fc0156e0 con 0x7f0a08135bb0 2024-04-26T00:01:35.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.882+0000 7f0a067fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:35.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:35.882+0000 7f0a067fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:36.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.034+0000 7f0a0fe0a640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h4"}] 2024-04-26T00:01:36.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.034+0000 7f0a0fe0a640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h4"}] 2024-04-26T00:01:36.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.034+0000 7f0a0fe0a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:36.017 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.034+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h4"} v 0) -- 0x7f09e8005380 con 0x7f0a08135bb0 2024-04-26T00:01:36.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.666+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h4"}]=0 removed item id -28 name 'h4' from crush map v216) ==== 118+0+0 (unknown 1334860049 0 0) 0x7f09fc014fe0 con 0x7f0a08135bb0 2024-04-26T00:01:36.648 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.666+0000 7f0a067fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h4"}] 2024-04-26T00:01:36.649 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.666+0000 7f0a067fc640 10 monclient: _finish_command 2 = system:0 removed item id -28 name 'h4' from crush map 2024-04-26T00:01:36.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.770+0000 7f0a0fe0a640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h4"}] 2024-04-26T00:01:36.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.770+0000 7f0a0fe0a640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h4"}] 2024-04-26T00:01:36.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.770+0000 7f0a0fe0a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:36.753 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.770+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h4"} v 0) -- 0x7f09e80010a0 con 0x7f0a08135bb0 2024-04-26T00:01:36.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.770+0000 7f0a067fc640 1 -- 172.21.15.171:0/568570092 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h4"}]=0 device 'h4' does not appear in the crush map v216) ==== 118+0+0 (unknown 3404819776 0 0) 0x7f09fc01db20 con 0x7f0a08135bb0 2024-04-26T00:01:36.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.770+0000 7f0a067fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h4"}] 2024-04-26T00:01:36.755 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.770+0000 7f0a067fc640 10 monclient: _finish_command 3 = system:0 device 'h4' does not appear in the crush map 2024-04-26T00:01:36.755 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h4' does not appear in the crush map 2024-04-26T00:01:36.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 >> v1:172.21.15.171:6812/722422047 conn(0x7f09f4037d60 legacy=0x7f09f403a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:36.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 10 monclient: shutdown 2024-04-26T00:01:36.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:36.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 >> v1:172.21.15.171:6791/0 conn(0x7f0a08135bb0 legacy=0x7f0a081ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:36.757 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 shutdown_connections 2024-04-26T00:01:36.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 >> 172.21.15.171:0/568570092 conn(0x7f0a080a2620 msgr2=0x7f0a0813e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:36.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 shutdown_connections 2024-04-26T00:01:36.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.774+0000 7f0a0fe0a640 1 -- 172.21.15.171:0/568570092 wait complete. 2024-04-26T00:01:36.772 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:36.772 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h5 2024-04-26T00:01:36.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient: get_monmap_and_config 2024-04-26T00:01:36.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient: build_initial_monmap 2024-04-26T00:01:36.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient: monmap: 2024-04-26T00:01:36.889 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:36.889 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:36.889 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:36.911891+0000 2024-04-26T00:01:36.889 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:36.911891+0000 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:36.890 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:36.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 1 Processor -- start 2024-04-26T00:01:36.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 1 -- start start 2024-04-26T00:01:36.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient: init 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient: _add_conns ranks=[8,1,5,6,2,3,4,0,7] 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient(hunting): picked mon.noname-e con 0x7f71f006e4f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient(hunting): picked mon.noname-f con 0x7f71f006efe0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient(hunting): picked mon.noname-h con 0x7f71f013aa40 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f0070df0 con 0x7f71f006efe0 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f00710d0 con 0x7f71f013aa40 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f0072f10 con 0x7f71f006e4f0 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient(hunting): authenticate will time out at 1347.618879s 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71eeffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f71f006efe0 0x7f71f0139320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:48000/0 (socket says 172.21.15.171:48000) 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71effff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f71f013aa40 0x7f71f013ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:54028/0 (socket says 172.21.15.171:54028) 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71eeffd640 1 -- 172.21.15.171:0/613444714 learned_addr learned my addr 172.21.15.171:0/613444714 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:36.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2015771582 0 0) 0x7f71f0070df0 con 0x7f71f006efe0 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): my global_id is 145198 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71dc003450 con 0x7f71f006efe0 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1802122415 0 0) 0x7f71f00710d0 con 0x7f71f013aa40 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient(hunting): my global_id is 6683 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71f0070df0 con 0x7f71f013aa40 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2251781209 0 0) 0x7f71dc003450 con 0x7f71f006efe0 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 >> v1:172.21.15.106:6793/0 conn(0x7f71f006e4f0 legacy=0x7f71f006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:36.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 >> v1:172.21.15.171:6791/0 conn(0x7f71f013aa40 legacy=0x7f71f013ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 monclient: found mon.noname-f 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f006fa90 con 0x7f71f006efe0 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f71e00016f0 con 0x7f71f006efe0 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: dump: 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:36.900 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 5 monclient: authenticate success, global_id 145198 2024-04-26T00:01:36.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71e00019d0 con 0x7f71f006efe0 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 1 -- 172.21.15.171:0/613444714 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f71e0004bf0 con 0x7f71f006efe0 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71ee7fc640 10 monclient: dump: 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:36.902 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.906+0000 7f71f5f52640 4 set_mon_vals no callback set 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: shutdown 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/613444714 >> v1:172.21.15.171:6789/0 conn(0x7f71f006efe0 legacy=0x7f71f0139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/613444714 shutdown_connections 2024-04-26T00:01:36.903 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/613444714 >> 172.21.15.171:0/613444714 conn(0x7f71f00a2620 msgr2=0x7f71f00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/613444714 shutdown_connections 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/613444714 wait complete. 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: build_initial_monmap 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: monmap: 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:36.904 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 Processor -- start 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- start start 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: init 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _add_conns ranks=[7,3,5,2,8,6,1,4,0] 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient(hunting): picked mon.noname-i con 0x7f71f006e4f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient(hunting): picked mon.noname-g con 0x7f71f006efe0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient(hunting): picked mon.noname-h con 0x7f71f013aa40 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:36.905 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f01c8d80 con 0x7f71f006efe0 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f009f370 con 0x7f71f013aa40 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71f009f650 con 0x7f71f006e4f0 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient(hunting): authenticate will time out at 1347.622015s 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71eeffd640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f71f006efe0 legacy=0x7f71f01cd1b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71ef7fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f71f006e4f0 0x7f71f0131470 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51424/0 (socket says 172.21.15.171:51424) 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71ef7fe640 1 -- 172.21.15.171:0/557485398 learned_addr learned my addr 172.21.15.171:0/557485398 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2056896510 0 0) 0x7f71f009f370 con 0x7f71f013aa40 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): my global_id is 6692 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71d0003530 con 0x7f71f013aa40 2024-04-26T00:01:36.906 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2744092585 0 0) 0x7f71f009f650 con 0x7f71f006e4f0 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): my global_id is 145213 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71f009f370 con 0x7f71f006e4f0 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1320761827 0 0) 0x7f71d0003530 con 0x7f71f013aa40 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71f009f650 con 0x7f71f013aa40 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f71e8001d00 con 0x7f71f013aa40 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): dump: 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.907 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:36.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2801844731 0 0) 0x7f71f009f370 con 0x7f71f006e4f0 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71d0003530 con 0x7f71f006e4f0 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f71d80019e0 con 0x7f71f006e4f0 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient(hunting): dump: 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:36.909 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2009457906 0 0) 0x7f71f009f650 con 0x7f71f013aa40 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 >> v1:172.21.15.171:6792/0 conn(0x7f71f006e4f0 legacy=0x7f71f0131470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 >> v1:172.21.15.171:6790/0 conn(0x7f71f006efe0 legacy=0x7f71f01cd1b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 monclient: found mon.h 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:36.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0070930 con 0x7f71f013aa40 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 5 monclient: authenticate success, global_id 6692 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _renew_subs 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f71f009df20 con 0x7f71f013aa40 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _renew_subs 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f71f009e3c0 con 0x7f71f013aa40 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f71e8004b70 con 0x7f71f013aa40 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:36.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f71e80050e0 con 0x7f71f013aa40 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71ed7fa640 4 set_mon_vals no callback set 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 10 monclient: dump: 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:36.912 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71d4005090 con 0x7f71f013aa40 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.910+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f71e8005300 con 0x7f71f013aa40 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.914+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(216..216 src has 138..216) ==== 13304+0+0 (unknown 2322141244 0 0) 0x7f71e8046d10 con 0x7f71f013aa40 2024-04-26T00:01:36.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.914+0000 7f71ef7fe640 10 monclient: get_auth_request con 0x7f71d0037e60 auth_method 0 2024-04-26T00:01:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.918+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f71e80159f0 con 0x7f71f013aa40 2024-04-26T00:01:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.918+0000 7f71e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:36.918+0000 7f71e7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:37.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.086+0000 7f71f5f52640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h5"}] 2024-04-26T00:01:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.086+0000 7f71f5f52640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h5"}] 2024-04-26T00:01:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.086+0000 7f71f5f52640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:37.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.086+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h5"} v 0) -- 0x7f71d4005380 con 0x7f71f013aa40 2024-04-26T00:01:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.674+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h5"}]=0 removed item id -31 name 'h5' from crush map v217) ==== 118+0+0 (unknown 794371125 0 0) 0x7f71e80152f0 con 0x7f71f013aa40 2024-04-26T00:01:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.674+0000 7f71e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h5"}] 2024-04-26T00:01:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.674+0000 7f71e7fff640 10 monclient: _finish_command 2 = system:0 removed item id -31 name 'h5' from crush map 2024-04-26T00:01:37.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.782+0000 7f71f5f52640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h5"}] 2024-04-26T00:01:37.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.782+0000 7f71f5f52640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h5"}] 2024-04-26T00:01:37.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.782+0000 7f71f5f52640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:37.766 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.782+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h5"} v 0) -- 0x7f71d4002220 con 0x7f71f013aa40 2024-04-26T00:01:37.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.782+0000 7f71e7fff640 1 -- 172.21.15.171:0/557485398 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h5"}]=0 device 'h5' does not appear in the crush map v217) ==== 118+0+0 (unknown 161363012 0 0) 0x7f71e801dea0 con 0x7f71f013aa40 2024-04-26T00:01:37.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.782+0000 7f71e7fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h5"}] 2024-04-26T00:01:37.767 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.782+0000 7f71e7fff640 10 monclient: _finish_command 3 = system:0 device 'h5' does not appear in the crush map 2024-04-26T00:01:37.768 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h5' does not appear in the crush map 2024-04-26T00:01:37.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 >> v1:172.21.15.171:6812/722422047 conn(0x7f71d0037e60 legacy=0x7f71d003a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:37.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 10 monclient: shutdown 2024-04-26T00:01:37.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:37.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 >> v1:172.21.15.171:6791/0 conn(0x7f71f013aa40 legacy=0x7f71f01d08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:37.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 shutdown_connections 2024-04-26T00:01:37.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 >> 172.21.15.171:0/557485398 conn(0x7f71f00a2620 msgr2=0x7f71f00a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:37.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 shutdown_connections 2024-04-26T00:01:37.771 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.786+0000 7f71f5f52640 1 -- 172.21.15.171:0/557485398 wait complete. 2024-04-26T00:01:37.784 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:37.785 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h6 2024-04-26T00:01:37.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient: get_monmap_and_config 2024-04-26T00:01:37.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient: build_initial_monmap 2024-04-26T00:01:37.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient: monmap: 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:37.923913+0000 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:37.923913+0000 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:37.902 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:37.903 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:37.903 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:37.903 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 1 Processor -- start 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 1 -- start start 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient: init 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient: _add_conns ranks=[3,1,2,6,7,8,5,0,4] 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient(hunting): picked mon.noname-g con 0x7f351c135bb0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient(hunting): picked mon.noname-f con 0x7f351c1356f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient(hunting): picked mon.noname-b con 0x7f351c13c130 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351c0a1da0 con 0x7f351c1356f0 2024-04-26T00:01:37.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f35212f1640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f351c135bb0 legacy=0x7f351c135f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351c0a1fe0 con 0x7f351c13c130 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351c072720 con 0x7f351c135bb0 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient(hunting): authenticate will time out at 1348.631026s 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3520af0640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f351c1356f0 0x7f351c13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:48002/0 (socket says 172.21.15.171:48002) 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3520af0640 1 -- 172.21.15.171:0/3750202903 learned_addr learned my addr 172.21.15.171:0/3750202903 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891611926 0 0) 0x7f351c0a1da0 con 0x7f351c1356f0 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:37.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient(hunting): my global_id is 145207 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3508003530 con 0x7f351c1356f0 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1118143660 0 0) 0x7f3508003530 con 0x7f351c1356f0 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 >> v1:172.21.15.171:6790/0 conn(0x7f351c135bb0 legacy=0x7f351c135f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 >> v1:172.21.15.106:6790/0 conn(0x7f351c13c130 legacy=0x7f351c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 monclient: found mon.noname-f 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351c0a17f0 con 0x7f351c1356f0 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:37.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35180017c0 con 0x7f351c1356f0 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 5 monclient: authenticate success, global_id 145207 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: dump: 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:37.914 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3518001b20 con 0x7f351c1356f0 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 1 -- 172.21.15.171:0/3750202903 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3518004bf0 con 0x7f351c1356f0 2024-04-26T00:01:37.915 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3523555640 4 set_mon_vals no callback set 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.918+0000 7f3513fff640 10 monclient: dump: 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:37.916 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: shutdown 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3750202903 >> v1:172.21.15.171:6789/0 conn(0x7f351c1356f0 legacy=0x7f351c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3750202903 shutdown_connections 2024-04-26T00:01:37.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3750202903 >> 172.21.15.171:0/3750202903 conn(0x7f351c0a2620 msgr2=0x7f351c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3750202903 shutdown_connections 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3750202903 wait complete. 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: build_initial_monmap 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: monmap: 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:37.918 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 Processor -- start 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- start start 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: init 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:37.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _add_conns ranks=[1,6,0,2,4,8,7,5,3] 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient(hunting): picked mon.noname-f con 0x7f351c1356f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient(hunting): picked mon.noname-d con 0x7f351c135bb0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient(hunting): picked mon.noname-a con 0x7f351c13c130 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351c0719a0 con 0x7f351c13c130 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351c12ffd0 con 0x7f351c1356f0 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f351c131760 con 0x7f351c135bb0 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient(hunting): authenticate will time out at 1348.633953s 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f35212f1640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f351c1356f0 0x7f351c134cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:48014/0 (socket says 172.21.15.171:48014) 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f35212f1640 1 -- 172.21.15.171:0/3331279668 learned_addr learned my addr 172.21.15.171:0/3331279668 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3728099199 0 0) 0x7f351c12ffd0 con 0x7f351c1356f0 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:37.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): my global_id is 145216 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3500003560 con 0x7f351c1356f0 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3623458583 0 0) 0x7f3500003560 con 0x7f351c1356f0 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f351c12ffd0 con 0x7f351c1356f0 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f350c004300 con 0x7f351c1356f0 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): dump: 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:37.921 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3699408500 0 0) 0x7f351c12ffd0 con 0x7f351c1356f0 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 >> v1:172.21.15.106:6792/0 conn(0x7f351c135bb0 legacy=0x7f351c1d15d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 >> v1:172.21.15.106:6789/0 conn(0x7f351c13c130 legacy=0x7f351c1d4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:37.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 monclient: found mon.f 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f351c130ec0 con 0x7f351c1356f0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 5 monclient: authenticate success, global_id 145216 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _renew_subs 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f351c1311a0 con 0x7f351c1356f0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _renew_subs 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f351c1353c0 con 0x7f351c1356f0 2024-04-26T00:01:37.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f350c0045f0 con 0x7f351c1356f0 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f350c004b60 con 0x7f351c1356f0 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f35137fe640 4 set_mon_vals no callback set 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 10 monclient: dump: 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:37.924 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f350c004d80 con 0x7f351c1356f0 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34fc005090 con 0x7f351c1356f0 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.922+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(217..217 src has 138..217) ==== 13094+0+0 (unknown 1585947536 0 0) 0x7f350c046b50 con 0x7f351c1356f0 2024-04-26T00:01:37.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.926+0000 7f3520af0640 10 monclient: get_auth_request con 0x7f3500037810 auth_method 0 2024-04-26T00:01:37.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.930+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f350c015860 con 0x7f351c1356f0 2024-04-26T00:01:37.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.930+0000 7f3511ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:37.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:37.930+0000 7f3511ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:38.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.090+0000 7f3523555640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h6"}] 2024-04-26T00:01:38.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.090+0000 7f3523555640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h6"}] 2024-04-26T00:01:38.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.090+0000 7f3523555640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:38.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.090+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h6"} v 0) -- 0x7f34fc005380 con 0x7f351c1356f0 2024-04-26T00:01:38.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.706+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h6"}]=0 removed item id -34 name 'h6' from crush map v218) ==== 118+0+0 (unknown 791081437 0 0) 0x7f350c019510 con 0x7f351c1356f0 2024-04-26T00:01:38.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.706+0000 7f3511ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h6"}] 2024-04-26T00:01:38.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.706+0000 7f3511ffb640 10 monclient: _finish_command 2 = system:0 removed item id -34 name 'h6' from crush map 2024-04-26T00:01:38.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.810+0000 7f3523555640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h6"}] 2024-04-26T00:01:38.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.810+0000 7f3523555640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h6"}] 2024-04-26T00:01:38.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.810+0000 7f3523555640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:38.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.810+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h6"} v 0) -- 0x7f34fc002220 con 0x7f351c1356f0 2024-04-26T00:01:38.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.810+0000 7f3511ffb640 1 -- 172.21.15.171:0/3331279668 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h6"}]=0 device 'h6' does not appear in the crush map v218) ==== 118+0+0 (unknown 1237559737 0 0) 0x7f350c040950 con 0x7f351c1356f0 2024-04-26T00:01:38.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.810+0000 7f3511ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h6"}] 2024-04-26T00:01:38.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.810+0000 7f3511ffb640 10 monclient: _finish_command 3 = system:0 device 'h6' does not appear in the crush map 2024-04-26T00:01:38.795 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h6' does not appear in the crush map 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 >> v1:172.21.15.171:6812/722422047 conn(0x7f3500037810 legacy=0x7f3500039cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 10 monclient: shutdown 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 >> v1:172.21.15.171:6789/0 conn(0x7f351c1356f0 legacy=0x7f351c134cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 shutdown_connections 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 >> 172.21.15.171:0/3331279668 conn(0x7f351c0a2620 msgr2=0x7f351c0a4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 shutdown_connections 2024-04-26T00:01:38.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.814+0000 7f3523555640 1 -- 172.21.15.171:0/3331279668 wait complete. 2024-04-26T00:01:38.812 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:38.812 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h7 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient: get_monmap_and_config 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient: build_initial_monmap 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient: monmap: 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:38.943553+0000 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:38.943553+0000 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:38.921 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:38.922 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:38.922 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:38.922 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:38.922 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:38.922 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:38.922 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:38.922 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:38.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 1 Processor -- start 2024-04-26T00:01:38.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 1 -- start start 2024-04-26T00:01:38.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient: init 2024-04-26T00:01:38.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:38.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient: _add_conns ranks=[4,2,1,3,6,7,0,8,5] 2024-04-26T00:01:38.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient(hunting): picked mon.noname-c con 0x7f29480a1610 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient(hunting): picked mon.noname-b con 0x7f2948135c00 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient(hunting): picked mon.noname-f con 0x7f2948136070 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2948072740 con 0x7f2948136070 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2948072a20 con 0x7f2948135c00 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2948072d00 con 0x7f29480a1610 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient(hunting): authenticate will time out at 1349.650504s 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294eac7640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f2948136070 0x7f294813e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:48026/0 (socket says 172.21.15.171:48026) 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294eac7640 1 -- 172.21.15.171:0/3089521034 learned_addr learned my addr 172.21.15.171:0/3089521034 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2077759131 0 0) 0x7f2948072740 con 0x7f2948136070 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): _negotiate 2024-04-26T00:01:38.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): my global_id is 145225 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2934003530 con 0x7f2948136070 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262195746 0 0) 0x7f2948072a20 con 0x7f2948135c00 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): _negotiate 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient(hunting): my global_id is 6779 2024-04-26T00:01:38.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2948072740 con 0x7f2948135c00 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2826131912 0 0) 0x7f2934003530 con 0x7f2948136070 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 >> v1:172.21.15.106:6791/0 conn(0x7f29480a1610 legacy=0x7f29480a19f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 >> v1:172.21.15.106:6790/0 conn(0x7f2948135c00 legacy=0x7f294813a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: _finish_hunting 0 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 monclient: found mon.noname-f 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29480a4610 con 0x7f2948136070 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: _finish_auth 0 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: _check_auth_tickets 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f29400017c0 con 0x7f2948136070 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:38.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: dump: 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:38.932 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 5 monclient: authenticate success, global_id 145225 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2940001a70 con 0x7f2948136070 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f295052a640 4 set_mon_vals no callback set 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 1 -- 172.21.15.171:0/3089521034 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2940004bf0 con 0x7f2948136070 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.938+0000 7f294d2c4640 10 monclient: dump: 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:38.933 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:38.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: shutdown 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/3089521034 >> v1:172.21.15.171:6789/0 conn(0x7f2948136070 legacy=0x7f294813e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/3089521034 shutdown_connections 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/3089521034 >> 172.21.15.171:0/3089521034 conn(0x7f29480a88b0 msgr2=0x7f29480a4930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/3089521034 shutdown_connections 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/3089521034 wait complete. 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: build_initial_monmap 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: monmap: 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:38.935 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 Processor -- start 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- start start 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: init 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:38.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _add_conns ranks=[7,6,0,2,8,5,1,4,3] 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient(hunting): picked mon.noname-i con 0x7f29480a1610 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient(hunting): picked mon.noname-d con 0x7f2948135c00 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient(hunting): picked mon.noname-a con 0x7f2948136070 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294811ea40 con 0x7f2948136070 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f294811ed20 con 0x7f2948135c00 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f29480a2160 con 0x7f29480a1610 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient(hunting): authenticate will time out at 1349.653530s 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f294e2c6640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f29480a1610 0x7f29481340a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:51436/0 (socket says 172.21.15.171:51436) 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f294e2c6640 1 -- 172.21.15.171:0/2221926071 learned_addr learned my addr 172.21.15.171:0/2221926071 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 876095618 0 0) 0x7f29480a2160 con 0x7f29480a1610 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:38.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): my global_id is 145222 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f292c003530 con 0x7f29480a1610 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 320796424 0 0) 0x7f292c003530 con 0x7f29480a1610 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f29480a2160 con 0x7f29480a1610 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2944001a60 con 0x7f29480a1610 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): dump: 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.938 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 242883103 0 0) 0x7f29480a2160 con 0x7f29480a1610 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 >> v1:172.21.15.106:6792/0 conn(0x7f2948135c00 legacy=0x7f29481d1ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:38.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 >> v1:172.21.15.106:6789/0 conn(0x7f2948136070 legacy=0x7f29481d53d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 monclient: found mon.i 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29480a13e0 con 0x7f29480a1610 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: _finish_auth 0 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 5 monclient: authenticate success, global_id 145222 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _renew_subs 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f294813d3e0 con 0x7f29480a1610 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _renew_subs 2024-04-26T00:01:38.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f294813e900 con 0x7f29480a1610 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f29440038d0 con 0x7f29480a1610 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2944003e40 con 0x7f29480a1610 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f294cac3640 4 set_mon_vals no callback set 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 10 monclient: dump: 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:38.941 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2930005090 con 0x7f29480a1610 2024-04-26T00:01:38.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2944003fe0 con 0x7f29480a1610 2024-04-26T00:01:38.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(218..218 src has 138..218) ==== 12884+0+0 (unknown 748581991 0 0) 0x7f2944046980 con 0x7f29480a1610 2024-04-26T00:01:38.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.942+0000 7f294dac5640 10 monclient: get_auth_request con 0x7f292c0377e0 auth_method 0 2024-04-26T00:01:38.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.950+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2944015740 con 0x7f29480a1610 2024-04-26T00:01:38.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.950+0000 7f293affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:38.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:38.950+0000 7f293affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:39.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.114+0000 7f295052a640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h7"}] 2024-04-26T00:01:39.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.114+0000 7f295052a640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h7"}] 2024-04-26T00:01:39.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.114+0000 7f295052a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:39.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.114+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h7"} v 0) -- 0x7f2930005380 con 0x7f29480a1610 2024-04-26T00:01:39.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.710+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h7"}]=0 removed item id -37 name 'h7' from crush map v219) ==== 118+0+0 (unknown 789332613 0 0) 0x7f29440193f0 con 0x7f29480a1610 2024-04-26T00:01:39.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.710+0000 7f293affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h7"}] 2024-04-26T00:01:39.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.710+0000 7f293affd640 10 monclient: _finish_command 2 = system:0 removed item id -37 name 'h7' from crush map 2024-04-26T00:01:39.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h7"}] 2024-04-26T00:01:39.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h7"}] 2024-04-26T00:01:39.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:39.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h7"} v 0) -- 0x7f2930002220 con 0x7f29480a1610 2024-04-26T00:01:39.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f293affd640 1 -- 172.21.15.171:0/2221926071 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h7"}]=0 device 'h7' does not appear in the crush map v219) ==== 118+0+0 (unknown 2326589629 0 0) 0x7f294401dcb0 con 0x7f29480a1610 2024-04-26T00:01:39.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f293affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h7"}] 2024-04-26T00:01:39.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f293affd640 10 monclient: _finish_command 3 = system:0 device 'h7' does not appear in the crush map 2024-04-26T00:01:39.802 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h7' does not appear in the crush map 2024-04-26T00:01:39.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 >> v1:172.21.15.171:6812/722422047 conn(0x7f292c0377e0 legacy=0x7f292c039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:39.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 10 monclient: shutdown 2024-04-26T00:01:39.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:39.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 >> v1:172.21.15.171:6792/0 conn(0x7f29480a1610 legacy=0x7f29481340a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:39.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 shutdown_connections 2024-04-26T00:01:39.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.818+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 >> 172.21.15.171:0/2221926071 conn(0x7f29480a88b0 msgr2=0x7f29480a65c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:39.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.822+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 shutdown_connections 2024-04-26T00:01:39.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.822+0000 7f295052a640 1 -- 172.21.15.171:0/2221926071 wait complete. 2024-04-26T00:01:39.818 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:39.819 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h8 2024-04-26T00:01:39.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient: get_monmap_and_config 2024-04-26T00:01:39.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient: build_initial_monmap 2024-04-26T00:01:39.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient: monmap: 2024-04-26T00:01:39.937 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:39.937 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:39.937 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:39.959564+0000 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:39.959564+0000 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:39.938 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 1 Processor -- start 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 1 -- start start 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient: init 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient: _add_conns ranks=[3,4,1,6,2,0,5,8,7] 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient(hunting): picked mon.noname-g con 0x7f5b50135bb0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient(hunting): picked mon.noname-c con 0x7f5b501356f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient(hunting): picked mon.noname-f con 0x7f5b5013c130 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b500a1da0 con 0x7f5b5013c130 2024-04-26T00:01:39.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b500a1fe0 con 0x7f5b50135bb0 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50072720 con 0x7f5b501356f0 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient(hunting): authenticate will time out at 1350.667052s 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4f7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f5b50135bb0 legacy=0x7f5b50135f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5b5013c130 0x7f5b5013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:48034/0 (socket says 172.21.15.171:48034) 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4ffff640 1 -- 172.21.15.171:0/3256807374 learned_addr learned my addr 172.21.15.171:0/3256807374 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1902135228 0 0) 0x7f5b500a1da0 con 0x7f5b5013c130 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient(hunting): my global_id is 145234 2024-04-26T00:01:39.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b3c003530 con 0x7f5b5013c130 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1713991618 0 0) 0x7f5b3c003530 con 0x7f5b5013c130 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 >> v1:172.21.15.106:6791/0 conn(0x7f5b501356f0 legacy=0x7f5b5013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 >> v1:172.21.15.171:6790/0 conn(0x7f5b50135bb0 legacy=0x7f5b50135f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 monclient: found mon.noname-f 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b500a17f0 con 0x7f5b5013c130 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: _finish_auth 0 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b48001b40 con 0x7f5b5013c130 2024-04-26T00:01:39.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 5 monclient: authenticate success, global_id 145234 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: dump: 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:39.949 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b48001ea0 con 0x7f5b5013c130 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 1 -- 172.21.15.171:0/3256807374 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b48004f70 con 0x7f5b5013c130 2024-04-26T00:01:39.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b5611a640 4 set_mon_vals no callback set 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.954+0000 7f5b4effd640 10 monclient: dump: 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:39.951 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: shutdown 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/3256807374 >> v1:172.21.15.171:6789/0 conn(0x7f5b5013c130 legacy=0x7f5b5013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/3256807374 shutdown_connections 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/3256807374 >> 172.21.15.171:0/3256807374 conn(0x7f5b500a2620 msgr2=0x7f5b500a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/3256807374 shutdown_connections 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/3256807374 wait complete. 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: build_initial_monmap 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: monmap: 2024-04-26T00:01:39.952 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:39.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 Processor -- start 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- start start 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: init 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _add_conns ranks=[5,6,0,3,8,2,4,1,7] 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient(hunting): picked mon.noname-h con 0x7f5b501356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient(hunting): picked mon.noname-d con 0x7f5b50135bb0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient(hunting): picked mon.noname-a con 0x7f5b5013c130 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b50070270 con 0x7f5b5013c130 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b500719a0 con 0x7f5b501356f0 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b5013be60 con 0x7f5b50135bb0 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:39.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient(hunting): authenticate will time out at 1350.670065s 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4f7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5b501356f0 0x7f5b5013b750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:54048/0 (socket says 172.21.15.171:54048) 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4f7fe640 1 -- 172.21.15.171:0/2295112261 learned_addr learned my addr 172.21.15.171:0/2295112261 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3020182757 0 0) 0x7f5b500719a0 con 0x7f5b501356f0 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): my global_id is 6701 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b30003560 con 0x7f5b501356f0 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2803732122 0 0) 0x7f5b30003560 con 0x7f5b501356f0 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b500719a0 con 0x7f5b501356f0 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b40004300 con 0x7f5b501356f0 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): dump: 2024-04-26T00:01:39.955 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:39.956 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3978991058 0 0) 0x7f5b50070270 con 0x7f5b5013c130 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): my global_id is 6903 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b30003560 con 0x7f5b5013c130 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385485329 0 0) 0x7f5b5013be60 con 0x7f5b50135bb0 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:39.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient(hunting): my global_id is 6837 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b50070270 con 0x7f5b50135bb0 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3734083084 0 0) 0x7f5b500719a0 con 0x7f5b501356f0 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 >> v1:172.21.15.106:6792/0 conn(0x7f5b50135bb0 legacy=0x7f5b501c8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 >> v1:172.21.15.106:6789/0 conn(0x7f5b5013c130 legacy=0x7f5b501d4630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 monclient: found mon.h 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b5006ff60 con 0x7f5b501356f0 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: _finish_auth 0 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:39.958 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 5 monclient: authenticate success, global_id 6701 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _renew_subs 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b501c94a0 con 0x7f5b501356f0 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _renew_subs 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b501d5d50 con 0x7f5b501356f0 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b400045f0 con 0x7f5b501356f0 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b40004b60 con 0x7f5b501356f0 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4dffb640 4 set_mon_vals no callback set 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b4cff9640 10 monclient: dump: 2024-04-26T00:01:39.959 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:39.960 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.958+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b34005090 con 0x7f5b501356f0 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.962+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5b40004d00 con 0x7f5b501356f0 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.962+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(219..219 src has 138..219) ==== 12674+0+0 (unknown 4015531293 0 0) 0x7f5b40046840 con 0x7f5b501356f0 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.962+0000 7f5b47fff640 10 monclient: get_auth_request con 0x7f5b30037a70 auth_method 0 2024-04-26T00:01:39.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.966+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5b40015820 con 0x7f5b501356f0 2024-04-26T00:01:39.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.966+0000 7f5b4cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:39.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:39.966+0000 7f5b4cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:40.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.130+0000 7f5b5611a640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h8"}] 2024-04-26T00:01:40.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.130+0000 7f5b5611a640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h8"}] 2024-04-26T00:01:40.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.130+0000 7f5b5611a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:40.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.130+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h8"} v 0) -- 0x7f5b34005380 con 0x7f5b501356f0 2024-04-26T00:01:40.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.742+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h8"}]=0 removed item id -40 name 'h8' from crush map v220) ==== 118+0+0 (unknown 2714944821 0 0) 0x7f5b40015120 con 0x7f5b501356f0 2024-04-26T00:01:40.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.742+0000 7f5b4cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h8"}] 2024-04-26T00:01:40.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.742+0000 7f5b4cff9640 10 monclient: _finish_command 2 = system:0 removed item id -40 name 'h8' from crush map 2024-04-26T00:01:40.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.846+0000 7f5b5611a640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h8"}] 2024-04-26T00:01:40.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.846+0000 7f5b5611a640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h8"}] 2024-04-26T00:01:40.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.846+0000 7f5b5611a640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:40.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.846+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h8"} v 0) -- 0x7f5b34002220 con 0x7f5b501356f0 2024-04-26T00:01:40.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.846+0000 7f5b4cff9640 1 -- 172.21.15.171:0/2295112261 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h8"}]=0 device 'h8' does not appear in the crush map v220) ==== 118+0+0 (unknown 3535788183 0 0) 0x7f5b4001dc60 con 0x7f5b501356f0 2024-04-26T00:01:40.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.846+0000 7f5b4cff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h8"}] 2024-04-26T00:01:40.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.846+0000 7f5b4cff9640 10 monclient: _finish_command 3 = system:0 device 'h8' does not appear in the crush map 2024-04-26T00:01:40.832 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h8' does not appear in the crush map 2024-04-26T00:01:40.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 >> v1:172.21.15.171:6812/722422047 conn(0x7f5b30037a70 legacy=0x7f5b30039f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:40.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 10 monclient: shutdown 2024-04-26T00:01:40.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:40.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 >> v1:172.21.15.171:6791/0 conn(0x7f5b501356f0 legacy=0x7f5b5013b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:40.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 shutdown_connections 2024-04-26T00:01:40.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 >> 172.21.15.171:0/2295112261 conn(0x7f5b500a2620 msgr2=0x7f5b50134270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:40.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 shutdown_connections 2024-04-26T00:01:40.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.850+0000 7f5b5611a640 1 -- 172.21.15.171:0/2295112261 wait complete. 2024-04-26T00:01:40.849 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:40.849 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h9 2024-04-26T00:01:40.965 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 10 monclient: get_monmap_and_config 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 10 monclient: build_initial_monmap 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 10 monclient: monmap: 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:40.988269+0000 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:40.988269+0000 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:40.966 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:40.967 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:40.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 1 Processor -- start 2024-04-26T00:01:40.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 1 -- start start 2024-04-26T00:01:40.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 10 monclient: init 2024-04-26T00:01:40.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:40.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.982+0000 7fa4aa0d0640 10 monclient: _add_conns ranks=[3,1,0,7,6,8,5,2,4] 2024-04-26T00:01:40.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): picked mon.noname-g con 0x7fa4a40a3930 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:40.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): picked mon.noname-f con 0x7fa4a4138150 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): picked mon.noname-a con 0x7fa4a4138570 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a40a2b70 con 0x7fa4a4138570 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a40a2e50 con 0x7fa4a4138150 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a40a4460 con 0x7fa4a40a3930 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a37fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fa4a40a3930 legacy=0x7fa4a4137a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): authenticate will time out at 1351.696138s 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa49affd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa4a4138150 0x7fa4a413cf70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47518/0 (socket says 172.21.15.171:47518) 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa49affd640 1 -- 172.21.15.171:0/1460583870 learned_addr learned my addr 172.21.15.171:0/1460583870 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:40.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071807707 0 0) 0x7fa4a40a2e50 con 0x7fa4a4138150 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient(hunting): my global_id is 145243 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa490003530 con 0x7fa4a4138150 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1571271449 0 0) 0x7fa490003530 con 0x7fa4a4138150 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 >> v1:172.21.15.171:6790/0 conn(0x7fa4a40a3930 legacy=0x7fa4a4137a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 >> v1:172.21.15.106:6789/0 conn(0x7fa4a4138570 legacy=0x7fa4a41406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:40.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 monclient: found mon.noname-f 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a40a1810 con 0x7fa4a4138150 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa48c0017c0 con 0x7fa4a4138150 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: dump: 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:40.980 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:40.981 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 5 monclient: authenticate success, global_id 145243 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa48c001b20 con 0x7fa4a4138150 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 4 set_mon_vals no callback set 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 1 -- 172.21.15.171:0/1460583870 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa48c001d50 con 0x7fa4a4138150 2024-04-26T00:01:40.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a2ffd640 10 monclient: dump: 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:40.983 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient: shutdown 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/1460583870 >> v1:172.21.15.171:6789/0 conn(0x7fa4a4138150 legacy=0x7fa4a413cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/1460583870 shutdown_connections 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/1460583870 >> 172.21.15.171:0/1460583870 conn(0x7fa4a40a6d70 msgr2=0x7fa4a40a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/1460583870 shutdown_connections 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/1460583870 wait complete. 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient: build_initial_monmap 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient: monmap: 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:40.984 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:40.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 Processor -- start 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- start start 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient: init 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient: _add_conns ranks=[3,2,7,1,6,0,4,8,5] 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): picked mon.noname-g con 0x7fa4a40a3930 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): picked mon.noname-b con 0x7fa4a4138150 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): picked mon.noname-i con 0x7fa4a4138570 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a40a1030 con 0x7fa4a4138150 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a37fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fa4a40a3930 legacy=0x7fa4a4133a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a4138d40 con 0x7fa4a40a3930 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4a409e9b0 con 0x7fa4a4138570 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4aa0d0640 10 monclient(hunting): authenticate will time out at 1351.699133s 2024-04-26T00:01:40.986 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a3fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fa4a4138570 0x7fa4a41d4cb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46338/0 (socket says 172.21.15.171:46338) 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a3fff640 1 -- 172.21.15.171:0/2374567196 learned_addr learned my addr 172.21.15.171:0/2374567196 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3777345692 0 0) 0x7fa4a409e9b0 con 0x7fa4a4138570 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): my global_id is 145231 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa484003530 con 0x7fa4a4138570 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1160149140 0 0) 0x7fa484003530 con 0x7fa4a4138570 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4a409e9b0 con 0x7fa4a4138570 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a3fff640 1 -- 172.21.15.171:0/2374567196 >> v1:172.21.15.171:6792/0 conn(0x7fa4a4138570 legacy=0x7fa4a41d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a3fff640 1 -- 172.21.15.171:0/2374567196 >> v1:172.21.15.171:6792/0 conn(0x7fa4a4138570 legacy=0x7fa4a41d4cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a3fff640 1 --1- 172.21.15.171:0/2374567196 >> v1:172.21.15.171:6792/0 conn(0x7fa4a4138570 0x7fa4a41d4cb0 :-1 s=OPENED pgs=227 cs=1 l=1).handle_message read tag failed 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a3fff640 1 --1- 172.21.15.171:0/2374567196 >> v1:172.21.15.171:6792/0 conn(0x7fa4a4138570 0x7fa4a41d4cb0 :-1 s=OPENED pgs=227 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.171:6792/0 2024-04-26T00:01:40.987 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060324767 0 0) 0x7fa4a40a1030 con 0x7fa4a4138150 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 10 monclient(hunting): my global_id is 6788 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.986+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa484003530 con 0x7fa4a4138150 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2014667505 0 0) 0x7fa484003530 con 0x7fa4a4138150 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4a40a1030 con 0x7fa4a4138150 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa48c001d50 con 0x7fa4a4138150 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient(hunting): dump: 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.988 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:40.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1798240320 0 0) 0x7fa4a40a1030 con 0x7fa4a4138150 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 >> v1:172.21.15.171:6792/0 conn(0x7fa4a4138570 legacy=0x7fa4a41d4cb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 >> v1:172.21.15.171:6790/0 conn(0x7fa4a40a3930 legacy=0x7fa4a4133a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 monclient: found mon.b 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4a4120b40 con 0x7fa4a4138150 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: _finish_auth 0 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:40.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 5 monclient: authenticate success, global_id 6788 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 10 monclient: _renew_subs 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4a41206f0 con 0x7fa4a4138150 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 10 monclient: _renew_subs 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4a4134130 con 0x7fa4a4138150 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa48c001b20 con 0x7fa4a4138150 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa48c004f70 con 0x7fa4a4138150 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a1ffb640 4 set_mon_vals no callback set 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:40.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 10 monclient: dump: 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:40.992 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa488005090 con 0x7fa4a4138150 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa48c00fd10 con 0x7fa4a4138150 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(220..220 src has 138..220) ==== 12464+0+0 (unknown 3147436639 0 0) 0x7fa48c046540 con 0x7fa4a4138150 2024-04-26T00:01:40.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:40.990+0000 7fa4a37fe640 10 monclient: get_auth_request con 0x7fa484037ad0 auth_method 0 2024-04-26T00:01:40.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.002+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa48c015580 con 0x7fa4a4138150 2024-04-26T00:01:40.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.002+0000 7fa4a0ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:40.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.002+0000 7fa4a0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.170+0000 7fa4aa0d0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h9"}] 2024-04-26T00:01:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.170+0000 7fa4aa0d0640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h9"}] 2024-04-26T00:01:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.170+0000 7fa4aa0d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:41.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.170+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "h9"} v 0) -- 0x7fa488005380 con 0x7fa4a4138150 2024-04-26T00:01:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.574+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h9"}]=0 removed item id -43 name 'h9' from crush map v221) ==== 118+0+0 (unknown 2717415021 0 0) 0x7fa48c01da30 con 0x7fa4a4138150 2024-04-26T00:01:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.574+0000 7fa4a0ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h9"}] 2024-04-26T00:01:41.557 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.574+0000 7fa4a0ff9640 10 monclient: _finish_command 2 = system:0 removed item id -43 name 'h9' from crush map 2024-04-26T00:01:41.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.698+0000 7fa4aa0d0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h9"}] 2024-04-26T00:01:41.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.698+0000 7fa4aa0d0640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h9"}] 2024-04-26T00:01:41.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.698+0000 7fa4aa0d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:41.680 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.698+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "h9"} v 0) -- 0x7fa4880010a0 con 0x7fa4a4138150 2024-04-26T00:01:41.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.698+0000 7fa4a0ff9640 1 -- 172.21.15.171:0/2374567196 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h9"}]=0 device 'h9' does not appear in the crush map v221) ==== 118+0+0 (unknown 298877331 0 0) 0x7fa48c0405b0 con 0x7fa4a4138150 2024-04-26T00:01:41.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.698+0000 7fa4a0ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h9"}] 2024-04-26T00:01:41.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.698+0000 7fa4a0ff9640 10 monclient: _finish_command 3 = system:0 device 'h9' does not appear in the crush map 2024-04-26T00:01:41.682 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h9' does not appear in the crush map 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 >> v1:172.21.15.171:6812/722422047 conn(0x7fa484037ad0 legacy=0x7fa484039f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 10 monclient: shutdown 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 >> v1:172.21.15.106:6790/0 conn(0x7fa4a4138150 legacy=0x7fa4a41d1580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 shutdown_connections 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 >> 172.21.15.171:0/2374567196 conn(0x7fa4a40a6d70 msgr2=0x7fa4a40a8830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 shutdown_connections 2024-04-26T00:01:41.685 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.702+0000 7fa4aa0d0640 1 -- 172.21.15.171:0/2374567196 wait complete. 2024-04-26T00:01:41.700 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:41.700 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h10 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient: get_monmap_and_config 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient: build_initial_monmap 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient: monmap: 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:41.831810+0000 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:41.831810+0000 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:41.809 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:41.810 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 1 Processor -- start 2024-04-26T00:01:41.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 1 -- start start 2024-04-26T00:01:41.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient: init 2024-04-26T00:01:41.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient: _add_conns ranks=[1,6,3,8,2,5,4,0,7] 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient(hunting): picked mon.noname-f con 0x7fb43c135c00 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient(hunting): picked mon.noname-d con 0x7fb43c135fe0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient(hunting): picked mon.noname-g con 0x7fb43c13c0d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c09a450 con 0x7fb43c135c00 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c09a730 con 0x7fb43c13c0d0 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c09aa10 con 0x7fb43c135fe0 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb4416ca640 10 monclient(hunting): authenticate will time out at 1352.539449s 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43b7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fb43c13c0d0 legacy=0x7fb43c13e4c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43affd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fb43c135c00 0x7fb43c09fea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47528/0 (socket says 172.21.15.171:47528) 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43affd640 1 -- 172.21.15.171:0/1062985631 learned_addr learned my addr 172.21.15.171:0/1062985631 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:41.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3604289768 0 0) 0x7fb43c09a450 con 0x7fb43c135c00 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43a7fc640 10 monclient(hunting): my global_id is 145252 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.826+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb428003530 con 0x7fb43c135c00 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1821912684 0 0) 0x7fb428003530 con 0x7fb43c135c00 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 >> v1:172.21.15.106:6792/0 conn(0x7fb43c135fe0 legacy=0x7fb43c13a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 >> v1:172.21.15.171:6790/0 conn(0x7fb43c13c0d0 legacy=0x7fb43c13e4c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 monclient: found mon.noname-f 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c0754e0 con 0x7fb43c135c00 2024-04-26T00:01:41.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb42c0017c0 con 0x7fb43c135c00 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 5 monclient: authenticate success, global_id 145252 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: dump: 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.820 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb42c001af0 con 0x7fb43c135c00 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 1 -- 172.21.15.171:0/1062985631 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb42c004bf0 con 0x7fb43c135c00 2024-04-26T00:01:41.821 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 4 set_mon_vals no callback set 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43a7fc640 10 monclient: dump: 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:41.822 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient: shutdown 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- 172.21.15.171:0/1062985631 >> v1:172.21.15.171:6789/0 conn(0x7fb43c135c00 legacy=0x7fb43c09fea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- 172.21.15.171:0/1062985631 shutdown_connections 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- 172.21.15.171:0/1062985631 >> 172.21.15.171:0/1062985631 conn(0x7fb43c0a6850 msgr2=0x7fb43c0a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- 172.21.15.171:0/1062985631 shutdown_connections 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- 172.21.15.171:0/1062985631 wait complete. 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient: build_initial_monmap 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient: monmap: 2024-04-26T00:01:41.823 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:41.824 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 Processor -- start 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- start start 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient: init 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient: _add_conns ranks=[8,0,4,5,7,1,2,6,3] 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient(hunting): picked mon.noname-e con 0x7fb43c135c00 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient(hunting): picked mon.noname-a con 0x7fb43c135fe0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient(hunting): picked mon.noname-c con 0x7fb43c13c0d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c137710 con 0x7fb43c135fe0 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c0a05f0 con 0x7fb43c13c0d0 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb43c1359d0 con 0x7fb43c135c00 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4416ca640 10 monclient(hunting): authenticate will time out at 1352.542358s 2024-04-26T00:01:41.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43affd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fb43c135c00 0x7fb43c1cae10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.171:56852/0 (socket says 172.21.15.171:56852) 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb43affd640 1 -- 172.21.15.171:0/4007990193 learned_addr learned my addr 172.21.15.171:0/4007990193 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb433fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb43c135fe0 0x7fb43c1cfe00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:50092/0 (socket says 172.21.15.171:50092) 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698331685 0 0) 0x7fb43c137710 con 0x7fb43c135fe0 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): my global_id is 6921 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41c003560 con 0x7fb43c135fe0 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2474683868 0 0) 0x7fb43c0a05f0 con 0x7fb43c13c0d0 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): my global_id is 145318 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb43c137710 con 0x7fb43c13c0d0 2024-04-26T00:01:41.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3581174003 0 0) 0x7fb43c1359d0 con 0x7fb43c135c00 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): my global_id is 204461 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb43c0a05f0 con 0x7fb43c135c00 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1103576150 0 0) 0x7fb41c003560 con 0x7fb43c135fe0 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb43c1359d0 con 0x7fb43c135fe0 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4240019d0 con 0x7fb43c135fe0 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): dump: 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:41.827 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2189620752 0 0) 0x7fb43c0a05f0 con 0x7fb43c135c00 2024-04-26T00:01:41.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb41c003560 con 0x7fb43c135c00 2024-04-26T00:01:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 488143132 0 0) 0x7fb43c137710 con 0x7fb43c13c0d0 2024-04-26T00:01:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb43c0a05f0 con 0x7fb43c13c0d0 2024-04-26T00:01:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb42c004b30 con 0x7fb43c135c00 2024-04-26T00:01:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:41.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): dump: 2024-04-26T00:01:41.830 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:41.830 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:41.830 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb434004460 con 0x7fb43c13c0d0 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.830+0000 7fb4337fe640 10 monclient(hunting): dump: 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:41.832 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3774586899 0 0) 0x7fb43c1359d0 con 0x7fb43c135fe0 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 >> v1:172.21.15.106:6793/0 conn(0x7fb43c135c00 legacy=0x7fb43c1cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 >> v1:172.21.15.106:6791/0 conn(0x7fb43c13c0d0 legacy=0x7fb43c1d3530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 monclient: found mon.a 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb43c137150 con 0x7fb43c135fe0 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:41.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 5 monclient: authenticate success, global_id 6921 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 10 monclient: _renew_subs 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb43c137430 con 0x7fb43c135fe0 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 10 monclient: _renew_subs 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb43c071850 con 0x7fb43c135fe0 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb4240038d0 con 0x7fb43c135fe0 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb424003e40 con 0x7fb43c135fe0 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:41.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb439ffb640 4 set_mon_vals no callback set 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 10 monclient: dump: 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:41.835 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb420005090 con 0x7fb43c135fe0 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb424004060 con 0x7fb43c135fe0 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(221..221 src has 138..221) ==== 12254+0+0 (unknown 1946895459 0 0) 0x7fb424046600 con 0x7fb43c135fe0 2024-04-26T00:01:41.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.834+0000 7fb43affd640 10 monclient: get_auth_request con 0x7fb41c038190 auth_method 0 2024-04-26T00:01:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.846+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb424015650 con 0x7fb43c135fe0 2024-04-26T00:01:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.846+0000 7fb4337fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:41.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.846+0000 7fb4337fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:41.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.998+0000 7fb4416ca640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h10"}] 2024-04-26T00:01:41.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.998+0000 7fb4416ca640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h10"}] 2024-04-26T00:01:41.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.998+0000 7fb4416ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:41.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:41.998+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h10"} v 0) -- 0x7fb420005380 con 0x7fb43c135fe0 2024-04-26T00:01:42.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.742+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h10"}]=0 removed item id -46 name 'h10' from crush map v222) ==== 120+0+0 (unknown 476927875 0 0) 0x7fb424019300 con 0x7fb43c135fe0 2024-04-26T00:01:42.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.742+0000 7fb4337fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h10"}] 2024-04-26T00:01:42.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.742+0000 7fb4337fe640 10 monclient: _finish_command 2 = system:0 removed item id -46 name 'h10' from crush map 2024-04-26T00:01:42.833 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.850+0000 7fb4416ca640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h10"}] 2024-04-26T00:01:42.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.850+0000 7fb4416ca640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h10"}] 2024-04-26T00:01:42.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.850+0000 7fb4416ca640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:01:42.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.850+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h10"} v 0) -- 0x7fb4200010a0 con 0x7fb43c135fe0 2024-04-26T00:01:42.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.850+0000 7fb4337fe640 1 -- 172.21.15.171:0/4007990193 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h10"}]=0 device 'h10' does not appear in the crush map v222) ==== 120+0+0 (unknown 3861204250 0 0) 0x7fb42401dbc0 con 0x7fb43c135fe0 2024-04-26T00:01:42.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.850+0000 7fb4337fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h10"}] 2024-04-26T00:01:42.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.850+0000 7fb4337fe640 10 monclient: _finish_command 3 = system:0 device 'h10' does not appear in the crush map 2024-04-26T00:01:42.835 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h10' does not appear in the crush map 2024-04-26T00:01:42.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 >> v1:172.21.15.171:6812/722422047 conn(0x7fb41c038190 legacy=0x7fb41c03a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:42.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 10 monclient: shutdown 2024-04-26T00:01:42.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:42.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 >> v1:172.21.15.106:6789/0 conn(0x7fb43c135fe0 legacy=0x7fb43c1cfe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:42.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 shutdown_connections 2024-04-26T00:01:42.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 >> 172.21.15.171:0/4007990193 conn(0x7fb43c0a6850 msgr2=0x7fb43c09b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:42.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 shutdown_connections 2024-04-26T00:01:42.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.854+0000 7fb4416ca640 1 -- 172.21.15.171:0/4007990193 wait complete. 2024-04-26T00:01:42.852 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:42.852 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h11 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient: get_monmap_and_config 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient: build_initial_monmap 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient: monmap: 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:42.995357+0000 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:42.995357+0000 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:42.973 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:42.974 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 1 Processor -- start 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 1 -- start start 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient: init 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient: _add_conns ranks=[3,8,1,0,4,6,2,5,7] 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient(hunting): picked mon.noname-g con 0x7ff6440a3930 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient(hunting): picked mon.noname-e con 0x7ff644138150 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:42.977 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient(hunting): picked mon.noname-f con 0x7ff644138570 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6440a2b70 con 0x7ff644138570 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6440a2e50 con 0x7ff6440a3930 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6440a4460 con 0x7ff644138150 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient(hunting): authenticate will time out at 1353.703012s 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64a4eb640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7ff6440a3930 legacy=0x7ff644137a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64acec640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff644138570 0x7ff6441406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47540/0 (socket says 172.21.15.171:47540) 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64acec640 1 -- 172.21.15.171:0/1606904062 learned_addr learned my addr 172.21.15.171:0/1606904062 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4161491012 0 0) 0x7ff6440a2b70 con 0x7ff644138570 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient(hunting): my global_id is 145261 2024-04-26T00:01:42.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff630003530 con 0x7ff644138570 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4276998595 0 0) 0x7ff630003530 con 0x7ff644138570 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 >> v1:172.21.15.106:6793/0 conn(0x7ff644138150 legacy=0x7ff64413cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 >> v1:172.21.15.171:6790/0 conn(0x7ff6440a3930 legacy=0x7ff644137a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: _finish_hunting 0 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 monclient: found mon.noname-f 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6440a1810 con 0x7ff644138570 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: _finish_auth 0 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: _check_auth_tickets 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff63c001b40 con 0x7ff644138570 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 5 monclient: authenticate success, global_id 145261 2024-04-26T00:01:42.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: dump: 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:42.980 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff63c001ea0 con 0x7ff644138570 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 1 -- 172.21.15.171:0/1606904062 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff63c004f70 con 0x7ff644138570 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff64c74f640 4 set_mon_vals no callback set 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.990+0000 7ff6494e9640 10 monclient: dump: 2024-04-26T00:01:42.981 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:42.982 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: shutdown 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/1606904062 >> v1:172.21.15.171:6789/0 conn(0x7ff644138570 legacy=0x7ff6441406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/1606904062 shutdown_connections 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/1606904062 >> 172.21.15.171:0/1606904062 conn(0x7ff6440a6d70 msgr2=0x7ff6440a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/1606904062 shutdown_connections 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/1606904062 wait complete. 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: build_initial_monmap 2024-04-26T00:01:42.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: monmap: 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:42.984 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:42.985 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:42.985 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:42.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 Processor -- start 2024-04-26T00:01:42.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- start start 2024-04-26T00:01:42.985 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: init 2024-04-26T00:01:42.988 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _add_conns ranks=[4,8,1,7,6,0,3,5,2] 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient(hunting): picked mon.noname-c con 0x7ff6440a3930 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient(hunting): picked mon.noname-e con 0x7ff644138150 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient(hunting): picked mon.noname-f con 0x7ff644138570 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff64409eb10 con 0x7ff644138570 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6440a1030 con 0x7ff6440a3930 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff644138d40 con 0x7ff644138150 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient(hunting): authenticate will time out at 1353.706112s 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64acec640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff644138570 0x7ff6441d4d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47544/0 (socket says 172.21.15.171:47544) 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64acec640 1 -- 172.21.15.171:0/2512422335 learned_addr learned my addr 172.21.15.171:0/2512422335 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417497942 0 0) 0x7ff64409eb10 con 0x7ff644138570 2024-04-26T00:01:42.989 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): my global_id is 145270 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff628003560 con 0x7ff644138570 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 347779417 0 0) 0x7ff628003560 con 0x7ff644138570 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff64409eb10 con 0x7ff644138570 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff63c001b00 con 0x7ff644138570 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): dump: 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.990 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1719458264 0 0) 0x7ff644138d40 con 0x7ff644138150 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:42.991 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): my global_id is 204479 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff628003560 con 0x7ff644138150 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446345851 0 0) 0x7ff640003a50 con 0x7ff6440a3930 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient(hunting): my global_id is 145327 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff644138d40 con 0x7ff6440a3930 2024-04-26T00:01:42.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1953151016 0 0) 0x7ff64409eb10 con 0x7ff644138570 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 >> v1:172.21.15.106:6793/0 conn(0x7ff644138150 legacy=0x7ff6441d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 >> v1:172.21.15.106:6791/0 conn(0x7ff6440a3930 legacy=0x7ff644133a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 monclient: found mon.f 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6441213e0 con 0x7ff644138570 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: _finish_auth 0 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 5 monclient: authenticate success, global_id 145270 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _renew_subs 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff644120b40 con 0x7ff644138570 2024-04-26T00:01:42.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _renew_subs 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff644134130 con 0x7ff644138570 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff63c001ea0 con 0x7ff644138570 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff648ce8640 4 set_mon_vals no callback set 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff63c005530 con 0x7ff644138570 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:42.994 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 10 monclient: dump: 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:42.995 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff62c005090 con 0x7ff644138570 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.994+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff63c0102d0 con 0x7ff644138570 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.998+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(222..222 src has 138..222) ==== 12041+0+0 (unknown 730208510 0 0) 0x7ff63c046ad0 con 0x7ff644138570 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:42.998+0000 7ff64a4eb640 10 monclient: get_auth_request con 0x7ff628037960 auth_method 0 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.002+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff63c015c90 con 0x7ff644138570 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.002+0000 7ff63affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:42.996 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.002+0000 7ff63affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.166+0000 7ff64c74f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h11"}] 2024-04-26T00:01:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.166+0000 7ff64c74f640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h11"}] 2024-04-26T00:01:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.166+0000 7ff64c74f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:43.149 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.166+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h11"} v 0) -- 0x7ff62c005380 con 0x7ff644138570 2024-04-26T00:01:43.769 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.786+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h11"}]=0 removed item id -49 name 'h11' from crush map v223) ==== 120+0+0 (unknown 1230033723 0 0) 0x7ff63c01e140 con 0x7ff644138570 2024-04-26T00:01:43.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.786+0000 7ff63affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h11"}] 2024-04-26T00:01:43.770 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.786+0000 7ff63affd640 10 monclient: _finish_command 2 = system:0 removed item id -49 name 'h11' from crush map 2024-04-26T00:01:43.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.890+0000 7ff64c74f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h11"}] 2024-04-26T00:01:43.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.890+0000 7ff64c74f640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h11"}] 2024-04-26T00:01:43.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.890+0000 7ff64c74f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:43.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.890+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h11"} v 0) -- 0x7ff62c002220 con 0x7ff644138570 2024-04-26T00:01:43.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff63affd640 1 -- 172.21.15.171:0/2512422335 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h11"}]=0 device 'h11' does not appear in the crush map v223) ==== 120+0+0 (unknown 1377658293 0 0) 0x7ff63c0427a0 con 0x7ff644138570 2024-04-26T00:01:43.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff63affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h11"}] 2024-04-26T00:01:43.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff63affd640 10 monclient: _finish_command 3 = system:0 device 'h11' does not appear in the crush map 2024-04-26T00:01:43.877 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h11' does not appear in the crush map 2024-04-26T00:01:43.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 >> v1:172.21.15.171:6812/722422047 conn(0x7ff628037960 legacy=0x7ff628039e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:43.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 10 monclient: shutdown 2024-04-26T00:01:43.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:43.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 >> v1:172.21.15.171:6789/0 conn(0x7ff644138570 legacy=0x7ff6441d4d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:43.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 shutdown_connections 2024-04-26T00:01:43.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 >> 172.21.15.171:0/2512422335 conn(0x7ff6440a6d70 msgr2=0x7ff6441369c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:43.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 shutdown_connections 2024-04-26T00:01:43.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:43.894+0000 7ff64c74f640 1 -- 172.21.15.171:0/2512422335 wait complete. 2024-04-26T00:01:43.894 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:43.894 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h12 2024-04-26T00:01:44.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.026+0000 7f11c7221640 10 monclient: get_monmap_and_config 2024-04-26T00:01:44.010 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.026+0000 7f11c7221640 10 monclient: build_initial_monmap 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.026+0000 7f11c7221640 10 monclient: monmap: 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:44.033262+0000 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:44.033262+0000 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:44.011 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:44.012 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:44.012 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:44.012 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:44.012 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.026+0000 7f11c7221640 1 Processor -- start 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.026+0000 7f11c7221640 1 -- start start 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.026+0000 7f11c7221640 10 monclient: init 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: _add_conns ranks=[6,5,7,1,3,8,0,4,2] 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): picked mon.noname-d con 0x7f11c0135bb0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): picked mon.noname-h con 0x7f11c01356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): picked mon.noname-i con 0x7f11c013c130 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:44.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c00a1da0 con 0x7f11c01356f0 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c00a1fe0 con 0x7f11c0135bb0 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c0072720 con 0x7f11c013c130 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): authenticate will time out at 1354.740174s 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bffff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f11c01356f0 0x7f11c013aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:51636/0 (socket says 172.21.15.171:51636) 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c57be640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f11c013c130 0x7f11c013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46340/0 (socket says 172.21.15.171:46340) 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bffff640 1 -- 172.21.15.171:0/709777624 learned_addr learned my addr 172.21.15.171:0/709777624 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277640977 0 0) 0x7f11c0072720 con 0x7f11c013c130 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:44.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): my global_id is 145240 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11a8003530 con 0x7f11c013c130 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304054852 0 0) 0x7f11c00a1da0 con 0x7f11c01356f0 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient(hunting): my global_id is 6710 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11c0072720 con 0x7f11c01356f0 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 950355459 0 0) 0x7f11a8003530 con 0x7f11c013c130 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 >> v1:172.21.15.106:6792/0 conn(0x7f11c0135bb0 legacy=0x7f11c0135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 >> v1:172.21.15.171:6791/0 conn(0x7f11c01356f0 legacy=0x7f11c013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 monclient: found mon.noname-i 2024-04-26T00:01:44.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c00a17f0 con 0x7f11c013c130 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11b8001b40 con 0x7f11c013c130 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 5 monclient: authenticate success, global_id 145240 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: dump: 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.023 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:44.024 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11b8001e20 con 0x7f11c013c130 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 4 set_mon_vals no callback set 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 1 -- 172.21.15.171:0/709777624 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11b8004eb0 con 0x7f11c013c130 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11bf7fe640 10 monclient: dump: 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:44.025 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: shutdown 2024-04-26T00:01:44.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- 172.21.15.171:0/709777624 >> v1:172.21.15.171:6792/0 conn(0x7f11c013c130 legacy=0x7f11c013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- 172.21.15.171:0/709777624 shutdown_connections 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- 172.21.15.171:0/709777624 >> 172.21.15.171:0/709777624 conn(0x7f11c00a2620 msgr2=0x7f11c00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- 172.21.15.171:0/709777624 shutdown_connections 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- 172.21.15.171:0/709777624 wait complete. 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: build_initial_monmap 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: monmap: 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:44.027 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:44.028 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 Processor -- start 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- start start 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: init 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient: _add_conns ranks=[4,8,0,1,3,5,7,2,6] 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): picked mon.noname-c con 0x7f11c01356f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): picked mon.noname-e con 0x7f11c0135bb0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): picked mon.noname-a con 0x7f11c013c130 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c0071ef0 con 0x7f11c013c130 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c00719a0 con 0x7f11c01356f0 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f11c0138e40 con 0x7f11c0135bb0 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c7221640 10 monclient(hunting): authenticate will time out at 1354.743270s 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c57be640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f11c013c130 0x7f11c0138030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:50096/0 (socket says 172.21.15.171:50096) 2024-04-26T00:01:44.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.030+0000 7f11c57be640 1 -- 172.21.15.171:0/1006949179 learned_addr learned my addr 172.21.15.171:0/1006949179 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771920626 0 0) 0x7f11c0071ef0 con 0x7f11c013c130 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): my global_id is 6930 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11ac003530 con 0x7f11c013c130 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543442682 0 0) 0x7f11c00719a0 con 0x7f11c01356f0 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): my global_id is 145336 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11c0071ef0 con 0x7f11c01356f0 2024-04-26T00:01:44.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3570654807 0 0) 0x7f11c0138e40 con 0x7f11c0135bb0 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): my global_id is 204488 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f11c00719a0 con 0x7f11c0135bb0 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bffff640 1 -- 172.21.15.171:0/1006949179 >> v1:172.21.15.106:6793/0 conn(0x7f11c0135bb0 legacy=0x7f11c0137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bffff640 1 -- 172.21.15.171:0/1006949179 >> v1:172.21.15.106:6793/0 conn(0x7f11c0135bb0 legacy=0x7f11c0137920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bffff640 1 --1- 172.21.15.171:0/1006949179 >> v1:172.21.15.106:6793/0 conn(0x7f11c0135bb0 0x7f11c0137920 :-1 s=OPENED pgs=137 cs=1 l=1).handle_message read tag failed 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bffff640 1 --1- 172.21.15.171:0/1006949179 >> v1:172.21.15.106:6793/0 conn(0x7f11c0135bb0 0x7f11c0137920 :-1 s=OPENED pgs=137 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6793/0 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1345208780 0 0) 0x7f11c0071ef0 con 0x7f11c01356f0 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11c0138e40 con 0x7f11c01356f0 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3297227818 0 0) 0x7f11ac003530 con 0x7f11c013c130 2024-04-26T00:01:44.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f11c0071ef0 con 0x7f11c013c130 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11b40019e0 con 0x7f11c01356f0 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): dump: 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:44.032 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11b8001b00 con 0x7f11c013c130 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient(hunting): dump: 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.033 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2288760031 0 0) 0x7f11c0138e40 con 0x7f11c01356f0 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 >> v1:172.21.15.106:6793/0 conn(0x7f11c0135bb0 legacy=0x7f11c0137920 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 >> v1:172.21.15.106:6789/0 conn(0x7f11c013c130 legacy=0x7f11c0138030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:44.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 monclient: found mon.c 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11c013b130 con 0x7f11c01356f0 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 5 monclient: authenticate success, global_id 145336 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 10 monclient: _renew_subs 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f11c013a890 con 0x7f11c01356f0 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 10 monclient: _renew_subs 2024-04-26T00:01:44.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f11c0139b70 con 0x7f11c01356f0 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f11b40038d0 con 0x7f11c01356f0 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11beffd640 4 set_mon_vals no callback set 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f11b4003dc0 con 0x7f11c01356f0 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 10 monclient: dump: 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:44.036 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:44.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:44.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11a0005090 con 0x7f11c01356f0 2024-04-26T00:01:44.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f11b4003f60 con 0x7f11c01356f0 2024-04-26T00:01:44.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(223..223 src has 138..223) ==== 11828+0+0 (unknown 3914831818 0 0) 0x7f11b40451a0 con 0x7f11c01356f0 2024-04-26T00:01:44.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.034+0000 7f11bffff640 10 monclient: get_auth_request con 0x7f11ac037e90 auth_method 0 2024-04-26T00:01:44.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.046+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f11b4014380 con 0x7f11c01356f0 2024-04-26T00:01:44.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.046+0000 7f11bd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:44.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.046+0000 7f11bd7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:44.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.214+0000 7f11c7221640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h12"}] 2024-04-26T00:01:44.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.214+0000 7f11c7221640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h12"}] 2024-04-26T00:01:44.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.214+0000 7f11c7221640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:44.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.214+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h12"} v 0) -- 0x7f11a0005380 con 0x7f11c01356f0 2024-04-26T00:01:44.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.794+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h12"}]=0 removed item id -52 name 'h12' from crush map v224) ==== 120+0+0 (unknown 1573842943 0 0) 0x7f11b4018030 con 0x7f11c01356f0 2024-04-26T00:01:44.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.794+0000 7f11bd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h12"}] 2024-04-26T00:01:44.779 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.794+0000 7f11bd7fa640 10 monclient: _finish_command 2 = system:0 removed item id -52 name 'h12' from crush map 2024-04-26T00:01:44.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.898+0000 7f11c7221640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h12"}] 2024-04-26T00:01:44.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.898+0000 7f11c7221640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h12"}] 2024-04-26T00:01:44.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.898+0000 7f11c7221640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:44.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.898+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h12"} v 0) -- 0x7f11a00010a0 con 0x7f11c01356f0 2024-04-26T00:01:44.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11bd7fa640 1 -- 172.21.15.171:0/1006949179 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h12"}]=0 device 'h12' does not appear in the crush map v224) ==== 120+0+0 (unknown 2813952508 0 0) 0x7f11b401c8f0 con 0x7f11c01356f0 2024-04-26T00:01:44.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11bd7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h12"}] 2024-04-26T00:01:44.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11bd7fa640 10 monclient: _finish_command 3 = system:0 device 'h12' does not appear in the crush map 2024-04-26T00:01:44.885 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h12' does not appear in the crush map 2024-04-26T00:01:44.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 >> v1:172.21.15.171:6812/722422047 conn(0x7f11ac037e90 legacy=0x7f11ac03a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:44.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 10 monclient: shutdown 2024-04-26T00:01:44.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:44.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 >> v1:172.21.15.106:6791/0 conn(0x7f11c01356f0 legacy=0x7f11c0137210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:44.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 shutdown_connections 2024-04-26T00:01:44.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 >> 172.21.15.171:0/1006949179 conn(0x7f11c00a2620 msgr2=0x7f11c01345e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:44.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 shutdown_connections 2024-04-26T00:01:44.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:44.902+0000 7f11c7221640 1 -- 172.21.15.171:0/1006949179 wait complete. 2024-04-26T00:01:44.903 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:44.903 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h13 2024-04-26T00:01:45.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: get_monmap_and_config 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: build_initial_monmap 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: monmap: 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:45.043413+0000 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:45.043413+0000 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:45.021 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:45.022 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:45.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 Processor -- start 2024-04-26T00:01:45.028 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- start start 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: init 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: _add_conns ranks=[1,7,0,6,2,8,5,3,4] 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient(hunting): picked mon.noname-f con 0x7fbacc06fe00 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient(hunting): picked mon.noname-i con 0x7fbacc06f600 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient(hunting): picked mon.noname-a con 0x7fbacc0701e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc06fa00 con 0x7fbacc0701e0 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc135400 con 0x7fbacc06fe00 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc071670 con 0x7fbacc06f600 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient(hunting): authenticate will time out at 1355.750341s 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbaca59c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fbacc06fe00 0x7fbacc1345e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47560/0 (socket says 172.21.15.171:47560) 2024-04-26T00:01:45.029 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbaca59c640 1 -- 172.21.15.171:0/1322369018 learned_addr learned my addr 172.21.15.171:0/1322369018 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac9d9b640 1 --1- 172.21.15.171:0/1322369018 >> v1:172.21.15.171:6792/0 conn(0x7fbacc06f600 0x7fbacc134cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46342/0 (socket says 172.21.15.171:46342) 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929065054 0 0) 0x7fbacc135400 con 0x7fbacc06fe00 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): my global_id is 145279 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbab4003530 con 0x7fbacc06fe00 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547343316 0 0) 0x7fbacc071670 con 0x7fbacc06f600 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient(hunting): my global_id is 145249 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbacc135400 con 0x7fbacc06f600 2024-04-26T00:01:45.030 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1488086219 0 0) 0x7fbab4003530 con 0x7fbacc06fe00 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 >> v1:172.21.15.171:6792/0 conn(0x7fbacc06f600 legacy=0x7fbacc134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 >> v1:172.21.15.106:6789/0 conn(0x7fbacc0701e0 legacy=0x7fbacc13d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: _finish_hunting 0 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 monclient: found mon.noname-f 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc070630 con 0x7fbacc06fe00 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: _finish_auth 0 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: _check_auth_tickets 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 5 monclient: authenticate success, global_id 145279 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbac4001a70 con 0x7fbacc06fe00 2024-04-26T00:01:45.031 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: dump: 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:45.032 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbac4001c60 con 0x7fbacc06fe00 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:45.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 1 -- 172.21.15.171:0/1322369018 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbac4004c30 con 0x7fbacc06fe00 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 4 set_mon_vals no callback set 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbac959a640 10 monclient: dump: 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:45.034 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 10 monclient: shutdown 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- 172.21.15.171:0/1322369018 >> v1:172.21.15.171:6789/0 conn(0x7fbacc06fe00 legacy=0x7fbacc1345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:45.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- 172.21.15.171:0/1322369018 shutdown_connections 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- 172.21.15.171:0/1322369018 >> 172.21.15.171:0/1322369018 conn(0x7fbacc0a2620 msgr2=0x7fbacc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.038+0000 7fbad0a2c640 1 -- 172.21.15.171:0/1322369018 shutdown_connections 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- 172.21.15.171:0/1322369018 wait complete. 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: build_initial_monmap 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: monmap: 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:45.036 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:45.037 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 Processor -- start 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- start start 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: init 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _add_conns ranks=[3,1,7,8,6,4,5,2,0] 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient(hunting): picked mon.noname-g con 0x7fbacc06f600 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient(hunting): picked mon.noname-f con 0x7fbacc06fe00 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient(hunting): picked mon.noname-i con 0x7fbacc0701e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc123a40 con 0x7fbacc06fe00 2024-04-26T00:01:45.038 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbaca59c640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fbacc06f600 legacy=0x7fbacc12f2f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc122590 con 0x7fbacc06f600 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbacc070d60 con 0x7fbacc0701e0 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient(hunting): authenticate will time out at 1355.753540s 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbacad9d640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fbacc0701e0 0x7fbacc1d5100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46350/0 (socket says 172.21.15.171:46350) 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbacad9d640 1 -- 172.21.15.171:0/2852170062 learned_addr learned my addr 172.21.15.171:0/2852170062 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbac9d9b640 1 --1- 172.21.15.171:0/2852170062 >> v1:172.21.15.171:6789/0 conn(0x7fbacc06fe00 0x7fbacc1d19d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47576/0 (socket says 172.21.15.171:47576) 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2755454402 0 0) 0x7fbacc123a40 con 0x7fbacc06fe00 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:45.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): my global_id is 145288 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaac003530 con 0x7fbacc06fe00 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2837064071 0 0) 0x7fbacc070d60 con 0x7fbacc0701e0 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): my global_id is 145258 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbacc123a40 con 0x7fbacc0701e0 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2717650574 0 0) 0x7fbacc123a40 con 0x7fbacc0701e0 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbacc070d60 con 0x7fbacc0701e0 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3343190723 0 0) 0x7fbaac003530 con 0x7fbacc06fe00 2024-04-26T00:01:45.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbacc123a40 con 0x7fbacc06fe00 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbabc001900 con 0x7fbacc0701e0 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): dump: 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:45.041 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:45.042 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbac0001330 con 0x7fbacc06fe00 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient(hunting): dump: 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:45.043 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2027408395 0 0) 0x7fbacc070d60 con 0x7fbacc0701e0 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 >> v1:172.21.15.171:6790/0 conn(0x7fbacc06f600 legacy=0x7fbacc12f2f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 >> v1:172.21.15.171:6789/0 conn(0x7fbacc06fe00 legacy=0x7fbacc1d19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 monclient: found mon.i 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbacc070880 con 0x7fbacc0701e0 2024-04-26T00:01:45.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 5 monclient: authenticate success, global_id 145258 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _renew_subs 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbacc123760 con 0x7fbacc0701e0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _renew_subs 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbacc1cc8d0 con 0x7fbacc0701e0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbabc001d10 con 0x7fbacc0701e0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbabc003c10 con 0x7fbacc0701e0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbac8d99640 4 set_mon_vals no callback set 2024-04-26T00:01:45.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 10 monclient: dump: 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:45.046 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbab0005090 con 0x7fbacc0701e0 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbabc003db0 con 0x7fbacc0701e0 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(224..224 src has 138..224) ==== 11615+0+0 (unknown 4131706054 0 0) 0x7fbabc0462f0 con 0x7fbacc0701e0 2024-04-26T00:01:45.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.042+0000 7fbaca59c640 10 monclient: get_auth_request con 0x7fbaac037d40 auth_method 0 2024-04-26T00:01:45.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.050+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbabc015660 con 0x7fbacc0701e0 2024-04-26T00:01:45.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.050+0000 7fbabaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:45.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.050+0000 7fbabaffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:45.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.218+0000 7fbad0a2c640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h13"}] 2024-04-26T00:01:45.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.218+0000 7fbad0a2c640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h13"}] 2024-04-26T00:01:45.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.218+0000 7fbad0a2c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:45.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.218+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h13"} v 0) -- 0x7fbab0005380 con 0x7fbacc0701e0 2024-04-26T00:01:45.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.818+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h13"}]=0 removed item id -55 name 'h13' from crush map v225) ==== 120+0+0 (unknown 1787167124 0 0) 0x7fbabc014f60 con 0x7fbacc0701e0 2024-04-26T00:01:45.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.818+0000 7fbabaffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h13"}] 2024-04-26T00:01:45.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.818+0000 7fbabaffd640 10 monclient: _finish_command 2 = system:0 removed item id -55 name 'h13' from crush map 2024-04-26T00:01:45.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.926+0000 7fbad0a2c640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h13"}] 2024-04-26T00:01:45.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.926+0000 7fbad0a2c640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h13"}] 2024-04-26T00:01:45.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.926+0000 7fbad0a2c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:45.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.926+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h13"} v 0) -- 0x7fbab0002220 con 0x7fbacc0701e0 2024-04-26T00:01:45.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.926+0000 7fbabaffd640 1 -- 172.21.15.171:0/2852170062 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h13"}]=0 device 'h13' does not appear in the crush map v225) ==== 120+0+0 (unknown 327264595 0 0) 0x7fbabc01db10 con 0x7fbacc0701e0 2024-04-26T00:01:45.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.926+0000 7fbabaffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h13"}] 2024-04-26T00:01:45.910 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.926+0000 7fbabaffd640 10 monclient: _finish_command 3 = system:0 device 'h13' does not appear in the crush map 2024-04-26T00:01:45.910 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h13' does not appear in the crush map 2024-04-26T00:01:45.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 >> v1:172.21.15.171:6812/722422047 conn(0x7fbaac037d40 legacy=0x7fbaac03a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:45.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 10 monclient: shutdown 2024-04-26T00:01:45.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:45.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 >> v1:172.21.15.171:6792/0 conn(0x7fbacc0701e0 legacy=0x7fbacc1d5100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:45.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 shutdown_connections 2024-04-26T00:01:45.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 >> 172.21.15.171:0/2852170062 conn(0x7fbacc0a2620 msgr2=0x7fbacc06ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:45.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 shutdown_connections 2024-04-26T00:01:45.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:45.930+0000 7fbad0a2c640 1 -- 172.21.15.171:0/2852170062 wait complete. 2024-04-26T00:01:45.927 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:45.927 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h14 2024-04-26T00:01:46.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient: get_monmap_and_config 2024-04-26T00:01:46.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient: build_initial_monmap 2024-04-26T00:01:46.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient: monmap: 2024-04-26T00:01:46.045 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:46.045 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:46.067565+0000 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:46.067565+0000 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:46.046 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:46.047 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:46.047 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:46.047 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:46.047 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:46.047 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 1 Processor -- start 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 1 -- start start 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient: init 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient: _add_conns ranks=[7,2,1,0,8,6,5,3,4] 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient(hunting): picked mon.noname-i con 0x7f0f20135bb0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient(hunting): picked mon.noname-b con 0x7f0f201356f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient(hunting): picked mon.noname-f con 0x7f0f2013c130 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:46.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f200a1da0 con 0x7f0f2013c130 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f200a1fe0 con 0x7f0f201356f0 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f20072720 con 0x7f0f20135bb0 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient(hunting): authenticate will time out at 1356.774800s 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1f7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f0f2013c130 0x7f0f2013e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47578/0 (socket says 172.21.15.171:47578) 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1f7fe640 1 -- 172.21.15.171:0/497508640 learned_addr learned my addr 172.21.15.171:0/497508640 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1effd640 1 --1- 172.21.15.171:0/497508640 >> v1:172.21.15.171:6792/0 conn(0x7f0f20135bb0 0x7f0f20135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46366/0 (socket says 172.21.15.171:46366) 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2539498165 0 0) 0x7f0f200a1da0 con 0x7f0f2013c130 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): my global_id is 145297 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f0c003530 con 0x7f0f2013c130 2024-04-26T00:01:46.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3227408268 0 0) 0x7f0f20072720 con 0x7f0f20135bb0 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient(hunting): my global_id is 145267 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f200a1da0 con 0x7f0f20135bb0 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1126844525 0 0) 0x7f0f0c003530 con 0x7f0f2013c130 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 >> v1:172.21.15.171:6792/0 conn(0x7f0f20135bb0 legacy=0x7f0f20135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 >> v1:172.21.15.106:6790/0 conn(0x7f0f201356f0 legacy=0x7f0f2013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 monclient: found mon.noname-f 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:46.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f200a17f0 con 0x7f0f2013c130 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f180017c0 con 0x7f0f2013c130 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: dump: 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:46.059 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 5 monclient: authenticate success, global_id 145297 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f18001a20 con 0x7f0f2013c130 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 1 -- 172.21.15.171:0/497508640 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f18004bf0 con 0x7f0f2013c130 2024-04-26T00:01:46.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f254c6640 4 set_mon_vals no callback set 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.062+0000 7f0f1dffb640 10 monclient: dump: 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:46.061 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: shutdown 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/497508640 >> v1:172.21.15.171:6789/0 conn(0x7f0f2013c130 legacy=0x7f0f2013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/497508640 shutdown_connections 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/497508640 >> 172.21.15.171:0/497508640 conn(0x7f0f200a2620 msgr2=0x7f0f200a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/497508640 shutdown_connections 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/497508640 wait complete. 2024-04-26T00:01:46.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: build_initial_monmap 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: monmap: 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:46.063 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 Processor -- start 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- start start 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: init 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _add_conns ranks=[5,7,8,0,4,1,2,6,3] 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient(hunting): picked mon.noname-h con 0x7f0f201356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient(hunting): picked mon.noname-i con 0x7f0f20135bb0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient(hunting): picked mon.noname-e con 0x7f0f2013c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f201314e0 con 0x7f0f201356f0 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2012fce0 con 0x7f0f20135bb0 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f2012f180 con 0x7f0f2013c130 2024-04-26T00:01:46.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient(hunting): authenticate will time out at 1356.777778s 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f1effd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f0f201356f0 0x7f0f20132a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:51642/0 (socket says 172.21.15.171:51642) 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f1effd640 1 -- 172.21.15.171:0/3100936729 learned_addr learned my addr 172.21.15.171:0/3100936729 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f1e7fc640 1 --1- 172.21.15.171:0/3100936729 >> v1:172.21.15.171:6792/0 conn(0x7f0f20135bb0 0x7f0f201cf380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46378/0 (socket says 172.21.15.171:46378) 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3340690855 0 0) 0x7f0f201314e0 con 0x7f0f201356f0 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): my global_id is 6719 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f00003530 con 0x7f0f201356f0 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 713726523 0 0) 0x7f0f2012fce0 con 0x7f0f20135bb0 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:46.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): my global_id is 145276 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f201314e0 con 0x7f0f20135bb0 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 353998527 0 0) 0x7f0f00003530 con 0x7f0f201356f0 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f2012fce0 con 0x7f0f201356f0 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1040731963 0 0) 0x7f0f201314e0 con 0x7f0f20135bb0 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f00003530 con 0x7f0f20135bb0 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f10001620 con 0x7f0f201356f0 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): dump: 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.066 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f08001d60 con 0x7f0f20135bb0 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:46.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): dump: 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:46.068 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555489272 0 0) 0x7f0f2012f180 con 0x7f0f2013c130 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient(hunting): my global_id is 204497 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f201314e0 con 0x7f0f2013c130 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1524284586 0 0) 0x7f0f2012fce0 con 0x7f0f201356f0 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 >> v1:172.21.15.106:6793/0 conn(0x7f0f2013c130 legacy=0x7f0f201d2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 >> v1:172.21.15.171:6792/0 conn(0x7f0f20135bb0 legacy=0x7f0f201cf380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:46.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 monclient: found mon.h 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f20130c40 con 0x7f0f201356f0 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 5 monclient: authenticate success, global_id 6719 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _renew_subs 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f2012ff20 con 0x7f0f201356f0 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _renew_subs 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f201cac90 con 0x7f0f201356f0 2024-04-26T00:01:46.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f10004aa0 con 0x7f0f201356f0 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f10004f90 con 0x7f0f201356f0 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f1d7fa640 4 set_mon_vals no callback set 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 10 monclient: dump: 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:46.071 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f04005090 con 0x7f0f201356f0 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0f1000fd30 con 0x7f0f201356f0 2024-04-26T00:01:46.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.066+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(225..225 src has 138..225) ==== 11402+0+0 (unknown 3950731754 0 0) 0x7f0f100464f0 con 0x7f0f201356f0 2024-04-26T00:01:46.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.070+0000 7f0f1e7fc640 10 monclient: get_auth_request con 0x7f0f00037d50 auth_method 0 2024-04-26T00:01:46.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.074+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0f100158d0 con 0x7f0f201356f0 2024-04-26T00:01:46.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.074+0000 7f0f177fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:46.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.074+0000 7f0f177fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:46.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.238+0000 7f0f254c6640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h14"}] 2024-04-26T00:01:46.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.238+0000 7f0f254c6640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h14"}] 2024-04-26T00:01:46.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.238+0000 7f0f254c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:46.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.238+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h14"} v 0) -- 0x7f0f04005380 con 0x7f0f201356f0 2024-04-26T00:01:46.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.822+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h14"}]=0 removed item id -58 name 'h14' from crush map v226) ==== 120+0+0 (unknown 2081339320 0 0) 0x7f0f100151d0 con 0x7f0f201356f0 2024-04-26T00:01:46.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.822+0000 7f0f177fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h14"}] 2024-04-26T00:01:46.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.822+0000 7f0f177fe640 10 monclient: _finish_command 2 = system:0 removed item id -58 name 'h14' from crush map 2024-04-26T00:01:46.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.926+0000 7f0f254c6640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h14"}] 2024-04-26T00:01:46.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.926+0000 7f0f254c6640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h14"}] 2024-04-26T00:01:46.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.926+0000 7f0f254c6640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:46.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.926+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h14"} v 0) -- 0x7f0f04002220 con 0x7f0f201356f0 2024-04-26T00:01:46.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.930+0000 7f0f177fe640 1 -- 172.21.15.171:0/3100936729 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h14"}]=0 device 'h14' does not appear in the crush map v226) ==== 120+0+0 (unknown 636513093 0 0) 0x7f0f10019520 con 0x7f0f201356f0 2024-04-26T00:01:46.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.930+0000 7f0f177fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h14"}] 2024-04-26T00:01:46.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.930+0000 7f0f177fe640 10 monclient: _finish_command 3 = system:0 device 'h14' does not appear in the crush map 2024-04-26T00:01:46.913 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h14' does not appear in the crush map 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 >> v1:172.21.15.171:6812/722422047 conn(0x7f0f00037d50 legacy=0x7f0f0003a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 10 monclient: shutdown 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 >> v1:172.21.15.171:6791/0 conn(0x7f0f201356f0 legacy=0x7f0f20132a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 shutdown_connections 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 >> 172.21.15.171:0/3100936729 conn(0x7f0f200a2620 msgr2=0x7f0f201338b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 shutdown_connections 2024-04-26T00:01:46.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:46.934+0000 7f0f254c6640 1 -- 172.21.15.171:0/3100936729 wait complete. 2024-04-26T00:01:46.931 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:46.931 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h15 2024-04-26T00:01:47.046 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.062+0000 7fc805a36640 10 monclient: get_monmap_and_config 2024-04-26T00:01:47.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.062+0000 7fc805a36640 10 monclient: build_initial_monmap 2024-04-26T00:01:47.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.062+0000 7fc805a36640 10 monclient: monmap: 2024-04-26T00:01:47.048 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:47.048 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:47.048 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:47.069383+0000 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:47.069383+0000 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:47.049 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:47.050 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:47.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.062+0000 7fc805a36640 1 Processor -- start 2024-04-26T00:01:47.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.062+0000 7fc805a36640 1 -- start start 2024-04-26T00:01:47.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.062+0000 7fc805a36640 10 monclient: init 2024-04-26T00:01:47.056 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: _add_conns ranks=[4,7,0,8,6,3,5,2,1] 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): picked mon.noname-c con 0x7fc800072210 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): picked mon.noname-i con 0x7fc800137e20 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): picked mon.noname-a con 0x7fc80013e3a0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc800072d00 con 0x7fc80013e3a0 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80006faa0 con 0x7fc800072210 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc800072f20 con 0x7fc800137e20 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): authenticate will time out at 1357.776312s 2024-04-26T00:01:47.057 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fe7fc640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fc800137e20 0x7fc80013cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46390/0 (socket says 172.21.15.171:46390) 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fe7fc640 1 -- 172.21.15.171:0/1446465245 learned_addr learned my addr 172.21.15.171:0/1446465245 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426427059 0 0) 0x7fc800072f20 con 0x7fc800137e20 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient(hunting): my global_id is 145285 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7e8003530 con 0x7fc800137e20 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2030135298 0 0) 0x7fc7e8003530 con 0x7fc800137e20 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 >> v1:172.21.15.106:6791/0 conn(0x7fc800072210 legacy=0x7fc8000725f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 >> v1:172.21.15.106:6789/0 conn(0x7fc80013e3a0 legacy=0x7fc800140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 monclient: found mon.noname-i 2024-04-26T00:01:47.058 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc80006f200 con 0x7fc800137e20 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7f0001800 con 0x7fc800137e20 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: dump: 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.059 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 5 monclient: authenticate success, global_id 145285 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7f0001aa0 con 0x7fc800137e20 2024-04-26T00:01:47.060 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 4 set_mon_vals no callback set 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 1 -- 172.21.15.171:0/1446465245 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7f0004bf0 con 0x7fc800137e20 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7fdffb640 10 monclient: dump: 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:47.061 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: shutdown 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- 172.21.15.171:0/1446465245 >> v1:172.21.15.171:6792/0 conn(0x7fc800137e20 legacy=0x7fc80013cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- 172.21.15.171:0/1446465245 shutdown_connections 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- 172.21.15.171:0/1446465245 >> 172.21.15.171:0/1446465245 conn(0x7fc8000a2620 msgr2=0x7fc8000a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- 172.21.15.171:0/1446465245 shutdown_connections 2024-04-26T00:01:47.062 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- 172.21.15.171:0/1446465245 wait complete. 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: build_initial_monmap 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: monmap: 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:47.063 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 Processor -- start 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- start start 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: init 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient: _add_conns ranks=[0,4,3,1,6,8,7,5,2] 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): picked mon.noname-a con 0x7fc800072210 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): picked mon.noname-c con 0x7fc800137e20 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): picked mon.noname-g con 0x7fc80013e3a0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:47.064 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc80012b070 con 0x7fc800072210 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc800131e60 con 0x7fc80013e3a0 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc800134260 con 0x7fc800137e20 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc805a36640 10 monclient(hunting): authenticate will time out at 1357.779305s 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7ff7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fc80013e3a0 legacy=0x7fc8001d4a70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7feffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc800072210 0x7fc80012a250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:50114/0 (socket says 172.21.15.171:50114) 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7feffd640 1 -- 172.21.15.171:0/2535070369 learned_addr learned my addr 172.21.15.171:0/2535070369 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611859576 0 0) 0x7fc80012b070 con 0x7fc800072210 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:47.065 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): my global_id is 6957 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7ec003530 con 0x7fc800072210 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675283292 0 0) 0x7fc800134260 con 0x7fc800137e20 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 10 monclient(hunting): my global_id is 145354 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.066+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc80012b070 con 0x7fc800137e20 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 865012282 0 0) 0x7fc7ec003530 con 0x7fc800072210 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc800134260 con 0x7fc800072210 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4981368 0 0) 0x7fc80012b070 con 0x7fc800137e20 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7ec003530 con 0x7fc800137e20 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7f4001ae0 con 0x7fc800072210 2024-04-26T00:01:47.066 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient(hunting): dump: 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:47.067 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7f00017c0 con 0x7fc800137e20 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient(hunting): dump: 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:47.068 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2386990030 0 0) 0x7fc7ec003530 con 0x7fc800137e20 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 >> v1:172.21.15.171:6790/0 conn(0x7fc80013e3a0 legacy=0x7fc8001d4a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 >> v1:172.21.15.106:6789/0 conn(0x7fc800072210 legacy=0x7fc80012a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:47.069 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 monclient: found mon.c 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8001339c0 con 0x7fc800137e20 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 5 monclient: authenticate success, global_id 145354 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 10 monclient: _renew_subs 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc800132ad0 con 0x7fc800137e20 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 10 monclient: _renew_subs 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc800134be0 con 0x7fc800137e20 2024-04-26T00:01:47.070 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7f0001210 con 0x7fc800137e20 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7f0001ce0 con 0x7fc800137e20 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7fd7fa640 4 set_mon_vals no callback set 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 10 monclient: dump: 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:47.071 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7e0005090 con 0x7fc800137e20 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc7f000fdb0 con 0x7fc800137e20 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(226..226 src has 138..226) ==== 11189+0+0 (unknown 3653601058 0 0) 0x7fc7f00460d0 con 0x7fc800137e20 2024-04-26T00:01:47.072 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.070+0000 7fc7feffd640 10 monclient: get_auth_request con 0x7fc7ec037df0 auth_method 0 2024-04-26T00:01:47.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.082+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc7f0015590 con 0x7fc800137e20 2024-04-26T00:01:47.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.082+0000 7fc7e7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:47.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.082+0000 7fc7e7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:47.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.246+0000 7fc805a36640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h15"}] 2024-04-26T00:01:47.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.246+0000 7fc805a36640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h15"}] 2024-04-26T00:01:47.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.246+0000 7fc805a36640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:47.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.246+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h15"} v 0) -- 0x7fc7e0005380 con 0x7fc800137e20 2024-04-26T00:01:47.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.854+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h15"}]=0 removed item id -61 name 'h15' from crush map v227) ==== 120+0+0 (unknown 2331712592 0 0) 0x7fc7f00191e0 con 0x7fc800137e20 2024-04-26T00:01:47.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.854+0000 7fc7e7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h15"}] 2024-04-26T00:01:47.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.854+0000 7fc7e7fff640 10 monclient: _finish_command 2 = system:0 removed item id -61 name 'h15' from crush map 2024-04-26T00:01:47.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.958+0000 7fc805a36640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h15"}] 2024-04-26T00:01:47.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.958+0000 7fc805a36640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h15"}] 2024-04-26T00:01:47.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.958+0000 7fc805a36640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:01:47.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.958+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h15"} v 0) -- 0x7fc7e00010a0 con 0x7fc800137e20 2024-04-26T00:01:47.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc7e7fff640 1 -- 172.21.15.171:0/2535070369 <== mon.4 v1:172.21.15.106:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h15"}]=0 device 'h15' does not appear in the crush map v227) ==== 120+0+0 (unknown 2445820906 0 0) 0x7fc7f001daa0 con 0x7fc800137e20 2024-04-26T00:01:47.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc7e7fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h15"}] 2024-04-26T00:01:47.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc7e7fff640 10 monclient: _finish_command 3 = system:0 device 'h15' does not appear in the crush map 2024-04-26T00:01:47.944 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h15' does not appear in the crush map 2024-04-26T00:01:47.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 >> v1:172.21.15.171:6812/722422047 conn(0x7fc7ec037df0 legacy=0x7fc7ec03a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:47.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 10 monclient: shutdown 2024-04-26T00:01:47.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:47.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 >> v1:172.21.15.106:6791/0 conn(0x7fc800137e20 legacy=0x7fc80012a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:47.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 shutdown_connections 2024-04-26T00:01:47.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 >> 172.21.15.171:0/2535070369 conn(0x7fc8000a2620 msgr2=0x7fc8000a39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:47.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 shutdown_connections 2024-04-26T00:01:47.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:47.962+0000 7fc805a36640 1 -- 172.21.15.171:0/2535070369 wait complete. 2024-04-26T00:01:47.960 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:47.960 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h16 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient: get_monmap_and_config 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient: build_initial_monmap 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient: monmap: 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:48.099638+0000 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:48.099638+0000 2024-04-26T00:01:48.077 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:48.078 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:48.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 1 Processor -- start 2024-04-26T00:01:48.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 1 -- start start 2024-04-26T00:01:48.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient: init 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient: _add_conns ranks=[3,1,8,2,0,6,4,7,5] 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient(hunting): picked mon.noname-g con 0x7ff9900a52c0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient(hunting): picked mon.noname-f con 0x7ff9900a4a30 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient(hunting): picked mon.noname-e con 0x7ff99013e3a0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9900a2fe0 con 0x7ff9900a4a30 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9900a5db0 con 0x7ff9900a52c0 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9900a2a20 con 0x7ff99013e3a0 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff995e92640 10 monclient(hunting): authenticate will time out at 1358.807385s 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff98f7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7ff9900a52c0 legacy=0x7ff9900a56a0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff98effd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff9900a4a30 0x7ff99013cc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47580/0 (socket says 172.21.15.171:47580) 2024-04-26T00:01:48.081 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.094+0000 7ff98effd640 1 -- 172.21.15.171:0/2080452949 learned_addr learned my addr 172.21.15.171:0/2080452949 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3485619796 0 0) 0x7ff984001120 con 0x7ff9900a4a30 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): my global_id is 145306 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff978003530 con 0x7ff9900a4a30 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678539511 0 0) 0x7ff9900a2a20 con 0x7ff99013e3a0 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient(hunting): my global_id is 204506 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff984001120 con 0x7ff99013e3a0 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3362555981 0 0) 0x7ff978003530 con 0x7ff9900a4a30 2024-04-26T00:01:48.082 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 >> v1:172.21.15.106:6793/0 conn(0x7ff99013e3a0 legacy=0x7ff990140790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 >> v1:172.21.15.171:6790/0 conn(0x7ff9900a52c0 legacy=0x7ff9900a56a0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 monclient: found mon.noname-f 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900a2d00 con 0x7ff9900a4a30 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff984001990 con 0x7ff9900a4a30 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: dump: 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:48.083 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 5 monclient: authenticate success, global_id 145306 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:48.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff984001cb0 con 0x7ff9900a4a30 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 4 set_mon_vals no callback set 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 1 -- 172.21.15.171:0/2080452949 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff984004bf0 con 0x7ff9900a4a30 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98e7fc640 10 monclient: dump: 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:48.085 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:48.086 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:48.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: shutdown 2024-04-26T00:01:48.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:48.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- 172.21.15.171:0/2080452949 >> v1:172.21.15.171:6789/0 conn(0x7ff9900a4a30 legacy=0x7ff99013cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:48.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- 172.21.15.171:0/2080452949 shutdown_connections 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- 172.21.15.171:0/2080452949 >> 172.21.15.171:0/2080452949 conn(0x7ff9900aa030 msgr2=0x7ff9900aa440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- 172.21.15.171:0/2080452949 shutdown_connections 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- 172.21.15.171:0/2080452949 wait complete. 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: build_initial_monmap 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: monmap: 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:48.091 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 Processor -- start 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- start start 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: init 2024-04-26T00:01:48.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: _add_conns ranks=[5,2,0,6,1,4,8,3,7] 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient(hunting): picked mon.noname-h con 0x7ff9900a4a30 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient(hunting): picked mon.noname-b con 0x7ff9900a52c0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient(hunting): picked mon.noname-a con 0x7ff99013e3a0 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99013d550 con 0x7ff99013e3a0 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff99012f580 con 0x7ff9900a52c0 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9900a1f50 con 0x7ff9900a4a30 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient(hunting): authenticate will time out at 1358.811080s 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98f7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7ff9900a4a30 0x7ff99012e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:51648/0 (socket says 172.21.15.171:51648) 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff98f7fe640 1 -- 172.21.15.171:0/2807019040 learned_addr learned my addr 172.21.15.171:0/2807019040 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149617037 0 0) 0x7ff9900a1f50 con 0x7ff9900a4a30 2024-04-26T00:01:48.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): my global_id is 6728 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff97c003560 con 0x7ff9900a4a30 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4129595901 0 0) 0x7ff97c003560 con 0x7ff9900a4a30 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff9900a1f50 con 0x7ff9900a4a30 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff980004300 con 0x7ff9900a4a30 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): dump: 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:48.094 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:48.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1854083312 0 0) 0x7ff99013d550 con 0x7ff99013e3a0 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): my global_id is 6966 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff97c003560 con 0x7ff99013e3a0 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1371716841 0 0) 0x7ff99012f580 con 0x7ff9900a52c0 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient(hunting): my global_id is 6806 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff99013d550 con 0x7ff9900a52c0 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2226438709 0 0) 0x7ff9900a1f50 con 0x7ff9900a4a30 2024-04-26T00:01:48.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 >> v1:172.21.15.106:6790/0 conn(0x7ff9900a52c0 legacy=0x7ff99012ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 >> v1:172.21.15.106:6789/0 conn(0x7ff99013e3a0 legacy=0x7ff9901d4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 monclient: found mon.h 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9900a0f80 con 0x7ff9900a4a30 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff977fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 5 monclient: authenticate success, global_id 6728 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: _renew_subs 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.098+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff990138120 con 0x7ff9900a4a30 2024-04-26T00:01:48.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff995e92640 10 monclient: _renew_subs 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff995e92640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7ff990137850 con 0x7ff9900a4a30 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff9800045f0 con 0x7ff9900a4a30 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff980004b60 con 0x7ff9900a4a30 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff98d7fa640 4 set_mon_vals no callback set 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 10 monclient: dump: 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:48.098 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff995e92640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff995e92640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff995e92640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:48.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff970005090 con 0x7ff9900a4a30 2024-04-26T00:01:48.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff980004d00 con 0x7ff9900a4a30 2024-04-26T00:01:48.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(227..227 src has 138..227) ==== 10976+0+0 (unknown 2352098872 0 0) 0x7ff980046210 con 0x7ff9900a4a30 2024-04-26T00:01:48.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.102+0000 7ff98effd640 10 monclient: get_auth_request con 0x7ff97c0379b0 auth_method 0 2024-04-26T00:01:48.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.106+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff980015800 con 0x7ff9900a4a30 2024-04-26T00:01:48.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.106+0000 7ff977fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:48.100 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.106+0000 7ff977fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:48.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.270+0000 7ff995e92640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h16"}] 2024-04-26T00:01:48.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.270+0000 7ff995e92640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h16"}] 2024-04-26T00:01:48.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.270+0000 7ff995e92640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:48.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.270+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h16"} v 0) -- 0x7ff970005380 con 0x7ff9900a4a30 2024-04-26T00:01:48.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.850+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h16"}]=0 removed item id -64 name 'h16' from crush map v228) ==== 120+0+0 (unknown 913721447 0 0) 0x7ff980015100 con 0x7ff9900a4a30 2024-04-26T00:01:48.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.850+0000 7ff977fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h16"}] 2024-04-26T00:01:48.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.850+0000 7ff977fff640 10 monclient: _finish_command 2 = system:0 removed item id -64 name 'h16' from crush map 2024-04-26T00:01:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.958+0000 7ff995e92640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h16"}] 2024-04-26T00:01:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.958+0000 7ff995e92640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h16"}] 2024-04-26T00:01:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.958+0000 7ff995e92640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:48.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.958+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h16"} v 0) -- 0x7ff970002220 con 0x7ff9900a4a30 2024-04-26T00:01:48.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff977fff640 1 -- 172.21.15.171:0/2807019040 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h16"}]=0 device 'h16' does not appear in the crush map v228) ==== 120+0+0 (unknown 2088881826 0 0) 0x7ff98001dcb0 con 0x7ff9900a4a30 2024-04-26T00:01:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff977fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h16"}] 2024-04-26T00:01:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff977fff640 10 monclient: _finish_command 3 = system:0 device 'h16' does not appear in the crush map 2024-04-26T00:01:48.944 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h16' does not appear in the crush map 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 >> v1:172.21.15.171:6812/722422047 conn(0x7ff97c0379b0 legacy=0x7ff97c039e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 10 monclient: shutdown 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 >> v1:172.21.15.171:6791/0 conn(0x7ff9900a4a30 legacy=0x7ff99012e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 shutdown_connections 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 >> 172.21.15.171:0/2807019040 conn(0x7ff9900aa030 msgr2=0x7ff990134fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 shutdown_connections 2024-04-26T00:01:48.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:48.962+0000 7ff995e92640 1 -- 172.21.15.171:0/2807019040 wait complete. 2024-04-26T00:01:48.961 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:48.961 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h17 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient: get_monmap_and_config 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient: build_initial_monmap 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient: monmap: 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:49.099553+0000 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:49.099553+0000 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:49.077 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:49.078 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:49.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 1 Processor -- start 2024-04-26T00:01:49.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 1 -- start start 2024-04-26T00:01:49.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient: init 2024-04-26T00:01:49.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:49.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient: _add_conns ranks=[1,6,7,2,5,0,8,3,4] 2024-04-26T00:01:49.084 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient(hunting): picked mon.noname-f con 0x7f1fc8135bb0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient(hunting): picked mon.noname-d con 0x7f1fc81356f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient(hunting): picked mon.noname-i con 0x7f1fc813c130 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80a1da0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80a1fe0 con 0x7f1fc81356f0 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc8072720 con 0x7f1fc813c130 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 10 monclient(hunting): authenticate will time out at 1359.807036s 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc759e640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f1fc813c130 0x7f1fc813e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:46412/0 (socket says 172.21.15.171:46412) 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc6d9d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1fc8135bb0 0x7f1fc8135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:47586/0 (socket says 172.21.15.171:47586) 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc759e640 1 -- 172.21.15.171:0/1430911178 learned_addr learned my addr 172.21.15.171:0/1430911178 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1799307114 0 0) 0x7f1fc80a1da0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:49.085 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): my global_id is 145315 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fb0003530 con 0x7f1fc8135bb0 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89543363 0 0) 0x7f1fc8072720 con 0x7f1fc813c130 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient(hunting): my global_id is 145294 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fc80a1da0 con 0x7f1fc813c130 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 213498246 0 0) 0x7f1fb0003530 con 0x7f1fc8135bb0 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 >> v1:172.21.15.171:6792/0 conn(0x7f1fc813c130 legacy=0x7f1fc813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 >> v1:172.21.15.106:6792/0 conn(0x7f1fc81356f0 legacy=0x7f1fc813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 monclient: found mon.noname-f 2024-04-26T00:01:49.086 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc80a17f0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient: _finish_auth 0 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1fb80016f0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 5 monclient: authenticate success, global_id 145315 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fc5d9b640 10 monclient: dump: 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:49.087 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:49.088 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.094+0000 7f1fcd202640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1fb80019d0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc5d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc5d9b640 1 -- 172.21.15.171:0/1430911178 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1fb8004b30 con 0x7f1fc8135bb0 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 4 set_mon_vals no callback set 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc5d9b640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc5d9b640 10 monclient: dump: 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:49.089 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: shutdown 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/1430911178 >> v1:172.21.15.171:6789/0 conn(0x7f1fc8135bb0 legacy=0x7f1fc8135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/1430911178 shutdown_connections 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/1430911178 >> 172.21.15.171:0/1430911178 conn(0x7f1fc80a2620 msgr2=0x7f1fc80a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:49.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/1430911178 shutdown_connections 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/1430911178 wait complete. 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: build_initial_monmap 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: monmap: 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:49.091 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 Processor -- start 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- start start 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: init 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _add_conns ranks=[4,5,0,1,2,6,3,8,7] 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient(hunting): picked mon.noname-c con 0x7f1fc81356f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient(hunting): picked mon.noname-h con 0x7f1fc8135bb0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient(hunting): picked mon.noname-a con 0x7f1fc813c130 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:49.092 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc8134490 con 0x7f1fc813c130 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80719a0 con 0x7f1fc81356f0 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fc80715c0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient(hunting): authenticate will time out at 1359.810175s 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc659c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f1fc8135bb0 0x7f1fc81d13a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:51656/0 (socket says 172.21.15.171:51656) 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc659c640 1 -- 172.21.15.171:0/2376598745 learned_addr learned my addr 172.21.15.171:0/2376598745 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576167195 0 0) 0x7f1fc80715c0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): my global_id is 6737 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1fb4003530 con 0x7f1fc8135bb0 2024-04-26T00:01:49.093 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 797322302 0 0) 0x7f1fb4003530 con 0x7f1fc8135bb0 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1fc80715c0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1fbc001b70 con 0x7f1fc8135bb0 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): dump: 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:49.094 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2571332610 0 0) 0x7f1fc80715c0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 >> v1:172.21.15.106:6791/0 conn(0x7f1fc81356f0 legacy=0x7f1fc8133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 >> v1:172.21.15.106:6789/0 conn(0x7f1fc813c130 legacy=0x7f1fc81d4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:49.095 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 monclient: found mon.h 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fc811ce60 con 0x7f1fc8135bb0 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 5 monclient: authenticate success, global_id 6737 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _renew_subs 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1fc80712d0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _renew_subs 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1fc811c270 con 0x7f1fc8135bb0 2024-04-26T00:01:49.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1fbc0038d0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1fbc003e40 con 0x7f1fc8135bb0 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fc559a640 4 set_mon_vals no callback set 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1faf7fe640 10 monclient: dump: 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:49.097 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.102+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1fbc003fe0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.098 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.098+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fa8005090 con 0x7f1fc8135bb0 2024-04-26T00:01:49.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.102+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(228..228 src has 138..228) ==== 10763+0+0 (unknown 1987819449 0 0) 0x7f1fbc046260 con 0x7f1fc8135bb0 2024-04-26T00:01:49.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.102+0000 7f1fc6d9d640 10 monclient: get_auth_request con 0x7f1fb4037830 auth_method 0 2024-04-26T00:01:49.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.106+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1fbc0158e0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.106+0000 7f1faf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:49.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.106+0000 7f1faf7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:49.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.270+0000 7f1fcd202640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h17"}] 2024-04-26T00:01:49.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.270+0000 7f1fcd202640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h17"}] 2024-04-26T00:01:49.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.270+0000 7f1fcd202640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:49.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.270+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h17"} v 0) -- 0x7f1fa8005380 con 0x7f1fc8135bb0 2024-04-26T00:01:49.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.882+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h17"}]=0 removed item id -67 name 'h17' from crush map v229) ==== 120+0+0 (unknown 3002214429 0 0) 0x7f1fbc0151e0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.882+0000 7f1faf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h17"}] 2024-04-26T00:01:49.865 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.882+0000 7f1faf7fe640 10 monclient: _finish_command 2 = system:0 removed item id -67 name 'h17' from crush map 2024-04-26T00:01:49.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.982+0000 7f1fcd202640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h17"}] 2024-04-26T00:01:49.966 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.982+0000 7f1fcd202640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h17"}] 2024-04-26T00:01:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.982+0000 7f1fcd202640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:49.967 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.982+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h17"} v 0) -- 0x7f1fa80010a0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1faf7fe640 1 -- 172.21.15.171:0/2376598745 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h17"}]=0 device 'h17' does not appear in the crush map v229) ==== 120+0+0 (unknown 3367626253 0 0) 0x7f1fbc01ddf0 con 0x7f1fc8135bb0 2024-04-26T00:01:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h17' does not appear in the crush map 2024-04-26T00:01:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1faf7fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h17"}] 2024-04-26T00:01:49.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1faf7fe640 10 monclient: _finish_command 3 = system:0 device 'h17' does not appear in the crush map 2024-04-26T00:01:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 >> v1:172.21.15.171:6812/722422047 conn(0x7f1fb4037830 legacy=0x7f1fb4039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 10 monclient: shutdown 2024-04-26T00:01:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 >> v1:172.21.15.171:6791/0 conn(0x7f1fc8135bb0 legacy=0x7f1fc81d13a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 shutdown_connections 2024-04-26T00:01:49.970 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 >> 172.21.15.171:0/2376598745 conn(0x7f1fc80a2620 msgr2=0x7f1fc813e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 shutdown_connections 2024-04-26T00:01:49.971 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:49.986+0000 7f1fcd202640 1 -- 172.21.15.171:0/2376598745 wait complete. 2024-04-26T00:01:49.984 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:49.984 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h18 2024-04-26T00:01:50.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.118+0000 7f614c6af640 10 monclient: get_monmap_and_config 2024-04-26T00:01:50.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.118+0000 7f614c6af640 10 monclient: build_initial_monmap 2024-04-26T00:01:50.102 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.118+0000 7f614c6af640 10 monclient: monmap: 2024-04-26T00:01:50.102 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:50.102 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:50.125128+0000 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:50.125128+0000 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:50.103 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.118+0000 7f614c6af640 1 Processor -- start 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.118+0000 7f614c6af640 1 -- start start 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.118+0000 7f614c6af640 10 monclient: init 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: _add_conns ranks=[5,2,0,7,6,4,3,8,1] 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): picked mon.noname-h con 0x7f614409c510 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): picked mon.noname-b con 0x7f6144135d60 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): picked mon.noname-a con 0x7f614413c290 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6144075900 con 0x7f614413c290 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614409d000 con 0x7f6144135d60 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614409d300 con 0x7f614409c510 2024-04-26T00:01:50.114 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): authenticate will time out at 1360.832258s 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614a44b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f614409c510 0x7f614409c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:51662/0 (socket says 172.21.15.171:51662) 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614a44b640 1 -- 172.21.15.171:0/3182261266 learned_addr learned my addr 172.21.15.171:0/3182261266 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184799475 0 0) 0x7f614409d300 con 0x7f614409c510 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient(hunting): _negotiate 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient(hunting): my global_id is 6746 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6130003530 con 0x7f614409c510 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 970009704 0 0) 0x7f6130003530 con 0x7f614409c510 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 >> v1:172.21.15.106:6790/0 conn(0x7f6144135d60 legacy=0x7f614413ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 >> v1:172.21.15.106:6789/0 conn(0x7f614413c290 legacy=0x7f614413e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: _finish_hunting 0 2024-04-26T00:01:50.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 monclient: found mon.noname-h 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6144075b30 con 0x7f614409c510 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: _finish_auth 0 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: _check_auth_tickets 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61400017c0 con 0x7f614409c510 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 5 monclient: authenticate success, global_id 6746 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: dump: 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:50.116 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:50.117 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6140001ab0 con 0x7f614409c510 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 1 -- 172.21.15.171:0/3182261266 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6140004bf0 con 0x7f614409c510 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 4 set_mon_vals no callback set 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149449640 10 monclient: dump: 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:50.118 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: shutdown 2024-04-26T00:01:50.119 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- 172.21.15.171:0/3182261266 >> v1:172.21.15.171:6791/0 conn(0x7f614409c510 legacy=0x7f614409c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- 172.21.15.171:0/3182261266 shutdown_connections 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- 172.21.15.171:0/3182261266 >> 172.21.15.171:0/3182261266 conn(0x7f61440a2e70 msgr2=0x7f61440a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- 172.21.15.171:0/3182261266 shutdown_connections 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- 172.21.15.171:0/3182261266 wait complete. 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: build_initial_monmap 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: monmap: 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:50.120 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 Processor -- start 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- start start 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: init 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient: _add_conns ranks=[8,4,2,6,3,5,1,7,0] 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): picked mon.noname-e con 0x7f614409c510 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): picked mon.noname-c con 0x7f6144135d60 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): picked mon.noname-b con 0x7f614413c290 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614409f0d0 con 0x7f614413c290 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614409ea10 con 0x7f6144135d60 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61440a02a0 con 0x7f614409c510 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:50.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614c6af640 10 monclient(hunting): authenticate will time out at 1360.835264s 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614ac4c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f614413c290 0x7f61441d4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:32944/0 (socket says 172.21.15.171:32944) 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f6149c4a640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f6144135d60 0x7f61441d1830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:37394/0 (socket says 172.21.15.171:37394) 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.122+0000 7f614ac4c640 1 -- 172.21.15.171:0/391449877 learned_addr learned my addr 172.21.15.171:0/391449877 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860296059 0 0) 0x7f614409f0d0 con 0x7f614413c290 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): my global_id is 6824 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6128003530 con 0x7f614413c290 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475420930 0 0) 0x7f614409ea10 con 0x7f6144135d60 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:50.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): my global_id is 145372 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f614409f0d0 con 0x7f6144135d60 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1947399081 0 0) 0x7f61440a02a0 con 0x7f614409c510 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): my global_id is 204515 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f614409ea10 con 0x7f614409c510 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2910361759 0 0) 0x7f6128003530 con 0x7f614413c290 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61440a02a0 con 0x7f614413c290 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f613c001d20 con 0x7f614413c290 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): dump: 2024-04-26T00:01:50.124 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:50.125 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 423587972 0 0) 0x7f614409f0d0 con 0x7f6144135d60 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6128003530 con 0x7f6144135d60 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3997190501 0 0) 0x7f614409ea10 con 0x7f614409c510 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f614409f0d0 con 0x7f614409c510 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134001a20 con 0x7f6144135d60 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): dump: 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:50.126 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:50.127 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6140004b30 con 0x7f614409c510 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient(hunting): dump: 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:50.128 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1392590463 0 0) 0x7f61440a02a0 con 0x7f614413c290 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 >> v1:172.21.15.106:6793/0 conn(0x7f614409c510 legacy=0x7f6144072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 >> v1:172.21.15.106:6791/0 conn(0x7f6144135d60 legacy=0x7f61441d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 monclient: found mon.b 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:50.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614409e090 con 0x7f614413c290 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: _finish_auth 0 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 5 monclient: authenticate success, global_id 6824 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 10 monclient: _renew_subs 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f614409dd20 con 0x7f614413c290 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 10 monclient: _renew_subs 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f61440734e0 con 0x7f614413c290 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f613c002040 con 0x7f614413c290 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f613c003f90 con 0x7f614413c290 2024-04-26T00:01:50.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f6148c48640 4 set_mon_vals no callback set 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 10 monclient: dump: 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:50.131 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f612c005090 con 0x7f614413c290 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f613c0041b0 con 0x7f614413c290 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(229..229 src has 138..229) ==== 10550+0+0 (unknown 779071225 0 0) 0x7f613c046220 con 0x7f614413c290 2024-04-26T00:01:50.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.126+0000 7f614a44b640 10 monclient: get_auth_request con 0x7f6128038250 auth_method 0 2024-04-26T00:01:50.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.142+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f613c0159c0 con 0x7f614413c290 2024-04-26T00:01:50.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.142+0000 7f613affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:50.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.142+0000 7f613affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:50.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.302+0000 7f614c6af640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h18"}] 2024-04-26T00:01:50.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.302+0000 7f614c6af640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h18"}] 2024-04-26T00:01:50.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.302+0000 7f614c6af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:50.287 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.302+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "h18"} v 0) -- 0x7f612c005380 con 0x7f614413c290 2024-04-26T00:01:50.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.898+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h18"}]=0 removed item id -70 name 'h18' from crush map v230) ==== 120+0+0 (unknown 1537110563 0 0) 0x7f613c0152c0 con 0x7f614413c290 2024-04-26T00:01:50.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.898+0000 7f613affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h18"}] 2024-04-26T00:01:50.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.898+0000 7f613affd640 10 monclient: _finish_command 2 = system:0 removed item id -70 name 'h18' from crush map 2024-04-26T00:01:50.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.994+0000 7f614c6af640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h18"}] 2024-04-26T00:01:50.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.994+0000 7f614c6af640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h18"}] 2024-04-26T00:01:50.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.994+0000 7f614c6af640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:01:50.978 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.994+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "osd crush rm", "name": "h18"} v 0) -- 0x7f612c0010a0 con 0x7f614413c290 2024-04-26T00:01:50.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f613affd640 1 -- 172.21.15.171:0/391449877 <== mon.2 v1:172.21.15.106:6790/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h18"}]=0 device 'h18' does not appear in the crush map v230) ==== 120+0+0 (unknown 613402822 0 0) 0x7f613c01de70 con 0x7f614413c290 2024-04-26T00:01:50.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f613affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h18"}] 2024-04-26T00:01:50.980 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f613affd640 10 monclient: _finish_command 3 = system:0 device 'h18' does not appear in the crush map 2024-04-26T00:01:50.980 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h18' does not appear in the crush map 2024-04-26T00:01:50.982 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 >> v1:172.21.15.171:6812/722422047 conn(0x7f6128038250 legacy=0x7f612803a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:50.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 10 monclient: shutdown 2024-04-26T00:01:50.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:50.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 >> v1:172.21.15.106:6790/0 conn(0x7f614413c290 legacy=0x7f61441d4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:50.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 shutdown_connections 2024-04-26T00:01:50.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 >> 172.21.15.171:0/391449877 conn(0x7f61440a2e70 msgr2=0x7f61440a1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:50.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 shutdown_connections 2024-04-26T00:01:50.983 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:50.998+0000 7f614c6af640 1 -- 172.21.15.171:0/391449877 wait complete. 2024-04-26T00:01:50.997 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:50.997 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h19 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient: get_monmap_and_config 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient: build_initial_monmap 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient: monmap: 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:51.135776+0000 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:51.135776+0000 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.113 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:51.114 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 1 Processor -- start 2024-04-26T00:01:51.121 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 1 -- start start 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient: init 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient: _add_conns ranks=[3,8,6,2,1,5,4,7,0] 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient(hunting): picked mon.noname-g con 0x7f2d58135bb0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient(hunting): picked mon.noname-e con 0x7f2d581356f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient(hunting): picked mon.noname-d con 0x7f2d5813c130 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d580a1da0 con 0x7f2d58135bb0 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d580a1fe0 con 0x7f2d5813c130 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d58072720 con 0x7f2d581356f0 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d6026f640 10 monclient(hunting): authenticate will time out at 1361.842721s 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5e00b640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f2d58135bb0 legacy=0x7f2d58135f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d80a640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f2d581356f0 0x7f2d5813aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.171:56626/0 (socket says 172.21.15.171:56626) 2024-04-26T00:01:51.122 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d80a640 1 -- 172.21.15.171:0/3710758362 learned_addr learned my addr 172.21.15.171:0/3710758362 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5e80c640 1 --1- 172.21.15.171:0/3710758362 >> v1:172.21.15.106:6792/0 conn(0x7f2d5813c130 0x7f2d5813e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:54846/0 (socket says 172.21.15.171:54846) 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 148453780 0 0) 0x7f2d58072720 con 0x7f2d581356f0 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): my global_id is 204524 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d44003530 con 0x7f2d581356f0 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3334889252 0 0) 0x7f2d580a1fe0 con 0x7f2d5813c130 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 10 monclient(hunting): my global_id is 6864 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.130+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d58072720 con 0x7f2d5813c130 2024-04-26T00:01:51.123 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1183912635 0 0) 0x7f2d44003530 con 0x7f2d581356f0 2024-04-26T00:01:51.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 >> v1:172.21.15.106:6792/0 conn(0x7f2d5813c130 legacy=0x7f2d5813e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.124 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 >> v1:172.21.15.171:6790/0 conn(0x7f2d58135bb0 legacy=0x7f2d58135f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: _finish_hunting 0 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 monclient: found mon.noname-e 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d580a17f0 con 0x7f2d581356f0 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: _finish_auth 0 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: _check_auth_tickets 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2d540016f0 con 0x7f2d581356f0 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:01:51.125 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: dump: 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.126 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 5 monclient: authenticate success, global_id 204524 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d54001a10 con 0x7f2d581356f0 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 1 -- 172.21.15.171:0/3710758362 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2d54004bf0 con 0x7f2d581356f0 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 4 set_mon_vals no callback set 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d009640 10 monclient: dump: 2024-04-26T00:01:51.127 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.128 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: shutdown 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- 172.21.15.171:0/3710758362 >> v1:172.21.15.106:6793/0 conn(0x7f2d581356f0 legacy=0x7f2d5813aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- 172.21.15.171:0/3710758362 shutdown_connections 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- 172.21.15.171:0/3710758362 >> 172.21.15.171:0/3710758362 conn(0x7f2d580a2620 msgr2=0x7f2d580a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- 172.21.15.171:0/3710758362 shutdown_connections 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- 172.21.15.171:0/3710758362 wait complete. 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: build_initial_monmap 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: monmap: 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:51.129 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 Processor -- start 2024-04-26T00:01:51.130 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- start start 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: init 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: _add_conns ranks=[2,5,0,1,4,7,6,8,3] 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient(hunting): picked mon.noname-b con 0x7f2d581356f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient(hunting): picked mon.noname-h con 0x7f2d58135bb0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient(hunting): picked mon.noname-a con 0x7f2d5813c130 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5813b460 con 0x7f2d5813c130 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d581389c0 con 0x7f2d581356f0 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d58071ef0 con 0x7f2d58135bb0 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient(hunting): authenticate will time out at 1361.846757s 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d80a640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f2d58135bb0 0x7f2d581cf3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33838/0 (socket says 172.21.15.171:33838) 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5d80a640 1 -- 172.21.15.171:0/1421808490 learned_addr learned my addr 172.21.15.171:0/1421808490 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:51.131 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655106016 0 0) 0x7f2d58071ef0 con 0x7f2d58135bb0 2024-04-26T00:01:51.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): my global_id is 6755 2024-04-26T00:01:51.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d3c003530 con 0x7f2d58135bb0 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4211558289 0 0) 0x7f2d3c003530 con 0x7f2d58135bb0 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d58071ef0 con 0x7f2d58135bb0 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2d54004b30 con 0x7f2d58135bb0 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): dump: 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.133 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.134 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3876234464 0 0) 0x7f2d581389c0 con 0x7f2d581356f0 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): my global_id is 6833 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d3c003530 con 0x7f2d581356f0 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361698228 0 0) 0x7f2d5813b460 con 0x7f2d5813c130 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.135 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient(hunting): my global_id is 6993 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d581389c0 con 0x7f2d5813c130 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4090311062 0 0) 0x7f2d58071ef0 con 0x7f2d58135bb0 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 >> v1:172.21.15.106:6790/0 conn(0x7f2d581356f0 legacy=0x7f2d581c7070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 >> v1:172.21.15.106:6789/0 conn(0x7f2d5813c130 legacy=0x7f2d581d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 monclient: found mon.h 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d580719a0 con 0x7f2d58135bb0 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: _finish_auth 0 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 5 monclient: authenticate success, global_id 6755 2024-04-26T00:01:51.136 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: _renew_subs 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d5813b180 con 0x7f2d58135bb0 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: _renew_subs 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d581c7780 con 0x7f2d58135bb0 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d54001a10 con 0x7f2d58135bb0 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2d54005240 con 0x7f2d58135bb0 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d5c808640 4 set_mon_vals no callback set 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.134+0000 7f2d4effd640 10 monclient: dump: 2024-04-26T00:01:51.137 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.138 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.138+0000 7f2d6026f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.138+0000 7f2d6026f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.138+0000 7f2d6026f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.138+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2d5400ffe0 con 0x7f2d58135bb0 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.138+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d40005090 con 0x7f2d58135bb0 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.138+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(230..230 src has 138..230) ==== 10337+0+0 (unknown 3845668892 0 0) 0x7f2d540460a0 con 0x7f2d58135bb0 2024-04-26T00:01:51.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.138+0000 7f2d5e00b640 10 monclient: get_auth_request con 0x7f2d3c0379a0 auth_method 0 2024-04-26T00:01:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.142+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f2d54015990 con 0x7f2d58135bb0 2024-04-26T00:01:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.142+0000 7f2d4effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:51.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.142+0000 7f2d4effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.310+0000 7f2d6026f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h19"}] 2024-04-26T00:01:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.310+0000 7f2d6026f640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h19"}] 2024-04-26T00:01:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.310+0000 7f2d6026f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:51.294 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.310+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h19"} v 0) -- 0x7f2d40005380 con 0x7f2d58135bb0 2024-04-26T00:01:51.557 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.574+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h19"}]=0 removed item id -73 name 'h19' from crush map v231) ==== 120+0+0 (unknown 3743027801 0 0) 0x7f2d54015290 con 0x7f2d58135bb0 2024-04-26T00:01:51.557 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.574+0000 7f2d4effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h19"}] 2024-04-26T00:01:51.557 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.574+0000 7f2d4effd640 10 monclient: _finish_command 2 = system:0 removed item id -73 name 'h19' from crush map 2024-04-26T00:01:51.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.682+0000 7f2d6026f640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h19"}] 2024-04-26T00:01:51.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.682+0000 7f2d6026f640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h19"}] 2024-04-26T00:01:51.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.682+0000 7f2d6026f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:51.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.682+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h19"} v 0) -- 0x7f2d400010a0 con 0x7f2d58135bb0 2024-04-26T00:01:51.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.682+0000 7f2d4effd640 1 -- 172.21.15.171:0/1421808490 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h19"}]=0 device 'h19' does not appear in the crush map v231) ==== 120+0+0 (unknown 2427969641 0 0) 0x7f2d5401dde0 con 0x7f2d58135bb0 2024-04-26T00:01:51.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.682+0000 7f2d4effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h19"}] 2024-04-26T00:01:51.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.682+0000 7f2d4effd640 10 monclient: _finish_command 3 = system:0 device 'h19' does not appear in the crush map 2024-04-26T00:01:51.667 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h19' does not appear in the crush map 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 >> v1:172.21.15.171:6812/722422047 conn(0x7f2d3c0379a0 legacy=0x7f2d3c039e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 10 monclient: shutdown 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 >> v1:172.21.15.171:6791/0 conn(0x7f2d58135bb0 legacy=0x7f2d581cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 shutdown_connections 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 >> 172.21.15.171:0/1421808490 conn(0x7f2d580a2620 msgr2=0x7f2d5813e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 shutdown_connections 2024-04-26T00:01:51.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.686+0000 7f2d6026f640 1 -- 172.21.15.171:0/1421808490 wait complete. 2024-04-26T00:01:51.683 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:51.683 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h20 2024-04-26T00:01:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: get_monmap_and_config 2024-04-26T00:01:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: build_initial_monmap 2024-04-26T00:01:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: monmap: 2024-04-26T00:01:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.788 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:51.811156+0000 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:51.811156+0000 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:51.789 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 Processor -- start 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- start start 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: init 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _add_conns ranks=[1,5,4,6,0,7,2,3,8] 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): picked mon.noname-f con 0x7f1f4c135bb0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): picked mon.noname-h con 0x7f1f4c1356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): picked mon.noname-c con 0x7f1f4c13c130 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:51.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c0a1da0 con 0x7f1f4c135bb0 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c0a1fe0 con 0x7f1f4c13c130 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c072720 con 0x7f1f4c1356f0 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): authenticate will time out at 1362.518159s 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f49d9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f1f4c1356f0 0x7f1f4c13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33848/0 (socket says 172.21.15.171:33848) 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f49d9b640 1 -- 172.21.15.171:0/154005927 learned_addr learned my addr 172.21.15.171:0/154005927 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4a59c640 1 --1- 172.21.15.171:0/154005927 >> v1:172.21.15.171:6789/0 conn(0x7f1f4c135bb0 0x7f1f4c135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49438/0 (socket says 172.21.15.171:49438) 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3483727478 0 0) 0x7f1f4c072720 con 0x7f1f4c1356f0 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): my global_id is 6764 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f34003530 con 0x7f1f4c1356f0 2024-04-26T00:01:51.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505903055 0 0) 0x7f1f4c0a1da0 con 0x7f1f4c135bb0 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient(hunting): my global_id is 145324 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4c072720 con 0x7f1f4c135bb0 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1979757936 0 0) 0x7f1f4c072720 con 0x7f1f4c135bb0 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 >> v1:172.21.15.171:6791/0 conn(0x7f1f4c1356f0 legacy=0x7f1f4c13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 >> v1:172.21.15.106:6791/0 conn(0x7f1f4c13c130 legacy=0x7f1f4c13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: _finish_hunting 0 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 monclient: found mon.noname-f 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:51.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c0a17f0 con 0x7f1f4c135bb0 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: _finish_auth 0 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: _check_auth_tickets 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f3c0017c0 con 0x7f1f4c135bb0 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: dump: 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.799 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 5 monclient: authenticate success, global_id 145324 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f3c001aa0 con 0x7f1f4c135bb0 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 1 -- 172.21.15.171:0/154005927 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f3c004b30 con 0x7f1f4c135bb0 2024-04-26T00:01:51.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 4 set_mon_vals no callback set 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4959a640 10 monclient: dump: 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.801 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: shutdown 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/154005927 >> v1:172.21.15.171:6789/0 conn(0x7f1f4c135bb0 legacy=0x7f1f4c135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/154005927 shutdown_connections 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/154005927 >> 172.21.15.171:0/154005927 conn(0x7f1f4c0a2620 msgr2=0x7f1f4c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/154005927 shutdown_connections 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/154005927 wait complete. 2024-04-26T00:01:51.802 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: build_initial_monmap 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: monmap: 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:51.803 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 Processor -- start 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- start start 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: init 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _add_conns ranks=[3,5,1,7,6,8,2,4,0] 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): picked mon.noname-g con 0x7f1f4c1356f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): picked mon.noname-h con 0x7f1f4c135bb0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): picked mon.noname-f con 0x7f1f4c13c130 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c13b340 con 0x7f1f4c13c130 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4a59c640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f1f4c1356f0 legacy=0x7f1f4c134500 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c13b620 con 0x7f1f4c1356f0 2024-04-26T00:01:51.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f4c13a0b0 con 0x7f1f4c135bb0 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient(hunting): authenticate will time out at 1362.521180s 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4ad9d640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1f4c13c130 0x7f1f4c1d2af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49444/0 (socket says 172.21.15.171:49444) 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4ad9d640 1 -- 172.21.15.171:0/2892480339 learned_addr learned my addr 172.21.15.171:0/2892480339 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f49d9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f1f4c135bb0 0x7f1f4c1cf3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33850/0 (socket says 172.21.15.171:33850) 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631051127 0 0) 0x7f1f4c13b340 con 0x7f1f4c13c130 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): my global_id is 145333 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f2c003530 con 0x7f1f4c13c130 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122674581 0 0) 0x7f1f4c13a0b0 con 0x7f1f4c135bb0 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:51.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): my global_id is 6773 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4c13b340 con 0x7f1f4c135bb0 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3849753003 0 0) 0x7f1f2c003530 con 0x7f1f4c13c130 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f4c13a0b0 con 0x7f1f4c13c130 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f44001d80 con 0x7f1f4c13c130 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): dump: 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.806 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3664086560 0 0) 0x7f1f4c13a0b0 con 0x7f1f4c13c130 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 >> v1:172.21.15.171:6791/0 conn(0x7f1f4c135bb0 legacy=0x7f1f4c1cf3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:51.807 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 >> v1:172.21.15.171:6790/0 conn(0x7f1f4c1356f0 legacy=0x7f1f4c134500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 monclient: found mon.f 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f4c139330 con 0x7f1f4c13c130 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: _finish_auth 0 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 5 monclient: authenticate success, global_id 145333 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _renew_subs 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f4c1c6dc0 con 0x7f1f4c13c130 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _renew_subs 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:51.808 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f4c13bc10 con 0x7f1f4c13c130 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f44003c50 con 0x7f1f4c13c130 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f440041c0 con 0x7f1f4c13c130 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f48d99640 4 set_mon_vals no callback set 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 10 monclient: dump: 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:51.809 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f30005090 con 0x7f1f4c13c130 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1f44004360 con 0x7f1f4c13c130 2024-04-26T00:01:51.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(231..231 src has 138..231) ==== 10124+0+0 (unknown 206034506 0 0) 0x7f1f440461f0 con 0x7f1f4c13c130 2024-04-26T00:01:51.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.810+0000 7f1f4a59c640 10 monclient: get_auth_request con 0x7f1f2c0376e0 auth_method 0 2024-04-26T00:01:51.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.814+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1f44015b50 con 0x7f1f4c13c130 2024-04-26T00:01:51.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.814+0000 7f1f3affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:51.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.814+0000 7f1f3affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:51.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.982+0000 7f1f50ca6640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h20"}] 2024-04-26T00:01:51.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.982+0000 7f1f50ca6640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h20"}] 2024-04-26T00:01:51.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.982+0000 7f1f50ca6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:51.964 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:51.982+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h20"} v 0) -- 0x7f1f30005380 con 0x7f1f4c13c130 2024-04-26T00:01:52.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:52.910+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h20"}]=0 removed item id -76 name 'h20' from crush map v232) ==== 120+0+0 (unknown 1806001554 0 0) 0x7f1f44015450 con 0x7f1f4c13c130 2024-04-26T00:01:52.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:52.910+0000 7f1f3affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h20"}] 2024-04-26T00:01:52.892 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:52.910+0000 7f1f3affd640 10 monclient: _finish_command 2 = system:0 removed item id -76 name 'h20' from crush map 2024-04-26T00:01:52.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.014+0000 7f1f50ca6640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h20"}] 2024-04-26T00:01:52.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.014+0000 7f1f50ca6640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h20"}] 2024-04-26T00:01:52.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.014+0000 7f1f50ca6640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:52.998 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.014+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h20"} v 0) -- 0x7f1f30002220 con 0x7f1f4c13c130 2024-04-26T00:01:53.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f3affd640 1 -- 172.21.15.171:0/2892480339 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h20"}]=0 device 'h20' does not appear in the crush map v232) ==== 120+0+0 (unknown 770842472 0 0) 0x7f1f4401e000 con 0x7f1f4c13c130 2024-04-26T00:01:53.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f3affd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h20"}] 2024-04-26T00:01:53.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f3affd640 10 monclient: _finish_command 3 = system:0 device 'h20' does not appear in the crush map 2024-04-26T00:01:53.000 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h20' does not appear in the crush map 2024-04-26T00:01:53.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 >> v1:172.21.15.171:6812/722422047 conn(0x7f1f2c0376e0 legacy=0x7f1f2c039ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:53.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 10 monclient: shutdown 2024-04-26T00:01:53.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:53.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 >> v1:172.21.15.171:6789/0 conn(0x7f1f4c13c130 legacy=0x7f1f4c1d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:53.002 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 shutdown_connections 2024-04-26T00:01:53.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 >> 172.21.15.171:0/2892480339 conn(0x7f1f4c0a2620 msgr2=0x7f1f4c13e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:53.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 shutdown_connections 2024-04-26T00:01:53.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.018+0000 7f1f50ca6640 1 -- 172.21.15.171:0/2892480339 wait complete. 2024-04-26T00:01:53.016 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:53.017 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h21 2024-04-26T00:01:53.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: get_monmap_and_config 2024-04-26T00:01:53.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: build_initial_monmap 2024-04-26T00:01:53.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: monmap: 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:53.157342+0000 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:53.157342+0000 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:53.135 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:53.136 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:53.136 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 Processor -- start 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- start start 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: init 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: _add_conns ranks=[7,5,2,8,3,6,1,4,0] 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): picked mon.noname-i con 0x7fea2409cdd0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): picked mon.noname-h con 0x7fea2409c180 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): picked mon.noname-b con 0x7fea2413e540 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2409a950 con 0x7fea2413e540 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea240a2ba0 con 0x7fea2409c180 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea2409b4c0 con 0x7fea2409cdd0 2024-04-26T00:01:53.139 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): authenticate will time out at 1363.865008s 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2259c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fea2409cdd0 0x7fea240a1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52428/0 (socket says 172.21.15.171:52428) 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2259c640 1 -- 172.21.15.171:0/1356011896 learned_addr learned my addr 172.21.15.171:0/1356011896 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 616082498 0 0) 0x7fea240a2ba0 con 0x7fea2409c180 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): my global_id is 6782 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea0c003530 con 0x7fea2409c180 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354894867 0 0) 0x7fea2409b4c0 con 0x7fea2409cdd0 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:53.140 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient(hunting): my global_id is 145303 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea240a2ba0 con 0x7fea2409cdd0 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2640338297 0 0) 0x7fea0c003530 con 0x7fea2409c180 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 >> v1:172.21.15.171:6792/0 conn(0x7fea2409cdd0 legacy=0x7fea240a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 >> v1:172.21.15.106:6790/0 conn(0x7fea2413e540 legacy=0x7fea24140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: _finish_hunting 0 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 monclient: found mon.noname-h 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea2409b7a0 con 0x7fea2409c180 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: _finish_auth 0 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: _check_auth_tickets 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:53.141 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea180017c0 con 0x7fea2409c180 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 5 monclient: authenticate success, global_id 6782 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: dump: 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:53.142 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea180019b0 con 0x7fea2409c180 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 1 -- 172.21.15.171:0/1356011896 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea18003960 con 0x7fea2409c180 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:53.143 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea2159a640 10 monclient: dump: 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:53.144 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 4 set_mon_vals no callback set 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: shutdown 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- 172.21.15.171:0/1356011896 >> v1:172.21.15.171:6791/0 conn(0x7fea2409c180 legacy=0x7fea240a2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- 172.21.15.171:0/1356011896 shutdown_connections 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- 172.21.15.171:0/1356011896 >> 172.21.15.171:0/1356011896 conn(0x7fea240a2e70 msgr2=0x7fea240a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- 172.21.15.171:0/1356011896 shutdown_connections 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- 172.21.15.171:0/1356011896 wait complete. 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: build_initial_monmap 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: monmap: 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:53.145 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 Processor -- start 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- start start 2024-04-26T00:01:53.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: init 2024-04-26T00:01:53.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:53.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient: _add_conns ranks=[1,7,4,2,6,5,3,0,8] 2024-04-26T00:01:53.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): picked mon.noname-f con 0x7fea2409c180 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:53.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): picked mon.noname-i con 0x7fea2409cdd0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:53.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): picked mon.noname-c con 0x7fea2413e540 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:53.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea24090470 con 0x7fea2409c180 2024-04-26T00:01:53.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea240714f0 con 0x7fea2413e540 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea240909c0 con 0x7fea2409cdd0 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.154+0000 7fea28f68640 10 monclient(hunting): authenticate will time out at 1363.867965s 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea21d9b640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fea2409cdd0 0x7fea24070de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52440/0 (socket says 172.21.15.171:52440) 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea21d9b640 1 -- 172.21.15.171:0/2814410310 learned_addr learned my addr 172.21.15.171:0/2814410310 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692402333 0 0) 0x7fea240909c0 con 0x7fea2409cdd0 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): my global_id is 145312 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea04003530 con 0x7fea2409cdd0 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1044351273 0 0) 0x7fea24090470 con 0x7fea2409c180 2024-04-26T00:01:53.151 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): my global_id is 145342 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea240909c0 con 0x7fea2409c180 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3679574928 0 0) 0x7fea04003530 con 0x7fea2409cdd0 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea24090470 con 0x7fea2409cdd0 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea18003600 con 0x7fea2409cdd0 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): dump: 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.152 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:53.153 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4172937671 0 0) 0x7fea240909c0 con 0x7fea2409c180 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fea04003530 con 0x7fea2409c180 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839699845 0 0) 0x7fea240714f0 con 0x7fea2413e540 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): my global_id is 145390 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fea240909c0 con 0x7fea2413e540 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea14001500 con 0x7fea2409c180 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient(hunting): dump: 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:53.154 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:53.155 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 429107330 0 0) 0x7fea24090470 con 0x7fea2409cdd0 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 >> v1:172.21.15.106:6791/0 conn(0x7fea2413e540 legacy=0x7fea241d4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 >> v1:172.21.15.171:6789/0 conn(0x7fea2409c180 legacy=0x7fea240706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 monclient: found mon.i 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea240906e0 con 0x7fea2409cdd0 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 5 monclient: authenticate success, global_id 145312 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 10 monclient: _renew_subs 2024-04-26T00:01:53.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fea24072130 con 0x7fea2409cdd0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 10 monclient: _renew_subs 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fea24071c50 con 0x7fea2409cdd0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea24068fb0 con 0x7fea2409cdd0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fea180019b0 con 0x7fea2409cdd0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fea18003e50 con 0x7fea2409cdd0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:53.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 10 monclient: dump: 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:53.158 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea20d99640 4 set_mon_vals no callback set 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fea18003ff0 con 0x7fea2409cdd0 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(232..232 src has 138..232) ==== 9911+0+0 (unknown 2974420262 0 0) 0x7fea18045c70 con 0x7fea2409cdd0 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.158+0000 7fea2259c640 10 monclient: get_auth_request con 0x7fea04038040 auth_method 0 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.162+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fea24071c50 con 0x7fea2409cdd0 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.162+0000 7fea12ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:53.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.162+0000 7fea12ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:53.305 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.322+0000 7fea28f68640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h21"}] 2024-04-26T00:01:53.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.322+0000 7fea28f68640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h21"}] 2024-04-26T00:01:53.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.322+0000 7fea28f68640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:53.306 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.322+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h21"} v 0) -- 0x7fea2406c6b0 con 0x7fea2409cdd0 2024-04-26T00:01:53.908 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.926+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h21"}]=0 removed item id -79 name 'h21' from crush map v233) ==== 120+0+0 (unknown 1050206506 0 0) 0x7fea18015630 con 0x7fea2409cdd0 2024-04-26T00:01:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.926+0000 7fea12ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h21"}] 2024-04-26T00:01:53.909 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:53.926+0000 7fea12ffd640 10 monclient: _finish_command 2 = system:0 removed item id -79 name 'h21' from crush map 2024-04-26T00:01:54.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.030+0000 7fea28f68640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h21"}] 2024-04-26T00:01:54.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.030+0000 7fea28f68640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h21"}] 2024-04-26T00:01:54.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.030+0000 7fea28f68640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:54.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.030+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h21"} v 0) -- 0x7fea24072820 con 0x7fea2409cdd0 2024-04-26T00:01:54.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea12ffd640 1 -- 172.21.15.171:0/2814410310 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h21"}]=0 device 'h21' does not appear in the crush map v233) ==== 120+0+0 (unknown 2580166599 0 0) 0x7fea18019280 con 0x7fea2409cdd0 2024-04-26T00:01:54.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea12ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h21"}] 2024-04-26T00:01:54.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea12ffd640 10 monclient: _finish_command 3 = system:0 device 'h21' does not appear in the crush map 2024-04-26T00:01:54.016 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h21' does not appear in the crush map 2024-04-26T00:01:54.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 >> v1:172.21.15.171:6812/722422047 conn(0x7fea04038040 legacy=0x7fea0403a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:54.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 10 monclient: shutdown 2024-04-26T00:01:54.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:54.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 >> v1:172.21.15.171:6792/0 conn(0x7fea2409cdd0 legacy=0x7fea24070de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:54.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 shutdown_connections 2024-04-26T00:01:54.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 >> 172.21.15.171:0/2814410310 conn(0x7fea240a2e70 msgr2=0x7fea2413a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:54.018 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 shutdown_connections 2024-04-26T00:01:54.019 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.034+0000 7fea28f68640 1 -- 172.21.15.171:0/2814410310 wait complete. 2024-04-26T00:01:54.033 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:54.033 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h22 2024-04-26T00:01:54.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: get_monmap_and_config 2024-04-26T00:01:54.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: build_initial_monmap 2024-04-26T00:01:54.146 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: monmap: 2024-04-26T00:01:54.146 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:54.169231+0000 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:54.169231+0000 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:54.147 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:54.154 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 Processor -- start 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- start start 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: init 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: _add_conns ranks=[3,2,0,4,8,6,7,5,1] 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): picked mon.noname-g con 0x7fc53c06e4f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): picked mon.noname-b con 0x7fc53c06efe0 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): picked mon.noname-a con 0x7fc53c13aa40 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c070df0 con 0x7fc53c13aa40 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c0710d0 con 0x7fc53c06efe0 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c072f10 con 0x7fc53c06e4f0 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): authenticate will time out at 1364.876079s 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc540c9d640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fc53c06e4f0 legacy=0x7fc53c06e8d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:54.155 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53bfff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc53c06efe0 0x7fc53c139320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:37272/0 (socket says 172.21.15.171:37272) 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc54149e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc53c13aa40 0x7fc53c13ce30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:48296/0 (socket says 172.21.15.171:48296) 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53bfff640 1 -- 172.21.15.171:0/2110420765 learned_addr learned my addr 172.21.15.171:0/2110420765 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1543363321 0 0) 0x7fc53c0710d0 con 0x7fc53c06efe0 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): my global_id is 6851 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc524003530 con 0x7fc53c06efe0 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794225503 0 0) 0x7fc53c070df0 con 0x7fc53c13aa40 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient(hunting): my global_id is 7002 2024-04-26T00:01:54.156 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc53c0710d0 con 0x7fc53c13aa40 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1936726507 0 0) 0x7fc524003530 con 0x7fc53c06efe0 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 >> v1:172.21.15.171:6790/0 conn(0x7fc53c06e4f0 legacy=0x7fc53c06e8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 >> v1:172.21.15.106:6789/0 conn(0x7fc53c13aa40 legacy=0x7fc53c13ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 monclient: found mon.noname-b 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c06fa90 con 0x7fc53c06efe0 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc5300017c0 con 0x7fc53c06efe0 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:01:54.157 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: dump: 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:54.158 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 5 monclient: authenticate success, global_id 6851 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc530001a20 con 0x7fc53c06efe0 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 4 set_mon_vals no callback set 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 1 -- 172.21.15.171:0/2110420765 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc530004bf0 con 0x7fc53c06efe0 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53b7fe640 10 monclient: dump: 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:54.159 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: shutdown 2024-04-26T00:01:54.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- 172.21.15.171:0/2110420765 >> v1:172.21.15.106:6790/0 conn(0x7fc53c06efe0 legacy=0x7fc53c139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- 172.21.15.171:0/2110420765 shutdown_connections 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- 172.21.15.171:0/2110420765 >> 172.21.15.171:0/2110420765 conn(0x7fc53c0a2620 msgr2=0x7fc53c0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- 172.21.15.171:0/2110420765 shutdown_connections 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- 172.21.15.171:0/2110420765 wait complete. 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: build_initial_monmap 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: monmap: 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:54.161 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 Processor -- start 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- start start 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: init 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:54.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient: _add_conns ranks=[4,5,6,3,2,0,7,1,8] 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): picked mon.noname-c con 0x7fc53c06e4f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): picked mon.noname-h con 0x7fc53c06efe0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): picked mon.noname-d con 0x7fc53c13aa40 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c122070 con 0x7fc53c06e4f0 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c124360 con 0x7fc53c06efe0 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc53c070930 con 0x7fc53c13aa40 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc542f01640 10 monclient(hunting): authenticate will time out at 1364.879802s 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53bfff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc53c06efe0 0x7fc53c1d1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33864/0 (socket says 172.21.15.171:33864) 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.166+0000 7fc53bfff640 1 -- 172.21.15.171:0/3899135057 learned_addr learned my addr 172.21.15.171:0/3899135057 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778408662 0 0) 0x7fc53c124360 con 0x7fc53c06efe0 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:54.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): my global_id is 6791 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc528003530 con 0x7fc53c06efe0 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 61487836 0 0) 0x7fc528003530 con 0x7fc53c06efe0 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc53c124360 con 0x7fc53c06efe0 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc530004b30 con 0x7fc53c06efe0 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): dump: 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:54.164 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 142159237 0 0) 0x7fc53c122070 con 0x7fc53c06e4f0 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): _negotiate 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:54.165 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient(hunting): my global_id is 145399 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc528003530 con 0x7fc53c06e4f0 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2293116672 0 0) 0x7fc53c124360 con 0x7fc53c06efe0 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 >> v1:172.21.15.106:6792/0 conn(0x7fc53c13aa40 legacy=0x7fc53c1d4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 >> v1:172.21.15.106:6791/0 conn(0x7fc53c06e4f0 legacy=0x7fc53c135990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: _finish_hunting 0 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 monclient: found mon.h 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c124080 con 0x7fc53c06efe0 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: _finish_auth 0 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: _check_auth_tickets 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 5 monclient: authenticate success, global_id 6791 2024-04-26T00:01:54.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 10 monclient: _renew_subs 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc53c122920 con 0x7fc53c06efe0 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 10 monclient: _renew_subs 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc53c136270 con 0x7fc53c06efe0 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc530001a20 con 0x7fc53c06efe0 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc530005240 con 0x7fc53c06efe0 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc53affd640 4 set_mon_vals no callback set 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 10 monclient: dump: 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:54.167 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:54.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc51c005090 con 0x7fc53c06efe0 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc53000ffe0 con 0x7fc53c06efe0 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(233..233 src has 138..233) ==== 9698+0+0 (unknown 1021339293 0 0) 0x7fc530045e50 con 0x7fc53c06efe0 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.170+0000 7fc540c9d640 10 monclient: get_auth_request con 0x7fc5280378b0 auth_method 0 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.174+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc5300159a0 con 0x7fc53c06efe0 2024-04-26T00:01:54.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.174+0000 7fc5397fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:54.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.174+0000 7fc5397fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.326+0000 7fc542f01640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h22"}] 2024-04-26T00:01:54.310 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.326+0000 7fc542f01640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h22"}] 2024-04-26T00:01:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.326+0000 7fc542f01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:54.311 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.326+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h22"} v 0) -- 0x7fc51c005380 con 0x7fc53c06efe0 2024-04-26T00:01:54.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.934+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h22"}]=0 removed item id -82 name 'h22' from crush map v234) ==== 120+0+0 (unknown 1428331777 0 0) 0x7fc5300152a0 con 0x7fc53c06efe0 2024-04-26T00:01:54.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.934+0000 7fc5397fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h22"}] 2024-04-26T00:01:54.913 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:54.934+0000 7fc5397fa640 10 monclient: _finish_command 2 = system:0 removed item id -82 name 'h22' from crush map 2024-04-26T00:01:55.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.042+0000 7fc542f01640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h22"}] 2024-04-26T00:01:55.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.042+0000 7fc542f01640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h22"}] 2024-04-26T00:01:55.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.042+0000 7fc542f01640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:55.020 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.042+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h22"} v 0) -- 0x7fc51c002220 con 0x7fc53c06efe0 2024-04-26T00:01:55.022 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.042+0000 7fc5397fa640 1 -- 172.21.15.171:0/3899135057 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h22"}]=0 device 'h22' does not appear in the crush map v234) ==== 120+0+0 (unknown 1080965319 0 0) 0x7fc53001ddf0 con 0x7fc53c06efe0 2024-04-26T00:01:55.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.042+0000 7fc5397fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h22"}] 2024-04-26T00:01:55.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.042+0000 7fc5397fa640 10 monclient: _finish_command 3 = system:0 device 'h22' does not appear in the crush map 2024-04-26T00:01:55.023 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h22' does not appear in the crush map 2024-04-26T00:01:55.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 >> v1:172.21.15.171:6812/722422047 conn(0x7fc5280378b0 legacy=0x7fc528039d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:55.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 10 monclient: shutdown 2024-04-26T00:01:55.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:55.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 >> v1:172.21.15.171:6791/0 conn(0x7fc53c06efe0 legacy=0x7fc53c1d1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:55.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 shutdown_connections 2024-04-26T00:01:55.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 >> 172.21.15.171:0/3899135057 conn(0x7fc53c0a2620 msgr2=0x7fc53c0a2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:55.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 shutdown_connections 2024-04-26T00:01:55.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.046+0000 7fc542f01640 1 -- 172.21.15.171:0/3899135057 wait complete. 2024-04-26T00:01:55.040 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:55.040 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h23 2024-04-26T00:01:55.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.178+0000 7fc778c3b640 10 monclient: get_monmap_and_config 2024-04-26T00:01:55.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.178+0000 7fc778c3b640 10 monclient: build_initial_monmap 2024-04-26T00:01:55.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.178+0000 7fc778c3b640 10 monclient: monmap: 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:55.181208+0000 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:55.181208+0000 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:55.159 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:55.160 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:55.160 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:55.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.178+0000 7fc778c3b640 1 Processor -- start 2024-04-26T00:01:55.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.178+0000 7fc778c3b640 1 -- start start 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.178+0000 7fc778c3b640 10 monclient: init 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: _add_conns ranks=[7,3,2,1,8,0,5,4,6] 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): picked mon.noname-i con 0x7fc77409cdd0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): picked mon.noname-g con 0x7fc77409c180 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): picked mon.noname-b con 0x7fc77413e540 addr v1:172.21.15.106:6790/0 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77409a950 con 0x7fc77413e540 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7740a2ba0 con 0x7fc77409c180 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77409b4c0 con 0x7fc77409cdd0 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): authenticate will time out at 1365.888213s 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc771d9b640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fc77409c180 legacy=0x7fc7740a2490 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:55.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77259c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fc77409cdd0 0x7fc7740a1d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52444/0 (socket says 172.21.15.171:52444) 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77259c640 1 -- 172.21.15.171:0/1485509708 learned_addr learned my addr 172.21.15.171:0/1485509708 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835570861 0 0) 0x7fc77409b4c0 con 0x7fc77409cdd0 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient(hunting): _negotiate 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient(hunting): my global_id is 145321 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc75c003530 con 0x7fc77409cdd0 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2221856843 0 0) 0x7fc75c003530 con 0x7fc77409cdd0 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 >> v1:172.21.15.171:6790/0 conn(0x7fc77409c180 legacy=0x7fc7740a2490 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 >> v1:172.21.15.106:6790/0 conn(0x7fc77413e540 legacy=0x7fc774140930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: _finish_hunting 0 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 monclient: found mon.noname-i 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:55.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77409b7a0 con 0x7fc77409cdd0 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: _finish_auth 0 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: _check_auth_tickets 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7640017c0 con 0x7fc77409cdd0 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 5 monclient: authenticate success, global_id 145321 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: dump: 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.169 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc764001ab0 con 0x7fc77409cdd0 2024-04-26T00:01:55.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 1 -- 172.21.15.171:0/1485509708 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc764004bf0 con 0x7fc77409cdd0 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc77159a640 10 monclient: dump: 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:55.171 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 4 set_mon_vals no callback set 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: shutdown 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- 172.21.15.171:0/1485509708 >> v1:172.21.15.171:6792/0 conn(0x7fc77409cdd0 legacy=0x7fc7740a1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- 172.21.15.171:0/1485509708 shutdown_connections 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- 172.21.15.171:0/1485509708 >> 172.21.15.171:0/1485509708 conn(0x7fc7740a2e70 msgr2=0x7fc7740a3250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- 172.21.15.171:0/1485509708 shutdown_connections 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- 172.21.15.171:0/1485509708 wait complete. 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: build_initial_monmap 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: monmap: 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:55.172 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:55.173 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 Processor -- start 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- start start 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: init 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient: _add_conns ranks=[0,8,5,3,7,1,2,6,4] 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): picked mon.noname-a con 0x7fc77409c180 addr v1:172.21.15.106:6789/0 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): picked mon.noname-e con 0x7fc77409cdd0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): picked mon.noname-h con 0x7fc77413e540 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77412f020 con 0x7fc77409c180 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc77409ab90 con 0x7fc77413e540 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc774133760 con 0x7fc77409cdd0 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:55.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc778c3b640 10 monclient(hunting): authenticate will time out at 1365.891335s 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc772d9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fc77413e540 0x7fc7741d4990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33872/0 (socket says 172.21.15.171:33872) 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc772d9d640 1 -- 172.21.15.171:0/436175181 learned_addr learned my addr 172.21.15.171:0/436175181 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4083985555 0 0) 0x7fc76c001590 con 0x7fc77413e540 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 10 monclient(hunting): my global_id is 6800 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc754003530 con 0x7fc77413e540 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3405796138 0 0) 0x7fc754003530 con 0x7fc77413e540 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc76c001590 con 0x7fc77413e540 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc76c001fc0 con 0x7fc77413e540 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.182+0000 7fc762ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:55.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): dump: 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:55.176 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2122953994 0 0) 0x7fc77412f020 con 0x7fc77409c180 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): my global_id is 7011 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc754003530 con 0x7fc77409c180 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 587842036 0 0) 0x7fc774133760 con 0x7fc77409cdd0 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient(hunting): my global_id is 204533 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc77412f020 con 0x7fc77409cdd0 2024-04-26T00:01:55.177 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2963975813 0 0) 0x7fc76c001590 con 0x7fc77413e540 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 >> v1:172.21.15.106:6793/0 conn(0x7fc77409cdd0 legacy=0x7fc774133050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 >> v1:172.21.15.106:6789/0 conn(0x7fc77409c180 legacy=0x7fc774132940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 monclient: found mon.h 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc77409a740 con 0x7fc77413e540 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 5 monclient: authenticate success, global_id 6800 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 10 monclient: _renew_subs 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:55.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc774135bb0 con 0x7fc77413e540 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 10 monclient: _renew_subs 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc774136340 con 0x7fc77413e540 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc76c003e00 con 0x7fc77413e540 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc76c004370 con 0x7fc77413e540 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc770d99640 4 set_mon_vals no callback set 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 10 monclient: dump: 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.179 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:55.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc758005090 con 0x7fc77413e540 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc76c004590 con 0x7fc77413e540 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(234..234 src has 138..234) ==== 9485+0+0 (unknown 410340169 0 0) 0x7fc76c0462e0 con 0x7fc77413e540 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.186+0000 7fc77259c640 10 monclient: get_auth_request con 0x7fc7540379a0 auth_method 0 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.190+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc77409ab90 con 0x7fc77413e540 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.190+0000 7fc762ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:55.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.190+0000 7fc762ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:55.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.354+0000 7fc778c3b640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h23"}] 2024-04-26T00:01:55.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.354+0000 7fc778c3b640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h23"}] 2024-04-26T00:01:55.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.354+0000 7fc778c3b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:55.334 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.354+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h23"} v 0) -- 0x7fc758005380 con 0x7fc77413e540 2024-04-26T00:01:55.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.958+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h23"}]=0 removed item id -85 name 'h23' from crush map v235) ==== 120+0+0 (unknown 1651143530 0 0) 0x7fc77409a950 con 0x7fc77413e540 2024-04-26T00:01:55.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.958+0000 7fc762ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h23"}] 2024-04-26T00:01:55.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:55.958+0000 7fc762ffd640 10 monclient: _finish_command 2 = system:0 removed item id -85 name 'h23' from crush map 2024-04-26T00:01:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.054+0000 7fc778c3b640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h23"}] 2024-04-26T00:01:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.054+0000 7fc778c3b640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h23"}] 2024-04-26T00:01:56.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.054+0000 7fc778c3b640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:01:56.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.054+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h23"} v 0) -- 0x7fc7580010a0 con 0x7fc77413e540 2024-04-26T00:01:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc762ffd640 1 -- 172.21.15.171:0/436175181 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h23"}]=0 device 'h23' does not appear in the crush map v235) ==== 120+0+0 (unknown 4099281000 0 0) 0x7fc76c015e60 con 0x7fc77413e540 2024-04-26T00:01:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc762ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h23"}] 2024-04-26T00:01:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc762ffd640 10 monclient: _finish_command 3 = system:0 device 'h23' does not appear in the crush map 2024-04-26T00:01:56.037 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h23' does not appear in the crush map 2024-04-26T00:01:56.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 >> v1:172.21.15.171:6812/722422047 conn(0x7fc7540379a0 legacy=0x7fc754039e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc778c3b640 10 monclient: shutdown 2024-04-26T00:01:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc778c3b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 >> v1:172.21.15.171:6791/0 conn(0x7fc77413e540 legacy=0x7fc7741d4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 shutdown_connections 2024-04-26T00:01:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 >> 172.21.15.171:0/436175181 conn(0x7fc7740a2e70 msgr2=0x7fc774131600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.058+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 shutdown_connections 2024-04-26T00:01:56.041 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.062+0000 7fc778c3b640 1 -- 172.21.15.171:0/436175181 wait complete. 2024-04-26T00:01:56.054 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:56.054 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h24 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient: get_monmap_and_config 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient: build_initial_monmap 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient: monmap: 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:56.192881+0000 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:56.192881+0000 2024-04-26T00:01:56.170 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:56.171 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 1 Processor -- start 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 1 -- start start 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient: init 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient: _add_conns ranks=[4,7,1,2,8,0,5,6,3] 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient(hunting): picked mon.noname-c con 0x7f4adc135bb0 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient(hunting): picked mon.noname-i con 0x7f4adc1356f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient(hunting): picked mon.noname-f con 0x7f4adc13c130 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc0a1da0 con 0x7f4adc13c130 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc0a1fe0 con 0x7f4adc135bb0 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc072720 con 0x7f4adc1356f0 2024-04-26T00:01:56.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.190+0000 7f4ae18f8640 10 monclient(hunting): authenticate will time out at 1366.899871s 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad3fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f4adc1356f0 0x7f4adc13aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52450/0 (socket says 172.21.15.171:52450) 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad3fff640 1 -- 172.21.15.171:0/3252437175 learned_addr learned my addr 172.21.15.171:0/3252437175 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4adb7fe640 1 --1- 172.21.15.171:0/3252437175 >> v1:172.21.15.171:6789/0 conn(0x7f4adc13c130 0x7f4adc13e520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49458/0 (socket says 172.21.15.171:49458) 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 939113990 0 0) 0x7f4adc0a1da0 con 0x7f4adc13c130 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): my global_id is 145351 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ac8003530 con 0x7f4adc13c130 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 665262379 0 0) 0x7f4adc072720 con 0x7f4adc1356f0 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:56.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient(hunting): my global_id is 145330 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4adc0a1da0 con 0x7f4adc1356f0 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3697690801 0 0) 0x7f4ac8003530 con 0x7f4adc13c130 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 >> v1:172.21.15.171:6792/0 conn(0x7f4adc1356f0 legacy=0x7f4adc13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 >> v1:172.21.15.106:6791/0 conn(0x7f4adc135bb0 legacy=0x7f4adc135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 monclient: found mon.noname-f 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc0a17f0 con 0x7f4adc13c130 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4ad4001b40 con 0x7f4adc13c130 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 5 monclient: authenticate success, global_id 145351 2024-04-26T00:01:56.180 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: dump: 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:56.181 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4ad4001da0 con 0x7f4adc13c130 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 4 set_mon_vals no callback set 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 1 -- 172.21.15.171:0/3252437175 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4ad4004eb0 con 0x7f4adc13c130 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ada7fc640 10 monclient: dump: 2024-04-26T00:01:56.182 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:56.183 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: shutdown 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- 172.21.15.171:0/3252437175 >> v1:172.21.15.171:6789/0 conn(0x7f4adc13c130 legacy=0x7f4adc13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- 172.21.15.171:0/3252437175 shutdown_connections 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- 172.21.15.171:0/3252437175 >> 172.21.15.171:0/3252437175 conn(0x7f4adc0a2620 msgr2=0x7f4adc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- 172.21.15.171:0/3252437175 shutdown_connections 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- 172.21.15.171:0/3252437175 wait complete. 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: build_initial_monmap 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: monmap: 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:56.184 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 Processor -- start 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- start start 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: init 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: _add_conns ranks=[1,6,3,2,4,7,5,8,0] 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient(hunting): picked mon.noname-f con 0x7f4adc1356f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:56.185 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient(hunting): picked mon.noname-d con 0x7f4adc135bb0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient(hunting): picked mon.noname-g con 0x7f4adc13c130 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc071ef0 con 0x7f4adc1356f0 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc0719a0 con 0x7f4adc13c130 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4adc12df80 con 0x7f4adc135bb0 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient(hunting): authenticate will time out at 1366.902931s 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4adb7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f4adc13c130 legacy=0x7f4adc1d4ba0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4adaffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f4adc1356f0 0x7f4adc06f600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49474/0 (socket says 172.21.15.171:49474) 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4adaffd640 1 -- 172.21.15.171:0/2675209320 learned_addr learned my addr 172.21.15.171:0/2675209320 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011905900 0 0) 0x7f4adc071ef0 con 0x7f4adc1356f0 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:56.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): my global_id is 145360 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4abc003530 con 0x7f4adc1356f0 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 359353874 0 0) 0x7f4abc003530 con 0x7f4adc1356f0 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4adc071ef0 con 0x7f4adc1356f0 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4acc001ae0 con 0x7f4adc1356f0 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): dump: 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:56.187 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2060914823 0 0) 0x7f4adc071ef0 con 0x7f4adc1356f0 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 >> v1:172.21.15.106:6792/0 conn(0x7f4adc135bb0 legacy=0x7f4adc06fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 >> v1:172.21.15.171:6790/0 conn(0x7f4adc13c130 legacy=0x7f4adc1d4ba0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 monclient: found mon.f 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:56.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4adc12d6e0 con 0x7f4adc1356f0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: _finish_auth 0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 5 monclient: authenticate success, global_id 145360 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: _renew_subs 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4adc134980 con 0x7f4adc1356f0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: _renew_subs 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4adc0705f0 con 0x7f4adc1356f0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4acc0038d0 con 0x7f4adc1356f0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4acc003e40 con 0x7f4adc1356f0 2024-04-26T00:01:56.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad9ffb640 4 set_mon_vals no callback set 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.194+0000 7f4ad8ff9640 10 monclient: dump: 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:56.190 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.198+0000 7f4ae18f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.198+0000 7f4ae18f8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.198+0000 7f4ae18f8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.198+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ac0005090 con 0x7f4adc1356f0 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.198+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4acc003fe0 con 0x7f4adc1356f0 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.198+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(235..235 src has 138..235) ==== 9272+0+0 (unknown 1642957151 0 0) 0x7f4acc045bf0 con 0x7f4adc1356f0 2024-04-26T00:01:56.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.198+0000 7f4ad3fff640 10 monclient: get_auth_request con 0x7f4abc037850 auth_method 0 2024-04-26T00:01:56.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.202+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f4acc0157f0 con 0x7f4adc1356f0 2024-04-26T00:01:56.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.202+0000 7f4ad8ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:56.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.202+0000 7f4ad8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:56.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.362+0000 7f4ae18f8640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h24"}] 2024-04-26T00:01:56.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.362+0000 7f4ae18f8640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h24"}] 2024-04-26T00:01:56.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.362+0000 7f4ae18f8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:56.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.362+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h24"} v 0) -- 0x7f4ac0005380 con 0x7f4adc1356f0 2024-04-26T00:01:56.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.966+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h24"}]=0 removed item id -88 name 'h24' from crush map v236) ==== 120+0+0 (unknown 1074743054 0 0) 0x7f4acc0194a0 con 0x7f4adc1356f0 2024-04-26T00:01:56.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.966+0000 7f4ad8ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h24"}] 2024-04-26T00:01:56.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:56.966+0000 7f4ad8ff9640 10 monclient: _finish_command 2 = system:0 removed item id -88 name 'h24' from crush map 2024-04-26T00:01:57.043 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h24"}] 2024-04-26T00:01:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h24"}] 2024-04-26T00:01:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:57.044 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h24"} v 0) -- 0x7f4ac00010a0 con 0x7f4adc1356f0 2024-04-26T00:01:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ad8ff9640 1 -- 172.21.15.171:0/2675209320 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h24"}]=0 device 'h24' does not appear in the crush map v236) ==== 120+0+0 (unknown 4140453942 0 0) 0x7f4acc01dd60 con 0x7f4adc1356f0 2024-04-26T00:01:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ad8ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h24"}] 2024-04-26T00:01:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ad8ff9640 10 monclient: _finish_command 3 = system:0 device 'h24' does not appear in the crush map 2024-04-26T00:01:57.045 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h24' does not appear in the crush map 2024-04-26T00:01:57.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 >> v1:172.21.15.171:6812/722422047 conn(0x7f4abc037850 legacy=0x7f4abc039d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:57.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 10 monclient: shutdown 2024-04-26T00:01:57.047 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:57.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.066+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 >> v1:172.21.15.171:6789/0 conn(0x7f4adc1356f0 legacy=0x7f4adc06f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:57.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.070+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 shutdown_connections 2024-04-26T00:01:57.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.070+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 >> 172.21.15.171:0/2675209320 conn(0x7f4adc0a2620 msgr2=0x7f4adc13e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:57.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.070+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 shutdown_connections 2024-04-26T00:01:57.048 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.070+0000 7f4ae18f8640 1 -- 172.21.15.171:0/2675209320 wait complete. 2024-04-26T00:01:57.062 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:57.062 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h25 2024-04-26T00:01:57.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.198+0000 7fd203760640 10 monclient: get_monmap_and_config 2024-04-26T00:01:57.178 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.198+0000 7fd203760640 10 monclient: build_initial_monmap 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.198+0000 7fd203760640 10 monclient: monmap: 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:57.201420+0000 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:57.201420+0000 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:57.179 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:57.180 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:57.180 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:57.180 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:57.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.198+0000 7fd203760640 1 Processor -- start 2024-04-26T00:01:57.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.198+0000 7fd203760640 1 -- start start 2024-04-26T00:01:57.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.198+0000 7fd203760640 10 monclient: init 2024-04-26T00:01:57.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:57.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: _add_conns ranks=[7,5,8,4,0,3,2,6,1] 2024-04-26T00:01:57.186 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): picked mon.noname-i con 0x7fd1fc135bb0 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): picked mon.noname-h con 0x7fd1fc1356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): picked mon.noname-e con 0x7fd1fc13c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc0a1da0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc0a1fe0 con 0x7fd1fc135bb0 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc072720 con 0x7fd1fc13c130 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): authenticate will time out at 1367.908570s 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd2014fc640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fd1fc135bb0 0x7fd1fc135f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52458/0 (socket says 172.21.15.171:52458) 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd2014fc640 1 -- 172.21.15.171:0/2696969191 learned_addr learned my addr 172.21.15.171:0/2696969191 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1448405934 0 0) 0x7fd1fc0a1da0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): my global_id is 6809 2024-04-26T00:01:57.187 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e8003530 con 0x7fd1fc1356f0 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493522361 0 0) 0x7fd1fc0a1fe0 con 0x7fd1fc135bb0 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient(hunting): my global_id is 145339 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1fc0a1da0 con 0x7fd1fc135bb0 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2722259278 0 0) 0x7fd1e8003530 con 0x7fd1fc1356f0 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 >> v1:172.21.15.106:6793/0 conn(0x7fd1fc13c130 legacy=0x7fd1fc13e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 >> v1:172.21.15.171:6792/0 conn(0x7fd1fc135bb0 legacy=0x7fd1fc135f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 monclient: found mon.noname-h 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:01:57.188 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc0a17f0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: _finish_auth 0 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd1f80017c0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 5 monclient: authenticate success, global_id 6809 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: dump: 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.189 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1f8001aa0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:57.190 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 1 -- 172.21.15.171:0/2696969191 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd1f8003940 con 0x7fd1fc1356f0 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 4 set_mon_vals no callback set 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f3fff640 10 monclient: dump: 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:57.191 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: shutdown 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- 172.21.15.171:0/2696969191 >> v1:172.21.15.171:6791/0 conn(0x7fd1fc1356f0 legacy=0x7fd1fc13aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- 172.21.15.171:0/2696969191 shutdown_connections 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- 172.21.15.171:0/2696969191 >> 172.21.15.171:0/2696969191 conn(0x7fd1fc0a2620 msgr2=0x7fd1fc0a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- 172.21.15.171:0/2696969191 shutdown_connections 2024-04-26T00:01:57.192 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- 172.21.15.171:0/2696969191 wait complete. 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: build_initial_monmap 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: monmap: 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:57.193 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 Processor -- start 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- start start 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: init 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient: _add_conns ranks=[1,3,5,6,2,0,4,8,7] 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): picked mon.noname-f con 0x7fd1fc1356f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): picked mon.noname-g con 0x7fd1fc135bb0 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): picked mon.noname-h con 0x7fd1fc13c130 addr v1:172.21.15.171:6791/0 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc1cadf0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc137db0 con 0x7fd1fc135bb0 2024-04-26T00:01:57.194 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1fc139800 con 0x7fd1fc13c130 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd203760640 10 monclient(hunting): authenticate will time out at 1367.911559s 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd200cfb640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fd1fc135bb0 legacy=0x7fd1fc13b5d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd201cfd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fd1fc13c130 0x7fd1fc1d2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:33884/0 (socket says 172.21.15.171:33884) 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd2014fc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd1fc1356f0 0x7fd1fc1ca6e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49488/0 (socket says 172.21.15.171:49488) 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd201cfd640 1 -- 172.21.15.171:0/4160016423 learned_addr learned my addr 172.21.15.171:0/4160016423 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2314647108 0 0) 0x7fd1fc1cadf0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): my global_id is 145369 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1e0003560 con 0x7fd1fc1356f0 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312863263 0 0) 0x7fd1fc139800 con 0x7fd1fc13c130 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:01:57.195 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 10 monclient(hunting): my global_id is 6818 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.202+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1fc1cadf0 con 0x7fd1fc13c130 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 805008238 0 0) 0x7fd1e0003560 con 0x7fd1fc1356f0 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1fc139800 con 0x7fd1fc1356f0 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd1ec001a00 con 0x7fd1fc1356f0 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient(hunting): dump: 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:57.196 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2000131318 0 0) 0x7fd1fc1cadf0 con 0x7fd1fc13c130 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1e0003560 con 0x7fd1fc13c130 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd1f4001cc0 con 0x7fd1fc13c130 2024-04-26T00:01:57.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient(hunting): dump: 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:57.198 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1788109675 0 0) 0x7fd1fc139800 con 0x7fd1fc1356f0 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 >> v1:172.21.15.171:6791/0 conn(0x7fd1fc13c130 legacy=0x7fd1fc1d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 >> v1:172.21.15.171:6790/0 conn(0x7fd1fc135bb0 legacy=0x7fd1fc13b5d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 monclient: found mon.f 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1fc139ae0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.199 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: _finish_auth 0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 5 monclient: authenticate success, global_id 145369 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 10 monclient: _renew_subs 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd1fc139dc0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 10 monclient: _renew_subs 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd1fc138910 con 0x7fd1fc1356f0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd1ec001cd0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd1ec004e60 con 0x7fd1fc1356f0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:57.200 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f37fe640 4 set_mon_vals no callback set 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 10 monclient: dump: 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:57.201 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1dc005090 con 0x7fd1fc1356f0 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd1ec005000 con 0x7fd1fc1356f0 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(236..236 src has 138..236) ==== 9059+0+0 (unknown 350123675 0 0) 0x7fd1ec0459d0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.202 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.206+0000 7fd200cfb640 10 monclient: get_auth_request con 0x7fd1e0037e70 auth_method 0 2024-04-26T00:01:57.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.210+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd1ec0156a0 con 0x7fd1fc1356f0 2024-04-26T00:01:57.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.210+0000 7fd1f1ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:57.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.210+0000 7fd1f1ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:57.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.374+0000 7fd203760640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h25"}] 2024-04-26T00:01:57.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.374+0000 7fd203760640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h25"}] 2024-04-26T00:01:57.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.374+0000 7fd203760640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:57.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.374+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h25"} v 0) -- 0x7fd1dc005380 con 0x7fd1fc1356f0 2024-04-26T00:01:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.990+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h25"}]=0 removed item id -91 name 'h25' from crush map v237) ==== 120+0+0 (unknown 3350833303 0 0) 0x7fd1ec019350 con 0x7fd1fc1356f0 2024-04-26T00:01:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.990+0000 7fd1f1ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h25"}] 2024-04-26T00:01:57.969 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:57.990+0000 7fd1f1ffb640 10 monclient: _finish_command 2 = system:0 removed item id -91 name 'h25' from crush map 2024-04-26T00:01:58.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.094+0000 7fd203760640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h25"}] 2024-04-26T00:01:58.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.094+0000 7fd203760640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h25"}] 2024-04-26T00:01:58.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.094+0000 7fd203760640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:58.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.094+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h25"} v 0) -- 0x7fd1dc0010a0 con 0x7fd1fc1356f0 2024-04-26T00:01:58.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.094+0000 7fd1f1ffb640 1 -- 172.21.15.171:0/4160016423 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h25"}]=0 device 'h25' does not appear in the crush map v237) ==== 120+0+0 (unknown 1123186841 0 0) 0x7fd1ec01dc10 con 0x7fd1fc1356f0 2024-04-26T00:01:58.074 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.094+0000 7fd1f1ffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h25"}] 2024-04-26T00:01:58.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.094+0000 7fd1f1ffb640 10 monclient: _finish_command 3 = system:0 device 'h25' does not appear in the crush map 2024-04-26T00:01:58.075 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h25' does not appear in the crush map 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 >> v1:172.21.15.171:6812/722422047 conn(0x7fd1e0037e70 legacy=0x7fd1e003a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 10 monclient: shutdown 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 >> v1:172.21.15.171:6789/0 conn(0x7fd1fc1356f0 legacy=0x7fd1fc1ca6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 shutdown_connections 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 >> 172.21.15.171:0/4160016423 conn(0x7fd1fc0a2620 msgr2=0x7fd1fc134250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 shutdown_connections 2024-04-26T00:01:58.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.098+0000 7fd203760640 1 -- 172.21.15.171:0/4160016423 wait complete. 2024-04-26T00:01:58.092 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:58.092 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h26 2024-04-26T00:01:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient: get_monmap_and_config 2024-04-26T00:01:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient: build_initial_monmap 2024-04-26T00:01:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient: monmap: 2024-04-26T00:01:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:58.233111+0000 2024-04-26T00:01:58.210 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:58.233111+0000 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:58.211 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 1 Processor -- start 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 1 -- start start 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient: init 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient: _add_conns ranks=[4,6,8,0,7,3,1,5,2] 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient(hunting): picked mon.noname-c con 0x7f9f80099510 addr v1:172.21.15.106:6791/0 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient(hunting): picked mon.noname-d con 0x7f9f800998f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 10 monclient(hunting): picked mon.noname-e con 0x7f9f80099cf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.230+0000 7f9f87dc9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f800a27c0 con 0x7f9f80099510 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8009a450 con 0x7f9f800998f0 2024-04-26T00:01:58.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8009a730 con 0x7f9f80099cf0 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 10 monclient(hunting): authenticate will time out at 1368.940037s 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f86366640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f9f80099cf0 0x7f9f8013e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.171:56644/0 (socket says 172.21.15.171:56644) 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f86366640 1 -- 172.21.15.171:0/4191438916 learned_addr learned my addr 172.21.15.171:0/4191438916 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f85b65640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9f80099510 0x7f9f8009fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:55192/0 (socket says 172.21.15.171:55192) 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863462652 0 0) 0x7f9f8009a450 con 0x7f9f800998f0 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _negotiate 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): my global_id is 6891 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f6c003530 con 0x7f9f800998f0 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885534912 0 0) 0x7f9f800a27c0 con 0x7f9f80099510 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _negotiate 2024-04-26T00:01:58.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): my global_id is 145417 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f8009a450 con 0x7f9f80099510 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4179635167 0 0) 0x7f9f8009a730 con 0x7f9f80099cf0 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _negotiate 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient(hunting): my global_id is 204551 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f800a27c0 con 0x7f9f80099cf0 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 664026057 0 0) 0x7f9f8009a450 con 0x7f9f80099510 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 >> v1:172.21.15.106:6793/0 conn(0x7f9f80099cf0 legacy=0x7f9f8013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 >> v1:172.21.15.106:6792/0 conn(0x7f9f800998f0 legacy=0x7f9f8013a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: _finish_hunting 0 2024-04-26T00:01:58.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 monclient: found mon.noname-c 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f8009aa10 con 0x7f9f80099510 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: _finish_auth 0 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: _check_auth_tickets 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f7c001aa0 con 0x7f9f80099510 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: dump: 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.218 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 5 monclient: authenticate success, global_id 145417 2024-04-26T00:01:58.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f7c001d10 con 0x7f9f80099510 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 1 -- 172.21.15.171:0/4191438916 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f7c004eb0 con 0x7f9f80099510 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 4 set_mon_vals no callback set 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f84b63640 10 monclient: dump: 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:58.220 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 10 monclient: shutdown 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- 172.21.15.171:0/4191438916 >> v1:172.21.15.106:6791/0 conn(0x7f9f80099510 legacy=0x7f9f8009fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- 172.21.15.171:0/4191438916 shutdown_connections 2024-04-26T00:01:58.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- 172.21.15.171:0/4191438916 >> 172.21.15.171:0/4191438916 conn(0x7f9f800a6850 msgr2=0x7f9f800a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- 172.21.15.171:0/4191438916 shutdown_connections 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- 172.21.15.171:0/4191438916 wait complete. 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 10 monclient: build_initial_monmap 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 10 monclient: monmap: 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:58.222 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 Processor -- start 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 1 -- start start 2024-04-26T00:01:58.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.234+0000 7f9f87dc9640 10 monclient: init 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _add_conns ranks=[7,1,8,2,5,3,6,0,4] 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient(hunting): picked mon.noname-i con 0x7f9f80099510 addr v1:172.21.15.171:6792/0 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient(hunting): picked mon.noname-f con 0x7f9f800998f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient(hunting): picked mon.noname-e con 0x7f9f80099cf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8013ad40 con 0x7f9f800998f0 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f8013d0a0 con 0x7f9f80099510 2024-04-26T00:01:58.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f80098ed0 con 0x7f9f80099cf0 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient(hunting): authenticate will time out at 1368.944144s 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f85b65640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f9f80099510 0x7f9f800980b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52462/0 (socket says 172.21.15.171:52462) 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f85b65640 1 -- 172.21.15.171:0/3355571023 learned_addr learned my addr 172.21.15.171:0/3355571023 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f85364640 1 --1- 172.21.15.171:0/3355571023 >> v1:172.21.15.171:6789/0 conn(0x7f9f800998f0 0x7f9f800987c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49500/0 (socket says 172.21.15.171:49500) 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185962143 0 0) 0x7f9f8013d0a0 con 0x7f9f80099510 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): my global_id is 145348 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f64003560 con 0x7f9f80099510 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2390169835 0 0) 0x7f9f8013ad40 con 0x7f9f800998f0 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:58.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): my global_id is 145378 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f8013d0a0 con 0x7f9f800998f0 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3577443439 0 0) 0x7f9f8013d0a0 con 0x7f9f800998f0 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f8013ad40 con 0x7f9f800998f0 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1348415797 0 0) 0x7f9f64003560 con 0x7f9f80099510 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f8013d0a0 con 0x7f9f80099510 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f70001640 con 0x7f9f800998f0 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): dump: 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:58.229 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:58.230 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f7c004eb0 con 0x7f9f80099510 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): dump: 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:58.231 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2137664643 0 0) 0x7f9f80098ed0 con 0x7f9f80099cf0 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient(hunting): my global_id is 204560 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f64003560 con 0x7f9f80099cf0 2024-04-26T00:01:58.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2969019270 0 0) 0x7f9f8013d0a0 con 0x7f9f80099510 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 >> v1:172.21.15.106:6793/0 conn(0x7f9f80099cf0 legacy=0x7f9f801d2ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 >> v1:172.21.15.171:6789/0 conn(0x7f9f800998f0 legacy=0x7f9f800987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: _finish_hunting 0 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 monclient: found mon.i 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f800992e0 con 0x7f9f80099510 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: _finish_auth 0 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: _check_auth_tickets 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 5 monclient: authenticate success, global_id 145348 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _renew_subs 2024-04-26T00:01:58.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f800a05f0 con 0x7f9f80099510 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _renew_subs 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f8013b420 con 0x7f9f80099510 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f7c001d10 con 0x7f9f80099510 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f77fff640 4 set_mon_vals no callback set 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9f7c0054f0 con 0x7f9f80099510 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 10 monclient: dump: 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:58.234 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:58.235 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9f7c010290 con 0x7f9f80099510 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f68005090 con 0x7f9f80099510 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(237..237 src has 138..237) ==== 8846+0+0 (unknown 1798639843 0 0) 0x7f9f7c045d70 con 0x7f9f80099510 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.238+0000 7f9f85364640 10 monclient: get_auth_request con 0x7f9f64037e30 auth_method 0 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.242+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9f7c015c10 con 0x7f9f80099510 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.242+0000 7f9f767fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:58.236 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.242+0000 7f9f767fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:58.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.406+0000 7f9f87dc9640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h26"}] 2024-04-26T00:01:58.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.406+0000 7f9f87dc9640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h26"}] 2024-04-26T00:01:58.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.406+0000 7f9f87dc9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:58.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.406+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h26"} v 0) -- 0x7f9f68005380 con 0x7f9f80099510 2024-04-26T00:01:58.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.990+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h26"}]=0 removed item id -94 name 'h26' from crush map v238) ==== 120+0+0 (unknown 1339653864 0 0) 0x7f9f7c015510 con 0x7f9f80099510 2024-04-26T00:01:58.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.990+0000 7f9f767fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h26"}] 2024-04-26T00:01:58.968 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:58.990+0000 7f9f767fc640 10 monclient: _finish_command 2 = system:0 removed item id -94 name 'h26' from crush map 2024-04-26T00:01:59.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.094+0000 7f9f87dc9640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h26"}] 2024-04-26T00:01:59.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.094+0000 7f9f87dc9640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h26"}] 2024-04-26T00:01:59.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.094+0000 7f9f87dc9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:01:59.073 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.094+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h26"} v 0) -- 0x7f9f68002220 con 0x7f9f80099510 2024-04-26T00:01:59.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.094+0000 7f9f767fc640 1 -- 172.21.15.171:0/3355571023 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h26"}]=0 device 'h26' does not appear in the crush map v238) ==== 120+0+0 (unknown 2606135193 0 0) 0x7f9f7c01e060 con 0x7f9f80099510 2024-04-26T00:01:59.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.094+0000 7f9f767fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h26"}] 2024-04-26T00:01:59.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.094+0000 7f9f767fc640 10 monclient: _finish_command 3 = system:0 device 'h26' does not appear in the crush map 2024-04-26T00:01:59.075 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h26' does not appear in the crush map 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 >> v1:172.21.15.171:6812/722422047 conn(0x7f9f64037e30 legacy=0x7f9f6403a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 10 monclient: shutdown 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 >> v1:172.21.15.171:6792/0 conn(0x7f9f80099510 legacy=0x7f9f800980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 shutdown_connections 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 >> 172.21.15.171:0/3355571023 conn(0x7f9f800a6850 msgr2=0x7f9f8013f0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 shutdown_connections 2024-04-26T00:01:59.078 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.098+0000 7f9f87dc9640 1 -- 172.21.15.171:0/3355571023 wait complete. 2024-04-26T00:01:59.093 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:01:59.093 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h27 2024-04-26T00:01:59.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.230+0000 7fc9585de640 10 monclient: get_monmap_and_config 2024-04-26T00:01:59.210 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.230+0000 7fc9585de640 10 monclient: build_initial_monmap 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.230+0000 7fc9585de640 10 monclient: monmap: 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:01:59.233348+0000 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:01:59.233348+0000 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:59.211 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:59.212 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:59.212 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:59.212 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:59.212 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:59.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 Processor -- start 2024-04-26T00:01:59.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- start start 2024-04-26T00:01:59.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: init 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: _add_conns ranks=[3,6,1,7,2,8,4,0,5] 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient(hunting): picked mon.noname-g con 0x7fc950099410 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient(hunting): picked mon.noname-d con 0x7fc9500997f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient(hunting): picked mon.noname-f con 0x7fc950099c10 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95009fb60 con 0x7fc950099c10 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9500a2bb0 con 0x7fc950099410 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95009a4f0 con 0x7fc9500997f0 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient(hunting): authenticate will time out at 1369.940962s 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc95637a640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fc950099410 legacy=0x7fc9500a1670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc956b7b640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc950099c10 0x7fc95013e0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49514/0 (socket says 172.21.15.171:49514) 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc956b7b640 1 -- 172.21.15.171:0/1752746451 learned_addr learned my addr 172.21.15.171:0/1752746451 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:59.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 669885264 0 0) 0x7fc95009fb60 con 0x7fc950099c10 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient(hunting): _negotiate 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient(hunting): my global_id is 145387 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc93c003530 con 0x7fc950099c10 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 517435256 0 0) 0x7fc93c003530 con 0x7fc950099c10 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 >> v1:172.21.15.106:6792/0 conn(0x7fc9500997f0 legacy=0x7fc95013a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 >> v1:172.21.15.171:6790/0 conn(0x7fc950099410 legacy=0x7fc9500a1670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: _finish_hunting 0 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 monclient: found mon.noname-f 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:01:59.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95009a7d0 con 0x7fc950099c10 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: _finish_auth 0 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: _check_auth_tickets 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 5 monclient: authenticate success, global_id 145387 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc948001b40 con 0x7fc950099c10 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: dump: 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.222 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc948001da0 con 0x7fc950099c10 2024-04-26T00:01:59.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 1 -- 172.21.15.171:0/1752746451 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc948004f70 con 0x7fc950099c10 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: get_monmap_and_config success 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 4 set_mon_vals no callback set 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc955378640 10 monclient: dump: 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:59.224 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: shutdown 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- 172.21.15.171:0/1752746451 >> v1:172.21.15.171:6789/0 conn(0x7fc950099c10 legacy=0x7fc95013e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- 172.21.15.171:0/1752746451 shutdown_connections 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- 172.21.15.171:0/1752746451 >> 172.21.15.171:0/1752746451 conn(0x7fc9500a6850 msgr2=0x7fc9500a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:01:59.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- 172.21.15.171:0/1752746451 shutdown_connections 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- 172.21.15.171:0/1752746451 wait complete. 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: build_initial_monmap 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: monmap: 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:01:59.226 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 Processor -- start 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 1 -- start start 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.234+0000 7fc9585de640 10 monclient: init 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _reopen_session rank -1 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _add_conns ranks=[1,6,3,4,8,7,5,0,2] 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient(hunting): picked mon.noname-f con 0x7fc950099410 addr v1:172.21.15.171:6789/0 2024-04-26T00:01:59.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient(hunting): picked mon.noname-d con 0x7fc9500997f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient(hunting): picked mon.noname-g con 0x7fc950099c10 addr v1:172.21.15.171:6790/0 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95012c1d0 con 0x7fc950099410 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95012c490 con 0x7fc950099c10 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc95012c770 con 0x7fc9500997f0 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient(hunting): _renew_subs 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc956b7b640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fc950099c10 legacy=0x7fc9501d5480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient(hunting): authenticate will time out at 1369.944162s 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc95637a640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fc950099410 0x7fc9500984a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49522/0 (socket says 172.21.15.171:49522) 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc95637a640 1 -- 172.21.15.171:0/72172892 learned_addr learned my addr 172.21.15.171:0/72172892 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193784563 0 0) 0x7fc95012c1d0 con 0x7fc950099410 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:59.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): my global_id is 145396 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc934003530 con 0x7fc950099410 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 891893005 0 0) 0x7fc934003530 con 0x7fc950099410 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc95012c1d0 con 0x7fc950099410 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc94c004300 con 0x7fc950099410 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): dump: 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:59.229 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441718109 0 0) 0x7fc95012c770 con 0x7fc9500997f0 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:01:59.230 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient(hunting): my global_id is 6909 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc934003530 con 0x7fc9500997f0 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 28455818 0 0) 0x7fc95012c1d0 con 0x7fc950099410 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 >> v1:172.21.15.106:6792/0 conn(0x7fc9500997f0 legacy=0x7fc9501d1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 >> v1:172.21.15.171:6790/0 conn(0x7fc950099c10 legacy=0x7fc9501d5480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 monclient: found mon.f 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc95012ca50 con 0x7fc950099410 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: _finish_auth 0 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 5 monclient: authenticate success, global_id 145396 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _renew_subs 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:59.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc95012b5c0 con 0x7fc950099410 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _renew_subs 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc95009f110 con 0x7fc950099410 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc94c0045f0 con 0x7fc950099410 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc94c004b60 con 0x7fc950099410 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc954b77640 4 set_mon_vals no callback set 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 10 monclient: dump: 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:01:59.232 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc94c004d40 con 0x7fc950099410 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:59.233 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc938005090 con 0x7fc950099410 2024-04-26T00:01:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(238..238 src has 138..238) ==== 8633+0+0 (unknown 985021264 0 0) 0x7fc94c045940 con 0x7fc950099410 2024-04-26T00:01:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.238+0000 7fc955b79640 10 monclient: get_auth_request con 0x7fc934037790 auth_method 0 2024-04-26T00:01:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.242+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc94c015790 con 0x7fc950099410 2024-04-26T00:01:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.242+0000 7fc946ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:01:59.234 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.242+0000 7fc946ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:01:59.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.406+0000 7fc9585de640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h27"}] 2024-04-26T00:01:59.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.406+0000 7fc9585de640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h27"}] 2024-04-26T00:01:59.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.406+0000 7fc9585de640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:01:59.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:01:59.406+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h27"} v 0) -- 0x7fc938005380 con 0x7fc950099410 2024-04-26T00:02:00.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.022+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h27"}]=0 removed item id -97 name 'h27' from crush map v239) ==== 120+0+0 (unknown 3411877522 0 0) 0x7fc94c019440 con 0x7fc950099410 2024-04-26T00:02:00.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.022+0000 7fc946ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h27"}] 2024-04-26T00:02:00.000 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.022+0000 7fc946ffd640 10 monclient: _finish_command 2 = system:0 removed item id -97 name 'h27' from crush map 2024-04-26T00:02:00.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.122+0000 7fc9585de640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h27"}] 2024-04-26T00:02:00.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.122+0000 7fc9585de640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h27"}] 2024-04-26T00:02:00.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.122+0000 7fc9585de640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:00.103 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.122+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h27"} v 0) -- 0x7fc938002220 con 0x7fc950099410 2024-04-26T00:02:00.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc946ffd640 1 -- 172.21.15.171:0/72172892 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h27"}]=0 device 'h27' does not appear in the crush map v239) ==== 120+0+0 (unknown 795762486 0 0) 0x7fc94c01dd00 con 0x7fc950099410 2024-04-26T00:02:00.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc946ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h27"}] 2024-04-26T00:02:00.105 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc946ffd640 10 monclient: _finish_command 3 = system:0 device 'h27' does not appear in the crush map 2024-04-26T00:02:00.105 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h27' does not appear in the crush map 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 >> v1:172.21.15.171:6812/722422047 conn(0x7fc934037790 legacy=0x7fc934039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 10 monclient: shutdown 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 >> v1:172.21.15.171:6789/0 conn(0x7fc950099410 legacy=0x7fc9500984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 shutdown_connections 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 >> 172.21.15.171:0/72172892 conn(0x7fc9500a6850 msgr2=0x7fc95009b1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 shutdown_connections 2024-04-26T00:02:00.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.126+0000 7fc9585de640 1 -- 172.21.15.171:0/72172892 wait complete. 2024-04-26T00:02:00.121 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:02:00.121 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h28 2024-04-26T00:02:00.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.258+0000 7f3af74e0640 10 monclient: get_monmap_and_config 2024-04-26T00:02:00.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.258+0000 7f3af74e0640 10 monclient: build_initial_monmap 2024-04-26T00:02:00.238 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.258+0000 7f3af74e0640 10 monclient: monmap: 2024-04-26T00:02:00.238 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:00.238 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:00.238 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:00.261141+0000 2024-04-26T00:02:00.238 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:00.261141+0000 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:00.239 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:00.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.258+0000 7f3af74e0640 1 Processor -- start 2024-04-26T00:02:00.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.258+0000 7f3af74e0640 1 -- start start 2024-04-26T00:02:00.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.258+0000 7f3af74e0640 10 monclient: init 2024-04-26T00:02:00.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:00.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: _add_conns ranks=[4,7,2,8,1,5,3,0,6] 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): picked mon.noname-c con 0x7f3af006e4f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): picked mon.noname-i con 0x7f3af006efe0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): picked mon.noname-b con 0x7f3af013aa40 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af0070df0 con 0x7f3af013aa40 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af00710d0 con 0x7f3af006e4f0 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af0072f10 con 0x7f3af006efe0 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): authenticate will time out at 1370.968568s 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af4a7b640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f3af006efe0 0x7f3af0139320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52474/0 (socket says 172.21.15.171:52474) 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af4a7b640 1 -- 172.21.15.171:0/1740290229 learned_addr learned my addr 172.21.15.171:0/1740290229 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2963513615 0 0) 0x7f3af0072f10 con 0x7f3af006efe0 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:00.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient(hunting): my global_id is 145357 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ad8003530 con 0x7f3af006efe0 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3520016554 0 0) 0x7f3ad8003530 con 0x7f3af006efe0 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 >> v1:172.21.15.106:6791/0 conn(0x7f3af006e4f0 legacy=0x7f3af006e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 >> v1:172.21.15.106:6790/0 conn(0x7f3af013aa40 legacy=0x7f3af013ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 monclient: found mon.noname-i 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af006fa90 con 0x7f3af006efe0 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: _finish_auth 0 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:00.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 5 monclient: authenticate success, global_id 145357 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ae40017c0 con 0x7f3af006efe0 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: dump: 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:00.249 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ae4001ab0 con 0x7f3af006efe0 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 4 set_mon_vals no callback set 2024-04-26T00:02:00.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 1 -- 172.21.15.171:0/1740290229 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ae4004bf0 con 0x7f3af006efe0 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aeffff640 10 monclient: dump: 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:00.251 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: shutdown 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- 172.21.15.171:0/1740290229 >> v1:172.21.15.171:6792/0 conn(0x7f3af006efe0 legacy=0x7f3af0139320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- 172.21.15.171:0/1740290229 shutdown_connections 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- 172.21.15.171:0/1740290229 >> 172.21.15.171:0/1740290229 conn(0x7f3af00a2620 msgr2=0x7f3af00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- 172.21.15.171:0/1740290229 shutdown_connections 2024-04-26T00:02:00.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- 172.21.15.171:0/1740290229 wait complete. 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: build_initial_monmap 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: monmap: 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:00.253 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 Processor -- start 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- start start 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: init 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient: _add_conns ranks=[1,6,7,0,4,5,2,8,3] 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): picked mon.noname-f con 0x7f3af006e4f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): picked mon.noname-d con 0x7f3af006efe0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): picked mon.noname-i con 0x7f3af013aa40 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:00.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af012afe0 con 0x7f3af006e4f0 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af009e1c0 con 0x7f3af006efe0 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3af0070930 con 0x7f3af013aa40 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af74e0640 10 monclient(hunting): authenticate will time out at 1370.971399s 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af5a7d640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f3af013aa40 0x7f3af01d5020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52484/0 (socket says 172.21.15.171:52484) 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af527c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f3af006e4f0 0x7f3af0130530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:49534/0 (socket says 172.21.15.171:49534) 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3af5a7d640 1 -- 172.21.15.171:0/1423311844 learned_addr learned my addr 172.21.15.171:0/1423311844 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3149847444 0 0) 0x7f3af012afe0 con 0x7f3af006e4f0 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): my global_id is 145405 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3adc003530 con 0x7f3af006e4f0 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232788149 0 0) 0x7f3af0070930 con 0x7f3af013aa40 2024-04-26T00:02:00.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 10 monclient(hunting): my global_id is 145366 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.262+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3af012afe0 con 0x7f3af013aa40 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2542346168 0 0) 0x7f3adc003530 con 0x7f3af006e4f0 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3af0070930 con 0x7f3af006e4f0 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3689772554 0 0) 0x7f3af012afe0 con 0x7f3af013aa40 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3adc003530 con 0x7f3af013aa40 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ae8001a10 con 0x7f3af006e4f0 2024-04-26T00:02:00.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): dump: 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:00.257 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ae0001da0 con 0x7f3af013aa40 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): dump: 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:00.258 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:00.259 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072045272 0 0) 0x7f3af009e1c0 con 0x7f3af006efe0 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient(hunting): my global_id is 6918 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3af012afe0 con 0x7f3af006efe0 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1652729639 0 0) 0x7f3af0070930 con 0x7f3af006e4f0 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 >> v1:172.21.15.171:6792/0 conn(0x7f3af013aa40 legacy=0x7f3af01d5020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 >> v1:172.21.15.106:6792/0 conn(0x7f3af006efe0 legacy=0x7f3af01d18f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: _finish_hunting 0 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 monclient: found mon.f 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:00.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3af012ad00 con 0x7f3af006e4f0 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: _finish_auth 0 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: _check_auth_tickets 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 5 monclient: authenticate success, global_id 145405 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 10 monclient: _renew_subs 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3af01cc860 con 0x7f3af006e4f0 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 10 monclient: _renew_subs 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3af01cccc0 con 0x7f3af006e4f0 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ae80038d0 con 0x7f3af006e4f0 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:00.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ae8001c00 con 0x7f3af006e4f0 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aef7fe640 4 set_mon_vals no callback set 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 10 monclient: dump: 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:00.262 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ad0005090 con 0x7f3af006e4f0 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3ae8003e40 con 0x7f3af006e4f0 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(239..239 src has 138..239) ==== 8420+0+0 (unknown 1851414345 0 0) 0x7f3ae8045760 con 0x7f3af006e4f0 2024-04-26T00:02:00.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.266+0000 7f3af4a7b640 10 monclient: get_auth_request con 0x7f3adc037e50 auth_method 0 2024-04-26T00:02:00.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.270+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3ae80156f0 con 0x7f3af006e4f0 2024-04-26T00:02:00.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.270+0000 7f3aedffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:00.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.270+0000 7f3aedffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:00.414 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.434+0000 7f3af74e0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h28"}] 2024-04-26T00:02:00.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.434+0000 7f3af74e0640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h28"}] 2024-04-26T00:02:00.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.434+0000 7f3af74e0640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:00.415 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:00.434+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h28"} v 0) -- 0x7f3ad0005380 con 0x7f3af006e4f0 2024-04-26T00:02:01.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.022+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h28"}]=0 removed item id -100 name 'h28' from crush map v240) ==== 121+0+0 (unknown 3990925037 0 0) 0x7f3ae8014ff0 con 0x7f3af006e4f0 2024-04-26T00:02:01.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.022+0000 7f3aedffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h28"}] 2024-04-26T00:02:01.001 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.022+0000 7f3aedffb640 10 monclient: _finish_command 2 = system:0 removed item id -100 name 'h28' from crush map 2024-04-26T00:02:01.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.126+0000 7f3af74e0640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h28"}] 2024-04-26T00:02:01.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.126+0000 7f3af74e0640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h28"}] 2024-04-26T00:02:01.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.126+0000 7f3af74e0640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.126+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h28"} v 0) -- 0x7f3ad0002220 con 0x7f3af006e4f0 2024-04-26T00:02:01.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.130+0000 7f3aedffb640 1 -- 172.21.15.171:0/1423311844 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h28"}]=0 device 'h28' does not appear in the crush map v240) ==== 120+0+0 (unknown 1306066437 0 0) 0x7f3ae8019340 con 0x7f3af006e4f0 2024-04-26T00:02:01.109 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.130+0000 7f3aedffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h28"}] 2024-04-26T00:02:01.110 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.130+0000 7f3aedffb640 10 monclient: _finish_command 3 = system:0 device 'h28' does not appear in the crush map 2024-04-26T00:02:01.110 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h28' does not appear in the crush map 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 >> v1:172.21.15.171:6812/722422047 conn(0x7f3adc037e50 legacy=0x7f3adc03a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 10 monclient: shutdown 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 >> v1:172.21.15.171:6789/0 conn(0x7f3af006e4f0 legacy=0x7f3af0130530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 shutdown_connections 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 >> 172.21.15.171:0/1423311844 conn(0x7f3af00a2620 msgr2=0x7f3af0129890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 shutdown_connections 2024-04-26T00:02:01.112 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.134+0000 7f3af74e0640 1 -- 172.21.15.171:0/1423311844 wait complete. 2024-04-26T00:02:01.126 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:02:01.127 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h29 2024-04-26T00:02:01.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.262+0000 7fd841468640 10 monclient: get_monmap_and_config 2024-04-26T00:02:01.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.262+0000 7fd841468640 10 monclient: build_initial_monmap 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.262+0000 7fd841468640 10 monclient: monmap: 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:01.264586+0000 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:01.264586+0000 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:01.242 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:01.243 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:01.243 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:01.243 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.262+0000 7fd841468640 1 Processor -- start 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.262+0000 7fd841468640 1 -- start start 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.262+0000 7fd841468640 10 monclient: init 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: _add_conns ranks=[6,8,1,4,3,7,0,5,2] 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): picked mon.noname-d con 0x7fd83c071f90 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): picked mon.noname-e con 0x7fd83c06f670 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): picked mon.noname-f con 0x7fd83c13afb0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:01.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c09ebf0 con 0x7fd83c13afb0 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c0a0180 con 0x7fd83c071f90 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c0a4220 con 0x7fd83c06f670 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): authenticate will time out at 1371.972481s 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd83b7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd83c13afb0 0x7fd83c13d3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52706/0 (socket says 172.21.15.171:52706) 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd83b7fe640 1 -- 172.21.15.171:0/24889259 learned_addr learned my addr 172.21.15.171:0/24889259 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1165734013 0 0) 0x7fd83c09ebf0 con 0x7fd83c13afb0 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient(hunting): my global_id is 145414 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd824003530 con 0x7fd83c13afb0 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1676121284 0 0) 0x7fd824003530 con 0x7fd83c13afb0 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 >> v1:172.21.15.106:6793/0 conn(0x7fd83c06f670 legacy=0x7fd83c139890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 >> v1:172.21.15.106:6792/0 conn(0x7fd83c071f90 legacy=0x7fd83c072370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 monclient: found mon.noname-f 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c0a1120 con 0x7fd83c13afb0 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: _finish_auth 0 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd834001b40 con 0x7fd83c13afb0 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: dump: 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.248 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 5 monclient: authenticate success, global_id 145414 2024-04-26T00:02:01.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd834001e30 con 0x7fd83c13afb0 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 1 -- 172.21.15.171:0/24889259 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd834004f70 con 0x7fd83c13afb0 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 4 set_mon_vals no callback set 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd839ffb640 10 monclient: dump: 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.250 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: shutdown 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- 172.21.15.171:0/24889259 >> v1:172.21.15.171:6789/0 conn(0x7fd83c13afb0 legacy=0x7fd83c13d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- 172.21.15.171:0/24889259 shutdown_connections 2024-04-26T00:02:01.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- 172.21.15.171:0/24889259 >> 172.21.15.171:0/24889259 conn(0x7fd83c0a73b0 msgr2=0x7fd83c0a38b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- 172.21.15.171:0/24889259 shutdown_connections 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- 172.21.15.171:0/24889259 wait complete. 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: build_initial_monmap 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: monmap: 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:01.252 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:01.253 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:01.253 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:01.253 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:01.253 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:01.253 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 Processor -- start 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- start start 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: init 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient: _add_conns ranks=[7,1,0,8,6,2,3,5,4] 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): picked mon.noname-i con 0x7fd83c06f670 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): picked mon.noname-f con 0x7fd83c071f90 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:01.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): picked mon.noname-a con 0x7fd83c13afb0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c12dad0 con 0x7fd83c13afb0 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c072af0 con 0x7fd83c071f90 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83c071d60 con 0x7fd83c06f670 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd841468640 10 monclient(hunting): authenticate will time out at 1371.975801s 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd83a7fc640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd83c071f90 0x7fd83c1d1870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52718/0 (socket says 172.21.15.171:52718) 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.266+0000 7fd83a7fc640 1 -- 172.21.15.171:0/3839408761 learned_addr learned my addr 172.21.15.171:0/3839408761 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1649072621 0 0) 0x7fd83c072af0 con 0x7fd83c071f90 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): my global_id is 145423 2024-04-26T00:02:01.258 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd828003530 con 0x7fd83c071f90 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2304797597 0 0) 0x7fd83c071d60 con 0x7fd83c06f670 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): my global_id is 145375 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd83c072af0 con 0x7fd83c06f670 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 484531273 0 0) 0x7fd828003530 con 0x7fd83c071f90 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd83c071d60 con 0x7fd83c071f90 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd830001a60 con 0x7fd83c071f90 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): dump: 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.259 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:01.260 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3765714256 0 0) 0x7fd83c12dad0 con 0x7fd83c13afb0 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): my global_id is 7020 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd828003530 con 0x7fd83c13afb0 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2476190803 0 0) 0x7fd83c072af0 con 0x7fd83c06f670 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd83c12dad0 con 0x7fd83c06f670 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd82c0019e0 con 0x7fd83c06f670 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient(hunting): dump: 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.261 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.262 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1903496739 0 0) 0x7fd83c071d60 con 0x7fd83c071f90 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 >> v1:172.21.15.171:6792/0 conn(0x7fd83c06f670 legacy=0x7fd83c12a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 >> v1:172.21.15.106:6789/0 conn(0x7fd83c13afb0 legacy=0x7fd83c1d4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 monclient: found mon.f 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd83c12d7f0 con 0x7fd83c071f90 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 5 monclient: authenticate success, global_id 145423 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 10 monclient: _renew_subs 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.263 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd83c09d190 con 0x7fd83c071f90 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 10 monclient: _renew_subs 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd83c09d830 con 0x7fd83c071f90 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8300038d0 con 0x7fd83c071f90 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd830003e40 con 0x7fd83c071f90 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8397fa640 4 set_mon_vals no callback set 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 10 monclient: dump: 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.264 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd830003fe0 con 0x7fd83c071f90 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:01.265 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:01.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(240..240 src has 138..240) ==== 8207+0+0 (unknown 1137410933 0 0) 0x7fd830045710 con 0x7fd83c071f90 2024-04-26T00:02:01.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd81c005090 con 0x7fd83c071f90 2024-04-26T00:02:01.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.270+0000 7fd83affd640 10 monclient: get_auth_request con 0x7fd828037ff0 auth_method 0 2024-04-26T00:02:01.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.274+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd830015790 con 0x7fd83c071f90 2024-04-26T00:02:01.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.274+0000 7fd8237fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:01.266 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.274+0000 7fd8237fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:01.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.442+0000 7fd841468640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h29"}] 2024-04-26T00:02:01.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.442+0000 7fd841468640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h29"}] 2024-04-26T00:02:01.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.442+0000 7fd841468640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.420 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.442+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h29"} v 0) -- 0x7fd81c005380 con 0x7fd83c071f90 2024-04-26T00:02:01.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.578+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h29"}]=0 removed item id -103 name 'h29' from crush map v241) ==== 121+0+0 (unknown 398530949 0 0) 0x7fd830015090 con 0x7fd83c071f90 2024-04-26T00:02:01.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.578+0000 7fd8237fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h29"}] 2024-04-26T00:02:01.558 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.578+0000 7fd8237fe640 10 monclient: _finish_command 2 = system:0 removed item id -103 name 'h29' from crush map 2024-04-26T00:02:01.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.690+0000 7fd841468640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h29"}] 2024-04-26T00:02:01.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.690+0000 7fd841468640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h29"}] 2024-04-26T00:02:01.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.690+0000 7fd841468640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:01.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.690+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "h29"} v 0) -- 0x7fd81c002220 con 0x7fd83c071f90 2024-04-26T00:02:01.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.690+0000 7fd8237fe640 1 -- 172.21.15.171:0/3839408761 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h29"}]=0 device 'h29' does not appear in the crush map v241) ==== 120+0+0 (unknown 4192261802 0 0) 0x7fd8300193e0 con 0x7fd83c071f90 2024-04-26T00:02:01.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.690+0000 7fd8237fe640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h29"}] 2024-04-26T00:02:01.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.690+0000 7fd8237fe640 10 monclient: _finish_command 3 = system:0 device 'h29' does not appear in the crush map 2024-04-26T00:02:01.671 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h29' does not appear in the crush map 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 >> v1:172.21.15.171:6812/722422047 conn(0x7fd828037ff0 legacy=0x7fd82803a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 10 monclient: shutdown 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 >> v1:172.21.15.171:6789/0 conn(0x7fd83c071f90 legacy=0x7fd83c1d1870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 shutdown_connections 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 >> 172.21.15.171:0/3839408761 conn(0x7fd83c0a73b0 msgr2=0x7fd83c070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 shutdown_connections 2024-04-26T00:02:01.673 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.694+0000 7fd841468640 1 -- 172.21.15.171:0/3839408761 wait complete. 2024-04-26T00:02:01.688 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:02:01.688 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h30 2024-04-26T00:02:01.800 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient: get_monmap_and_config 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient: build_initial_monmap 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient: monmap: 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:01.823564+0000 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:01.823564+0000 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:01.801 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:01.802 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:01.802 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:01.802 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 1 Processor -- start 2024-04-26T00:02:01.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 1 -- start start 2024-04-26T00:02:01.803 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient: init 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient: _add_conns ranks=[3,6,2,0,4,7,5,8,1] 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient(hunting): picked mon.noname-g con 0x7f63b80a3930 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient(hunting): picked mon.noname-d con 0x7f63b8138150 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient(hunting): picked mon.noname-b con 0x7f63b8138570 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b80a2b70 con 0x7f63b8138570 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b80a2e50 con 0x7f63b80a3930 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b80a4460 con 0x7f63b8138150 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bf57c640 10 monclient(hunting): authenticate will time out at 1372.531300s 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bd318640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f63b80a3930 legacy=0x7f63b8137a40 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bdb19640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f63b8138570 0x7f63b81406a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:34834/0 (socket says 172.21.15.171:34834) 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.822+0000 7f63bdb19640 1 -- 172.21.15.171:0/866725628 learned_addr learned my addr 172.21.15.171:0/866725628 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:01.804 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122288751 0 0) 0x7f63b80a2b70 con 0x7f63b8138570 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): my global_id is 6869 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63a4003530 con 0x7f63b8138570 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3208464108 0 0) 0x7f63b80a4460 con 0x7f63b8138150 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient(hunting): my global_id is 6936 2024-04-26T00:02:01.805 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b80a2b70 con 0x7f63b8138150 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3400735712 0 0) 0x7f63b80a2b70 con 0x7f63b8138150 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 >> v1:172.21.15.171:6790/0 conn(0x7f63b80a3930 legacy=0x7f63b8137a40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 >> v1:172.21.15.106:6790/0 conn(0x7f63b8138570 legacy=0x7f63b81406a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 monclient: found mon.noname-d 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b80a1810 con 0x7f63b8138150 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: _finish_auth 0 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a80017a0 con 0x7f63b8138150 2024-04-26T00:02:01.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: dump: 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.812 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 5 monclient: authenticate success, global_id 6936 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63a8001a00 con 0x7f63b8138150 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 1 -- 172.21.15.171:0/866725628 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a8003960 con 0x7f63b8138150 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63affff640 10 monclient: dump: 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.813 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:01.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 4 set_mon_vals no callback set 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient: shutdown 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- 172.21.15.171:0/866725628 >> v1:172.21.15.106:6792/0 conn(0x7f63b8138150 legacy=0x7f63b813cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- 172.21.15.171:0/866725628 shutdown_connections 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- 172.21.15.171:0/866725628 >> 172.21.15.171:0/866725628 conn(0x7f63b80a6d70 msgr2=0x7f63b80a7180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- 172.21.15.171:0/866725628 shutdown_connections 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- 172.21.15.171:0/866725628 wait complete. 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient: build_initial_monmap 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient: monmap: 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:01.815 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 Processor -- start 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- start start 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient: init 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:01.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient: _add_conns ranks=[2,0,6,5,1,7,3,8,4] 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient(hunting): picked mon.noname-b con 0x7f63b80a3930 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient(hunting): picked mon.noname-a con 0x7f63b8138150 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient(hunting): picked mon.noname-d con 0x7f63b8138570 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b8125450 con 0x7f63b8138150 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b80a1030 con 0x7f63b80a3930 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b81ccec0 con 0x7f63b8138570 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bf57c640 10 monclient(hunting): authenticate will time out at 1372.535163s 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bd318640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f63b80a3930 0x7f63b8136d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.171:34846/0 (socket says 172.21.15.171:34846) 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.826+0000 7f63bd318640 1 -- 172.21.15.171:0/1859722089 learned_addr learned my addr 172.21.15.171:0/1859722089 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182401179 0 0) 0x7f63b81ccec0 con 0x7f63b8138570 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.817 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): my global_id is 6945 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f639c003530 con 0x7f63b8138570 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1277041499 0 0) 0x7f63b8125450 con 0x7f63b8138150 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): my global_id is 7029 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b81ccec0 con 0x7f63b8138150 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2520855776 0 0) 0x7f63b80a1030 con 0x7f63b80a3930 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): my global_id is 6878 2024-04-26T00:02:01.818 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63b8125450 con 0x7f63b80a3930 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3524314430 0 0) 0x7f639c003530 con 0x7f63b8138570 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63b80a1030 con 0x7f63b8138570 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63b00018e0 con 0x7f63b8138570 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): dump: 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.819 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 237550967 0 0) 0x7f63b81ccec0 con 0x7f63b8138150 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f639c003530 con 0x7f63b8138150 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a8001360 con 0x7f63b8138150 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): dump: 2024-04-26T00:02:01.820 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.821 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3654657022 0 0) 0x7f63b8125450 con 0x7f63b80a3930 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63b81ccec0 con 0x7f63b80a3930 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63b4004300 con 0x7f63b80a3930 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient(hunting): dump: 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.822 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3659243256 0 0) 0x7f63b80a1030 con 0x7f63b8138570 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 >> v1:172.21.15.106:6790/0 conn(0x7f63b80a3930 legacy=0x7f63b8136d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 >> v1:172.21.15.106:6789/0 conn(0x7f63b8138150 legacy=0x7f63b81d1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: _finish_hunting 0 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 monclient: found mon.d 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:01.823 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b8127740 con 0x7f63b8138570 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: _finish_auth 0 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: _check_auth_tickets 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 5 monclient: authenticate success, global_id 6945 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 10 monclient: _renew_subs 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63b81261d0 con 0x7f63b8138570 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 10 monclient: _renew_subs 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f63b8137630 con 0x7f63b8138570 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63b0004e20 con 0x7f63b8138570 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:01.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63b0005310 con 0x7f63b8138570 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63aeffd640 4 set_mon_vals no callback set 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 10 monclient: dump: 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:01.825 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6398005090 con 0x7f63b8138570 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f63b00100b0 con 0x7f63b8138570 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(241..241 src has 138..241) ==== 7994+0+0 (unknown 3031351417 0 0) 0x7f63b0045890 con 0x7f63b8138570 2024-04-26T00:02:01.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.830+0000 7f63bd318640 10 monclient: get_auth_request con 0x7f639c0381e0 auth_method 0 2024-04-26T00:02:01.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.842+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f63b0015b10 con 0x7f63b8138570 2024-04-26T00:02:01.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.842+0000 7f63adffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:01.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.842+0000 7f63adffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:01.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.998+0000 7f63bf57c640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h30"}] 2024-04-26T00:02:01.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.998+0000 7f63bf57c640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h30"}] 2024-04-26T00:02:01.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.998+0000 7f63bf57c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:01.979 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:01.998+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h30"} v 0) -- 0x7f6398005380 con 0x7f63b8138570 2024-04-26T00:02:02.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.610+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h30"}]=0 removed item id -106 name 'h30' from crush map v242) ==== 121+0+0 (unknown 1017365145 0 0) 0x7f63b0015410 con 0x7f63b8138570 2024-04-26T00:02:02.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.614+0000 7f63adffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h30"}] 2024-04-26T00:02:02.591 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.614+0000 7f63adffb640 10 monclient: _finish_command 2 = system:0 removed item id -106 name 'h30' from crush map 2024-04-26T00:02:02.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.710+0000 7f63bf57c640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h30"}] 2024-04-26T00:02:02.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.710+0000 7f63bf57c640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h30"}] 2024-04-26T00:02:02.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.710+0000 7f63bf57c640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:02.689 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.710+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h30"} v 0) -- 0x7f63980010a0 con 0x7f63b8138570 2024-04-26T00:02:02.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.710+0000 7f63adffb640 1 -- 172.21.15.171:0/1859722089 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h30"}]=0 device 'h30' does not appear in the crush map v242) ==== 120+0+0 (unknown 43767254 0 0) 0x7f63b0019760 con 0x7f63b8138570 2024-04-26T00:02:02.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.710+0000 7f63adffb640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h30"}] 2024-04-26T00:02:02.691 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.710+0000 7f63adffb640 10 monclient: _finish_command 3 = system:0 device 'h30' does not appear in the crush map 2024-04-26T00:02:02.691 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h30' does not appear in the crush map 2024-04-26T00:02:02.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 >> v1:172.21.15.171:6812/722422047 conn(0x7f639c0381e0 legacy=0x7f639c03a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:02.694 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 10 monclient: shutdown 2024-04-26T00:02:02.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:02.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 >> v1:172.21.15.106:6792/0 conn(0x7f63b8138570 legacy=0x7f63b81d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:02.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 shutdown_connections 2024-04-26T00:02:02.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 >> 172.21.15.171:0/1859722089 conn(0x7f63b80a6d70 msgr2=0x7f63b80a8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:02.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 shutdown_connections 2024-04-26T00:02:02.695 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.714+0000 7f63bf57c640 1 -- 172.21.15.171:0/1859722089 wait complete. 2024-04-26T00:02:02.709 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:02:02.709 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h31 2024-04-26T00:02:02.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient: get_monmap_and_config 2024-04-26T00:02:02.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient: build_initial_monmap 2024-04-26T00:02:02.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient: monmap: 2024-04-26T00:02:02.826 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:02.826 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:02.826 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:02.849112+0000 2024-04-26T00:02:02.826 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:02.849112+0000 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:02.827 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:02.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 1 Processor -- start 2024-04-26T00:02:02.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 1 -- start start 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient: init 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient: _add_conns ranks=[1,6,4,0,7,2,3,8,5] 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient(hunting): picked mon.noname-f con 0x7fbf0006fe00 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.846+0000 7fbf07d38640 10 monclient(hunting): picked mon.noname-d con 0x7fbf0006f600 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): picked mon.noname-c con 0x7fbf000701e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0006fa00 con 0x7fbf0006fe00 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf00135400 con 0x7fbf000701e0 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf00071670 con 0x7fbf0006f600 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): authenticate will time out at 1373.556099s 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf05ad4640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fbf0006fe00 0x7fbf001345e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52722/0 (socket says 172.21.15.171:52722) 2024-04-26T00:02:02.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf05ad4640 1 -- 172.21.15.171:0/1642734111 learned_addr learned my addr 172.21.15.171:0/1642734111 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 645981121 0 0) 0x7fbf0006fa00 con 0x7fbf0006fe00 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient(hunting): _negotiate 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient(hunting): my global_id is 145432 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbeec003530 con 0x7fbf0006fe00 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1300843882 0 0) 0x7fbeec003530 con 0x7fbf0006fe00 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 >> v1:172.21.15.106:6792/0 conn(0x7fbf0006f600 legacy=0x7fbf00134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 >> v1:172.21.15.106:6791/0 conn(0x7fbf000701e0 legacy=0x7fbf0013d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: _finish_hunting 0 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 monclient: found mon.noname-f 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:02:02.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf00070630 con 0x7fbf0006fe00 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: _finish_auth 0 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: _check_auth_tickets 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 5 monclient: authenticate success, global_id 145432 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbefc0017c0 con 0x7fbf0006fe00 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: dump: 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:02.837 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:02.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbefc001ab0 con 0x7fbf0006fe00 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 4 set_mon_vals no callback set 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 1 -- 172.21.15.171:0/1642734111 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbefc004bf0 con 0x7fbf0006fe00 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf04ad2640 10 monclient: dump: 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:02.839 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: shutdown 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- 172.21.15.171:0/1642734111 >> v1:172.21.15.171:6789/0 conn(0x7fbf0006fe00 legacy=0x7fbf001345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- 172.21.15.171:0/1642734111 shutdown_connections 2024-04-26T00:02:02.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- 172.21.15.171:0/1642734111 >> 172.21.15.171:0/1642734111 conn(0x7fbf000a2620 msgr2=0x7fbf000a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- 172.21.15.171:0/1642734111 shutdown_connections 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- 172.21.15.171:0/1642734111 wait complete. 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: build_initial_monmap 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: monmap: 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:02.841 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 Processor -- start 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- start start 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: init 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: _add_conns ranks=[3,5,7,4,8,1,6,0,2] 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): picked mon.noname-g con 0x7fbf0006f600 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): picked mon.noname-h con 0x7fbf0006fe00 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:02.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): picked mon.noname-i con 0x7fbf000701e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:02.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0009f680 con 0x7fbf0006f600 2024-04-26T00:02:02.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf0009f260 con 0x7fbf0006fe00 2024-04-26T00:02:02.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf00070d60 con 0x7fbf000701e0 2024-04-26T00:02:02.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:02.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient(hunting): authenticate will time out at 1373.558971s 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf05ad4640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fbf0006f600 legacy=0x7fbf0012c270 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf052d3640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fbf0006fe00 0x7fbf001cf930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:49664/0 (socket says 172.21.15.171:49664) 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf052d3640 1 -- 172.21.15.171:0/1480248767 learned_addr learned my addr 172.21.15.171:0/1480248767 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4200035857 0 0) 0x7fbf0009f260 con 0x7fbf0006fe00 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): my global_id is 6827 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbee4003530 con 0x7fbf0006fe00 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3452124944 0 0) 0x7fbf00070d60 con 0x7fbf000701e0 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:02.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): my global_id is 145384 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbf0009f260 con 0x7fbf000701e0 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1262909333 0 0) 0x7fbee4003530 con 0x7fbf0006fe00 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbf00070d60 con 0x7fbf0006fe00 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbef0001a80 con 0x7fbf0006fe00 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): dump: 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:02.845 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:02.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 450125511 0 0) 0x7fbf0009f260 con 0x7fbf000701e0 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbee4003530 con 0x7fbf000701e0 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbef8001b90 con 0x7fbf000701e0 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient(hunting): dump: 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:02.847 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 736032000 0 0) 0x7fbf00070d60 con 0x7fbf0006fe00 2024-04-26T00:02:02.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 >> v1:172.21.15.171:6792/0 conn(0x7fbf000701e0 legacy=0x7fbf001d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 >> v1:172.21.15.171:6790/0 conn(0x7fbf0006f600 legacy=0x7fbf0012c270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 monclient: found mon.h 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf00070880 con 0x7fbf0006fe00 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbef67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 5 monclient: authenticate success, global_id 6827 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: _renew_subs 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:02.849 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbf0009cf70 con 0x7fbf0006fe00 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: _renew_subs 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.850+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fbf0009d7c0 con 0x7fbf0006fe00 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbef00038d0 con 0x7fbf0006fe00 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbef0003e40 con 0x7fbf0006fe00 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef7fff640 4 set_mon_vals no callback set 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 10 monclient: dump: 2024-04-26T00:02:02.850 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:02.851 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbf07d38640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbf07d38640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbf07d38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbee8005090 con 0x7fbf0006fe00 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbef0004060 con 0x7fbf0006fe00 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(242..242 src has 138..242) ==== 7781+0+0 (unknown 3178168999 0 0) 0x7fbef0045600 con 0x7fbf0006fe00 2024-04-26T00:02:02.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.854+0000 7fbf05ad4640 10 monclient: get_auth_request con 0x7fbee4037dc0 auth_method 0 2024-04-26T00:02:02.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.858+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbef0015900 con 0x7fbf0006fe00 2024-04-26T00:02:02.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.858+0000 7fbef67fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:02.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:02.858+0000 7fbef67fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:03.003 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.026+0000 7fbf07d38640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h31"}] 2024-04-26T00:02:03.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.026+0000 7fbf07d38640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h31"}] 2024-04-26T00:02:03.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.026+0000 7fbf07d38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:03.004 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.026+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h31"} v 0) -- 0x7fbee8005380 con 0x7fbf0006fe00 2024-04-26T00:02:03.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.610+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h31"}]=0 removed item id -109 name 'h31' from crush map v243) ==== 121+0+0 (unknown 389779763 0 0) 0x7fbef0004450 con 0x7fbf0006fe00 2024-04-26T00:02:03.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.610+0000 7fbef67fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h31"}] 2024-04-26T00:02:03.590 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.610+0000 7fbef67fc640 10 monclient: _finish_command 2 = system:0 removed item id -109 name 'h31' from crush map 2024-04-26T00:02:03.696 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.718+0000 7fbf07d38640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h31"}] 2024-04-26T00:02:03.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.718+0000 7fbf07d38640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h31"}] 2024-04-26T00:02:03.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.718+0000 7fbf07d38640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:03.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.718+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd crush rm", "name": "h31"} v 0) -- 0x7fbee8002220 con 0x7fbf0006fe00 2024-04-26T00:02:03.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.718+0000 7fbef67fc640 1 -- 172.21.15.171:0/1480248767 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h31"}]=0 device 'h31' does not appear in the crush map v243) ==== 120+0+0 (unknown 3064200569 0 0) 0x7fbef001dd20 con 0x7fbf0006fe00 2024-04-26T00:02:03.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.718+0000 7fbef67fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h31"}] 2024-04-26T00:02:03.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.718+0000 7fbef67fc640 10 monclient: _finish_command 3 = system:0 device 'h31' does not appear in the crush map 2024-04-26T00:02:03.698 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h31' does not appear in the crush map 2024-04-26T00:02:03.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 >> v1:172.21.15.171:6812/722422047 conn(0x7fbee4037dc0 legacy=0x7fbee403a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:03.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 10 monclient: shutdown 2024-04-26T00:02:03.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:03.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 >> v1:172.21.15.171:6791/0 conn(0x7fbf0006fe00 legacy=0x7fbf001cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:03.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 shutdown_connections 2024-04-26T00:02:03.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 >> 172.21.15.171:0/1480248767 conn(0x7fbf000a2620 msgr2=0x7fbf00131c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:03.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 shutdown_connections 2024-04-26T00:02:03.702 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.722+0000 7fbf07d38640 1 -- 172.21.15.171:0/1480248767 wait complete. 2024-04-26T00:02:03.714 INFO:tasks.workunit.client.0.smithi171.stderr:+ for f in `seq 1 32` 2024-04-26T00:02:03.714 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm h32 2024-04-26T00:02:03.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient: get_monmap_and_config 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient: build_initial_monmap 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient: monmap: 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:03.851510+0000 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:03.851510+0000 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:03.837 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 1 Processor -- start 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 1 -- start start 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient: init 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient: _add_conns ranks=[5,2,8,3,4,7,1,0,6] 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient(hunting): picked mon.noname-h con 0x7f67d009ff90 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient(hunting): picked mon.noname-b con 0x7f67d01343f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:03.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient(hunting): picked mon.noname-e con 0x7f67d0134850 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d009f240 con 0x7f67d01343f0 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d009f4b0 con 0x7f67d009ff90 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d009f790 con 0x7f67d0134850 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 10 monclient(hunting): authenticate will time out at 1374.559308s 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d4eee640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f67d009ff90 0x7f67d0133ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:49672/0 (socket says 172.21.15.171:49672) 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d4eee640 1 -- 172.21.15.171:0/980539266 learned_addr learned my addr 172.21.15.171:0/980539266 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2068284524 0 0) 0x7f67d009f4b0 con 0x7f67d009ff90 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient(hunting): my global_id is 6836 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67c0003530 con 0x7f67d009ff90 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 267805873 0 0) 0x7f67c0003530 con 0x7f67d009ff90 2024-04-26T00:02:03.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 >> v1:172.21.15.106:6793/0 conn(0x7f67d0134850 legacy=0x7f67d013c730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 >> v1:172.21.15.106:6790/0 conn(0x7f67d01343f0 legacy=0x7f67d0139000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 monclient: found mon.noname-h 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d009fa70 con 0x7f67d009ff90 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67c40017c0 con 0x7f67d009ff90 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.850+0000 7f67d7152640 5 monclient: authenticate success, global_id 6836 2024-04-26T00:02:03.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 10 monclient: dump: 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:03.841 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67c4001ab0 con 0x7f67d009ff90 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 1 -- 172.21.15.171:0/980539266 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67c4004bf0 con 0x7f67d009ff90 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 4 set_mon_vals no callback set 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:03.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cf7fe640 10 monclient: dump: 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:03.843 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: shutdown 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- 172.21.15.171:0/980539266 >> v1:172.21.15.171:6791/0 conn(0x7f67d009ff90 legacy=0x7f67d0133ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- 172.21.15.171:0/980539266 shutdown_connections 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- 172.21.15.171:0/980539266 >> 172.21.15.171:0/980539266 conn(0x7f67d00a6850 msgr2=0x7f67d00a6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- 172.21.15.171:0/980539266 shutdown_connections 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- 172.21.15.171:0/980539266 wait complete. 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: build_initial_monmap 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: monmap: 2024-04-26T00:02:03.844 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:03.845 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 Processor -- start 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- start start 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: init 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: _add_conns ranks=[1,7,2,0,8,4,3,6,5] 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient(hunting): picked mon.noname-f con 0x7f67d009ff90 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient(hunting): picked mon.noname-i con 0x7f67d01343f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient(hunting): picked mon.noname-b con 0x7f67d0134850 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d00a2370 con 0x7f67d009ff90 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d01bc320 con 0x7f67d0134850 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67d01bd5f0 con 0x7f67d01343f0 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:03.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient(hunting): authenticate will time out at 1374.562211s 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d4eee640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f67d009ff90 0x7f67d0099480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52744/0 (socket says 172.21.15.171:52744) 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d4eee640 1 -- 172.21.15.171:0/3220368079 learned_addr learned my addr 172.21.15.171:0/3220368079 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 503420224 0 0) 0x7f67d01bd5f0 con 0x7f67d01343f0 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): my global_id is 145393 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67b4003530 con 0x7f67d01343f0 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789323631 0 0) 0x7f67d00a2370 con 0x7f67d009ff90 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:03.847 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): my global_id is 145441 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67d01bd5f0 con 0x7f67d009ff90 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3810570225 0 0) 0x7f67b4003530 con 0x7f67d01343f0 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67d00a2370 con 0x7f67d01343f0 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67bc001a60 con 0x7f67d01343f0 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): dump: 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:03.848 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:03.849 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4066533624 0 0) 0x7f67d01bd5f0 con 0x7f67d009ff90 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f67b4003530 con 0x7f67d009ff90 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2659133907 0 0) 0x7f67d01bc320 con 0x7f67d0134850 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:03.850 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): my global_id is 6896 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67d01bd5f0 con 0x7f67d0134850 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67c4004b30 con 0x7f67d009ff90 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient(hunting): dump: 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:03.851 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1434221130 0 0) 0x7f67d00a2370 con 0x7f67d01343f0 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 >> v1:172.21.15.106:6790/0 conn(0x7f67d0134850 legacy=0x7f67d01d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:03.852 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 >> v1:172.21.15.171:6789/0 conn(0x7f67d009ff90 legacy=0x7f67d0099480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 monclient: found mon.i 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d0130e20 con 0x7f67d01343f0 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 5 monclient: authenticate success, global_id 145393 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: _renew_subs 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:02:03.853 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f67d01bb650 con 0x7f67d01343f0 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f67bc0038d0 con 0x7f67d01343f0 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f67bc003e40 con 0x7f67d01343f0 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: _renew_subs 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f67d0099d60 con 0x7f67d01343f0 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67ceffd640 4 set_mon_vals no callback set 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:03.854 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.854+0000 7f67cd7fa640 10 monclient: dump: 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:03.855 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.858+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f67bc0040a0 con 0x7f67d01343f0 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.858+0000 7f67d7152640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.858+0000 7f67d7152640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:03.856 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.858+0000 7f67d7152640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:02:03.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.858+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d0068570 con 0x7f67d01343f0 2024-04-26T00:02:03.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.858+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(243..243 src has 138..243) ==== 7568+0+0 (unknown 3578284535 0 0) 0x7f67bc0443c0 con 0x7f67d01343f0 2024-04-26T00:02:03.857 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.858+0000 7f67d4eee640 10 monclient: get_auth_request con 0x7f67b4037eb0 auth_method 0 2024-04-26T00:02:03.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.862+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f67bc014710 con 0x7f67d01343f0 2024-04-26T00:02:03.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.862+0000 7f67cd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:03.858 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:03.862+0000 7f67cd7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:04.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.026+0000 7f67d7152640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h32"}] 2024-04-26T00:02:04.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.026+0000 7f67d7152640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "h32"}] 2024-04-26T00:02:04.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.026+0000 7f67d7152640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:02:04.006 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.026+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h32"} v 0) -- 0x7f67d01bc4f0 con 0x7f67d01343f0 2024-04-26T00:02:04.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.642+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h32"}]=0 removed item id -112 name 'h32' from crush map v244) ==== 121+0+0 (unknown 1742575481 0 0) 0x7f67bc014010 con 0x7f67d01343f0 2024-04-26T00:02:04.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.642+0000 7f67cd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "h32"}] 2024-04-26T00:02:04.621 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.642+0000 7f67cd7fa640 10 monclient: _finish_command 2 = system:0 removed item id -112 name 'h32' from crush map 2024-04-26T00:02:04.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.746+0000 7f67d7152640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "h32"}] 2024-04-26T00:02:04.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.746+0000 7f67d7152640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "h32"}] 2024-04-26T00:02:04.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.746+0000 7f67d7152640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:02:04.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.746+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "osd crush rm", "name": "h32"} v 0) -- 0x7f67d00a6170 con 0x7f67d01343f0 2024-04-26T00:02:04.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.746+0000 7f67cd7fa640 1 -- 172.21.15.171:0/3220368079 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "h32"}]=0 device 'h32' does not appear in the crush map v244) ==== 120+0+0 (unknown 1542090801 0 0) 0x7f67bc01cbc0 con 0x7f67d01343f0 2024-04-26T00:02:04.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67cd7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "h32"}] 2024-04-26T00:02:04.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67cd7fa640 10 monclient: _finish_command 3 = system:0 device 'h32' does not appear in the crush map 2024-04-26T00:02:04.728 INFO:tasks.workunit.client.0.smithi171.stderr:device 'h32' does not appear in the crush map 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 >> v1:172.21.15.171:6812/722422047 conn(0x7f67b4037eb0 legacy=0x7f67b403a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 10 monclient: shutdown 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 >> v1:172.21.15.171:6792/0 conn(0x7f67d01343f0 legacy=0x7f67d01cf900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 shutdown_connections 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 >> 172.21.15.171:0/3220368079 conn(0x7f67d00a6850 msgr2=0x7f67d009c360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 shutdown_connections 2024-04-26T00:02:04.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.750+0000 7f67d7152640 1 -- 172.21.15.171:0/3220368079 wait complete. 2024-04-26T00:02:04.744 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush rm r1 2024-04-26T00:02:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.882+0000 7f1dd5cda640 10 monclient: get_monmap_and_config 2024-04-26T00:02:04.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.882+0000 7f1dd5cda640 10 monclient: build_initial_monmap 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.882+0000 7f1dd5cda640 10 monclient: monmap: 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:04.885306+0000 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:04.885306+0000 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:04.863 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:04.864 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:04.864 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.882+0000 7f1dd5cda640 1 Processor -- start 2024-04-26T00:02:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.882+0000 7f1dd5cda640 1 -- start start 2024-04-26T00:02:04.871 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.882+0000 7f1dd5cda640 10 monclient: init 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: _add_conns ranks=[3,5,0,1,8,6,2,7,4] 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): picked mon.noname-g con 0x7f1dd0135bb0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): picked mon.noname-h con 0x7f1dd01356f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): picked mon.noname-a con 0x7f1dd013c130 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd00a1da0 con 0x7f1dd013c130 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd00a1fe0 con 0x7f1dd0135bb0 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd0072720 con 0x7f1dd01356f0 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): authenticate will time out at 1375.592252s 2024-04-26T00:02:04.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dcf7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f1dd0135bb0 legacy=0x7f1dd0135f90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dceffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f1dd01356f0 0x7f1dd013aa10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:49682/0 (socket says 172.21.15.171:49682) 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dceffd640 1 -- 172.21.15.171:0/177261853 learned_addr learned my addr 172.21.15.171:0/177261853 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3938073993 0 0) 0x7f1dd0072720 con 0x7f1dd01356f0 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient(hunting): my global_id is 6845 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1db8003530 con 0x7f1dd01356f0 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 37287239 0 0) 0x7f1db8003530 con 0x7f1dd01356f0 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 >> v1:172.21.15.171:6790/0 conn(0x7f1dd0135bb0 legacy=0x7f1dd0135f90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 >> v1:172.21.15.106:6789/0 conn(0x7f1dd013c130 legacy=0x7f1dd013e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:04.873 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 monclient: found mon.noname-h 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd00a17f0 con 0x7f1dd01356f0 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1dc40017c0 con 0x7f1dd01356f0 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 5 monclient: authenticate success, global_id 6845 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:04.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: dump: 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:04.875 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1dc4001b20 con 0x7f1dd01356f0 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 4 set_mon_vals no callback set 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 1 -- 172.21.15.171:0/177261853 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1dc4001d50 con 0x7f1dd01356f0 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:04.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dce7fc640 10 monclient: dump: 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:04.877 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: shutdown 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- 172.21.15.171:0/177261853 >> v1:172.21.15.171:6791/0 conn(0x7f1dd01356f0 legacy=0x7f1dd013aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- 172.21.15.171:0/177261853 shutdown_connections 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- 172.21.15.171:0/177261853 >> 172.21.15.171:0/177261853 conn(0x7f1dd00a2620 msgr2=0x7f1dd00a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- 172.21.15.171:0/177261853 shutdown_connections 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- 172.21.15.171:0/177261853 wait complete. 2024-04-26T00:02:04.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: build_initial_monmap 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: monmap: 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:04.879 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 Processor -- start 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- start start 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: init 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient: _add_conns ranks=[3,1,8,7,2,4,6,0,5] 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): picked mon.noname-g con 0x7f1dd01356f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): picked mon.noname-f con 0x7f1dd0135bb0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:04.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): picked mon.noname-e con 0x7f1dd013c130 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dcf7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f1dd01356f0 legacy=0x7f1dd01c9f80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd00719a0 con 0x7f1dd0135bb0 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd0139560 con 0x7f1dd01356f0 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dd013afb0 con 0x7f1dd013c130 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dd5cda640 10 monclient(hunting): authenticate will time out at 1375.595295s 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dceffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f1dd0135bb0 0x7f1dd01ca690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52754/0 (socket says 172.21.15.171:52754) 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1dceffd640 1 -- 172.21.15.171:0/2705220294 learned_addr learned my addr 172.21.15.171:0/2705220294 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3531277408 0 0) 0x7f1dd00719a0 con 0x7f1dd0135bb0 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:04.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): my global_id is 145450 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dbc003530 con 0x7f1dd0135bb0 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3041703409 0 0) 0x7f1dbc003530 con 0x7f1dd0135bb0 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1dd00719a0 con 0x7f1dd0135bb0 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1dc4001780 con 0x7f1dd0135bb0 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): dump: 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.882 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:04.883 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1240650711 0 0) 0x7f1dd013afb0 con 0x7f1dd013c130 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.886+0000 7f1db7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient(hunting): my global_id is 204587 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1dbc003530 con 0x7f1dd013c130 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2116696035 0 0) 0x7f1dd00719a0 con 0x7f1dd0135bb0 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 >> v1:172.21.15.106:6793/0 conn(0x7f1dd013c130 legacy=0x7f1dd01d2320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 >> v1:172.21.15.171:6790/0 conn(0x7f1dd01356f0 legacy=0x7f1dd01c9f80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:04.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 monclient: found mon.f 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dd01cada0 con 0x7f1dd0135bb0 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: _finish_auth 0 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 5 monclient: authenticate success, global_id 145450 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 10 monclient: _renew_subs 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1dd01388a0 con 0x7f1dd0135bb0 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 10 monclient: _renew_subs 2024-04-26T00:02:04.885 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1dd013be40 con 0x7f1dd0135bb0 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1dc4001b20 con 0x7f1dd0135bb0 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1dc4001130 con 0x7f1dd0135bb0 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dcdffb640 4 set_mon_vals no callback set 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 10 monclient: dump: 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.886 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:04.887 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1db0005090 con 0x7f1dd0135bb0 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1dc400ff50 con 0x7f1dd0135bb0 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(244..244 src has 138..244) ==== 7355+0+0 (unknown 1544598150 0 0) 0x7f1dc4045560 con 0x7f1dd0135bb0 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.890+0000 7f1dcf7fe640 10 monclient: get_auth_request con 0x7f1dbc037710 auth_method 0 2024-04-26T00:02:04.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.894+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1dc4015a40 con 0x7f1dd0135bb0 2024-04-26T00:02:04.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.894+0000 7f1db7fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:04.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:04.894+0000 7f1db7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:05.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.058+0000 7f1dd5cda640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "r1"}] 2024-04-26T00:02:05.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.058+0000 7f1dd5cda640 10 monclient: _send_command 2 [{"prefix": "osd crush rm", "name": "r1"}] 2024-04-26T00:02:05.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.058+0000 7f1dd5cda640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:05.039 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.058+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "r1"} v 0) -- 0x7f1db0005380 con 0x7f1dd0135bb0 2024-04-26T00:02:05.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.642+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "r1"}]=0 removed item id -16 name 'r1' from crush map v245) ==== 118+0+0 (unknown 2650000602 0 0) 0x7f1dc4015340 con 0x7f1dd0135bb0 2024-04-26T00:02:05.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.642+0000 7f1db7fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush rm", "name": "r1"}] 2024-04-26T00:02:05.620 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.642+0000 7f1db7fff640 10 monclient: _finish_command 2 = system:0 removed item id -16 name 'r1' from crush map 2024-04-26T00:02:05.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.746+0000 7f1dd5cda640 10 start_mon_command cmd=[{"prefix": "osd crush rm", "name": "r1"}] 2024-04-26T00:02:05.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.746+0000 7f1dd5cda640 10 monclient: _send_command 3 [{"prefix": "osd crush rm", "name": "r1"}] 2024-04-26T00:02:05.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.746+0000 7f1dd5cda640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:05.726 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.746+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush rm", "name": "r1"} v 0) -- 0x7f1db0002220 con 0x7f1dd0135bb0 2024-04-26T00:02:05.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.746+0000 7f1db7fff640 1 -- 172.21.15.171:0/2705220294 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush rm", "name": "r1"}]=0 device 'r1' does not appear in the crush map v245) ==== 118+0+0 (unknown 3733252568 0 0) 0x7f1dc4042490 con 0x7f1dd0135bb0 2024-04-26T00:02:05.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.746+0000 7f1db7fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush rm", "name": "r1"}] 2024-04-26T00:02:05.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.746+0000 7f1db7fff640 10 monclient: _finish_command 3 = system:0 device 'r1' does not appear in the crush map 2024-04-26T00:02:05.727 INFO:tasks.workunit.client.0.smithi171.stderr:device 'r1' does not appear in the crush map 2024-04-26T00:02:05.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 >> v1:172.21.15.171:6812/722422047 conn(0x7f1dbc037710 legacy=0x7f1dbc039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:05.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 10 monclient: shutdown 2024-04-26T00:02:05.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:05.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 >> v1:172.21.15.171:6789/0 conn(0x7f1dd0135bb0 legacy=0x7f1dd01ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:05.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 shutdown_connections 2024-04-26T00:02:05.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 >> 172.21.15.171:0/2705220294 conn(0x7f1dd00a2620 msgr2=0x7f1dd013e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:05.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 shutdown_connections 2024-04-26T00:02:05.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.750+0000 7f1dd5cda640 1 -- 172.21.15.171:0/2705220294 wait complete. 2024-04-26T00:02:05.744 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd crush weight-set rm-compat 2024-04-26T00:02:05.862 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.882+0000 7f6c5ea60640 10 monclient: get_monmap_and_config 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.882+0000 7f6c5ea60640 10 monclient: build_initial_monmap 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.882+0000 7f6c5ea60640 10 monclient: monmap: 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:05.885451+0000 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:05.885451+0000 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:05.863 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:05.864 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:05.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.882+0000 7f6c5ea60640 1 Processor -- start 2024-04-26T00:02:05.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.882+0000 7f6c5ea60640 1 -- start start 2024-04-26T00:02:05.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.882+0000 7f6c5ea60640 10 monclient: init 2024-04-26T00:02:05.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:05.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: _add_conns ranks=[0,8,7,5,1,2,4,3,6] 2024-04-26T00:02:05.874 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): picked mon.noname-a con 0x7f6c5806fe00 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): picked mon.noname-e con 0x7f6c5806f600 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): picked mon.noname-i con 0x7f6c580701e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5806fa00 con 0x7f6c5806fe00 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c58135400 con 0x7f6c580701e0 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c58071670 con 0x7f6c5806f600 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): authenticate will time out at 1376.592430s 2024-04-26T00:02:05.875 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5cffd640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f6c580701e0 0x7f6c5813d930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52564/0 (socket says 172.21.15.171:52564) 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5cffd640 1 -- 172.21.15.171:0/4066170296 learned_addr learned my addr 172.21.15.171:0/4066170296 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1530343091 0 0) 0x7f6c58135400 con 0x7f6c580701e0 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient(hunting): my global_id is 145402 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c40003530 con 0x7f6c580701e0 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 421803376 0 0) 0x7f6c40003530 con 0x7f6c580701e0 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 >> v1:172.21.15.106:6793/0 conn(0x7f6c5806f600 legacy=0x7f6c58134cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:05.876 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 >> v1:172.21.15.106:6789/0 conn(0x7f6c5806fe00 legacy=0x7f6c581345e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:05.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:05.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 monclient: found mon.noname-i 2024-04-26T00:02:05.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:05.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:02:05.877 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c58070630 con 0x7f6c580701e0 2024-04-26T00:02:05.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: _finish_auth 0 2024-04-26T00:02:05.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:05.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:05.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6c50001b40 con 0x7f6c580701e0 2024-04-26T00:02:05.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:05.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:02:05.878 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: dump: 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:05.879 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:05.880 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 5 monclient: authenticate success, global_id 145402 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c50001e30 con 0x7f6c580701e0 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 4 set_mon_vals no callback set 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 1 -- 172.21.15.171:0/4066170296 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6c50004f70 con 0x7f6c580701e0 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:05.881 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c56ffd640 10 monclient: dump: 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:05.882 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: shutdown 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- 172.21.15.171:0/4066170296 >> v1:172.21.15.171:6792/0 conn(0x7f6c580701e0 legacy=0x7f6c5813d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- 172.21.15.171:0/4066170296 shutdown_connections 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- 172.21.15.171:0/4066170296 >> 172.21.15.171:0/4066170296 conn(0x7f6c580a2620 msgr2=0x7f6c580a2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- 172.21.15.171:0/4066170296 shutdown_connections 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- 172.21.15.171:0/4066170296 wait complete. 2024-04-26T00:02:05.883 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: build_initial_monmap 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: monmap: 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:05.884 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:05.885 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:05.886 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:05.886 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:05.886 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:05.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 Processor -- start 2024-04-26T00:02:05.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- start start 2024-04-26T00:02:05.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: init 2024-04-26T00:02:05.886 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient: _add_conns ranks=[1,5,4,2,8,0,7,6,3] 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): picked mon.noname-f con 0x7f6c5806f600 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): picked mon.noname-h con 0x7f6c5806fe00 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): picked mon.noname-c con 0x7f6c580701e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5809f110 con 0x7f6c5806f600 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5811d220 con 0x7f6c580701e0 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c5811d500 con 0x7f6c5806fe00 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:05.887 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c5ea60640 10 monclient(hunting): authenticate will time out at 1376.595632s 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c577fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6c5806fe00 0x7f6c581cd8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:49690/0 (socket says 172.21.15.171:49690) 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c577fe640 1 -- 172.21.15.171:0/686585694 learned_addr learned my addr 172.21.15.171:0/686585694 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893202623 0 0) 0x7f6c5809f110 con 0x7f6c5806f600 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): my global_id is 145459 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c44003560 con 0x7f6c5806f600 2024-04-26T00:02:05.888 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4193598056 0 0) 0x7f6c5811d500 con 0x7f6c5806fe00 2024-04-26T00:02:05.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:05.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:05.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:05.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 10 monclient(hunting): my global_id is 6854 2024-04-26T00:02:05.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.886+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c5809f110 con 0x7f6c5806fe00 2024-04-26T00:02:05.889 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 151399553 0 0) 0x7f6c44003560 con 0x7f6c5806f600 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c5811d500 con 0x7f6c5806f600 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6c4c0019e0 con 0x7f6c5806f600 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): dump: 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:05.890 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:05.891 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:05.892 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:05.892 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:05.892 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:05.892 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:05.893 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:05.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:05.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3632818299 0 0) 0x7f6c5809f110 con 0x7f6c5806fe00 2024-04-26T00:02:05.893 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c44003560 con 0x7f6c5806fe00 2024-04-26T00:02:05.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6c48001a60 con 0x7f6c5806fe00 2024-04-26T00:02:05.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:05.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:05.894 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): dump: 2024-04-26T00:02:05.894 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:05.894 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:05.894 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.895 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.895 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:05.895 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:05.895 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:05.895 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:05.895 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:05.896 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3977115353 0 0) 0x7f6c5811d220 con 0x7f6c580701e0 2024-04-26T00:02:05.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:05.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:05.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:05.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient(hunting): my global_id is 145444 2024-04-26T00:02:05.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c5809f110 con 0x7f6c580701e0 2024-04-26T00:02:05.897 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 87580220 0 0) 0x7f6c5811d500 con 0x7f6c5806f600 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 >> v1:172.21.15.171:6791/0 conn(0x7f6c5806fe00 legacy=0x7f6c581cd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 >> v1:172.21.15.106:6791/0 conn(0x7f6c580701e0 legacy=0x7f6c581d0ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 monclient: found mon.f 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c5812d7e0 con 0x7f6c5806f600 2024-04-26T00:02:05.898 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 5 monclient: authenticate success, global_id 145459 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 10 monclient: _renew_subs 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c5809e830 con 0x7f6c5806f600 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 10 monclient: _renew_subs 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:05.899 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c5809db90 con 0x7f6c5806f600 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c4c003950 con 0x7f6c5806f600 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6c4c003e40 con 0x7f6c5806f600 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c567fc640 4 set_mon_vals no callback set 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 10 monclient: dump: 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:05.900 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6c4c003fe0 con 0x7f6c5806f600 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:05.901 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:05.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:05.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c38005090 con 0x7f6c5806f600 2024-04-26T00:02:05.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(245..245 src has 138..245) ==== 7145+0+0 (unknown 2466889685 0 0) 0x7f6c4c0440d0 con 0x7f6c5806f600 2024-04-26T00:02:05.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.890+0000 7f6c577fe640 10 monclient: get_auth_request con 0x7f6c44037e70 auth_method 0 2024-04-26T00:02:05.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.894+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6c4c0145c0 con 0x7f6c5806f600 2024-04-26T00:02:05.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.894+0000 7f6c54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:05.902 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:05.894+0000 7f6c54ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:06.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.062+0000 7f6c5ea60640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:02:06.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.062+0000 7f6c5ea60640 10 monclient: _send_command 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:02:06.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.062+0000 7f6c5ea60640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:06.040 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.062+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f6c38005380 con 0x7f6c5806f600 2024-04-26T00:02:06.650 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.670+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v246) ==== 78+0+0 (unknown 2147043512 0 0) 0x7f6c4c013ec0 con 0x7f6c5806f600 2024-04-26T00:02:06.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.670+0000 7f6c54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:02:06.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.670+0000 7f6c54ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:06.758 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.778+0000 7f6c5ea60640 10 start_mon_command cmd=[{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:02:06.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.778+0000 7f6c5ea60640 10 monclient: _send_command 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:02:06.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.778+0000 7f6c5ea60640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:06.759 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:06.778+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd crush weight-set rm-compat"} v 0) -- 0x7f6c38002220 con 0x7f6c5806f600 2024-04-26T00:02:07.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.670+0000 7f6c54ff9640 1 -- 172.21.15.171:0/686585694 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd crush weight-set rm-compat"}]=0 v247) ==== 78+0+0 (unknown 1043858077 0 0) 0x7f6c4c01ca70 con 0x7f6c5806f600 2024-04-26T00:02:07.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.670+0000 7f6c54ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd crush weight-set rm-compat"}] 2024-04-26T00:02:07.651 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.670+0000 7f6c54ff9640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 >> v1:172.21.15.171:6812/722422047 conn(0x7f6c44037e70 legacy=0x7f6c4403a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 10 monclient: shutdown 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 >> v1:172.21.15.171:6789/0 conn(0x7f6c5806f600 legacy=0x7f6c5812d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 shutdown_connections 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 >> 172.21.15.171:0/686585694 conn(0x7f6c580a2620 msgr2=0x7f6c58131cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 shutdown_connections 2024-04-26T00:02:07.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.674+0000 7f6c5ea60640 1 -- 172.21.15.171:0/686585694 wait complete. 2024-04-26T00:02:07.678 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo OK 2024-04-26T00:02:07.679 INFO:tasks.workunit.client.0.smithi171.stdout:OK 2024-04-26T00:02:07.680 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T00:02:07.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T00:02:07.736 INFO:tasks.workunit:Running workunits matching mon/osd.sh on client.0... 2024-04-26T00:02:07.737 INFO:tasks.workunit:Running workunit mon/osd.sh... 2024-04-26T00:02:07.738 DEBUG:teuthology.orchestra.run.smithi171:workunit test mon/osd.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/osd.sh 2024-04-26T00:02:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:+ set -e 2024-04-26T00:02:07.788 INFO:tasks.workunit.client.0.smithi171.stderr:+ uuidgen 2024-04-26T00:02:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:+ ua=aa68e4d6-7b8f-4a5a-8b0b-22213bea2028 2024-04-26T00:02:07.789 INFO:tasks.workunit.client.0.smithi171.stderr:+ uuidgen 2024-04-26T00:02:07.790 INFO:tasks.workunit.client.0.smithi171.stderr:+ ub=60732f5d-c1b7-4f69-8e61-e3844a8c6da1 2024-04-26T00:02:07.790 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd create aa68e4d6-7b8f-4a5a-8b0b-22213bea2028 2024-04-26T00:02:07.911 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: get_monmap_and_config 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: build_initial_monmap 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: monmap: 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:07.934701+0000 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:07.934701+0000 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:07.912 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:07.913 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:07.913 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:07.913 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:07.913 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 Processor -- start 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- start start 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: init 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: _add_conns ranks=[6,5,8,1,7,4,0,3,2] 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient(hunting): picked mon.noname-d con 0x7fb890132a30 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient(hunting): picked mon.noname-h con 0x7fb8900727b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient(hunting): picked mon.noname-e con 0x7fb890132e10 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb890136400 con 0x7fb8900727b0 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89009fa80 con 0x7fb890132a30 2024-04-26T00:02:07.916 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89009b890 con 0x7fb890132e10 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient(hunting): authenticate will time out at 1378.641586s 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88f7fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb8900727b0 0x7fb890135cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:49700/0 (socket says 172.21.15.171:49700) 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88f7fe640 1 -- 172.21.15.171:0/159664112 learned_addr learned my addr 172.21.15.171:0/159664112 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3415957821 0 0) 0x7fb890136400 con 0x7fb8900727b0 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient(hunting): my global_id is 6863 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb87c003530 con 0x7fb8900727b0 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3071407048 0 0) 0x7fb87c003530 con 0x7fb8900727b0 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 >> v1:172.21.15.106:6793/0 conn(0x7fb890132e10 legacy=0x7fb89013e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 >> v1:172.21.15.106:6792/0 conn(0x7fb890132a30 legacy=0x7fb8901355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:07.917 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 monclient: found mon.noname-h 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8900a3500 con 0x7fb8900727b0 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: _finish_auth 0 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8780017c0 con 0x7fb8900727b0 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: dump: 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:07.918 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 5 monclient: authenticate success, global_id 6863 2024-04-26T00:02:07.919 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb878001ab0 con 0x7fb8900727b0 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 1 -- 172.21.15.171:0/159664112 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb878004bf0 con 0x7fb8900727b0 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb88effd640 10 monclient: dump: 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:07.920 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 4 set_mon_vals no callback set 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 10 monclient: shutdown 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- 172.21.15.171:0/159664112 >> v1:172.21.15.171:6791/0 conn(0x7fb8900727b0 legacy=0x7fb890135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- 172.21.15.171:0/159664112 shutdown_connections 2024-04-26T00:02:07.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- 172.21.15.171:0/159664112 >> 172.21.15.171:0/159664112 conn(0x7fb8900a67e0 msgr2=0x7fb8900a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- 172.21.15.171:0/159664112 shutdown_connections 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.934+0000 7fb8963ab640 1 -- 172.21.15.171:0/159664112 wait complete. 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: build_initial_monmap 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: monmap: 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:07.922 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 Processor -- start 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 -- start start 2024-04-26T00:02:07.923 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: init 2024-04-26T00:02:07.926 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _add_conns ranks=[3,6,2,0,8,4,7,5,1] 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient(hunting): picked mon.noname-g con 0x7fb8900727b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient(hunting): picked mon.noname-d con 0x7fb890132a30 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient(hunting): picked mon.noname-b con 0x7fb890132e10 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb890072c10 con 0x7fb890132e10 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88ffff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fb8900727b0 legacy=0x7fb890131340 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb89009ade0 con 0x7fb8900727b0 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb890120a50 con 0x7fb890132a30 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient(hunting): authenticate will time out at 1378.645467s 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88f7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb890132a30 0x7fb8901cf8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:60116/0 (socket says 172.21.15.171:60116) 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88f7fe640 1 -- 172.21.15.171:0/2078495063 learned_addr learned my addr 172.21.15.171:0/2078495063 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:07.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 555627266 0 0) 0x7fb890120a50 con 0x7fb890132a30 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): my global_id is 6972 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb870003530 con 0x7fb890132a30 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486337841 0 0) 0x7fb890072c10 con 0x7fb890132e10 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): my global_id is 6905 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb890120a50 con 0x7fb890132e10 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4280054501 0 0) 0x7fb870003530 con 0x7fb890132a30 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb890072c10 con 0x7fb890132a30 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3464641495 0 0) 0x7fb890120a50 con 0x7fb890132e10 2024-04-26T00:02:07.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb870003530 con 0x7fb890132e10 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb878001780 con 0x7fb890132a30 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): dump: 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:07.929 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb880001c50 con 0x7fb890132e10 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient(hunting): dump: 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:07.930 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1641573573 0 0) 0x7fb890072c10 con 0x7fb890132a30 2024-04-26T00:02:07.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 >> v1:172.21.15.171:6790/0 conn(0x7fb8900727b0 legacy=0x7fb890131340 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 >> v1:172.21.15.106:6790/0 conn(0x7fb890132e10 legacy=0x7fb8901d3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 monclient: found mon.d 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb890122d40 con 0x7fb890132a30 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 5 monclient: authenticate success, global_id 6972 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _renew_subs 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8901217d0 con 0x7fb890132a30 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _renew_subs 2024-04-26T00:02:07.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8901caa30 con 0x7fb890132a30 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb878001ab0 con 0x7fb890132a30 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88e7fc640 4 set_mon_vals no callback set 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb878001c60 con 0x7fb890132a30 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb88cff9640 10 monclient: dump: 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:07.933 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.938+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb874005090 con 0x7fb890132a30 2024-04-26T00:02:07.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.942+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb878010050 con 0x7fb890132a30 2024-04-26T00:02:07.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.942+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(247..247 src has 138..247) ==== 6817+0+0 (unknown 3335973100 0 0) 0x7fb878045020 con 0x7fb890132a30 2024-04-26T00:02:07.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.942+0000 7fb88ffff640 10 monclient: get_auth_request con 0x7fb870037d40 auth_method 0 2024-04-26T00:02:07.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.954+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb8780157b0 con 0x7fb890132a30 2024-04-26T00:02:07.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.954+0000 7fb88cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:07.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:07.954+0000 7fb88cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:08.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.126+0000 7fb8963ab640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:08.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.126+0000 7fb8963ab640 10 monclient: _send_command 2 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:08.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.126+0000 7fb8963ab640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:08.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.126+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"} v 0) -- 0x7fb874005380 con 0x7fb890132a30 2024-04-26T00:02:08.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.702+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}]=0 v248) ==== 106+0+3 (unknown 1797275238 0 944643765) 0x7fb87801dc60 con 0x7fb890132a30 2024-04-26T00:02:08.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.702+0000 7fb88cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:08.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.702+0000 7fb88cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:08.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.814+0000 7fb8963ab640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:08.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.814+0000 7fb8963ab640 10 monclient: _send_command 3 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:08.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.814+0000 7fb8963ab640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:08.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.814+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"} v 0) -- 0x7fb8740010a0 con 0x7fb890132a30 2024-04-26T00:02:08.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.814+0000 7fb88cff9640 1 -- 172.21.15.171:0/2078495063 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}]=0 v248) ==== 106+0+3 (unknown 1797275238 0 944643765) 0x7fb8780407e0 con 0x7fb890132a30 2024-04-26T00:02:08.794 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.814+0000 7fb88cff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:08.795 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.814+0000 7fb88cff9640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 >> v1:172.21.15.171:6812/722422047 conn(0x7fb870037d40 legacy=0x7fb87003a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 10 monclient: shutdown 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 >> v1:172.21.15.106:6792/0 conn(0x7fb890132a30 legacy=0x7fb8901cf8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 shutdown_connections 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 >> 172.21.15.171:0/2078495063 conn(0x7fb8900a67e0 msgr2=0x7fb890134b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 shutdown_connections 2024-04-26T00:02:08.797 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.818+0000 7fb8963ab640 1 -- 172.21.15.171:0/2078495063 wait complete. 2024-04-26T00:02:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:+ na=12 2024-04-26T00:02:08.812 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd create aa68e4d6-7b8f-4a5a-8b0b-22213bea2028 2024-04-26T00:02:08.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.946+0000 7fd465b88640 10 monclient: get_monmap_and_config 2024-04-26T00:02:08.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.946+0000 7fd465b88640 10 monclient: build_initial_monmap 2024-04-26T00:02:08.927 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient: monmap: 2024-04-26T00:02:08.927 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:08.950484+0000 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:08.950484+0000 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:08.928 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:08.929 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 Processor -- start 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- start start 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient: init 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient: _add_conns ranks=[0,2,4,8,1,6,5,7,3] 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient(hunting): picked mon.noname-a con 0x7fd460132a30 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient(hunting): picked mon.noname-b con 0x7fd4600727b0 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient(hunting): picked mon.noname-c con 0x7fd460132e10 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd460136400 con 0x7fd460132a30 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46009fa80 con 0x7fd4600727b0 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46009b890 con 0x7fd460132e10 2024-04-26T00:02:08.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient(hunting): authenticate will time out at 1379.657403s 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fd460132e10 0x7fd46013e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:58644/0 (socket says 172.21.15.171:58644) 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd460132a30 0x7fd4601355e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:34132/0 (socket says 172.21.15.171:34132) 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45ffff640 1 -- 172.21.15.171:0/1753598292 learned_addr learned my addr 172.21.15.171:0/1753598292 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1243168199 0 0) 0x7fd46009fa80 con 0x7fd4600727b0 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): my global_id is 6914 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd448003530 con 0x7fd4600727b0 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2264934944 0 0) 0x7fd46009b890 con 0x7fd460132e10 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:08.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): my global_id is 145453 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd46009fa80 con 0x7fd460132e10 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 202135135 0 0) 0x7fd460136400 con 0x7fd460132a30 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient(hunting): my global_id is 7056 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd46009b890 con 0x7fd460132a30 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498023675 0 0) 0x7fd46009fa80 con 0x7fd460132e10 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 >> v1:172.21.15.106:6790/0 conn(0x7fd4600727b0 legacy=0x7fd460135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 >> v1:172.21.15.106:6789/0 conn(0x7fd460132a30 legacy=0x7fd4601355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 monclient: found mon.noname-c 2024-04-26T00:02:08.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4600a3500 con 0x7fd460132e10 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd458001b20 con 0x7fd460132e10 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: dump: 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.935 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 5 monclient: authenticate success, global_id 145453 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd458001e00 con 0x7fd460132e10 2024-04-26T00:02:08.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 4 set_mon_vals no callback set 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 1 -- 172.21.15.171:0/1753598292 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd458004f70 con 0x7fd460132e10 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd45e7fc640 10 monclient: dump: 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:08.937 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 10 monclient: shutdown 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- 172.21.15.171:0/1753598292 >> v1:172.21.15.106:6791/0 conn(0x7fd460132e10 legacy=0x7fd46013e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- 172.21.15.171:0/1753598292 shutdown_connections 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- 172.21.15.171:0/1753598292 >> 172.21.15.171:0/1753598292 conn(0x7fd4600a67e0 msgr2=0x7fd4600a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- 172.21.15.171:0/1753598292 shutdown_connections 2024-04-26T00:02:08.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.950+0000 7fd465b88640 1 -- 172.21.15.171:0/1753598292 wait complete. 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: build_initial_monmap 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: monmap: 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:08.939 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:08.940 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:08.940 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:08.940 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:08.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 Processor -- start 2024-04-26T00:02:08.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 -- start start 2024-04-26T00:02:08.940 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: init 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _add_conns ranks=[1,0,8,2,6,5,4,3,7] 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient(hunting): picked mon.noname-f con 0x7fd4600727b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient(hunting): picked mon.noname-a con 0x7fd460132a30 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient(hunting): picked mon.noname-e con 0x7fd460132e10 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd460120460 con 0x7fd460132a30 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46011f7a0 con 0x7fd4600727b0 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46011d100 con 0x7fd460132e10 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient(hunting): authenticate will time out at 1379.661357s 2024-04-26T00:02:08.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd45f7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fd4600727b0 0x7fd46011c2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52768/0 (socket says 172.21.15.171:52768) 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd45f7fe640 1 -- 172.21.15.171:0/1871031075 learned_addr learned my addr 172.21.15.171:0/1871031075 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3891305932 0 0) 0x7fd46011f7a0 con 0x7fd4600727b0 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): my global_id is 145468 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd44c003530 con 0x7fd4600727b0 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4035185899 0 0) 0x7fd44c003530 con 0x7fd4600727b0 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd46011f7a0 con 0x7fd4600727b0 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd450001a90 con 0x7fd4600727b0 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): dump: 2024-04-26T00:02:08.948 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:08.949 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433640793 0 0) 0x7fd454001170 con 0x7fd460132a30 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): my global_id is 7065 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd44c003530 con 0x7fd460132a30 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 539385849 0 0) 0x7fd46011d100 con 0x7fd460132e10 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient(hunting): my global_id is 204614 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd454001170 con 0x7fd460132e10 2024-04-26T00:02:08.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2123135498 0 0) 0x7fd46011f7a0 con 0x7fd4600727b0 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 >> v1:172.21.15.106:6793/0 conn(0x7fd460132e10 legacy=0x7fd4601d2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 >> v1:172.21.15.106:6789/0 conn(0x7fd460132a30 legacy=0x7fd46011c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 monclient: found mon.f 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46011dc30 con 0x7fd4600727b0 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: _finish_auth 0 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 5 monclient: authenticate success, global_id 145468 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _renew_subs 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd46011e2f0 con 0x7fd4600727b0 2024-04-26T00:02:08.951 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _renew_subs 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd46011f4c0 con 0x7fd4600727b0 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd460068fb0 con 0x7fd4600727b0 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd450004b20 con 0x7fd4600727b0 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd450005090 con 0x7fd4600727b0 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 10 monclient: dump: 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:08.952 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:08.953 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:08.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd45d7fa640 4 set_mon_vals no callback set 2024-04-26T00:02:08.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd450005230 con 0x7fd4600727b0 2024-04-26T00:02:08.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(248..248 src has 138..248) ==== 6817+0+0 (unknown 458439952 0 0) 0x7fd450045130 con 0x7fd4600727b0 2024-04-26T00:02:08.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.954+0000 7fd45effd640 10 monclient: get_auth_request con 0x7fd44c037a70 auth_method 0 2024-04-26T00:02:08.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.958+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd4500157c0 con 0x7fd4600727b0 2024-04-26T00:02:08.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.962+0000 7fd447fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:08.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:08.962+0000 7fd447fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:09.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.134+0000 7fd465b88640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:09.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.134+0000 7fd465b88640 10 monclient: _send_command 2 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:09.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.134+0000 7fd465b88640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.115 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.134+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"} v 0) -- 0x7fd460072e40 con 0x7fd4600727b0 2024-04-26T00:02:09.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.138+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}]=0 v248) ==== 106+0+3 (unknown 1797275238 0 944643765) 0x7fd4500150c0 con 0x7fd4600727b0 2024-04-26T00:02:09.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.138+0000 7fd447fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:09.116 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.138+0000 7fd447fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:09.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.242+0000 7fd465b88640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:09.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.242+0000 7fd465b88640 10 monclient: _send_command 3 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:09.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.242+0000 7fd465b88640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.242+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"} v 0) -- 0x7fd4600008e0 con 0x7fd4600727b0 2024-04-26T00:02:09.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd447fff640 1 -- 172.21.15.171:0/1871031075 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}]=0 v248) ==== 106+0+3 (unknown 1797275238 0 944643765) 0x7fd45001dc70 con 0x7fd4600727b0 2024-04-26T00:02:09.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd447fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:09.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd447fff640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:02:09.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 >> v1:172.21.15.171:6812/722422047 conn(0x7fd44c037a70 legacy=0x7fd44c039f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd465b88640 10 monclient: shutdown 2024-04-26T00:02:09.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd465b88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:09.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 >> v1:172.21.15.171:6789/0 conn(0x7fd4600727b0 legacy=0x7fd46011c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 shutdown_connections 2024-04-26T00:02:09.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.246+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 >> 172.21.15.171:0/1871031075 conn(0x7fd4600a67e0 msgr2=0x7fd460133aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:09.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.250+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 shutdown_connections 2024-04-26T00:02:09.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.250+0000 7fd465b88640 1 -- 172.21.15.171:0/1871031075 wait complete. 2024-04-26T00:02:09.242 INFO:tasks.workunit.client.0.smithi171.stderr:+ test 12 -eq 12 2024-04-26T00:02:09.242 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd create 60732f5d-c1b7-4f69-8e61-e3844a8c6da1 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient: get_monmap_and_config 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient: build_initial_monmap 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient: monmap: 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:09.379643+0000 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:09.379643+0000 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:09.364 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 1 Processor -- start 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 1 -- start start 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient: init 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient: _add_conns ranks=[1,3,7,2,8,4,6,0,5] 2024-04-26T00:02:09.365 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient(hunting): picked mon.noname-f con 0x7f8f3c132a30 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient(hunting): picked mon.noname-g con 0x7f8f3c0727b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient(hunting): picked mon.noname-i con 0x7f8f3c132e10 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c136400 con 0x7f8f3c132a30 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c09fa80 con 0x7f8f3c0727b0 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c09b890 con 0x7f8f3c132e10 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient(hunting): authenticate will time out at 1380.086535s 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3affd640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f8f3c0727b0 legacy=0x7f8f3c135cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3bfff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f8f3c132e10 0x7f8f3c13e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52576/0 (socket says 172.21.15.171:52576) 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3b7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8f3c132a30 0x7f8f3c1355e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52772/0 (socket says 172.21.15.171:52772) 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3bfff640 1 -- 172.21.15.171:0/1895409143 learned_addr learned my addr 172.21.15.171:0/1895409143 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612693979 0 0) 0x7f8f3c136400 con 0x7f8f3c132a30 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:09.366 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:09.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:09.367 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): my global_id is 145477 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f28003530 con 0x7f8f3c132a30 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 960711290 0 0) 0x7f8f3c09b890 con 0x7f8f3c132e10 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient(hunting): my global_id is 145411 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f3c136400 con 0x7f8f3c132e10 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1930049061 0 0) 0x7f8f28003530 con 0x7f8f3c132a30 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 >> v1:172.21.15.171:6792/0 conn(0x7f8f3c132e10 legacy=0x7f8f3c13e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 >> v1:172.21.15.171:6790/0 conn(0x7f8f3c0727b0 legacy=0x7f8f3c135cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:02:09.368 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 monclient: found mon.noname-f 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c0a3500 con 0x7f8f3c132a30 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8f240017c0 con 0x7f8f3c132a30 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 5 monclient: authenticate success, global_id 145477 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: dump: 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.369 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.370 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f24001a60 con 0x7f8f3c132a30 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 1 -- 172.21.15.171:0/1895409143 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8f24004b30 con 0x7f8f3c132a30 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f41d8a640 4 set_mon_vals no callback set 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.378+0000 7f8f3a7fc640 10 monclient: dump: 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.371 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: shutdown 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1895409143 >> v1:172.21.15.171:6789/0 conn(0x7f8f3c132a30 legacy=0x7f8f3c1355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.372 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1895409143 shutdown_connections 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1895409143 >> 172.21.15.171:0/1895409143 conn(0x7f8f3c0a67e0 msgr2=0x7f8f3c0a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1895409143 shutdown_connections 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1895409143 wait complete. 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: build_initial_monmap 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: monmap: 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:09.373 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 Processor -- start 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- start start 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: init 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _add_conns ranks=[1,3,6,4,0,7,2,5,8] 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient(hunting): picked mon.noname-f con 0x7f8f3c0727b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient(hunting): picked mon.noname-g con 0x7f8f3c132a30 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:09.374 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient(hunting): picked mon.noname-d con 0x7f8f3c132e10 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c11d2e0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c072240 con 0x7f8f3c132a30 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f3c11e880 con 0x7f8f3c132e10 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f3affd640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f8f3c132a30 legacy=0x7f8f3c1cf310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient(hunting): authenticate will time out at 1380.089682s 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f3b7fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8f3c0727b0 0x7f8f3c131740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52774/0 (socket says 172.21.15.171:52774) 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f3b7fe640 1 -- 172.21.15.171:0/1308788852 learned_addr learned my addr 172.21.15.171:0/1308788852 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3504807011 0 0) 0x7f8f3c11d2e0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): my global_id is 145486 2024-04-26T00:02:09.375 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f1c003530 con 0x7f8f3c0727b0 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 293361796 0 0) 0x7f8f1c003530 con 0x7f8f3c0727b0 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8f3c11d2e0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8f24001780 con 0x7f8f3c0727b0 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): dump: 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.376 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3662069662 0 0) 0x7f8f3c11d2e0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 >> v1:172.21.15.106:6792/0 conn(0x7f8f3c132e10 legacy=0x7f8f3c1d2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 >> v1:172.21.15.171:6790/0 conn(0x7f8f3c132a30 legacy=0x7f8f3c1cf310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 monclient: found mon.f 2024-04-26T00:02:09.377 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f3c11eb60 con 0x7f8f3c0727b0 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: _finish_auth 0 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 5 monclient: authenticate success, global_id 145486 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _renew_subs 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8f3c11d4f0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _renew_subs 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8f3c11d990 con 0x7f8f3c0727b0 2024-04-26T00:02:09.378 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8f24001cd0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8f24001a60 con 0x7f8f3c0727b0 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f39ffb640 4 set_mon_vals no callback set 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 10 monclient: dump: 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.379 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f20005090 con 0x7f8f3c0727b0 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8f24010030 con 0x7f8f3c0727b0 2024-04-26T00:02:09.380 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(248..248 src has 138..248) ==== 6817+0+0 (unknown 458439952 0 0) 0x7f8f24045280 con 0x7f8f3c0727b0 2024-04-26T00:02:09.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.382+0000 7f8f3affd640 10 monclient: get_auth_request con 0x7f8f1c037850 auth_method 0 2024-04-26T00:02:09.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.390+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8f24015990 con 0x7f8f3c0727b0 2024-04-26T00:02:09.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.390+0000 7f8f33fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:09.381 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.390+0000 7f8f33fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:09.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.562+0000 7f8f41d8a640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:09.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.562+0000 7f8f41d8a640 10 monclient: _send_command 2 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:09.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.562+0000 7f8f41d8a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.540 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.562+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"} v 0) -- 0x7f8f20005380 con 0x7f8f3c0727b0 2024-04-26T00:02:09.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.702+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}]=0 v249) ==== 106+0+3 (unknown 350679121 0 1367428999) 0x7f8f24042420 con 0x7f8f3c0727b0 2024-04-26T00:02:09.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.702+0000 7f8f33fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:09.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.702+0000 7f8f33fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:09.791 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.814+0000 7f8f41d8a640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:09.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.814+0000 7f8f41d8a640 10 monclient: _send_command 3 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:09.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.814+0000 7f8f41d8a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.792 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.814+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"} v 0) -- 0x7f8f20005be0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.814+0000 7f8f33fff640 1 -- 172.21.15.171:0/1308788852 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}]=0 v249) ==== 106+0+3 (unknown 350679121 0 1367428999) 0x7f8f240427a0 con 0x7f8f3c0727b0 2024-04-26T00:02:09.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.814+0000 7f8f33fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:09.793 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.814+0000 7f8f33fff640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 >> v1:172.21.15.171:6812/722422047 conn(0x7f8f1c037850 legacy=0x7f8f1c039d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 10 monclient: shutdown 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 >> v1:172.21.15.171:6789/0 conn(0x7f8f3c0727b0 legacy=0x7f8f3c131740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 shutdown_connections 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 >> 172.21.15.171:0/1308788852 conn(0x7f8f3c0a67e0 msgr2=0x7f8f3c0a1160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 shutdown_connections 2024-04-26T00:02:09.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.818+0000 7f8f41d8a640 1 -- 172.21.15.171:0/1308788852 wait complete. 2024-04-26T00:02:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:+ nb=14 2024-04-26T00:02:09.810 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd create 60732f5d-c1b7-4f69-8e61-e3844a8c6da1 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient: get_monmap_and_config 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient: build_initial_monmap 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient: monmap: 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:09.943906+0000 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:09.943906+0000 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:09.921 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:09.922 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:09.922 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:09.922 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:09.922 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:09.922 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:09.922 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 1 Processor -- start 2024-04-26T00:02:09.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 1 -- start start 2024-04-26T00:02:09.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient: init 2024-04-26T00:02:09.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient: _add_conns ranks=[6,1,7,8,4,2,3,5,0] 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient(hunting): picked mon.noname-d con 0x7f3ee00a2930 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient(hunting): picked mon.noname-f con 0x7f3ee00a1160 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient(hunting): picked mon.noname-i con 0x7f3ee00a3420 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee00a01c0 con 0x7f3ee00a1160 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee009eb10 con 0x7f3ee00a2930 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee00a43c0 con 0x7f3ee00a3420 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ee59bd640 10 monclient(hunting): authenticate will time out at 1380.651692s 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ed7fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f3ee00a1160 0x7f3ee0139ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52784/0 (socket says 172.21.15.171:52784) 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3ed7fff640 1 -- 172.21.15.171:0/923933406 learned_addr learned my addr 172.21.15.171:0/923933406 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.942+0000 7f3edf7fe640 1 --1- 172.21.15.171:0/923933406 >> v1:172.21.15.171:6792/0 conn(0x7f3ee00a3420 0x7f3ee013d2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:52584/0 (socket says 172.21.15.171:52584) 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1587774252 0 0) 0x7f3ee00a43c0 con 0x7f3ee00a3420 2024-04-26T00:02:09.930 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): my global_id is 145420 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ecc003530 con 0x7f3ee00a3420 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1827716942 0 0) 0x7f3ee00a01c0 con 0x7f3ee00a1160 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient(hunting): my global_id is 145495 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ee00a43c0 con 0x7f3ee00a1160 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2723335358 0 0) 0x7f3ee00a43c0 con 0x7f3ee00a1160 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 >> v1:172.21.15.171:6792/0 conn(0x7f3ee00a3420 legacy=0x7f3ee013d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 >> v1:172.21.15.106:6792/0 conn(0x7f3ee00a2930 legacy=0x7f3ee00a2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 monclient: found mon.noname-f 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee006f750 con 0x7f3ee00a1160 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ec8001740 con 0x7f3ee00a1160 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:09.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: dump: 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.933 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 5 monclient: authenticate success, global_id 145495 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ec80019a0 con 0x7f3ee00a1160 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 4 set_mon_vals no callback set 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 1 -- 172.21.15.171:0/923933406 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ec8004bf0 con 0x7f3ee00a1160 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ede7fc640 10 monclient: dump: 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.934 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.935 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: shutdown 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- 172.21.15.171:0/923933406 >> v1:172.21.15.171:6789/0 conn(0x7f3ee00a1160 legacy=0x7f3ee0139ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- 172.21.15.171:0/923933406 shutdown_connections 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- 172.21.15.171:0/923933406 >> 172.21.15.171:0/923933406 conn(0x7f3ee00a7520 msgr2=0x7f3ee00a3a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- 172.21.15.171:0/923933406 shutdown_connections 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- 172.21.15.171:0/923933406 wait complete. 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: build_initial_monmap 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: monmap: 2024-04-26T00:02:09.936 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:09.937 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 Processor -- start 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- start start 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: init 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: _add_conns ranks=[1,6,4,2,3,0,7,8,5] 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient(hunting): picked mon.noname-f con 0x7f3ee00a1160 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient(hunting): picked mon.noname-d con 0x7f3ee00a2930 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient(hunting): picked mon.noname-c con 0x7f3ee00a3420 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee0072bd0 con 0x7f3ee00a1160 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee01210f0 con 0x7f3ee00a3420 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ee0132100 con 0x7f3ee00a2930 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:09.938 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient(hunting): authenticate will time out at 1380.654643s 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edeffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f3ee00a1160 0x7f3ee01319f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:52792/0 (socket says 172.21.15.171:52792) 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edeffd640 1 -- 172.21.15.171:0/2296973105 learned_addr learned my addr 172.21.15.171:0/2296973105 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 603727733 0 0) 0x7f3ee0072bd0 con 0x7f3ee00a1160 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): my global_id is 145504 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ec0003530 con 0x7f3ee00a1160 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2082741485 0 0) 0x7f3ec0003530 con 0x7f3ee00a1160 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ee0072bd0 con 0x7f3ee00a1160 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ed0001b20 con 0x7f3ee00a1160 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:09.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): dump: 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.940 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2845629700 0 0) 0x7f3ee0072bd0 con 0x7f3ee00a1160 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 >> v1:172.21.15.106:6792/0 conn(0x7f3ee00a2930 legacy=0x7f3ee01cd0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 >> v1:172.21.15.106:6791/0 conn(0x7f3ee00a3420 legacy=0x7f3ee01d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:09.941 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 monclient: found mon.f 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee011fc40 con 0x7f3ee00a1160 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:09.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 5 monclient: authenticate success, global_id 145504 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: _renew_subs 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee0132360 con 0x7f3ee00a1160 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: _renew_subs 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3ee01c7f40 con 0x7f3ee00a1160 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ed00038d0 con 0x7f3ee00a1160 2024-04-26T00:02:09.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ed0003e40 con 0x7f3ee00a1160 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3eddffb640 4 set_mon_vals no callback set 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.946+0000 7f3edcff9640 10 monclient: dump: 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.944 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:09.945 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.950+0000 7f3ee59bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.950+0000 7f3ee59bd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.950+0000 7f3ee59bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:09.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.950+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3ed0004060 con 0x7f3ee00a1160 2024-04-26T00:02:09.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.950+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ec4005090 con 0x7f3ee00a1160 2024-04-26T00:02:09.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.950+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(249..249 src has 138..249) ==== 6817+0+0 (unknown 3274752984 0 0) 0x7f3ed0045380 con 0x7f3ee00a1160 2024-04-26T00:02:09.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.950+0000 7f3ed7fff640 10 monclient: get_auth_request con 0x7f3ec00378a0 auth_method 0 2024-04-26T00:02:09.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.954+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3ed00159b0 con 0x7f3ee00a1160 2024-04-26T00:02:09.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.954+0000 7f3edcff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:09.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:09.954+0000 7f3edcff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.110+0000 7f3ee59bd640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.110+0000 7f3ee59bd640 10 monclient: _send_command 2 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.110+0000 7f3ee59bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:10.090 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.110+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"} v 0) -- 0x7f3ec4005380 con 0x7f3ee00a1160 2024-04-26T00:02:10.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.110+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}]=0 v249) ==== 106+0+3 (unknown 350679121 0 1367428999) 0x7f3ed00152b0 con 0x7f3ee00a1160 2024-04-26T00:02:10.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.114+0000 7f3edcff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:10.091 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.114+0000 7f3edcff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:10.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.218+0000 7f3ee59bd640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:10.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.218+0000 7f3ee59bd640 10 monclient: _send_command 3 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:10.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.218+0000 7f3ee59bd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:10.197 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.218+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"} v 0) -- 0x7f3ec4005be0 con 0x7f3ee00a1160 2024-04-26T00:02:10.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.218+0000 7f3edcff9640 1 -- 172.21.15.171:0/2296973105 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}]=0 v249) ==== 106+0+3 (unknown 350679121 0 1367428999) 0x7f3ed001de60 con 0x7f3ee00a1160 2024-04-26T00:02:10.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.218+0000 7f3edcff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create", "uuid": "60732f5d-c1b7-4f69-8e61-e3844a8c6da1"}] 2024-04-26T00:02:10.198 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.218+0000 7f3edcff9640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 >> v1:172.21.15.171:6812/722422047 conn(0x7f3ec00378a0 legacy=0x7f3ec0039d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 10 monclient: shutdown 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 >> v1:172.21.15.171:6789/0 conn(0x7f3ee00a1160 legacy=0x7f3ee01319f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 shutdown_connections 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 >> 172.21.15.171:0/2296973105 conn(0x7f3ee00a7520 msgr2=0x7f3ee00719f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 shutdown_connections 2024-04-26T00:02:10.201 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.222+0000 7f3ee59bd640 1 -- 172.21.15.171:0/2296973105 wait complete. 2024-04-26T00:02:10.216 INFO:tasks.workunit.client.0.smithi171.stderr:+ test 14 -eq 14 2024-04-26T00:02:10.216 INFO:tasks.workunit.client.0.smithi171.stderr:+ test 14 -ne 12 2024-04-26T00:02:10.216 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd rm 12 2024-04-26T00:02:10.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.350+0000 7fb8fc120640 10 monclient: get_monmap_and_config 2024-04-26T00:02:10.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.350+0000 7fb8fc120640 10 monclient: build_initial_monmap 2024-04-26T00:02:10.331 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient: monmap: 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:10.354554+0000 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:10.354554+0000 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:10.332 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:10.333 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:10.333 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 Processor -- start 2024-04-26T00:02:10.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- start start 2024-04-26T00:02:10.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient: init 2024-04-26T00:02:10.339 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient: _add_conns ranks=[0,5,4,2,7,1,6,3,8] 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient(hunting): picked mon.noname-a con 0x7fb8f4071f00 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient(hunting): picked mon.noname-h con 0x7fb8f409e960 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient(hunting): picked mon.noname-c con 0x7fb8f406f6e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f40a00f0 con 0x7fb8f4071f00 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f40a42f0 con 0x7fb8f406f6e0 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f40a1170 con 0x7fb8f409e960 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient(hunting): authenticate will time out at 1381.061987s 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f96bb640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb8f409e960 0x7fb8f4139900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:38712/0 (socket says 172.21.15.171:38712) 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f96bb640 1 -- 172.21.15.171:0/3210390156 learned_addr learned my addr 172.21.15.171:0/3210390156 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1359463265 0 0) 0x7fb8f40a1170 con 0x7fb8f409e960 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.340 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient(hunting): my global_id is 6872 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8e0003530 con 0x7fb8f409e960 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3349574648 0 0) 0x7fb8e0003530 con 0x7fb8f409e960 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 >> v1:172.21.15.106:6791/0 conn(0x7fb8f406f6e0 legacy=0x7fb8f413d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 >> v1:172.21.15.106:6789/0 conn(0x7fb8f4071f00 legacy=0x7fb8f40722e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: _finish_hunting 0 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 monclient: found mon.noname-h 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f4141780 con 0x7fb8f409e960 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: _finish_auth 0 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: _check_auth_tickets 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:10.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8e40017c0 con 0x7fb8f409e960 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 5 monclient: authenticate success, global_id 6872 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: dump: 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.342 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8e4001ab0 con 0x7fb8f409e960 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 1 -- 172.21.15.171:0/3210390156 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8e4004bf0 con 0x7fb8f409e960 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:10.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8f8eba640 10 monclient: dump: 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.344 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 4 set_mon_vals no callback set 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 10 monclient: shutdown 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- 172.21.15.171:0/3210390156 >> v1:172.21.15.171:6791/0 conn(0x7fb8f409e960 legacy=0x7fb8f4139900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- 172.21.15.171:0/3210390156 shutdown_connections 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- 172.21.15.171:0/3210390156 >> 172.21.15.171:0/3210390156 conn(0x7fb8f40a7420 msgr2=0x7fb8f40a3920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- 172.21.15.171:0/3210390156 shutdown_connections 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.354+0000 7fb8fc120640 1 -- 172.21.15.171:0/3210390156 wait complete. 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: build_initial_monmap 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: monmap: 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:10.345 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 Processor -- start 2024-04-26T00:02:10.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 -- start start 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: init 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _add_conns ranks=[0,6,5,8,3,2,1,7,4] 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient(hunting): picked mon.noname-a con 0x7fb8f406f6e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient(hunting): picked mon.noname-d con 0x7fb8f4071f00 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient(hunting): picked mon.noname-h con 0x7fb8f409e960 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f411dad0 con 0x7fb8f406f6e0 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f4072b60 con 0x7fb8f409e960 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb8f4071cd0 con 0x7fb8f4071f00 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient(hunting): authenticate will time out at 1381.065046s 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fa6bd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb8f409e960 0x7fb8f41d5240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:38728/0 (socket says 172.21.15.171:38728) 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fa6bd640 1 -- 172.21.15.171:0/276765804 learned_addr learned my addr 172.21.15.171:0/276765804 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:10.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4157293478 0 0) 0x7fb8f4072b60 con 0x7fb8f409e960 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): my global_id is 6881 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8d8003560 con 0x7fb8f409e960 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2664727157 0 0) 0x7fb8d8003560 con 0x7fb8f409e960 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb8f4072b60 con 0x7fb8f409e960 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8ec001e20 con 0x7fb8f409e960 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): dump: 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.348 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:10.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739627411 0 0) 0x7fb8f411dad0 con 0x7fb8f406f6e0 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient(hunting): my global_id is 7083 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb8d8003560 con 0x7fb8f406f6e0 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3482163737 0 0) 0x7fb8f4072b60 con 0x7fb8f409e960 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 >> v1:172.21.15.106:6792/0 conn(0x7fb8f4071f00 legacy=0x7fb8f41d1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 >> v1:172.21.15.106:6789/0 conn(0x7fb8f406f6e0 legacy=0x7fb8f4134ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 monclient: found mon.h 2024-04-26T00:02:10.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f40a37e0 con 0x7fb8f409e960 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 5 monclient: authenticate success, global_id 6881 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _renew_subs 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f411d7f0 con 0x7fb8f409e960 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _renew_subs 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb8f4141100 con 0x7fb8f409e960 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb8ec003c90 con 0x7fb8f409e960 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:10.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8ec004200 con 0x7fb8f409e960 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ebfff640 4 set_mon_vals no callback set 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 10 monclient: dump: 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.352 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb8ec0043a0 con 0x7fb8f409e960 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8dc005090 con 0x7fb8f409e960 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(249..249 src has 138..249) ==== 6817+0+0 (unknown 3274752984 0 0) 0x7fb8ec045610 con 0x7fb8f409e960 2024-04-26T00:02:10.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.358+0000 7fb8f9ebc640 10 monclient: get_auth_request con 0x7fb8d8037870 auth_method 0 2024-04-26T00:02:10.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.362+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fb8ec015b80 con 0x7fb8f409e960 2024-04-26T00:02:10.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.362+0000 7fb8ea7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:10.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.362+0000 7fb8ea7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:10.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.522+0000 7fb8fc120640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:10.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.522+0000 7fb8fc120640 10 monclient: _send_command 2 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:10.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.522+0000 7fb8fc120640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:10.500 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.522+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd rm", "ids": ["12"]} v 0) -- 0x7fb8dc005380 con 0x7fb8f409e960 2024-04-26T00:02:10.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:10.519+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e249 definitely_dead 0 2024-04-26T00:02:10.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.722+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["12"]}]=0 removed osd.12 v250) ==== 83+0+0 (unknown 1285384214 0 0) 0x7fb8ec019830 con 0x7fb8f409e960 2024-04-26T00:02:10.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.722+0000 7fb8ea7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:10.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.722+0000 7fb8ea7fc640 10 monclient: _finish_command 2 = system:0 removed osd.12 2024-04-26T00:02:10.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.830+0000 7fb8fc120640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:10.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.830+0000 7fb8fc120640 10 monclient: _send_command 3 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:10.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.830+0000 7fb8fc120640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:10.810 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.830+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd rm", "ids": ["12"]} v 0) -- 0x7fb8dc000bd0 con 0x7fb8f409e960 2024-04-26T00:02:10.811 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:10.831+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e250 definitely_dead 0 2024-04-26T00:02:10.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8ea7fc640 1 -- 172.21.15.171:0/276765804 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["12"]}]=0 osd.12 does not exist. v250) ==== 92+0+0 (unknown 189017566 0 0) 0x7fb8ec01e0f0 con 0x7fb8f409e960 2024-04-26T00:02:10.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8ea7fc640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:10.811 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8ea7fc640 10 monclient: _finish_command 3 = system:0 osd.12 does not exist. 2024-04-26T00:02:10.811 INFO:tasks.workunit.client.0.smithi171.stderr:osd.12 does not exist. 2024-04-26T00:02:10.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 >> v1:172.21.15.171:6812/722422047 conn(0x7fb8d8037870 legacy=0x7fb8d8039d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.813 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 10 monclient: shutdown 2024-04-26T00:02:10.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:10.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 >> v1:172.21.15.171:6791/0 conn(0x7fb8f409e960 legacy=0x7fb8f41d5240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 shutdown_connections 2024-04-26T00:02:10.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 >> 172.21.15.171:0/276765804 conn(0x7fb8f40a7420 msgr2=0x7fb8f406b1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:10.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 shutdown_connections 2024-04-26T00:02:10.814 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.834+0000 7fb8fc120640 1 -- 172.21.15.171:0/276765804 wait complete. 2024-04-26T00:02:10.828 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd rm 12 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.958+0000 7ff72e98b640 10 monclient: get_monmap_and_config 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.958+0000 7ff72e98b640 10 monclient: build_initial_monmap 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.958+0000 7ff72e98b640 10 monclient: monmap: 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:10.962107+0000 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:10.962107+0000 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:10.939 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:10.940 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:10.940 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 Processor -- start 2024-04-26T00:02:10.942 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- start start 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient: init 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient: _add_conns ranks=[0,3,2,6,4,7,8,5,1] 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient(hunting): picked mon.noname-a con 0x7ff728131880 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient(hunting): picked mon.noname-g con 0x7ff72809e7b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient(hunting): picked mon.noname-b con 0x7ff72809ebf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72809c660 con 0x7ff728131880 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72809da10 con 0x7ff72809ebf0 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72809dcf0 con 0x7ff72809e7b0 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff7277fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7ff72809e7b0 legacy=0x7ff728139880 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient(hunting): authenticate will time out at 1381.669113s 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff727fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff728131880 0x7ff728131c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:39414/0 (socket says 172.21.15.171:39414) 2024-04-26T00:02:10.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff727fff640 1 -- 172.21.15.171:0/1312413855 learned_addr learned my addr 172.21.15.171:0/1312413855 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988665015 0 0) 0x7ff72809c660 con 0x7ff728131880 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): my global_id is 7092 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff710003530 con 0x7ff728131880 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1723834027 0 0) 0x7ff72809da10 con 0x7ff72809ebf0 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient(hunting): my global_id is 6923 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72809c660 con 0x7ff72809ebf0 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 626799236 0 0) 0x7ff710003530 con 0x7ff728131880 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 >> v1:172.21.15.171:6790/0 conn(0x7ff72809e7b0 legacy=0x7ff728139880 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:02:10.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 >> v1:172.21.15.106:6790/0 conn(0x7ff72809ebf0 legacy=0x7ff72813cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 monclient: found mon.noname-a 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff72809dfd0 con 0x7ff728131880 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: _finish_auth 0 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff7180017c0 con 0x7ff728131880 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: dump: 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.945 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.946 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 5 monclient: authenticate success, global_id 7092 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff718001a70 con 0x7ff728131880 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 4 set_mon_vals no callback set 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 1 -- 172.21.15.171:0/1312413855 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff718004bf0 con 0x7ff728131880 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff726ffd640 10 monclient: dump: 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.947 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 10 monclient: shutdown 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- 172.21.15.171:0/1312413855 >> v1:172.21.15.106:6789/0 conn(0x7ff728131880 legacy=0x7ff728131c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- 172.21.15.171:0/1312413855 shutdown_connections 2024-04-26T00:02:10.948 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- 172.21.15.171:0/1312413855 >> 172.21.15.171:0/1312413855 conn(0x7ff7280a67e0 msgr2=0x7ff7280a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- 172.21.15.171:0/1312413855 shutdown_connections 2024-04-26T00:02:10.949 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.962+0000 7ff72e98b640 1 -- 172.21.15.171:0/1312413855 wait complete. 2024-04-26T00:02:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: build_initial_monmap 2024-04-26T00:02:10.952 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: monmap: 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:10.953 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 Processor -- start 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 -- start start 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: init 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _add_conns ranks=[6,1,5,4,2,3,0,8,7] 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient(hunting): picked mon.noname-d con 0x7ff72809e7b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient(hunting): picked mon.noname-f con 0x7ff72809ebf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient(hunting): picked mon.noname-h con 0x7ff728131880 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff7281cd140 con 0x7ff72809ebf0 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff72809d4c0 con 0x7ff728131880 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff728072090 con 0x7ff72809e7b0 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:10.954 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient(hunting): authenticate will time out at 1381.673266s 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72cf28640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7ff728131880 0x7ff7281d4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:38734/0 (socket says 172.21.15.171:38734) 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff7277fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7ff72809ebf0 0x7ff7281d1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:33194/0 (socket says 172.21.15.171:33194) 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72cf28640 1 -- 172.21.15.171:0/390898094 learned_addr learned my addr 172.21.15.171:0/390898094 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3637809891 0 0) 0x7ff72809d4c0 con 0x7ff728131880 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): my global_id is 6890 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff714003530 con 0x7ff728131880 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 633502787 0 0) 0x7ff71c0039c0 con 0x7ff72809ebf0 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): my global_id is 145513 2024-04-26T00:02:10.955 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72809d4c0 con 0x7ff72809ebf0 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1535223122 0 0) 0x7ff714003530 con 0x7ff728131880 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff71c0039c0 con 0x7ff728131880 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 927606792 0 0) 0x7ff72809d4c0 con 0x7ff72809ebf0 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff714003530 con 0x7ff72809ebf0 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff720001da0 con 0x7ff728131880 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): dump: 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.956 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff71c0042f0 con 0x7ff72809ebf0 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): dump: 2024-04-26T00:02:10.957 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.958 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163494574 0 0) 0x7ff728072090 con 0x7ff72809e7b0 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient(hunting): my global_id is 7017 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff72809d4c0 con 0x7ff72809e7b0 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 896921309 0 0) 0x7ff714003530 con 0x7ff72809ebf0 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 >> v1:172.21.15.106:6792/0 conn(0x7ff72809e7b0 legacy=0x7ff728130b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 >> v1:172.21.15.171:6791/0 conn(0x7ff728131880 legacy=0x7ff7281d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 monclient: found mon.f 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff728122500 con 0x7ff72809ebf0 2024-04-26T00:02:10.959 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 5 monclient: authenticate success, global_id 145513 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _renew_subs 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff728121c60 con 0x7ff72809ebf0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _renew_subs 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff728120d70 con 0x7ff72809ebf0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff71c004550 con 0x7ff72809ebf0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff71c004a40 con 0x7ff72809ebf0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:10.960 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff7267fc640 4 set_mon_vals no callback set 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 10 monclient: dump: 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:10.961 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff71c004be0 con 0x7ff72809ebf0 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff708005090 con 0x7ff72809ebf0 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(250..250 src has 138..250) ==== 6817+0+0 (unknown 2927146609 0 0) 0x7ff71c0450c0 con 0x7ff72809ebf0 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.966+0000 7ff727fff640 10 monclient: get_auth_request con 0x7ff714037f30 auth_method 0 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.970+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff7281cd140 con 0x7ff72809ebf0 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.970+0000 7ff724ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:10.962 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:10.970+0000 7ff724ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:11.106 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.126+0000 7ff72e98b640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:11.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.126+0000 7ff72e98b640 10 monclient: _send_command 2 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:11.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.126+0000 7ff72e98b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:11.107 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.126+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd rm", "ids": ["12"]} v 0) -- 0x7ff708005380 con 0x7ff72809ebf0 2024-04-26T00:02:11.107 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:11.131+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e250 definitely_dead 0 2024-04-26T00:02:11.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.130+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["12"]}]=0 osd.12 does not exist. v250) ==== 92+0+0 (unknown 189017566 0 0) 0x7ff71c015690 con 0x7ff72809ebf0 2024-04-26T00:02:11.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.130+0000 7ff724ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:11.108 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.130+0000 7ff724ff9640 10 monclient: _finish_command 2 = system:0 osd.12 does not exist. 2024-04-26T00:02:11.204 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.226+0000 7ff72e98b640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:11.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.226+0000 7ff72e98b640 10 monclient: _send_command 3 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:11.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.226+0000 7ff72e98b640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:02:11.205 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.226+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "osd rm", "ids": ["12"]} v 0) -- 0x7ff708000bd0 con 0x7ff72809ebf0 2024-04-26T00:02:11.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:11.223+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e250 definitely_dead 0 2024-04-26T00:02:11.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.226+0000 7ff724ff9640 1 -- 172.21.15.171:0/390898094 <== mon.1 v1:172.21.15.171:6789/0 11 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["12"]}]=0 osd.12 does not exist. v250) ==== 92+0+0 (unknown 189017566 0 0) 0x7ff71c014f90 con 0x7ff72809ebf0 2024-04-26T00:02:11.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.226+0000 7ff724ff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd rm", "ids": ["12"]}] 2024-04-26T00:02:11.206 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.226+0000 7ff724ff9640 10 monclient: _finish_command 3 = system:0 osd.12 does not exist. 2024-04-26T00:02:11.206 INFO:tasks.workunit.client.0.smithi171.stderr:osd.12 does not exist. 2024-04-26T00:02:11.208 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 >> v1:172.21.15.171:6812/722422047 conn(0x7ff714037f30 legacy=0x7ff71403a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 10 monclient: shutdown 2024-04-26T00:02:11.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:11.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 >> v1:172.21.15.171:6789/0 conn(0x7ff72809ebf0 legacy=0x7ff7281d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 shutdown_connections 2024-04-26T00:02:11.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 >> 172.21.15.171:0/390898094 conn(0x7ff7280a67e0 msgr2=0x7ff7281bb5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:11.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 shutdown_connections 2024-04-26T00:02:11.209 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.230+0000 7ff72e98b640 1 -- 172.21.15.171:0/390898094 wait complete. 2024-04-26T00:02:11.221 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd rm 14 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.354+0000 7f4c82010640 10 monclient: get_monmap_and_config 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.354+0000 7f4c82010640 10 monclient: build_initial_monmap 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.354+0000 7f4c82010640 10 monclient: monmap: 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:11.358200+0000 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:11.358200+0000 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:11.335 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:11.336 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 Processor -- start 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- start start 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: init 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: _add_conns ranks=[4,5,7,3,0,1,8,2,6] 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient(hunting): picked mon.noname-c con 0x7f4c7c0a0340 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient(hunting): picked mon.noname-h con 0x7f4c7c09f780 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient(hunting): picked mon.noname-i con 0x7f4c7c13e5b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c09a090 con 0x7f4c7c0a0340 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c06bfe0 con 0x7f4c7c09f780 2024-04-26T00:02:11.342 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c0a0720 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient(hunting): authenticate will time out at 1382.065356s 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7affd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4c7c09f780 0x7f4c7c06b8d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:38736/0 (socket says 172.21.15.171:38736) 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7affd640 1 -- 172.21.15.171:0/2141477385 learned_addr learned my addr 172.21.15.171:0/2141477385 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 662650706 0 0) 0x7f4c7c06bfe0 con 0x7f4c7c09f780 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): my global_id is 6899 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c64003530 con 0x7f4c7c09f780 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1026951113 0 0) 0x7f4c7c0a0720 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:11.343 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient(hunting): my global_id is 145429 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c7c06bfe0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4006524055 0 0) 0x7f4c64003530 con 0x7f4c7c09f780 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 >> v1:172.21.15.171:6792/0 conn(0x7f4c7c13e5b0 legacy=0x7f4c7c1409a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 >> v1:172.21.15.106:6791/0 conn(0x7f4c7c0a0340 legacy=0x7f4c7c06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 monclient: found mon.noname-h 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c09ea30 con 0x7f4c7c09f780 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c700017c0 con 0x7f4c7c09f780 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:11.344 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: dump: 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.345 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 5 monclient: authenticate success, global_id 6899 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c70001a30 con 0x7f4c7c09f780 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 1 -- 172.21.15.171:0/2141477385 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c70004bf0 con 0x7f4c7c09f780 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 4 set_mon_vals no callback set 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c7a7fc640 10 monclient: dump: 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.346 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: shutdown 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:11.347 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- 172.21.15.171:0/2141477385 >> v1:172.21.15.171:6791/0 conn(0x7f4c7c09f780 legacy=0x7f4c7c06b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- 172.21.15.171:0/2141477385 shutdown_connections 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- 172.21.15.171:0/2141477385 >> 172.21.15.171:0/2141477385 conn(0x7f4c7c0a63e0 msgr2=0x7f4c7c0a67c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- 172.21.15.171:0/2141477385 shutdown_connections 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- 172.21.15.171:0/2141477385 wait complete. 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: build_initial_monmap 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: monmap: 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:11.348 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 Processor -- start 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 1 -- start start 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.358+0000 7f4c82010640 10 monclient: init 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _add_conns ranks=[3,4,5,7,1,0,6,2,8] 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient(hunting): picked mon.noname-g con 0x7f4c7c09f780 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient(hunting): picked mon.noname-c con 0x7f4c7c0a0340 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:11.349 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient(hunting): picked mon.noname-h con 0x7f4c7c13e5b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c098e60 con 0x7f4c7c09f780 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c072480 con 0x7f4c7c0a0340 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c7b7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f4c7c09f780 legacy=0x7f4c7c070360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c7c09dcb0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient(hunting): authenticate will time out at 1382.068383s 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c7bfff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f4c7c13e5b0 0x7f4c7c1d4ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:38752/0 (socket says 172.21.15.171:38752) 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c7bfff640 1 -- 172.21.15.171:0/2051043540 learned_addr learned my addr 172.21.15.171:0/2051043540 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 245525206 0 0) 0x7f4c7c09dcb0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): my global_id is 6908 2024-04-26T00:02:11.350 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c68003530 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3024035681 0 0) 0x7f4c68003530 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c7c09dcb0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c74001950 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): dump: 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.351 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 249270758 0 0) 0x7f4c7c072480 con 0x7f4c7c0a0340 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:11.352 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient(hunting): my global_id is 145489 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c68003530 con 0x7f4c7c0a0340 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2995156698 0 0) 0x7f4c7c09dcb0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 >> v1:172.21.15.106:6791/0 conn(0x7f4c7c0a0340 legacy=0x7f4c7c070a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 >> v1:172.21.15.171:6790/0 conn(0x7f4c7c09f780 legacy=0x7f4c7c070360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 monclient: found mon.h 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c7c071180 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: _finish_auth 0 2024-04-26T00:02:11.353 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 5 monclient: authenticate success, global_id 6908 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _renew_subs 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c7c090e10 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _renew_subs 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c7c090400 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4c74003950 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4c74003ec0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:11.354 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c79ffb640 4 set_mon_vals no callback set 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 10 monclient: dump: 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.355 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4c74004060 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c5c005090 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(250..250 src has 138..250) ==== 6817+0+0 (unknown 2927146609 0 0) 0x7f4c740451c0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.356 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.362+0000 7f4c7b7fe640 10 monclient: get_auth_request con 0x7f4c68037810 auth_method 0 2024-04-26T00:02:11.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.366+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f4c740157f0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.366+0000 7f4c63fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:11.357 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.366+0000 7f4c63fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:11.506 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.526+0000 7f4c82010640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["14"]}] 2024-04-26T00:02:11.506 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.526+0000 7f4c82010640 10 monclient: _send_command 2 [{"prefix": "osd rm", "ids": ["14"]}] 2024-04-26T00:02:11.506 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.526+0000 7f4c82010640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.506 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.526+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd rm", "ids": ["14"]} v 0) -- 0x7f4c5c005380 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:11.527+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e250 definitely_dead 0 2024-04-26T00:02:11.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.582+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["14"]}]=0 removed osd.14 v251) ==== 83+0+0 (unknown 3894252619 0 0) 0x7f4c740150f0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.582+0000 7f4c63fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd rm", "ids": ["14"]}] 2024-04-26T00:02:11.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.582+0000 7f4c63fff640 10 monclient: _finish_command 2 = system:0 removed osd.14 2024-04-26T00:02:11.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.702+0000 7f4c82010640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["14"]}] 2024-04-26T00:02:11.682 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.702+0000 7f4c82010640 10 monclient: _send_command 3 [{"prefix": "osd rm", "ids": ["14"]}] 2024-04-26T00:02:11.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.702+0000 7f4c82010640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.683 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.702+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "osd rm", "ids": ["14"]} v 0) -- 0x7f4c5c000c00 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:11.703+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e251 definitely_dead 0 2024-04-26T00:02:11.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c63fff640 1 -- 172.21.15.171:0/2051043540 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["14"]}]=0 osd.14 does not exist. v251) ==== 92+0+0 (unknown 1164467084 0 0) 0x7f4c7401dca0 con 0x7f4c7c13e5b0 2024-04-26T00:02:11.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c63fff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd rm", "ids": ["14"]}] 2024-04-26T00:02:11.684 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c63fff640 10 monclient: _finish_command 3 = system:0 osd.14 does not exist. 2024-04-26T00:02:11.684 INFO:tasks.workunit.client.0.smithi171.stderr:osd.14 does not exist. 2024-04-26T00:02:11.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 >> v1:172.21.15.171:6812/722422047 conn(0x7f4c68037810 legacy=0x7f4c68039cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 10 monclient: shutdown 2024-04-26T00:02:11.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:11.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 >> v1:172.21.15.171:6791/0 conn(0x7f4c7c13e5b0 legacy=0x7f4c7c1d4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.686 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 shutdown_connections 2024-04-26T00:02:11.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 >> 172.21.15.171:0/2051043540 conn(0x7f4c7c0a63e0 msgr2=0x7f4c7c1389c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:11.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 shutdown_connections 2024-04-26T00:02:11.687 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.706+0000 7f4c82010640 1 -- 172.21.15.171:0/2051043540 wait complete. 2024-04-26T00:02:11.701 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd rm 1000 2024-04-26T00:02:11.815 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.834+0000 7f63b65ff640 10 monclient: get_monmap_and_config 2024-04-26T00:02:11.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.834+0000 7f63b65ff640 10 monclient: build_initial_monmap 2024-04-26T00:02:11.816 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.834+0000 7f63b65ff640 10 monclient: monmap: 2024-04-26T00:02:11.816 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:11.816 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.816 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:11.838348+0000 2024-04-26T00:02:11.816 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:11.838348+0000 2024-04-26T00:02:11.817 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:11.817 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.817 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:11.817 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:11.817 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:11.817 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:11.818 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:11.818 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:11.818 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:11.818 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:11.818 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:11.818 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 Processor -- start 2024-04-26T00:02:11.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- start start 2024-04-26T00:02:11.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient: init 2024-04-26T00:02:11.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:11.824 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient: _add_conns ranks=[5,3,6,1,4,8,2,0,7] 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient(hunting): picked mon.noname-h con 0x7f63b00a2720 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient(hunting): picked mon.noname-g con 0x7f63b0134890 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient(hunting): picked mon.noname-d con 0x7f63b0134c70 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b0070f70 con 0x7f63b0134890 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b00709b0 con 0x7f63b00a2720 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b0070c90 con 0x7f63b0134c70 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63af7fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f63b0134890 legacy=0x7f63b0139430 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient(hunting): authenticate will time out at 1382.545709s 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63affff640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f63b00a2720 0x7f63b0134180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:38754/0 (socket says 172.21.15.171:38754) 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63affff640 1 -- 172.21.15.171:0/4240983594 learned_addr learned my addr 172.21.15.171:0/4240983594 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354334623 0 0) 0x7f63b00709b0 con 0x7f63b00a2720 2024-04-26T00:02:11.825 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient(hunting): my global_id is 6917 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6398004640 con 0x7f63b00a2720 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3740886689 0 0) 0x7f6398004640 con 0x7f63b00a2720 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 >> v1:172.21.15.106:6792/0 conn(0x7f63b0134c70 legacy=0x7f63b013cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 >> v1:172.21.15.171:6790/0 conn(0x7f63b0134890 legacy=0x7f63b0139430 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 monclient: found mon.noname-h 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b00a3b10 con 0x7f63b00a2720 2024-04-26T00:02:11.826 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: _finish_auth 0 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a00017c0 con 0x7f63b00a2720 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: dump: 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.827 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 5 monclient: authenticate success, global_id 6917 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63a0001ab0 con 0x7f63b00a2720 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 1 -- 172.21.15.171:0/4240983594 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a0004bf0 con 0x7f63b00a2720 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:11.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63aeffd640 10 monclient: dump: 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.829 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 4 set_mon_vals no callback set 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 10 monclient: shutdown 2024-04-26T00:02:11.830 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:11.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- 172.21.15.171:0/4240983594 >> v1:172.21.15.171:6791/0 conn(0x7f63b00a2720 legacy=0x7f63b0134180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- 172.21.15.171:0/4240983594 shutdown_connections 2024-04-26T00:02:11.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- 172.21.15.171:0/4240983594 >> 172.21.15.171:0/4240983594 conn(0x7f63b006b5c0 msgr2=0x7f63b006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:11.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- 172.21.15.171:0/4240983594 shutdown_connections 2024-04-26T00:02:11.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.838+0000 7f63b65ff640 1 -- 172.21.15.171:0/4240983594 wait complete. 2024-04-26T00:02:11.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: build_initial_monmap 2024-04-26T00:02:11.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: monmap: 2024-04-26T00:02:11.832 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:11.832 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:11.832 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:11.832 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:11.832 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:11.832 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.833 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:11.833 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:11.833 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:11.833 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:11.833 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:11.833 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:11.833 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:11.834 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:11.834 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:11.834 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 Processor -- start 2024-04-26T00:02:11.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 -- start start 2024-04-26T00:02:11.834 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: init 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _add_conns ranks=[6,0,3,8,1,4,2,5,7] 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient(hunting): picked mon.noname-d con 0x7f63b00a2720 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient(hunting): picked mon.noname-a con 0x7f63b0134890 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient(hunting): picked mon.noname-g con 0x7f63b0134c70 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b01226e0 con 0x7f63b0134890 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b01222c0 con 0x7f63b0134c70 2024-04-26T00:02:11.835 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b4b9c640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f63b0134c70 legacy=0x7f63b01d0b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f63b0135200 con 0x7f63b00a2720 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient(hunting): authenticate will time out at 1382.549290s 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63affff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f63b00a2720 0x7f63b01c8490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:42806/0 (socket says 172.21.15.171:42806) 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63affff640 1 -- 172.21.15.171:0/631798541 learned_addr learned my addr 172.21.15.171:0/631798541 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63af7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f63b0134890 0x7f63b01cd440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:39420/0 (socket says 172.21.15.171:39420) 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492805596 0 0) 0x7f63a4003a50 con 0x7f63b0134890 2024-04-26T00:02:11.836 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:11.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:11.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:11.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): my global_id is 7101 2024-04-26T00:02:11.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f639c003530 con 0x7f63b0134890 2024-04-26T00:02:11.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269416821 0 0) 0x7f63b0135200 con 0x7f63b00a2720 2024-04-26T00:02:11.837 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:11.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:11.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:11.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): my global_id is 7035 2024-04-26T00:02:11.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f63a4003a50 con 0x7f63b00a2720 2024-04-26T00:02:11.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1284713885 0 0) 0x7f639c003530 con 0x7f63b0134890 2024-04-26T00:02:11.838 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f63b0135200 con 0x7f63b0134890 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a4004440 con 0x7f63b0134890 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): dump: 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.839 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:11.840 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3068654239 0 0) 0x7f63a4003a50 con 0x7f63b00a2720 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f639c003530 con 0x7f63b00a2720 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a0001780 con 0x7f63b00a2720 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient(hunting): dump: 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.841 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2370583408 0 0) 0x7f63b0135200 con 0x7f63b0134890 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 >> v1:172.21.15.106:6792/0 conn(0x7f63b00a2720 legacy=0x7f63b01c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 >> v1:172.21.15.171:6790/0 conn(0x7f63b0134c70 legacy=0x7f63b01d0b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 monclient: found mon.a 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:11.842 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63b0121fe0 con 0x7f63b0134890 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 5 monclient: authenticate success, global_id 7101 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _renew_subs 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f63b0120430 con 0x7f63b0134890 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _renew_subs 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f63b011f3a0 con 0x7f63b0134890 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f63a40046f0 con 0x7f63b0134890 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63ae7fc640 4 set_mon_vals no callback set 2024-04-26T00:02:11.843 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f63a4004c60 con 0x7f63b0134890 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63acff9640 10 monclient: dump: 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:11.844 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.842+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6390005090 con 0x7f63b0134890 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.846+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f63a4004e80 con 0x7f63b0134890 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.846+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(251..251 src has 138..251) ==== 6817+0+0 (unknown 1981499577 0 0) 0x7f63a4045300 con 0x7f63b0134890 2024-04-26T00:02:11.845 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.846+0000 7f63affff640 10 monclient: get_auth_request con 0x7f639c037e00 auth_method 0 2024-04-26T00:02:11.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.858+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f63b01226e0 con 0x7f63b0134890 2024-04-26T00:02:11.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.858+0000 7f63acff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:11.846 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:11.858+0000 7f63acff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:11.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.014+0000 7f63b65ff640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["1000"]}] 2024-04-26T00:02:11.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.014+0000 7f63b65ff640 10 monclient: _send_command 2 [{"prefix": "osd rm", "ids": ["1000"]}] 2024-04-26T00:02:11.992 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.014+0000 7f63b65ff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:11.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.014+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd rm", "ids": ["1000"]} v 0) -- 0x7f6390005380 con 0x7f63b0134890 2024-04-26T00:02:11.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:12.015+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e251 definitely_dead 0 2024-04-26T00:02:11.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.014+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["1000"]}]=0 osd.1000 does not exist. v251) ==== 96+0+0 (unknown 1707474571 0 0) 0x7f63a40158d0 con 0x7f63b0134890 2024-04-26T00:02:11.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.014+0000 7f63acff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd rm", "ids": ["1000"]}] 2024-04-26T00:02:11.993 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.014+0000 7f63acff9640 10 monclient: _finish_command 2 = system:0 osd.1000 does not exist. 2024-04-26T00:02:12.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 10 start_mon_command cmd=[{"prefix": "osd rm", "ids": ["1000"]}] 2024-04-26T00:02:12.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 10 monclient: _send_command 3 [{"prefix": "osd rm", "ids": ["1000"]}] 2024-04-26T00:02:12.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:12.096 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd rm", "ids": ["1000"]} v 0) -- 0x7f6390005b90 con 0x7f63b0134890 2024-04-26T00:02:12.097 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:12.119+0000 7f5cf9f98640 -1 mon.a@0(leader).osd e251 definitely_dead 0 2024-04-26T00:02:12.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63acff9640 1 -- 172.21.15.171:0/631798541 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd rm", "ids": ["1000"]}]=0 osd.1000 does not exist. v251) ==== 96+0+0 (unknown 1707474571 0 0) 0x7f63a40151d0 con 0x7f63b0134890 2024-04-26T00:02:12.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63acff9640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd rm", "ids": ["1000"]}] 2024-04-26T00:02:12.097 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63acff9640 10 monclient: _finish_command 3 = system:0 osd.1000 does not exist. 2024-04-26T00:02:12.097 INFO:tasks.workunit.client.0.smithi171.stderr:osd.1000 does not exist. 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 >> v1:172.21.15.171:6812/722422047 conn(0x7f639c037e00 legacy=0x7f639c03a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 10 monclient: shutdown 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 >> v1:172.21.15.106:6789/0 conn(0x7f63b0134890 legacy=0x7f63b01cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 shutdown_connections 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 >> 172.21.15.171:0/631798541 conn(0x7f63b006b5c0 msgr2=0x7f63b0133780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 shutdown_connections 2024-04-26T00:02:12.099 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.118+0000 7f63b65ff640 1 -- 172.21.15.171:0/631798541 wait complete. 2024-04-26T00:02:12.113 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph osd create aa68e4d6-7b8f-4a5a-8b0b-22213bea2028 2024-04-26T00:02:12.228 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient: get_monmap_and_config 2024-04-26T00:02:12.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient: build_initial_monmap 2024-04-26T00:02:12.229 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient: monmap: 2024-04-26T00:02:12.229 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:12.229 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:12.229 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:12.251675+0000 2024-04-26T00:02:12.229 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:12.251675+0000 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:12.230 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:12.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 1 Processor -- start 2024-04-26T00:02:12.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 1 -- start start 2024-04-26T00:02:12.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient: init 2024-04-26T00:02:12.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:12.239 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient: _add_conns ranks=[4,0,7,1,2,5,8,6,3] 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient(hunting): picked mon.noname-c con 0x7f05400a01e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient(hunting): picked mon.noname-a con 0x7f05400a05c0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient(hunting): picked mon.noname-i con 0x7f05400a09e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054009aa60 con 0x7f05400a05c0 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05400a3ba0 con 0x7f05400a01e0 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05400a3e80 con 0x7f05400a09e0 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f0544ff1640 10 monclient(hunting): authenticate will time out at 1382.959521s 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f053ed9d640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f05400a09e0 0x7f054013e0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:44160/0 (socket says 172.21.15.171:44160) 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f053ed9d640 1 -- 172.21.15.171:0/2598569823 learned_addr learned my addr 172.21.15.171:0/2598569823 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.250+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439451579 0 0) 0x7f05400a3e80 con 0x7f05400a09e0 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:02:12.240 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient(hunting): my global_id is 145438 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0528003530 con 0x7f05400a09e0 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3722230375 0 0) 0x7f0528003530 con 0x7f05400a09e0 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 >> v1:172.21.15.106:6791/0 conn(0x7f05400a01e0 legacy=0x7f0540132540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 >> v1:172.21.15.106:6789/0 conn(0x7f05400a05c0 legacy=0x7f054013a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: _finish_hunting 0 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 monclient: found mon.noname-i 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0540075630 con 0x7f05400a09e0 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: _finish_auth 0 2024-04-26T00:02:12.241 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: _check_auth_tickets 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0538001b40 con 0x7f05400a09e0 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: dump: 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:12.242 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 5 monclient: authenticate success, global_id 145438 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0538001ea0 con 0x7f05400a09e0 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 1 -- 172.21.15.171:0/2598569823 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f05380020d0 con 0x7f05400a09e0 2024-04-26T00:02:12.243 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053d59a640 10 monclient: dump: 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:12.244 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 4 set_mon_vals no callback set 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient: shutdown 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- 172.21.15.171:0/2598569823 >> v1:172.21.15.171:6792/0 conn(0x7f05400a09e0 legacy=0x7f054013e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- 172.21.15.171:0/2598569823 shutdown_connections 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- 172.21.15.171:0/2598569823 >> 172.21.15.171:0/2598569823 conn(0x7f054006b5c0 msgr2=0x7f054006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- 172.21.15.171:0/2598569823 shutdown_connections 2024-04-26T00:02:12.245 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- 172.21.15.171:0/2598569823 wait complete. 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient: build_initial_monmap 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient: monmap: 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:12.246 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 Processor -- start 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- start start 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient: init 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:12.247 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient: _add_conns ranks=[4,3,0,5,2,7,8,6,1] 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient(hunting): picked mon.noname-c con 0x7f05400a01e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient(hunting): picked mon.noname-g con 0x7f05400a05c0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient(hunting): picked mon.noname-a con 0x7f05400a09e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054012f9d0 con 0x7f05400a09e0 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f05400a3070 con 0x7f05400a05c0 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f054009ffb0 con 0x7f05400a01e0 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053dd9b640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f05400a05c0 legacy=0x7f05401cfb00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f0544ff1640 10 monclient(hunting): authenticate will time out at 1382.962596s 2024-04-26T00:02:12.248 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053ed9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f05400a09e0 0x7f05401d3230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:39436/0 (socket says 172.21.15.171:39436) 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f053ed9d640 1 -- 172.21.15.171:0/187667527 learned_addr learned my addr 172.21.15.171:0/187667527 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311096388 0 0) 0x7f054009ffb0 con 0x7f05400a01e0 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): my global_id is 145507 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0520003530 con 0x7f05400a01e0 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282491719 0 0) 0x7f054012f9d0 con 0x7f05400a09e0 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): my global_id is 7119 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f054009ffb0 con 0x7f05400a09e0 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3455845968 0 0) 0x7f054009ffb0 con 0x7f05400a09e0 2024-04-26T00:02:12.249 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f054012f9d0 con 0x7f05400a09e0 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 678177930 0 0) 0x7f0520003530 con 0x7f05400a01e0 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f054009ffb0 con 0x7f05400a01e0 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0538001b00 con 0x7f05400a09e0 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): dump: 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.250 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:12.251 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0530001a20 con 0x7f05400a01e0 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.254+0000 7f052effd640 10 monclient(hunting): dump: 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:12.252 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2846839689 0 0) 0x7f054012f9d0 con 0x7f05400a09e0 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 >> v1:172.21.15.106:6791/0 conn(0x7f05400a01e0 legacy=0x7f05401caab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 >> v1:172.21.15.171:6790/0 conn(0x7f05400a05c0 legacy=0x7f05401cfb00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 monclient: found mon.a 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05401315b0 con 0x7f05400a09e0 2024-04-26T00:02:12.253 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: _finish_auth 0 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 5 monclient: authenticate success, global_id 7119 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 10 monclient: _renew_subs 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0540131890 con 0x7f05400a09e0 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 10 monclient: _renew_subs 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0540131e80 con 0x7f05400a09e0 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0538001ea0 con 0x7f05400a09e0 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f053cd99640 4 set_mon_vals no callback set 2024-04-26T00:02:12.254 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f05380052f0 con 0x7f05400a09e0 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 10 monclient: dump: 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:12.255 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0524005090 con 0x7f05400a09e0 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0538010110 con 0x7f05400a09e0 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(251..251 src has 138..251) ==== 6817+0+0 (unknown 1981499577 0 0) 0x7f05380453a0 con 0x7f05400a09e0 2024-04-26T00:02:12.256 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.258+0000 7f053e59c640 10 monclient: get_auth_request con 0x7f0520037d50 auth_method 0 2024-04-26T00:02:12.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.270+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f053801de80 con 0x7f05400a09e0 2024-04-26T00:02:12.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.270+0000 7f052effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:12.257 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.270+0000 7f052effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:12.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.446+0000 7f0544ff1640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:12.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.446+0000 7f0544ff1640 10 monclient: _send_command 2 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:12.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.446+0000 7f0544ff1640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:12.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.446+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"} v 0) -- 0x7f0524005380 con 0x7f05400a09e0 2024-04-26T00:02:12.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.738+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}]=0 v252) ==== 106+0+3 (unknown 892238649 0 944643765) 0x7f05380405c0 con 0x7f05400a09e0 2024-04-26T00:02:12.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.738+0000 7f052effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:12.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.738+0000 7f052effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:12.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 10 start_mon_command cmd=[{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:12.827 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 10 monclient: _send_command 3 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:12.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:12.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"} v 0) -- 0x7f05240010a0 con 0x7f05400a09e0 2024-04-26T00:02:12.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f052effd640 1 -- 172.21.15.171:0/187667527 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}]=0 v252) ==== 106+0+3 (unknown 892238649 0 944643765) 0x7f0538040c40 con 0x7f05400a09e0 2024-04-26T00:02:12.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f052effd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "osd create", "uuid": "aa68e4d6-7b8f-4a5a-8b0b-22213bea2028"}] 2024-04-26T00:02:12.828 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f052effd640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 >> v1:172.21.15.171:6812/722422047 conn(0x7f0520037d50 legacy=0x7f052003a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 10 monclient: shutdown 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 >> v1:172.21.15.106:6789/0 conn(0x7f05400a09e0 legacy=0x7f05401d3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 shutdown_connections 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 >> 172.21.15.171:0/187667527 conn(0x7f054006b5c0 msgr2=0x7f05400712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 shutdown_connections 2024-04-26T00:02:12.831 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:12.850+0000 7f0544ff1640 1 -- 172.21.15.171:0/187667527 wait complete. 2024-04-26T00:02:12.845 INFO:tasks.workunit.client.0.smithi171.stderr:+ na2=12 2024-04-26T00:02:12.845 INFO:tasks.workunit.client.0.smithi171.stdout:OK 2024-04-26T00:02:12.846 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo OK 2024-04-26T00:02:12.847 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T00:02:12.847 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T00:02:12.903 INFO:tasks.workunit:Running workunits matching mon/caps.sh on client.0... 2024-04-26T00:02:12.905 INFO:tasks.workunit:Running workunit mon/caps.sh... 2024-04-26T00:02:12.905 DEBUG:teuthology.orchestra.run.smithi171:workunit test mon/caps.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b22e2ebdeb24376882b7bda2a7329c8cccc2276a TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh 2024-04-26T00:02:12.956 INFO:tasks.workunit.client.0.smithi171.stderr:+ tmp=/tmp/cephtest-mon-caps-madness 2024-04-26T00:02:12.956 INFO:tasks.workunit.client.0.smithi171.stderr:+ exit_on_error=1 2024-04-26T00:02:12.956 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ ! -z '' ]] 2024-04-26T00:02:12.957 INFO:tasks.workunit.client.0.smithi171.stderr:++ uname 2024-04-26T00:02:12.957 INFO:tasks.workunit.client.0.smithi171.stderr:+ '[' Linux = FreeBSD ']' 2024-04-26T00:02:12.957 INFO:tasks.workunit.client.0.smithi171.stderr:+ ETIMEDOUT=110 2024-04-26T00:02:12.957 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph auth get-or-create client.bazar > /tmp/cephtest-mon-caps-madness.bazar.keyring' 0 2024-04-26T00:02:12.958 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph auth get-or-create client.bazar > /tmp/cephtest-mon-caps-madness.bazar.keyring' 2024-04-26T00:02:12.958 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=0 2024-04-26T00:02:12.958 INFO:tasks.workunit.client.0.smithi171.stdout:ceph auth get-or-create client.bazar > /tmp/cephtest-mon-caps-madness.bazar.keyring 2024-04-26T00:02:12.958 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph auth get-or-create client.bazar '>' /tmp/cephtest-mon-caps-madness.bazar.keyring 2024-04-26T00:02:12.958 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph auth get-or-create client.bazar '>' /tmp/cephtest-mon-caps-madness.bazar.keyring 2024-04-26T00:02:13.482 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=0 2024-04-26T00:02:13.482 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 0 -ne 0 ]] 2024-04-26T00:02:13.482 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:13.482 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bazar.keyring --user bazar quorum_status' 13 2024-04-26T00:02:13.482 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bazar.keyring --user bazar quorum_status 2024-04-26T00:02:13.483 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bazar.keyring --user bazar quorum_status' 2024-04-26T00:02:13.483 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:02:13.483 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bazar.keyring --user bazar quorum_status 2024-04-26T00:02:13.483 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bazar.keyring --user bazar quorum_status 2024-04-26T00:02:13.598 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:02:13.599 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:02:13.599 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:13.599 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph auth del client.bazar 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.726+0000 7f002ed7c640 10 monclient: get_monmap_and_config 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.726+0000 7f002ed7c640 10 monclient: build_initial_monmap 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.726+0000 7f002ed7c640 10 monclient: monmap: 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:02:13.730350+0000 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:02:13.730350+0000 2024-04-26T00:02:13.707 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:13.708 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:13.714 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 Processor -- start 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- start start 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: init 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: _add_conns ranks=[7,3,6,4,8,0,5,1,2] 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient(hunting): picked mon.noname-i con 0x7f0028132a30 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient(hunting): picked mon.noname-g con 0x7f00280727b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient(hunting): picked mon.noname-d con 0x7f0028132e10 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0028136400 con 0x7f00280727b0 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002809fa80 con 0x7f0028132e10 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002809b890 con 0x7f0028132a30 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient(hunting): authenticate will time out at 1384.437287s 2024-04-26T00:02:13.715 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f0027fff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f00280727b0 legacy=0x7f0028135cf0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002cb18640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f0028132a30 0x7f00281355e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:44172/0 (socket says 172.21.15.171:44172) 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002cb18640 1 -- 172.21.15.171:0/1849082156 learned_addr learned my addr 172.21.15.171:0/1849082156 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540486028 0 0) 0x7f002809b890 con 0x7f0028132a30 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient(hunting): my global_id is 145447 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0010003530 con 0x7f0028132a30 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3233028944 0 0) 0x7f0010003530 con 0x7f0028132a30 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 >> v1:172.21.15.106:6792/0 conn(0x7f0028132e10 legacy=0x7f002813e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 >> v1:172.21.15.171:6790/0 conn(0x7f00280727b0 legacy=0x7f0028135cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 monclient: found mon.noname-i 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:13.716 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00280a3500 con 0x7f0028132a30 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f001c0017c0 con 0x7f0028132a30 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: dump: 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:13.717 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 5 monclient: authenticate success, global_id 145447 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f001c001b20 con 0x7f0028132a30 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:13.718 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 1 -- 172.21.15.171:0/1849082156 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f001c001d50 con 0x7f0028132a30 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f00277fe640 10 monclient: dump: 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:13.719 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 4 set_mon_vals no callback set 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: shutdown 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- 172.21.15.171:0/1849082156 >> v1:172.21.15.171:6792/0 conn(0x7f0028132a30 legacy=0x7f00281355e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- 172.21.15.171:0/1849082156 shutdown_connections 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- 172.21.15.171:0/1849082156 >> 172.21.15.171:0/1849082156 conn(0x7f00280a67e0 msgr2=0x7f00280a2790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- 172.21.15.171:0/1849082156 shutdown_connections 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- 172.21.15.171:0/1849082156 wait complete. 2024-04-26T00:02:13.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: build_initial_monmap 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: monmap: 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:13.721 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 Processor -- start 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 1 -- start start 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: init 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.730+0000 7f002ed7c640 10 monclient: _add_conns ranks=[5,1,6,7,0,4,3,2,8] 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient(hunting): picked mon.noname-h con 0x7f00280727b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient(hunting): picked mon.noname-f con 0x7f0028132a30 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient(hunting): picked mon.noname-d con 0x7f0028132e10 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0028072c10 con 0x7f0028132a30 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0028072480 con 0x7f00280727b0 2024-04-26T00:02:13.722 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f002811f3b0 con 0x7f0028132e10 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient(hunting): authenticate will time out at 1384.440078s 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002cb18640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f00280727b0 0x7f00281319d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:38788/0 (socket says 172.21.15.171:38788) 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002cb18640 1 -- 172.21.15.171:0/1965778313 learned_addr learned my addr 172.21.15.171:0/1965778313 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526718398 0 0) 0x7f0028072480 con 0x7f00280727b0 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): my global_id is 6944 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0014003530 con 0x7f00280727b0 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 187777281 0 0) 0x7f0028072c10 con 0x7f0028132a30 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:13.723 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): my global_id is 145531 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0028072480 con 0x7f0028132a30 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1270577598 0 0) 0x7f0014003530 con 0x7f00280727b0 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0028072c10 con 0x7f00280727b0 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1824382953 0 0) 0x7f0028072480 con 0x7f0028132a30 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0014003530 con 0x7f0028132a30 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f001c001780 con 0x7f00280727b0 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): dump: 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.724 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0018004540 con 0x7f0028132a30 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:13.725 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): dump: 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:13.726 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:13.727 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:13.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 256294183 0 0) 0x7f002811f3b0 con 0x7f0028132e10 2024-04-26T00:02:13.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:13.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:13.727 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient(hunting): my global_id is 7071 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0028072480 con 0x7f0028132e10 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2947630575 0 0) 0x7f0028072c10 con 0x7f00280727b0 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 >> v1:172.21.15.106:6792/0 conn(0x7f0028132e10 legacy=0x7f00281d2c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 >> v1:172.21.15.171:6789/0 conn(0x7f0028132a30 legacy=0x7f00281cf4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 monclient: found mon.h 2024-04-26T00:02:13.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:13.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:13.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f002811eb10 con 0x7f00280727b0 2024-04-26T00:02:13.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:13.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:13.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:13.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 5 monclient: authenticate success, global_id 6944 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient: _renew_subs 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f002811dee0 con 0x7f00280727b0 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient: _renew_subs 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f00281320e0 con 0x7f00280727b0 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f001c001b20 con 0x7f00280727b0 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f001c001050 con 0x7f00280727b0 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f0026ffd640 4 set_mon_vals no callback set 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 10 monclient: dump: 2024-04-26T00:02:13.730 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:13.731 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f001c00ff50 con 0x7f00280727b0 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0008005090 con 0x7f00280727b0 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(252..252 src has 138..252) ==== 6817+0+0 (unknown 1961385251 0 0) 0x7f001c045300 con 0x7f00280727b0 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.734+0000 7f0027fff640 10 monclient: get_auth_request con 0x7f0014037e70 auth_method 0 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.738+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f001c019520 con 0x7f00280727b0 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.738+0000 7f00257fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:13.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.738+0000 7f00257fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:13.924 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.946+0000 7f002ed7c640 10 start_mon_command cmd=[{"prefix": "auth del", "entity": "client.bazar"}] 2024-04-26T00:02:13.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.946+0000 7f002ed7c640 10 monclient: _send_command 2 [{"prefix": "auth del", "entity": "client.bazar"}] 2024-04-26T00:02:13.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.946+0000 7f002ed7c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:13.925 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.946+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "auth del", "entity": "client.bazar"} v 0) -- 0x7f0008005380 con 0x7f00280727b0 2024-04-26T00:02:13.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.954+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bazar"}]=0 v24) ==== 82+0+0 (unknown 3126103877 0 0) 0x7f001c01dde0 con 0x7f00280727b0 2024-04-26T00:02:13.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.954+0000 7f00257fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "auth del", "entity": "client.bazar"}] 2024-04-26T00:02:13.933 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:13.954+0000 7f00257fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:14.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.094+0000 7f002ed7c640 10 start_mon_command cmd=[{"prefix": "auth del", "entity": "client.bazar"}] 2024-04-26T00:02:14.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.094+0000 7f002ed7c640 10 monclient: _send_command 3 [{"prefix": "auth del", "entity": "client.bazar"}] 2024-04-26T00:02:14.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.094+0000 7f002ed7c640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:02:14.075 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.094+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "auth del", "entity": "client.bazar"} v 0) -- 0x7f0008002220 con 0x7f00280727b0 2024-04-26T00:02:14.076 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f00257fa640 1 -- 172.21.15.171:0/1965778313 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bazar"}]=0 v24) ==== 82+0+0 (unknown 3126103877 0 0) 0x7f001c013610 con 0x7f00280727b0 2024-04-26T00:02:14.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f00257fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "auth del", "entity": "client.bazar"}] 2024-04-26T00:02:14.077 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f00257fa640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:02:14.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 >> v1:172.21.15.171:6812/722422047 conn(0x7f0014037e70 legacy=0x7f001403a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:14.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 10 monclient: shutdown 2024-04-26T00:02:14.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:14.079 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 >> v1:172.21.15.171:6791/0 conn(0x7f00280727b0 legacy=0x7f00281319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:14.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 shutdown_connections 2024-04-26T00:02:14.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 >> 172.21.15.171:0/1965778313 conn(0x7f00280a67e0 msgr2=0x7f00281bd810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:14.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 shutdown_connections 2024-04-26T00:02:14.080 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:02:14.098+0000 7f002ed7c640 1 -- 172.21.15.171:0/1965778313 wait complete. 2024-04-26T00:02:14.091 INFO:tasks.workunit.client.0.smithi171.stderr:+ c=''\''allow command "auth ls", allow command quorum_status'\''' 2024-04-26T00:02:14.092 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph auth get-or-create client.foo mon '\''allow command "auth ls", allow command quorum_status'\'' > /tmp/cephtest-mon-caps-madness.foo.keyring' 0 2024-04-26T00:02:14.092 INFO:tasks.workunit.client.0.smithi171.stdout:ceph auth get-or-create client.foo mon 'allow command "auth ls", allow command quorum_status' > /tmp/cephtest-mon-caps-madness.foo.keyring 2024-04-26T00:02:14.092 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph auth get-or-create client.foo mon '\''allow command "auth ls", allow command quorum_status'\'' > /tmp/cephtest-mon-caps-madness.foo.keyring' 2024-04-26T00:02:14.092 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=0 2024-04-26T00:02:14.092 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph auth get-or-create client.foo mon ''\''allow' command '"auth' 'ls",' allow command 'quorum_status'\''' '>' /tmp/cephtest-mon-caps-madness.foo.keyring 2024-04-26T00:02:14.093 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph auth get-or-create client.foo mon ''\''allow' command '"auth' 'ls",' allow command 'quorum_status'\''' '>' /tmp/cephtest-mon-caps-madness.foo.keyring 2024-04-26T00:02:14.603 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=0 2024-04-26T00:02:14.603 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 0 -ne 0 ]] 2024-04-26T00:02:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status' 0 2024-04-26T00:02:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status' 2024-04-26T00:02:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=0 2024-04-26T00:02:14.604 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status 2024-04-26T00:02:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status 2024-04-26T00:02:14.604 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status 2024-04-26T00:02:15.103 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=0 2024-04-26T00:02:15.103 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 0 -ne 0 ]] 2024-04-26T00:02:15.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:15.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth ls' 0 2024-04-26T00:02:15.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth ls' 2024-04-26T00:02:15.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=0 2024-04-26T00:02:15.104 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth ls 2024-04-26T00:02:15.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth ls 2024-04-26T00:02:15.104 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth ls 2024-04-26T00:02:15.579 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=0 2024-04-26T00:02:15.580 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 0 -ne 0 ]] 2024-04-26T00:02:15.580 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:15.580 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth export' 13 2024-04-26T00:02:15.580 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth export' 2024-04-26T00:02:15.580 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:02:15.580 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth export 2024-04-26T00:02:15.580 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth export 2024-04-26T00:02:15.581 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth export 2024-04-26T00:02:15.923 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:02:15.923 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:02:15.923 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:15.923 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth del client.bazar' 13 2024-04-26T00:02:15.923 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth del client.bazar 2024-04-26T00:02:15.924 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth del client.bazar' 2024-04-26T00:02:15.924 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:02:15.924 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth del client.bazar 2024-04-26T00:02:15.924 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo auth del client.bazar 2024-04-26T00:02:16.273 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:02:16.273 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:02:16.274 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:16.274 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo osd dump' 13 2024-04-26T00:02:16.274 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo osd dump' 2024-04-26T00:02:16.274 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:02:16.274 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo osd dump 2024-04-26T00:02:16.274 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo osd dump 2024-04-26T00:02:16.274 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo osd dump 2024-04-26T00:02:16.550 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:02:16.551 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:02:16.551 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:02:16.551 INFO:tasks.workunit.client.0.smithi171.stderr:+ export CEPH_ARGS=--rados-mon-op-timeout=300 2024-04-26T00:02:16.551 INFO:tasks.workunit.client.0.smithi171.stderr:+ CEPH_ARGS=--rados-mon-op-timeout=300 2024-04-26T00:02:16.551 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo pg dump' 110 2024-04-26T00:02:16.551 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo pg dump' 2024-04-26T00:02:16.552 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=110 2024-04-26T00:02:16.552 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo pg dump 2024-04-26T00:02:16.552 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo pg dump 2024-04-26T00:02:16.553 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo pg dump 2024-04-26T00:02:49.464 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-04-26T00:02:49.465 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-04-26T00:02:49.465 INFO:tasks.ceph.mon.g:Restarting daemon 2024-04-26T00:02:49.465 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-04-26T00:02:49.469 INFO:tasks.ceph.mon.g:Started 2024-04-26T00:02:49.469 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:02:49.470 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:02:49.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient: get_monmap_and_config 2024-04-26T00:02:49.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient: build_initial_monmap 2024-04-26T00:02:49.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient: monmap: 2024-04-26T00:02:49.599 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:49.623669+0000 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:49.623669+0000 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:49.600 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:49.601 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:49.601 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 1 Processor -- start 2024-04-26T00:02:49.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 1 -- start start 2024-04-26T00:02:49.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient: init 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient: _add_conns ranks=[8,1,6,4,5,3,7,2,0] 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient(hunting): picked mon.noname-e con 0x7fdc34134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient(hunting): picked mon.noname-f con 0x7fdc340725d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient(hunting): picked mon.noname-d con 0x7fdc3413ace0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc34071270 con 0x7fdc340725d0 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc340714e0 con 0x7fdc3413ace0 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc340729f0 con 0x7fdc34134820 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc3bee9640 10 monclient(hunting): authenticate will time out at 1425.151352s 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc39c85640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fdc34134820 0x7fdc34134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:39066/0 (socket says 172.21.15.106:39066) 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc39c85640 1 -- 172.21.15.106:0/253211754 learned_addr learned my addr 172.21.15.106:0/253211754 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 735658817 0 0) 0x7fdc2c0014a0 con 0x7fdc3413ace0 2024-04-26T00:02:49.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _negotiate 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): my global_id is 7107 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc20003530 con 0x7fdc3413ace0 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2172543383 0 0) 0x7fdc340729f0 con 0x7fdc34134820 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _negotiate 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): my global_id is 204659 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc2c0014a0 con 0x7fdc34134820 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616159397 0 0) 0x7fdc34071270 con 0x7fdc340725d0 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _negotiate 2024-04-26T00:02:49.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 10 monclient(hunting): my global_id is 145603 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.618+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc340729f0 con 0x7fdc340725d0 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1579085375 0 0) 0x7fdc20003530 con 0x7fdc3413ace0 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 >> v1:172.21.15.106:6793/0 conn(0x7fdc34134820 legacy=0x7fdc34134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 >> v1:172.21.15.171:6789/0 conn(0x7fdc340725d0 legacy=0x7fdc341395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: _finish_hunting 0 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 monclient: found mon.noname-d 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc340717c0 con 0x7fdc3413ace0 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: _finish_auth 0 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: _check_auth_tickets 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:49.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc2c001d10 con 0x7fdc3413ace0 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 5 monclient: authenticate success, global_id 7107 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: dump: 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:49.612 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc2c001fb0 con 0x7fdc3413ace0 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 4 set_mon_vals no callback set 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 1 -- 172.21.15.106:0/253211754 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc2c003ce0 con 0x7fdc3413ace0 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:49.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc38c83640 10 monclient: dump: 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:49.614 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: shutdown 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- 172.21.15.106:0/253211754 >> v1:172.21.15.106:6792/0 conn(0x7fdc3413ace0 legacy=0x7fdc3413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- 172.21.15.106:0/253211754 shutdown_connections 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- 172.21.15.106:0/253211754 >> 172.21.15.106:0/253211754 conn(0x7fdc340a64e0 msgr2=0x7fdc340a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- 172.21.15.106:0/253211754 shutdown_connections 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- 172.21.15.106:0/253211754 wait complete. 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: build_initial_monmap 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: monmap: 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:49.615 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 Processor -- start 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- start start 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: init 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: _add_conns ranks=[3,8,6,1,2,5,7,4,0] 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient(hunting): picked mon.noname-g con 0x7fdc340725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient(hunting): picked mon.noname-e con 0x7fdc34134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient(hunting): picked mon.noname-d con 0x7fdc3413ace0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3409b6a0 con 0x7fdc340725d0 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc34072c60 con 0x7fdc3413ace0 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc340706a0 con 0x7fdc34134820 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient(hunting): authenticate will time out at 1425.154339s 2024-04-26T00:02:49.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3a486640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fdc3413ace0 0x7fdc341d0ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49936/0 (socket says 172.21.15.106:49936) 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3a486640 1 -- 172.21.15.106:0/352813514 learned_addr learned my addr 172.21.15.106:0/352813514 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231498870 0 0) 0x7fdc34072c60 con 0x7fdc3413ace0 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): my global_id is 7116 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc14003530 con 0x7fdc3413ace0 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2184355153 0 0) 0x7fdc340706a0 con 0x7fdc34134820 2024-04-26T00:02:49.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:49.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:49.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:49.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): my global_id is 204668 2024-04-26T00:02:49.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc34072c60 con 0x7fdc34134820 2024-04-26T00:02:49.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1832602275 0 0) 0x7fdc14003530 con 0x7fdc3413ace0 2024-04-26T00:02:49.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc340706a0 con 0x7fdc3413ace0 2024-04-26T00:02:49.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4277298496 0 0) 0x7fdc34072c60 con 0x7fdc34134820 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc14003530 con 0x7fdc34134820 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc2c003cc0 con 0x7fdc3413ace0 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): dump: 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.621 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc1c001220 con 0x7fdc34134820 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:49.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient(hunting): dump: 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:49.623 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3188903825 0 0) 0x7fdc14003530 con 0x7fdc34134820 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 >> v1:172.21.15.106:6792/0 conn(0x7fdc3413ace0 legacy=0x7fdc341d0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 >> v1:172.21.15.171:6790/0 conn(0x7fdc340725d0 legacy=0x7fdc3409ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 monclient: found mon.e 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc341c86e0 con 0x7fdc34134820 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:49.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 5 monclient: authenticate success, global_id 204668 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: _renew_subs 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdc34133f90 con 0x7fdc34134820 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: _renew_subs 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdc3409f340 con 0x7fdc34134820 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc1c003600 con 0x7fdc34134820 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc1c003af0 con 0x7fdc34134820 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:49.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc33fff640 4 set_mon_vals no callback set 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.622+0000 7fdc327fc640 10 monclient: dump: 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:49.626 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.626+0000 7fdc3bee9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.626+0000 7fdc3bee9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.626+0000 7fdc3bee9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.626+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc18005090 con 0x7fdc34134820 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.626+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdc1c00e890 con 0x7fdc34134820 2024-04-26T00:02:49.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.626+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fdc1c043c60 con 0x7fdc34134820 2024-04-26T00:02:49.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.626+0000 7fdc39c85640 10 monclient: get_auth_request con 0x7fdc14037cf0 auth_method 0 2024-04-26T00:02:49.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.634+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdc1c014360 con 0x7fdc34134820 2024-04-26T00:02:49.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.634+0000 7fdc327fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:49.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.634+0000 7fdc327fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.866+0000 7fdc3bee9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:02:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.866+0000 7fdc3bee9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:02:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.866+0000 7fdc3bee9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:49.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.866+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fdc18005380 con 0x7fdc34134820 2024-04-26T00:02:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.866+0000 7fdc327fc640 1 -- 172.21.15.106:0/352813514 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1609659133) 0x7fdc1c013c60 con 0x7fdc34134820 2024-04-26T00:02:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.866+0000 7fdc327fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:02:49.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.866+0000 7fdc327fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:49.848 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":48,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:02:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 >> v1:172.21.15.171:6812/722422047 conn(0x7fdc14037cf0 legacy=0x7fdc1403a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 10 monclient: shutdown 2024-04-26T00:02:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 >> v1:172.21.15.106:6793/0 conn(0x7fdc34134820 legacy=0x7fdc341cd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 shutdown_connections 2024-04-26T00:02:49.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 >> 172.21.15.106:0/352813514 conn(0x7fdc340a64e0 msgr2=0x7fdc340a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 shutdown_connections 2024-04-26T00:02:49.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:49.870+0000 7fdc3bee9640 1 -- 172.21.15.106:0/352813514 wait complete. 2024-04-26T00:02:49.866 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:02:49.866 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:02:49.866 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:02:49.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient: get_monmap_and_config 2024-04-26T00:02:49.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient: build_initial_monmap 2024-04-26T00:02:49.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient: monmap: 2024-04-26T00:02:49.982 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:50.006585+0000 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:50.006585+0000 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:49.983 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:49.984 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:49.984 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 1 Processor -- start 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 1 -- start start 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient: init 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient: _add_conns ranks=[2,3,0,6,4,8,1,7,5] 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient(hunting): picked mon.noname-b con 0x7f09a8137730 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient(hunting): picked mon.noname-g con 0x7f09a80a0b20 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient(hunting): picked mon.noname-a con 0x7f09a8138220 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a80a2750 con 0x7f09a8138220 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a80a2a30 con 0x7f09a8137730 2024-04-26T00:02:49.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a80a2d10 con 0x7f09a80a0b20 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient(hunting): authenticate will time out at 1425.533707s 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ae1a6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f09a8138220 0x7f09a8140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34588/0 (socket says 172.21.15.106:34588) 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ad9a5640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f09a8137730 0x7f09a8137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55338/0 (socket says 172.21.15.106:55338) 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ae1a6640 1 -- 172.21.15.106:0/4276044798 learned_addr learned my addr 172.21.15.106:0/4276044798 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509542031 0 0) 0x7f09a80a2750 con 0x7f09a8138220 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): _negotiate 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): my global_id is 7182 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0994003530 con 0x7f09a8138220 2024-04-26T00:02:49.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2941869040 0 0) 0x7f09a80a2a30 con 0x7f09a8137730 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): _negotiate 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient(hunting): my global_id is 6959 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a80a2750 con 0x7f09a8137730 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3194536741 0 0) 0x7f0994003530 con 0x7f09a8138220 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 >> v1:172.21.15.171:6790/0 conn(0x7f09a80a0b20 legacy=0x7f09a813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 >> v1:172.21.15.106:6790/0 conn(0x7f09a8137730 legacy=0x7f09a8137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:49.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: _finish_hunting 0 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 monclient: found mon.noname-a 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a80a4680 con 0x7f09a8138220 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: _finish_auth 0 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: _check_auth_tickets 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09a4001b40 con 0x7f09a8138220 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: dump: 2024-04-26T00:02:49.996 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:49.997 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 5 monclient: authenticate success, global_id 7182 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09a4001de0 con 0x7f09a8138220 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 1 -- 172.21.15.106:0/4276044798 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09a4004f70 con 0x7f09a8138220 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09afc09640 4 set_mon_vals no callback set 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:49.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.002+0000 7f09ac9a3640 10 monclient: dump: 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:49.999 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: shutdown 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/4276044798 >> v1:172.21.15.106:6789/0 conn(0x7f09a8138220 legacy=0x7f09a8140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/4276044798 shutdown_connections 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/4276044798 >> 172.21.15.106:0/4276044798 conn(0x7f09a80a6b80 msgr2=0x7f09a80a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/4276044798 shutdown_connections 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/4276044798 wait complete. 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: monmap: 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.001 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 Processor -- start 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- start start 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: init 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: _add_conns ranks=[7,4,2,1,6,0,8,5,3] 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient(hunting): picked mon.noname-i con 0x7f09a80a0b20 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient(hunting): picked mon.noname-c con 0x7f09a8137730 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient(hunting): picked mon.noname-b con 0x7f09a8138220 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:50.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09ad1a4640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f09a8137730 0x7f09a81315d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55448/0 (socket says 172.21.15.106:55448) 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09ad1a4640 1 -- 172.21.15.106:0/51429051 learned_addr learned my addr 172.21.15.106:0/51429051 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a8134d60 con 0x7f09a8138220 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a80a1e20 con 0x7f09a8137730 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a80a19d0 con 0x7f09a80a0b20 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient(hunting): authenticate will time out at 1425.538401s 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 42658275 0 0) 0x7f09a8134d60 con 0x7f09a8138220 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): my global_id is 6968 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f098c003530 con 0x7f09a8138220 2024-04-26T00:02:50.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 865816702 0 0) 0x7f09a80a1e20 con 0x7f09a8137730 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): my global_id is 145597 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a8134d60 con 0x7f09a8137730 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1762752381 0 0) 0x7f098c003530 con 0x7f09a8138220 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09a80a1e20 con 0x7f09a8138220 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09a4001a40 con 0x7f09a8138220 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): dump: 2024-04-26T00:02:50.004 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.005 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3555166763 0 0) 0x7f09a8134d60 con 0x7f09a8137730 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f098c003530 con 0x7f09a8137730 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0998001a60 con 0x7f09a8137730 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient(hunting): dump: 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.006 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2217736869 0 0) 0x7f09a80a1e20 con 0x7f09a8138220 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.171:6792/0 conn(0x7f09a80a0b20 legacy=0x7f09a8130ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.106:6791/0 conn(0x7f09a8137730 legacy=0x7f09a81315d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 monclient: found mon.b 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a8131ce0 con 0x7f09a8138220 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 5 monclient: authenticate success, global_id 6968 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: _renew_subs 2024-04-26T00:02:50.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09a8134a80 con 0x7f09a8138220 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: _renew_subs 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f09a8141510 con 0x7f09a8138220 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f09a4004ed0 con 0x7f09a8138220 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.006+0000 7f099e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09a4005520 con 0x7f09a8138220 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: dump: 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.009 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.010 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099ffff640 4 set_mon_vals no callback set 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f09afc09640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f09a40102c0 con 0x7f09a8138220 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f09900065d0 con 0x7f0990002870 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f09a40452b0 con 0x7f09a8138220 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 537977735 0 0) 0x7f09900065d0 con 0x7f0990002870 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient(hunting): my global_id is 7191 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a80a1e20 con 0x7f0990002870 2024-04-26T00:02:50.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f09ad1a4640 10 monclient: get_auth_request con 0x7f098c037dd0 auth_method 0 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3699410031 0 0) 0x7f09a80a1e20 con 0x7f0990002870 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09900065d0 con 0x7f0990002870 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09a0001520 con 0x7f0990002870 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: dump: 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.012 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3147440193 0 0) 0x7f09900065d0 con 0x7f0990002870 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f099000a160 con 0x7f0990002870 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f09a0001520 con 0x7f0990002870 2024-04-26T00:02:50.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:50.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.106:6789/0 conn(0x7f0990002870 legacy=0x7f0990004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.010+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.106:6789/0 conn(0x7f0990002870 legacy=0x7f0990004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.014+0000 7f09afc09640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:50.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.014+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0990009e50 con 0x7f0990009110 2024-04-26T00:02:50.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2481589053 0 0) 0x7f0990009e50 con 0x7f0990009110 2024-04-26T00:02:50.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient(hunting): my global_id is 7200 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09900065d0 con 0x7f0990009110 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2959321887 0 0) 0x7f09900065d0 con 0x7f0990009110 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0990009e50 con 0x7f0990009110 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09a0004d20 con 0x7f0990009110 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient: dump: 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.016 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.017 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2596959764 0 0) 0x7f0990009e50 con 0x7f0990009110 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f099000c3e0 con 0x7f0990009110 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 3681774103) 0x7f09a0007090 con 0x7f0990009110 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.106:6789/0 conn(0x7f0990009110 legacy=0x7f09900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f099e7fc640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.106:6789/0 conn(0x7f0990009110 legacy=0x7f09900095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 488577, 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:50.019 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:50.020 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.021 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.022 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:50.023 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.024 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:50.025 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.026 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:50.027 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:50.028 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.029 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.030 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.032 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.033 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.037 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.039 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.040 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.040 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.040 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:50.040 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:50.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.171:6812/722422047 conn(0x7f098c037dd0 legacy=0x7f098c03a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 10 monclient: shutdown 2024-04-26T00:02:50.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 >> v1:172.21.15.106:6790/0 conn(0x7f09a8138220 legacy=0x7f09a81d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09ae1a6640 1 -- 172.21.15.106:0/51429051 reap_dead start 2024-04-26T00:02:50.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09ae1a6640 1 -- 172.21.15.106:0/51429051 reap_dead start 2024-04-26T00:02:50.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 shutdown_connections 2024-04-26T00:02:50.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 >> 172.21.15.106:0/51429051 conn(0x7f09a80a6b80 msgr2=0x7f09a80a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 shutdown_connections 2024-04-26T00:02:50.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.018+0000 7f09afc09640 1 -- 172.21.15.106:0/51429051 wait complete. 2024-04-26T00:02:50.042 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:50.042 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:02:50.043 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:02:50.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.174+0000 7f7fce380640 10 monclient: get_monmap_and_config 2024-04-26T00:02:50.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.174+0000 7f7fce380640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: monmap: 2024-04-26T00:02:50.158 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.158 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.158 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:50.182390+0000 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:50.182390+0000 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.159 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.160 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 Processor -- start 2024-04-26T00:02:50.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- start start 2024-04-26T00:02:50.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: init 2024-04-26T00:02:50.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: _add_conns ranks=[7,4,8,3,0,1,5,6,2] 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient(hunting): picked mon.noname-i con 0x7f7fc80a16f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient(hunting): picked mon.noname-c con 0x7f7fc809b680 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient(hunting): picked mon.noname-e con 0x7f7fc809aef0 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc809f940 con 0x7f7fc809b680 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc809bd10 con 0x7f7fc80a16f0 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc809bff0 con 0x7f7fc809aef0 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient(hunting): authenticate will time out at 1425.709700s 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc77fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f7fc809b680 0x7f7fc813cb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55450/0 (socket says 172.21.15.106:55450) 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc77fe640 1 -- 172.21.15.106:0/3582601447 learned_addr learned my addr 172.21.15.106:0/3582601447 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3996749277 0 0) 0x7f7fc809f940 con 0x7f7fc809b680 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): my global_id is 145606 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb0003530 con 0x7f7fc809b680 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 729617637 0 0) 0x7f7fc809bff0 con 0x7f7fc809aef0 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient(hunting): my global_id is 204677 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc809f940 con 0x7f7fc809aef0 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572348985 0 0) 0x7f7fb0003530 con 0x7f7fc809b680 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 >> v1:172.21.15.106:6793/0 conn(0x7f7fc809aef0 legacy=0x7f7fc81402b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 >> v1:172.21.15.171:6792/0 conn(0x7f7fc80a16f0 legacy=0x7f7fc80a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 monclient: found mon.noname-c 2024-04-26T00:02:50.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc809c2d0 con 0x7f7fc809b680 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fb80017c0 con 0x7f7fc809b680 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 5 monclient: authenticate success, global_id 145606 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: dump: 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.174 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.175 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fb8001a70 con 0x7f7fc809b680 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 1 -- 172.21.15.106:0/3582601447 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fb8004bf0 con 0x7f7fc809b680 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 4 set_mon_vals no callback set 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fc6ffd640 10 monclient: dump: 2024-04-26T00:02:50.176 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.177 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: shutdown 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- 172.21.15.106:0/3582601447 >> v1:172.21.15.106:6791/0 conn(0x7f7fc809b680 legacy=0x7f7fc813cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- 172.21.15.106:0/3582601447 shutdown_connections 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- 172.21.15.106:0/3582601447 >> 172.21.15.106:0/3582601447 conn(0x7f7fc80a62e0 msgr2=0x7f7fc80a27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- 172.21.15.106:0/3582601447 shutdown_connections 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 1 -- 172.21.15.106:0/3582601447 wait complete. 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.178+0000 7f7fce380640 10 monclient: monmap: 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.178 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.179 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 Processor -- start 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 -- start start 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient: init 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient: _add_conns ranks=[1,2,6,8,3,4,7,5,0] 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient(hunting): picked mon.noname-f con 0x7f7fc809aef0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient(hunting): picked mon.noname-b con 0x7f7fc809b680 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient(hunting): picked mon.noname-d con 0x7f7fc80a16f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc81a3b60 con 0x7f7fc809aef0 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc81a2360 con 0x7f7fc809b680 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7fc809fb60 con 0x7f7fc80a16f0 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient(hunting): authenticate will time out at 1425.712632s 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc77fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7fc809b680 0x7f7fc81d1570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55354/0 (socket says 172.21.15.106:55354) 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fcc91d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f7fc80a16f0 0x7f7fc81d4ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49940/0 (socket says 172.21.15.106:49940) 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc77fe640 1 -- 172.21.15.106:0/1217928401 learned_addr learned my addr 172.21.15.106:0/1217928401 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1885476838 0 0) 0x7f7fc81a2360 con 0x7f7fc809b680 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): my global_id is 6977 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb4003530 con 0x7f7fc809b680 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4136303691 0 0) 0x7f7fc809fb60 con 0x7f7fc80a16f0 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): my global_id is 7125 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc81a2360 con 0x7f7fc80a16f0 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 476796398 0 0) 0x7f7fb4003530 con 0x7f7fc809b680 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fc809fb60 con 0x7f7fc809b680 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fb8004b30 con 0x7f7fc809b680 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): dump: 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.182 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2090386746 0 0) 0x7f7fc81a2360 con 0x7f7fc80a16f0 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fb4003530 con 0x7f7fc80a16f0 2024-04-26T00:02:50.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fc0001de0 con 0x7f7fc80a16f0 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): dump: 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.184 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259456384 0 0) 0x7f7fc81a3b60 con 0x7f7fc809aef0 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): my global_id is 145612 2024-04-26T00:02:50.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc81a2360 con 0x7f7fc809aef0 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2121033158 0 0) 0x7f7fc809fb60 con 0x7f7fc809b680 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6792/0 conn(0x7f7fc80a16f0 legacy=0x7f7fc81d4ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.171:6789/0 conn(0x7f7fc809aef0 legacy=0x7f7fc81b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 monclient: found mon.b 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7fc81a3880 con 0x7f7fc809b680 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 5 monclient: authenticate success, global_id 6977 2024-04-26T00:02:50.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient: _renew_subs 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7fc81a2090 con 0x7f7fc809b680 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient: _renew_subs 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7fc81b6a80 con 0x7f7fc809b680 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc77fe640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc809b680 legacy=0x7f7fc81d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc77fe640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc809b680 legacy=0x7f7fc81d1570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc77fe640 1 --1- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc809b680 0x7f7fc81d1570 :-1 s=OPENED pgs=533 cs=1 l=1).handle_message read tag failed 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc77fe640 1 --1- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc809b680 0x7f7fc81d1570 :-1 s=OPENED pgs=533 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: ms_handle_reset current mon v1:172.21.15.106:6790/0 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc809b680 legacy=0x7f7fc81d1570 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _add_conns ranks=[5,4,2,7,6,0,1,3,8] 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): picked mon.h con 0x7f7fb40059a0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): picked mon.c con 0x7f7fb4009610 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): picked mon.b con 0x7f7fb400d550 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7fc809fb60 con 0x7f7fb400d550 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7fb4003530 con 0x7f7fb4009610 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7fc81a3b60 con 0x7f7fb40059a0 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093977129 0 0) 0x7f7fb4003530 con 0x7f7fb4009610 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-26T00:02:50.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6791/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f7fb40116a0 con 0x7f7fb4009610 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 291600512 0 0) 0x7f7fc809fb60 con 0x7f7fb400d550 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth already have auth, reseting 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 132 bytes epoch 0) -- 0x7f7fb4003530 con 0x7f7fb400d550 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 233+0+0 (unknown 1827191647 0 0) 0x7f7fb40116a0 con 0x7f7fb4009610 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.171:6791/0 conn(0x7f7fb40059a0 legacy=0x7f7fb4007d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fb400d550 legacy=0x7f7fb400fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 monclient: found mon.c 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,mgrmap=0+,monmap=2+,osdmap=0}) -- 0x7f7fb40148d0 con 0x7f7fb4009610 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fb80011c0 con 0x7f7fb4009610 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: dump: 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.190 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7fc809f590 con 0x7f7fc80a21b0 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7fb80052b0 con 0x7f7fb4009610 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc67fc640 4 set_mon_vals no callback set 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3984997171 0 0) 0x7f7fc809f590 con 0x7f7fc80a21b0 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 10 monclient(hunting): my global_id is 6986 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fb40116a0 con 0x7f7fc80a21b0 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7fb80100e0 con 0x7f7fb4009610 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.4 v1:172.21.15.106:6791/0 6 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f7fb8045460 con 0x7f7fb4009610 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2557158352 0 0) 0x7f7fb40116a0 con 0x7f7fc80a21b0 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.182+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fc809f590 con 0x7f7fc80a21b0 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fbc0016d0 con 0x7f7fc80a21b0 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 10 monclient: dump: 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.192 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fcc91d640 10 monclient: get_auth_request con 0x7f7fc809b680 auth_method 0 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1076845754 0 0) 0x7f7fc809f590 con 0x7f7fc80a21b0 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7fc8075890 con 0x7f7fc80a21b0 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7fbc001b30 con 0x7f7fc80a21b0 2024-04-26T00:02:50.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:50.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc80a21b0 legacy=0x7f7fc81ba3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc80a21b0 legacy=0x7f7fc81ba3c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.186+0000 7f7fcc91d640 1 -- 172.21.15.106:0/1217928401 reap_dead start 2024-04-26T00:02:50.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fce380640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:50.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7fc8062e50 con 0x7f7fc81cc450 2024-04-26T00:02:50.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177626198 0 0) 0x7f7fc8062e50 con 0x7f7fc81cc450 2024-04-26T00:02:50.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient(hunting): my global_id is 6995 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7fc809f590 con 0x7f7fc81cc450 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1720331326 0 0) 0x7f7fc809f590 con 0x7f7fc81cc450 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7fc8062e50 con 0x7f7fc81cc450 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7fbc003960 con 0x7f7fc81cc450 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient: dump: 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.196 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1504916883 0 0) 0x7f7fc8062e50 con 0x7f7fc81cc450 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7fc806c7f0 con 0x7f7fc81cc450 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 722874825) 0x7f7fbc003cd0 con 0x7f7fc81cc450 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:50.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc81cc450 legacy=0x7f7fc81b61a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fc4ff9640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6790/0 conn(0x7f7fc81cc450 legacy=0x7f7fc81b61a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 488753, 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:50.198 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.199 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.200 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:50.201 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.202 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.203 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.204 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.205 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.208 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:50.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.210 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.215 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:50.216 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.171:6812/722422047 conn(0x7f7fc809b680 legacy=0x7f7fb4045d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fce380640 10 monclient: shutdown 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fce380640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.190+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 >> v1:172.21.15.106:6791/0 conn(0x7f7fb4009610 legacy=0x7f7fb400ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.194+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 shutdown_connections 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.194+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 >> 172.21.15.106:0/1217928401 conn(0x7f7fc80a62e0 msgr2=0x7f7fc809d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.194+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 shutdown_connections 2024-04-26T00:02:50.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.194+0000 7f7fce380640 1 -- 172.21.15.106:0/1217928401 wait complete. 2024-04-26T00:02:50.219 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:50.219 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:02:50.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:02:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: get_monmap_and_config 2024-04-26T00:02:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: monmap: 2024-04-26T00:02:50.338 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:50.362715+0000 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:50.362715+0000 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.339 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 Processor -- start 2024-04-26T00:02:50.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- start start 2024-04-26T00:02:50.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: init 2024-04-26T00:02:50.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: _add_conns ranks=[6,3,5,4,7,1,0,2,8] 2024-04-26T00:02:50.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient(hunting): picked mon.noname-d con 0x7fe8ac0a1a60 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:50.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient(hunting): picked mon.noname-g con 0x7fe8ac0a2550 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient(hunting): picked mon.noname-h con 0x7fe8ac09f7d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac09eb10 con 0x7fe8ac0a2550 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac09fc00 con 0x7fe8ac09f7d0 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac06b4a0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient(hunting): authenticate will time out at 1425.890046s 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8ab7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe8ac0a1a60 0x7fe8ac0a1e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49950/0 (socket says 172.21.15.106:49950) 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8ab7fe640 1 -- 172.21.15.106:0/2017836539 learned_addr learned my addr 172.21.15.106:0/2017836539 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378217843 0 0) 0x7fe8ac06b4a0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient(hunting): my global_id is 7134 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe894003530 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2755537192 0 0) 0x7fe894003530 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 >> v1:172.21.15.171:6791/0 conn(0x7fe8ac09f7d0 legacy=0x7fe8ac140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 >> v1:172.21.15.171:6790/0 conn(0x7fe8ac0a2550 legacy=0x7fe8ac13cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 monclient: found mon.noname-d 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac09dc60 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe89c0017c0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 5 monclient: authenticate success, global_id 7134 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: dump: 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.351 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe89c001ab0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 1 -- 172.21.15.106:0/2017836539 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe89c004bf0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:50.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 4 set_mon_vals no callback set 2024-04-26T00:02:50.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8aa7fc640 10 monclient: dump: 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.354 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.355 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 10 monclient: shutdown 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/2017836539 >> v1:172.21.15.106:6792/0 conn(0x7fe8ac0a1a60 legacy=0x7fe8ac0a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/2017836539 shutdown_connections 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/2017836539 >> 172.21.15.106:0/2017836539 conn(0x7fe8ac0a6fe0 msgr2=0x7fe8ac0a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/2017836539 shutdown_connections 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.358+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/2017836539 wait complete. 2024-04-26T00:02:50.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: monmap: 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.357 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 Processor -- start 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 -- start start 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: init 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: _add_conns ranks=[1,4,3,0,7,6,8,5,2] 2024-04-26T00:02:50.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient(hunting): picked mon.noname-f con 0x7fe8ac09f7d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient(hunting): picked mon.noname-c con 0x7fe8ac0a1a60 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient(hunting): picked mon.noname-g con 0x7fe8ac0a2550 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac13d330 con 0x7fe8ac09f7d0 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac072600 con 0x7fe8ac0a2550 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8ac09e150 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient(hunting): authenticate will time out at 1425.893694s 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8aaffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fe8ac0a1a60 0x7fe8ac1d1df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55464/0 (socket says 172.21.15.106:55464) 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8aaffd640 1 -- 172.21.15.106:0/1405257031 learned_addr learned my addr 172.21.15.106:0/1405257031 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479872860 0 0) 0x7fe8ac09e150 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): my global_id is 145615 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe898003530 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1489090087 0 0) 0x7fe898003530 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe8ac09e150 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe8a0001a80 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): dump: 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.360 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.361 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122840840 0 0) 0x7fe8ac09fc00 con 0x7fe8ac0a2550 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): my global_id is 214113 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe898003530 con 0x7fe8ac0a2550 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 76135388 0 0) 0x7fe8ac09dc60 con 0x7fe8ac09f7d0 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient(hunting): my global_id is 145621 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ac09fc00 con 0x7fe8ac09f7d0 2024-04-26T00:02:50.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4031735022 0 0) 0x7fe8ac09e150 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.171:6790/0 conn(0x7fe8ac0a2550 legacy=0x7fe8ac1d5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.171:6789/0 conn(0x7fe8ac09f7d0 legacy=0x7fe8ac1cce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 monclient: found mon.c 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8ac13cc30 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 5 monclient: authenticate success, global_id 145615 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: _renew_subs 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe8ac13cf10 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: _renew_subs 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8ac09b9b0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8a0003950 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe8a0003ec0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8a9ffb640 4 set_mon_vals no callback set 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 10 monclient: dump: 2024-04-26T00:02:50.364 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.365 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe88c0065d0 con 0x7fe88c002870 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe8a00040e0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.362+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fe8a00451f0 con 0x7fe8ac0a1a60 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112168175 0 0) 0x7fe88c0065d0 con 0x7fe88c002870 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient(hunting): my global_id is 145624 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8ac09e150 con 0x7fe88c002870 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe8abfff640 10 monclient: get_auth_request con 0x7fe8980379f0 auth_method 0 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2935933534 0 0) 0x7fe8ac09e150 con 0x7fe88c002870 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe88c0065d0 con 0x7fe88c002870 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe89c001440 con 0x7fe88c002870 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient: dump: 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.367 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2150063432 0 0) 0x7fe88c0065d0 con 0x7fe88c002870 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe88c00a160 con 0x7fe88c002870 2024-04-26T00:02:50.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe89c001830 con 0x7fe88c002870 2024-04-26T00:02:50.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:50.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.106:6791/0 conn(0x7fe88c002870 legacy=0x7fe88c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.366+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.106:6791/0 conn(0x7fe88c002870 legacy=0x7fe88c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe8b1cdb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:50.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe88c009e50 con 0x7fe88c009110 2024-04-26T00:02:50.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715487479 0 0) 0x7fe88c009e50 con 0x7fe88c009110 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 10 monclient(hunting): my global_id is 145633 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe88c0065d0 con 0x7fe88c009110 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1952697090 0 0) 0x7fe88c0065d0 con 0x7fe88c009110 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe88c009e50 con 0x7fe88c009110 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe89c005000 con 0x7fe88c009110 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 10 monclient: dump: 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.371 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.372 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1801574925 0 0) 0x7fe88c009e50 con 0x7fe88c009110 2024-04-26T00:02:50.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.370+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe88c00c3e0 con 0x7fe88c009110 2024-04-26T00:02:50.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 2521458490) 0x7fe89c0064f0 con 0x7fe88c009110 2024-04-26T00:02:50.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe893fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:50.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe893fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:50.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.106:6791/0 conn(0x7fe88c009110 legacy=0x7fe88c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe893fff640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.106:6791/0 conn(0x7fe88c009110 legacy=0x7fe88c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 233901, 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:50.374 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.375 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.376 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.377 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:50.378 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.379 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.380 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.383 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.384 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:50.387 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.389 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.391 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:50.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:50.393 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:50.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.171:6812/722422047 conn(0x7fe8980379f0 legacy=0x7fe898039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 10 monclient: shutdown 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 >> v1:172.21.15.106:6791/0 conn(0x7fe8ac0a1a60 legacy=0x7fe8ac1d1df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8abfff640 1 -- 172.21.15.106:0/1405257031 reap_dead start 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8abfff640 1 -- 172.21.15.106:0/1405257031 reap_dead start 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 shutdown_connections 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 >> 172.21.15.106:0/1405257031 conn(0x7fe8ac0a6fe0 msgr2=0x7fe8ac067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 shutdown_connections 2024-04-26T00:02:50.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.374+0000 7fe8b1cdb640 1 -- 172.21.15.106:0/1405257031 wait complete. 2024-04-26T00:02:50.395 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:50.395 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:02:50.396 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:02:50.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: get_monmap_and_config 2024-04-26T00:02:50.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: monmap: 2024-04-26T00:02:50.510 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.510 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.510 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:50.534590+0000 2024-04-26T00:02:50.510 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:50.534590+0000 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.511 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.512 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 Processor -- start 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- start start 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: init 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: _add_conns ranks=[0,3,1,6,8,7,4,2,5] 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient(hunting): picked mon.noname-a con 0x7f9c28137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient(hunting): picked mon.noname-g con 0x7f9c280a0b20 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:50.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient(hunting): picked mon.noname-f con 0x7f9c28138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c280a2750 con 0x7f9c28137730 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c280a2a30 con 0x7f9c28138220 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c280a2d10 con 0x7f9c280a0b20 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient(hunting): authenticate will time out at 1426.061840s 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c277fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9c28137730 0x7f9c28137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34616/0 (socket says 172.21.15.106:34616) 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c277fe640 1 -- 172.21.15.106:0/2651054066 learned_addr learned my addr 172.21.15.106:0/2651054066 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1188626137 0 0) 0x7f9c280a2750 con 0x7f9c28137730 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient(hunting): my global_id is 7209 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c10003530 con 0x7f9c28137730 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2134921216 0 0) 0x7f9c10003530 con 0x7f9c28137730 2024-04-26T00:02:50.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 >> v1:172.21.15.171:6790/0 conn(0x7f9c280a0b20 legacy=0x7f9c2813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 >> v1:172.21.15.171:6789/0 conn(0x7f9c28138220 legacy=0x7f9c28140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 monclient: found mon.noname-a 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c280a4680 con 0x7f9c28137730 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c180017c0 con 0x7f9c28137730 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: dump: 2024-04-26T00:02:50.521 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.522 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 5 monclient: authenticate success, global_id 7209 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c18001b20 con 0x7f9c28137730 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 1 -- 172.21.15.106:0/2651054066 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c18001d50 con 0x7f9c28137730 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 4 set_mon_vals no callback set 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c267fc640 10 monclient: dump: 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.523 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: shutdown 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- 172.21.15.106:0/2651054066 >> v1:172.21.15.106:6789/0 conn(0x7f9c28137730 legacy=0x7f9c28137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- 172.21.15.106:0/2651054066 shutdown_connections 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- 172.21.15.106:0/2651054066 >> 172.21.15.106:0/2651054066 conn(0x7f9c280a6b80 msgr2=0x7f9c280a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- 172.21.15.106:0/2651054066 shutdown_connections 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 1 -- 172.21.15.106:0/2651054066 wait complete. 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.530+0000 7f9c2de44640 10 monclient: monmap: 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 Processor -- start 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 -- start start 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient: init 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient: _add_conns ranks=[6,4,8,5,3,0,1,7,2] 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient(hunting): picked mon.noname-d con 0x7f9c280a0b20 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:50.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient(hunting): picked mon.noname-c con 0x7f9c28137730 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient(hunting): picked mon.noname-e con 0x7f9c28138220 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c28132570 con 0x7f9c28137730 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c28130680 con 0x7f9c280a0b20 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c28132290 con 0x7f9c28138220 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient(hunting): authenticate will time out at 1426.064798s 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c277fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9c280a0b20 0x7f9c2812f860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49952/0 (socket says 172.21.15.106:49952) 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c277fe640 1 -- 172.21.15.106:0/3450357102 learned_addr learned my addr 172.21.15.106:0/3450357102 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 945229954 0 0) 0x7f9c28130680 con 0x7f9c280a0b20 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): my global_id is 7143 2024-04-26T00:02:50.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c14003530 con 0x7f9c280a0b20 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 266084488 0 0) 0x7f9c28132570 con 0x7f9c28137730 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): my global_id is 145642 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c28130680 con 0x7f9c28137730 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3130739604 0 0) 0x7f9c28132290 con 0x7f9c28138220 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): my global_id is 204686 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c28132570 con 0x7f9c28138220 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1189611683 0 0) 0x7f9c14003530 con 0x7f9c280a0b20 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c28132290 con 0x7f9c280a0b20 2024-04-26T00:02:50.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c18001780 con 0x7f9c280a0b20 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): dump: 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.529 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1020849105 0 0) 0x7f9c28130680 con 0x7f9c28137730 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c14003530 con 0x7f9c28137730 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 18346844 0 0) 0x7f9c28132570 con 0x7f9c28138220 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c28130680 con 0x7f9c28138220 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c1c0019a0 con 0x7f9c28137730 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): dump: 2024-04-26T00:02:50.530 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.531 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c20001bb0 con 0x7f9c28138220 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): dump: 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.532 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1136860019 0 0) 0x7f9c14003530 con 0x7f9c28137730 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.106:6793/0 conn(0x7f9c28138220 legacy=0x7f9c281d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.106:6792/0 conn(0x7f9c280a0b20 legacy=0x7f9c2812f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 monclient: found mon.c 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c281363e0 con 0x7f9c28137730 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 5 monclient: authenticate success, global_id 145642 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient: _renew_subs 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c2809fdb0 con 0x7f9c28137730 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient: _renew_subs 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:50.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c281d6180 con 0x7f9c28137730 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c1c001ce0 con 0x7f9c28137730 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c1c003c10 con 0x7f9c28137730 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c25ffb640 4 set_mon_vals no callback set 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: dump: 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.535 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c080065d0 con 0x7f9c08002870 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9c1c003db0 con 0x7f9c28137730 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f9c1c043e70 con 0x7f9c28137730 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1021419974 0 0) 0x7f9c080065d0 con 0x7f9c08002870 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient(hunting): my global_id is 7152 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c14003530 con 0x7f9c08002870 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c27fff640 10 monclient: get_auth_request con 0x7f9c140381f0 auth_method 0 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1925293502 0 0) 0x7f9c14003530 con 0x7f9c08002870 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c080065d0 con 0x7f9c08002870 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c180050a0 con 0x7f9c08002870 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 10 monclient: dump: 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1562405845 0 0) 0x7f9c080065d0 con 0x7f9c08002870 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.534+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c0800a160 con 0x7f9c08002870 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.538+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9c18005240 con 0x7f9c08002870 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.538+0000 7f9c0ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.538+0000 7f9c0ffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.538+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.106:6792/0 conn(0x7f9c08002870 legacy=0x7f9c08004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.538+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.106:6792/0 conn(0x7f9c08002870 legacy=0x7f9c08004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c08009e50 con 0x7f9c08009110 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3093219951 0 0) 0x7f9c08009e50 con 0x7f9c08009110 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient(hunting): my global_id is 7161 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c080065d0 con 0x7f9c08009110 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2334205443 0 0) 0x7f9c080065d0 con 0x7f9c08009110 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c08009e50 con 0x7f9c08009110 2024-04-26T00:02:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c18005a80 con 0x7f9c08009110 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient: dump: 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1466177727 0 0) 0x7f9c08009e50 con 0x7f9c08009110 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c0800c3e0 con 0x7f9c08009110 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 100647595) 0x7f9c180086f0 con 0x7f9c08009110 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.106:6792/0 conn(0x7f9c08009110 legacy=0x7f9c080095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c0ffff640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.106:6792/0 conn(0x7f9c08009110 legacy=0x7f9c080095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 489081, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:50.544 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.545 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.546 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:50.547 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.548 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:50.549 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.550 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.551 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.552 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.553 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:50.554 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.556 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.557 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.560 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.561 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.562 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.563 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.563 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.563 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.563 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.563 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:50.563 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:50.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.171:6812/722422047 conn(0x7f9c140381f0 legacy=0x7f9c1403a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 10 monclient: shutdown 2024-04-26T00:02:50.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 >> v1:172.21.15.106:6791/0 conn(0x7f9c28137730 legacy=0x7f9c2812ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c27fff640 1 -- 172.21.15.106:0/3450357102 reap_dead start 2024-04-26T00:02:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c27fff640 1 -- 172.21.15.106:0/3450357102 reap_dead start 2024-04-26T00:02:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 shutdown_connections 2024-04-26T00:02:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 >> 172.21.15.106:0/3450357102 conn(0x7f9c280a6b80 msgr2=0x7f9c2812e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 shutdown_connections 2024-04-26T00:02:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.542+0000 7f9c2de44640 1 -- 172.21.15.106:0/3450357102 wait complete. 2024-04-26T00:02:50.565 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:50.566 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:02:50.566 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.706+0000 7fc7a92da640 10 monclient: get_monmap_and_config 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.706+0000 7fc7a92da640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.706+0000 7fc7a92da640 10 monclient: monmap: 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:50.714314+0000 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:50.714314+0000 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.690 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.691 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 Processor -- start 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- start start 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient: init 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient: _add_conns ranks=[6,2,3,5,0,1,8,7,4] 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient(hunting): picked mon.noname-d con 0x7fc7a4134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient(hunting): picked mon.noname-b con 0x7fc7a40a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient(hunting): picked mon.noname-g con 0x7fc7a413e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:50.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a406dd40 con 0x7fc7a40a4820 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a40a2b10 con 0x7fc7a413e200 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a40a2df0 con 0x7fc7a4134970 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient(hunting): authenticate will time out at 1426.241633s 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a2ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc7a4134970 0x7fc7a4134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49978/0 (socket says 172.21.15.106:49978) 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a27fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc7a40a4820 0x7fc7a413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55394/0 (socket says 172.21.15.106:55394) 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a2ffd640 1 -- 172.21.15.106:0/1321089239 learned_addr learned my addr 172.21.15.106:0/1321089239 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 578228903 0 0) 0x7fc7a40a2df0 con 0x7fc7a4134970 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): my global_id is 7170 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc78c003530 con 0x7fc7a4134970 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3300803466 0 0) 0x7fc7a406dd40 con 0x7fc7a40a4820 2024-04-26T00:02:50.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient(hunting): my global_id is 7004 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a40a2df0 con 0x7fc7a40a4820 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1659738707 0 0) 0x7fc7a40a2df0 con 0x7fc7a40a4820 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 >> v1:172.21.15.106:6792/0 conn(0x7fc7a4134970 legacy=0x7fc7a4134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 >> v1:172.21.15.171:6790/0 conn(0x7fc7a413e200 legacy=0x7fc7a41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 monclient: found mon.noname-b 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a40a30d0 con 0x7fc7a40a4820 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7980017c0 con 0x7fc7a40a4820 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: dump: 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.702 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 5 monclient: authenticate success, global_id 7004 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7980019b0 con 0x7fc7a40a4820 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 1 -- 172.21.15.106:0/1321089239 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc798001c20 con 0x7fc7a40a4820 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 4 set_mon_vals no callback set 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:50.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a1ffb640 10 monclient: dump: 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.704 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient: shutdown 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- 172.21.15.106:0/1321089239 >> v1:172.21.15.106:6790/0 conn(0x7fc7a40a4820 legacy=0x7fc7a413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- 172.21.15.106:0/1321089239 shutdown_connections 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- 172.21.15.106:0/1321089239 >> 172.21.15.106:0/1321089239 conn(0x7fc7a40a9e20 msgr2=0x7fc7a40aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- 172.21.15.106:0/1321089239 shutdown_connections 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 1 -- 172.21.15.106:0/1321089239 wait complete. 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.710+0000 7fc7a92da640 10 monclient: monmap: 2024-04-26T00:02:50.705 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.706 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 Processor -- start 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 -- start start 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient: init 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient: _add_conns ranks=[6,3,0,7,1,8,5,4,2] 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient(hunting): picked mon.noname-d con 0x7fc7a40a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient(hunting): picked mon.noname-g con 0x7fc7a4134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient(hunting): picked mon.noname-a con 0x7fc7a413e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a40a1e00 con 0x7fc7a413e200 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a40a0360 con 0x7fc7a4134970 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7a409e6e0 con 0x7fc7a40a4820 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient(hunting): authenticate will time out at 1426.244638s 2024-04-26T00:02:50.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a2ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc7a40a4820 0x7fc7a412c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49984/0 (socket says 172.21.15.106:49984) 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a2ffd640 1 -- 172.21.15.106:0/2706080806 learned_addr learned my addr 172.21.15.106:0/2706080806 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3069870161 0 0) 0x7fc7a409e6e0 con 0x7fc7a40a4820 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): my global_id is 7179 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc790003530 con 0x7fc7a40a4820 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2955675740 0 0) 0x7fc7a40a1e00 con 0x7fc7a413e200 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): my global_id is 7218 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a409e6e0 con 0x7fc7a413e200 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2569918083 0 0) 0x7fc790003530 con 0x7fc7a40a4820 2024-04-26T00:02:50.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7a40a1e00 con 0x7fc7a40a4820 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2026456744 0 0) 0x7fc7a409e6e0 con 0x7fc7a413e200 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc790003530 con 0x7fc7a413e200 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc794001580 con 0x7fc7a40a4820 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): dump: 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.709 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc79c001c40 con 0x7fc7a413e200 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:50.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): dump: 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.711 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568594144 0 0) 0x7fc7a40a0360 con 0x7fc7a4134970 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): my global_id is 214140 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a409e6e0 con 0x7fc7a4134970 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3794889307 0 0) 0x7fc7a40a1e00 con 0x7fc7a40a4820 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.171:6790/0 conn(0x7fc7a4134970 legacy=0x7fc7a41d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.106:6789/0 conn(0x7fc7a413e200 legacy=0x7fc7a41d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 monclient: found mon.d 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:50.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7a409f790 con 0x7fc7a40a4820 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 5 monclient: authenticate success, global_id 7179 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient: _renew_subs 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc7a409d5f0 con 0x7fc7a40a4820 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient: _renew_subs 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7a412ced0 con 0x7fc7a40a4820 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc794004aa0 con 0x7fc7a40a4820 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc794004f90 con 0x7fc7a40a4820 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a17fa640 4 set_mon_vals no callback set 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: dump: 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.714 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc79400fd30 con 0x7fc7a40a4820 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc7840065d0 con 0x7fc784002870 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fc7940451c0 con 0x7fc7a40a4820 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1228270207 0 0) 0x7fc7840065d0 con 0x7fc784002870 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient(hunting): my global_id is 204695 2024-04-26T00:02:50.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a40a1e00 con 0x7fc784002870 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc7a37fe640 10 monclient: get_auth_request con 0x7fc790037f00 auth_method 0 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2064921375 0 0) 0x7fc7a40a1e00 con 0x7fc784002870 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7840065d0 con 0x7fc784002870 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc798001780 con 0x7fc784002870 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: dump: 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.716 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3769322859 0 0) 0x7fc7840065d0 con 0x7fc784002870 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc78400a160 con 0x7fc784002870 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc798001ad0 con 0x7fc784002870 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.106:6793/0 conn(0x7fc784002870 legacy=0x7fc784004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.714+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.106:6793/0 conn(0x7fc784002870 legacy=0x7fc784004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc784009e50 con 0x7fc784009110 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200502508 0 0) 0x7fc784009e50 con 0x7fc784009110 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient(hunting): my global_id is 204704 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7840065d0 con 0x7fc784009110 2024-04-26T00:02:50.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2051227379 0 0) 0x7fc7840065d0 con 0x7fc784009110 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc784009e50 con 0x7fc784009110 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc798004f10 con 0x7fc784009110 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient: dump: 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.720 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2007787600 0 0) 0x7fc784009e50 con 0x7fc784009110 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc78400c3e0 con 0x7fc784009110 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 3814911298) 0x7fc798007220 con 0x7fc784009110 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:50.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.106:6793/0 conn(0x7fc784009110 legacy=0x7fc7840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc78b7fe640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.106:6793/0 conn(0x7fc784009110 legacy=0x7fc7840095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 117462, 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:50.722 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.723 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.724 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.725 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:50.726 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.727 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.728 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:50.729 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.730 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.732 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:50.733 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.735 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:50.737 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:50.738 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.739 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.740 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.741 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:50.741 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:50.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.171:6812/722422047 conn(0x7fc790037f00 legacy=0x7fc79003a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 10 monclient: shutdown 2024-04-26T00:02:50.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 >> v1:172.21.15.106:6792/0 conn(0x7fc7a40a4820 legacy=0x7fc7a412c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a37fe640 1 -- 172.21.15.106:0/2706080806 reap_dead start 2024-04-26T00:02:50.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a37fe640 1 -- 172.21.15.106:0/2706080806 reap_dead start 2024-04-26T00:02:50.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 shutdown_connections 2024-04-26T00:02:50.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 >> 172.21.15.106:0/2706080806 conn(0x7fc7a40a9e20 msgr2=0x7fc7a4130b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 shutdown_connections 2024-04-26T00:02:50.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.722+0000 7fc7a92da640 1 -- 172.21.15.106:0/2706080806 wait complete. 2024-04-26T00:02:50.743 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:50.743 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:02:50.743 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.882+0000 7f95b2f39640 10 monclient: get_monmap_and_config 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.882+0000 7f95b2f39640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.882+0000 7f95b2f39640 10 monclient: monmap: 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:50.890313+0000 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:50.890313+0000 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.866 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.867 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 Processor -- start 2024-04-26T00:02:50.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- start start 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: init 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: _add_conns ranks=[0,1,6,4,8,2,7,3,5] 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient(hunting): picked mon.noname-a con 0x7f95ac06e3e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient(hunting): picked mon.noname-f con 0x7f95ac06fba0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient(hunting): picked mon.noname-d con 0x7f95ac06eed0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac070f80 con 0x7f95ac06e3e0 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac071e00 con 0x7f95ac06fba0 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac0709c0 con 0x7f95ac06eed0 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient(hunting): authenticate will time out at 1426.417364s 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b0cd5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f95ac06e3e0 0x7f95ac06e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34630/0 (socket says 172.21.15.106:34630) 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b0cd5640 1 -- 172.21.15.106:0/3211547247 learned_addr learned my addr 172.21.15.106:0/3211547247 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2958895283 0 0) 0x7f959c001120 con 0x7f95ac06e3e0 2024-04-26T00:02:50.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): my global_id is 7227 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9594005740 con 0x7f95ac06e3e0 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2417685572 0 0) 0x7f95ac0709c0 con 0x7f95ac06eed0 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient(hunting): my global_id is 7188 2024-04-26T00:02:50.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f959c001120 con 0x7f95ac06eed0 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 697008793 0 0) 0x7f9594005740 con 0x7f95ac06e3e0 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 >> v1:172.21.15.106:6792/0 conn(0x7f95ac06eed0 legacy=0x7f95ac13c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 >> v1:172.21.15.171:6789/0 conn(0x7f95ac06fba0 legacy=0x7f95ac1391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 monclient: found mon.noname-a 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac070ca0 con 0x7f95ac06e3e0 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f959c001990 con 0x7f95ac06e3e0 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 5 monclient: authenticate success, global_id 7227 2024-04-26T00:02:50.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: dump: 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.878 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f959c001c00 con 0x7f95ac06e3e0 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 4 set_mon_vals no callback set 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 1 -- 172.21.15.106:0/3211547247 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f959c004bf0 con 0x7f95ac06e3e0 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95ab7fe640 10 monclient: dump: 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.879 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: shutdown 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- 172.21.15.106:0/3211547247 >> v1:172.21.15.106:6789/0 conn(0x7f95ac06e3e0 legacy=0x7f95ac06e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- 172.21.15.106:0/3211547247 shutdown_connections 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- 172.21.15.106:0/3211547247 >> 172.21.15.106:0/3211547247 conn(0x7f95ac0a64e0 msgr2=0x7f95ac0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- 172.21.15.106:0/3211547247 shutdown_connections 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- 172.21.15.106:0/3211547247 wait complete. 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: build_initial_monmap 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: monmap: 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.881 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 Processor -- start 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 1 -- start start 2024-04-26T00:02:50.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.886+0000 7f95b2f39640 10 monclient: init 2024-04-26T00:02:50.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:50.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient: _add_conns ranks=[6,3,0,2,5,1,7,8,4] 2024-04-26T00:02:50.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient(hunting): picked mon.noname-d con 0x7f95ac06e3e0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient(hunting): picked mon.noname-g con 0x7f95ac06eed0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient(hunting): picked mon.noname-a con 0x7f95ac06fba0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac1a4be0 con 0x7f95ac06fba0 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac072060 con 0x7f95ac06eed0 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f95ac1a28f0 con 0x7f95ac06e3e0 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient(hunting): authenticate will time out at 1426.420538s 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b0cd5640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f95ac06e3e0 0x7f95ac1b7450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50002/0 (socket says 172.21.15.106:50002) 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b0cd5640 1 -- 172.21.15.106:0/3727027560 learned_addr learned my addr 172.21.15.106:0/3727027560 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:50.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3127836429 0 0) 0x7f95ac1a4be0 con 0x7f95ac06fba0 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): my global_id is 7236 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9598003530 con 0x7f95ac06fba0 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2994609742 0 0) 0x7f95ac1a28f0 con 0x7f95ac06e3e0 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): my global_id is 7197 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95ac1a4be0 con 0x7f95ac06e3e0 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3043591461 0 0) 0x7f9598003530 con 0x7f95ac06fba0 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95ac1a28f0 con 0x7f95ac06fba0 2024-04-26T00:02:50.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f95a4001900 con 0x7f95ac06fba0 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): dump: 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.887 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3113391639 0 0) 0x7f95ac1a4be0 con 0x7f95ac06e3e0 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9598003530 con 0x7f95ac06e3e0 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f959c004b30 con 0x7f95ac06e3e0 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): dump: 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.888 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2658204326 0 0) 0x7f95ac072060 con 0x7f95ac06eed0 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): my global_id is 214149 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95ac1a4be0 con 0x7f95ac06eed0 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3144965960 0 0) 0x7f95ac1a28f0 con 0x7f95ac06fba0 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.106:6792/0 conn(0x7f95ac06e3e0 legacy=0x7f95ac1b7450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.171:6790/0 conn(0x7f95ac06eed0 legacy=0x7f95ac1cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 monclient: found mon.a 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:50.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95ac1a4900 con 0x7f95ac06fba0 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 5 monclient: authenticate success, global_id 7236 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient: _renew_subs 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f95ac1a3160 con 0x7f95ac06fba0 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient: _renew_subs 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f95ac1b7d30 con 0x7f95ac06fba0 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95a4001b20 con 0x7f95ac06fba0 2024-04-26T00:02:50.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f95a4003f70 con 0x7f95ac06fba0 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95aaffd640 4 set_mon_vals no callback set 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: dump: 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.892 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f958c0065d0 con 0x7f958c002870 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f95a400ed10 con 0x7f95ac06fba0 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f95a4044380 con 0x7f95ac06fba0 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95abfff640 10 monclient: get_auth_request con 0x7f9598037e40 auth_method 0 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2760326294 0 0) 0x7f958c0065d0 con 0x7f958c002870 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient(hunting): my global_id is 145639 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95ac1a28f0 con 0x7f958c002870 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3114399185 0 0) 0x7f95ac1a28f0 con 0x7f958c002870 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f958c0065d0 con 0x7f958c002870 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f959c001c00 con 0x7f958c002870 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 10 monclient: dump: 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.894 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2402010812 0 0) 0x7f958c0065d0 con 0x7f958c002870 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.890+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f958c00a160 con 0x7f958c002870 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.894+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f959c0053c0 con 0x7f958c002870 2024-04-26T00:02:50.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.894+0000 7f95a97fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:50.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.894+0000 7f95a97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:50.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.894+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.171:6789/0 conn(0x7f958c002870 legacy=0x7f958c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.894+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.171:6789/0 conn(0x7f958c002870 legacy=0x7f958c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95b2f39640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f958c009e50 con 0x7f958c009110 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044231966 0 0) 0x7f958c009e50 con 0x7f958c009110 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95a97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95a97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95a97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95a97fa640 10 monclient(hunting): my global_id is 145648 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.898+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f958c0065d0 con 0x7f958c009110 2024-04-26T00:02:50.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2244512858 0 0) 0x7f958c0065d0 con 0x7f958c009110 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f958c009e50 con 0x7f958c009110 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f959c005ba0 con 0x7f958c009110 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 10 monclient: dump: 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:50.898 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1522584445 0 0) 0x7f958c009e50 con 0x7f958c009110 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f958c00c3e0 con 0x7f958c009110 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1437961775) 0x7f959c008870 con 0x7f958c009110 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:50.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.171:6789/0 conn(0x7f958c009110 legacy=0x7f958c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95a97fa640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.171:6789/0 conn(0x7f958c009110 legacy=0x7f958c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 234433, 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:50.900 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:50.901 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:50.902 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:50.903 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:50.904 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.905 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.906 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:50.907 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:50.909 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:50.910 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:50.912 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.913 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:50.914 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.915 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:50.916 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.917 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:50.918 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.171:6812/722422047 conn(0x7f9598037e40 legacy=0x7f959803a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 10 monclient: shutdown 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 >> v1:172.21.15.106:6789/0 conn(0x7f95ac06fba0 legacy=0x7f95ac1d0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b14d6640 1 -- 172.21.15.106:0/3727027560 reap_dead start 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b14d6640 1 -- 172.21.15.106:0/3727027560 reap_dead start 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 shutdown_connections 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 >> 172.21.15.106:0/3727027560 conn(0x7f95ac0a64e0 msgr2=0x7f95ac1bb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 shutdown_connections 2024-04-26T00:02:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:50.902+0000 7f95b2f39640 1 -- 172.21.15.106:0/3727027560 wait complete. 2024-04-26T00:02:50.921 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:50.921 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:02:50.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:02:51.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient: get_monmap_and_config 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient: monmap: 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:51.059183+0000 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:51.059183+0000 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.035 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.036 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.036 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.036 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.036 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.036 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.036 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 1 Processor -- start 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 1 -- start start 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient: init 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient: _add_conns ranks=[5,2,6,7,4,0,3,8,1] 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient(hunting): picked mon.noname-h con 0x7f9b48137730 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient(hunting): picked mon.noname-b con 0x7f9b480a0b20 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient(hunting): picked mon.noname-d con 0x7f9b48138220 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b480a2750 con 0x7f9b480a0b20 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b480a2a30 con 0x7f9b48137730 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b480a2d10 con 0x7f9b48138220 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4c90f640 10 monclient(hunting): authenticate will time out at 1426.587090s 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b46d9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9b48138220 0x7f9b48140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50012/0 (socket says 172.21.15.106:50012) 2024-04-26T00:02:51.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b45d9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f9b480a0b20 0x7f9b4813ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55408/0 (socket says 172.21.15.106:55408) 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b46d9d640 1 -- 172.21.15.106:0/2727778287 learned_addr learned my addr 172.21.15.106:0/2727778287 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299836436 0 0) 0x7f9b480a2750 con 0x7f9b480a0b20 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): my global_id is 7013 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b30003530 con 0x7f9b480a0b20 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026099844 0 0) 0x7f9b480a2d10 con 0x7f9b48138220 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient(hunting): my global_id is 7206 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b480a2750 con 0x7f9b48138220 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3945746166 0 0) 0x7f9b480a2750 con 0x7f9b48138220 2024-04-26T00:02:51.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 >> v1:172.21.15.171:6791/0 conn(0x7f9b48137730 legacy=0x7f9b48137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 >> v1:172.21.15.106:6790/0 conn(0x7f9b480a0b20 legacy=0x7f9b4813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 monclient: found mon.noname-d 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b480a4680 con 0x7f9b48138220 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b40001a50 con 0x7f9b48138220 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.054+0000 7f9b4559a640 10 monclient: dump: 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.045 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 5 monclient: authenticate success, global_id 7206 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b40001db0 con 0x7f9b48138220 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4559a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4559a640 1 -- 172.21.15.106:0/2727778287 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b40004f70 con 0x7f9b48138220 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4559a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4559a640 10 monclient: dump: 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.047 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 4 set_mon_vals no callback set 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: shutdown 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- 172.21.15.106:0/2727778287 >> v1:172.21.15.106:6792/0 conn(0x7f9b48138220 legacy=0x7f9b48140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- 172.21.15.106:0/2727778287 shutdown_connections 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- 172.21.15.106:0/2727778287 >> 172.21.15.106:0/2727778287 conn(0x7f9b480a6b80 msgr2=0x7f9b480a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- 172.21.15.106:0/2727778287 shutdown_connections 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- 172.21.15.106:0/2727778287 wait complete. 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: monmap: 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.049 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 Processor -- start 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- start start 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: init 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: _add_conns ranks=[7,1,4,6,3,8,0,2,5] 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient(hunting): picked mon.noname-i con 0x7f9b480a0b20 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient(hunting): picked mon.noname-f con 0x7f9b48137730 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient(hunting): picked mon.noname-c con 0x7f9b48138220 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4809f2b0 con 0x7f9b48137730 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4809c810 con 0x7f9b48138220 2024-04-26T00:02:51.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b4809de00 con 0x7f9b480a0b20 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient(hunting): authenticate will time out at 1426.590326s 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b46d9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9b48138220 0x7f9b481d4a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55490/0 (socket says 172.21.15.106:55490) 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b46d9d640 1 -- 172.21.15.106:0/4014071282 learned_addr learned my addr 172.21.15.106:0/4014071282 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2511643394 0 0) 0x7f9b4809c810 con 0x7f9b48138220 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): my global_id is 145651 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b28003530 con 0x7f9b48138220 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 795808165 0 0) 0x7f9b28003530 con 0x7f9b48138220 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b4809c810 con 0x7f9b48138220 2024-04-26T00:02:51.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b40001b30 con 0x7f9b48138220 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): dump: 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.052 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2299354002 0 0) 0x7f9b4809c810 con 0x7f9b48138220 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.171:6792/0 conn(0x7f9b480a0b20 legacy=0x7f9b4809b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.171:6789/0 conn(0x7f9b48137730 legacy=0x7f9b4809c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 monclient: found mon.c 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4809d740 con 0x7f9b48138220 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 5 monclient: authenticate success, global_id 145651 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: _renew_subs 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4809f590 con 0x7f9b48138220 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: _renew_subs 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b480a05f0 con 0x7f9b48138220 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9b40001d70 con 0x7f9b48138220 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b400054a0 con 0x7f9b48138220 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b44d99640 4 set_mon_vals no callback set 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b36ffd640 10 monclient: dump: 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.055 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.058+0000 7f9b4c90f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9b2c0065d0 con 0x7f9b2c002870 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9b40010240 con 0x7f9b48138220 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f9b400454c0 con 0x7f9b48138220 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1113036338 0 0) 0x7f9b2c0065d0 con 0x7f9b2c002870 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b45d9b640 10 monclient: get_auth_request con 0x7f9b280377e0 auth_method 0 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient(hunting): my global_id is 214158 2024-04-26T00:02:51.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b4809c810 con 0x7f9b2c002870 2024-04-26T00:02:51.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2928954878 0 0) 0x7f9b4809c810 con 0x7f9b2c002870 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b2c0065d0 con 0x7f9b2c002870 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b380018f0 con 0x7f9b2c002870 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient: dump: 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.059 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2669934605 0 0) 0x7f9b2c0065d0 con 0x7f9b2c002870 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b2c00a160 con 0x7f9b2c002870 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9b38001d00 con 0x7f9b2c002870 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.171:6790/0 conn(0x7f9b2c002870 legacy=0x7f9b2c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.062+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.171:6790/0 conn(0x7f9b2c002870 legacy=0x7f9b2c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:51.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9b2c009e50 con 0x7f9b2c009110 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381853202 0 0) 0x7f9b2c009e50 con 0x7f9b2c009110 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient(hunting): my global_id is 214167 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b2c0065d0 con 0x7f9b2c009110 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3813253217 0 0) 0x7f9b2c0065d0 con 0x7f9b2c009110 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b2c009e50 con 0x7f9b2c009110 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9b38003bd0 con 0x7f9b2c009110 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient: dump: 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.061 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2283446271 0 0) 0x7f9b2c009e50 con 0x7f9b2c009110 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9b2c00c3e0 con 0x7f9b2c009110 2024-04-26T00:02:51.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 3051878567) 0x7f9b38005da0 con 0x7f9b2c009110 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.171:6790/0 conn(0x7f9b2c009110 legacy=0x7f9b2c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b36ffd640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.171:6790/0 conn(0x7f9b2c009110 legacy=0x7f9b2c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 1495, 2024-04-26T00:02:51.063 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:51.064 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:51.065 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:51.066 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:51.067 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:51.068 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.069 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.070 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.071 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.072 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.073 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.074 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.075 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:51.076 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.078 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:51.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:51.080 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.171:6812/722422047 conn(0x7f9b280377e0 legacy=0x7f9b28039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 10 monclient: shutdown 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 >> v1:172.21.15.106:6791/0 conn(0x7f9b48138220 legacy=0x7f9b481d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b46d9d640 1 -- 172.21.15.106:0/4014071282 reap_dead start 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b46d9d640 1 -- 172.21.15.106:0/4014071282 reap_dead start 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 shutdown_connections 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 >> 172.21.15.106:0/4014071282 conn(0x7f9b480a6b80 msgr2=0x7f9b48135350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 shutdown_connections 2024-04-26T00:02:51.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.070+0000 7f9b4c90f640 1 -- 172.21.15.106:0/4014071282 wait complete. 2024-04-26T00:02:51.083 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:51.083 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:02:51.083 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.214+0000 7f547acaa640 10 monclient: get_monmap_and_config 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.214+0000 7f547acaa640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.214+0000 7f547acaa640 10 monclient: monmap: 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:51.222225+0000 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:51.222225+0000 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.198 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.199 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.199 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.199 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.199 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.199 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.199 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.199 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 Processor -- start 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- start start 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: init 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: _add_conns ranks=[2,5,1,6,0,7,3,4,8] 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient(hunting): picked mon.noname-b con 0x7f54741357a0 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient(hunting): picked mon.noname-h con 0x7f5474135390 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient(hunting): picked mon.noname-f con 0x7f5474071d30 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5474136290 con 0x7f5474071d30 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54740724c0 con 0x7f54741357a0 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f54740a5110 con 0x7f5474135390 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient(hunting): authenticate will time out at 1426.749317s 2024-04-26T00:02:51.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f5478a46640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f54741357a0 0x7f5474135b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55412/0 (socket says 172.21.15.106:55412) 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f5478a46640 1 -- 172.21.15.106:0/4070823915 learned_addr learned my addr 172.21.15.106:0/4070823915 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 226324889 0 0) 0x7f54740724c0 con 0x7f54741357a0 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient(hunting): my global_id is 7022 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f545c003530 con 0x7f54741357a0 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2055619110 0 0) 0x7f545c003530 con 0x7f54741357a0 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 >> v1:172.21.15.171:6791/0 conn(0x7f5474135390 legacy=0x7f547413a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 >> v1:172.21.15.171:6789/0 conn(0x7f5474071d30 legacy=0x7f547413dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 monclient: found mon.noname-b 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:02:51.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5474070fa0 con 0x7f54741357a0 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f546c0017c0 con 0x7f54741357a0 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: dump: 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.208 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 5 monclient: authenticate success, global_id 7022 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f546c001ab0 con 0x7f54741357a0 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 1 -- 172.21.15.106:0/4070823915 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f546c004bf0 con 0x7f54741357a0 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:51.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f54737fe640 10 monclient: dump: 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.210 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 4 set_mon_vals no callback set 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: shutdown 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- 172.21.15.106:0/4070823915 >> v1:172.21.15.106:6790/0 conn(0x7f54741357a0 legacy=0x7f5474135b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- 172.21.15.106:0/4070823915 shutdown_connections 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- 172.21.15.106:0/4070823915 >> 172.21.15.106:0/4070823915 conn(0x7f54740a8370 msgr2=0x7f54740a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- 172.21.15.106:0/4070823915 shutdown_connections 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- 172.21.15.106:0/4070823915 wait complete. 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: monmap: 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:51.211 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 Processor -- start 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 1 -- start start 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.218+0000 7f547acaa640 10 monclient: init 2024-04-26T00:02:51.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient: _add_conns ranks=[4,8,5,7,2,1,6,0,3] 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient(hunting): picked mon.noname-c con 0x7f5474071d30 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient(hunting): picked mon.noname-e con 0x7f5474135390 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient(hunting): picked mon.noname-h con 0x7f54741357a0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f547409c5d0 con 0x7f5474071d30 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f547409de90 con 0x7f54741357a0 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f547409cef0 con 0x7f5474135390 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient(hunting): authenticate will time out at 1426.752366s 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f5473fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f5474135390 0x7f547409b1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:39136/0 (socket says 172.21.15.106:39136) 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f5478a46640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f5474071d30 0x7f547409aac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55506/0 (socket says 172.21.15.106:55506) 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f5473fff640 1 -- 172.21.15.106:0/3347372361 learned_addr learned my addr 172.21.15.106:0/3347372361 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3645855198 0 0) 0x7f547409c5d0 con 0x7f5474071d30 2024-04-26T00:02:51.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): my global_id is 145660 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5460003530 con 0x7f5474071d30 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279771453 0 0) 0x7f547409cef0 con 0x7f5474135390 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): my global_id is 204713 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f547409c5d0 con 0x7f5474135390 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 691245487 0 0) 0x7f5460003530 con 0x7f5474071d30 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f547409cef0 con 0x7f5474071d30 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f546c001780 con 0x7f5474071d30 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:51.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): dump: 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.215 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2254407605 0 0) 0x7f547409c5d0 con 0x7f5474135390 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5460003530 con 0x7f5474135390 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f54680019e0 con 0x7f5474135390 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): dump: 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.216 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3656595734 0 0) 0x7f547409de90 con 0x7f54741357a0 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): my global_id is 7016 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f547409c5d0 con 0x7f54741357a0 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3142307379 0 0) 0x7f547409cef0 con 0x7f5474071d30 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.106:6793/0 conn(0x7f5474135390 legacy=0x7f547409b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.171:6791/0 conn(0x7f54741357a0 legacy=0x7f54741d27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 monclient: found mon.c 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f547409b8e0 con 0x7f5474071d30 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 5 monclient: authenticate success, global_id 145660 2024-04-26T00:02:51.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient: _renew_subs 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f54740a1450 con 0x7f5474071d30 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient: _renew_subs 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5474134cf0 con 0x7f5474071d30 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f546c001ab0 con 0x7f5474071d30 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f546c001ce0 con 0x7f5474071d30 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f5472ffd640 4 set_mon_vals no callback set 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: dump: 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.219 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f54540065d0 con 0x7f5454002870 2024-04-26T00:02:51.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f546c010050 con 0x7f5474071d30 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f546c045110 con 0x7f5474071d30 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f5479247640 10 monclient: get_auth_request con 0x7f5460037ee0 auth_method 0 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320683473 0 0) 0x7f54540065d0 con 0x7f5454002870 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient(hunting): my global_id is 7025 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f547409cef0 con 0x7f5454002870 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2486680719 0 0) 0x7f547409cef0 con 0x7f5454002870 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f54540065d0 con 0x7f5454002870 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5468003b90 con 0x7f5454002870 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 10 monclient: dump: 2024-04-26T00:02:51.221 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.222 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2984625726 0 0) 0x7f54540065d0 con 0x7f5454002870 2024-04-26T00:02:51.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.222+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f545400a160 con 0x7f5454002870 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.226+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f54680057d0 con 0x7f5454002870 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.226+0000 7f54717fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.226+0000 7f54717fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.226+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.171:6791/0 conn(0x7f5454002870 legacy=0x7f5454004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.226+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.171:6791/0 conn(0x7f5454002870 legacy=0x7f5454004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f547acaa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5454009e30 con 0x7f54540090f0 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3770512864 0 0) 0x7f5454009e30 con 0x7f54540090f0 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 10 monclient(hunting): my global_id is 7034 2024-04-26T00:02:51.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f54540065d0 con 0x7f54540090f0 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 563488950 0 0) 0x7f54540065d0 con 0x7f54540090f0 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5454009e30 con 0x7f54540090f0 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5468004360 con 0x7f54540090f0 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 10 monclient: dump: 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.225 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 978357396 0 0) 0x7f5454009e30 con 0x7f54540090f0 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.230+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f545400c3a0 con 0x7f54540090f0 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 722800331) 0x7f5468005980 con 0x7f54540090f0 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f54717fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f54717fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.171:6791/0 conn(0x7f54540090f0 legacy=0x7f5454009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f54717fa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.171:6791/0 conn(0x7f54540090f0 legacy=0x7f5454009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 489735, 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:51.227 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.228 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.229 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:51.230 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.231 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:51.233 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.234 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:51.235 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.236 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.237 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.238 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:51.239 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.241 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:51.242 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:51.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:51.244 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.171:6812/722422047 conn(0x7f5460037ee0 legacy=0x7f546003a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 10 monclient: shutdown 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 >> v1:172.21.15.106:6791/0 conn(0x7f5474071d30 legacy=0x7f547409aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f5479247640 1 -- 172.21.15.106:0/3347372361 reap_dead start 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f5479247640 1 -- 172.21.15.106:0/3347372361 reap_dead start 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 shutdown_connections 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 >> 172.21.15.106:0/3347372361 conn(0x7f54740a8370 msgr2=0x7f547412e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 shutdown_connections 2024-04-26T00:02:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.234+0000 7f547acaa640 1 -- 172.21.15.106:0/3347372361 wait complete. 2024-04-26T00:02:51.247 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:51.247 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:02:51.247 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:02:51.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.382+0000 7fda5f441640 10 monclient: get_monmap_and_config 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.382+0000 7fda5f441640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.382+0000 7fda5f441640 10 monclient: monmap: 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:51.390176+0000 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:51.390176+0000 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.366 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.367 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.367 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.367 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.367 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.367 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.367 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.367 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 Processor -- start 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- start start 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient: init 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient: _add_conns ranks=[2,0,5,7,6,3,8,4,1] 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient(hunting): picked mon.noname-b con 0x7fda58134820 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient(hunting): picked mon.noname-a con 0x7fda580725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient(hunting): picked mon.noname-h con 0x7fda5813ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:51.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda58071270 con 0x7fda580725d0 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda580714e0 con 0x7fda58134820 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda580729f0 con 0x7fda5813ace0 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient(hunting): authenticate will time out at 1426.917274s 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5d1dd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fda58134820 0x7fda58134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55424/0 (socket says 172.21.15.106:55424) 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5d1dd640 1 -- 172.21.15.106:0/2971139116 learned_addr learned my addr 172.21.15.106:0/2971139116 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161138085 0 0) 0x7fda58071270 con 0x7fda580725d0 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): my global_id is 7245 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda44003530 con 0x7fda580725d0 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 171892039 0 0) 0x7fda4c001120 con 0x7fda58134820 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): my global_id is 7031 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda58071270 con 0x7fda58134820 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3476177081 0 0) 0x7fda580729f0 con 0x7fda5813ace0 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient(hunting): my global_id is 7043 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda4c001120 con 0x7fda5813ace0 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4196684926 0 0) 0x7fda44003530 con 0x7fda580725d0 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 >> v1:172.21.15.171:6791/0 conn(0x7fda5813ace0 legacy=0x7fda5813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 >> v1:172.21.15.106:6790/0 conn(0x7fda58134820 legacy=0x7fda58134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 monclient: found mon.noname-a 2024-04-26T00:02:51.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda580717c0 con 0x7fda580725d0 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda540017c0 con 0x7fda580725d0 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 5 monclient: authenticate success, global_id 7245 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: dump: 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.377 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:51.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda54001a20 con 0x7fda580725d0 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 1 -- 172.21.15.106:0/2971139116 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda54003960 con 0x7fda580725d0 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 4 set_mon_vals no callback set 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda4bfff640 10 monclient: dump: 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.379 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient: shutdown 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- 172.21.15.106:0/2971139116 >> v1:172.21.15.106:6789/0 conn(0x7fda580725d0 legacy=0x7fda581395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- 172.21.15.106:0/2971139116 shutdown_connections 2024-04-26T00:02:51.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- 172.21.15.106:0/2971139116 >> 172.21.15.106:0/2971139116 conn(0x7fda580a64e0 msgr2=0x7fda580a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- 172.21.15.106:0/2971139116 shutdown_connections 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 -- 172.21.15.106:0/2971139116 wait complete. 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 10 monclient: monmap: 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.386+0000 7fda5f441640 1 Processor -- start 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 1 -- start start 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient: init 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient: _add_conns ranks=[0,1,3,7,8,6,5,2,4] 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient(hunting): picked mon.noname-a con 0x7fda580725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient(hunting): picked mon.noname-f con 0x7fda58134820 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient(hunting): picked mon.noname-g con 0x7fda5813ace0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5813cba0 con 0x7fda580725d0 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda5813b660 con 0x7fda58134820 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda581cd5a0 con 0x7fda5813ace0 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient(hunting): authenticate will time out at 1426.920548s 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5d1dd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fda580725d0 0x7fda581cc780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34656/0 (socket says 172.21.15.106:34656) 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5d1dd640 1 -- 172.21.15.106:0/3216531663 learned_addr learned my addr 172.21.15.106:0/3216531663 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527893873 0 0) 0x7fda4c001bf0 con 0x7fda580725d0 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): my global_id is 7254 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda3c003530 con 0x7fda580725d0 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1230827595 0 0) 0x7fda3c003530 con 0x7fda580725d0 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda4c001bf0 con 0x7fda580725d0 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda4c0047f0 con 0x7fda580725d0 2024-04-26T00:02:51.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): dump: 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.384 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2428226708 0 0) 0x7fda4c001bf0 con 0x7fda580725d0 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.171:6790/0 conn(0x7fda5813ace0 legacy=0x7fda581d4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.171:6789/0 conn(0x7fda58134820 legacy=0x7fda581cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 monclient: found mon.a 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda58139450 con 0x7fda580725d0 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 5 monclient: authenticate success, global_id 7254 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient: _renew_subs 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda5813b940 con 0x7fda580725d0 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient: _renew_subs 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fda5813b380 con 0x7fda580725d0 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda4c004d90 con 0x7fda580725d0 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda4c005300 con 0x7fda580725d0 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda4b7fe640 4 set_mon_vals no callback set 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: dump: 2024-04-26T00:02:51.386 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.387 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda380065d0 con 0x7fda38002870 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fda4c0054a0 con 0x7fda580725d0 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fda4c045630 con 0x7fda580725d0 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda5d9de640 10 monclient: get_auth_request con 0x7fda3c0378b0 auth_method 0 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979663928 0 0) 0x7fda380065d0 con 0x7fda38002870 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient(hunting): my global_id is 145519 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda4c001bf0 con 0x7fda38002870 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1965901012 0 0) 0x7fda4c001bf0 con 0x7fda38002870 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda380065d0 con 0x7fda38002870 2024-04-26T00:02:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda54003940 con 0x7fda38002870 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 10 monclient: dump: 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 109353425 0 0) 0x7fda380065d0 con 0x7fda38002870 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.390+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda3800a160 con 0x7fda38002870 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.394+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fda54001140 con 0x7fda38002870 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.394+0000 7fda49ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.394+0000 7fda49ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.394+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.171:6792/0 conn(0x7fda38002870 legacy=0x7fda38004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.394+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.171:6792/0 conn(0x7fda38002870 legacy=0x7fda38004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda5f441640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda38009e50 con 0x7fda38009110 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 642685205 0 0) 0x7fda38009e50 con 0x7fda38009110 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 10 monclient(hunting): my global_id is 145528 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda380065d0 con 0x7fda38009110 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2844092745 0 0) 0x7fda380065d0 con 0x7fda38009110 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda38009e50 con 0x7fda38009110 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda54004000 con 0x7fda38009110 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 10 monclient: dump: 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3222351841 0 0) 0x7fda38009e50 con 0x7fda38009110 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.398+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fda3800c3e0 con 0x7fda38009110 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 57807472) 0x7fda54006280 con 0x7fda38009110 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda49ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda49ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.171:6792/0 conn(0x7fda38009110 legacy=0x7fda380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda49ffb640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.171:6792/0 conn(0x7fda38009110 legacy=0x7fda380095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:51.397 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:51.397 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 234933, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:51.398 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.399 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.400 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:51.401 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:51.402 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.403 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:51.404 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:51.406 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:51.408 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.410 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.411 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:51.412 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:51.413 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:51.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:51.415 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:51.416 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:51.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.171:6812/722422047 conn(0x7fda3c0378b0 legacy=0x7fda3c039d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 10 monclient: shutdown 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 >> v1:172.21.15.106:6789/0 conn(0x7fda580725d0 legacy=0x7fda581cc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5d9de640 1 -- 172.21.15.106:0/3216531663 reap_dead start 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5d9de640 1 -- 172.21.15.106:0/3216531663 reap_dead start 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 shutdown_connections 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 >> 172.21.15.106:0/3216531663 conn(0x7fda580a64e0 msgr2=0x7fda580a1780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 shutdown_connections 2024-04-26T00:02:51.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.402+0000 7fda5f441640 1 -- 172.21.15.106:0/3216531663 wait complete. 2024-04-26T00:02:51.418 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:51.419 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:02:51.419 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:02:51.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.550+0000 7fdffe964640 10 monclient: get_monmap_and_config 2024-04-26T00:02:51.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.550+0000 7fdffe964640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.550+0000 7fdffe964640 10 monclient: monmap: 2024-04-26T00:02:51.532 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:51.556655+0000 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:51.556655+0000 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.533 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.534 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.534 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.550+0000 7fdffe964640 1 Processor -- start 2024-04-26T00:02:51.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.550+0000 7fdffe964640 1 -- start start 2024-04-26T00:02:51.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.550+0000 7fdffe964640 10 monclient: init 2024-04-26T00:02:51.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: _add_conns ranks=[7,0,6,2,8,3,5,1,4] 2024-04-26T00:02:51.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): picked mon.noname-i con 0x7fdff8135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): picked mon.noname-a con 0x7fdff81353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): picked mon.noname-d con 0x7fdff813bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff806f2d0 con 0x7fdff81353b0 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff8072330 con 0x7fdff813bdf0 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff8072610 con 0x7fdff8135870 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): authenticate will time out at 1427.084554s 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdfef7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdff81353b0 0x7fdff813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34672/0 (socket says 172.21.15.106:34672) 2024-04-26T00:02:51.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdfef7fe640 1 -- 172.21.15.106:0/4119977193 learned_addr learned my addr 172.21.15.106:0/4119977193 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffcf01640 1 --1- 172.21.15.106:0/4119977193 >> v1:172.21.15.106:6792/0 conn(0x7fdff813bdf0 0x7fdff813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50018/0 (socket says 172.21.15.106:50018) 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1555966410 0 0) 0x7fdff8072330 con 0x7fdff813bdf0 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): my global_id is 7215 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfe4003530 con 0x7fdff813bdf0 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 86556378 0 0) 0x7fdff806f2d0 con 0x7fdff81353b0 2024-04-26T00:02:51.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient(hunting): my global_id is 7263 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdff8072330 con 0x7fdff81353b0 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 907765815 0 0) 0x7fdfe4003530 con 0x7fdff813bdf0 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 >> v1:172.21.15.171:6792/0 conn(0x7fdff8135870 legacy=0x7fdff8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 >> v1:172.21.15.106:6789/0 conn(0x7fdff81353b0 legacy=0x7fdff813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 monclient: found mon.noname-d 2024-04-26T00:02:51.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:02:51.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff80a3260 con 0x7fdff813bdf0 2024-04-26T00:02:51.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdff0001b40 con 0x7fdff813bdf0 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 5 monclient: authenticate success, global_id 7215 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: dump: 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.546 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.547 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdff0001e20 con 0x7fdff813bdf0 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 1 -- 172.21.15.106:0/4119977193 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdff0004eb0 con 0x7fdff813bdf0 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 4 set_mon_vals no callback set 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdff77fe640 10 monclient: dump: 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.548 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: shutdown 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- 172.21.15.106:0/4119977193 >> v1:172.21.15.106:6792/0 conn(0x7fdff813bdf0 legacy=0x7fdff813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- 172.21.15.106:0/4119977193 shutdown_connections 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- 172.21.15.106:0/4119977193 >> 172.21.15.106:0/4119977193 conn(0x7fdff80a64e0 msgr2=0x7fdff80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- 172.21.15.106:0/4119977193 shutdown_connections 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- 172.21.15.106:0/4119977193 wait complete. 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: build_initial_monmap 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: monmap: 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:51.550 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 Processor -- start 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- start start 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: init 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient: _add_conns ranks=[1,2,7,3,8,6,5,0,4] 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): picked mon.noname-f con 0x7fdff81353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): picked mon.noname-b con 0x7fdff8135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): picked mon.noname-i con 0x7fdff813bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff809f930 con 0x7fdff81353b0 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff809f470 con 0x7fdff8135870 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdff8070e70 con 0x7fdff813bdf0 2024-04-26T00:02:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.554+0000 7fdffe964640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 monclient(hunting): authenticate will time out at 1427.088009s 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdfef7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fdff8135870 0x7fdff81d13f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55426/0 (socket says 172.21.15.106:55426) 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdfef7fe640 1 -- 172.21.15.106:0/136829801 learned_addr learned my addr 172.21.15.106:0/136829801 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4162706839 0 0) 0x7fdff809f470 con 0x7fdff8135870 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): my global_id is 7040 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdfd8003530 con 0x7fdff8135870 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 746998763 0 0) 0x7fdfd8003530 con 0x7fdff8135870 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdff809f470 con 0x7fdff8135870 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdfe00014e0 con 0x7fdff8135870 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:51.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): dump: 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1886547503 0 0) 0x7fdff809f470 con 0x7fdff8135870 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 >> v1:172.21.15.171:6792/0 conn(0x7fdff813bdf0 legacy=0x7fdff81d4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 >> v1:172.21.15.171:6789/0 conn(0x7fdff81353b0 legacy=0x7fdff81349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 monclient: found mon.b 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdff8071430 con 0x7fdff8135870 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 5 monclient: authenticate success, global_id 7040 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 monclient: _renew_subs 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdff81350e0 con 0x7fdff8135870 2024-04-26T00:02:51.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 monclient: _renew_subs 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdff80701a0 con 0x7fdff8135870 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdfe0004aa0 con 0x7fdff8135870 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdfe0004f90 con 0x7fdff8135870 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff6ffd640 4 set_mon_vals no callback set 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 10 monclient: dump: 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:51.557 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:51.558 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdfe000fd30 con 0x7fdff8135870 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfdc005090 con 0x7fdff8135870 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fdfe00452d0 con 0x7fdff8135870 2024-04-26T00:02:51.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.558+0000 7fdff7fff640 10 monclient: get_auth_request con 0x7fdfd80376f0 auth_method 0 2024-04-26T00:02:51.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.562+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fdfe0015900 con 0x7fdff8135870 2024-04-26T00:02:51.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.562+0000 7fdff57fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:51.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.562+0000 7fdff57fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:51.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.794+0000 7fdffe964640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:02:51.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.794+0000 7fdffe964640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:02:51.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.794+0000 7fdffe964640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:51.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.794+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fdfdc005b90 con 0x7fdff8135870 2024-04-26T00:02:51.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.798+0000 7fdff57fa640 1 -- 172.21.15.106:0/136829801 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fdfe0015200 con 0x7fdff8135870 2024-04-26T00:02:51.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.798+0000 7fdff57fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:02:51.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.798+0000 7fdff57fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:51.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=11,kv=10,logm=54} crc {auth=1560969644,config=692619927,health=2113251397,kv=3875002534,logm=2638175188}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=12,kv=10,logm=52} crc {auth=3810276800,config=692619927,health=2686426325,kv=3875002534,logm=1416620277}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=26,config=2,health=10,kv=10,logm=52} crc {auth=933072754,config=692619927,health=456364412,kv=3875002534,logm=3191717051}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=25,config=2,health=11,kv=9,logm=53} crc {auth=885900658,config=692619927,health=1605123571,kv=1190676538,logm=884123329}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=25,config=2,health=12,kv=10,logm=51} crc {auth=616152911,config=692619927,health=3495635461,kv=3875002534,logm=394639045}) 2024-04-26T00:02:51.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=22,config=2,health=11,kv=9,logm=56} crc {auth=3983157650,config=692619927,health=2578878242,kv=4062637107,logm=2886644286}) 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=24,config=2,health=12,kv=9,logm=53} crc {auth=3712893734,config=692619927,health=3495635461,kv=3246163658,logm=2269925612}) 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=9,logm=51} crc {auth=933072754,config=692619927,health=3495635462,kv=3246163658,logm=2633646134}) 2024-04-26T00:02:51.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.798+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=23,config=2,health=12,kv=10,logm=53} crc {auth=1206504307,config=692619927,health=3505849290,kv=3875002534,logm=1137560251}) 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 >> v1:172.21.15.171:6812/722422047 conn(0x7fdfd80376f0 legacy=0x7fdfd8039bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 10 monclient: shutdown 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 >> v1:172.21.15.106:6790/0 conn(0x7fdff8135870 legacy=0x7fdff81d13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 shutdown_connections 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 >> 172.21.15.106:0/136829801 conn(0x7fdff80a64e0 msgr2=0x7fdff80a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 shutdown_connections 2024-04-26T00:02:51.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:51.802+0000 7fdffe964640 1 -- 172.21.15.106:0/136829801 wait complete. 2024-04-26T00:02:51.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=994457264}) 2024-04-26T00:02:51.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=519774019}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1019163936}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=893951077}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3329343203}) 2024-04-26T00:02:51.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1271064577}) 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3479876700}) 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1769221254}) 2024-04-26T00:02:51.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.802+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3552389099}) 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.806+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.806+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1821379899}) 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2364312161}) 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2979035777}) 2024-04-26T00:02:51.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1057381667}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3155957535}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2346540444}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=326088841}) 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=666583281}) 2024-04-26T00:02:51.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3878692759}) 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3867347576}) 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.810+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1397135005}) 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2111447774}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3956204366}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3343009519}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1208397444}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3988277468}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1541833722}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=185355000}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2561478569}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4119180598}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.804 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=403903587}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1881769536}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2888463647}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4235739905}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1135721723}) 2024-04-26T00:02:51.805 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942220762}) 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.814+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2010045504}) 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2610848253}) 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295201234}) 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.806 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=14749789}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=160379161}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1590000112}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2195877506}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2632159040}) 2024-04-26T00:02:51.807 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.808 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1029204829}) 2024-04-26T00:02:51.808 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.818+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2378363323}) 2024-04-26T00:02:51.809 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=272669441}) 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=69969856}) 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.831 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1437078980}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3102975789}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2582288278}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2667359208}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3902480933}) 2024-04-26T00:02:51.832 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3805869609}) 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.822+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1258279605}) 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2466601793}) 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1140563266}) 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.833 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=650982945}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4187366318}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=268339983}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=970234865}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2320440314}) 2024-04-26T00:02:51.834 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2287589855}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4220433065}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1722822324}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3930294228}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2166347982}) 2024-04-26T00:02:51.835 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1763464373}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1895936928}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1152067817}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4162646589}) 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.836 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=799557366}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.826+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=571052548}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1543285221}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=965569562}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=485115763}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.837 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3236110533}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3816400394}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2667889744}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2880516444}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208701266}) 2024-04-26T00:02:51.838 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.830+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2325833364}) 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3384984970}) 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3419494814}) 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1185813282}) 2024-04-26T00:02:51.839 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3987261166}) 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3106397886}) 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4053010432}) 2024-04-26T00:02:51.840 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=877036075}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1387535609}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3961454680}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3127918534}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2313888213}) 2024-04-26T00:02:51.841 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2717212350}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2731060716}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3168411857}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2729859956}) 2024-04-26T00:02:51.842 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1011589980}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3949093949}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.834+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=992320436}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3498265843}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2413121380}) 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.843 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3158157517}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3465016227}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2381175353}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2321527613}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.844 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3094621398}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1465901234}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.838+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=906937120}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3756506362}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2136024560}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.845 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4281192721}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1277854848}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1213662606}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=320566139}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=869490561}) 2024-04-26T00:02:51.846 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3211264605}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.842+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=841246195}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2423914277}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=758886764}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3536777148}) 2024-04-26T00:02:51.847 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=682045203}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2978512916}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1388804058}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=939465086}) 2024-04-26T00:02:51.848 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2932907815}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3703292362}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2749737847}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2511122300}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2169357835}) 2024-04-26T00:02:51.849 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1194042495}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1507919926}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3909948815}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3154651884}) 2024-04-26T00:02:51.850 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.851 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3466035373}) 2024-04-26T00:02:51.851 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.846+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=355786130}) 2024-04-26T00:02:51.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3870254666}) 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=715230015}) 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1838194060}) 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2671337256}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1609561214}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1125894658}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4120333844}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=230834751}) 2024-04-26T00:02:51.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.850+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2237228446}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1538758275}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1143866566}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3236461474}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3903131650}) 2024-04-26T00:02:51.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=883648076}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=276591903}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3512755843}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885852317}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.854+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3928360800}) 2024-04-26T00:02:51.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2494135912}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=397835655}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3874828064}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=483524996}) 2024-04-26T00:02:51.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=679096695}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3336968681}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1448265964}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3012577235}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=854707499}) 2024-04-26T00:02:51.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3796883899}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2989513518}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3033448900}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=252385232}) 2024-04-26T00:02:51.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1635740174}) 2024-04-26T00:02:51.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2714520452}) 2024-04-26T00:02:51.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1742385826}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3598718610}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.858+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1306822380}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1847485775}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1542518309}) 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1914178166}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3494499118}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=501811011}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1907962751}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4200316790}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=681775487}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.862+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1591017258}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3348522265}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1115206771}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1088055954}) 2024-04-26T00:02:51.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2319154340}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1654627089}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=334553468}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1200658726}) 2024-04-26T00:02:51.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1840174499}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.866+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2264153658}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4130305617}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1356887558}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1782252847}) 2024-04-26T00:02:51.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=700318508}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2093862699}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3664150092}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2673002974}) 2024-04-26T00:02:51.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4026667485}) 2024-04-26T00:02:51.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=443354271}) 2024-04-26T00:02:51.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3593564335}) 2024-04-26T00:02:51.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3991841237}) 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3986645922}) 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3813794708}) 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4189517131}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2364153441}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2800782122}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=883849739}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.870+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=876430884}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1298949970}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3689020747}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1330259350}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3143154419}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2874405524}) 2024-04-26T00:02:51.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=449433984}) 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3489244266}) 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987537360}) 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.874+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3781250197}) 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1497452654}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=822295625}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=690675422}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3875931329}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2559718125}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2021811788}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=896488668}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=359352648}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=878517463}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2812215198}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=471790363}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3196824579}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1671437646}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1540629359}) 2024-04-26T00:02:51.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2535814121}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=337747108}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739940297}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.878+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2222941595}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=751933852}) 2024-04-26T00:02:51.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1097420223}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133258054}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3980394226}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1515144185}) 2024-04-26T00:02:51.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2742846641}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3912573001}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800137463}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.882+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=719460945}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2866584222}) 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=746648904}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4091377088}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3915537385}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1712242891}) 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=236882309}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4216430522}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4000746997}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.886+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1298351679}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1653924365}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3433504801}) 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=250560435}) 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4273807115}) 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=567083623}) 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3649295143}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3418322783}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=556772437}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1545195527}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2187565302}) 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1854275718}) 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1551961273}) 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2284474636}) 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2557275755}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4258173406}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2144823041}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732496961}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.890+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4051909697}) 2024-04-26T00:02:51.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=597894990}) 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1004994591}) 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4211613892}) 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=245061793}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1403799176}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=146850711}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4029588101}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3119678466}) 2024-04-26T00:02:51.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.894+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=306925719}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3481112309}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=592470061}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2618998672}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3231115752}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=866452511}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=257239945}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=634181226}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=739024925}) 2024-04-26T00:02:51.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.898+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4263730991}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1567222129}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2039469316}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1238779460}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2917705239}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1179851285}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2855300939}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1996956344}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=721828918}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3000240328}) 2024-04-26T00:02:51.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2544556942}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4257350204}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1441449435}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=221388571}) 2024-04-26T00:02:51.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2224015930}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3613968439}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1232861107}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1088804319}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.902+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=382805079}) 2024-04-26T00:02:51.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1315496041}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3689203437}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=992951900}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2770802357}) 2024-04-26T00:02:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=313519507}) 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2602113053}) 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1170315538}) 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2050058333}) 2024-04-26T00:02:51.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.906+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2377431959}) 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=644535869}) 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=387990472}) 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1880001245}) 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=424503176}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3172178162}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=753901517}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2486029858}) 2024-04-26T00:02:51.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1812990598}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3909438954}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4115689013}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1168272900}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=569607150}) 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4205711998}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2362030340}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=616975914}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2456650618}) 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.984 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3027317537}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.910+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=889705445}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2439521606}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=620536142}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1233464347}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3035295667}) 2024-04-26T00:02:51.985 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=793757130}) 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2515394630}) 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2869160161}) 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=291623615}) 2024-04-26T00:02:51.986 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.914+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=910172108}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1371235186}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1246486624}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3315550534}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.987 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3335215484}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1984782853}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2976369549}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=411218880}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638467205}) 2024-04-26T00:02:51.988 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3594207530}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=541782307}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2947489193}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2248932099}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=445988373}) 2024-04-26T00:02:51.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2953058678}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=707433343}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3939659858}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833651049}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.918+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3033990048}) 2024-04-26T00:02:51.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3447088787}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3932297540}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1729151920}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4273484957}) 2024-04-26T00:02:51.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2637689687}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=310640654}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2951692171}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=548537982}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2364186354}) 2024-04-26T00:02:51.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=942016829}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3326587692}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=492502131}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4188219899}) 2024-04-26T00:02:51.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3460628477}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3949131882}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1177333789}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3040955549}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.922+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3505429516}) 2024-04-26T00:02:51.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3725963265}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2374729447}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2488595495}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2983211561}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.995 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2503402796}) 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2947443628}) 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=720055664}) 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=648241390}) 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=295517717}) 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.996 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2227430405}) 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=177197889}) 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4265653515}) 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.926+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2726751059}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3357639590}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1668073103}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=686344566}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059647774}) 2024-04-26T00:02:51.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=979011350}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1597232548}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=677299537}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1809378215}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:51.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2049762920}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1113717084}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1618812225}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2839594844}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2441019400}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.930+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4100251973}) 2024-04-26T00:02:52.000 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1610027940}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=98743545}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2607458299}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1425018535}) 2024-04-26T00:02:52.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3630916208}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1219821713}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=479104224}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=5945967}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.934+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3908807340}) 2024-04-26T00:02:52.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=171676869}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2518994055}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2520198926}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2729812323}) 2024-04-26T00:02:52.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2657349523}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1499103786}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=475146306}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2130222934}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=597162087}) 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2962204999}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1577499336}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=524813882}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1005646877}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=423627161}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3584469788}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2719745193}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4078288982}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.938+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=525169640}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=199500573}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2665914366}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3664346426}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4274803988}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4119612228}) 2024-04-26T00:02:52.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1145390250}) 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4244659158}) 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=587520705}) 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=509424722}) 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=517781074}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2681312411}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3563656615}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3432529717}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1411306323}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4011758289}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2426718182}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3509156621}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.942+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1876423989}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1718141188}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=923922895}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=535162727}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1582029486}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1844428199}) 2024-04-26T00:02:52.011 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=645925911}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3048334218}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196960522}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1680525342}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1021747897}) 2024-04-26T00:02:52.012 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3151675591}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1275853861}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2347007907}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2209009205}) 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2114257571}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1342482082}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4049038934}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.946+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1126434739}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=702505804}) 2024-04-26T00:02:52.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=809159710}) 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1671696393}) 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2979420555}) 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.015 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3799151156}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3111112771}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1433362370}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2681839229}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2723792935}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2073902785}) 2024-04-26T00:02:52.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1864879218}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=74098778}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2517722061}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4063277621}) 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3375235595}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2430948901}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2925133008}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.950+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3861011698}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=928697985}) 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2055864061}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2108799210}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3726103894}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2988713991}) 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2918139943}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3637267917}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1597288269}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1911737387}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2737018280}) 2024-04-26T00:02:52.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3360160113}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3930023795}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3062764566}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1427554223}) 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3435083489}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2185639038}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3212132355}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.954+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2856742359}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3696833701}) 2024-04-26T00:02:52.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2087056568}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=836140174}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=671356443}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2513409523}) 2024-04-26T00:02:52.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3516281358}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3774848459}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4206154869}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.958+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1588724434}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3332520320}) 2024-04-26T00:02:52.024 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4220172400}) 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4093978742}) 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=629281559}) 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.025 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2140743094}) 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3802019370}) 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3788419965}) 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=334416645}) 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3251705295}) 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=57,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=1} crc {logm=1745834915,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=2132208971}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=56,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=3} crc {logm=2383955952,mdsmap=2840952586,mgr=2375242210,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=2111106029}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=58,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=4} crc {logm=4262078693,mdsmap=2840952586,mgr=3312120796,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=483364347,mon_config_key=2647213004,monmap=828017138,osd_metadata=3508034597,osd_pg_creating=4127804811,osdmap=729485376}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=54,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=5} crc {logm=4120645816,mdsmap=3140514009,mgr=2434058937,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2216111147,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=2115862702}) 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=54,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=4} crc {logm=1730696903,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3183981761,monmap=828017138,osd_metadata=2918934446,osd_pg_creating=4127804811,osdmap=729485376}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=57,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=2} crc {logm=3841513140,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=809949667,monmap=375078350,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1572195549}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=56,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=3} crc {logm=2342499190,mdsmap=2840952586,mgr=3261276571,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=2299174070}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=53,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2964589499,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=3150129445,monmap=828017138,osd_metadata=1304444448,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.962+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=53,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=8} crc {logm=2541972396,mdsmap=2840952586,mgr=3261276571,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3217809922,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=3510156089}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.028 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=483229510}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=987632193}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2450907806}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=2737495958}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2575991846}) 2024-04-26T00:02:52.029 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2965029024}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=819355761}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=4262467925}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.966+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1204497355}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.978+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.978+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.978+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=74} crc {osdmap=2853530003}) 2024-04-26T00:02:52.030 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.978+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.978+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.978+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=72} crc {osdmap=2041496900}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=73} crc {osdmap=3238659721}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=72} crc {osdmap=4135947107}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=70} crc {osdmap=2223154560}) 2024-04-26T00:02:52.031 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=72} crc {osdmap=746685791}) 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=75} crc {osdmap=1411958329}) 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1906828603}) 2024-04-26T00:02:52.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:02:51.982+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=71} crc {osdmap=3372413191}) 2024-04-26T00:02:52.810 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:02:52.810 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:02:52.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient: get_monmap_and_config 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient: build_initial_monmap 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient: monmap: 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:52.976108+0000 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:52.976108+0000 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:52.952 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:52.953 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:52.953 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:52.953 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:52.953 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 1 Processor -- start 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 1 -- start start 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient: init 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient: _add_conns ranks=[7,8,6,5,0,4,1,2,3] 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient(hunting): picked mon.noname-i con 0x7f01680a4f60 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient(hunting): picked mon.noname-e con 0x7f01680a4680 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient(hunting): picked mon.noname-d con 0x7f016813e060 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:52.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01680a5a50 con 0x7f016813e060 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01680a2610 con 0x7f01680a4f60 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01680a3e30 con 0x7f01680a4680 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016ee47640 10 monclient(hunting): authenticate will time out at 1428.503238s 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f0167fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f01680a4680 0x7f016813c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:39142/0 (socket says 172.21.15.106:39142) 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f016d3e4640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f016813e060 0x7f0168140450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50030/0 (socket says 172.21.15.106:50030) 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f0167fff640 1 -- 172.21.15.106:0/2023962942 learned_addr learned my addr 172.21.15.106:0/2023962942 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2654557621 0 0) 0x7f0158001120 con 0x7f016813e060 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): my global_id is 7224 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0150003530 con 0x7f016813e060 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3339377083 0 0) 0x7f01680a3e30 con 0x7f01680a4680 2024-04-26T00:02:52.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient(hunting): my global_id is 204722 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0158001120 con 0x7f01680a4680 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4038287518 0 0) 0x7f0150003530 con 0x7f016813e060 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 >> v1:172.21.15.106:6793/0 conn(0x7f01680a4680 legacy=0x7f016813c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 >> v1:172.21.15.171:6792/0 conn(0x7f01680a4f60 legacy=0x7f01680a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 1 monclient: found mon.noname-d 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.970+0000 7f01677fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01680a1310 con 0x7f016813e060 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:52.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0158001990 con 0x7f016813e060 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: dump: 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:52.963 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 5 monclient: authenticate success, global_id 7224 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0158001c70 con 0x7f016813e060 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 4 set_mon_vals no callback set 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 1 -- 172.21.15.106:0/2023962942 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0158004b30 con 0x7f016813e060 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:52.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01677fe640 10 monclient: dump: 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:52.965 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: shutdown 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- 172.21.15.106:0/2023962942 >> v1:172.21.15.106:6792/0 conn(0x7f016813e060 legacy=0x7f0168140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- 172.21.15.106:0/2023962942 shutdown_connections 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- 172.21.15.106:0/2023962942 >> 172.21.15.106:0/2023962942 conn(0x7f01680a9c80 msgr2=0x7f01680aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- 172.21.15.106:0/2023962942 shutdown_connections 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- 172.21.15.106:0/2023962942 wait complete. 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: build_initial_monmap 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: monmap: 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:52.966 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:52.967 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 Processor -- start 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- start start 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: init 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: _add_conns ranks=[0,4,7,1,5,8,6,2,3] 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient(hunting): picked mon.noname-a con 0x7f01680a4680 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient(hunting): picked mon.noname-c con 0x7f01680a4f60 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient(hunting): picked mon.noname-i con 0x7f016813e060 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f016809f760 con 0x7f01680a4680 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01681cd170 con 0x7f01680a4f60 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f016809dfd0 con 0x7f016813e060 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient(hunting): authenticate will time out at 1428.506301s 2024-04-26T00:02:52.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016cbe3640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f01680a4680 0x7f01681cc350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34692/0 (socket says 172.21.15.106:34692) 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016cbe3640 1 -- 172.21.15.106:0/2983942932 learned_addr learned my addr 172.21.15.106:0/2983942932 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 770056392 0 0) 0x7f016809f760 con 0x7f01680a4680 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): my global_id is 7272 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0154003530 con 0x7f01680a4680 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286297639 0 0) 0x7f01681cd170 con 0x7f01680a4f60 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): my global_id is 145669 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f016809f760 con 0x7f01680a4f60 2024-04-26T00:02:52.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1131577077 0 0) 0x7f0154003530 con 0x7f01680a4680 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01681cd170 con 0x7f01680a4680 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0160001ea0 con 0x7f01680a4680 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): dump: 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 508327494 0 0) 0x7f016809f760 con 0x7f01680a4f60 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0154003530 con 0x7f01680a4f60 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f015c001400 con 0x7f01680a4f60 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): dump: 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320345330 0 0) 0x7f016809dfd0 con 0x7f016813e060 2024-04-26T00:02:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient(hunting): my global_id is 145564 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f016809f760 con 0x7f016813e060 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2583269777 0 0) 0x7f01681cd170 con 0x7f01680a4680 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 >> v1:172.21.15.171:6792/0 conn(0x7f016813e060 legacy=0x7f01681d48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 >> v1:172.21.15.106:6791/0 conn(0x7f01680a4f60 legacy=0x7f01681cca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 monclient: found mon.a 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01680a0730 con 0x7f01680a4680 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:52.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 5 monclient: authenticate success, global_id 7272 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: _renew_subs 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f01680a1b90 con 0x7f01680a4680 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: _renew_subs 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f016809f480 con 0x7f01680a4680 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0160003c90 con 0x7f01680a4680 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0160004200 con 0x7f01680a4680 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f0166ffd640 4 set_mon_vals no callback set 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:52.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.974+0000 7f01657fa640 10 monclient: dump: 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:52.975 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.978+0000 7f016ee47640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.978+0000 7f016ee47640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.978+0000 7f016ee47640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.978+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f01600043a0 con 0x7f01680a4680 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.978+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0148005090 con 0x7f01680a4680 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.978+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f0160045540 con 0x7f01680a4680 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.978+0000 7f0167fff640 10 monclient: get_auth_request con 0x7f0154037ee0 auth_method 0 2024-04-26T00:02:52.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.982+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0160015c00 con 0x7f01680a4680 2024-04-26T00:02:52.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.982+0000 7f01657fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:52.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:52.982+0000 7f01657fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:53.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.202+0000 7f016ee47640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:02:53.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.202+0000 7f016ee47640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:02:53.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.202+0000 7f016ee47640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:53.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.202+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0148005380 con 0x7f01680a4680 2024-04-26T00:02:53.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.202+0000 7f01657fa640 1 -- 172.21.15.106:0/2983942932 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 122674381) 0x7f0160015500 con 0x7f01680a4680 2024-04-26T00:02:53.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f01657fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:02:53.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f01657fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:53.186 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":48,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 >> v1:172.21.15.171:6812/722422047 conn(0x7f0154037ee0 legacy=0x7f015403a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 10 monclient: shutdown 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 >> v1:172.21.15.106:6789/0 conn(0x7f01680a4680 legacy=0x7f01681cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 shutdown_connections 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 >> 172.21.15.106:0/2983942932 conn(0x7f01680a9c80 msgr2=0x7f01681379a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 shutdown_connections 2024-04-26T00:02:53.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.206+0000 7f016ee47640 1 -- 172.21.15.106:0/2983942932 wait complete. 2024-04-26T00:02:53.203 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:02:53.204 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T00:02:53.204 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:02:53.204 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:02:53.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.346+0000 7f237948a640 10 monclient: get_monmap_and_config 2024-04-26T00:02:53.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.346+0000 7f237948a640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.346+0000 7f237948a640 10 monclient: monmap: 2024-04-26T00:02:53.330 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.330 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.330 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:53.354036+0000 2024-04-26T00:02:53.330 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:53.354036+0000 2024-04-26T00:02:53.330 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.331 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.331 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.331 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.331 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.333 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.333 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.333 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.334 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.334 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.334 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.334 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 Processor -- start 2024-04-26T00:02:53.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- start start 2024-04-26T00:02:53.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient: init 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient: _add_conns ranks=[1,5,7,2,8,3,0,6,4] 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient(hunting): picked mon.noname-f con 0x7f237406e3e0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient(hunting): picked mon.noname-h con 0x7f237406fba0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient(hunting): picked mon.noname-i con 0x7f237406eed0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2374070f80 con 0x7f237406e3e0 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2374071e00 con 0x7f237406fba0 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23740709c0 con 0x7f237406eed0 2024-04-26T00:02:53.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient(hunting): authenticate will time out at 1428.881200s 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f23727fc640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f237406fba0 0x7f23741391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:48926/0 (socket says 172.21.15.106:48926) 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f23727fc640 1 -- 172.21.15.106:0/1289023786 learned_addr learned my addr 172.21.15.106:0/1289023786 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2061535144 0 0) 0x7f23640014a0 con 0x7f237406e3e0 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): my global_id is 145693 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f235c003450 con 0x7f237406e3e0 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3636891133 0 0) 0x7f2374071e00 con 0x7f237406fba0 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): my global_id is 7052 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23640014a0 con 0x7f237406fba0 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985381655 0 0) 0x7f23740709c0 con 0x7f237406eed0 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient(hunting): my global_id is 145573 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2374071e00 con 0x7f237406eed0 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1206295924 0 0) 0x7f235c003450 con 0x7f237406e3e0 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 >> v1:172.21.15.171:6792/0 conn(0x7f237406eed0 legacy=0x7f237413c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 >> v1:172.21.15.171:6791/0 conn(0x7f237406fba0 legacy=0x7f23741391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 monclient: found mon.noname-f 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2374070ca0 con 0x7f237406e3e0 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2364001d10 con 0x7f237406e3e0 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: dump: 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.345 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 5 monclient: authenticate success, global_id 145693 2024-04-26T00:02:53.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2364001fc0 con 0x7f237406e3e0 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 1 -- 172.21.15.106:0/1289023786 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2364003ce0 con 0x7f237406e3e0 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 4 set_mon_vals no callback set 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f2371ffb640 10 monclient: dump: 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.347 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 10 monclient: shutdown 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- 172.21.15.106:0/1289023786 >> v1:172.21.15.171:6789/0 conn(0x7f237406e3e0 legacy=0x7f237406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- 172.21.15.106:0/1289023786 shutdown_connections 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- 172.21.15.106:0/1289023786 >> 172.21.15.106:0/1289023786 conn(0x7f23740a64e0 msgr2=0x7f23740a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- 172.21.15.106:0/1289023786 shutdown_connections 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.350+0000 7f237948a640 1 -- 172.21.15.106:0/1289023786 wait complete. 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: monmap: 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.349 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 Processor -- start 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 -- start start 2024-04-26T00:02:53.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: init 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: _add_conns ranks=[2,3,8,6,4,5,1,7,0] 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient(hunting): picked mon.noname-b con 0x7f237406e3e0 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient(hunting): picked mon.noname-g con 0x7f237406eed0 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient(hunting): picked mon.noname-e con 0x7f237406fba0 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23741a3a20 con 0x7f237406e3e0 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23741a5d10 con 0x7f237406eed0 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23741a42d0 con 0x7f237406fba0 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient(hunting): authenticate will time out at 1428.885031s 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f23737fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f237406fba0 0x7f23741d0780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:39154/0 (socket says 172.21.15.106:39154) 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f23737fe640 1 -- 172.21.15.106:0/1869976351 learned_addr learned my addr 172.21.15.106:0/1869976351 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f2372ffd640 1 --1- 172.21.15.106:0/1869976351 >> v1:172.21.15.106:6790/0 conn(0x7f237406e3e0 0x7f23741b8350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55436/0 (socket says 172.21.15.106:55436) 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300945144 0 0) 0x7f23741a42d0 con 0x7f237406fba0 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): my global_id is 204731 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2360003530 con 0x7f237406fba0 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2158781273 0 0) 0x7f23741a3a20 con 0x7f237406e3e0 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): my global_id is 7049 2024-04-26T00:02:53.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23741a42d0 con 0x7f237406e3e0 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2818218606 0 0) 0x7f23741a5d10 con 0x7f237406eed0 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): my global_id is 214185 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23741a3a20 con 0x7f237406eed0 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2253218840 0 0) 0x7f2360003530 con 0x7f237406fba0 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23741a5d10 con 0x7f237406fba0 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f236c001a40 con 0x7f237406fba0 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): dump: 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.353 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:53.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1315067603 0 0) 0x7f23741a42d0 con 0x7f237406e3e0 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2360003530 con 0x7f237406e3e0 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2364001cd0 con 0x7f237406e3e0 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): dump: 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.355 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 767353880 0 0) 0x7f23741a5d10 con 0x7f237406fba0 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.171:6790/0 conn(0x7f237406eed0 legacy=0x7f23741cd050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.106:6790/0 conn(0x7f237406e3e0 legacy=0x7f23741b8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 monclient: found mon.e 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23741b8a60 con 0x7f237406fba0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 5 monclient: authenticate success, global_id 204731 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: _renew_subs 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f23741b8c90 con 0x7f237406fba0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: _renew_subs 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f23741c8100 con 0x7f237406fba0 2024-04-26T00:02:53.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f236c0038d0 con 0x7f237406fba0 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f236c003e40 con 0x7f237406fba0 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f23717fa640 4 set_mon_vals no callback set 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: dump: 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.358 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f236c004060 con 0x7f237406fba0 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f23540065d0 con 0x7f2354002870 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f236c0451b0 con 0x7f237406fba0 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2795200082 0 0) 0x7f23540065d0 con 0x7f2354002870 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient(hunting): my global_id is 7281 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23741a5d10 con 0x7f2354002870 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f23727fc640 10 monclient: get_auth_request con 0x7f2360037ea0 auth_method 0 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3526333901 0 0) 0x7f23741a5d10 con 0x7f2354002870 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23540065d0 con 0x7f2354002870 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2364004340 con 0x7f2354002870 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 10 monclient: dump: 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.360 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2535596125 0 0) 0x7f23540065d0 con 0x7f2354002870 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.354+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f235400a160 con 0x7f2354002870 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.358+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f23640045f0 con 0x7f2354002870 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.358+0000 7f235b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.358+0000 7f235b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:53.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.358+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.106:6789/0 conn(0x7f2354002870 legacy=0x7f2354004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.358+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.106:6789/0 conn(0x7f2354002870 legacy=0x7f2354004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:53.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2354009e50 con 0x7f2354009110 2024-04-26T00:02:53.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937172216 0 0) 0x7f2354009e50 con 0x7f2354009110 2024-04-26T00:02:53.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient(hunting): my global_id is 7290 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23540065d0 con 0x7f2354009110 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2923639076 0 0) 0x7f23540065d0 con 0x7f2354009110 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2354009e50 con 0x7f2354009110 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2364004d50 con 0x7f2354009110 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient: dump: 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.364 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1556971576 0 0) 0x7f2354009e50 con 0x7f2354009110 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f235400c3e0 con 0x7f2354009110 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 3696395837) 0x7f23640095b0 con 0x7f2354009110 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:53.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.106:6789/0 conn(0x7f2354009110 legacy=0x7f23540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f235b7fe640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.106:6789/0 conn(0x7f2354009110 legacy=0x7f23540095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 491921, 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:53.366 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.367 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.368 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.369 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.370 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.372 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.373 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.374 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.375 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.377 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.378 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.379 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.380 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.382 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:53.383 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:53.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.171:6812/722422047 conn(0x7f2360037ea0 legacy=0x7f236003a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 10 monclient: shutdown 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 >> v1:172.21.15.106:6793/0 conn(0x7f237406fba0 legacy=0x7f23741d0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f23737fe640 1 -- 172.21.15.106:0/1869976351 reap_dead start 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f23737fe640 1 -- 172.21.15.106:0/1869976351 reap_dead start 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 shutdown_connections 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 >> 172.21.15.106:0/1869976351 conn(0x7f23740a64e0 msgr2=0x7f23740a4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 shutdown_connections 2024-04-26T00:02:53.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.362+0000 7f237948a640 1 -- 172.21.15.106:0/1869976351 wait complete. 2024-04-26T00:02:53.385 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:53.386 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:02:53.386 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:02:53.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.522+0000 7f62ee70a640 10 monclient: get_monmap_and_config 2024-04-26T00:02:53.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.522+0000 7f62ee70a640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.522+0000 7f62ee70a640 10 monclient: monmap: 2024-04-26T00:02:53.505 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:53.529791+0000 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:53.529791+0000 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.506 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 Processor -- start 2024-04-26T00:02:53.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- start start 2024-04-26T00:02:53.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: init 2024-04-26T00:02:53.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: _add_conns ranks=[1,2,5,0,3,7,6,4,8] 2024-04-26T00:02:53.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient(hunting): picked mon.noname-f con 0x7f62e8134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:53.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient(hunting): picked mon.noname-b con 0x7f62e80a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient(hunting): picked mon.noname-h con 0x7f62e813e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e806dd40 con 0x7f62e8134970 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e80a2b10 con 0x7f62e80a4820 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e80a2df0 con 0x7f62e813e200 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient(hunting): authenticate will time out at 1429.057231s 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62df7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f62e80a4820 0x7f62e813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55442/0 (socket says 172.21.15.106:55442) 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62df7fe640 1 -- 172.21.15.106:0/3621057291 learned_addr learned my addr 172.21.15.106:0/3621057291 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275682882 0 0) 0x7f62e80a2b10 con 0x7f62e80a4820 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient(hunting): my global_id is 7058 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c8003530 con 0x7f62e80a4820 2024-04-26T00:02:53.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 771488724 0 0) 0x7f62c8003530 con 0x7f62e80a4820 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 >> v1:172.21.15.171:6791/0 conn(0x7f62e813e200 legacy=0x7f62e81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 >> v1:172.21.15.171:6789/0 conn(0x7f62e8134970 legacy=0x7f62e8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 monclient: found mon.noname-b 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e80a30d0 con 0x7f62e80a4820 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 5 monclient: authenticate success, global_id 7058 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62d80017c0 con 0x7f62e80a4820 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: dump: 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.516 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62d8001ab0 con 0x7f62e80a4820 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 1 -- 172.21.15.106:0/3621057291 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62d8004bf0 con 0x7f62e80a4820 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 4 set_mon_vals no callback set 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62e77fe640 10 monclient: dump: 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.517 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: shutdown 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- 172.21.15.106:0/3621057291 >> v1:172.21.15.106:6790/0 conn(0x7f62e80a4820 legacy=0x7f62e813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- 172.21.15.106:0/3621057291 shutdown_connections 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- 172.21.15.106:0/3621057291 >> 172.21.15.106:0/3621057291 conn(0x7f62e80a9e20 msgr2=0x7f62e80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- 172.21.15.106:0/3621057291 shutdown_connections 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- 172.21.15.106:0/3621057291 wait complete. 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: monmap: 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.519 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 Processor -- start 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 1 -- start start 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: init 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient: _add_conns ranks=[6,8,3,7,2,5,0,4,1] 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.526+0000 7f62ee70a640 10 monclient(hunting): picked mon.noname-d con 0x7f62e80a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient(hunting): picked mon.noname-e con 0x7f62e8134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient(hunting): picked mon.noname-g con 0x7f62e813e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:53.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e809e2e0 con 0x7f62e813e200 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e80a1e00 con 0x7f62e80a4820 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62e809ce30 con 0x7f62e8134970 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient(hunting): authenticate will time out at 1429.060064s 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e7fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f62e80a4820 0x7f62e809faf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50046/0 (socket says 172.21.15.106:50046) 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e7fff640 1 -- 172.21.15.106:0/4215604981 learned_addr learned my addr 172.21.15.106:0/4215604981 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943036013 0 0) 0x7f62e80a1e00 con 0x7f62e80a4820 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): my global_id is 7233 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62cc003530 con 0x7f62e80a4820 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885675432 0 0) 0x7f62e809ce30 con 0x7f62e8134970 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): my global_id is 204740 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e80a1e00 con 0x7f62e8134970 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4254718600 0 0) 0x7f62e809e2e0 con 0x7f62e813e200 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): my global_id is 214194 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e809ce30 con 0x7f62e813e200 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3939646805 0 0) 0x7f62e80a1e00 con 0x7f62e8134970 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e809e2e0 con 0x7f62e8134970 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62d8001780 con 0x7f62e8134970 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:02:53.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): dump: 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.523 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 717773482 0 0) 0x7f62cc003530 con 0x7f62e80a4820 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e80a1e00 con 0x7f62e80a4820 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62d0001a60 con 0x7f62e80a4820 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): dump: 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.524 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4180422567 0 0) 0x7f62e809e2e0 con 0x7f62e8134970 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.106:6792/0 conn(0x7f62e80a4820 legacy=0x7f62e809faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.171:6790/0 conn(0x7f62e813e200 legacy=0x7f62e81d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 monclient: found mon.e 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:53.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62e809e000 con 0x7f62e8134970 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 5 monclient: authenticate success, global_id 204740 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient: _renew_subs 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f62e809c2d0 con 0x7f62e8134970 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62d8001c60 con 0x7f62e8134970 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient: _renew_subs 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f62e80a03d0 con 0x7f62e8134970 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62d8004b50 con 0x7f62e8134970 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: dump: 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.527 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e6ffd640 4 set_mon_vals no callback set 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f62d80100f0 con 0x7f62e8134970 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f62d8045180 con 0x7f62e8134970 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62e8067160 con 0x7f62e81cc680 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e7fff640 10 monclient: get_auth_request con 0x7f62cc0380a0 auth_method 0 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496913577 0 0) 0x7f62e8067160 con 0x7f62e81cc680 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient(hunting): my global_id is 7067 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e809e2e0 con 0x7f62e81cc680 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3218790412 0 0) 0x7f62e809e2e0 con 0x7f62e81cc680 2024-04-26T00:02:53.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e8067160 con 0x7f62e81cc680 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62e0001ba0 con 0x7f62e81cc680 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: dump: 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.529 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1855452587 0 0) 0x7f62e8067160 con 0x7f62e81cc680 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62e80a0660 con 0x7f62e81cc680 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f62e00020b0 con 0x7f62e81cc680 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.106:6790/0 conn(0x7f62e81cc680 legacy=0x7f62e812b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.530+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.106:6790/0 conn(0x7f62e81cc680 legacy=0x7f62e812b620 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62e8062e50 con 0x7f62e802d010 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425783798 0 0) 0x7f62e8062e50 con 0x7f62e802d010 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient(hunting): my global_id is 7076 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62e8067160 con 0x7f62e802d010 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2981774 0 0) 0x7f62e8067160 con 0x7f62e802d010 2024-04-26T00:02:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62e8062e50 con 0x7f62e802d010 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f62e0003fb0 con 0x7f62e802d010 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient: dump: 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3884003797 0 0) 0x7f62e8062e50 con 0x7f62e802d010 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f62e80aa490 con 0x7f62e802d010 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3874398431) 0x7f62e00049d0 con 0x7f62e802d010 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.106:6790/0 conn(0x7f62e802d010 legacy=0x7f62e812bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62e57fa640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.106:6790/0 conn(0x7f62e802d010 legacy=0x7f62e812bd30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 492101, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:53.535 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.536 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.537 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:53.538 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.539 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:53.540 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:53.542 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.544 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.545 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.546 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.547 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:53.548 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.549 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.550 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.551 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:53.552 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.171:6812/722422047 conn(0x7f62cc0380a0 legacy=0x7f62cc03a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 10 monclient: shutdown 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 >> v1:172.21.15.106:6793/0 conn(0x7f62e8134970 legacy=0x7f62e81d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ecca7640 1 -- 172.21.15.106:0/4215604981 reap_dead start 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ecca7640 1 -- 172.21.15.106:0/4215604981 reap_dead start 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 shutdown_connections 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 >> 172.21.15.106:0/4215604981 conn(0x7f62e80a9e20 msgr2=0x7f62e8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 shutdown_connections 2024-04-26T00:02:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.538+0000 7f62ee70a640 1 -- 172.21.15.106:0/4215604981 wait complete. 2024-04-26T00:02:53.554 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:53.554 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:02:53.555 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: get_monmap_and_config 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: monmap: 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:53.694818+0000 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:53.694818+0000 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.671 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 Processor -- start 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- start start 2024-04-26T00:02:53.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: init 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: _add_conns ranks=[5,7,2,0,3,8,6,1,4] 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient(hunting): picked mon.noname-h con 0x7f8018134760 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient(hunting): picked mon.noname-i con 0x7f80180a0d70 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient(hunting): picked mon.noname-b con 0x7f801813df70 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801806b910 con 0x7f801813df70 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f801809fac0 con 0x7f8018134760 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80180a0080 con 0x7f80180a0d70 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient(hunting): authenticate will time out at 1429.221914s 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f80177fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f801813df70 0x7f8018140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55466/0 (socket says 172.21.15.106:55466) 2024-04-26T00:02:53.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f80177fe640 1 -- 172.21.15.106:0/405785984 learned_addr learned my addr 172.21.15.106:0/405785984 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182004895 0 0) 0x7f801806b910 con 0x7f801813df70 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient(hunting): my global_id is 7085 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8000003530 con 0x7f801813df70 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1581718002 0 0) 0x7f8000003530 con 0x7f801813df70 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 >> v1:172.21.15.171:6792/0 conn(0x7f80180a0d70 legacy=0x7f801813c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 >> v1:172.21.15.171:6791/0 conn(0x7f8018134760 legacy=0x7f8018134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 monclient: found mon.noname-b 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801809f280 con 0x7f801813df70 2024-04-26T00:02:53.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 5 monclient: authenticate success, global_id 7085 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8010001b40 con 0x7f801813df70 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: dump: 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.682 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8010001ea0 con 0x7f801813df70 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 4 set_mon_vals no callback set 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 1 -- 172.21.15.106:0/405785984 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80100020d0 con 0x7f801813df70 2024-04-26T00:02:53.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f8015ffb640 10 monclient: dump: 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.684 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 10 monclient: shutdown 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- 172.21.15.106:0/405785984 >> v1:172.21.15.106:6790/0 conn(0x7f801813df70 legacy=0x7f8018140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- 172.21.15.106:0/405785984 shutdown_connections 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- 172.21.15.106:0/405785984 >> 172.21.15.106:0/405785984 conn(0x7f80180a7240 msgr2=0x7f80180a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- 172.21.15.106:0/405785984 shutdown_connections 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.690+0000 7f801da4c640 1 -- 172.21.15.106:0/405785984 wait complete. 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: monmap: 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:53.685 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 Processor -- start 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 -- start start 2024-04-26T00:02:53.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: init 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: _add_conns ranks=[2,1,6,0,5,3,7,4,8] 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient(hunting): picked mon.noname-b con 0x7f80180a0d70 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient(hunting): picked mon.noname-f con 0x7f8018134760 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient(hunting): picked mon.noname-d con 0x7f801813df70 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018137600 con 0x7f8018134760 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018072500 con 0x7f80180a0d70 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8018072930 con 0x7f801813df70 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient(hunting): authenticate will time out at 1429.225259s 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f8016ffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f80180a0d70 0x7f80181ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55474/0 (socket says 172.21.15.106:55474) 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f8016ffd640 1 -- 172.21.15.106:0/3492872238 learned_addr learned my addr 172.21.15.106:0/3492872238 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908342659 0 0) 0x7f8018072500 con 0x7f80180a0d70 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): my global_id is 7094 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8004003530 con 0x7f80180a0d70 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050128847 0 0) 0x7f8018072930 con 0x7f801813df70 2024-04-26T00:02:53.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): my global_id is 7242 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8018072500 con 0x7f801813df70 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1967218489 0 0) 0x7f8004003530 con 0x7f80180a0d70 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8018072930 con 0x7f80180a0d70 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f800c001ae0 con 0x7f80180a0d70 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): dump: 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.689 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1579961615 0 0) 0x7f8018137600 con 0x7f8018134760 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): my global_id is 145711 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8004003530 con 0x7f8018134760 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2066644854 0 0) 0x7f8018072500 con 0x7f801813df70 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8018137600 con 0x7f801813df70 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8010001b00 con 0x7f801813df70 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): dump: 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.691 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2373671512 0 0) 0x7f8018072930 con 0x7f80180a0d70 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.106:6792/0 conn(0x7f801813df70 legacy=0x7f80181d54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.171:6789/0 conn(0x7f8018134760 legacy=0x7f80181d1da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 monclient: found mon.b 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80181398f0 con 0x7f80180a0d70 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 5 monclient: authenticate success, global_id 7094 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: _renew_subs 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f80181384a0 con 0x7f80180a0d70 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: _renew_subs 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f80181369e0 con 0x7f80180a0d70 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f800c0038d0 con 0x7f80180a0d70 2024-04-26T00:02:53.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f800c003dc0 con 0x7f80180a0d70 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f80157fa640 4 set_mon_vals no callback set 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: dump: 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.694 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f800c003f60 con 0x7f80180a0d70 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7ff80065d0 con 0x7f7ff8002870 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f800c045210 con 0x7f80180a0d70 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1063570753 0 0) 0x7f7ff80065d0 con 0x7f7ff8002870 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient(hunting): my global_id is 145678 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8018072930 con 0x7f7ff8002870 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f80177fe640 10 monclient: get_auth_request con 0x7f8004037fc0 auth_method 0 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4188112053 0 0) 0x7f8018072930 con 0x7f7ff8002870 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ff80065d0 con 0x7f7ff8002870 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80080018f0 con 0x7f7ff8002870 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.694+0000 7f7ffffff640 10 monclient: dump: 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.696 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.698+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2533191254 0 0) 0x7f7ff80065d0 con 0x7f7ff8002870 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.698+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7ff800a160 con 0x7f7ff8002870 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.698+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8008004630 con 0x7f7ff8002870 2024-04-26T00:02:53.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.698+0000 7f7ffffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.698+0000 7f7ffffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.698+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.106:6791/0 conn(0x7f7ff8002870 legacy=0x7f7ff8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.698+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.106:6791/0 conn(0x7f7ff8002870 legacy=0x7f7ff8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7ff8009e50 con 0x7f7ff8009110 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 839178891 0 0) 0x7f7ff8009e50 con 0x7f7ff8009110 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient(hunting): my global_id is 145687 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7ff80065d0 con 0x7f7ff8009110 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1812596794 0 0) 0x7f7ff80065d0 con 0x7f7ff8009110 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7ff8009e50 con 0x7f7ff8009110 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8008003bb0 con 0x7f7ff8009110 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient: dump: 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.700 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.701 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1890596284 0 0) 0x7f7ff8009e50 con 0x7f7ff8009110 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7ff800c3e0 con 0x7f7ff8009110 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 2293058293) 0x7f8008003e30 con 0x7f7ff8009110 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.106:6791/0 conn(0x7f7ff8009110 legacy=0x7f7ff80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f7ffffff640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.106:6791/0 conn(0x7f7ff8009110 legacy=0x7f7ff80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:53.702 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 237233, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:53.703 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.705 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:53.706 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.707 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.709 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:53.711 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.714 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:53.716 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.718 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.719 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.720 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:02:53.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:53.722 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:53.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.171:6812/722422047 conn(0x7f8004037fc0 legacy=0x7f800403a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 10 monclient: shutdown 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 >> v1:172.21.15.106:6790/0 conn(0x7f80180a0d70 legacy=0x7f80181ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f80177fe640 1 -- 172.21.15.106:0/3492872238 reap_dead start 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f80177fe640 1 -- 172.21.15.106:0/3492872238 reap_dead start 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 shutdown_connections 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 >> 172.21.15.106:0/3492872238 conn(0x7f80180a7240 msgr2=0x7f80180a2480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 shutdown_connections 2024-04-26T00:02:53.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.702+0000 7f801da4c640 1 -- 172.21.15.106:0/3492872238 wait complete. 2024-04-26T00:02:53.724 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:53.725 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:02:53.725 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:02:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.858+0000 7f1f67167640 10 monclient: get_monmap_and_config 2024-04-26T00:02:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.858+0000 7f1f67167640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.858+0000 7f1f67167640 10 monclient: monmap: 2024-04-26T00:02:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.841 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:53.865868+0000 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:53.865868+0000 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.842 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.843 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.843 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 Processor -- start 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- start start 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: init 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: _add_conns ranks=[4,7,6,3,2,8,5,0,1] 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient(hunting): picked mon.noname-c con 0x7f1f60134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient(hunting): picked mon.noname-i con 0x7f1f600a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient(hunting): picked mon.noname-d con 0x7f1f6013e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6006dd40 con 0x7f1f60134970 2024-04-26T00:02:53.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f600a2b10 con 0x7f1f6013e200 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f600a2df0 con 0x7f1f600a4820 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient(hunting): authenticate will time out at 1429.393284s 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f64f03640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f1f60134970 0x7f1f60134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55552/0 (socket says 172.21.15.106:55552) 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f64f03640 1 -- 172.21.15.106:0/1011097389 learned_addr learned my addr 172.21.15.106:0/1011097389 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3928072726 0 0) 0x7f1f6006dd40 con 0x7f1f60134970 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): my global_id is 145696 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f48003530 con 0x7f1f60134970 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060733151 0 0) 0x7f1f600a2b10 con 0x7f1f6013e200 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient(hunting): my global_id is 7251 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f6006dd40 con 0x7f1f6013e200 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2917097224 0 0) 0x7f1f48003530 con 0x7f1f60134970 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 >> v1:172.21.15.171:6792/0 conn(0x7f1f600a4820 legacy=0x7f1f6013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 >> v1:172.21.15.106:6792/0 conn(0x7f1f6013e200 legacy=0x7f1f601405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 monclient: found mon.noname-c 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f600a30d0 con 0x7f1f60134970 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f500017c0 con 0x7f1f60134970 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: dump: 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.854 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 5 monclient: authenticate success, global_id 145696 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f50001a30 con 0x7f1f60134970 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 4 set_mon_vals no callback set 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 1 -- 172.21.15.106:0/1011097389 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f50004bf0 con 0x7f1f60134970 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:53.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f5f7fe640 10 monclient: dump: 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.856 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: shutdown 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- 172.21.15.106:0/1011097389 >> v1:172.21.15.106:6791/0 conn(0x7f1f60134970 legacy=0x7f1f60134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- 172.21.15.106:0/1011097389 shutdown_connections 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- 172.21.15.106:0/1011097389 >> 172.21.15.106:0/1011097389 conn(0x7f1f600a9e20 msgr2=0x7f1f600aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- 172.21.15.106:0/1011097389 shutdown_connections 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- 172.21.15.106:0/1011097389 wait complete. 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: build_initial_monmap 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: monmap: 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:53.857 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 Processor -- start 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 1 -- start start 2024-04-26T00:02:53.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.862+0000 7f1f67167640 10 monclient: init 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient: _add_conns ranks=[6,7,4,0,8,5,2,1,3] 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient(hunting): picked mon.noname-d con 0x7f1f600a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient(hunting): picked mon.noname-i con 0x7f1f60134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient(hunting): picked mon.noname-c con 0x7f1f6013e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6009ed80 con 0x7f1f6013e200 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6009c0b0 con 0x7f1f600a4820 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f6009e0c0 con 0x7f1f60134970 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient(hunting): authenticate will time out at 1429.396390s 2024-04-26T00:02:53.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f64f03640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f1f600a4820 0x7f1f6012a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50068/0 (socket says 172.21.15.106:50068) 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f64f03640 1 -- 172.21.15.106:0/501321680 learned_addr learned my addr 172.21.15.106:0/501321680 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157437578 0 0) 0x7f1f6009c0b0 con 0x7f1f600a4820 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): my global_id is 7260 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4c003530 con 0x7f1f600a4820 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 201213892 0 0) 0x7f1f6006dd40 con 0x7f1f6013e200 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): my global_id is 145705 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f6009c0b0 con 0x7f1f6013e200 2024-04-26T00:02:53.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 887391329 0 0) 0x7f1f6009c0b0 con 0x7f1f6013e200 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f6006dd40 con 0x7f1f6013e200 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3378745898 0 0) 0x7f1f4c003530 con 0x7f1f600a4820 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f6009c0b0 con 0x7f1f600a4820 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f58001c80 con 0x7f1f6013e200 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): dump: 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.861 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f50004b30 con 0x7f1f600a4820 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:53.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): dump: 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.863 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3982513241 0 0) 0x7f1f6009e0c0 con 0x7f1f60134970 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): my global_id is 145600 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f4c003530 con 0x7f1f60134970 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1946168337 0 0) 0x7f1f6006dd40 con 0x7f1f6013e200 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.171:6792/0 conn(0x7f1f60134970 legacy=0x7f1f601d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.106:6792/0 conn(0x7f1f600a4820 legacy=0x7f1f6012a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 monclient: found mon.c 2024-04-26T00:02:53.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f6009db00 con 0x7f1f6013e200 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 5 monclient: authenticate success, global_id 145705 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient: _renew_subs 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1f6009cc10 con 0x7f1f6013e200 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient: _renew_subs 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f1f6009b9b0 con 0x7f1f6013e200 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1f580039a0 con 0x7f1f6013e200 2024-04-26T00:02:53.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f58003f10 con 0x7f1f6013e200 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5effd640 4 set_mon_vals no callback set 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: dump: 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.866 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f400065d0 con 0x7f1f40002870 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1f5800ecb0 con 0x7f1f6013e200 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f1f58043fe0 con 0x7f1f6013e200 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661155255 0 0) 0x7f1f400065d0 con 0x7f1f40002870 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient(hunting): my global_id is 7269 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f6006dd40 con 0x7f1f40002870 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5ffff640 10 monclient: get_auth_request con 0x7f1f4c037eb0 auth_method 0 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2154503675 0 0) 0x7f1f6006dd40 con 0x7f1f40002870 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f400065d0 con 0x7f1f40002870 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f50001a30 con 0x7f1f40002870 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: dump: 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.868 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2956323789 0 0) 0x7f1f400065d0 con 0x7f1f40002870 2024-04-26T00:02:53.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1f4000a160 con 0x7f1f40002870 2024-04-26T00:02:53.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1f50005610 con 0x7f1f40002870 2024-04-26T00:02:53.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:53.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:53.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.106:6792/0 conn(0x7f1f40002870 legacy=0x7f1f40004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.866+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.106:6792/0 conn(0x7f1f40002870 legacy=0x7f1f40004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1f40009e50 con 0x7f1f40009110 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906407243 0 0) 0x7f1f40009e50 con 0x7f1f40009110 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient(hunting): my global_id is 7278 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f400065d0 con 0x7f1f40009110 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 924505760 0 0) 0x7f1f400065d0 con 0x7f1f40009110 2024-04-26T00:02:53.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1f40009e50 con 0x7f1f40009110 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1f50005e00 con 0x7f1f40009110 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient: dump: 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:53.873 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3269967498 0 0) 0x7f1f40009e50 con 0x7f1f40009110 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1f4000c3e0 con 0x7f1f40009110 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2382623516) 0x7f1f50008150 con 0x7f1f40009110 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.106:6792/0 conn(0x7f1f40009110 legacy=0x7f1f400095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f5d7fa640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.106:6792/0 conn(0x7f1f40009110 legacy=0x7f1f400095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 492413, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:53.875 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.876 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.877 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.878 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:53.879 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:53.881 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.882 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.883 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.884 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.885 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:53.886 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:53.888 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:53.890 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.891 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:53.892 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:53.893 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:53.893 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:53.893 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:53.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:53.893 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:53.893 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.171:6812/722422047 conn(0x7f1f4c037eb0 legacy=0x7f1f4c03a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 10 monclient: shutdown 2024-04-26T00:02:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 >> v1:172.21.15.106:6791/0 conn(0x7f1f6013e200 legacy=0x7f1f601d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f65704640 1 -- 172.21.15.106:0/501321680 reap_dead start 2024-04-26T00:02:53.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f65704640 1 -- 172.21.15.106:0/501321680 reap_dead start 2024-04-26T00:02:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 shutdown_connections 2024-04-26T00:02:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 >> 172.21.15.106:0/501321680 conn(0x7f1f600a9e20 msgr2=0x7f1f60067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 shutdown_connections 2024-04-26T00:02:53.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:53.874+0000 7f1f67167640 1 -- 172.21.15.106:0/501321680 wait complete. 2024-04-26T00:02:53.895 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:53.895 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:02:53.895 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: get_monmap_and_config 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: monmap: 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:54.031257+0000 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:54.031257+0000 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.007 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.008 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 1 Processor -- start 2024-04-26T00:02:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 1 -- start start 2024-04-26T00:02:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: init 2024-04-26T00:02:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: _add_conns ranks=[3,8,5,2,0,4,1,6,7] 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient(hunting): picked mon.noname-g con 0x7f55f0134820 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient(hunting): picked mon.noname-e con 0x7f55f00725d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient(hunting): picked mon.noname-h con 0x7f55f013ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f0071270 con 0x7f55f0134820 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f00714e0 con 0x7f55f013ace0 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f00729f0 con 0x7f55f00725d0 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient(hunting): authenticate will time out at 1429.558524s 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55eeffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f55f00725d0 0x7f55f01395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:39168/0 (socket says 172.21.15.106:39168) 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55eeffd640 1 -- 172.21.15.106:0/2137514461 learned_addr learned my addr 172.21.15.106:0/2137514461 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168514235 0 0) 0x7f55f00729f0 con 0x7f55f00725d0 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient(hunting): my global_id is 204749 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d8003530 con 0x7f55f00725d0 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2900862388 0 0) 0x7f55d8003530 con 0x7f55f00725d0 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 >> v1:172.21.15.171:6791/0 conn(0x7f55f013ace0 legacy=0x7f55f013d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 >> v1:172.21.15.171:6790/0 conn(0x7f55f0134820 legacy=0x7f55f0134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 monclient: found mon.noname-e 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f00717c0 con 0x7f55f00725d0 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55e0001820 con 0x7f55f00725d0 2024-04-26T00:02:54.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 5 monclient: authenticate success, global_id 204749 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: dump: 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.019 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55e0001b30 con 0x7f55f00725d0 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 1 -- 172.21.15.106:0/2137514461 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55e0004bf0 con 0x7f55f00725d0 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 4 set_mon_vals no callback set 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55ee7fc640 10 monclient: dump: 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.020 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 10 monclient: shutdown 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.026+0000 7f55f5de7640 1 -- 172.21.15.106:0/2137514461 >> v1:172.21.15.106:6793/0 conn(0x7f55f00725d0 legacy=0x7f55f01395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- 172.21.15.106:0/2137514461 shutdown_connections 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- 172.21.15.106:0/2137514461 >> 172.21.15.106:0/2137514461 conn(0x7f55f00a64e0 msgr2=0x7f55f00a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- 172.21.15.106:0/2137514461 shutdown_connections 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- 172.21.15.106:0/2137514461 wait complete. 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: monmap: 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.022 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 Processor -- start 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- start start 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: init 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: _add_conns ranks=[8,0,2,1,3,6,7,4,5] 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient(hunting): picked mon.noname-e con 0x7f55f00725d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient(hunting): picked mon.noname-a con 0x7f55f0134820 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient(hunting): picked mon.noname-b con 0x7f55f013ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f01345f0 con 0x7f55f0134820 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f013d550 con 0x7f55f013ace0 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f55f013c030 con 0x7f55f00725d0 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient(hunting): authenticate will time out at 1429.561688s 2024-04-26T00:02:54.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55eeffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f55f0134820 0x7f55f01d1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34724/0 (socket says 172.21.15.106:34724) 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55eeffd640 1 -- 172.21.15.106:0/3722945993 learned_addr learned my addr 172.21.15.106:0/3722945993 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3954751295 0 0) 0x7f55f013c030 con 0x7f55f00725d0 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): my global_id is 204758 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55dc003530 con 0x7f55f00725d0 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 763394939 0 0) 0x7f55f013d550 con 0x7f55f013ace0 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): my global_id is 7103 2024-04-26T00:02:54.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f013c030 con 0x7f55f013ace0 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3094801934 0 0) 0x7f55f01345f0 con 0x7f55f0134820 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): my global_id is 7299 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f013d550 con 0x7f55f0134820 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 86257186 0 0) 0x7f55dc003530 con 0x7f55f00725d0 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55f01345f0 con 0x7f55f00725d0 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55e40019a0 con 0x7f55f00725d0 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): dump: 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.026 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:54.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3829920375 0 0) 0x7f55f013c030 con 0x7f55f013ace0 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55dc003530 con 0x7f55f013ace0 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55e8001bb0 con 0x7f55f013ace0 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): dump: 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.028 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3678883227 0 0) 0x7f55f01345f0 con 0x7f55f00725d0 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.106:6790/0 conn(0x7f55f013ace0 legacy=0x7f55f01d5290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.106:6789/0 conn(0x7f55f0134820 legacy=0x7f55f01d1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 monclient: found mon.e 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:54.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55f013d830 con 0x7f55f00725d0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 5 monclient: authenticate success, global_id 204758 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: _renew_subs 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f55f013bbb0 con 0x7f55f00725d0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: _renew_subs 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f55f013dc50 con 0x7f55f00725d0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f55e4001ca0 con 0x7f55f00725d0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55e4003c10 con 0x7f55f00725d0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55edffb640 4 set_mon_vals no callback set 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient: dump: 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.031 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f55d00065d0 con 0x7f55d0002870 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4012866368 0 0) 0x7f55d00065d0 con 0x7f55d0002870 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 10 monclient(hunting): my global_id is 204767 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f01345f0 con 0x7f55d0002870 2024-04-26T00:02:54.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.030+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f55e4003db0 con 0x7f55f00725d0 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f55e4043e20 con 0x7f55f00725d0 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 393108515 0 0) 0x7f55f01345f0 con 0x7f55d0002870 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55d00065d0 con 0x7f55d0002870 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55e00019c0 con 0x7f55d0002870 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 10 monclient: dump: 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.033 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55effff640 10 monclient: get_auth_request con 0x7f55dc037d70 auth_method 0 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 145894440 0 0) 0x7f55d00065d0 con 0x7f55d0002870 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f55d000a160 con 0x7f55d0002870 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f55e0007480 con 0x7f55d0002870 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.034 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:54.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.106:6793/0 conn(0x7f55d0002870 legacy=0x7f55d0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.034+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.106:6793/0 conn(0x7f55d0002870 legacy=0x7f55d0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55f5de7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:54.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f55d0009e50 con 0x7f55d0009110 2024-04-26T00:02:54.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638545419 0 0) 0x7f55d0009e50 con 0x7f55d0009110 2024-04-26T00:02:54.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient(hunting): my global_id is 204776 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55d00065d0 con 0x7f55d0009110 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2661631553 0 0) 0x7f55d00065d0 con 0x7f55d0009110 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f55d0009e50 con 0x7f55d0009110 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f55e0005340 con 0x7f55d0009110 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient: dump: 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.037 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2747091776 0 0) 0x7f55d0009e50 con 0x7f55d0009110 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f55d000c3e0 con 0x7f55d0009110 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1642249541) 0x7f55e0006690 con 0x7f55d0009110 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:54.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.106:6793/0 conn(0x7f55d0009110 legacy=0x7f55d00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.038+0000 7f55d7fff640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.106:6793/0 conn(0x7f55d0009110 legacy=0x7f55d00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 120778, 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:54.039 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.040 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:54.041 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:54.042 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:54.043 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:54.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.045 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.046 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.047 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.048 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.049 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.050 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.051 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.052 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.053 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.054 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.055 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.056 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:54.057 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:54.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.171:6812/722422047 conn(0x7f55dc037d70 legacy=0x7f55dc03a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 10 monclient: shutdown 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 >> v1:172.21.15.106:6793/0 conn(0x7f55f00725d0 legacy=0x7f55f012a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55effff640 1 -- 172.21.15.106:0/3722945993 reap_dead start 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55effff640 1 -- 172.21.15.106:0/3722945993 reap_dead start 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 shutdown_connections 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 >> 172.21.15.106:0/3722945993 conn(0x7f55f00a64e0 msgr2=0x7f55f0130840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 shutdown_connections 2024-04-26T00:02:54.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.042+0000 7f55f5de7640 1 -- 172.21.15.106:0/3722945993 wait complete. 2024-04-26T00:02:54.059 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:54.060 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:02:54.060 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:02:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient: get_monmap_and_config 2024-04-26T00:02:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient: monmap: 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:54.196884+0000 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:54.196884+0000 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.173 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.174 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.174 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 1 Processor -- start 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 1 -- start start 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient: init 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient: _add_conns ranks=[2,8,6,4,5,0,7,1,3] 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient(hunting): picked mon.noname-b con 0x7fb52c134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient(hunting): picked mon.noname-e con 0x7fb52c0a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.190+0000 7fb53471c640 10 monclient(hunting): picked mon.noname-d con 0x7fb52c13e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c06dd40 con 0x7fb52c134970 2024-04-26T00:02:54.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c0a2b10 con 0x7fb52c13e200 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c0a2df0 con 0x7fb52c0a4820 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient(hunting): authenticate will time out at 1429.724042s 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb532cb9640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb52c13e200 0x7fb52c1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50090/0 (socket says 172.21.15.106:50090) 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb531cb7640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fb52c0a4820 0x7fb52c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:39200/0 (socket says 172.21.15.106:39200) 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb532cb9640 1 -- 172.21.15.106:0/18175438 learned_addr learned my addr 172.21.15.106:0/18175438 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2368717040 0 0) 0x7fb52c0a2b10 con 0x7fb52c13e200 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): my global_id is 7287 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb518003530 con 0x7fb52c13e200 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1355540416 0 0) 0x7fb52c06dd40 con 0x7fb52c134970 2024-04-26T00:02:54.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): my global_id is 7112 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52c0a2b10 con 0x7fb52c134970 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424698811 0 0) 0x7fb52c0a2df0 con 0x7fb52c0a4820 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient(hunting): my global_id is 204785 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52c06dd40 con 0x7fb52c0a4820 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 906185475 0 0) 0x7fb52c0a2b10 con 0x7fb52c134970 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 >> v1:172.21.15.106:6793/0 conn(0x7fb52c0a4820 legacy=0x7fb52c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 >> v1:172.21.15.106:6792/0 conn(0x7fb52c13e200 legacy=0x7fb52c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 monclient: found mon.noname-b 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c0a30d0 con 0x7fb52c134970 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb51c0017a0 con 0x7fb52c134970 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: dump: 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.185 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.186 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 5 monclient: authenticate success, global_id 7112 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb51c001a10 con 0x7fb52c134970 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 1 -- 172.21.15.106:0/18175438 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb51c003960 con 0x7fb52c134970 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 4 set_mon_vals no callback set 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb5314b6640 10 monclient: dump: 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.187 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient: shutdown 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- 172.21.15.106:0/18175438 >> v1:172.21.15.106:6790/0 conn(0x7fb52c134970 legacy=0x7fb52c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- 172.21.15.106:0/18175438 shutdown_connections 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- 172.21.15.106:0/18175438 >> 172.21.15.106:0/18175438 conn(0x7fb52c0a9e20 msgr2=0x7fb52c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- 172.21.15.106:0/18175438 shutdown_connections 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- 172.21.15.106:0/18175438 wait complete. 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient: monmap: 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.189 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 Processor -- start 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- start start 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient: init 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient: _add_conns ranks=[1,0,4,7,3,8,5,2,6] 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient(hunting): picked mon.noname-f con 0x7fb52c0a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:54.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient(hunting): picked mon.noname-a con 0x7fb52c134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient(hunting): picked mon.noname-c con 0x7fb52c13e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c13c230 con 0x7fb52c134970 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c13a670 con 0x7fb52c0a4820 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb52c1396d0 con 0x7fb52c13e200 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb53471c640 10 monclient(hunting): authenticate will time out at 1429.727131s 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb532cb9640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fb52c13e200 0x7fb52c1d45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55572/0 (socket says 172.21.15.106:55572) 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb532cb9640 1 -- 172.21.15.106:0/1901764178 learned_addr learned my addr 172.21.15.106:0/1901764178 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4237686964 0 0) 0x7fb52c13c230 con 0x7fb52c134970 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): my global_id is 7308 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb510003530 con 0x7fb52c134970 2024-04-26T00:02:54.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2810318839 0 0) 0x7fb52c1396d0 con 0x7fb52c13e200 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): my global_id is 145714 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52c13c230 con 0x7fb52c13e200 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2660648046 0 0) 0x7fb52c13c230 con 0x7fb52c13e200 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb52c1396d0 con 0x7fb52c13e200 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb524001d90 con 0x7fb52c13e200 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): dump: 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.192 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:54.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 10757573 0 0) 0x7fb510003530 con 0x7fb52c134970 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb52c13c230 con 0x7fb52c134970 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb5280012a0 con 0x7fb52c134970 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 10 monclient(hunting): dump: 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.194 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.194+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 330810138 0 0) 0x7fb52c1396d0 con 0x7fb52c13e200 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.171:6789/0 conn(0x7fb52c0a4820 legacy=0x7fb52c1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.106:6789/0 conn(0x7fb52c134970 legacy=0x7fb52c138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 monclient: found mon.c 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:54.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52c13b6f0 con 0x7fb52c13e200 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 5 monclient: authenticate success, global_id 145714 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 10 monclient: _renew_subs 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb52c0a1e00 con 0x7fb52c13e200 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 10 monclient: _renew_subs 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb52c13bf50 con 0x7fb52c13e200 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb524004e20 con 0x7fb52c13e200 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb524005310 con 0x7fb52c13e200 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb530cb5640 4 set_mon_vals no callback set 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: dump: 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.197 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb5140065d0 con 0x7fb514002870 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb5240100b0 con 0x7fb52c13e200 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fb5240455d0 con 0x7fb52c13e200 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb531cb7640 10 monclient: get_auth_request con 0x7fb510037d10 auth_method 0 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102257741 0 0) 0x7fb5140065d0 con 0x7fb514002870 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient(hunting): my global_id is 145729 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52c1396d0 con 0x7fb514002870 2024-04-26T00:02:54.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4229934749 0 0) 0x7fb52c1396d0 con 0x7fb514002870 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5140065d0 con 0x7fb514002870 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb51c003940 con 0x7fb514002870 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: dump: 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.199 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1674405657 0 0) 0x7fb5140065d0 con 0x7fb514002870 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb51400a160 con 0x7fb514002870 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb51c001310 con 0x7fb514002870 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.171:6789/0 conn(0x7fb514002870 legacy=0x7fb514004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.198+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.171:6789/0 conn(0x7fb514002870 legacy=0x7fb514004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb53471c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:54.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb514009e50 con 0x7fb514009110 2024-04-26T00:02:54.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1231646439 0 0) 0x7fb514009e50 con 0x7fb514009110 2024-04-26T00:02:54.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient(hunting): my global_id is 145738 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5140065d0 con 0x7fb514009110 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2867123665 0 0) 0x7fb5140065d0 con 0x7fb514009110 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb514009e50 con 0x7fb514009110 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb51c001770 con 0x7fb514009110 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient: dump: 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.203 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 661554534 0 0) 0x7fb514009e50 con 0x7fb514009110 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb51400c3e0 con 0x7fb514009110 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2624440984) 0x7fb51c0064b0 con 0x7fb514009110 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.171:6789/0 conn(0x7fb514009110 legacy=0x7fb5140095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb522ffd640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.171:6789/0 conn(0x7fb514009110 legacy=0x7fb5140095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 237741, 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:54.205 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.206 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.207 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:54.208 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.209 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:54.210 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.212 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.216 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.217 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.218 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.219 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.220 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:54.221 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.223 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:54.223 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:54.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.171:6812/722422047 conn(0x7fb510037d10 legacy=0x7fb51003a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb53471c640 10 monclient: shutdown 2024-04-26T00:02:54.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb53471c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 >> v1:172.21.15.106:6791/0 conn(0x7fb52c13e200 legacy=0x7fb52c1d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb532cb9640 1 -- 172.21.15.106:0/1901764178 reap_dead start 2024-04-26T00:02:54.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.206+0000 7fb532cb9640 1 -- 172.21.15.106:0/1901764178 reap_dead start 2024-04-26T00:02:54.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.210+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 shutdown_connections 2024-04-26T00:02:54.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.210+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 >> 172.21.15.106:0/1901764178 conn(0x7fb52c0a9e20 msgr2=0x7fb52c134d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.210+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 shutdown_connections 2024-04-26T00:02:54.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.210+0000 7fb53471c640 1 -- 172.21.15.106:0/1901764178 wait complete. 2024-04-26T00:02:54.225 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:54.225 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:02:54.225 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:02:54.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.354+0000 7fe475b04640 10 monclient: get_monmap_and_config 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.354+0000 7fe475b04640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.354+0000 7fe475b04640 10 monclient: monmap: 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:54.362098+0000 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:54.362098+0000 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.338 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.339 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.339 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 Processor -- start 2024-04-26T00:02:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- start start 2024-04-26T00:02:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: init 2024-04-26T00:02:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: _add_conns ranks=[1,5,0,2,8,7,3,6,4] 2024-04-26T00:02:54.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient(hunting): picked mon.noname-f con 0x7fe470134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient(hunting): picked mon.noname-h con 0x7fe4700a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient(hunting): picked mon.noname-a con 0x7fe47013e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe47006dd40 con 0x7fe47013e200 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4700a2b10 con 0x7fe470134970 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4700a2df0 con 0x7fe4700a4820 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient(hunting): authenticate will time out at 1429.889223s 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe47013e200 0x7fe4701405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34734/0 (socket says 172.21.15.106:34734) 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46ffff640 1 -- 172.21.15.106:0/2808468891 learned_addr learned my addr 172.21.15.106:0/2808468891 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828800581 0 0) 0x7fe47006dd40 con 0x7fe47013e200 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient(hunting): my global_id is 7317 2024-04-26T00:02:54.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe45c003530 con 0x7fe47013e200 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2334590715 0 0) 0x7fe45c003530 con 0x7fe47013e200 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 >> v1:172.21.15.171:6791/0 conn(0x7fe4700a4820 legacy=0x7fe47013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 >> v1:172.21.15.171:6789/0 conn(0x7fe470134970 legacy=0x7fe470134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 monclient: found mon.noname-a 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4700a30d0 con 0x7fe47013e200 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe468001b40 con 0x7fe47013e200 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:54.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: dump: 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.349 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 5 monclient: authenticate success, global_id 7317 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe468001e30 con 0x7fe47013e200 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 1 -- 172.21.15.106:0/2808468891 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe468004f70 con 0x7fe47013e200 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe46effd640 10 monclient: dump: 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.350 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.353 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 4 set_mon_vals no callback set 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: shutdown 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- 172.21.15.106:0/2808468891 >> v1:172.21.15.106:6789/0 conn(0x7fe47013e200 legacy=0x7fe4701405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- 172.21.15.106:0/2808468891 shutdown_connections 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- 172.21.15.106:0/2808468891 >> 172.21.15.106:0/2808468891 conn(0x7fe4700a9e20 msgr2=0x7fe4700aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- 172.21.15.106:0/2808468891 shutdown_connections 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- 172.21.15.106:0/2808468891 wait complete. 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: monmap: 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.355 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 Processor -- start 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 1 -- start start 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: init 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.358+0000 7fe475b04640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient: _add_conns ranks=[7,0,6,4,1,8,2,3,5] 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient(hunting): picked mon.noname-i con 0x7fe4700a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient(hunting): picked mon.noname-a con 0x7fe470134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient(hunting): picked mon.noname-d con 0x7fe47013e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe470138e30 con 0x7fe470134970 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe470139110 con 0x7fe47013e200 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4701388b0 con 0x7fe4700a4820 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient(hunting): authenticate will time out at 1429.892094s 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe47013e200 0x7fe4701d4730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50104/0 (socket says 172.21.15.106:50104) 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe466ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe470134970 0x7fe47013c940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34738/0 (socket says 172.21.15.106:34738) 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46ffff640 1 -- 172.21.15.106:0/2082082897 learned_addr learned my addr 172.21.15.106:0/2082082897 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 25547792 0 0) 0x7fe470138e30 con 0x7fe470134970 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): my global_id is 7326 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe450003530 con 0x7fe470134970 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267791113 0 0) 0x7fe470139110 con 0x7fe47013e200 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): my global_id is 7296 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe470138e30 con 0x7fe47013e200 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3868532534 0 0) 0x7fe450003530 con 0x7fe470134970 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe470139110 con 0x7fe470134970 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe458001a60 con 0x7fe470134970 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): dump: 2024-04-26T00:02:54.358 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.359 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2058693862 0 0) 0x7fe470138e30 con 0x7fe47013e200 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe450003530 con 0x7fe47013e200 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2201173545 0 0) 0x7fe4701388b0 con 0x7fe4700a4820 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): my global_id is 145609 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe470138e30 con 0x7fe4700a4820 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe468001b00 con 0x7fe47013e200 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): dump: 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.360 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1207678426 0 0) 0x7fe470139110 con 0x7fe470134970 2024-04-26T00:02:54.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.171:6792/0 conn(0x7fe4700a4820 legacy=0x7fe4701cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.106:6792/0 conn(0x7fe47013e200 legacy=0x7fe4701d4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 monclient: found mon.a 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4700a1e00 con 0x7fe470134970 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 5 monclient: authenticate success, global_id 7326 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient: _renew_subs 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:54.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe4700a1a40 con 0x7fe470134970 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient: _renew_subs 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe47012dda0 con 0x7fe470134970 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe4580038d0 con 0x7fe470134970 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe458003e40 con 0x7fe470134970 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46e7fc640 4 set_mon_vals no callback set 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: dump: 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.363 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe4540065d0 con 0x7fe454002870 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe458004060 con 0x7fe470134970 2024-04-26T00:02:54.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fe458045170 con 0x7fe470134970 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46ffff640 10 monclient: get_auth_request con 0x7fe450037f80 auth_method 0 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 531964408 0 0) 0x7fe4540065d0 con 0x7fe454002870 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient(hunting): my global_id is 214212 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe470139110 con 0x7fe454002870 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 831566820 0 0) 0x7fe470139110 con 0x7fe454002870 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe4540065d0 con 0x7fe454002870 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe460001870 con 0x7fe454002870 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 10 monclient: dump: 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.365 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2777462951 0 0) 0x7fe4540065d0 con 0x7fe454002870 2024-04-26T00:02:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.362+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe45400a160 con 0x7fe454002870 2024-04-26T00:02:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.366+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe460004650 con 0x7fe454002870 2024-04-26T00:02:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.366+0000 7fe46cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.366+0000 7fe46cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.366+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.171:6790/0 conn(0x7fe454002870 legacy=0x7fe454004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.366+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.171:6790/0 conn(0x7fe454002870 legacy=0x7fe454004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe475b04640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:54.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe454009e50 con 0x7fe454009110 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 470228256 0 0) 0x7fe454009e50 con 0x7fe454009110 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 10 monclient(hunting): my global_id is 214221 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4540065d0 con 0x7fe454009110 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 472753065 0 0) 0x7fe4540065d0 con 0x7fe454009110 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe454009e50 con 0x7fe454009110 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe460003c50 con 0x7fe454009110 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 10 monclient: dump: 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.369 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 815598437 0 0) 0x7fe454009e50 con 0x7fe454009110 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.370+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe45400c3e0 con 0x7fe454009110 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2940544141) 0x7fe460004880 con 0x7fe454009110 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe46cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe46cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.171:6790/0 conn(0x7fe454009110 legacy=0x7fe4540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe46cff9640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.171:6790/0 conn(0x7fe454009110 legacy=0x7fe4540095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:54.371 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 4795, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.372 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.373 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.374 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:54.375 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.376 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.377 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:54.378 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.379 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.380 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.381 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:54.382 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.383 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.384 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.385 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.386 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.387 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.388 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:54.389 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.171:6812/722422047 conn(0x7fe450037f80 legacy=0x7fe45003a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 10 monclient: shutdown 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 >> v1:172.21.15.106:6789/0 conn(0x7fe470134970 legacy=0x7fe47013c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe46ffff640 1 -- 172.21.15.106:0/2082082897 reap_dead start 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe46ffff640 1 -- 172.21.15.106:0/2082082897 reap_dead start 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 shutdown_connections 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 >> 172.21.15.106:0/2082082897 conn(0x7fe4700a9e20 msgr2=0x7fe470067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 shutdown_connections 2024-04-26T00:02:54.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.374+0000 7fe475b04640 1 -- 172.21.15.106:0/2082082897 wait complete. 2024-04-26T00:02:54.392 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:54.392 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:02:54.392 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: get_monmap_and_config 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: monmap: 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:54.527180+0000 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:54.527180+0000 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.503 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.504 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 Processor -- start 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- start start 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: init 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: _add_conns ranks=[8,5,1,6,0,4,7,3,2] 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient(hunting): picked mon.noname-e con 0x7f0f70135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient(hunting): picked mon.noname-h con 0x7f0f701353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient(hunting): picked mon.noname-f con 0x7f0f7013bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7006f2d0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f70072330 con 0x7f0f701353b0 2024-04-26T00:02:54.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f70072610 con 0x7f0f70135870 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient(hunting): authenticate will time out at 1430.054314s 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f75bf5640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0f70135870 0x7f0f70135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:39202/0 (socket says 172.21.15.106:39202) 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f75bf5640 1 -- 172.21.15.106:0/244504596 learned_addr learned my addr 172.21.15.106:0/244504596 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 701947537 0 0) 0x7f0f70072610 con 0x7f0f70135870 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient(hunting): my global_id is 204794 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f5c003530 con 0x7f0f70135870 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1216770904 0 0) 0x7f0f5c003530 con 0x7f0f70135870 2024-04-26T00:02:54.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 >> v1:172.21.15.171:6791/0 conn(0x7f0f701353b0 legacy=0x7f0f7013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 >> v1:172.21.15.171:6789/0 conn(0x7f0f7013bdf0 legacy=0x7f0f7013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 monclient: found mon.noname-e 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f700a3260 con 0x7f0f70135870 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f68001800 con 0x7f0f70135870 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 5 monclient: authenticate success, global_id 204794 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: dump: 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.515 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f68001b10 con 0x7f0f70135870 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 1 -- 172.21.15.106:0/244504596 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f68004bf0 con 0x7f0f70135870 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:54.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 4 set_mon_vals no callback set 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f74bf3640 10 monclient: dump: 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.517 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 10 monclient: shutdown 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- 172.21.15.106:0/244504596 >> v1:172.21.15.106:6793/0 conn(0x7f0f70135870 legacy=0x7f0f70135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- 172.21.15.106:0/244504596 shutdown_connections 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- 172.21.15.106:0/244504596 >> 172.21.15.106:0/244504596 conn(0x7f0f700a64e0 msgr2=0x7f0f700a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- 172.21.15.106:0/244504596 shutdown_connections 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.522+0000 7f0f77e59640 1 -- 172.21.15.106:0/244504596 wait complete. 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: monmap: 2024-04-26T00:02:54.518 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.519 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 Processor -- start 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 -- start start 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: init 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: _add_conns ranks=[7,5,0,6,4,8,1,3,2] 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient(hunting): picked mon.noname-i con 0x7f0f701353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient(hunting): picked mon.noname-h con 0x7f0f70135870 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient(hunting): picked mon.noname-a con 0x7f0f7013bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f70131bb0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7009f470 con 0x7f0f70135870 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f701c73d0 con 0x7f0f701353b0 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient(hunting): authenticate will time out at 1430.057181s 2024-04-26T00:02:54.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f763f6640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0f7013bdf0 0x7f0f701d2a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34750/0 (socket says 172.21.15.106:34750) 2024-04-26T00:02:54.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f763f6640 1 -- 172.21.15.106:0/3757042363 learned_addr learned my addr 172.21.15.106:0/3757042363 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176238605 0 0) 0x7f0f7006f2d0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): my global_id is 7335 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f54003530 con 0x7f0f7013bdf0 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1197830271 0 0) 0x7f0f54003530 con 0x7f0f7013bdf0 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f7006f2d0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f64001980 con 0x7f0f7013bdf0 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): dump: 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.523 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.524 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057414853 0 0) 0x7f0f7009f470 con 0x7f0f70135870 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): my global_id is 7106 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f54003530 con 0x7f0f70135870 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3536697590 0 0) 0x7f0f7006f2d0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.171:6792/0 conn(0x7f0f701353b0 legacy=0x7f0f70134990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.171:6791/0 conn(0x7f0f70135870 legacy=0x7f0f701cf330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 monclient: found mon.a 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7009e6f0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 5 monclient: authenticate success, global_id 7335 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: _renew_subs 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f701c70a0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: _renew_subs 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f701350a0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f64003950 con 0x7f0f7013bdf0 2024-04-26T00:02:54.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f64003ec0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f63fff640 4 set_mon_vals no callback set 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: dump: 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.527 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f580065d0 con 0x7f0f58002870 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0f640040e0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f0f640451f0 con 0x7f0f7013bdf0 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4228014031 0 0) 0x7f0f580065d0 con 0x7f0f58002870 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient(hunting): my global_id is 7115 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f7006f2d0 con 0x7f0f58002870 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f753f4640 10 monclient: get_auth_request con 0x7f0f540377a0 auth_method 0 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4206874641 0 0) 0x7f0f7006f2d0 con 0x7f0f58002870 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f580065d0 con 0x7f0f58002870 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f68004bf0 con 0x7f0f58002870 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.526+0000 7f0f627fc640 10 monclient: dump: 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.529 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.530+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4178973564 0 0) 0x7f0f580065d0 con 0x7f0f58002870 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.530+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f5800a160 con 0x7f0f58002870 2024-04-26T00:02:54.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.530+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0f68001660 con 0x7f0f58002870 2024-04-26T00:02:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.530+0000 7f0f627fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.530+0000 7f0f627fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.530+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.171:6791/0 conn(0x7f0f58002870 legacy=0x7f0f58004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.530+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.171:6791/0 conn(0x7f0f58002870 legacy=0x7f0f58004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f77e59640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f58009e50 con 0x7f0f58009110 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2109955754 0 0) 0x7f0f58009e50 con 0x7f0f58009110 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 10 monclient(hunting): my global_id is 7124 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f580065d0 con 0x7f0f58009110 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3628331101 0 0) 0x7f0f580065d0 con 0x7f0f58009110 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f58009e50 con 0x7f0f58009110 2024-04-26T00:02:54.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f68005000 con 0x7f0f58009110 2024-04-26T00:02:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.534+0000 7f0f627fc640 10 monclient: dump: 2024-04-26T00:02:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.534 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.536 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 889095319 0 0) 0x7f0f58009e50 con 0x7f0f58009110 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f5800c3e0 con 0x7f0f58009110 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3133041868) 0x7f0f68007260 con 0x7f0f58009110 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f627fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f627fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.171:6791/0 conn(0x7f0f58009110 legacy=0x7f0f580095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f627fc640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.171:6791/0 conn(0x7f0f58009110 legacy=0x7f0f580095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.538 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 493039, 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:54.539 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.540 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:54.541 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.542 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:54.543 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:54.543 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:54.543 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:54.543 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.544 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.545 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.546 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.549 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.550 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.551 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.552 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.554 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:54.555 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:54.557 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.557 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.559 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.560 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:54.561 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.171:6812/722422047 conn(0x7f0f540377a0 legacy=0x7f0f54039c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 10 monclient: shutdown 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 >> v1:172.21.15.106:6789/0 conn(0x7f0f7013bdf0 legacy=0x7f0f701d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f763f6640 1 -- 172.21.15.106:0/3757042363 reap_dead start 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f763f6640 1 -- 172.21.15.106:0/3757042363 reap_dead start 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 shutdown_connections 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 >> 172.21.15.106:0/3757042363 conn(0x7f0f700a64e0 msgr2=0x7f0f7012e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 shutdown_connections 2024-04-26T00:02:54.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.538+0000 7f0f77e59640 1 -- 172.21.15.106:0/3757042363 wait complete. 2024-04-26T00:02:54.564 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:54.564 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:02:54.564 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:02:54.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: get_monmap_and_config 2024-04-26T00:02:54.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: monmap: 2024-04-26T00:02:54.682 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.682 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:54.706718+0000 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:54.706718+0000 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.683 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 Processor -- start 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- start start 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: init 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: _add_conns ranks=[2,5,3,1,4,0,8,6,7] 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient(hunting): picked mon.noname-b con 0x7fd5e0134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient(hunting): picked mon.noname-h con 0x7fd5e00a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient(hunting): picked mon.noname-g con 0x7fd5e013e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e006dd40 con 0x7fd5e0134970 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e00a2b10 con 0x7fd5e013e200 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e00a2df0 con 0x7fd5e00a4820 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient(hunting): authenticate will time out at 1430.234014s 2024-04-26T00:02:54.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5df7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd5e0134970 0x7fd5e0134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55504/0 (socket says 172.21.15.106:55504) 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5df7fe640 1 -- 172.21.15.106:0/2058369080 learned_addr learned my addr 172.21.15.106:0/2058369080 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3072688438 0 0) 0x7fd5e006dd40 con 0x7fd5e0134970 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient(hunting): my global_id is 7121 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c8003530 con 0x7fd5e0134970 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3959049152 0 0) 0x7fd5c8003530 con 0x7fd5e0134970 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 >> v1:172.21.15.171:6791/0 conn(0x7fd5e00a4820 legacy=0x7fd5e013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 >> v1:172.21.15.171:6790/0 conn(0x7fd5e013e200 legacy=0x7fd5e01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 monclient: found mon.noname-b 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e00a30d0 con 0x7fd5e0134970 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d00017c0 con 0x7fd5e0134970 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: dump: 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.693 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.694 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 5 monclient: authenticate success, global_id 7121 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5d0001ab0 con 0x7fd5e0134970 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 4 set_mon_vals no callback set 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 1 -- 172.21.15.106:0/2058369080 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d0004bf0 con 0x7fd5e0134970 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5de7fc640 10 monclient: dump: 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.695 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 10 monclient: shutdown 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- 172.21.15.106:0/2058369080 >> v1:172.21.15.106:6790/0 conn(0x7fd5e0134970 legacy=0x7fd5e0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- 172.21.15.106:0/2058369080 shutdown_connections 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- 172.21.15.106:0/2058369080 >> 172.21.15.106:0/2058369080 conn(0x7fd5e00a9e20 msgr2=0x7fd5e00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- 172.21.15.106:0/2058369080 shutdown_connections 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.702+0000 7fd5e5da7640 1 -- 172.21.15.106:0/2058369080 wait complete. 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: monmap: 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.697 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 1 Processor -- start 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 1 -- start start 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: init 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: _add_conns ranks=[3,5,7,4,8,1,2,0,6] 2024-04-26T00:02:54.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient(hunting): picked mon.noname-g con 0x7fd5e00a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient(hunting): picked mon.noname-h con 0x7fd5e0134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient(hunting): picked mon.noname-i con 0x7fd5e013e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e012d350 con 0x7fd5e00a4820 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e01398a0 con 0x7fd5e0134970 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e00a1e00 con 0x7fd5e013e200 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient(hunting): authenticate will time out at 1430.237378s 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5df7fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd5e00a4820 0x7fd5e012c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:37498/0 (socket says 172.21.15.106:37498) 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5deffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fd5e0134970 0x7fd5e012cc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:49008/0 (socket says 172.21.15.106:49008) 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5df7fe640 1 -- 172.21.15.106:0/1241321962 learned_addr learned my addr 172.21.15.106:0/1241321962 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000850447 0 0) 0x7fd5e00a1e00 con 0x7fd5e013e200 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): my global_id is 145627 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5cc003530 con 0x7fd5e013e200 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 476089312 0 0) 0x7fd5e012d350 con 0x7fd5e00a4820 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): my global_id is 214230 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e00a1e00 con 0x7fd5e00a4820 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2986307338 0 0) 0x7fd5e01398a0 con 0x7fd5e0134970 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): my global_id is 7142 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e012d350 con 0x7fd5e0134970 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 408329529 0 0) 0x7fd5e00a1e00 con 0x7fd5e00a4820 2024-04-26T00:02:54.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5e01398a0 con 0x7fd5e00a4820 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d0001780 con 0x7fd5e00a4820 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): dump: 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.701 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 830897684 0 0) 0x7fd5cc003530 con 0x7fd5e013e200 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5e00a1e00 con 0x7fd5e013e200 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3262698549 0 0) 0x7fd5e012d350 con 0x7fd5e0134970 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5cc003530 con 0x7fd5e0134970 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d8001c80 con 0x7fd5e013e200 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:54.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): dump: 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.703 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d40019d0 con 0x7fd5e0134970 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient(hunting): dump: 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.704 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 936838521 0 0) 0x7fd5e01398a0 con 0x7fd5e00a4820 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6792/0 conn(0x7fd5e013e200 legacy=0x7fd5e01d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6791/0 conn(0x7fd5e0134970 legacy=0x7fd5e012cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 monclient: found mon.g 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e00a1a40 con 0x7fd5e00a4820 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 5 monclient: authenticate success, global_id 214230 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: _renew_subs 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e013acb0 con 0x7fd5e00a4820 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: _renew_subs 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5e01382b0 con 0x7fd5e00a4820 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5d0001180 con 0x7fd5e00a4820 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5ddffb640 4 set_mon_vals no callback set 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d00051b0 con 0x7fd5e00a4820 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5c7fff640 10 monclient: dump: 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.707 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.706+0000 7fd5e5da7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd5c00065d0 con 0x7fd5c0002870 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd5d000ff50 con 0x7fd5e00a4820 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fd5d0045120 con 0x7fd5e00a4820 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4282860499 0 0) 0x7fd5c00065d0 con 0x7fd5c0002870 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient(hunting): my global_id is 145636 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e01398a0 con 0x7fd5c0002870 2024-04-26T00:02:54.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5dffff640 10 monclient: get_auth_request con 0x7fd5cc0381a0 auth_method 0 2024-04-26T00:02:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1787314013 0 0) 0x7fd5e01398a0 con 0x7fd5c0002870 2024-04-26T00:02:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5c00065d0 con 0x7fd5c0002870 2024-04-26T00:02:54.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d4003940 con 0x7fd5c0002870 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient: dump: 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.711 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3056205897 0 0) 0x7fd5c00065d0 con 0x7fd5c0002870 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5c000a160 con 0x7fd5c0002870 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd5d40057d0 con 0x7fd5c0002870 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6792/0 conn(0x7fd5c0002870 legacy=0x7fd5c0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.710+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6792/0 conn(0x7fd5c0002870 legacy=0x7fd5c0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd5c0009e10 con 0x7fd5c00090f0 2024-04-26T00:02:54.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638710867 0 0) 0x7fd5c0009e10 con 0x7fd5c00090f0 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient(hunting): my global_id is 145645 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c00065d0 con 0x7fd5c00090f0 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3536398094 0 0) 0x7fd5c00065d0 con 0x7fd5c00090f0 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5c0009e10 con 0x7fd5c00090f0 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5d4004220 con 0x7fd5c00090f0 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient: dump: 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.713 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1094784796 0 0) 0x7fd5c0009e10 con 0x7fd5c00090f0 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd5c000c390 con 0x7fd5c00090f0 2024-04-26T00:02:54.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1512760245) 0x7fd5d4005980 con 0x7fd5c00090f0 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6792/0 conn(0x7fd5c00090f0 legacy=0x7fd5c0009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5c7fff640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6792/0 conn(0x7fd5c00090f0 legacy=0x7fd5c0009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 48, 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 238253, 2024-04-26T00:02:54.715 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:02:54.716 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.717 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:02:54.718 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:02:54.719 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:02:54.720 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.721 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.722 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.723 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.725 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.726 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.727 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.728 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:02:54.729 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:02:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:02:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:02:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.731 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:02:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:02:54.732 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:02:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:02:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:02:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:02:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:02:54.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:02:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:02:54.734 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:02:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:02:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:02:54.735 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:02:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:02:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:02:54.736 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:02:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:02:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:02:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:02:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:02:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:02:54.737 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:02:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:02:54.738 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:02:54.738 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:54.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6812/722422047 conn(0x7fd5cc0381a0 legacy=0x7fd5cc03a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 10 monclient: shutdown 2024-04-26T00:02:54.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 >> v1:172.21.15.171:6790/0 conn(0x7fd5e00a4820 legacy=0x7fd5e012c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5dffff640 1 -- 172.21.15.106:0/1241321962 reap_dead start 2024-04-26T00:02:54.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5dffff640 1 -- 172.21.15.106:0/1241321962 reap_dead start 2024-04-26T00:02:54.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 shutdown_connections 2024-04-26T00:02:54.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 >> 172.21.15.106:0/1241321962 conn(0x7fd5e00a9e20 msgr2=0x7fd5e0067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 shutdown_connections 2024-04-26T00:02:54.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.718+0000 7fd5e5da7640 1 -- 172.21.15.106:0/1241321962 wait complete. 2024-04-26T00:02:54.743 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:02:54.743 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['f', 'e'] 2024-04-26T00:02:54.743 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['c', 'g'] 2024-04-26T00:02:54.743 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-04-26T00:02:54.744 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f store 2024-04-26T00:02:54.744 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f sync_force --yes-i-really-mean-it 2024-04-26T00:02:54.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: get_monmap_and_config 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: monmap: 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:54.886697+0000 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:54.886697+0000 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 Processor -- start 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- start start 2024-04-26T00:02:54.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: init 2024-04-26T00:02:54.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: _add_conns ranks=[3,2,6,8,5,4,0,1,7] 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient(hunting): picked mon.noname-g con 0x7f5dd0134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient(hunting): picked mon.noname-b con 0x7f5dd00a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient(hunting): picked mon.noname-d con 0x7f5dd013e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd006dd40 con 0x7f5dd00a4820 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd00a2b10 con 0x7f5dd0134970 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd00a2df0 con 0x7f5dd013e200 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient(hunting): authenticate will time out at 1430.413710s 2024-04-26T00:02:54.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dcf7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f5dd00a4820 0x7f5dd013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55512/0 (socket says 172.21.15.106:55512) 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dcf7fe640 1 -- 172.21.15.106:0/2972894775 learned_addr learned my addr 172.21.15.106:0/2972894775 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd4951640 1 --1- 172.21.15.106:0/2972894775 >> v1:172.21.15.106:6792/0 conn(0x7f5dd013e200 0x7f5dd01405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:50112/0 (socket says 172.21.15.106:50112) 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686587224 0 0) 0x7f5dd006dd40 con 0x7f5dd00a4820 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): my global_id is 7130 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db8003530 con 0x7f5dd00a4820 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 277921743 0 0) 0x7f5dd00a2df0 con 0x7f5dd013e200 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient(hunting): my global_id is 7305 2024-04-26T00:02:54.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd006dd40 con 0x7f5dd013e200 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3723140470 0 0) 0x7f5db8003530 con 0x7f5dd00a4820 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 >> v1:172.21.15.106:6792/0 conn(0x7f5dd013e200 legacy=0x7f5dd01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 >> v1:172.21.15.171:6790/0 conn(0x7f5dd0134970 legacy=0x7f5dd0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 monclient: found mon.noname-b 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd00a30d0 con 0x7f5dd00a4820 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 5 monclient: authenticate success, global_id 7130 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5dc40017c0 con 0x7f5dd00a4820 2024-04-26T00:02:54.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: dump: 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.876 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.877 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5dc40019b0 con 0x7f5dd00a4820 2024-04-26T00:02:54.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 4 set_mon_vals no callback set 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 1 -- 172.21.15.106:0/2972894775 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5dc4004bf0 con 0x7f5dd00a4820 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dceffd640 10 monclient: dump: 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.878 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: shutdown 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- 172.21.15.106:0/2972894775 >> v1:172.21.15.106:6790/0 conn(0x7f5dd00a4820 legacy=0x7f5dd013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- 172.21.15.106:0/2972894775 shutdown_connections 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- 172.21.15.106:0/2972894775 >> 172.21.15.106:0/2972894775 conn(0x7f5dd00a9e20 msgr2=0x7f5dd00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- 172.21.15.106:0/2972894775 shutdown_connections 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 1 -- 172.21.15.106:0/2972894775 wait complete. 2024-04-26T00:02:54.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: build_initial_monmap 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.882+0000 7f5dd63b4640 10 monclient: monmap: 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:54.880 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 Processor -- start 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 -- start start 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient: init 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient: _add_conns ranks=[4,5,2,1,8,3,0,7,6] 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient(hunting): picked mon.noname-c con 0x7f5dd00a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient(hunting): picked mon.noname-h con 0x7f5dd0134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient(hunting): picked mon.noname-b con 0x7f5dd013e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd01396d0 con 0x7f5dd013e200 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd0139f30 con 0x7f5dd00a4820 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dd013c200 con 0x7f5dd0134970 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:54.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient(hunting): authenticate will time out at 1430.416769s 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd4951640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f5dd013e200 0x7f5dd01d45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55516/0 (socket says 172.21.15.106:55516) 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd4951640 1 -- 172.21.15.106:0/105204894 learned_addr learned my addr 172.21.15.106:0/105204894 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2777897450 0 0) 0x7f5dd01396d0 con 0x7f5dd013e200 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): my global_id is 7139 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dbc003530 con 0x7f5dd013e200 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031180423 0 0) 0x7f5dd0139f30 con 0x7f5dd00a4820 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): my global_id is 145723 2024-04-26T00:02:54.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd01396d0 con 0x7f5dd00a4820 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1515242344 0 0) 0x7f5dbc003530 con 0x7f5dd013e200 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5dd0139f30 con 0x7f5dd013e200 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5dc8001cc0 con 0x7f5dd013e200 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): dump: 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.883 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2989107275 0 0) 0x7f5dd013c200 con 0x7f5dd0134970 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): my global_id is 7151 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dbc003530 con 0x7f5dd0134970 2024-04-26T00:02:54.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2825608723 0 0) 0x7f5dd01396d0 con 0x7f5dd00a4820 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5dd013c200 con 0x7f5dd00a4820 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5dc0001a20 con 0x7f5dd00a4820 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): dump: 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.885 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3077061661 0 0) 0x7f5dd0139f30 con 0x7f5dd013e200 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.171:6791/0 conn(0x7f5dd0134970 legacy=0x7f5dd0138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.106:6791/0 conn(0x7f5dd00a4820 legacy=0x7f5dd01388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: _finish_hunting 0 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 monclient: found mon.b 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:54.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd00a1e00 con 0x7f5dd013e200 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: _finish_auth 0 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: _check_auth_tickets 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 5 monclient: authenticate success, global_id 7139 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient: _renew_subs 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd013bf20 con 0x7f5dd013e200 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient: _renew_subs 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5dd013a350 con 0x7f5dd013e200 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5dc8001fd0 con 0x7f5dd013e200 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5dc8005160 con 0x7f5dd013e200 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dce7fc640 4 set_mon_vals no callback set 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: dump: 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.888 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5db00065d0 con 0x7f5db0002870 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5dc800ff00 con 0x7f5dd013e200 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f5dc8045380 con 0x7f5dd013e200 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dcf7fe640 10 monclient: get_auth_request con 0x7f5dbc037fe0 auth_method 0 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1692753906 0 0) 0x7f5db00065d0 con 0x7f5db0002870 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient(hunting): my global_id is 145765 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5dd0139f30 con 0x7f5db0002870 2024-04-26T00:02:54.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3660543485 0 0) 0x7f5dd0139f30 con 0x7f5db0002870 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5db00065d0 con 0x7f5db0002870 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5dc0003960 con 0x7f5db0002870 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 10 monclient: dump: 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.890 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3346893697 0 0) 0x7f5db00065d0 con 0x7f5db0002870 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.886+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5db000a160 con 0x7f5db0002870 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.890+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5dc0003cd0 con 0x7f5db0002870 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.890+0000 7f5dccff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.890+0000 7f5dccff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.890+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.171:6789/0 conn(0x7f5db0002870 legacy=0x7f5db0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.890+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.171:6789/0 conn(0x7f5db0002870 legacy=0x7f5db0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.894+0000 7f5dd63b4640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.894+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5db0009e60 con 0x7f5db0009120 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1396351888 0 0) 0x7f5db0009e60 con 0x7f5db0009120 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient(hunting): _negotiate 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient(hunting): my global_id is 145774 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db00065d0 con 0x7f5db0009120 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1839697950 0 0) 0x7f5db00065d0 con 0x7f5db0009120 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5db0009e60 con 0x7f5db0009120 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5dc0004650 con 0x7f5db0009120 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient: dump: 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:54.893 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:54.894 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3206742920 0 0) 0x7f5db0009e60 con 0x7f5db0009120 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f5db000c3e0 con 0x7f5db0009120 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f5dc0005060 con 0x7f5db0009120 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.171:6789/0 conn(0x7f5db0009120 legacy=0x7f5db00095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dccff9640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.171:6789/0 conn(0x7f5db0009120 legacy=0x7f5db00095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-26T00:02:54.895 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-26T00:02:54.896 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.171:6812/722422047 conn(0x7f5dbc037fe0 legacy=0x7f5dbc03a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 10 monclient: shutdown 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 >> v1:172.21.15.106:6790/0 conn(0x7f5dd013e200 legacy=0x7f5dd01d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd4951640 1 -- 172.21.15.106:0/105204894 reap_dead start 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd4951640 1 -- 172.21.15.106:0/105204894 reap_dead start 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 shutdown_connections 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 >> 172.21.15.106:0/105204894 conn(0x7f5dd00a9e20 msgr2=0x7f5dd0130a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 shutdown_connections 2024-04-26T00:02:54.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:54.898+0000 7f5dd63b4640 1 -- 172.21.15.106:0/105204894 wait complete. 2024-04-26T00:02:54.898 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-26T00:02:54.898 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-04-26T00:02:54.898 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:02:54.916 INFO:tasks.ceph.mon.f:Stopped 2024-04-26T00:02:54.916 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-04-26T00:02:54.916 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e store 2024-04-26T00:02:54.916 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e sync_force --yes-i-really-mean-it 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.046+0000 7fcbc3d01640 10 monclient: get_monmap_and_config 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.046+0000 7fcbc3d01640 10 monclient: build_initial_monmap 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.046+0000 7fcbc3d01640 10 monclient: monmap: 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:02:55.052494+0000 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:02:55.052494+0000 2024-04-26T00:02:55.028 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:55.029 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:55.030 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:55.030 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.037 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.046+0000 7fcbc3d01640 1 Processor -- start 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.046+0000 7fcbc3d01640 1 -- start start 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.046+0000 7fcbc3d01640 10 monclient: init 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: _add_conns ranks=[0,3,1,4,2,8,5,7,6] 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): picked mon.noname-a con 0x7fcbbc134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): picked mon.noname-g con 0x7fcbbc0a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): picked mon.noname-f con 0x7fcbbc13e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc06dd40 con 0x7fcbbc134970 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc0a2b10 con 0x7fcbbc13e200 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc0a2df0 con 0x7fcbbc0a4820 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): authenticate will time out at 1430.580257s 2024-04-26T00:02:55.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc1a9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fcbbc134970 0x7fcbbc134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34760/0 (socket says 172.21.15.106:34760) 2024-04-26T00:02:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc1a9d640 1 -- 172.21.15.106:0/209107989 learned_addr learned my addr 172.21.15.106:0/209107989 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc229e640 1 -- 172.21.15.106:0/209107989 >> v1:172.21.15.171:6789/0 conn(0x7fcbbc13e200 legacy=0x7fcbbc1405f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:02:55.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4076974305 0 0) 0x7fcbbc06dd40 con 0x7fcbbc134970 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient(hunting): _negotiate 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient(hunting): my global_id is 7344 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcba8003530 con 0x7fcbbc134970 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1489172110 0 0) 0x7fcba8003530 con 0x7fcbbc134970 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 >> v1:172.21.15.171:6790/0 conn(0x7fcbbc0a4820 legacy=0x7fcbbc13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 >> v1:172.21.15.171:6789/0 conn(0x7fcbbc13e200 legacy=0x7fcbbc1405f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: _finish_hunting 0 2024-04-26T00:02:55.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 monclient: found mon.noname-a 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc0a30d0 con 0x7fcbbc134970 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: _finish_auth 0 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: _check_auth_tickets 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbb80017c0 con 0x7fcbbc134970 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 5 monclient: authenticate success, global_id 7344 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: dump: 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:55.041 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:55.042 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbb8001ab0 con 0x7fcbbc134970 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 1 -- 172.21.15.106:0/209107989 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbb8004bf0 con 0x7fcbbc134970 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: get_monmap_and_config success 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 4 set_mon_vals no callback set 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc0a9b640 10 monclient: dump: 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.043 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:55.044 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: shutdown 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- 172.21.15.106:0/209107989 >> v1:172.21.15.106:6789/0 conn(0x7fcbbc134970 legacy=0x7fcbbc134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- 172.21.15.106:0/209107989 shutdown_connections 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- 172.21.15.106:0/209107989 >> 172.21.15.106:0/209107989 conn(0x7fcbbc0a9e20 msgr2=0x7fcbbc0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- 172.21.15.106:0/209107989 shutdown_connections 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- 172.21.15.106:0/209107989 wait complete. 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: build_initial_monmap 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: monmap: 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:02:55.045 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 Processor -- start 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- start start 2024-04-26T00:02:55.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: init 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: _reopen_session rank -1 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient: _add_conns ranks=[2,1,5,6,3,8,4,0,7] 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): picked mon.noname-b con 0x7fcbbc0a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): picked mon.noname-f con 0x7fcbbc134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): picked mon.noname-h con 0x7fcbbc13e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc1396d0 con 0x7fcbbc134970 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc13ab40 con 0x7fcbbc0a4820 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbbc13ae20 con 0x7fcbbc13e200 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): _renew_subs 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc3d01640 10 monclient(hunting): authenticate will time out at 1430.583196s 2024-04-26T00:02:55.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc1a9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fcbbc0a4820 0x7fcbbc1388b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55524/0 (socket says 172.21.15.106:55524) 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc1a9d640 1 -- 172.21.15.106:0/4060225472 learned_addr learned my addr 172.21.15.106:0/4060225472 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbc129c640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.171:6789/0 conn(0x7fcbbc134970 legacy=0x7fcbbc138fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 384753007 0 0) 0x7fcbbc13ab40 con 0x7fcbbc0a4820 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): my global_id is 7148 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcba0003530 con 0x7fcbbc0a4820 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2260746596 0 0) 0x7fcba0003530 con 0x7fcbbc0a4820 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbbc13ab40 con 0x7fcbbc0a4820 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbb8004b30 con 0x7fcbbc0a4820 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:02:55.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): dump: 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:55.049 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1606373838 0 0) 0x7fcbbc13ab40 con 0x7fcbbc0a4820 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.050+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.171:6791/0 conn(0x7fcbbc13e200 legacy=0x7fcbbc1d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.171:6789/0 conn(0x7fcbbc134970 legacy=0x7fcbbc138fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 monclient: found mon.b 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:55.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbbc137660 con 0x7fcbbc0a4820 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: _finish_auth 0 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 5 monclient: authenticate success, global_id 7148 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 10 monclient: _renew_subs 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcbbc137d20 con 0x7fcbbc0a4820 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 10 monclient: _renew_subs 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcbbc138280 con 0x7fcbbc0a4820 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbb8001ab0 con 0x7fcbbc0a4820 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:02:55.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb3fff640 4 set_mon_vals no callback set 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbb8001c60 con 0x7fcbbc0a4820 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: dump: 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:55.052 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcba40065d0 con 0x7fcba4002870 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcbb80100e0 con 0x7fcbbc0a4820 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fcbb8045280 con 0x7fcbbc0a4820 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960421763 0 0) 0x7fcba40065d0 con 0x7fcba4002870 2024-04-26T00:02:55.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient(hunting): my global_id is 204803 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbbc13ab40 con 0x7fcba4002870 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbc229e640 10 monclient: get_auth_request con 0x7fcba0037780 auth_method 0 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3606250726 0 0) 0x7fcbbc13ab40 con 0x7fcba4002870 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcba40065d0 con 0x7fcba4002870 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbac0017a0 con 0x7fcba4002870 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: dump: 2024-04-26T00:02:55.054 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:55.055 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 948164660 0 0) 0x7fcba40065d0 con 0x7fcba4002870 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcba400a160 con 0x7fcba4002870 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcbac001d10 con 0x7fcba4002870 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.106:6793/0 conn(0x7fcba4002870 legacy=0x7fcba4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:55.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.054+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.106:6793/0 conn(0x7fcba4002870 legacy=0x7fcba4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:02:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcba4009e60 con 0x7fcba4009120 2024-04-26T00:02:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1906637461 0 0) 0x7fcba4009e60 con 0x7fcba4009120 2024-04-26T00:02:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:02:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:02:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:02:55.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient(hunting): my global_id is 204812 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcba40065d0 con 0x7fcba4009120 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3296478542 0 0) 0x7fcba40065d0 con 0x7fcba4009120 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcba4009e60 con 0x7fcba4009120 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcbac003bb0 con 0x7fcba4009120 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient: dump: 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:02:55.059 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:02:55.060 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2984562815 0 0) 0x7fcba4009e60 con 0x7fcba4009120 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7fcba400c3e0 con 0x7fcba4009120 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7fcbac003e70 con 0x7fcba4009120 2024-04-26T00:02:55.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:02:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:02:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.106:6793/0 conn(0x7fcba4009120 legacy=0x7fcba40095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:55.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbb27fc640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.106:6793/0 conn(0x7fcba4009120 legacy=0x7fcba40095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:02:55.063 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:02:55.063 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-26T00:02:55.063 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-26T00:02:55.063 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:02:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.171:6812/722422047 conn(0x7fcba0037780 legacy=0x7fcba0039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:55.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 10 monclient: shutdown 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 >> v1:172.21.15.106:6790/0 conn(0x7fcbbc0a4820 legacy=0x7fcbbc1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc229e640 1 -- 172.21.15.106:0/4060225472 reap_dead start 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc229e640 1 -- 172.21.15.106:0/4060225472 reap_dead start 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 shutdown_connections 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 >> 172.21.15.106:0/4060225472 conn(0x7fcbbc0a9e20 msgr2=0x7fcbbc130bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 shutdown_connections 2024-04-26T00:02:55.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:02:55.062+0000 7fcbc3d01640 1 -- 172.21.15.106:0/4060225472 wait complete. 2024-04-26T00:02:55.065 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-26T00:02:55.066 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-04-26T00:02:55.066 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:02:55.077 INFO:tasks.ceph.mon.e:Stopped 2024-04-26T00:02:55.077 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-26T00:02:55.077 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-26T00:02:55.077 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-04-26T00:02:55.077 INFO:tasks.ceph.mon.g:Sent signal 19 2024-04-26T00:02:55.077 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T00:03:10.079 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-26T00:03:10.079 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-26T00:03:10.080 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-04-26T00:03:10.080 INFO:tasks.ceph.mon.g:Sent signal 18 2024-04-26T00:03:10.080 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-04-26T00:03:10.080 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:03:10.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient: get_monmap_and_config 2024-04-26T00:03:10.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient: build_initial_monmap 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient: monmap: 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:10.235894+0000 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:10.235894+0000 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:10.212 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:10.213 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:10.213 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:10.213 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 1 Processor -- start 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 1 -- start start 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient: init 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient: _add_conns ranks=[2,5,7,0,3,8,1,6,4] 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient(hunting): picked mon.noname-b con 0x7fc46c135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient(hunting): picked mon.noname-h con 0x7fc46c1353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient(hunting): picked mon.noname-i con 0x7fc46c13bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c06f2d0 con 0x7fc46c135870 2024-04-26T00:03:10.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c072330 con 0x7fc46c1353b0 2024-04-26T00:03:10.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c072610 con 0x7fc46c13bdf0 2024-04-26T00:03:10.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:10.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc471515640 10 monclient(hunting): authenticate will time out at 1445.763067s 2024-04-26T00:03:10.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc46affd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc46c135870 0x7fc46c135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:59734/0 (socket says 172.21.15.106:59734) 2024-04-26T00:03:10.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:10.234+0000 7fc46affd640 1 -- 172.21.15.106:0/1898365838 learned_addr learned my addr 172.21.15.106:0/1898365838 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:13.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient(hunting): tick 2024-04-26T00:03:13.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:03:13.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 1 monclient(hunting): continuing hunt 2024-04-26T00:03:13.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 1 -- 172.21.15.106:0/1898365838 >> v1:172.21.15.171:6792/0 conn(0x7fc46c13bdf0 legacy=0x7fc46c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 1 -- 172.21.15.106:0/1898365838 >> v1:172.21.15.171:6791/0 conn(0x7fc46c1353b0 legacy=0x7fc46c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 1 -- 172.21.15.106:0/1898365838 >> v1:172.21.15.106:6790/0 conn(0x7fc46c135870 legacy=0x7fc46c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient: _add_conns ranks=[0,3,6,1,8,4] 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient(hunting): picked mon.noname-a con 0x7fc44c0037f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient(hunting): picked mon.noname-g con 0x7fc44c0073e0 addr v1:172.21.15.171:6790/0 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient(hunting): picked mon.noname-d con 0x7fc44c00b170 addr v1:172.21.15.106:6792/0 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 1 -- 172.21.15.106:0/1898365838 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c0a3260 con 0x7fc44c0037f0 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 1 -- 172.21.15.106:0/1898365838 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c00fff0 con 0x7fc44c0073e0 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 1 -- 172.21.15.106:0/1898365838 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc44c011280 con 0x7fc44c00b170 2024-04-26T00:03:13.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:13.234+0000 7fc468ff9640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794191204 0 0) 0x7fc44c00fff0 con 0x7fc44c0073e0 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient(hunting): my global_id is 214257 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc458003530 con 0x7fc44c0073e0 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3964466539 0 0) 0x7fc458003530 con 0x7fc44c0073e0 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 >> v1:172.21.15.106:6792/0 conn(0x7fc44c00b170 legacy=0x7fc44c00d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 >> v1:172.21.15.106:6789/0 conn(0x7fc44c0037f0 legacy=0x7fc44c005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 monclient: found mon.noname-g 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc44c0124f0 con 0x7fc44c0073e0 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc46b7fe640 1 -- 172.21.15.106:0/1898365838 reap_dead start 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc454001800 con 0x7fc44c0073e0 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: dump: 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.140 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc471515640 5 monclient: authenticate success, global_id 214257 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc471515640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc454001a60 con 0x7fc44c0073e0 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 1 -- 172.21.15.106:0/1898365838 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc454003940 con 0x7fc44c0073e0 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc471515640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc471515640 4 set_mon_vals no callback set 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.158+0000 7fc469ffb640 10 monclient: dump: 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.142 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.143 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.144 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient: shutdown 2024-04-26T00:03:15.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- 172.21.15.106:0/1898365838 >> v1:172.21.15.171:6790/0 conn(0x7fc44c0073e0 legacy=0x7fc44c0098a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- 172.21.15.106:0/1898365838 shutdown_connections 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- 172.21.15.106:0/1898365838 >> 172.21.15.106:0/1898365838 conn(0x7fc46c0a64e0 msgr2=0x7fc46c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- 172.21.15.106:0/1898365838 shutdown_connections 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- 172.21.15.106:0/1898365838 wait complete. 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient: build_initial_monmap 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient: monmap: 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:15.149 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 Processor -- start 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- start start 2024-04-26T00:03:15.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient: init 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient: _add_conns ranks=[3,1,0,7,4,6,8,5,2] 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient(hunting): picked mon.noname-g con 0x7fc46c09dce0 addr v1:172.21.15.171:6790/0 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient(hunting): picked mon.noname-f con 0x7fc46c11dc90 addr v1:172.21.15.171:6789/0 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient(hunting): picked mon.noname-a con 0x7fc46c1d31e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c1c96b0 con 0x7fc46c1d31e0 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c09f930 con 0x7fc46c11dc90 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46c09f470 con 0x7fc46c09dce0 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc471515640 10 monclient(hunting): authenticate will time out at 1450.691593s 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc46b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc46c1d31e0 0x7fc46c1d55d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41734/0 (socket says 172.21.15.106:41734) 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc46b7fe640 1 -- 172.21.15.106:0/236182469 learned_addr learned my addr 172.21.15.106:0/236182469 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.162+0000 7fc46a7fc640 1 -- 172.21.15.106:0/236182469 >> v1:172.21.15.171:6789/0 conn(0x7fc46c11dc90 legacy=0x7fc46c1d1ac0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:03:15.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1644061634 0 0) 0x7fc46c09f470 con 0x7fc46c09dce0 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): my global_id is 214266 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc44c00a070 con 0x7fc46c09dce0 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3014417894 0 0) 0x7fc44c00a070 con 0x7fc46c09dce0 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc46c09f470 con 0x7fc46c09dce0 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc464001c90 con 0x7fc46c09dce0 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): dump: 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.152 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1010913453 0 0) 0x7fc46c09f470 con 0x7fc46c09dce0 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 >> v1:172.21.15.171:6789/0 conn(0x7fc46c11dc90 legacy=0x7fc46c1d1ac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 >> v1:172.21.15.106:6789/0 conn(0x7fc46c1d31e0 legacy=0x7fc46c1d55d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 monclient: found mon.g 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc46c11f200 con 0x7fc46c09dce0 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 5 monclient: authenticate success, global_id 214266 2024-04-26T00:03:15.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 10 monclient: _renew_subs 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc46c11e960 con 0x7fc46c09dce0 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 10 monclient: _renew_subs 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc46c1d6cf0 con 0x7fc46c09dce0 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc464004b70 con 0x7fc46c09dce0 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc464005060 con 0x7fc46c09dce0 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 10 monclient: dump: 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.155 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.156 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4697fa640 4 set_mon_vals no callback set 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc450005090 con 0x7fc46c09dce0 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc464005200 con 0x7fc46c09dce0 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fc464045330 con 0x7fc46c09dce0 2024-04-26T00:03:15.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.166+0000 7fc46a7fc640 10 monclient: get_auth_request con 0x7fc44c038e70 auth_method 0 2024-04-26T00:03:15.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.182+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc464015960 con 0x7fc46c09dce0 2024-04-26T00:03:15.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.182+0000 7fc4637fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.182+0000 7fc4637fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:15.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.418+0000 7fc471515640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:03:15.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.418+0000 7fc471515640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:03:15.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.418+0000 7fc471515640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:03:15.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.418+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc450005380 con 0x7fc46c09dce0 2024-04-26T00:03:15.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.418+0000 7fc4637fe640 1 -- 172.21.15.106:0/236182469 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2732 (unknown 254746657 0 104254472) 0x7fc464015260 con 0x7fc46c09dce0 2024-04-26T00:03:15.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.418+0000 7fc4637fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:03:15.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.418+0000 7fc4637fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:15.400 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":58,"quorum":[0,2,3,4,5,6,7],"quorum_names":["a","b","g","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:03:15.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 >> v1:172.21.15.171:6812/722422047 conn(0x7fc44c038e70 legacy=0x7fc44c03b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 10 monclient: shutdown 2024-04-26T00:03:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 >> v1:172.21.15.171:6790/0 conn(0x7fc46c09dce0 legacy=0x7fc46c131840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 shutdown_connections 2024-04-26T00:03:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 >> 172.21.15.106:0/236182469 conn(0x7fc46c0a64e0 msgr2=0x7fc46c134660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 shutdown_connections 2024-04-26T00:03:15.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.422+0000 7fc471515640 1 -- 172.21.15.106:0/236182469 wait complete. 2024-04-26T00:03:15.415 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-04-26T00:03:15.415 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon a 2024-04-26T00:03:15.415 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:03:15.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 10 monclient: get_monmap_and_config 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 10 monclient: build_initial_monmap 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 10 monclient: monmap: 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:15.556968+0000 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:15.556968+0000 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.533 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:15.534 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 1 Processor -- start 2024-04-26T00:03:15.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 1 -- start start 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 10 monclient: init 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 10 monclient: _add_conns ranks=[5,7,4,2,1,8,0,6,3] 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.554+0000 7fafaecae640 10 monclient(hunting): picked mon.noname-h con 0x7fafa8137730 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): picked mon.noname-i con 0x7fafa80a0b20 addr v1:172.21.15.171:6792/0 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): picked mon.noname-c con 0x7fafa8138220 addr v1:172.21.15.106:6791/0 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa80a2750 con 0x7fafa8138220 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa80a2a30 con 0x7fafa8137730 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa80a2d10 con 0x7fafa80a0b20 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): authenticate will time out at 1451.084077s 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafad24b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fafa8138220 0x7fafa8140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40044/0 (socket says 172.21.15.106:40044) 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafad24b640 1 -- 172.21.15.106:0/3783420229 learned_addr learned my addr 172.21.15.106:0/3783420229 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:15.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666707938 0 0) 0x7fafa80a2750 con 0x7fafa8138220 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient(hunting): my global_id is 145732 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf90003530 con 0x7fafa8138220 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2665240269 0 0) 0x7faf90003530 con 0x7fafa8138220 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 >> v1:172.21.15.171:6792/0 conn(0x7fafa80a0b20 legacy=0x7fafa813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 >> v1:172.21.15.171:6791/0 conn(0x7fafa8137730 legacy=0x7fafa8137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 monclient: found mon.noname-c 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa80a4680 con 0x7fafa8138220 2024-04-26T00:03:15.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafa0001b40 con 0x7fafa8138220 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: dump: 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.543 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 5 monclient: authenticate success, global_id 145732 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafa0001da0 con 0x7fafa8138220 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 1 -- 172.21.15.106:0/3783420229 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafa0004f70 con 0x7fafa8138220 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 4 set_mon_vals no callback set 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa77fe640 10 monclient: dump: 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.545 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient: shutdown 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- 172.21.15.106:0/3783420229 >> v1:172.21.15.106:6791/0 conn(0x7fafa8138220 legacy=0x7fafa8140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- 172.21.15.106:0/3783420229 shutdown_connections 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- 172.21.15.106:0/3783420229 >> 172.21.15.106:0/3783420229 conn(0x7fafa80a6b80 msgr2=0x7fafa80a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- 172.21.15.106:0/3783420229 shutdown_connections 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- 172.21.15.106:0/3783420229 wait complete. 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient: build_initial_monmap 2024-04-26T00:03:15.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient: monmap: 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:15.547 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 Processor -- start 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- start start 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient: init 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient: _add_conns ranks=[5,3,4,1,7,8,2,0,6] 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): picked mon.noname-h con 0x7fafa80a0b20 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:15.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): picked mon.noname-g con 0x7fafa8137730 addr v1:172.21.15.171:6790/0 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): picked mon.noname-c con 0x7fafa8138220 addr v1:172.21.15.106:6791/0 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa809b120 con 0x7fafa8137730 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa809aca0 con 0x7fafa8138220 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa80a1e20 con 0x7fafa80a0b20 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafaecae640 10 monclient(hunting): authenticate will time out at 1451.087167s 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafad24b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fafa8138220 0x7fafa81d5380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40050/0 (socket says 172.21.15.106:40050) 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafad24b640 1 -- 172.21.15.106:0/4007065830 learned_addr learned my addr 172.21.15.106:0/4007065830 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1925008120 0 0) 0x7fafa809aca0 con 0x7fafa8138220 2024-04-26T00:03:15.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): my global_id is 145741 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf94003530 con 0x7fafa8138220 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 753750299 0 0) 0x7faf94003530 con 0x7fafa8138220 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fafa809aca0 con 0x7fafa8138220 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafa0004eb0 con 0x7fafa8138220 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): dump: 2024-04-26T00:03:15.550 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.551 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419430127 0 0) 0x7fafa80a1e20 con 0x7fafa80a0b20 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient(hunting): my global_id is 7178 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf94003530 con 0x7fafa80a0b20 2024-04-26T00:03:15.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1285240427 0 0) 0x7fafa809aca0 con 0x7fafa8138220 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.171:6791/0 conn(0x7fafa80a0b20 legacy=0x7fafa81ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.171:6790/0 conn(0x7fafa8137730 legacy=0x7fafa81d1c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 monclient: found mon.c 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa809cf70 con 0x7fafa8138220 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.558+0000 7fafa57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 5 monclient: authenticate success, global_id 145741 2024-04-26T00:03:15.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 10 monclient: _renew_subs 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fafa809d390 con 0x7fafa8138220 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 10 monclient: _renew_subs 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fafa8134f10 con 0x7fafa8138220 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fafa0001da0 con 0x7fafa8138220 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fafa0005520 con 0x7fafa8138220 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa6ffd640 4 set_mon_vals no callback set 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:03:15.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: dump: 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.555 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf880065d0 con 0x7faf88002870 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fafa00102c0 con 0x7fafa8138220 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fafa0045640 con 0x7fafa8138220 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856671016 0 0) 0x7faf880065d0 con 0x7faf88002870 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient(hunting): my global_id is 7353 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fafa809aca0 con 0x7faf88002870 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa7fff640 10 monclient: get_auth_request con 0x7faf94037890 auth_method 0 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1292663959 0 0) 0x7fafa809aca0 con 0x7faf88002870 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf880065d0 con 0x7faf88002870 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf980018c0 con 0x7faf88002870 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: dump: 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.557 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.558 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 198772659 0 0) 0x7faf880065d0 con 0x7faf88002870 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faf8800a160 con 0x7faf88002870 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7faf98001cf0 con 0x7faf88002870 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.106:6789/0 conn(0x7faf88002870 legacy=0x7faf88004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.562+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.106:6789/0 conn(0x7faf88002870 legacy=0x7faf88004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:15.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:03:15.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faf88009e50 con 0x7faf88009110 2024-04-26T00:03:15.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236319671 0 0) 0x7faf88009e50 con 0x7faf88009110 2024-04-26T00:03:15.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient(hunting): my global_id is 7362 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf880065d0 con 0x7faf88009110 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 239677159 0 0) 0x7faf880065d0 con 0x7faf88009110 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faf88009e50 con 0x7faf88009110 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faf98003bb0 con 0x7faf88009110 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient: dump: 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.562 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.563 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 128492929 0 0) 0x7faf88009e50 con 0x7faf88009110 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faf8800c3e0 con 0x7faf88009110 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7545 (unknown 0 0 510572266) 0x7faf98004020 con 0x7faf88009110 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.106:6789/0 conn(0x7faf88009110 legacy=0x7faf880095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafa57fa640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.106:6789/0 conn(0x7faf88009110 legacy=0x7faf880095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:15.564 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 58, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 514129, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.565 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.566 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:03:15.567 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.568 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:03:15.569 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:03:15.570 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.571 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.572 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.573 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.574 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.575 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.576 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.577 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.578 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:03:15.579 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:03:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:03:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.580 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.581 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:03:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.582 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:03:15.583 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:03:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.587 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:03:15.589 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:03:15.590 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:03:15.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:03:15.594 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:03:15.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.171:6812/722422047 conn(0x7faf94037890 legacy=0x7faf94039d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 10 monclient: shutdown 2024-04-26T00:03:15.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 >> v1:172.21.15.106:6791/0 conn(0x7fafa8138220 legacy=0x7fafa81d5380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafad24b640 1 -- 172.21.15.106:0/4007065830 reap_dead start 2024-04-26T00:03:15.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafad24b640 1 -- 172.21.15.106:0/4007065830 reap_dead start 2024-04-26T00:03:15.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 shutdown_connections 2024-04-26T00:03:15.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 >> 172.21.15.106:0/4007065830 conn(0x7fafa80a6b80 msgr2=0x7fafa80a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 shutdown_connections 2024-04-26T00:03:15.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.570+0000 7fafaecae640 1 -- 172.21.15.106:0/4007065830 wait complete. 2024-04-26T00:03:15.597 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:03:15.597 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-04-26T00:03:15.597 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: get_monmap_and_config 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: build_initial_monmap 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: monmap: 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:15.742764+0000 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:15.742764+0000 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:15.728 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 Processor -- start 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- start start 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: init 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: _add_conns ranks=[0,7,2,5,3,6,1,4,8] 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient(hunting): picked mon.noname-a con 0x7f3c08134820 addr v1:172.21.15.106:6789/0 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient(hunting): picked mon.noname-i con 0x7f3c080725d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:03:15.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient(hunting): picked mon.noname-b con 0x7f3c0813ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c08071270 con 0x7f3c08134820 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c080714e0 con 0x7f3c0813ace0 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c080729f0 con 0x7f3c080725d0 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient(hunting): authenticate will time out at 1451.270014s 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c077fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3c08134820 0x7f3c08134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41540/0 (socket says 172.21.15.106:41540) 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c077fe640 1 -- 172.21.15.106:0/1210659685 learned_addr learned my addr 172.21.15.106:0/1210659685 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:15.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c07fff640 1 --1- 172.21.15.106:0/1210659685 >> v1:172.21.15.106:6790/0 conn(0x7f3c0813ace0 0x7f3c0813d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47402/0 (socket says 172.21.15.106:47402) 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 387569972 0 0) 0x7f3c08071270 con 0x7f3c08134820 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): my global_id is 7371 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf0003530 con 0x7f3c08134820 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3026237125 0 0) 0x7f3c000014a0 con 0x7f3c0813ace0 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient(hunting): my global_id is 7157 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c08071270 con 0x7f3c0813ace0 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3832163388 0 0) 0x7f3bf0003530 con 0x7f3c08134820 2024-04-26T00:03:15.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 >> v1:172.21.15.171:6792/0 conn(0x7f3c080725d0 legacy=0x7f3c081395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 >> v1:172.21.15.106:6790/0 conn(0x7f3c0813ace0 legacy=0x7f3c0813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 monclient: found mon.noname-a 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c080717c0 con 0x7f3c08134820 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 5 monclient: authenticate success, global_id 7371 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3bf80017c0 con 0x7f3c08134820 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: dump: 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.733 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3bf8001a20 con 0x7f3c08134820 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 4 set_mon_vals no callback set 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 1 -- 172.21.15.106:0/1210659685 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3bf8004bf0 con 0x7f3c08134820 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c067fc640 10 monclient: dump: 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.734 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 10 monclient: shutdown 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/1210659685 >> v1:172.21.15.106:6789/0 conn(0x7f3c08134820 legacy=0x7f3c08134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/1210659685 shutdown_connections 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/1210659685 >> 172.21.15.106:0/1210659685 conn(0x7f3c080a64e0 msgr2=0x7f3c080a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/1210659685 shutdown_connections 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.742+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/1210659685 wait complete. 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: build_initial_monmap 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: monmap: 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:15.736 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 Processor -- start 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 -- start start 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: init 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:15.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: _add_conns ranks=[5,8,1,3,7,2,4,0,6] 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient(hunting): picked mon.noname-h con 0x7f3c080725d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient(hunting): picked mon.noname-e con 0x7f3c08134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient(hunting): picked mon.noname-f con 0x7f3c0813ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0813dc10 con 0x7f3c0813ace0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0813b520 con 0x7f3c080725d0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c0813d7f0 con 0x7f3c08134820 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient(hunting): authenticate will time out at 1451.273001s 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c06ffd640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f3c08134820 legacy=0x7f3c081d1b60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c07fff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f3c0813ace0 legacy=0x7f3c081d5290 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c077fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f3c080725d0 0x7f3c0812a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:59716/0 (socket says 172.21.15.106:59716) 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c077fe640 1 -- 172.21.15.106:0/3333999585 learned_addr learned my addr 172.21.15.106:0/3333999585 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773226233 0 0) 0x7f3c0813b520 con 0x7f3c080725d0 2024-04-26T00:03:15.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): my global_id is 7187 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3bf4003530 con 0x7f3c080725d0 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 957476962 0 0) 0x7f3bf4003530 con 0x7f3c080725d0 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3c0813b520 con 0x7f3c080725d0 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3bf80047f0 con 0x7f3c080725d0 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): dump: 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.739 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 11313250 0 0) 0x7f3c0813b520 con 0x7f3c080725d0 2024-04-26T00:03:15.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.106:6793/0 conn(0x7f3c08134820 legacy=0x7f3c081d1b60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.171:6789/0 conn(0x7f3c0813ace0 legacy=0x7f3c081d5290 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 monclient: found mon.h 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c080706a0 con 0x7f3c080725d0 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 5 monclient: authenticate success, global_id 7187 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: _renew_subs 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3c0813d510 con 0x7f3c080725d0 2024-04-26T00:03:15.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: _renew_subs 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f3c0813d230 con 0x7f3c080725d0 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3bf8001a20 con 0x7f3c080725d0 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c05ffb640 4 set_mon_vals no callback set 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3bf8005280 con 0x7f3c080725d0 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: dump: 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.742 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3be80065d0 con 0x7f3be8002870 2024-04-26T00:03:15.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 743233626 0 0) 0x7f3be80065d0 con 0x7f3be8002870 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient(hunting): my global_id is 7166 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3c0813b520 con 0x7f3be8002870 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 597553514 0 0) 0x7f3c0813b520 con 0x7f3be8002870 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3be80065d0 con 0x7f3be8002870 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3bfc001820 con 0x7f3be8002870 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.746+0000 7f3beffff640 10 monclient: dump: 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.744 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3500372569 0 0) 0x7f3be80065d0 con 0x7f3be8002870 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3be800a160 con 0x7f3be8002870 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3bf8010020 con 0x7f3c080725d0 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f3bf8045210 con 0x7f3c080725d0 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3bfc0057d0 con 0x7f3be8002870 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.106:6790/0 conn(0x7f3be8002870 legacy=0x7f3be8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.106:6790/0 conn(0x7f3be8002870 legacy=0x7f3be8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:15.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.750+0000 7f3c07fff640 10 monclient: get_auth_request con 0x7f3bf40380b0 auth_method 0 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3c0dbf3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3be8009eb0 con 0x7f3be8009170 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2991487441 0 0) 0x7f3be8009eb0 con 0x7f3be8009170 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient(hunting): my global_id is 7175 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3be80065d0 con 0x7f3be8009170 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2009041819 0 0) 0x7f3be80065d0 con 0x7f3be8009170 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3be8009eb0 con 0x7f3be8009170 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3bfc003bf0 con 0x7f3be8009170 2024-04-26T00:03:15.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient: dump: 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.749 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1508641263 0 0) 0x7f3be8009eb0 con 0x7f3be8009170 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3be800c390 con 0x7f3be8009170 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 3822610415) 0x7f3bfc005a20 con 0x7f3be8009170 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.106:6790/0 conn(0x7f3be8009170 legacy=0x7f3be8009600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3beffff640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.106:6790/0 conn(0x7f3be8009170 legacy=0x7f3be8009600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:15.750 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 58, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 514317, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:03:15.751 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.752 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.753 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:15.754 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.755 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.756 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:03:15.758 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.761 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:03:15.762 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:15.764 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.768 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:03:15.770 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.171:6812/722422047 conn(0x7f3bf40380b0 legacy=0x7f3bf403a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3c0dbf3640 10 monclient: shutdown 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3c0dbf3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 >> v1:172.21.15.171:6791/0 conn(0x7f3c080725d0 legacy=0x7f3c0812a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.754+0000 7f3c07fff640 1 -- 172.21.15.106:0/3333999585 reap_dead start 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.758+0000 7f3c07fff640 1 -- 172.21.15.106:0/3333999585 reap_dead start 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.758+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 shutdown_connections 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.758+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 >> 172.21.15.106:0/3333999585 conn(0x7f3c080a64e0 msgr2=0x7f3c081308d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.758+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 shutdown_connections 2024-04-26T00:03:15.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.758+0000 7f3c0dbf3640 1 -- 172.21.15.106:0/3333999585 wait complete. 2024-04-26T00:03:15.773 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:03:15.773 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon c 2024-04-26T00:03:15.773 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:03:15.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: get_monmap_and_config 2024-04-26T00:03:15.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: build_initial_monmap 2024-04-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: monmap: 2024-04-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:15.910822+0000 2024-04-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:15.910822+0000 2024-04-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:15.887 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:15.888 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:15.889 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:15.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 Processor -- start 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- start start 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: init 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: _add_conns ranks=[6,8,2,0,7,5,3,4,1] 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient(hunting): picked mon.noname-d con 0x7f579c135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient(hunting): picked mon.noname-e con 0x7f579c1353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient(hunting): picked mon.noname-b con 0x7f579c13bdf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c06f2d0 con 0x7f579c13bdf0 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c072330 con 0x7f579c135870 2024-04-26T00:03:15.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c072610 con 0x7f579c1353b0 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient(hunting): authenticate will time out at 1451.437923s 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579a59c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f579c135870 0x7f579c135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39382/0 (socket says 172.21.15.106:39382) 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579ad9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f579c13bdf0 0x7f579c13e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47422/0 (socket says 172.21.15.106:47422) 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579a59c640 1 -- 172.21.15.106:0/1277932069 learned_addr learned my addr 172.21.15.106:0/1277932069 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f5799d9b640 1 -- 172.21.15.106:0/1277932069 >> v1:172.21.15.106:6793/0 conn(0x7f579c1353b0 legacy=0x7f579c13a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 439641108 0 0) 0x7f579c072330 con 0x7f579c135870 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): my global_id is 7314 2024-04-26T00:03:15.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5784003530 con 0x7f579c135870 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 70569457 0 0) 0x7f579c06f2d0 con 0x7f579c13bdf0 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient(hunting): my global_id is 7184 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f579c072330 con 0x7f579c13bdf0 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1669108188 0 0) 0x7f579c072330 con 0x7f579c13bdf0 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 >> v1:172.21.15.106:6793/0 conn(0x7f579c1353b0 legacy=0x7f579c13a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 >> v1:172.21.15.106:6792/0 conn(0x7f579c135870 legacy=0x7f579c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 monclient: found mon.noname-b 2024-04-26T00:03:15.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c0a3260 con 0x7f579c13bdf0 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5794001b20 con 0x7f579c13bdf0 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 5 monclient: authenticate success, global_id 7184 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: dump: 2024-04-26T00:03:15.905 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.906 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5794001e00 con 0x7f579c13bdf0 2024-04-26T00:03:15.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 1 -- 172.21.15.106:0/1277932069 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5794004eb0 con 0x7f579c13bdf0 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 4 set_mon_vals no callback set 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f579959a640 10 monclient: dump: 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.908 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.909 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: shutdown 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- 172.21.15.106:0/1277932069 >> v1:172.21.15.106:6790/0 conn(0x7f579c13bdf0 legacy=0x7f579c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- 172.21.15.106:0/1277932069 shutdown_connections 2024-04-26T00:03:15.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- 172.21.15.106:0/1277932069 >> 172.21.15.106:0/1277932069 conn(0x7f579c0a64e0 msgr2=0x7f579c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- 172.21.15.106:0/1277932069 shutdown_connections 2024-04-26T00:03:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 1 -- 172.21.15.106:0/1277932069 wait complete. 2024-04-26T00:03:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: build_initial_monmap 2024-04-26T00:03:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.910+0000 7f57a0ec2640 10 monclient: monmap: 2024-04-26T00:03:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:15.912 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 Processor -- start 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 -- start start 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient: init 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient: _add_conns ranks=[1,6,4,5,8,3,7,0,2] 2024-04-26T00:03:15.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient(hunting): picked mon.noname-f con 0x7f579c1353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient(hunting): picked mon.noname-d con 0x7f579c135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient(hunting): picked mon.noname-c con 0x7f579c13bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c09aa80 con 0x7f579c1353b0 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c09f470 con 0x7f579c13bdf0 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f579c09c4d0 con 0x7f579c135870 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient(hunting): authenticate will time out at 1451.440869s 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f5799d9b640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f579c135870 0x7f579c1d1390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39386/0 (socket says 172.21.15.106:39386) 2024-04-26T00:03:15.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f5799d9b640 1 -- 172.21.15.106:0/2114208630 learned_addr learned my addr 172.21.15.106:0/2114208630 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f579a59c640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.171:6789/0 conn(0x7f579c1353b0 legacy=0x7f579c09e2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470089017 0 0) 0x7f579c09c4d0 con 0x7f579c135870 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): my global_id is 7323 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f577c003530 con 0x7f579c135870 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3787822201 0 0) 0x7f579c09f470 con 0x7f579c13bdf0 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): my global_id is 145750 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f579c09c4d0 con 0x7f579c13bdf0 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2445130499 0 0) 0x7f577c003530 con 0x7f579c135870 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f579c09f470 con 0x7f579c135870 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5790004230 con 0x7f579c135870 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): dump: 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.916 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.917 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3108554012 0 0) 0x7f579c09c4d0 con 0x7f579c13bdf0 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f577c003530 con 0x7f579c13bdf0 2024-04-26T00:03:15.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5794001ae0 con 0x7f579c13bdf0 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): dump: 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.919 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.920 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.921 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.921 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.921 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3829767675 0 0) 0x7f579c09f470 con 0x7f579c135870 2024-04-26T00:03:15.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.106:6791/0 conn(0x7f579c13bdf0 legacy=0x7f579c1d4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.171:6789/0 conn(0x7f579c1353b0 legacy=0x7f579c09e2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:03:15.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: _finish_hunting 0 2024-04-26T00:03:15.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 monclient: found mon.d 2024-04-26T00:03:15.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:15.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:03:15.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f579c1c95e0 con 0x7f579c135870 2024-04-26T00:03:15.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: _finish_auth 0 2024-04-26T00:03:15.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: _check_auth_tickets 2024-04-26T00:03:15.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 5 monclient: authenticate success, global_id 7323 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient: _renew_subs 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f579c09e9b0 con 0x7f579c135870 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient: _renew_subs 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f579c09b9f0 con 0x7f579c135870 2024-04-26T00:03:15.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5790004550 con 0x7f579c135870 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5790004ac0 con 0x7f579c135870 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f5798d99640 4 set_mon_vals no callback set 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: dump: 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.924 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.925 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5790004ce0 con 0x7f579c135870 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f57800065d0 con 0x7f5780002870 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f5790045200 con 0x7f579c135870 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1315552310 0 0) 0x7f57800065d0 con 0x7f5780002870 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient(hunting): my global_id is 145759 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f579c09f470 con 0x7f5780002870 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1906717490 0 0) 0x7f579c09f470 con 0x7f5780002870 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f57800065d0 con 0x7f5780002870 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f578c001220 con 0x7f5780002870 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f579ad9d640 10 monclient: get_auth_request con 0x7f577c037e60 auth_method 0 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: dump: 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.928 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3108051514 0 0) 0x7f57800065d0 con 0x7f5780002870 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f578000a160 con 0x7f5780002870 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f578c001cb0 con 0x7f5780002870 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.106:6791/0 conn(0x7f5780002870 legacy=0x7f5780004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.914+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.106:6791/0 conn(0x7f5780002870 legacy=0x7f5780004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5780009e30 con 0x7f57800090f0 2024-04-26T00:03:15.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2052448756 0 0) 0x7f5780009e30 con 0x7f57800090f0 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient(hunting): my global_id is 145768 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f57800065d0 con 0x7f57800090f0 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3782050246 0 0) 0x7f57800065d0 con 0x7f57800090f0 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5780009e30 con 0x7f57800090f0 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f578c004de0 con 0x7f57800090f0 2024-04-26T00:03:15.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient: dump: 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:15.932 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3406434496 0 0) 0x7f5780009e30 con 0x7f57800090f0 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f578000c3a0 con 0x7f57800090f0 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7883 (unknown 0 0 210570580) 0x7f578c0071b0 con 0x7f57800090f0 2024-04-26T00:03:15.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:03:15.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:15.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.106:6791/0 conn(0x7f57800090f0 legacy=0x7f5780009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f578affd640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.106:6791/0 conn(0x7f57800090f0 legacy=0x7f5780009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:15.934 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:03:15.934 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:15.934 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 58, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 259452, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:03:15.935 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.936 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.937 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:03:15.938 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:03:15.939 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:15.940 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:15.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:03:15.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:03:15.944 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:03:15.946 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.948 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.949 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.951 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:03:15.953 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.954 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:03:15.955 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:15.957 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.958 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.959 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:15.960 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:15.961 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:15.961 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:15.961 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:15.961 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:15.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:15.961 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:03:15.961 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:03:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.171:6812/722422047 conn(0x7f577c037e60 legacy=0x7f577c03a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 10 monclient: shutdown 2024-04-26T00:03:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 >> v1:172.21.15.106:6792/0 conn(0x7f579c135870 legacy=0x7f579c1d1390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f579ad9d640 1 -- 172.21.15.106:0/2114208630 reap_dead start 2024-04-26T00:03:15.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f579ad9d640 1 -- 172.21.15.106:0/2114208630 reap_dead start 2024-04-26T00:03:15.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 shutdown_connections 2024-04-26T00:03:15.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 >> 172.21.15.106:0/2114208630 conn(0x7f579c0a64e0 msgr2=0x7f579c13a9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:15.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 shutdown_connections 2024-04-26T00:03:15.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:15.922+0000 7f57a0ec2640 1 -- 172.21.15.106:0/2114208630 wait complete. 2024-04-26T00:03:15.964 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:03:15.964 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2024-04-26T00:03:15.965 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: get_monmap_and_config 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: monmap: 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:16.106432+0000 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:16.106432+0000 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.082 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.083 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 Processor -- start 2024-04-26T00:03:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- start start 2024-04-26T00:03:16.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: init 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: _add_conns ranks=[2,3,4,5,7,6,0,8,1] 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient(hunting): picked mon.noname-b con 0x7faebc137730 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient(hunting): picked mon.noname-g con 0x7faebc0a0b20 addr v1:172.21.15.171:6790/0 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient(hunting): picked mon.noname-c con 0x7faebc138220 addr v1:172.21.15.106:6791/0 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc0a2750 con 0x7faebc137730 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc0a2a30 con 0x7faebc0a0b20 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc0a2d10 con 0x7faebc138220 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient(hunting): authenticate will time out at 1451.633571s 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec1f15640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7faebc137730 0x7faebc137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47432/0 (socket says 172.21.15.106:47432) 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec2716640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7faebc138220 0x7faebc140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40074/0 (socket says 172.21.15.106:40074) 2024-04-26T00:03:16.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec1f15640 1 -- 172.21.15.106:0/1706518176 learned_addr learned my addr 172.21.15.106:0/1706518176 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1810800093 0 0) 0x7faebc0a2d10 con 0x7faebc138220 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): my global_id is 145777 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faea8003530 con 0x7faebc138220 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 314368740 0 0) 0x7faebc0a2750 con 0x7faebc137730 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient(hunting): my global_id is 7193 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faebc0a2d10 con 0x7faebc137730 2024-04-26T00:03:16.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1257286189 0 0) 0x7faebc0a2d10 con 0x7faebc137730 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 >> v1:172.21.15.106:6791/0 conn(0x7faebc138220 legacy=0x7faebc140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 >> v1:172.21.15.171:6790/0 conn(0x7faebc0a0b20 legacy=0x7faebc13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 monclient: found mon.noname-b 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc0a4680 con 0x7faebc137730 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faeb80017a0 con 0x7faebc137730 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: dump: 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.095 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 5 monclient: authenticate success, global_id 7193 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faeb8001b00 con 0x7faebc137730 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 1 -- 172.21.15.106:0/1706518176 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faeb8004bf0 con 0x7faebc137730 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec0f13640 10 monclient: dump: 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.096 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.097 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 4 set_mon_vals no callback set 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 10 monclient: shutdown 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- 172.21.15.106:0/1706518176 >> v1:172.21.15.106:6790/0 conn(0x7faebc137730 legacy=0x7faebc137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- 172.21.15.106:0/1706518176 shutdown_connections 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- 172.21.15.106:0/1706518176 >> 172.21.15.106:0/1706518176 conn(0x7faebc0a6b80 msgr2=0x7faebc0a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- 172.21.15.106:0/1706518176 shutdown_connections 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.106+0000 7faec4179640 1 -- 172.21.15.106:0/1706518176 wait complete. 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: monmap: 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.098 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 Processor -- start 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 -- start start 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: init 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: _add_conns ranks=[0,8,5,7,6,1,2,3,4] 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient(hunting): picked mon.noname-a con 0x7faebc0a0b20 addr v1:172.21.15.106:6789/0 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient(hunting): picked mon.noname-e con 0x7faebc137730 addr v1:172.21.15.106:6793/0 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient(hunting): picked mon.noname-h con 0x7faebc138220 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc0a1e20 con 0x7faebc0a0b20 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc0a19d0 con 0x7faebc138220 2024-04-26T00:03:16.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faebc09aa90 con 0x7faebc137730 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient(hunting): authenticate will time out at 1451.637338s 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec1714640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7faebc137730 legacy=0x7faebc134690 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec1f15640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7faebc0a0b20 0x7faebc133f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41552/0 (socket says 172.21.15.106:41552) 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec1f15640 1 -- 172.21.15.106:0/3547873192 learned_addr learned my addr 172.21.15.106:0/3547873192 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 771917736 0 0) 0x7faebc0a4680 con 0x7faebc0a0b20 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): my global_id is 7380 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faea0003530 con 0x7faebc0a0b20 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 986567825 0 0) 0x7faea0003530 con 0x7faebc0a0b20 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faebc0a4680 con 0x7faebc0a0b20 2024-04-26T00:03:16.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faeb8001760 con 0x7faebc0a0b20 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): dump: 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.102 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4191383780 0 0) 0x7faebc0a19d0 con 0x7faebc138220 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): my global_id is 7196 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faea0003530 con 0x7faebc138220 2024-04-26T00:03:16.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 852250148 0 0) 0x7faebc0a4680 con 0x7faebc0a0b20 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.106:6793/0 conn(0x7faebc137730 legacy=0x7faebc134690 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.171:6791/0 conn(0x7faebc138220 legacy=0x7faebc1d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 monclient: found mon.a 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faebc09cb10 con 0x7faebc0a0b20 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 5 monclient: authenticate success, global_id 7380 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: _renew_subs 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faebc09cdf0 con 0x7faebc0a0b20 2024-04-26T00:03:16.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: _renew_subs 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7faebc0a0670 con 0x7faebc0a0b20 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faeb8001cb0 con 0x7faebc0a0b20 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faeb8001ac0 con 0x7faebc0a0b20 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb3fff640 4 set_mon_vals no callback set 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: dump: 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.105 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.106 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7faeb80100f0 con 0x7faebc0a0b20 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7faeb8045390 con 0x7faebc0a0b20 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faebc075890 con 0x7faebc134da0 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faec1714640 10 monclient: get_auth_request con 0x7faea0037790 auth_method 0 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4158311762 0 0) 0x7faebc075890 con 0x7faebc134da0 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient(hunting): my global_id is 7332 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faebc0a4680 con 0x7faebc134da0 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1117663043 0 0) 0x7faebc0a4680 con 0x7faebc134da0 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faebc075890 con 0x7faebc134da0 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faeb4001b60 con 0x7faebc134da0 2024-04-26T00:03:16.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.110+0000 7faeb27fc640 10 monclient: dump: 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.108 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.114+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3783675001 0 0) 0x7faebc075890 con 0x7faebc134da0 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.114+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faebc062e50 con 0x7faebc134da0 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.114+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7faeb4001f70 con 0x7faebc134da0 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.114+0000 7faeb27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.114+0000 7faeb27fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.114+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.106:6792/0 conn(0x7faebc134da0 legacy=0x7faebc12f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.114+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.106:6792/0 conn(0x7faebc134da0 legacy=0x7faebc12f880 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faebc09b200 con 0x7faebc02d010 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3842591507 0 0) 0x7faebc09b200 con 0x7faebc02d010 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient(hunting): my global_id is 7341 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faebc075890 con 0x7faebc02d010 2024-04-26T00:03:16.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2439293591 0 0) 0x7faebc075890 con 0x7faebc02d010 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faebc09b200 con 0x7faebc02d010 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faeb40050a0 con 0x7faebc02d010 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient: dump: 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.112 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1715145605 0 0) 0x7faebc09b200 con 0x7faebc02d010 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faebc06b210 con 0x7faebc02d010 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 3343662968) 0x7faeb4007360 con 0x7faebc02d010 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.106:6792/0 conn(0x7faebc02d010 legacy=0x7faebc12ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faeb27fc640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.106:6792/0 conn(0x7faebc02d010 legacy=0x7faebc12ff90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 58, 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 514657, 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:03:16.114 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.115 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.116 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:03:16.117 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.118 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:03:16.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:16.122 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.123 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.127 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.132 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:16.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.134 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.134 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:03:16.134 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:03:16.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.171:6812/722422047 conn(0x7faea0037790 legacy=0x7faea0039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 10 monclient: shutdown 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 >> v1:172.21.15.106:6789/0 conn(0x7faebc0a0b20 legacy=0x7faebc133f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec2716640 1 -- 172.21.15.106:0/3547873192 reap_dead start 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec2716640 1 -- 172.21.15.106:0/3547873192 reap_dead start 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 shutdown_connections 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 >> 172.21.15.106:0/3547873192 conn(0x7faebc0a6b80 msgr2=0x7faebc12e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 shutdown_connections 2024-04-26T00:03:16.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.118+0000 7faec4179640 1 -- 172.21.15.106:0/3547873192 wait complete. 2024-04-26T00:03:16.136 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:03:16.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-04-26T00:03:16.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:03:16.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: get_monmap_and_config 2024-04-26T00:03:16.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: monmap: 2024-04-26T00:03:16.254 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.254 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:16.278926+0000 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:16.278926+0000 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.255 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 1 Processor -- start 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 1 -- start start 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: init 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: _add_conns ranks=[2,5,6,0,7,3,8,4,1] 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient(hunting): picked mon.noname-b con 0x7fbcc4135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient(hunting): picked mon.noname-h con 0x7fbcc41353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient(hunting): picked mon.noname-d con 0x7fbcc413bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc406f2d0 con 0x7fbcc4135870 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4072330 con 0x7fbcc41353b0 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc4072610 con 0x7fbcc413bdf0 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient(hunting): authenticate will time out at 1451.806536s 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc9c19640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fbcc4135870 0x7fbcc4135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47438/0 (socket says 172.21.15.106:47438) 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc9c19640 1 -- 172.21.15.106:0/256163117 learned_addr learned my addr 172.21.15.106:0/256163117 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcca41a640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fbcc413bdf0 0x7fbcc413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39402/0 (socket says 172.21.15.106:39402) 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322435475 0 0) 0x7fbcc4072610 con 0x7fbcc413bdf0 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): my global_id is 7350 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb0003530 con 0x7fbcc413bdf0 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902916165 0 0) 0x7fbcc406f2d0 con 0x7fbcc4135870 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient(hunting): my global_id is 7202 2024-04-26T00:03:16.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc4072610 con 0x7fbcc4135870 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 466592348 0 0) 0x7fbcb0003530 con 0x7fbcc413bdf0 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 >> v1:172.21.15.171:6791/0 conn(0x7fbcc41353b0 legacy=0x7fbcc413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 >> v1:172.21.15.106:6790/0 conn(0x7fbcc4135870 legacy=0x7fbcc4135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 monclient: found mon.noname-d 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc40a3260 con 0x7fbcc413bdf0 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcbc001b80 con 0x7fbcc413bdf0 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 5 monclient: authenticate success, global_id 7350 2024-04-26T00:03:16.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:03:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: dump: 2024-04-26T00:03:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.267 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.268 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcbc001e10 con 0x7fbcc413bdf0 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 1 -- 172.21.15.106:0/256163117 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcbc004eb0 con 0x7fbcc413bdf0 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 4 set_mon_vals no callback set 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbcc8c17640 10 monclient: dump: 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.269 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 10 monclient: shutdown 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.277+0000 7fbccbe7d640 1 -- 172.21.15.106:0/256163117 >> v1:172.21.15.106:6792/0 conn(0x7fbcc413bdf0 legacy=0x7fbcc413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- 172.21.15.106:0/256163117 shutdown_connections 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- 172.21.15.106:0/256163117 >> 172.21.15.106:0/256163117 conn(0x7fbcc40a64e0 msgr2=0x7fbcc40a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- 172.21.15.106:0/256163117 shutdown_connections 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- 172.21.15.106:0/256163117 wait complete. 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: monmap: 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.271 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 Processor -- start 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- start start 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: init 2024-04-26T00:03:16.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: _add_conns ranks=[2,6,4,3,5,7,8,0,1] 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient(hunting): picked mon.noname-b con 0x7fbcc41353b0 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient(hunting): picked mon.noname-d con 0x7fbcc4135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient(hunting): picked mon.noname-c con 0x7fbcc413bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc411dfd0 con 0x7fbcc41353b0 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc411c230 con 0x7fbcc413bdf0 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcc409f930 con 0x7fbcc4135870 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient(hunting): authenticate will time out at 1451.809556s 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcc9418640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fbcc4135870 0x7fbcc409dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39410/0 (socket says 172.21.15.106:39410) 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcc9418640 1 -- 172.21.15.106:0/3768449616 learned_addr learned my addr 172.21.15.106:0/3768449616 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3943593430 0 0) 0x7fbcc409f930 con 0x7fbcc4135870 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): my global_id is 7359 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbca8003530 con 0x7fbcc4135870 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257088563 0 0) 0x7fbcc411dfd0 con 0x7fbcc41353b0 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): my global_id is 7211 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc409f930 con 0x7fbcc41353b0 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407347422 0 0) 0x7fbcc411c230 con 0x7fbcc413bdf0 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): my global_id is 145786 2024-04-26T00:03:16.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc411dfd0 con 0x7fbcc413bdf0 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1888428689 0 0) 0x7fbcc409f930 con 0x7fbcc41353b0 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc411c230 con 0x7fbcc41353b0 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc0001a80 con 0x7fbcc41353b0 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): dump: 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.275 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 152838963 0 0) 0x7fbca8003530 con 0x7fbcc4135870 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcc409f930 con 0x7fbcc4135870 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcb4001aa0 con 0x7fbcc4135870 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:03:16.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): dump: 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.277 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 334021129 0 0) 0x7fbcc411dfd0 con 0x7fbcc413bdf0 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbca8003530 con 0x7fbcc413bdf0 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcbc001b40 con 0x7fbcc413bdf0 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient(hunting): dump: 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.278 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3521718580 0 0) 0x7fbcc411c230 con 0x7fbcc41353b0 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.106:6792/0 conn(0x7fbcc4135870 legacy=0x7fbcc409dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.106:6791/0 conn(0x7fbcc413bdf0 legacy=0x7fbcc41d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 monclient: found mon.b 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcc409f470 con 0x7fbcc41353b0 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 5 monclient: authenticate success, global_id 7211 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: _renew_subs 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:03:16.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcc411e2b0 con 0x7fbcc41353b0 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: _renew_subs 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcc4135070 con 0x7fbcc41353b0 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcc0001ce0 con 0x7fbcc41353b0 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc0004de0 con 0x7fbcc41353b0 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcbbfff640 4 set_mon_vals no callback set 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 10 monclient: dump: 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcac0065d0 con 0x7fbcac002870 2024-04-26T00:03:16.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbcc000fb80 con 0x7fbcc41353b0 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.281+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fbcc0044e70 con 0x7fbcc41353b0 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcca41a640 10 monclient: get_auth_request con 0x7fbca8038140 auth_method 0 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 427626893 0 0) 0x7fbcac0065d0 con 0x7fbcac002870 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient(hunting): my global_id is 214284 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc411c230 con 0x7fbcac002870 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 467984135 0 0) 0x7fbcc411c230 con 0x7fbcac002870 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcac0065d0 con 0x7fbcac002870 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcb4003e80 con 0x7fbcac002870 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient: dump: 2024-04-26T00:03:16.283 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.284 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4252195630 0 0) 0x7fbcac0065d0 con 0x7fbcac002870 2024-04-26T00:03:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcac00a160 con 0x7fbcac002870 2024-04-26T00:03:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbcb4004140 con 0x7fbcac002870 2024-04-26T00:03:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.171:6790/0 conn(0x7fbcac002870 legacy=0x7fbcac004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.285+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.171:6790/0 conn(0x7fbcac002870 legacy=0x7fbcac004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.289+0000 7fbccbe7d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcac009e10 con 0x7fbcac0090f0 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625132383 0 0) 0x7fbcac009e10 con 0x7fbcac0090f0 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient(hunting): my global_id is 214293 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcac0065d0 con 0x7fbcac0090f0 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 845521282 0 0) 0x7fbcac0065d0 con 0x7fbcac0090f0 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcac009e10 con 0x7fbcac0090f0 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcb4005b10 con 0x7fbcac0090f0 2024-04-26T00:03:16.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient: dump: 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.288 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2116972013 0 0) 0x7fbcac009e10 con 0x7fbcac0090f0 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbcac00c390 con 0x7fbcac0090f0 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 1035405902) 0x7fbcb4006f20 con 0x7fbcac0090f0 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.171:6790/0 conn(0x7fbcac0090f0 legacy=0x7fbcac009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcba7fc640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.171:6790/0 conn(0x7fbcac0090f0 legacy=0x7fbcac009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.289 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 58, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 26715, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:03:16.290 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.291 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.292 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:03:16.293 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.294 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:16.295 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.297 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.298 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.301 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.305 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:16.307 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:03:16.308 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:03:16.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.171:6812/722422047 conn(0x7fbca8038140 legacy=0x7fbca803a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 10 monclient: shutdown 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 >> v1:172.21.15.106:6790/0 conn(0x7fbcc41353b0 legacy=0x7fbcc409d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcca41a640 1 -- 172.21.15.106:0/3768449616 reap_dead start 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbcca41a640 1 -- 172.21.15.106:0/3768449616 reap_dead start 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 shutdown_connections 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 >> 172.21.15.106:0/3768449616 conn(0x7fbcc40a64e0 msgr2=0x7fbcc413b650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 shutdown_connections 2024-04-26T00:03:16.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.293+0000 7fbccbe7d640 1 -- 172.21.15.106:0/3768449616 wait complete. 2024-04-26T00:03:16.310 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:03:16.311 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-04-26T00:03:16.311 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:03:16.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient: get_monmap_and_config 2024-04-26T00:03:16.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient: monmap: 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:16.447187+0000 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:16.447187+0000 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.424 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.425 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.425 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.425 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.425 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 1 Processor -- start 2024-04-26T00:03:16.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 1 -- start start 2024-04-26T00:03:16.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient: init 2024-04-26T00:03:16.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient: _add_conns ranks=[1,7,2,5,6,4,3,0,8] 2024-04-26T00:03:16.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient(hunting): picked mon.noname-f con 0x7f78b00a0630 addr v1:172.21.15.171:6789/0 2024-04-26T00:03:16.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient(hunting): picked mon.noname-i con 0x7f78b006ba20 addr v1:172.21.15.171:6792/0 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient(hunting): picked mon.noname-b con 0x7f78b013def0 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b009f620 con 0x7f78b00a0630 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b006b7e0 con 0x7f78b013def0 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b009ed80 con 0x7f78b006ba20 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient(hunting): authenticate will time out at 1451.975028s 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78affff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f78b00a0630 legacy=0x7f78b00a0a10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b4f79640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f78b013def0 0x7f78b01402e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47454/0 (socket says 172.21.15.106:47454) 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b4f79640 1 -- 172.21.15.106:0/3022270672 learned_addr learned my addr 172.21.15.106:0/3022270672 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3092029436 0 0) 0x7f78b006b7e0 con 0x7f78b013def0 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient(hunting): my global_id is 7220 2024-04-26T00:03:16.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7898003530 con 0x7f78b013def0 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 863395146 0 0) 0x7f7898003530 con 0x7f78b013def0 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 >> v1:172.21.15.171:6792/0 conn(0x7f78b006ba20 legacy=0x7f78b013c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 >> v1:172.21.15.171:6789/0 conn(0x7f78b00a0630 legacy=0x7f78b00a0a10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 monclient: found mon.noname-b 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b00a4460 con 0x7f78b013def0 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 5 monclient: authenticate success, global_id 7220 2024-04-26T00:03:16.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a8001b40 con 0x7f78b013def0 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: dump: 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.435 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78a8001ea0 con 0x7f78b013def0 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 1 -- 172.21.15.106:0/3022270672 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a80020d0 con 0x7f78b013def0 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78b69dc640 4 set_mon_vals no callback set 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.445+0000 7f78aeffd640 10 monclient: dump: 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.437 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: shutdown 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/3022270672 >> v1:172.21.15.106:6790/0 conn(0x7f78b013def0 legacy=0x7f78b01402e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/3022270672 shutdown_connections 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/3022270672 >> 172.21.15.106:0/3022270672 conn(0x7f78b00a36e0 msgr2=0x7f78b00a3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/3022270672 shutdown_connections 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/3022270672 wait complete. 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: monmap: 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:16.438 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 Processor -- start 2024-04-26T00:03:16.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- start start 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: init 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: _add_conns ranks=[0,4,5,7,3,8,2,1,6] 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient(hunting): picked mon.noname-a con 0x7f78b006ba20 addr v1:172.21.15.106:6789/0 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient(hunting): picked mon.noname-c con 0x7f78b00a0630 addr v1:172.21.15.106:6791/0 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient(hunting): picked mon.noname-h con 0x7f78b013def0 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b009d490 con 0x7f78b006ba20 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b009e510 con 0x7f78b00a0630 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78b0137870 con 0x7f78b013def0 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient(hunting): authenticate will time out at 1451.977881s 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78affff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f78b006ba20 0x7f78b0136a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41560/0 (socket says 172.21.15.106:41560) 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78affff640 1 -- 172.21.15.106:0/737720023 learned_addr learned my addr 172.21.15.106:0/737720023 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536622653 0 0) 0x7f78b009d490 con 0x7f78b006ba20 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): my global_id is 7389 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f789c003530 con 0x7f78b006ba20 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2853138127 0 0) 0x7f78b009ed80 con 0x7f78b00a0630 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): my global_id is 145795 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b009d490 con 0x7f78b00a0630 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 292098946 0 0) 0x7f789c003530 con 0x7f78b006ba20 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78b009ed80 con 0x7f78b006ba20 2024-04-26T00:03:16.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a0004380 con 0x7f78b006ba20 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): dump: 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.442 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 58705247 0 0) 0x7f78b009d490 con 0x7f78b00a0630 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f789c003530 con 0x7f78b00a0630 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a40019a0 con 0x7f78b00a0630 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): dump: 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.443 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.444 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2665872509 0 0) 0x7f78b0137870 con 0x7f78b013def0 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient(hunting): my global_id is 7214 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b009d490 con 0x7f78b013def0 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4094582401 0 0) 0x7f78b009ed80 con 0x7f78b006ba20 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.171:6791/0 conn(0x7f78b013def0 legacy=0x7f78b01d4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.106:6791/0 conn(0x7f78b00a0630 legacy=0x7f78b0137160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 monclient: found mon.a 2024-04-26T00:03:16.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78b0139720 con 0x7f78b006ba20 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 5 monclient: authenticate success, global_id 7389 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: _renew_subs 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78b01382d0 con 0x7f78b006ba20 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: _renew_subs 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f78b009ca60 con 0x7f78b006ba20 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78a0004520 con 0x7f78b006ba20 2024-04-26T00:03:16.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a0004a90 con 0x7f78b006ba20 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78ae7fc640 4 set_mon_vals no callback set 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 10 monclient: dump: 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.447 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f78900065d0 con 0x7f7890002870 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.449+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f78a0004cb0 con 0x7f78b006ba20 2024-04-26T00:03:16.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f78a0045240 con 0x7f78b006ba20 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78b4f79640 10 monclient: get_auth_request con 0x7f789c037ee0 auth_method 0 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2954973424 0 0) 0x7f78900065d0 con 0x7f7890002870 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient(hunting): my global_id is 7223 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78b009ed80 con 0x7f7890002870 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 670599874 0 0) 0x7f78b009ed80 con 0x7f7890002870 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78900065d0 con 0x7f7890002870 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a4003c10 con 0x7f7890002870 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient: dump: 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.450 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3656526151 0 0) 0x7f78900065d0 con 0x7f7890002870 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f789000a160 con 0x7f7890002870 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f78a4006060 con 0x7f7890002870 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.171:6791/0 conn(0x7f7890002870 legacy=0x7f7890004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.453+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.171:6791/0 conn(0x7f7890002870 legacy=0x7f7890004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:03:16.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7890009e50 con 0x7f7890009110 2024-04-26T00:03:16.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4150776197 0 0) 0x7f7890009e50 con 0x7f7890009110 2024-04-26T00:03:16.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient(hunting): my global_id is 7232 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78900065d0 con 0x7f7890009110 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1125657259 0 0) 0x7f78900065d0 con 0x7f7890009110 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7890009e50 con 0x7f7890009110 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a40046b0 con 0x7f7890009110 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient: dump: 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.454 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.455 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.455 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.455 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.455 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1001772807 0 0) 0x7f7890009e50 con 0x7f7890009110 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f789000c3e0 con 0x7f7890009110 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 1430230121) 0x7f78a40059e0 con 0x7f7890009110 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.171:6791/0 conn(0x7f7890009110 legacy=0x7f78900095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78acff9640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.171:6791/0 conn(0x7f7890009110 legacy=0x7f78900095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.457 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:03:16.457 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:16.457 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:16.457 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:03:16.457 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 58, 2024-04-26T00:03:16.457 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 514963, 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.458 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.459 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.460 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:03:16.461 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.462 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.465 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.468 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:03:16.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.472 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.473 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.475 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:03:16.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.477 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:03:16.477 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:03:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.171:6812/722422047 conn(0x7f789c037ee0 legacy=0x7f789c03a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 10 monclient: shutdown 2024-04-26T00:03:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 >> v1:172.21.15.106:6789/0 conn(0x7f78b006ba20 legacy=0x7f78b0136a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b4f79640 1 -- 172.21.15.106:0/737720023 reap_dead start 2024-04-26T00:03:16.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b4f79640 1 -- 172.21.15.106:0/737720023 reap_dead start 2024-04-26T00:03:16.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 shutdown_connections 2024-04-26T00:03:16.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 >> 172.21.15.106:0/737720023 conn(0x7f78b00a36e0 msgr2=0x7f78b00a1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 shutdown_connections 2024-04-26T00:03:16.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.461+0000 7f78b69dc640 1 -- 172.21.15.106:0/737720023 wait complete. 2024-04-26T00:03:16.479 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:03:16.479 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-04-26T00:03:16.479 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:03:16.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.617+0000 7f3cf0bec640 10 monclient: get_monmap_and_config 2024-04-26T00:03:16.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.617+0000 7f3cf0bec640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.617+0000 7f3cf0bec640 10 monclient: monmap: 2024-04-26T00:03:16.597 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.597 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.597 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:03:16.621874+0000 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:03:16.621874+0000 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.598 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 Processor -- start 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- start start 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient: init 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient: _add_conns ranks=[7,2,6,5,3,1,4,0,8] 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient(hunting): picked mon.noname-i con 0x7f3cec134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient(hunting): picked mon.noname-b con 0x7f3cec0a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient(hunting): picked mon.noname-d con 0x7f3cec13e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cec06dd40 con 0x7f3cec0a4820 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cec0a2b10 con 0x7f3cec13e200 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cec0a2df0 con 0x7f3cec134970 2024-04-26T00:03:16.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient(hunting): authenticate will time out at 1452.149021s 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce9d9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f3cec0a4820 0x7f3cec13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47460/0 (socket says 172.21.15.106:47460) 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce9d9b640 1 -- 172.21.15.106:0/4214254944 learned_addr learned my addr 172.21.15.106:0/4214254944 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973165143 0 0) 0x7f3cec06dd40 con 0x7f3cec0a4820 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): my global_id is 7229 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cd4003530 con 0x7f3cec0a4820 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3851633129 0 0) 0x7f3cec0a2b10 con 0x7f3cec13e200 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): my global_id is 7368 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cec06dd40 con 0x7f3cec13e200 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889005626 0 0) 0x7f3cec0a2df0 con 0x7f3cec134970 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient(hunting): my global_id is 145681 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cec0a2b10 con 0x7f3cec134970 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 167763037 0 0) 0x7f3cec06dd40 con 0x7f3cec13e200 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 >> v1:172.21.15.171:6792/0 conn(0x7f3cec134970 legacy=0x7f3cec134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 >> v1:172.21.15.106:6790/0 conn(0x7f3cec0a4820 legacy=0x7f3cec13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 monclient: found mon.noname-d 2024-04-26T00:03:16.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec0a30d0 con 0x7f3cec13e200 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ce4001b20 con 0x7f3cec13e200 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: dump: 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.607 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 5 monclient: authenticate success, global_id 7368 2024-04-26T00:03:16.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ce4001d80 con 0x7f3cec13e200 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 1 -- 172.21.15.106:0/4214254944 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ce4003ce0 con 0x7f3cec13e200 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient: get_monmap_and_config success 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 4 set_mon_vals no callback set 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3ce959a640 10 monclient: dump: 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient: shutdown 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- 172.21.15.106:0/4214254944 >> v1:172.21.15.106:6792/0 conn(0x7f3cec13e200 legacy=0x7f3cec1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- 172.21.15.106:0/4214254944 shutdown_connections 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- 172.21.15.106:0/4214254944 >> 172.21.15.106:0/4214254944 conn(0x7f3cec0a9e20 msgr2=0x7f3cec0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- 172.21.15.106:0/4214254944 shutdown_connections 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 1 -- 172.21.15.106:0/4214254944 wait complete. 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient: build_initial_monmap 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.621+0000 7f3cf0bec640 10 monclient: monmap: 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.611 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 Processor -- start 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 -- start start 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient: init 2024-04-26T00:03:16.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient: _reopen_session rank -1 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient: _add_conns ranks=[6,0,5,4,1,2,8,7,3] 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient(hunting): picked mon.noname-d con 0x7f3cec0a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient(hunting): picked mon.noname-a con 0x7f3cec134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient(hunting): picked mon.noname-h con 0x7f3cec13e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cec1390a0 con 0x7f3cec134970 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cec0a1e00 con 0x7f3cec13e200 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cec1331d0 con 0x7f3cec0a4820 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient(hunting): _renew_subs 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient(hunting): authenticate will time out at 1452.153151s 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3ce9d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3cec134970 0x7f3cec1d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41562/0 (socket says 172.21.15.106:41562) 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3ce9d9b640 1 -- 172.21.15.106:0/1039155430 learned_addr learned my addr 172.21.15.106:0/1039155430 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3950844333 0 0) 0x7f3cec1390a0 con 0x7f3cec134970 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): my global_id is 7398 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3ccc003560 con 0x7f3cec134970 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852304657 0 0) 0x7f3cec1331d0 con 0x7f3cec0a4820 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): my global_id is 7377 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cec1390a0 con 0x7f3cec0a4820 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3586730625 0 0) 0x7f3ccc003560 con 0x7f3cec134970 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3cec1331d0 con 0x7f3cec134970 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1283515087 0 0) 0x7f3cec1390a0 con 0x7f3cec0a4820 2024-04-26T00:03:16.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3ccc003560 con 0x7f3cec0a4820 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ce0001550 con 0x7f3cec134970 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): dump: 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.615 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3cdc001a00 con 0x7f3cec0a4820 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient(hunting): dump: 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.616 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3553983749 0 0) 0x7f3cec1331d0 con 0x7f3cec134970 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.106:6792/0 conn(0x7f3cec0a4820 legacy=0x7f3cec13c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.171:6791/0 conn(0x7f3cec13e200 legacy=0x7f3cec1d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: _finish_hunting 0 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 monclient: found mon.a 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cec1324a0 con 0x7f3cec134970 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: _finish_auth 0 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: _check_auth_tickets 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 5 monclient: authenticate success, global_id 7398 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient: _renew_subs 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3cec1334e0 con 0x7f3cec134970 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient: _renew_subs 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:03:16.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3cec13d1b0 con 0x7f3cec134970 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3ce0004aa0 con 0x7f3cec134970 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3ce0004f90 con 0x7f3cec134970 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3ce8d99640 4 set_mon_vals no callback set 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 10 monclient: dump: 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.619 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.620 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3cd00065d0 con 0x7f3cd0002870 2024-04-26T00:03:16.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3ce000fd30 con 0x7f3cec134970 2024-04-26T00:03:16.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.625+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f3ce0045170 con 0x7f3cec134970 2024-04-26T00:03:16.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cead9d640 10 monclient: get_auth_request con 0x7f3ccc037e70 auth_method 0 2024-04-26T00:03:16.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567051064 0 0) 0x7f3cd00065d0 con 0x7f3cd0002870 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient(hunting): my global_id is 145690 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cec1331d0 con 0x7f3cd0002870 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2962861758 0 0) 0x7f3cec1331d0 con 0x7f3cd0002870 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3cd00065d0 con 0x7f3cd0002870 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3cdc003940 con 0x7f3cd0002870 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient: dump: 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.624 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 349012805 0 0) 0x7f3cd00065d0 con 0x7f3cd0002870 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3cd000a160 con 0x7f3cd0002870 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3cdc003d30 con 0x7f3cd0002870 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.171:6792/0 conn(0x7f3cd0002870 legacy=0x7f3cd0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.629+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.171:6792/0 conn(0x7f3cd0002870 legacy=0x7f3cd0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3cd0009e10 con 0x7f3cd00090f0 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2890078013 0 0) 0x7f3cd0009e10 con 0x7f3cd00090f0 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient(hunting): my global_id is 145699 2024-04-26T00:03:16.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3cd00065d0 con 0x7f3cd00090f0 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3389907875 0 0) 0x7f3cd00065d0 con 0x7f3cd00090f0 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3cd0009e10 con 0x7f3cd00090f0 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3cdc0045b0 con 0x7f3cd00090f0 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient: dump: 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:03:16.627 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1935357585 0 0) 0x7f3cd0009e10 con 0x7f3cd00090f0 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3cd000c390 con 0x7f3cd00090f0 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 1473349450) 0x7f3cdc0059e0 con 0x7f3cd00090f0 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.171:6792/0 conn(0x7f3cd00090f0 legacy=0x7f3cd0009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cdaffd640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.171:6792/0 conn(0x7f3cd00090f0 legacy=0x7f3cd0009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 58, 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 260169, 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:03:16.629 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.630 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.631 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:03:16.632 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:03:16.633 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:03:16.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.635 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:03:16.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.640 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:03:16.641 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:03:16.642 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.644 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:03:16.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:03:16.647 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:03:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:03:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:03:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:03:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:03:16.648 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:03:16.648 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:03:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.171:6812/722422047 conn(0x7f3ccc037e70 legacy=0x7f3ccc03a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 10 monclient: shutdown 2024-04-26T00:03:16.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:03:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 >> v1:172.21.15.106:6789/0 conn(0x7f3cec134970 legacy=0x7f3cec1d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:03:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cead9d640 1 -- 172.21.15.106:0/1039155430 reap_dead start 2024-04-26T00:03:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cead9d640 1 -- 172.21.15.106:0/1039155430 reap_dead start 2024-04-26T00:03:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 shutdown_connections 2024-04-26T00:03:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 >> 172.21.15.106:0/1039155430 conn(0x7f3cec0a9e20 msgr2=0x7f3cec130ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:03:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 shutdown_connections 2024-04-26T00:03:16.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:03:16.637+0000 7f3cf0bec640 1 -- 172.21.15.106:0/1039155430 wait complete. 2024-04-26T00:03:16.650 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:03:16.650 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-26T00:04:46.652 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-26T00:04:46.652 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-04-26T00:04:46.652 INFO:tasks.ceph.mon.f:Restarting daemon 2024-04-26T00:04:46.653 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-04-26T00:04:46.656 INFO:tasks.ceph.mon.f:Started 2024-04-26T00:04:46.656 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-26T00:04:46.656 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-04-26T00:04:46.657 INFO:tasks.ceph.mon.e:Restarting daemon 2024-04-26T00:04:46.657 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-04-26T00:04:46.660 INFO:tasks.ceph.mon.e:Started 2024-04-26T00:04:46.660 INFO:tasks.mon_thrash:Sending STOP to mon c 2024-04-26T00:04:46.660 INFO:tasks.ceph.mon.c:Sent signal 19 2024-04-26T00:04:46.660 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-04-26T00:04:46.661 INFO:tasks.ceph.mon.g:Sent signal 19 2024-04-26T00:04:46.661 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T00:04:46.759 INFO:tasks.ceph.mon.f.smithi171.stderr:2024-04-26T00:04:46.780+0000 7fcbab373c80 -1 mon.f@-1(???).log v0 log_external_backlog rewinding external_log_to from 347 -> 0 (sync_force? mon rebuild?) 2024-04-26T00:04:46.762 INFO:tasks.ceph.mon.e.smithi106.stderr:2024-04-26T00:04:46.784+0000 7feed9da8c80 -1 mon.e@-1(???).log v0 log_external_backlog rewinding external_log_to from 347 -> 0 (sync_force? mon rebuild?) 2024-04-26T00:05:01.662 INFO:tasks.mon_thrash:Sending CONT to mon c 2024-04-26T00:05:01.662 INFO:tasks.ceph.mon.c:Sent signal 18 2024-04-26T00:05:01.663 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-04-26T00:05:01.663 INFO:tasks.ceph.mon.g:Sent signal 18 2024-04-26T00:05:01.663 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:05:01.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:05:01.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: get_monmap_and_config 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: build_initial_monmap 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: monmap: 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:01.835124+0000 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:01.835124+0000 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:01.810 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:01.811 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:01.811 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 Processor -- start 2024-04-26T00:05:01.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- start start 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: init 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: _add_conns ranks=[8,3,1,4,2,0,7,5,6] 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient(hunting): picked mon.noname-e con 0x7f6d6c134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient(hunting): picked mon.noname-g con 0x7f6d6c0a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient(hunting): picked mon.noname-f con 0x7f6d6c13e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6c06dd40 con 0x7f6d6c13e200 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6c0a2b10 con 0x7f6d6c0a4820 2024-04-26T00:05:01.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6c0a2df0 con 0x7f6d6c134970 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient(hunting): authenticate will time out at 1557.361980s 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6b7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f6d6c134970 0x7f6d6c134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:34046/0 (socket says 172.21.15.106:34046) 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6b7fe640 1 -- 172.21.15.106:0/451274781 learned_addr learned my addr 172.21.15.106:0/451274781 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322519564 0 0) 0x7f6d6c0a2df0 con 0x7f6d6c134970 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient(hunting): my global_id is 224108 2024-04-26T00:05:01.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d58003530 con 0x7f6d6c134970 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1091422611 0 0) 0x7f6d58003530 con 0x7f6d6c134970 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 >> v1:172.21.15.171:6790/0 conn(0x7f6d6c0a4820 legacy=0x7f6d6c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 >> v1:172.21.15.171:6789/0 conn(0x7f6d6c13e200 legacy=0x7f6d6c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 monclient: found mon.noname-e 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6c0a30d0 con 0x7f6d6c134970 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: _finish_auth 0 2024-04-26T00:05:01.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d5c0017c0 con 0x7f6d6c134970 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: dump: 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:01.823 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:01.824 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:01.825 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 5 monclient: authenticate success, global_id 224108 2024-04-26T00:05:01.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d5c001ab0 con 0x7f6d6c134970 2024-04-26T00:05:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 1 -- 172.21.15.106:0/451274781 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d5c004bf0 con 0x7f6d6c134970 2024-04-26T00:05:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 4 set_mon_vals no callback set 2024-04-26T00:05:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:01.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d6affd640 10 monclient: dump: 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:01.827 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 10 monclient: shutdown 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- 172.21.15.106:0/451274781 >> v1:172.21.15.106:6793/0 conn(0x7f6d6c134970 legacy=0x7f6d6c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- 172.21.15.106:0/451274781 shutdown_connections 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- 172.21.15.106:0/451274781 >> 172.21.15.106:0/451274781 conn(0x7f6d6c0a9e20 msgr2=0x7f6d6c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- 172.21.15.106:0/451274781 shutdown_connections 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.831+0000 7f6d71f5a640 1 -- 172.21.15.106:0/451274781 wait complete. 2024-04-26T00:05:01.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: build_initial_monmap 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: monmap: 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:01.829 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 1 Processor -- start 2024-04-26T00:05:01.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 1 -- start start 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: init 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: _add_conns ranks=[5,1,3,8,6,4,7,0,2] 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient(hunting): picked mon.noname-h con 0x7f6d6c0a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient(hunting): picked mon.noname-f con 0x7f6d6c134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient(hunting): picked mon.noname-g con 0x7f6d6c13e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6c09eea0 con 0x7f6d6c134970 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6c09e490 con 0x7f6d6c13e200 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d6c09e1b0 con 0x7f6d6c0a4820 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient(hunting): authenticate will time out at 1557.365291s 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d63fff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f6d6c134970 0x7f6d6c12a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:51340/0 (socket says 172.21.15.106:51340) 2024-04-26T00:05:01.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d63fff640 1 -- 172.21.15.106:0/1685318153 learned_addr learned my addr 172.21.15.106:0/1685318153 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036535744 0 0) 0x7f6d6c09e490 con 0x7f6d6c13e200 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): my global_id is 214311 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d4c003530 con 0x7f6d6c13e200 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3293734019 0 0) 0x7f6d6c09eea0 con 0x7f6d6c134970 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): my global_id is 224110 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d6c09e490 con 0x7f6d6c134970 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479053699 0 0) 0x7f6d6c09e1b0 con 0x7f6d6c0a4820 2024-04-26T00:05:01.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): my global_id is 7241 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d6c09eea0 con 0x7f6d6c0a4820 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d6b7fe640 1 -- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6791/0 conn(0x7f6d6c0a4820 legacy=0x7f6d6c09c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d6b7fe640 1 -- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6791/0 conn(0x7f6d6c0a4820 legacy=0x7f6d6c09c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d6b7fe640 1 --1- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6791/0 conn(0x7f6d6c0a4820 0x7f6d6c09c450 :-1 s=OPENED pgs=611 cs=1 l=1).handle_message read tag failed 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d6b7fe640 1 --1- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6791/0 conn(0x7f6d6c0a4820 0x7f6d6c09c450 :-1 s=OPENED pgs=611 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.171:6791/0 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2960842053 0 0) 0x7f6d4c003530 con 0x7f6d6c13e200 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d6c09e1b0 con 0x7f6d6c13e200 2024-04-26T00:05:01.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2072897112 0 0) 0x7f6d6c09e490 con 0x7f6d6c134970 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6d4c003530 con 0x7f6d6c134970 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d64001bf0 con 0x7f6d6c13e200 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): dump: 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:01.834 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d54001aa0 con 0x7f6d6c134970 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient(hunting): dump: 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:01.835 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:01.836 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 806063737 0 0) 0x7f6d4c003530 con 0x7f6d6c134970 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6791/0 conn(0x7f6d6c0a4820 legacy=0x7f6d6c09c450 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6790/0 conn(0x7f6d6c13e200 legacy=0x7f6d6c1d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 monclient: found mon.f 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d6c09d8f0 con 0x7f6d6c134970 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: _finish_auth 0 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:05:01.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 5 monclient: authenticate success, global_id 224110 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: _renew_subs 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6d6c09b9b0 con 0x7f6d6c134970 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: _renew_subs 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6d6c12ae80 con 0x7f6d6c134970 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6d54001c80 con 0x7f6d6c134970 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6d54003c10 con 0x7f6d6c134970 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d6a7fc640 4 set_mon_vals no callback set 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.835+0000 7f6d68ff9640 10 monclient: dump: 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.839+0000 7f6d71f5a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.839+0000 7f6d71f5a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.839+0000 7f6d71f5a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.839+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d50005090 con 0x7f6d6c134970 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.839+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6d54003db0 con 0x7f6d6c134970 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.839+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f6d54045190 con 0x7f6d6c134970 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.839+0000 7f6d6b7fe640 10 monclient: get_auth_request con 0x7f6d4c037ed0 auth_method 0 2024-04-26T00:05:01.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.851+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6d54015760 con 0x7f6d6c134970 2024-04-26T00:05:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.851+0000 7f6d68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:01.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:01.851+0000 7f6d68ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.075+0000 7f6d71f5a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:05:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.075+0000 7f6d71f5a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:05:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.075+0000 7f6d71f5a640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.075+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6d50005380 con 0x7f6d6c134970 2024-04-26T00:05:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.075+0000 7f6d68ff9640 1 -- 172.21.15.106:0/1685318153 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1197773066) 0x7f6d54015060 con 0x7f6d6c134970 2024-04-26T00:05:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.075+0000 7f6d68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:05:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.075+0000 7f6d68ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:02.057 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":72,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:05:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6812/722422047 conn(0x7f6d4c037ed0 legacy=0x7f6d4c03a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 10 monclient: shutdown 2024-04-26T00:05:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 >> v1:172.21.15.171:6789/0 conn(0x7f6d6c134970 legacy=0x7f6d6c12a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 shutdown_connections 2024-04-26T00:05:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 >> 172.21.15.106:0/1685318153 conn(0x7f6d6c0a9e20 msgr2=0x7f6d6c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 shutdown_connections 2024-04-26T00:05:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.079+0000 7f6d71f5a640 1 -- 172.21.15.106:0/1685318153 wait complete. 2024-04-26T00:05:02.074 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:05:02.075 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:05:02.075 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:05:02.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: get_monmap_and_config 2024-04-26T00:05:02.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: monmap: 2024-04-26T00:05:02.217 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:02.242595+0000 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:02.242595+0000 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.219 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 Processor -- start 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- start start 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: init 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: _add_conns ranks=[2,0,1,6,3,4,7,8,5] 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient(hunting): picked mon.noname-b con 0x7f6048137730 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient(hunting): picked mon.noname-a con 0x7f60480a0b20 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient(hunting): picked mon.noname-f con 0x7f6048138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60480a2750 con 0x7f60480a0b20 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60480a2a30 con 0x7f6048138220 2024-04-26T00:05:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60480a2d10 con 0x7f6048137730 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient(hunting): authenticate will time out at 1557.769833s 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f60467fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f60480a0b20 0x7f604813ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57298/0 (socket says 172.21.15.106:57298) 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f60467fc640 1 -- 172.21.15.106:0/206839385 learned_addr learned my addr 172.21.15.106:0/206839385 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041693894 0 0) 0x7f60480a2750 con 0x7f60480a0b20 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): my global_id is 7407 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6030003530 con 0x7f60480a0b20 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 782812912 0 0) 0x7f60480a2d10 con 0x7f6048137730 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient(hunting): my global_id is 7238 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60480a2750 con 0x7f6048137730 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1883991914 0 0) 0x7f6030003530 con 0x7f60480a0b20 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 >> v1:172.21.15.106:6790/0 conn(0x7f6048137730 legacy=0x7f6048137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 >> v1:172.21.15.171:6789/0 conn(0x7f6048138220 legacy=0x7f6048140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 monclient: found mon.noname-a 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60480a4680 con 0x7f60480a0b20 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f60380017c0 con 0x7f60480a0b20 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: dump: 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 5 monclient: authenticate success, global_id 7407 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6038001ae0 con 0x7f60480a0b20 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 1 -- 172.21.15.106:0/206839385 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6038001d50 con 0x7f60480a0b20 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f6045ffb640 10 monclient: dump: 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 4 set_mon_vals no callback set 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 10 monclient: shutdown 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- 172.21.15.106:0/206839385 >> v1:172.21.15.106:6789/0 conn(0x7f60480a0b20 legacy=0x7f604813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- 172.21.15.106:0/206839385 shutdown_connections 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- 172.21.15.106:0/206839385 >> 172.21.15.106:0/206839385 conn(0x7f60480a6b80 msgr2=0x7f60480a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- 172.21.15.106:0/206839385 shutdown_connections 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.239+0000 7f604d33a640 1 -- 172.21.15.106:0/206839385 wait complete. 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: monmap: 2024-04-26T00:05:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 Processor -- start 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 -- start start 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: init 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: _add_conns ranks=[0,5,1,3,2,7,6,4,8] 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient(hunting): picked mon.noname-a con 0x7f60480a0b20 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient(hunting): picked mon.noname-h con 0x7f6048137730 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient(hunting): picked mon.noname-f con 0x7f6048138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60481ccfe0 con 0x7f60480a0b20 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60480a19d0 con 0x7f6048138220 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6048133220 con 0x7f6048137730 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f6046ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f60480a0b20 0x7f60481cc1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57302/0 (socket says 172.21.15.106:57302) 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f6046ffd640 1 -- 172.21.15.106:0/3413413032 learned_addr learned my addr 172.21.15.106:0/3413413032 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient(hunting): authenticate will time out at 1557.773549s 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357054286 0 0) 0x7f60481ccfe0 con 0x7f60480a0b20 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): my global_id is 7416 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6034003530 con 0x7f60480a0b20 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1880999348 0 0) 0x7f6034003530 con 0x7f60480a0b20 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60481ccfe0 con 0x7f60480a0b20 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 123985366 0 0) 0x7f60480a19d0 con 0x7f6048138220 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): my global_id is 224128 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6034003530 con 0x7f6048138220 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f603c001ac0 con 0x7f60480a0b20 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): dump: 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105773942 0 0) 0x7f6048133220 con 0x7f6048137730 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): my global_id is 7250 2024-04-26T00:05:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60480a19d0 con 0x7f6048137730 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1443979146 0 0) 0x7f60481ccfe0 con 0x7f60480a0b20 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.171:6791/0 conn(0x7f6048137730 legacy=0x7f60481cc8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.171:6789/0 conn(0x7f6048138220 legacy=0x7f60481d4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 monclient: found mon.a 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6048133c50 con 0x7f60480a0b20 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 5 monclient: authenticate success, global_id 7416 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: _renew_subs 2024-04-26T00:05:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6048132700 con 0x7f60480a0b20 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: _renew_subs 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6048135190 con 0x7f60480a0b20 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f603c0038d0 con 0x7f60480a0b20 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f603c003e40 con 0x7f60480a0b20 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f60457fa640 4 set_mon_vals no callback set 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: dump: 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.240 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f60280065d0 con 0x7f6028002870 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361366964 0 0) 0x7f60280065d0 con 0x7f6028002870 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient(hunting): my global_id is 7425 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60481ccfe0 con 0x7f6028002870 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3085116089 0 0) 0x7f60481ccfe0 con 0x7f6028002870 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f60280065d0 con 0x7f6028002870 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6038001be0 con 0x7f6028002870 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 10 monclient: dump: 2024-04-26T00:05:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f603c004060 con 0x7f60480a0b20 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.243+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f603c045170 con 0x7f60480a0b20 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 292038718 0 0) 0x7f60280065d0 con 0x7f6028002870 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f602800a160 con 0x7f6028002870 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f60477fe640 10 monclient: get_auth_request con 0x7f6034037df0 auth_method 0 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6038001670 con 0x7f6028002870 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f602f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f602f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.106:6789/0 conn(0x7f6028002870 legacy=0x7f6028004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.247+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.106:6789/0 conn(0x7f6028002870 legacy=0x7f6028004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6028009e60 con 0x7f6028009120 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3255152756 0 0) 0x7f6028009e60 con 0x7f6028009120 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient(hunting): my global_id is 7434 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f60280065d0 con 0x7f6028009120 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 341790817 0 0) 0x7f60280065d0 con 0x7f6028009120 2024-04-26T00:05:02.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6028009e60 con 0x7f6028009120 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6038005340 con 0x7f6028009120 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient: dump: 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.246 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 459120876 0 0) 0x7f6028009e60 con 0x7f6028009120 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f602800c3e0 con 0x7f6028009120 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 1740024750) 0x7f60380076d0 con 0x7f6028009120 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:02.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.106:6789/0 conn(0x7f6028009120 legacy=0x7f60280095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f602f7fe640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.106:6789/0 conn(0x7f6028009120 legacy=0x7f60280095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 620811, 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.262 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:02.264 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.266 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:02.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.267 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.267 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:02.267 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.171:6812/722422047 conn(0x7f6034037df0 legacy=0x7f603403a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 10 monclient: shutdown 2024-04-26T00:05:02.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 >> v1:172.21.15.106:6789/0 conn(0x7f60480a0b20 legacy=0x7f60481cc1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f60477fe640 1 -- 172.21.15.106:0/3413413032 reap_dead start 2024-04-26T00:05:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f60477fe640 1 -- 172.21.15.106:0/3413413032 reap_dead start 2024-04-26T00:05:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 shutdown_connections 2024-04-26T00:05:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 >> 172.21.15.106:0/3413413032 conn(0x7f60480a6b80 msgr2=0x7f60480a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 shutdown_connections 2024-04-26T00:05:02.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.251+0000 7f604d33a640 1 -- 172.21.15.106:0/3413413032 wait complete. 2024-04-26T00:05:02.269 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:02.269 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:05:02.270 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:05:02.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.403+0000 7f84919f7640 10 monclient: get_monmap_and_config 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.403+0000 7f84919f7640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.403+0000 7f84919f7640 10 monclient: monmap: 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:02.410133+0000 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:02.410133+0000 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.385 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.386 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.386 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.386 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.386 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.386 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.386 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 Processor -- start 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- start start 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient: init 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient: _add_conns ranks=[6,2,7,8,0,4,3,1,5] 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient(hunting): picked mon.noname-d con 0x7f848c134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient(hunting): picked mon.noname-b con 0x7f848c0a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient(hunting): picked mon.noname-i con 0x7f848c13e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848c06dd40 con 0x7f848c0a4820 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848c0a2b10 con 0x7f848c134970 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848c0a2df0 con 0x7f848c13e200 2024-04-26T00:05:02.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient(hunting): authenticate will time out at 1557.937108s 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f848affd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f848c134970 0x7f848c134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35518/0 (socket says 172.21.15.106:35518) 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f848affd640 1 -- 172.21.15.106:0/742760140 learned_addr learned my addr 172.21.15.106:0/742760140 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f848a7fc640 1 --1- 172.21.15.106:0/742760140 >> v1:172.21.15.106:6790/0 conn(0x7f848c0a4820 0x7f848c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:33756/0 (socket says 172.21.15.106:33756) 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f848affd640 1 -- 172.21.15.106:0/742760140 >> v1:172.21.15.106:6792/0 conn(0x7f848c134970 legacy=0x7f848c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f848affd640 1 -- 172.21.15.106:0/742760140 >> v1:172.21.15.106:6792/0 conn(0x7f848c134970 legacy=0x7f848c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f848affd640 1 --1- 172.21.15.106:0/742760140 >> v1:172.21.15.106:6792/0 conn(0x7f848c134970 0x7f848c134d50 :-1 s=OPENED pgs=645 cs=1 l=1).handle_message read tag failed 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f848affd640 1 --1- 172.21.15.106:0/742760140 >> v1:172.21.15.106:6792/0 conn(0x7f848c134970 0x7f848c134d50 :-1 s=OPENED pgs=645 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6792/0 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189345232 0 0) 0x7f848c06dd40 con 0x7f848c0a4820 2024-04-26T00:05:02.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): my global_id is 7247 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8474003530 con 0x7f848c0a4820 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819944680 0 0) 0x7f848c0a2df0 con 0x7f848c13e200 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient(hunting): my global_id is 145708 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f848c06dd40 con 0x7f848c13e200 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3274271693 0 0) 0x7f8474003530 con 0x7f848c0a4820 2024-04-26T00:05:02.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 >> v1:172.21.15.171:6792/0 conn(0x7f848c13e200 legacy=0x7f848c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 >> v1:172.21.15.106:6792/0 conn(0x7f848c134970 legacy=0x7f848c134d50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 monclient: found mon.noname-b 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848c0a30d0 con 0x7f848c0a4820 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 5 monclient: authenticate success, global_id 7247 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:02.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f847c0016f0 con 0x7f848c0a4820 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: dump: 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.398 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f847c0019a0 con 0x7f848c0a4820 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 1 -- 172.21.15.106:0/742760140 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f847c004b30 con 0x7f848c0a4820 2024-04-26T00:05:02.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 4 set_mon_vals no callback set 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f8489ffb640 10 monclient: dump: 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.400 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient: shutdown 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- 172.21.15.106:0/742760140 >> v1:172.21.15.106:6790/0 conn(0x7f848c0a4820 legacy=0x7f848c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- 172.21.15.106:0/742760140 shutdown_connections 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- 172.21.15.106:0/742760140 >> 172.21.15.106:0/742760140 conn(0x7f848c0a9e20 msgr2=0x7f848c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- 172.21.15.106:0/742760140 shutdown_connections 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 -- 172.21.15.106:0/742760140 wait complete. 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 10 monclient: monmap: 2024-04-26T00:05:02.401 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.402 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.407+0000 7f84919f7640 1 Processor -- start 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 1 -- start start 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient: init 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient: _add_conns ranks=[6,4,1,8,5,7,3,0,2] 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient(hunting): picked mon.noname-d con 0x7f848c0a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient(hunting): picked mon.noname-c con 0x7f848c134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient(hunting): picked mon.noname-f con 0x7f848c13e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848c09f180 con 0x7f848c13e200 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848c0a0410 con 0x7f848c134970 2024-04-26T00:05:02.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848c0a1e00 con 0x7f848c0a4820 2024-04-26T00:05:02.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient(hunting): authenticate will time out at 1557.940841s 2024-04-26T00:05:02.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f848affd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f848c0a4820 0x7f848c1cc650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35532/0 (socket says 172.21.15.106:35532) 2024-04-26T00:05:02.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f848affd640 1 -- 172.21.15.106:0/210195900 learned_addr learned my addr 172.21.15.106:0/210195900 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 68352858 0 0) 0x7f848c0a1e00 con 0x7f848c0a4820 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): my global_id is 7386 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8478003530 con 0x7f848c0a4820 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2316554507 0 0) 0x7f848c0a0410 con 0x7f848c134970 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): my global_id is 145804 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f848c0a1e00 con 0x7f848c134970 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2133705686 0 0) 0x7f8478003530 con 0x7f848c0a4820 2024-04-26T00:05:02.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f848c0a0410 con 0x7f848c0a4820 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4154555599 0 0) 0x7f848c09f180 con 0x7f848c13e200 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): my global_id is 224137 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8478003530 con 0x7f848c13e200 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8480001a60 con 0x7f848c0a4820 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): dump: 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.406 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2985448588 0 0) 0x7f848c0a1e00 con 0x7f848c134970 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f848c09f180 con 0x7f848c134970 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f847c004bf0 con 0x7f848c134970 2024-04-26T00:05:02.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): dump: 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.410 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1053934568 0 0) 0x7f848c0a0410 con 0x7f848c0a4820 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.106:6791/0 conn(0x7f848c134970 legacy=0x7f848c13c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.171:6789/0 conn(0x7f848c13e200 legacy=0x7f848c1d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 monclient: found mon.d 2024-04-26T00:05:02.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f848c0a1a40 con 0x7f848c0a4820 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 5 monclient: authenticate success, global_id 7386 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient: _renew_subs 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f848c09e400 con 0x7f848c0a4820 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient: _renew_subs 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f848c13cea0 con 0x7f848c0a4820 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8480004aa0 con 0x7f848c0a4820 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8480005010 con 0x7f848c0a4820 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84897fa640 4 set_mon_vals no callback set 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: dump: 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.413 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f846c0065d0 con 0x7f846c002870 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f84800051b0 con 0x7f848c0a4820 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f8480045120 con 0x7f848c0a4820 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410759273 0 0) 0x7f846c0065d0 con 0x7f846c002870 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient(hunting): my global_id is 7256 2024-04-26T00:05:02.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f848c0a0410 con 0x7f846c002870 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f848b7fe640 10 monclient: get_auth_request con 0x7f8478037fc0 auth_method 0 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1431474806 0 0) 0x7f848c0a0410 con 0x7f846c002870 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f846c0065d0 con 0x7f846c002870 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f847c0019a0 con 0x7f846c002870 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: dump: 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.415 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3748251019 0 0) 0x7f846c0065d0 con 0x7f846c002870 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f846c00a160 con 0x7f846c002870 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f847c005310 con 0x7f846c002870 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:02.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.106:6790/0 conn(0x7f846c002870 legacy=0x7f846c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.411+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.106:6790/0 conn(0x7f846c002870 legacy=0x7f846c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f846c009e50 con 0x7f846c009110 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2990155954 0 0) 0x7f846c009e50 con 0x7f846c009110 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient(hunting): my global_id is 7265 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f846c0065d0 con 0x7f846c009110 2024-04-26T00:05:02.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3107927123 0 0) 0x7f846c0065d0 con 0x7f846c009110 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f846c009e50 con 0x7f846c009110 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f847c005740 con 0x7f846c009110 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient: dump: 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.419 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1831576394 0 0) 0x7f846c009e50 con 0x7f846c009110 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f846c00c3e0 con 0x7f846c009110 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1695396224) 0x7f847c0087c0 con 0x7f846c009110 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.106:6790/0 conn(0x7f846c009110 legacy=0x7f846c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f8473fff640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.106:6790/0 conn(0x7f846c009110 legacy=0x7f846c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 620983, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:02.421 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.422 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.423 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:02.424 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.425 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:02.426 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.428 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:02.429 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.430 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.432 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.434 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:02.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.436 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.437 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:02.438 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.439 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.440 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.441 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:05:02.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.442 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:02.442 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.171:6812/722422047 conn(0x7f8478037fc0 legacy=0x7f847803a480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 10 monclient: shutdown 2024-04-26T00:05:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 >> v1:172.21.15.106:6792/0 conn(0x7f848c0a4820 legacy=0x7f848c1cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f848b7fe640 1 -- 172.21.15.106:0/210195900 reap_dead start 2024-04-26T00:05:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f848b7fe640 1 -- 172.21.15.106:0/210195900 reap_dead start 2024-04-26T00:05:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 shutdown_connections 2024-04-26T00:05:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 >> 172.21.15.106:0/210195900 conn(0x7f848c0a9e20 msgr2=0x7f848c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 shutdown_connections 2024-04-26T00:05:02.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.419+0000 7f84919f7640 1 -- 172.21.15.106:0/210195900 wait complete. 2024-04-26T00:05:02.444 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:02.444 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:05:02.444 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:05:02.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.575+0000 7f109fede640 10 monclient: get_monmap_and_config 2024-04-26T00:05:02.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.575+0000 7f109fede640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.575+0000 7f109fede640 10 monclient: monmap: 2024-04-26T00:05:02.556 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.556 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.556 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:02.581645+0000 2024-04-26T00:05:02.556 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:02.581645+0000 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.557 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.575+0000 7f109fede640 1 Processor -- start 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- start start 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: init 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: _add_conns ranks=[3,1,5,6,8,7,2,0,4] 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient(hunting): picked mon.noname-g con 0x7f1098134820 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient(hunting): picked mon.noname-f con 0x7f10980725d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient(hunting): picked mon.noname-h con 0x7f109813ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:02.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1098071270 con 0x7f10980725d0 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10980714e0 con 0x7f1098134820 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10980729f0 con 0x7f109813ace0 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient(hunting): authenticate will time out at 1558.108828s 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109e47b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f109813ace0 0x7f109813d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:44354/0 (socket says 172.21.15.106:44354) 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109e47b640 1 -- 172.21.15.106:0/609544154 learned_addr learned my addr 172.21.15.106:0/609544154 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2191589926 0 0) 0x7f1098071270 con 0x7f10980725d0 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): my global_id is 224155 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1084003530 con 0x7f10980725d0 2024-04-26T00:05:02.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313148886 0 0) 0x7f10900014a0 con 0x7f1098134820 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): my global_id is 214320 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1098071270 con 0x7f1098134820 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183236048 0 0) 0x7f10980729f0 con 0x7f109813ace0 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient(hunting): my global_id is 7259 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10900014a0 con 0x7f109813ace0 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 730615411 0 0) 0x7f1084003530 con 0x7f10980725d0 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 >> v1:172.21.15.171:6791/0 conn(0x7f109813ace0 legacy=0x7f109813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 >> v1:172.21.15.171:6790/0 conn(0x7f1098134820 legacy=0x7f1098134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 monclient: found mon.noname-f 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10980717c0 con 0x7f10980725d0 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f108c0017c0 con 0x7f10980725d0 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: dump: 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.568 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 5 monclient: authenticate success, global_id 224155 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f108c001ae0 con 0x7f10980725d0 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 4 set_mon_vals no callback set 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 1 -- 172.21.15.106:0/609544154 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f108c003960 con 0x7f10980725d0 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109cc78640 10 monclient: dump: 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.570 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: shutdown 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- 172.21.15.106:0/609544154 >> v1:172.21.15.171:6789/0 conn(0x7f10980725d0 legacy=0x7f10981395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- 172.21.15.106:0/609544154 shutdown_connections 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- 172.21.15.106:0/609544154 >> 172.21.15.106:0/609544154 conn(0x7f10980a64e0 msgr2=0x7f10980a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- 172.21.15.106:0/609544154 shutdown_connections 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- 172.21.15.106:0/609544154 wait complete. 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: monmap: 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.572 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 Processor -- start 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 1 -- start start 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.579+0000 7f109fede640 10 monclient: init 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient: _add_conns ranks=[5,0,2,7,8,3,4,6,1] 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient(hunting): picked mon.noname-h con 0x7f10980725d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:02.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient(hunting): picked mon.noname-a con 0x7f1098134820 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient(hunting): picked mon.noname-b con 0x7f109813ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10980706a0 con 0x7f1098134820 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1098133e40 con 0x7f109813ace0 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f109809d3d0 con 0x7f10980725d0 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient(hunting): authenticate will time out at 1558.112484s 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109d479640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1098134820 0x7f10981cd410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57318/0 (socket says 172.21.15.106:57318) 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109d479640 1 -- 172.21.15.106:0/3357827796 learned_addr learned my addr 172.21.15.106:0/3357827796 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 397178867 0 0) 0x7f109809d3d0 con 0x7f10980725d0 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): my global_id is 7268 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f107c003530 con 0x7f10980725d0 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714938548 0 0) 0x7f10980706a0 con 0x7f1098134820 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): my global_id is 7452 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f109809d3d0 con 0x7f1098134820 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3658011359 0 0) 0x7f107c003530 con 0x7f10980725d0 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10980706a0 con 0x7f10980725d0 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1090001fb0 con 0x7f10980725d0 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:02.575 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.576 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 23166916 0 0) 0x7f109809d3d0 con 0x7f1098134820 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f107c003530 con 0x7f1098134820 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f108c001780 con 0x7f1098134820 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.577 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2691512969 0 0) 0x7f107c003530 con 0x7f1098134820 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.171:6791/0 conn(0x7f10980725d0 legacy=0x7f109809ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.106:6790/0 conn(0x7f109813ace0 legacy=0x7f10981d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 monclient: found mon.a 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f109809d6b0 con 0x7f1098134820 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 5 monclient: authenticate success, global_id 7452 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient: _renew_subs 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f109809b820 con 0x7f1098134820 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient: _renew_subs 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f109809f6f0 con 0x7f1098134820 2024-04-26T00:05:02.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f108c001ae0 con 0x7f1098134820 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f108c004260 con 0x7f1098134820 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: dump: 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.580 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108bfff640 4 set_mon_vals no callback set 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f108c004400 con 0x7f1098134820 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f108c0451e0 con 0x7f1098134820 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f10800065d0 con 0x7f1080002870 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f109dc7a640 10 monclient: get_auth_request con 0x7f107c037e20 auth_method 0 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351024664 0 0) 0x7f10800065d0 con 0x7f1080002870 2024-04-26T00:05:02.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient(hunting): my global_id is 145813 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f107c003530 con 0x7f1080002870 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 266611462 0 0) 0x7f107c003530 con 0x7f1080002870 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f10800065d0 con 0x7f1080002870 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1094001890 con 0x7f1080002870 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 10 monclient: dump: 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.582 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1697990383 0 0) 0x7f10800065d0 con 0x7f1080002870 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.583+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f108000a160 con 0x7f1080002870 2024-04-26T00:05:02.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.587+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1094001b80 con 0x7f1080002870 2024-04-26T00:05:02.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.587+0000 7f108a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.587+0000 7f108a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:02.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.587+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.106:6791/0 conn(0x7f1080002870 legacy=0x7f1080004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.587+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.106:6791/0 conn(0x7f1080002870 legacy=0x7f1080004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:02.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1080009e50 con 0x7f1080009110 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3567388634 0 0) 0x7f1080009e50 con 0x7f1080009110 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient(hunting): my global_id is 145822 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f10800065d0 con 0x7f1080009110 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2567777885 0 0) 0x7f10800065d0 con 0x7f1080009110 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1080009e50 con 0x7f1080009110 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1094004de0 con 0x7f1080009110 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient: dump: 2024-04-26T00:05:02.586 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.587 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.587 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.587 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.587 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.587 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2774442699 0 0) 0x7f1080009e50 con 0x7f1080009110 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f108000c3e0 con 0x7f1080009110 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 1829341975) 0x7f10940058e0 con 0x7f1080009110 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:02.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.106:6791/0 conn(0x7f1080009110 legacy=0x7f10800095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f108a7fc640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.106:6791/0 conn(0x7f1080009110 legacy=0x7f10800095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 366122, 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:02.589 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:02.590 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:02.591 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:02.592 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.593 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:02.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.595 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.596 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.597 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:02.598 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.599 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.600 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.601 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.603 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.604 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:02.608 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:02.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.171:6812/722422047 conn(0x7f107c037e20 legacy=0x7f107c03a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 10 monclient: shutdown 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 >> v1:172.21.15.106:6789/0 conn(0x7f1098134820 legacy=0x7f10981cd410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109e47b640 1 -- 172.21.15.106:0/3357827796 reap_dead start 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 shutdown_connections 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 >> 172.21.15.106:0/3357827796 conn(0x7f10980a64e0 msgr2=0x7f10980a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 shutdown_connections 2024-04-26T00:05:02.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.591+0000 7f109fede640 1 -- 172.21.15.106:0/3357827796 wait complete. 2024-04-26T00:05:02.610 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:02.611 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:05:02.611 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:05:02.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.747+0000 7f37be664640 10 monclient: get_monmap_and_config 2024-04-26T00:05:02.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.747+0000 7f37be664640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.747+0000 7f37be664640 10 monclient: monmap: 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:02.753941+0000 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:02.753941+0000 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.729 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.730 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.730 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 Processor -- start 2024-04-26T00:05:02.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- start start 2024-04-26T00:05:02.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: init 2024-04-26T00:05:02.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: _add_conns ranks=[5,7,2,0,4,8,1,6,3] 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient(hunting): picked mon.noname-h con 0x7f37b8134820 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient(hunting): picked mon.noname-i con 0x7f37b80725d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient(hunting): picked mon.noname-b con 0x7f37b813ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b8071270 con 0x7f37b813ace0 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b80714e0 con 0x7f37b8134820 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b80729f0 con 0x7f37b80725d0 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient(hunting): authenticate will time out at 1558.281051s 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37bcc01640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f37b813ace0 0x7f37b813d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:33796/0 (socket says 172.21.15.106:33796) 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37bcc01640 1 -- 172.21.15.106:0/1548507832 learned_addr learned my addr 172.21.15.106:0/1548507832 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910839952 0 0) 0x7f37b8071270 con 0x7f37b813ace0 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): my global_id is 7283 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37a4003530 con 0x7f37b813ace0 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639104103 0 0) 0x7f37b80729f0 con 0x7f37b80725d0 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient(hunting): my global_id is 145717 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37b8071270 con 0x7f37b80725d0 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1934976846 0 0) 0x7f37a4003530 con 0x7f37b813ace0 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 >> v1:172.21.15.171:6792/0 conn(0x7f37b80725d0 legacy=0x7f37b81395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 >> v1:172.21.15.171:6791/0 conn(0x7f37b8134820 legacy=0x7f37b8134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 monclient: found mon.noname-b 2024-04-26T00:05:02.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b80717c0 con 0x7f37b813ace0 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 5 monclient: authenticate success, global_id 7283 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37b0001b40 con 0x7f37b813ace0 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: dump: 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.740 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37b0001e60 con 0x7f37b813ace0 2024-04-26T00:05:02.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 1 -- 172.21.15.106:0/1548507832 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37b0004f70 con 0x7f37b813ace0 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 4 set_mon_vals no callback set 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37b77fe640 10 monclient: dump: 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.742 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: shutdown 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- 172.21.15.106:0/1548507832 >> v1:172.21.15.106:6790/0 conn(0x7f37b813ace0 legacy=0x7f37b813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- 172.21.15.106:0/1548507832 shutdown_connections 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- 172.21.15.106:0/1548507832 >> 172.21.15.106:0/1548507832 conn(0x7f37b80a64e0 msgr2=0x7f37b80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- 172.21.15.106:0/1548507832 shutdown_connections 2024-04-26T00:05:02.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- 172.21.15.106:0/1548507832 wait complete. 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: monmap: 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.744 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 Processor -- start 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 1 -- start start 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.751+0000 7f37be664640 10 monclient: init 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient: _add_conns ranks=[8,4,3,7,6,2,0,5,1] 2024-04-26T00:05:02.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient(hunting): picked mon.noname-e con 0x7f37b80725d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient(hunting): picked mon.noname-c con 0x7f37b8134820 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient(hunting): picked mon.noname-g con 0x7f37b813ace0 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b8133980 con 0x7f37b813ace0 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b809b5e0 con 0x7f37b8134820 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37b809c7c0 con 0x7f37b80725d0 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient(hunting): authenticate will time out at 1558.284462s 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37af7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f37b8134820 0x7f37b81cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48292/0 (socket says 172.21.15.106:48292) 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b7fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f37b80725d0 0x7f37b8129370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:34052/0 (socket says 172.21.15.106:34052) 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37af7fe640 1 -- 172.21.15.106:0/1736630825 learned_addr learned my addr 172.21.15.106:0/1736630825 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073317437 0 0) 0x7f37b809b5e0 con 0x7f37b8134820 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): my global_id is 145831 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3798003530 con 0x7f37b8134820 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1821134441 0 0) 0x7f37b809c7c0 con 0x7f37b80725d0 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): my global_id is 224117 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37b809b5e0 con 0x7f37b80725d0 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1114248412 0 0) 0x7f3798003530 con 0x7f37b8134820 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f37b809c7c0 con 0x7f37b8134820 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37a0001b40 con 0x7f37b8134820 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): dump: 2024-04-26T00:05:02.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.748 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2427771183 0 0) 0x7f37b809b5e0 con 0x7f37b80725d0 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3798003530 con 0x7f37b80725d0 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37a80019d0 con 0x7f37b80725d0 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): dump: 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.749 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2309166466 0 0) 0x7f37b809c7c0 con 0x7f37b8134820 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.106:6793/0 conn(0x7f37b80725d0 legacy=0x7f37b8129370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.171:6790/0 conn(0x7f37b813ace0 legacy=0x7f37b81d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 monclient: found mon.c 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37b809da40 con 0x7f37b8134820 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 5 monclient: authenticate success, global_id 145831 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient: _renew_subs 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f37b809b8d0 con 0x7f37b8134820 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient: _renew_subs 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:02.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f37b8132ff0 con 0x7f37b8134820 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f37a00038d0 con 0x7f37b8134820 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37a0003e40 con 0x7f37b8134820 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b6ffd640 4 set_mon_vals no callback set 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: dump: 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.752 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f379c0065d0 con 0x7f379c002870 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f37a0004060 con 0x7f37b8134820 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f37a00451a0 con 0x7f37b8134820 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 392916853 0 0) 0x7f379c0065d0 con 0x7f379c002870 2024-04-26T00:05:02.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient(hunting): my global_id is 7395 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37b809c7c0 con 0x7f379c002870 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37bcc01640 10 monclient: get_auth_request con 0x7f3798037cf0 auth_method 0 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2674663574 0 0) 0x7f37b809c7c0 con 0x7f379c002870 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f379c0065d0 con 0x7f379c002870 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37a8003960 con 0x7f379c002870 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: dump: 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.754 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3445452 0 0) 0x7f379c0065d0 con 0x7f379c002870 2024-04-26T00:05:02.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f379c00a160 con 0x7f379c002870 2024-04-26T00:05:02.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f37a80057d0 con 0x7f379c002870 2024-04-26T00:05:02.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:02.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.106:6792/0 conn(0x7f379c002870 legacy=0x7f379c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.755+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.106:6792/0 conn(0x7f379c002870 legacy=0x7f379c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:02.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f379c009e30 con 0x7f379c0090f0 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638465597 0 0) 0x7f379c009e30 con 0x7f379c0090f0 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient(hunting): my global_id is 7404 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f379c0065d0 con 0x7f379c0090f0 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3019261023 0 0) 0x7f379c0065d0 con 0x7f379c0090f0 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f379c009e30 con 0x7f379c0090f0 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37a8004310 con 0x7f379c0090f0 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient: dump: 2024-04-26T00:05:02.758 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.759 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4200252345 0 0) 0x7f379c009e30 con 0x7f379c0090f0 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f379c00c3a0 con 0x7f379c0090f0 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1076857367) 0x7f37a8007a40 con 0x7f379c0090f0 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.106:6792/0 conn(0x7f379c0090f0 legacy=0x7f379c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37b57fa640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.106:6792/0 conn(0x7f379c0090f0 legacy=0x7f379c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:02.760 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 621303, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:02.761 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.762 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.763 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:02.764 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.765 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.766 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.767 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:02.769 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:02.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.777 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.778 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.779 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.780 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:02.780 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.171:6812/722422047 conn(0x7f3798037cf0 legacy=0x7f379803a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 10 monclient: shutdown 2024-04-26T00:05:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 >> v1:172.21.15.106:6791/0 conn(0x7f37b8134820 legacy=0x7f37b81cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37bcc01640 1 -- 172.21.15.106:0/1736630825 reap_dead start 2024-04-26T00:05:02.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37bcc01640 1 -- 172.21.15.106:0/1736630825 reap_dead start 2024-04-26T00:05:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 shutdown_connections 2024-04-26T00:05:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 >> 172.21.15.106:0/1736630825 conn(0x7f37b80a64e0 msgr2=0x7f37b80a1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 shutdown_connections 2024-04-26T00:05:02.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.763+0000 7f37be664640 1 -- 172.21.15.106:0/1736630825 wait complete. 2024-04-26T00:05:02.782 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:02.782 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:05:02.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:05:02.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient: get_monmap_and_config 2024-04-26T00:05:02.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient: monmap: 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:02.920972+0000 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:02.920972+0000 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.896 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.897 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.897 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.897 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 1 Processor -- start 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 1 -- start start 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient: init 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient: _add_conns ranks=[7,0,6,8,4,1,5,3,2] 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient(hunting): picked mon.noname-i con 0x7f0ee00a1bc0 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient(hunting): picked mon.noname-a con 0x7f0ee009e7f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient(hunting): picked mon.noname-d con 0x7f0ee00a26b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:02.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee009bf60 con 0x7f0ee009e7f0 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee009d850 con 0x7f0ee00a26b0 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee009db30 con 0x7f0ee00a1bc0 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ee4ac9640 10 monclient(hunting): authenticate will time out at 1558.447768s 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0eded9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f0ee00a26b0 0x7f0ee013d0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:35566/0 (socket says 172.21.15.106:35566) 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0ed7fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0ee009e7f0 0x7f0ee01399b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57320/0 (socket says 172.21.15.106:57320) 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.915+0000 7f0eded9d640 1 -- 172.21.15.106:0/2550963543 learned_addr learned my addr 172.21.15.106:0/2550963543 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1764739117 0 0) 0x7f0ee009bf60 con 0x7f0ee009e7f0 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): my global_id is 7461 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ecc003530 con 0x7f0ee009e7f0 2024-04-26T00:05:02.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438807779 0 0) 0x7f0ee009d850 con 0x7f0ee00a26b0 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient(hunting): my global_id is 7413 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ee009bf60 con 0x7f0ee00a26b0 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 548545670 0 0) 0x7f0ee009bf60 con 0x7f0ee00a26b0 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 >> v1:172.21.15.171:6792/0 conn(0x7f0ee00a1bc0 legacy=0x7f0ee00a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 >> v1:172.21.15.106:6789/0 conn(0x7f0ee009e7f0 legacy=0x7f0ee01399b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 monclient: found mon.noname-d 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee00a0510 con 0x7f0ee00a26b0 2024-04-26T00:05:02.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ed8001b40 con 0x7f0ee00a26b0 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: dump: 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 5 monclient: authenticate success, global_id 7413 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ed8001d30 con 0x7f0ee00a26b0 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 4 set_mon_vals no callback set 2024-04-26T00:05:02.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 1 -- 172.21.15.106:0/2550963543 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ed8004f70 con 0x7f0ee00a26b0 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0eddd9b640 10 monclient: dump: 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.912 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: shutdown 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/2550963543 >> v1:172.21.15.106:6792/0 conn(0x7f0ee00a26b0 legacy=0x7f0ee013d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/2550963543 shutdown_connections 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/2550963543 >> 172.21.15.106:0/2550963543 conn(0x7f0ee006b210 msgr2=0x7f0ee006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/2550963543 shutdown_connections 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/2550963543 wait complete. 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: build_initial_monmap 2024-04-26T00:05:02.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: monmap: 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:02.914 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 Processor -- start 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- start start 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: init 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: _add_conns ranks=[5,0,8,3,2,7,4,6,1] 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient(hunting): picked mon.noname-h con 0x7f0ee00a1bc0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient(hunting): picked mon.noname-a con 0x7f0ee00a26b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient(hunting): picked mon.noname-e con 0x7f0ee01b21d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee0070c30 con 0x7f0ee00a26b0 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee0072210 con 0x7f0ee00a1bc0 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ee009cb70 con 0x7f0ee01b21d0 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:02.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient(hunting): authenticate will time out at 1558.450681s 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed7fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f0ee00a26b0 0x7f0ee01d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57322/0 (socket says 172.21.15.106:57322) 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed7fff640 1 -- 172.21.15.106:0/558872481 learned_addr learned my addr 172.21.15.106:0/558872481 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3924793757 0 0) 0x7f0ee0070c30 con 0x7f0ee00a26b0 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): my global_id is 7470 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ec0003530 con 0x7f0ee00a26b0 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3077184968 0 0) 0x7f0ee009cb70 con 0x7f0ee01b21d0 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): my global_id is 224126 2024-04-26T00:05:02.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ee0070c30 con 0x7f0ee01b21d0 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 66496418 0 0) 0x7f0ee0070c30 con 0x7f0ee01b21d0 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ee009cb70 con 0x7f0ee01b21d0 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ed8001b40 con 0x7f0ee01b21d0 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): dump: 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.917 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 323520437 0 0) 0x7f0ec0003530 con 0x7f0ee00a26b0 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ee0070c30 con 0x7f0ee00a26b0 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ec80014e0 con 0x7f0ee00a26b0 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:02.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient(hunting): dump: 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4262747734 0 0) 0x7f0ee009cb70 con 0x7f0ee01b21d0 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.171:6791/0 conn(0x7f0ee00a1bc0 legacy=0x7f0ee01b1ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.106:6789/0 conn(0x7f0ee00a26b0 legacy=0x7f0ee01d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 monclient: found mon.e 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee00711f0 con 0x7f0ee01b21d0 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 5 monclient: authenticate success, global_id 224126 2024-04-26T00:05:02.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: _renew_subs 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ee00727d0 con 0x7f0ee01b21d0 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: _renew_subs 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ee01c8c50 con 0x7f0ee01b21d0 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ed8001d30 con 0x7f0ee01b21d0 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ed8005560 con 0x7f0ee01b21d0 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0edd59a640 4 set_mon_vals no callback set 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.919+0000 7f0ed6ffd640 10 monclient: dump: 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.921 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.922 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ee4ac9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ec40065d0 con 0x7f0ec4002870 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0ed8010300 con 0x7f0ee01b21d0 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f0ed8045580 con 0x7f0ee01b21d0 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4195507525 0 0) 0x7f0ec40065d0 con 0x7f0ec4002870 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient(hunting): my global_id is 224135 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ee009cb70 con 0x7f0ec4002870 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed7fff640 10 monclient: get_auth_request con 0x7f0ec0037e20 auth_method 0 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 396069053 0 0) 0x7f0ee009cb70 con 0x7f0ec4002870 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ec40065d0 con 0x7f0ec4002870 2024-04-26T00:05:02.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ed00017f0 con 0x7f0ec4002870 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient: dump: 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.924 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1802805380 0 0) 0x7f0ec40065d0 con 0x7f0ec4002870 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ec400a160 con 0x7f0ec4002870 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0ed0001cb0 con 0x7f0ec4002870 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.106:6793/0 conn(0x7f0ec4002870 legacy=0x7f0ec4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.923+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.106:6793/0 conn(0x7f0ec4002870 legacy=0x7f0ec4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ee4ac9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:02.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ec4009e50 con 0x7f0ec4009110 2024-04-26T00:05:02.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 638884864 0 0) 0x7f0ec4009e50 con 0x7f0ec4009110 2024-04-26T00:05:02.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ed6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:02.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:02.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ed6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ed6ffd640 10 monclient(hunting): my global_id is 224144 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.927+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ec40065d0 con 0x7f0ec4009110 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3387581678 0 0) 0x7f0ec40065d0 con 0x7f0ec4009110 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ec4009e50 con 0x7f0ec4009110 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ed0003c50 con 0x7f0ec4009110 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 10 monclient: dump: 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:02.928 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1745714037 0 0) 0x7f0ec4009e50 con 0x7f0ec4009110 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ec400c3e0 con 0x7f0ec4009110 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 3326199924) 0x7f0ed0003ec0 con 0x7f0ec4009110 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:02.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.106:6793/0 conn(0x7f0ec4009110 legacy=0x7f0ec40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ed6ffd640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.106:6793/0 conn(0x7f0ec4009110 legacy=0x7f0ec40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:02.930 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:02.930 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:02.930 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:02.930 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 16163, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:02.931 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.932 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.933 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:02.934 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:02.935 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:02.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:02.937 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:02.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:02.942 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:02.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.944 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:02.944 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.945 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:02.945 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.945 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.946 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:02.946 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:02.946 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.947 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:02.947 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.947 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:02.948 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.948 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.948 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:02.949 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:02.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.950 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:02.950 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.951 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:02.951 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.951 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.951 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:02.952 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:02.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:02.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:02.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.953 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:02.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:02.953 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:02.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.954 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:02.954 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:02.954 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:02.954 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:02.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.955 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:02.955 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:02.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.955 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.955 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.956 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:02.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.956 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:02.956 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:02.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:02.956 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:02.957 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:02.957 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:02.957 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:02.957 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:02.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:02.957 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:02.958 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:02.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.171:6812/722422047 conn(0x7f0ec0037e20 legacy=0x7f0ec003a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 10 monclient: shutdown 2024-04-26T00:05:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 >> v1:172.21.15.106:6793/0 conn(0x7f0ee01b21d0 legacy=0x7f0ee01d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0eded9d640 1 -- 172.21.15.106:0/558872481 reap_dead start 2024-04-26T00:05:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0eded9d640 1 -- 172.21.15.106:0/558872481 reap_dead start 2024-04-26T00:05:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 shutdown_connections 2024-04-26T00:05:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 >> 172.21.15.106:0/558872481 conn(0x7f0ee006b210 msgr2=0x7f0ee009f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 shutdown_connections 2024-04-26T00:05:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:02.931+0000 7f0ee4ac9640 1 -- 172.21.15.106:0/558872481 wait complete. 2024-04-26T00:05:02.963 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:02.963 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:05:02.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:05:03.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient: get_monmap_and_config 2024-04-26T00:05:03.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient: monmap: 2024-04-26T00:05:03.075 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.075 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:03.100802+0000 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:03.100802+0000 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.076 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.077 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 1 Processor -- start 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 1 -- start start 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient: init 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient: _add_conns ranks=[8,4,1,6,5,0,7,3,2] 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient(hunting): picked mon.noname-e con 0x7fc318137730 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.095+0000 7fc320108640 10 monclient(hunting): picked mon.noname-c con 0x7fc3180a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient(hunting): picked mon.noname-f con 0x7fc318138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3180a2750 con 0x7fc318138220 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3180a2a30 con 0x7fc3180a0b20 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3180a2d10 con 0x7fc318137730 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient(hunting): authenticate will time out at 1558.628129s 2024-04-26T00:05:03.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31dea4640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc318137730 0x7fc318137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:34074/0 (socket says 172.21.15.106:34074) 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31dea4640 1 -- 172.21.15.106:0/1230078182 learned_addr learned my addr 172.21.15.106:0/1230078182 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4013138608 0 0) 0x7fc3180a2d10 con 0x7fc318137730 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): my global_id is 224153 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc304003530 con 0x7fc318137730 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3548621235 0 0) 0x7fc3180a2a30 con 0x7fc3180a0b20 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient(hunting): my global_id is 145849 2024-04-26T00:05:03.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3180a2d10 con 0x7fc3180a0b20 2024-04-26T00:05:03.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2290354830 0 0) 0x7fc3180a2d10 con 0x7fc3180a0b20 2024-04-26T00:05:03.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 >> v1:172.21.15.106:6793/0 conn(0x7fc318137730 legacy=0x7fc318137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 >> v1:172.21.15.171:6789/0 conn(0x7fc318138220 legacy=0x7fc318140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 monclient: found mon.noname-c 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3180a4680 con 0x7fc3180a0b20 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3080017c0 con 0x7fc3180a0b20 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: dump: 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.088 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 5 monclient: authenticate success, global_id 145849 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc308001a20 con 0x7fc3180a0b20 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 1 -- 172.21.15.106:0/1230078182 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc308003960 con 0x7fc3180a0b20 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc31cea2640 10 monclient: dump: 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.090 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 4 set_mon_vals no callback set 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient: shutdown 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- 172.21.15.106:0/1230078182 >> v1:172.21.15.106:6791/0 conn(0x7fc3180a0b20 legacy=0x7fc31813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- 172.21.15.106:0/1230078182 shutdown_connections 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- 172.21.15.106:0/1230078182 >> 172.21.15.106:0/1230078182 conn(0x7fc3180a6b80 msgr2=0x7fc3180a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- 172.21.15.106:0/1230078182 shutdown_connections 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- 172.21.15.106:0/1230078182 wait complete. 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient: monmap: 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.092 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 Processor -- start 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 1 -- start start 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient: init 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.099+0000 7fc320108640 10 monclient: _add_conns ranks=[5,8,3,7,6,0,1,2,4] 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient(hunting): picked mon.noname-h con 0x7fc3180a0b20 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient(hunting): picked mon.noname-e con 0x7fc318137730 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient(hunting): picked mon.noname-g con 0x7fc318138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc31809cf50 con 0x7fc318138220 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3180a1e20 con 0x7fc3180a0b20 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3180a19d0 con 0x7fc318137730 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient(hunting): authenticate will time out at 1558.632082s 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc31d6a3640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc318137730 0x7fc3181346f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:34080/0 (socket says 172.21.15.106:34080) 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc31d6a3640 1 -- 172.21.15.106:0/3778688668 learned_addr learned my addr 172.21.15.106:0/3778688668 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4167144041 0 0) 0x7fc3180a19d0 con 0x7fc318137730 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): my global_id is 224162 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2fc003530 con 0x7fc318137730 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3126095176 0 0) 0x7fc2fc003530 con 0x7fc318137730 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3180a19d0 con 0x7fc318137730 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc308003940 con 0x7fc318137730 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.095 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2435787560 0 0) 0x7fc31809cf50 con 0x7fc318138220 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): my global_id is 214338 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2fc003530 con 0x7fc318138220 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1913240725 0 0) 0x7fc3180a19d0 con 0x7fc318137730 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.171:6791/0 conn(0x7fc3180a0b20 legacy=0x7fc318133fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.171:6790/0 conn(0x7fc318138220 legacy=0x7fc3181d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 monclient: found mon.e 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31809cc70 con 0x7fc318137730 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 5 monclient: authenticate success, global_id 224162 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient: _renew_subs 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc31809b950 con 0x7fc318137730 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient: _renew_subs 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fc318134fd0 con 0x7fc318137730 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc308001a20 con 0x7fc318137730 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc308004070 con 0x7fc318137730 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:03.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30ffff640 4 set_mon_vals no callback set 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: dump: 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3000065d0 con 0x7fc300002870 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc308004210 con 0x7fc318137730 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fc308045250 con 0x7fc318137730 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc31e6a5640 10 monclient: get_auth_request con 0x7fc2fc037840 auth_method 0 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1815739187 0 0) 0x7fc3000065d0 con 0x7fc300002870 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient(hunting): my global_id is 224173 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3180a19d0 con 0x7fc300002870 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 592257044 0 0) 0x7fc3180a19d0 con 0x7fc300002870 2024-04-26T00:05:03.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3000065d0 con 0x7fc300002870 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc310001740 con 0x7fc300002870 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 10 monclient: dump: 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.101 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3003540305 0 0) 0x7fc3000065d0 con 0x7fc300002870 2024-04-26T00:05:03.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.103+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc30000a160 con 0x7fc300002870 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.107+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc310001b10 con 0x7fc300002870 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.107+0000 7fc30e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.107+0000 7fc30e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.107+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.171:6789/0 conn(0x7fc300002870 legacy=0x7fc300004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.107+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.171:6789/0 conn(0x7fc300002870 legacy=0x7fc300004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc320108640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc300009e50 con 0x7fc300009110 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 738268444 0 0) 0x7fc300009e50 con 0x7fc300009110 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc30e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc30e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc30e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc30e7fc640 10 monclient(hunting): my global_id is 224182 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.111+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3000065d0 con 0x7fc300009110 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1585058253 0 0) 0x7fc3000065d0 con 0x7fc300009110 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc300009e50 con 0x7fc300009110 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3100050a0 con 0x7fc300009110 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 10 monclient: dump: 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.105 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1490248864 0 0) 0x7fc300009e50 con 0x7fc300009110 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc30000c3e0 con 0x7fc300009110 2024-04-26T00:05:03.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 85125703) 0x7fc310007410 con 0x7fc300009110 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.171:6789/0 conn(0x7fc300009110 legacy=0x7fc3000095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc30e7fc640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.171:6789/0 conn(0x7fc300009110 legacy=0x7fc3000095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 16351, 2024-04-26T00:05:03.107 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:03.108 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:03.109 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:03.110 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.111 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.112 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:03.114 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.116 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.117 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:03.119 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.121 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.122 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.124 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:03.125 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:03.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.171:6812/722422047 conn(0x7fc2fc037840 legacy=0x7fc2fc039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 10 monclient: shutdown 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 >> v1:172.21.15.106:6793/0 conn(0x7fc318137730 legacy=0x7fc3181346f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc31e6a5640 1 -- 172.21.15.106:0/3778688668 reap_dead start 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc31e6a5640 1 -- 172.21.15.106:0/3778688668 reap_dead start 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 shutdown_connections 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 >> 172.21.15.106:0/3778688668 conn(0x7fc3180a6b80 msgr2=0x7fc3180a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 shutdown_connections 2024-04-26T00:05:03.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.115+0000 7fc320108640 1 -- 172.21.15.106:0/3778688668 wait complete. 2024-04-26T00:05:03.127 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:03.128 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:05:03.128 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:05:03.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient: get_monmap_and_config 2024-04-26T00:05:03.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient: monmap: 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:03.264028+0000 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:03.264028+0000 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.239 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.240 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.240 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 1 Processor -- start 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 1 -- start start 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient: init 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient: _add_conns ranks=[4,2,3,0,1,7,5,6,8] 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient(hunting): picked mon.noname-c con 0x7f345c0a4f60 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient(hunting): picked mon.noname-b con 0x7f345c0a4680 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient(hunting): picked mon.noname-g con 0x7f345c13e060 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a5a50 con 0x7f345c0a4680 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a2610 con 0x7f345c13e060 2024-04-26T00:05:03.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f345a59c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f345c0a4f60 0x7f345c0a5340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48308/0 (socket says 172.21.15.106:48308) 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f345a59c640 1 -- 172.21.15.106:0/3025131490 learned_addr learned my addr 172.21.15.106:0/3025131490 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 1 -- 172.21.15.106:0/3025131490 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a3e30 con 0x7f345c0a4f60 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.259+0000 7f3460de8640 10 monclient(hunting): authenticate will time out at 1558.791779s 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208080774 0 0) 0x7f3444001050 con 0x7f345c0a4680 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): my global_id is 7292 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3448003530 con 0x7f345c0a4680 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520246561 0 0) 0x7f345c0a3e30 con 0x7f345c0a4f60 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient(hunting): my global_id is 145858 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3444001050 con 0x7f345c0a4f60 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1566386745 0 0) 0x7f3448003530 con 0x7f345c0a4680 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 >> v1:172.21.15.106:6791/0 conn(0x7f345c0a4f60 legacy=0x7f345c0a5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 >> v1:172.21.15.171:6790/0 conn(0x7f345c13e060 legacy=0x7f345c140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 monclient: found mon.noname-b 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c0a1310 con 0x7f345c0a4680 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f34440018c0 con 0x7f345c0a4680 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: dump: 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.246 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 5 monclient: authenticate success, global_id 7292 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3444001b20 con 0x7f345c0a4680 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 1 -- 172.21.15.106:0/3025131490 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3444001d50 con 0x7f345c0a4680 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3459d9b640 10 monclient: dump: 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.247 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:03.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 4 set_mon_vals no callback set 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: shutdown 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- 172.21.15.106:0/3025131490 >> v1:172.21.15.106:6790/0 conn(0x7f345c0a4680 legacy=0x7f345c13c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- 172.21.15.106:0/3025131490 shutdown_connections 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- 172.21.15.106:0/3025131490 >> 172.21.15.106:0/3025131490 conn(0x7f345c0a9c80 msgr2=0x7f345c0aa090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- 172.21.15.106:0/3025131490 shutdown_connections 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- 172.21.15.106:0/3025131490 wait complete. 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: monmap: 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:03.249 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 Processor -- start 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- start start 2024-04-26T00:05:03.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: init 2024-04-26T00:05:03.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: _add_conns ranks=[1,0,4,6,3,7,8,5,2] 2024-04-26T00:05:03.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient(hunting): picked mon.noname-f con 0x7f345c0a4680 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:03.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient(hunting): picked mon.noname-a con 0x7f345c0a4f60 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:03.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient(hunting): picked mon.noname-c con 0x7f345c13e060 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:03.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c09f660 con 0x7f345c0a4f60 2024-04-26T00:05:03.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a40e0 con 0x7f345c0a4680 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f345c0a1b90 con 0x7f345c13e060 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient(hunting): authenticate will time out at 1558.794820s 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3453fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f345c0a4f60 0x7f345c1d1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57338/0 (socket says 172.21.15.106:57338) 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f345ad9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f345c13e060 0x7f345c1d4da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48322/0 (socket says 172.21.15.106:48322) 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3453fff640 1 -- 172.21.15.106:0/3543689484 learned_addr learned my addr 172.21.15.106:0/3543689484 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3146697821 0 0) 0x7f345c0a1b90 con 0x7f345c13e060 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): my global_id is 145867 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f343c003530 con 0x7f345c13e060 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1915855548 0 0) 0x7f345c09f660 con 0x7f345c0a4f60 2024-04-26T00:05:03.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): my global_id is 7479 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345c0a1b90 con 0x7f345c0a4f60 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 996456319 0 0) 0x7f343c003530 con 0x7f345c13e060 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f345c09f660 con 0x7f345c13e060 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3454001cc0 con 0x7f345c13e060 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): dump: 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.258 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025843002 0 0) 0x7f345c0a40e0 con 0x7f345c0a4680 2024-04-26T00:05:03.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): my global_id is 224191 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f343c003530 con 0x7f345c0a4680 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1215671242 0 0) 0x7f345c0a1b90 con 0x7f345c0a4f60 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f345c0a40e0 con 0x7f345c0a4f60 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f34440017c0 con 0x7f345c0a4f60 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient(hunting): dump: 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.260 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.261 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 215294711 0 0) 0x7f345c09f660 con 0x7f345c13e060 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.171:6789/0 conn(0x7f345c0a4680 legacy=0x7f345c1337c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.106:6789/0 conn(0x7f345c0a4f60 legacy=0x7f345c1d1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 monclient: found mon.c 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345c09d300 con 0x7f345c13e060 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3452ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 5 monclient: authenticate success, global_id 145867 2024-04-26T00:05:03.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: _renew_subs 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f345c09f380 con 0x7f345c13e060 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: _renew_subs 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.263+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f345c09dba0 con 0x7f345c13e060 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3454002090 con 0x7f345c13e060 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3454003f90 con 0x7f345c13e060 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f345959a640 4 set_mon_vals no callback set 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: dump: 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.263 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3460de8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34400065d0 con 0x7f3440002870 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f34540041b0 con 0x7f345c13e060 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f34540453c0 con 0x7f345c13e060 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3453fff640 10 monclient: get_auth_request con 0x7f343c037f90 auth_method 0 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1812486125 0 0) 0x7f34400065d0 con 0x7f3440002870 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient(hunting): my global_id is 214356 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f345c09f660 con 0x7f3440002870 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1504587041 0 0) 0x7f345c09f660 con 0x7f3440002870 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34400065d0 con 0x7f3440002870 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f344c001910 con 0x7f3440002870 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: dump: 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.266 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 554722663 0 0) 0x7f34400065d0 con 0x7f3440002870 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f344000a160 con 0x7f3440002870 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f344c001d00 con 0x7f3440002870 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.171:6790/0 conn(0x7f3440002870 legacy=0x7f3440004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.267+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.171:6790/0 conn(0x7f3440002870 legacy=0x7f3440004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f344000c4f0 con 0x7f34400090b0 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3512780673 0 0) 0x7f344000c4f0 con 0x7f34400090b0 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient(hunting): my global_id is 214365 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34400065d0 con 0x7f34400090b0 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 424437718 0 0) 0x7f34400065d0 con 0x7f34400090b0 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f344000c4f0 con 0x7f34400090b0 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f344c004de0 con 0x7f34400090b0 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient: dump: 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.268 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 457185505 0 0) 0x7f344000c4f0 con 0x7f34400090b0 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3440009c90 con 0x7f34400090b0 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1187155937) 0x7f344c007150 con 0x7f34400090b0 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.171:6790/0 conn(0x7f34400090b0 legacy=0x7f3440009540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3452ffd640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.171:6790/0 conn(0x7f34400090b0 legacy=0x7f3440009540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 133698, 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:03.270 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.271 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.272 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:03.273 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.274 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:03.275 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.277 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:03.279 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.280 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:03.281 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.283 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.284 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.285 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.286 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:03.287 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.171:6812/722422047 conn(0x7f343c037f90 legacy=0x7f343c03a450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 10 monclient: shutdown 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 >> v1:172.21.15.106:6791/0 conn(0x7f345c13e060 legacy=0x7f345c1d4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f345ad9d640 1 -- 172.21.15.106:0/3543689484 reap_dead start 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f345ad9d640 1 -- 172.21.15.106:0/3543689484 reap_dead start 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 shutdown_connections 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 >> 172.21.15.106:0/3543689484 conn(0x7f345c0a9c80 msgr2=0x7f345c136970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 shutdown_connections 2024-04-26T00:05:03.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.275+0000 7f3460de8640 1 -- 172.21.15.106:0/3543689484 wait complete. 2024-04-26T00:05:03.290 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:03.290 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:05:03.290 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:05:03.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: get_monmap_and_config 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: monmap: 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:03.427213+0000 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:03.427213+0000 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.402 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.403 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.403 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.403 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.403 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.403 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 Processor -- start 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- start start 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: init 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: _add_conns ranks=[5,8,1,6,7,3,4,2,0] 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient(hunting): picked mon.noname-h con 0x7f50dc137730 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient(hunting): picked mon.noname-e con 0x7f50dc0a0b20 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:03.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient(hunting): picked mon.noname-f con 0x7f50dc138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50dc0a2750 con 0x7f50dc138220 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50dc0a2a30 con 0x7f50dc137730 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50dc0a2d10 con 0x7f50dc0a0b20 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient(hunting): authenticate will time out at 1558.954266s 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e135f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f50dc0a0b20 0x7f50dc13ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:34084/0 (socket says 172.21.15.106:34084) 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e135f640 1 -- 172.21.15.106:0/1253985999 learned_addr learned my addr 172.21.15.106:0/1253985999 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997819498 0 0) 0x7f50dc0a2d10 con 0x7f50dc0a0b20 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient(hunting): my global_id is 224180 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c8003530 con 0x7f50dc0a0b20 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 561299535 0 0) 0x7f50c8003530 con 0x7f50dc0a0b20 2024-04-26T00:05:03.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 >> v1:172.21.15.171:6791/0 conn(0x7f50dc137730 legacy=0x7f50dc137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 >> v1:172.21.15.171:6789/0 conn(0x7f50dc138220 legacy=0x7f50dc140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 monclient: found mon.noname-e 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc0a4680 con 0x7f50dc0a0b20 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50cc0017c0 con 0x7f50dc0a0b20 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: dump: 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.412 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 5 monclient: authenticate success, global_id 224180 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50cc001b20 con 0x7f50dc0a0b20 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 1 -- 172.21.15.106:0/1253985999 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50cc001d50 con 0x7f50dc0a0b20 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 4 set_mon_vals no callback set 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e0b5e640 10 monclient: dump: 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.414 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 10 monclient: shutdown 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- 172.21.15.106:0/1253985999 >> v1:172.21.15.106:6793/0 conn(0x7f50dc0a0b20 legacy=0x7f50dc13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- 172.21.15.106:0/1253985999 shutdown_connections 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- 172.21.15.106:0/1253985999 >> 172.21.15.106:0/1253985999 conn(0x7f50dc0a6b80 msgr2=0x7f50dc0a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- 172.21.15.106:0/1253985999 shutdown_connections 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.423+0000 7f50e3dc4640 1 -- 172.21.15.106:0/1253985999 wait complete. 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: monmap: 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 Processor -- start 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 -- start start 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: init 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: _add_conns ranks=[3,2,7,8,4,0,6,1,5] 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient(hunting): picked mon.noname-g con 0x7f50dc0a0b20 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient(hunting): picked mon.noname-b con 0x7f50dc137730 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient(hunting): picked mon.noname-i con 0x7f50dc138220 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:03.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50dc130710 con 0x7f50dc137730 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50dc132bb0 con 0x7f50dc0a0b20 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50dc0a0300 con 0x7f50dc138220 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient(hunting): authenticate will time out at 1558.957134s 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e135f640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f50dc137730 0x7f50dc130000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:33810/0 (socket says 172.21.15.106:33810) 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e135f640 1 -- 172.21.15.106:0/3252997739 learned_addr learned my addr 172.21.15.106:0/3252997739 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1257694237 0 0) 0x7f50dc130710 con 0x7f50dc137730 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): my global_id is 7301 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c0003530 con 0x7f50dc137730 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3308343100 0 0) 0x7f50c0003530 con 0x7f50dc137730 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50dc130710 con 0x7f50dc137730 2024-04-26T00:05:03.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50cc001780 con 0x7f50dc137730 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): dump: 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.419 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2949648323 0 0) 0x7f50dc0a0300 con 0x7f50dc138220 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): my global_id is 145744 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c0003530 con 0x7f50dc138220 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 614450989 0 0) 0x7f50dc132bb0 con 0x7f50dc0a0b20 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): my global_id is 214374 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50dc0a0300 con 0x7f50dc0a0b20 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1533364797 0 0) 0x7f50dc130710 con 0x7f50dc137730 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.171:6792/0 conn(0x7f50dc138220 legacy=0x7f50dc1d4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.171:6790/0 conn(0x7f50dc0a0b20 legacy=0x7f50dc12f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 monclient: found mon.b 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50dc131f00 con 0x7f50dc137730 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 5 monclient: authenticate success, global_id 7301 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: _renew_subs 2024-04-26T00:05:03.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50dc1317a0 con 0x7f50dc137730 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: _renew_subs 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f50dc1331a0 con 0x7f50dc137730 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50cc001070 con 0x7f50dc137730 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50cc0053d0 con 0x7f50dc137730 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d3fff640 4 set_mon_vals no callback set 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient: dump: 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.422 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50c40065d0 con 0x7f50c4002870 2024-04-26T00:05:03.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f50cc0101f0 con 0x7f50dc137730 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f50cc0452f0 con 0x7f50dc137730 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1180898919 0 0) 0x7f50c40065d0 con 0x7f50c4002870 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 10 monclient(hunting): my global_id is 7313 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50dc130710 con 0x7f50c4002870 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.427+0000 7f50e2361640 10 monclient: get_auth_request con 0x7f50c0037930 auth_method 0 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1273518307 0 0) 0x7f50dc130710 con 0x7f50c4002870 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50c40065d0 con 0x7f50c4002870 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50d8001930 con 0x7f50c4002870 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 10 monclient: dump: 2024-04-26T00:05:03.424 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3062512100 0 0) 0x7f50c40065d0 con 0x7f50c4002870 2024-04-26T00:05:03.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50c400a160 con 0x7f50c4002870 2024-04-26T00:05:03.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f50d8001d30 con 0x7f50c4002870 2024-04-26T00:05:03.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:03.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.171:6791/0 conn(0x7f50c4002870 legacy=0x7f50c4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.431+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.171:6791/0 conn(0x7f50c4002870 legacy=0x7f50c4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.435+0000 7f50e3dc4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:03.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.435+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50c4009e50 con 0x7f50c4009110 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3023893553 0 0) 0x7f50c4009e50 con 0x7f50c4009110 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient(hunting): my global_id is 7322 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50c40065d0 con 0x7f50c4009110 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3931829030 0 0) 0x7f50c40065d0 con 0x7f50c4009110 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50c4009e50 con 0x7f50c4009110 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50d8003b30 con 0x7f50c4009110 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient: dump: 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2324696262 0 0) 0x7f50c4009e50 con 0x7f50c4009110 2024-04-26T00:05:03.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f50c400c3e0 con 0x7f50c4009110 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2716817907) 0x7f50d8004fc0 con 0x7f50c4009110 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.171:6791/0 conn(0x7f50c4009110 legacy=0x7f50c40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50d27fc640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.171:6791/0 conn(0x7f50c4009110 legacy=0x7f50c40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:03.430 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 621942, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.431 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:03.432 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:03.433 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:03.434 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.435 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:03.435 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.435 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.435 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.438 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.439 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.440 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:03.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.443 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:03.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.449 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.450 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:03.451 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.171:6812/722422047 conn(0x7f50c0037930 legacy=0x7f50c0039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 10 monclient: shutdown 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 >> v1:172.21.15.106:6790/0 conn(0x7f50dc137730 legacy=0x7f50dc130000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e2361640 1 -- 172.21.15.106:0/3252997739 reap_dead start 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e2361640 1 -- 172.21.15.106:0/3252997739 reap_dead start 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 shutdown_connections 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 >> 172.21.15.106:0/3252997739 conn(0x7f50dc0a6b80 msgr2=0x7f50dc12e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 shutdown_connections 2024-04-26T00:05:03.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.439+0000 7f50e3dc4640 1 -- 172.21.15.106:0/3252997739 wait complete. 2024-04-26T00:05:03.454 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:03.454 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:05:03.454 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.591+0000 7f614a378640 10 monclient: get_monmap_and_config 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.591+0000 7f614a378640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.591+0000 7f614a378640 10 monclient: monmap: 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:03.598164+0000 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:03.598164+0000 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.573 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.574 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 Processor -- start 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- start start 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: init 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: _add_conns ranks=[0,7,1,8,6,3,2,4,5] 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient(hunting): picked mon.noname-a con 0x7f6144135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient(hunting): picked mon.noname-i con 0x7f61441353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient(hunting): picked mon.noname-f con 0x7f614413bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614406f2d0 con 0x7f6144135870 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6144072330 con 0x7f614413bdf0 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6144072610 con 0x7f61441353b0 2024-04-26T00:05:03.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient(hunting): authenticate will time out at 1559.125273s 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6143fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6144135870 0x7f6144135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57340/0 (socket says 172.21.15.106:57340) 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6143fff640 1 -- 172.21.15.106:0/2830092856 learned_addr learned my addr 172.21.15.106:0/2830092856 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3475136376 0 0) 0x7f614406f2d0 con 0x7f6144135870 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient(hunting): my global_id is 7488 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f612c003530 con 0x7f6144135870 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3861383848 0 0) 0x7f612c003530 con 0x7f6144135870 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 >> v1:172.21.15.171:6792/0 conn(0x7f61441353b0 legacy=0x7f614413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 >> v1:172.21.15.171:6789/0 conn(0x7f614413bdf0 legacy=0x7f614413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 monclient: found mon.noname-a 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61440a3260 con 0x7f6144135870 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 5 monclient: authenticate success, global_id 7488 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61340017c0 con 0x7f6144135870 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: dump: 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.587 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6134001ab0 con 0x7f6144135870 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 1 -- 172.21.15.106:0/2830092856 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134004bf0 con 0x7f6144135870 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 4 set_mon_vals no callback set 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f6142ffd640 10 monclient: dump: 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.589 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: shutdown 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- 172.21.15.106:0/2830092856 >> v1:172.21.15.106:6789/0 conn(0x7f6144135870 legacy=0x7f6144135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- 172.21.15.106:0/2830092856 shutdown_connections 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- 172.21.15.106:0/2830092856 >> 172.21.15.106:0/2830092856 conn(0x7f61440a64e0 msgr2=0x7f61440a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- 172.21.15.106:0/2830092856 shutdown_connections 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- 172.21.15.106:0/2830092856 wait complete. 2024-04-26T00:05:03.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: monmap: 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 Processor -- start 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 1 -- start start 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.595+0000 7f614a378640 10 monclient: init 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient: _add_conns ranks=[3,5,7,8,6,4,0,1,2] 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient(hunting): picked mon.noname-g con 0x7f61441353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient(hunting): picked mon.noname-h con 0x7f6144135870 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient(hunting): picked mon.noname-i con 0x7f614413bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:03.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61441348d0 con 0x7f61441353b0 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614409f470 con 0x7f6144135870 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614409f930 con 0x7f614413bdf0 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient(hunting): authenticate will time out at 1559.128268s 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f61437fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f6144135870 0x7f61441341c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:44418/0 (socket says 172.21.15.106:44418) 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f61437fe640 1 -- 172.21.15.106:0/22558289 learned_addr learned my addr 172.21.15.106:0/22558289 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931674992 0 0) 0x7f614409f470 con 0x7f6144135870 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): my global_id is 7331 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6130003530 con 0x7f6144135870 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12466080 0 0) 0x7f61441348d0 con 0x7f61441353b0 2024-04-26T00:05:03.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): my global_id is 214383 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f614409f470 con 0x7f61441353b0 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 925913175 0 0) 0x7f614409f930 con 0x7f614413bdf0 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): my global_id is 145753 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61441348d0 con 0x7f614413bdf0 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2954448079 0 0) 0x7f6130003530 con 0x7f6144135870 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f614409f930 con 0x7f6144135870 2024-04-26T00:05:03.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6138001b20 con 0x7f6144135870 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): dump: 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.595 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1292265436 0 0) 0x7f614409f470 con 0x7f61441353b0 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6130003530 con 0x7f61441353b0 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1313318724 0 0) 0x7f61441348d0 con 0x7f614413bdf0 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f614409f470 con 0x7f614413bdf0 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f613c001bf0 con 0x7f614413bdf0 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): dump: 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.596 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.597 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134001780 con 0x7f61441353b0 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): dump: 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.598 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1165541838 0 0) 0x7f614409f930 con 0x7f6144135870 2024-04-26T00:05:03.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6792/0 conn(0x7f614413bdf0 legacy=0x7f61441d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6790/0 conn(0x7f61441353b0 legacy=0x7f6144133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 monclient: found mon.h 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61441350c0 con 0x7f6144135870 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 5 monclient: authenticate success, global_id 7331 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient: _renew_subs 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f61440702c0 con 0x7f6144135870 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient: _renew_subs 2024-04-26T00:05:03.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f614406ff00 con 0x7f6144135870 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6138001cc0 con 0x7f6144135870 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6138003c10 con 0x7f6144135870 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f61427fc640 4 set_mon_vals no callback set 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: dump: 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.601 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f61240065d0 con 0x7f6124002870 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3062855125 0 0) 0x7f61240065d0 con 0x7f6124002870 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient(hunting): my global_id is 145762 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f614409f930 con 0x7f6124002870 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3197304986 0 0) 0x7f614409f930 con 0x7f6124002870 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61240065d0 con 0x7f6124002870 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134004f00 con 0x7f6124002870 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 10 monclient: dump: 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.603 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.604 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.599+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6138003db0 con 0x7f6144135870 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f6138045120 con 0x7f6144135870 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 942204844 0 0) 0x7f61240065d0 con 0x7f6124002870 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f612400a160 con 0x7f6124002870 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6148915640 10 monclient: get_auth_request con 0x7f6130038020 auth_method 0 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f61340051d0 con 0x7f6124002870 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6792/0 conn(0x7f6124002870 legacy=0x7f6124004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.603+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6792/0 conn(0x7f6124002870 legacy=0x7f6124004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.607+0000 7f614a378640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.607+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6124009e60 con 0x7f6124009120 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1136253555 0 0) 0x7f6124009e60 con 0x7f6124009120 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient(hunting): my global_id is 145771 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61240065d0 con 0x7f6124009120 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3501997269 0 0) 0x7f61240065d0 con 0x7f6124009120 2024-04-26T00:05:03.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6124009e60 con 0x7f6124009120 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134005a50 con 0x7f6124009120 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient: dump: 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.608 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1694297146 0 0) 0x7f6124009e60 con 0x7f6124009120 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f612400c3e0 con 0x7f6124009120 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 424550791) 0x7f6134007eb0 con 0x7f6124009120 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:03.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6792/0 conn(0x7f6124009120 legacy=0x7f61240095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6140ff9640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6792/0 conn(0x7f6124009120 legacy=0x7f61240095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 367144, 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:03.610 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:03.611 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:03.612 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:03.613 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:03.614 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.615 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.618 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.619 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.623 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.624 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.625 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:03.626 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:03.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:03.629 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:03.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:03.629 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:03.629 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6812/722422047 conn(0x7f6130038020 legacy=0x7f613003a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 10 monclient: shutdown 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 >> v1:172.21.15.171:6791/0 conn(0x7f6144135870 legacy=0x7f61441341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6148915640 1 -- 172.21.15.106:0/22558289 reap_dead start 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f6148915640 1 -- 172.21.15.106:0/22558289 reap_dead start 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 shutdown_connections 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 >> 172.21.15.106:0/22558289 conn(0x7f61440a64e0 msgr2=0x7f61440a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 shutdown_connections 2024-04-26T00:05:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.611+0000 7f614a378640 1 -- 172.21.15.106:0/22558289 wait complete. 2024-04-26T00:05:03.631 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:03.632 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:05:03.632 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:05:03.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient: get_monmap_and_config 2024-04-26T00:05:03.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient: monmap: 2024-04-26T00:05:03.751 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.751 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.751 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:03.775640+0000 2024-04-26T00:05:03.751 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:03.775640+0000 2024-04-26T00:05:03.751 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.752 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.752 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.752 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.752 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.752 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.753 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.753 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.753 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.753 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.753 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.753 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 1 Processor -- start 2024-04-26T00:05:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 1 -- start start 2024-04-26T00:05:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient: init 2024-04-26T00:05:03.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient: _add_conns ranks=[5,7,4,6,3,0,2,8,1] 2024-04-26T00:05:03.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient(hunting): picked mon.noname-h con 0x7fa3dc1311d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:03.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient(hunting): picked mon.noname-i con 0x7fa3dc09c570 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:03.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient(hunting): picked mon.noname-c con 0x7fa3dc09c970 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:03.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc09d160 con 0x7fa3dc09c970 2024-04-26T00:05:03.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc09b8b0 con 0x7fa3dc1311d0 2024-04-26T00:05:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc09bb90 con 0x7fa3dc09c570 2024-04-26T00:05:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 10 monclient(hunting): authenticate will time out at 1559.303105s 2024-04-26T00:05:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3db7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fa3dc09c970 0x7fa3dc140160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48332/0 (socket says 172.21.15.106:48332) 2024-04-26T00:05:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3db7fe640 1 -- 172.21.15.106:0/1415667490 learned_addr learned my addr 172.21.15.106:0/1415667490 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1354279191 0 0) 0x7fa3dc09d160 con 0x7fa3dc09c970 2024-04-26T00:05:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient(hunting): my global_id is 145876 2024-04-26T00:05:03.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3c8003530 con 0x7fa3dc09c970 2024-04-26T00:05:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1019808152 0 0) 0x7fa3c8003530 con 0x7fa3dc09c970 2024-04-26T00:05:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 >> v1:172.21.15.171:6792/0 conn(0x7fa3dc09c570 legacy=0x7fa3dc13ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 >> v1:172.21.15.171:6791/0 conn(0x7fa3dc1311d0 legacy=0x7fa3dc1315b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 monclient: found mon.noname-c 2024-04-26T00:05:03.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc0a6f70 con 0x7fa3dc09c970 2024-04-26T00:05:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 5 monclient: authenticate success, global_id 145876 2024-04-26T00:05:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa3d40017c0 con 0x7fa3dc09c970 2024-04-26T00:05:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3d9ffb640 10 monclient: dump: 2024-04-26T00:05:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.773 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.774 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.775 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.771+0000 7fa3e18eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3d4001b20 con 0x7fa3dc09c970 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:03.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 4 set_mon_vals no callback set 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d9ffb640 1 -- 172.21.15.106:0/1415667490 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa3d4001d50 con 0x7fa3dc09c970 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d9ffb640 10 monclient: dump: 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.777 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.778 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.779 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.779 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.779 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: shutdown 2024-04-26T00:05:03.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:03.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- 172.21.15.106:0/1415667490 >> v1:172.21.15.106:6791/0 conn(0x7fa3dc09c970 legacy=0x7fa3dc140160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- 172.21.15.106:0/1415667490 shutdown_connections 2024-04-26T00:05:03.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- 172.21.15.106:0/1415667490 >> 172.21.15.106:0/1415667490 conn(0x7fa3dc0a6220 msgr2=0x7fa3dc0a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:03.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- 172.21.15.106:0/1415667490 shutdown_connections 2024-04-26T00:05:03.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- 172.21.15.106:0/1415667490 wait complete. 2024-04-26T00:05:03.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: build_initial_monmap 2024-04-26T00:05:03.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: monmap: 2024-04-26T00:05:03.780 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:03.781 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 Processor -- start 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- start start 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: init 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: _add_conns ranks=[4,5,6,0,1,7,3,2,8] 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient(hunting): picked mon.noname-c con 0x7fa3dc09c570 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:03.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient(hunting): picked mon.noname-h con 0x7fa3dc09c970 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:03.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient(hunting): picked mon.noname-d con 0x7fa3dc1311d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:03.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc132040 con 0x7fa3dc09c570 2024-04-26T00:05:03.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc12d810 con 0x7fa3dc09c970 2024-04-26T00:05:03.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3dc12daf0 con 0x7fa3dc1311d0 2024-04-26T00:05:03.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:03.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient(hunting): authenticate will time out at 1559.306081s 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3daffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fa3dc09c570 0x7fa3dc12b050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48334/0 (socket says 172.21.15.106:48334) 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3daffd640 1 -- 172.21.15.106:0/2252078198 learned_addr learned my addr 172.21.15.106:0/2252078198 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215507181 0 0) 0x7fa3dc132040 con 0x7fa3dc09c570 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): my global_id is 145885 2024-04-26T00:05:03.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3bc003530 con 0x7fa3dc09c570 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2182604743 0 0) 0x7fa3dc12daf0 con 0x7fa3dc1311d0 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): my global_id is 7431 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3dc132040 con 0x7fa3dc1311d0 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2874197214 0 0) 0x7fa3bc003530 con 0x7fa3dc09c570 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3dc12daf0 con 0x7fa3dc09c570 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1845210343 0 0) 0x7fa3dc12d810 con 0x7fa3dc09c970 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:03.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): my global_id is 7349 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa3bc003530 con 0x7fa3dc09c970 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa3c40019b0 con 0x7fa3dc09c570 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): dump: 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.786 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2152095378 0 0) 0x7fa3dc132040 con 0x7fa3dc1311d0 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa3dc12d810 con 0x7fa3dc1311d0 2024-04-26T00:05:03.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa3d4001780 con 0x7fa3dc1311d0 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient(hunting): dump: 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.788 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.789 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.790 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.790 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1843109518 0 0) 0x7fa3dc12daf0 con 0x7fa3dc09c570 2024-04-26T00:05:03.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 >> v1:172.21.15.106:6792/0 conn(0x7fa3dc1311d0 legacy=0x7fa3dc1d4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 >> v1:172.21.15.171:6791/0 conn(0x7fa3dc09c970 legacy=0x7fa3dc12b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 monclient: found mon.c 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3dc12ddd0 con 0x7fa3dc09c570 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: _finish_auth 0 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 5 monclient: authenticate success, global_id 145885 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: _renew_subs 2024-04-26T00:05:03.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa3dc073260 con 0x7fa3dc09c570 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: _renew_subs 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa3dc0726a0 con 0x7fa3dc09c570 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa3c4001d40 con 0x7fa3dc09c570 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa3c4003c10 con 0x7fa3dc09c570 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d97fa640 4 set_mon_vals no callback set 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3d3fff640 10 monclient: dump: 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.792 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.775+0000 7fa3e18eb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.779+0000 7fa3e18eb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.779+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa3c4003db0 con 0x7fa3dc09c570 2024-04-26T00:05:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.779+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3c0005090 con 0x7fa3dc09c570 2024-04-26T00:05:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.779+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fa3c40450a0 con 0x7fa3dc09c570 2024-04-26T00:05:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.779+0000 7fa3da7fc640 10 monclient: get_auth_request con 0x7fa3bc037fd0 auth_method 0 2024-04-26T00:05:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.783+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa3c4015610 con 0x7fa3dc09c570 2024-04-26T00:05:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.783+0000 7fa3d3fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:03.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:03.783+0000 7fa3d3fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:03.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.011+0000 7fa3e18eb640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:05:03.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.011+0000 7fa3e18eb640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:05:03.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.011+0000 7fa3e18eb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:03.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.011+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa3c0005b90 con 0x7fa3dc09c570 2024-04-26T00:05:03.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3d3fff640 1 -- 172.21.15.106:0/2252078198 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fa3c40192c0 con 0x7fa3dc09c570 2024-04-26T00:05:03.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3d3fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:05:03.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3d3fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=27,config=2,health=12,kv=11,logm=48} crc {auth=1286531739,config=692619927,health=837658266,kv=1196280792,logm=194756063}) 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=27,config=2,health=12,kv=11,logm=48} crc {auth=4058120114,config=692619927,health=837658266,kv=1196280792,logm=4070186612}) 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=25,config=2,health=12,kv=11,logm=50} crc {auth=2362855892,config=692619927,health=837658266,kv=2490975962,logm=3837617038}) 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.997 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=1437197864,config=692619927,health=837658266,kv=2727743179,logm=3655891292}) 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=228823508,config=692619927,health=837658266,kv=1996692365,logm=701286180}) 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=26,config=2,health=11,kv=12,logm=49} crc {auth=1910045892,config=692619927,health=395768754,kv=3140520969,logm=2967706257}) 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.998 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=2093240324,config=692619927,health=837658266,kv=1996692365,logm=3115099253}) 2024-04-26T00:05:03.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:03.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=11,kv=11,logm=50} crc {auth=2937895241,config=692619927,health=3029971502,kv=4113770424,logm=4116187200}) 2024-04-26T00:05:03.999 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.015+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=25,config=2,health=12,kv=11,logm=50} crc {auth=2642175926,config=692619927,health=837658266,kv=2103812669,logm=1759065135}) 2024-04-26T00:05:03.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 >> v1:172.21.15.171:6812/722422047 conn(0x7fa3bc037fd0 legacy=0x7fa3bc03a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:03.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3e18eb640 10 monclient: shutdown 2024-04-26T00:05:04.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3e18eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:04.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 >> v1:172.21.15.106:6791/0 conn(0x7fa3dc09c570 legacy=0x7fa3dc12b050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:04.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 shutdown_connections 2024-04-26T00:05:04.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 >> 172.21.15.106:0/2252078198 conn(0x7fa3dc0a6220 msgr2=0x7fa3dc09f630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:04.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.015+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 shutdown_connections 2024-04-26T00:05:04.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:04.019+0000 7fa3e18eb640 1 -- 172.21.15.106:0/2252078198 wait complete. 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2880163722}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1700283419}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3039086975}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3815754974}) 2024-04-26T00:05:04.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3789410474}) 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2931840448}) 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1206569955}) 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3945657513}) 2024-04-26T00:05:04.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.023+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1009300588}) 2024-04-26T00:05:04.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3588787116}) 2024-04-26T00:05:04.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.008 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2091371511}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=722074841}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1340436995}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3311278145}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1529843158}) 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.009 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1523857219}) 2024-04-26T00:05:04.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=589793073}) 2024-04-26T00:05:04.010 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.027+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=727637582}) 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1261013987}) 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=666313213}) 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1807457735}) 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.013 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=297130571}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3321899614}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2815965482}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3251443152}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2195723425}) 2024-04-26T00:05:04.014 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.031+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2561855856}) 2024-04-26T00:05:04.015 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2137115829}) 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1612906053}) 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3488856640}) 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4007003450}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1125478112}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2227965400}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3162735718}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1065667473}) 2024-04-26T00:05:04.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.035+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3124689385}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=747096194}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3162120305}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=139774739}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1889144650}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2900641341}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1270420164}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4022108213}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1764788468}) 2024-04-26T00:05:04.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.039+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1336030315}) 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2240460635}) 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1618004783}) 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.026 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4150389866}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2247199717}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1946937689}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2056231761}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2461409003}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=463514372}) 2024-04-26T00:05:04.027 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.043+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=764529114}) 2024-04-26T00:05:04.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3676933281}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3312582608}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=479559379}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3716299755}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=358285946}) 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1800178197}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3206543214}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1162110516}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.047+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3900405742}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1153902662}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3011009021}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1578378775}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3462982248}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=561538146}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3392995623}) 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=523280822}) 2024-04-26T00:05:04.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1923105038}) 2024-04-26T00:05:04.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.051+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=623042693}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4193793427}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1326813160}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2042156064}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2804063217}) 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.043 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=71973433}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2308332033}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2007036350}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2491695338}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.055+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3110527728}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3251721293}) 2024-04-26T00:05:04.044 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1532530910}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3040970544}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3916394475}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1341315956}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1438875543}) 2024-04-26T00:05:04.045 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3294976919}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=534802897}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2297106846}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1671659141}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2239625711}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.059+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.046 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1525791470}) 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1401910215}) 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1054389373}) 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2335907929}) 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=438372522}) 2024-04-26T00:05:04.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2638436462}) 2024-04-26T00:05:04.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1594922360}) 2024-04-26T00:05:04.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1200722956}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3861334864}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1262004626}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3203018327}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=450780806}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3218903333}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=473849840}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341674823}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.063+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2248546097}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1804373145}) 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.073 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=93666378}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4058109484}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1944655744}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2084218910}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4279257997}) 2024-04-26T00:05:04.074 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3964908681}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=780823990}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.067+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1496717}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2997729437}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4243349055}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3468968763}) 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.075 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=779338794}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2692350113}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4059999691}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=318182178}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=203363576}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.071+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1542683179}) 2024-04-26T00:05:04.076 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1422025276}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=754269397}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1428757088}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3476161771}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2181481897}) 2024-04-26T00:05:04.077 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2365501850}) 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1681972393}) 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1587411204}) 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2453751038}) 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.078 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1277477956}) 2024-04-26T00:05:04.079 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.079 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2999968580}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4113548162}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.075+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3717374987}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=772485942}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3831152000}) 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.080 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2065480534}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=327538172}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1771508925}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2059266205}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2128128942}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2666779452}) 2024-04-26T00:05:04.081 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2646064981}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2801060968}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4114634609}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=893658373}) 2024-04-26T00:05:04.082 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3645964007}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.079+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2165876499}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2306909227}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1739684878}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2582820073}) 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3548337261}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2355592026}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3732429973}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2737329204}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3656156809}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.083+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1823122288}) 2024-04-26T00:05:04.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3830715738}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3674791789}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3380861104}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3567097542}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3554656100}) 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1658666212}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=832077573}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1632282294}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1568703209}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3460884628}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1931967172}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4061004555}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=712509331}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.087+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=496386788}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1597769939}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=12504767}) 2024-04-26T00:05:04.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2160688013}) 2024-04-26T00:05:04.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1454539935}) 2024-04-26T00:05:04.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.091+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2084090094}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3653222663}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1287647190}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3393716951}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3224428723}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=979257945}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2229439187}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2702455289}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=584120877}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1634775693}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=850193353}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=38465548}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2428404813}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3965435790}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1311879327}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.095+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3548369706}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=600326000}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3428636896}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=250353693}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1331700038}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1672283770}) 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3878657494}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2346259190}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1524178691}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=387458754}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738856510}) 2024-04-26T00:05:04.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.099+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2124697234}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=701315319}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2311882622}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2511132076}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=295896115}) 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=659606204}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=553959881}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=844997595}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2229036842}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.103+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1658902574}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2919196490}) 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3765148694}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2573255684}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2531176199}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=645316943}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3713427696}) 2024-04-26T00:05:04.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=253106476}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=568475662}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3070285966}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3576824015}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=385790301}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2939095248}) 2024-04-26T00:05:04.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=953501776}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1641388798}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2538536873}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1705449051}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=355056117}) 2024-04-26T00:05:04.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.107+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3229902438}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1924274447}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3109623350}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3635456784}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2952124833}) 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2953719631}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2914373409}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2164831433}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2618093923}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.111+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=661939195}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1530246835}) 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4152285691}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=343941091}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3937804185}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4161607448}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1542423779}) 2024-04-26T00:05:04.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1774143191}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3405014388}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2919939091}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2109702719}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4118772955}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2840712419}) 2024-04-26T00:05:04.139 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2906447263}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3689386229}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2030094842}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2129697792}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2041176030}) 2024-04-26T00:05:04.140 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.115+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2219437922}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1849504473}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1424852608}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=677982916}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2499956175}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.141 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2655346898}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2765312950}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1136267255}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1084968141}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.119+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1410067373}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2574921594}) 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.142 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1037379815}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2103095504}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1159675164}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2183502425}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=352112436}) 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.143 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=988763289}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861319222}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1841458656}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2955839031}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2928355615}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2153516074}) 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.144 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2863631257}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3107138793}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2493756746}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=593031057}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.123+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1347654783}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4130722967}) 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.145 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1209856829}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=853360270}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1860783419}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2673517973}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.146 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3292436714}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3617022907}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=572050958}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2676933473}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.127+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3181969754}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2057111553}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.147 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2479769659}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4000685831}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=354482556}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2606193264}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1610288959}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.148 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4085925088}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=723355321}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3208165122}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4125875190}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.131+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1736215593}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3348265543}) 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.149 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3691315030}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3610794705}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=381456741}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1461783858}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=218203516}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2543558743}) 2024-04-26T00:05:04.150 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2160276710}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1604352547}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=273220089}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=44588911}) 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.151 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=905490872}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2681069792}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1035252808}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033393236}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.135+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4152735108}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=73159380}) 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.152 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1920494006}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2477292229}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3289899355}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=884144794}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2013742568}) 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.153 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1156381019}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995731680}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.139+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1302666729}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1871173862}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1878498854}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1527646167}) 2024-04-26T00:05:04.154 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1949664788}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1365172650}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1635316627}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3530637870}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3797623282}) 2024-04-26T00:05:04.155 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.143+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3811241505}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3678365369}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3791496424}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2367416991}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=848738992}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=44707469}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1690553868}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3968547707}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3365020144}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.147+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2978310813}) 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1812914706}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=121592811}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3830236456}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1521532374}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=461872403}) 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2964098227}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1365356837}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3234921246}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2591831681}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3810373212}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4135065037}) 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4120790483}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2074264481}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3774732684}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3205218957}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=504735519}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=817860486}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.151+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1625312813}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2497160787}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=854591539}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=977930836}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2125895515}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2358670106}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4036927000}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=235279797}) 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3995300185}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.155+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3160809618}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2724215736}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1865087994}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2511721494}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1818153014}) 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2746330559}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=646364634}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2356802477}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1839332725}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3009595997}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1733347702}) 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1073176985}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2326867326}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2786734313}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1250735504}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3144352106}) 2024-04-26T00:05:04.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3184641775}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1760368937}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.159+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1858235395}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1458514230}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=273374858}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1583248930}) 2024-04-26T00:05:04.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1554627311}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3000826212}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2677070404}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1927966575}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244323197}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.163+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3158227106}) 2024-04-26T00:05:04.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2779485965}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4100747992}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2520486576}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1064965136}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=672971354}) 2024-04-26T00:05:04.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2516414882}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2137305700}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4244634099}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1018839266}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=486775312}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3416101798}) 2024-04-26T00:05:04.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1792300115}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2519485401}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4263259089}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=549929805}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.167+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1708940391}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2140859562}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2229366618}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3713514952}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2428583899}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3073500084}) 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2176634473}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2371119653}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1041008034}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2358373106}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1371222858}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.171+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=366277494}) 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3056680872}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1560400264}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2024014468}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1269502802}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3417366497}) 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3100404825}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=793088863}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3516194479}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.175+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=104189177}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1149314689}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3131590406}) 2024-04-26T00:05:04.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3468898301}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2001968909}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3850698551}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3954861401}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=11817669}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3275776369}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2861031547}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=834280173}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1920861553}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3450272827}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=153445562}) 2024-04-26T00:05:04.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2805795081}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=187594096}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.179+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2383677889}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=349819762}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1120319398}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2879117485}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=113863241}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1466431754}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1313387790}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4141634297}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2531599084}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3730030609}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3394681227}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.183+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1566512315}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4174981593}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2053858996}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3736650234}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2794724536}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3274357623}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3759213819}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3089719128}) 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1036884334}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.187+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2604852715}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1655256686}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3724882390}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3824909895}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1424476397}) 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=415687564}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=124170900}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3991913434}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1255328802}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1579545772}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3375839348}) 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2896805973}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4122983815}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3901307122}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3056892010}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=866362125}) 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2115700761}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3591907335}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.191+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4031095156}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2884864710}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1904867318}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3508629673}) 2024-04-26T00:05:04.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3999583698}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4254600593}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4127933645}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2117974112}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3432707385}) 2024-04-26T00:05:04.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.195+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3101159076}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3816995739}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3421474120}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3784717174}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2173717552}) 2024-04-26T00:05:04.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2797108447}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2194752613}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2646036637}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2957566749}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.199+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3568310798}) 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4007833011}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=754240487}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3742987517}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3903002331}) 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2841481630}) 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1510320802}) 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=107006896}) 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917608426}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=355055081}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=442713204}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3780044865}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2335553479}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=748089235}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1568732259}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4092294407}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2762726145}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2255834203}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.203+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2161576511}) 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1476049991}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2970153145}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2781161712}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1167872104}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2540467395}) 2024-04-26T00:05:04.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3015937765}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=183874853}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1187816070}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1324567021}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1718429969}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2172769073}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.207+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4225867459}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4293541705}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1576360546}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3616278750}) 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2892424506}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2034007744}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3674450657}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4038127957}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1660275615}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3030554396}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=821596274}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=65431347}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1604095398}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2337427182}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3521587446}) 2024-04-26T00:05:04.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.211+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2563467961}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=825800619}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2763472374}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1895876062}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1250420445}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.262 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2922156863}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1948546890}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3006611716}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1684829744}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.215+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2664732570}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1711351459}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.263 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=908905862}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3485253091}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3380336488}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1110326353}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=194185889}) 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.264 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2352671197}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1049299866}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=109709128}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4215114430}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3415955285}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1165139804}) 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.265 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=421883680}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1173976379}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1818549381}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=390904737}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2805441111}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.219+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4195732833}) 2024-04-26T00:05:04.266 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=699488262}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4178042292}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2473700200}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3453547204}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=800667185}) 2024-04-26T00:05:04.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=315607327}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3602782358}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2248973101}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.223+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=454780816}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3387980465}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2780346686}) 2024-04-26T00:05:04.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2121186307}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3754358884}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1332308094}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2326111449}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2285266544}) 2024-04-26T00:05:04.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927070484}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.227+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4056825417}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3570451785}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3638561188}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3905530673}) 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1104522695}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1257075259}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3231505532}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=964205803}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=573452246}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=602168780}) 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=949085910}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1225616999}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3596391502}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=346774883}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3629091046}) 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2153111344}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3423556539}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=319646867}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.231+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3740144431}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1443081158}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=496206946}) 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=312451397}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1275649046}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1605488384}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=846486440}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3481815894}) 2024-04-26T00:05:04.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2966346607}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3111611515}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2505300414}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2972638927}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2263874161}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1327293522}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2373757091}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3723304035}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3245500402}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4108944459}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.235+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3456362019}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2573436488}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1354613218}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2427151490}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1805368394}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2707739787}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3458674356}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1557521049}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2231243645}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2177373793}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=900166347}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=124401918}) 2024-04-26T00:05:04.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3584916917}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3401648894}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3031817549}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=180975218}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=15938546}) 2024-04-26T00:05:04.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2964322907}) 2024-04-26T00:05:04.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.239+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1384118577}) 2024-04-26T00:05:04.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=800540914}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2320954430}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1171565610}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1396189508}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2072198134}) 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1671964193}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2826954132}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2192659405}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2768532623}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3166121496}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.243+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3316419646}) 2024-04-26T00:05:04.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=773617636}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2598284989}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1565849484}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3629671542}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2228783683}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2376924863}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1770231530}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2166406722}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1458919272}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3292004171}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=952060170}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3927087220}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3590992173}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2287736396}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1807801149}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.247+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3223916203}) 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=48,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=8} crc {logm=2701894466,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3088216788,mon_config_key=3430297671,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=46,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=9} crc {logm=1437431240,mdsmap=2840952586,mgr=119571008,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2810830885,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1651690888}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=48,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=7} crc {logm=1511266170,mdsmap=2840952586,mgr=1156056738,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1178889788,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=4195375812}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=45,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=8} crc {logm=3628055305,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=2457790029}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=45,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=9,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=12} crc {logm=3258256788,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2595024871,mon_config_key=1722568972,monmap=375078350,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=2051646558}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=46,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=8} crc {logm=4239243793,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2357297982,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=3101620485}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=47,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=7} crc {logm=1397003480,mdsmap=2840952586,mgr=3261276571,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=4195375812}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=44,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=11} crc {logm=2593278991,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1571818931,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=1418571243}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.251+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=47,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=8} crc {logm=2406821535,mdsmap=2840952586,mgr=3822201789,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2790193341,mon_config_key=809949667,monmap=828017138,osd_metadata=2883694957,osd_pg_creating=4127804811,osdmap=1654094220}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=2574000026}) 2024-04-26T00:05:04.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2262974164}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=3340094149}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1092504969}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=721516824}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2900245784}) 2024-04-26T00:05:04.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1340445727}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=1105426921}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.255+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=1809228249}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=72} crc {osdmap=2813366524}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=75} crc {osdmap=3008298212}) 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=75} crc {osdmap=735129572}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.267+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=76} crc {osdmap=3609257534}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=75} crc {osdmap=2565093959}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=75} crc {osdmap=2639507218}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=72} crc {osdmap=2595783688}) 2024-04-26T00:05:04.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:05:04.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=73} crc {osdmap=1826243764}) 2024-04-26T00:05:04.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:05:04.271+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=72} crc {osdmap=2416930035}) 2024-04-26T00:05:05.016 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:05:05.017 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient: get_monmap_and_config 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient: monmap: 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:05.159439+0000 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:05.159439+0000 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.134 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.135 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 1 Processor -- start 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 1 -- start start 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient: init 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient: _add_conns ranks=[4,5,3,7,1,8,2,6,0] 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient(hunting): picked mon.noname-c con 0x7efca0137730 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient(hunting): picked mon.noname-h con 0x7efca00a0b20 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient(hunting): picked mon.noname-g con 0x7efca0138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca00a2750 con 0x7efca0138220 2024-04-26T00:05:05.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca00a2a30 con 0x7efca0137730 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca00a2d10 con 0x7efca00a0b20 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient(hunting): authenticate will time out at 1560.686966s 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9f7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7efca0137730 0x7efca0137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:48340/0 (socket says 172.21.15.106:48340) 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9f7fe640 1 -- 172.21.15.106:0/1338550526 learned_addr learned my addr 172.21.15.106:0/1338550526 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142661955 0 0) 0x7efca00a2a30 con 0x7efca0137730 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient(hunting): my global_id is 145894 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc8c003530 con 0x7efca0137730 2024-04-26T00:05:05.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2094759620 0 0) 0x7efc8c003530 con 0x7efca0137730 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 >> v1:172.21.15.171:6791/0 conn(0x7efca00a0b20 legacy=0x7efca013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 >> v1:172.21.15.171:6790/0 conn(0x7efca0138220 legacy=0x7efca0140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 monclient: found mon.noname-c 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca00a4680 con 0x7efca0137730 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efc900017c0 con 0x7efca0137730 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 5 monclient: authenticate success, global_id 145894 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:05.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: dump: 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.144 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc90001b20 con 0x7efca0137730 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efca6104640 4 set_mon_vals no callback set 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 1 -- 172.21.15.106:0/1338550526 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efc90001d50 con 0x7efca0137730 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.155+0000 7efc9effd640 10 monclient: dump: 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.145 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: shutdown 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/1338550526 >> v1:172.21.15.106:6791/0 conn(0x7efca0137730 legacy=0x7efca0137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/1338550526 shutdown_connections 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/1338550526 >> 172.21.15.106:0/1338550526 conn(0x7efca00a6b80 msgr2=0x7efca00a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/1338550526 shutdown_connections 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/1338550526 wait complete. 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: monmap: 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.147 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 Processor -- start 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- start start 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: init 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _add_conns ranks=[0,1,3,4,8,5,7,2,6] 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient(hunting): picked mon.noname-a con 0x7efca00a0b20 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient(hunting): picked mon.noname-f con 0x7efca0137730 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:05.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient(hunting): picked mon.noname-g con 0x7efca0138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca01c99d0 con 0x7efca00a0b20 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca00a1e20 con 0x7efca0137730 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efca009d940 con 0x7efca0138220 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient(hunting): authenticate will time out at 1560.689997s 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7efca00a0b20 0x7efca01c8bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:57362/0 (socket says 172.21.15.106:57362) 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9f7fe640 1 -- 172.21.15.106:0/2016335259 learned_addr learned my addr 172.21.15.106:0/2016335259 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 541993335 0 0) 0x7efca01c99d0 con 0x7efca00a0b20 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): my global_id is 7497 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc80003530 con 0x7efca00a0b20 2024-04-26T00:05:05.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2297891097 0 0) 0x7efc80003530 con 0x7efca00a0b20 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efca01c99d0 con 0x7efca00a0b20 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efc90001780 con 0x7efca00a0b20 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): dump: 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.150 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3758317378 0 0) 0x7efca009d940 con 0x7efca0138220 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient(hunting): my global_id is 214401 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc80003530 con 0x7efca0138220 2024-04-26T00:05:05.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2241837176 0 0) 0x7efca01c99d0 con 0x7efca00a0b20 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 >> v1:172.21.15.171:6790/0 conn(0x7efca0138220 legacy=0x7efca01d4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 >> v1:172.21.15.171:6789/0 conn(0x7efca0137730 legacy=0x7efca01c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 monclient: found mon.a 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efca009f400 con 0x7efca00a0b20 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 5 monclient: authenticate success, global_id 7497 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _renew_subs 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efca009e730 con 0x7efca00a0b20 2024-04-26T00:05:05.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _renew_subs 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7efca01d5b50 con 0x7efca00a0b20 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efc90001b20 con 0x7efca00a0b20 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efc900010b0 con 0x7efca00a0b20 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9dffb640 4 set_mon_vals no callback set 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 10 monclient: dump: 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.153 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7efc9000ff50 con 0x7efca00a0b20 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:05.154 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.159+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc84005090 con 0x7efca00a0b20 2024-04-26T00:05:05.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.163+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7efc90045320 con 0x7efca00a0b20 2024-04-26T00:05:05.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.163+0000 7efc97fff640 10 monclient: get_auth_request con 0x7efc800378e0 auth_method 0 2024-04-26T00:05:05.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.167+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7efc900159b0 con 0x7efca00a0b20 2024-04-26T00:05:05.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.167+0000 7efc9cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.167+0000 7efc9cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:05.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:05:05.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:05:05.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:05.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efc84005380 con 0x7efca00a0b20 2024-04-26T00:05:05.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efc9cff9640 1 -- 172.21.15.106:0/2016335259 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 534396730) 0x7efc900152b0 con 0x7efca00a0b20 2024-04-26T00:05:05.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efc9cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:05:05.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efc9cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:05.367 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":72,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 >> v1:172.21.15.171:6812/722422047 conn(0x7efc800378e0 legacy=0x7efc80039da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 10 monclient: shutdown 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 >> v1:172.21.15.106:6789/0 conn(0x7efca00a0b20 legacy=0x7efca01c8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.387+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 shutdown_connections 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.391+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 >> 172.21.15.106:0/2016335259 conn(0x7efca00a6b80 msgr2=0x7efca00a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.391+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 shutdown_connections 2024-04-26T00:05:05.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.391+0000 7efca6104640 1 -- 172.21.15.106:0/2016335259 wait complete. 2024-04-26T00:05:05.385 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:05:05.385 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T00:05:05.385 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:05:05.385 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:05:05.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient: get_monmap_and_config 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient: monmap: 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:05.523283+0000 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:05.523283+0000 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.498 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.499 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 1 Processor -- start 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 1 -- start start 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient: init 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient: _add_conns ranks=[6,3,4,8,0,5,7,2,1] 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient(hunting): picked mon.noname-d con 0x7f9250134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient(hunting): picked mon.noname-g con 0x7f92500a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient(hunting): picked mon.noname-c con 0x7f925013e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f925006dd40 con 0x7f92500a4820 2024-04-26T00:05:05.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92500a2b10 con 0x7f925013e200 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92500a2df0 con 0x7f9250134970 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f9254a36640 10 monclient(hunting): authenticate will time out at 1561.051198s 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924e59c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9250134970 0x7f9250134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:40130/0 (socket says 172.21.15.106:40130) 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924ed9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f925013e200 0x7f92501405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55048/0 (socket says 172.21.15.106:55048) 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924e59c640 1 -- 172.21.15.106:0/1354148744 learned_addr learned my addr 172.21.15.106:0/1354148744 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2971405925 0 0) 0x7f92500a2b10 con 0x7f925013e200 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): my global_id is 145903 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9238003530 con 0x7f925013e200 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1097225389 0 0) 0x7f92500a2df0 con 0x7f9250134970 2024-04-26T00:05:05.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 10 monclient(hunting): my global_id is 7440 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92500a2b10 con 0x7f9250134970 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.519+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 415885628 0 0) 0x7f9238003530 con 0x7f925013e200 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 >> v1:172.21.15.106:6792/0 conn(0x7f9250134970 legacy=0x7f9250134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 >> v1:172.21.15.171:6790/0 conn(0x7f92500a4820 legacy=0x7f925013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 1 monclient: found mon.noname-c 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92500a30d0 con 0x7f925013e200 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 5 monclient: authenticate success, global_id 145903 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9248001b40 con 0x7f925013e200 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: dump: 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.505 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9248001d30 con 0x7f925013e200 2024-04-26T00:05:05.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 1 -- 172.21.15.106:0/1354148744 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9248004eb0 con 0x7f925013e200 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924d59a640 10 monclient: dump: 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.507 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 4 set_mon_vals no callback set 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: shutdown 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- 172.21.15.106:0/1354148744 >> v1:172.21.15.106:6791/0 conn(0x7f925013e200 legacy=0x7f92501405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- 172.21.15.106:0/1354148744 shutdown_connections 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- 172.21.15.106:0/1354148744 >> 172.21.15.106:0/1354148744 conn(0x7f92500a9e20 msgr2=0x7f92500aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- 172.21.15.106:0/1354148744 shutdown_connections 2024-04-26T00:05:05.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- 172.21.15.106:0/1354148744 wait complete. 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: monmap: 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.509 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.510 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 Processor -- start 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- start start 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: init 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: _add_conns ranks=[1,8,2,0,6,3,7,4,5] 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient(hunting): picked mon.noname-f con 0x7f92500a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient(hunting): picked mon.noname-e con 0x7f9250134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:05.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient(hunting): picked mon.noname-b con 0x7f925013e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f92501396d0 con 0x7f92500a4820 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f925013d630 con 0x7f925013e200 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9250139e00 con 0x7f9250134970 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient(hunting): authenticate will time out at 1561.054490s 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924ed9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f925013e200 0x7f92501d4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43800/0 (socket says 172.21.15.106:43800) 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924ed9d640 1 -- 172.21.15.106:0/987981370 learned_addr learned my addr 172.21.15.106:0/987981370 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 985225168 0 0) 0x7f925013d630 con 0x7f925013e200 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): my global_id is 7310 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9230003530 con 0x7f925013e200 2024-04-26T00:05:05.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3761458878 0 0) 0x7f9250139e00 con 0x7f9250134970 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): my global_id is 224189 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f925013d630 con 0x7f9250134970 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2559232019 0 0) 0x7f9230003530 con 0x7f925013e200 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9250139e00 con 0x7f925013e200 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9248001a40 con 0x7f925013e200 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): dump: 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.518 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1636330007 0 0) 0x7f925013d630 con 0x7f9250134970 2024-04-26T00:05:05.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9230003530 con 0x7f9250134970 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1612432830 0 0) 0x7f92501396d0 con 0x7f92500a4820 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): my global_id is 224227 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f925013d630 con 0x7f92500a4820 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f92440019e0 con 0x7f9250134970 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient(hunting): dump: 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.520 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 592229067 0 0) 0x7f9250139e00 con 0x7f925013e200 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.106:6793/0 conn(0x7f9250134970 legacy=0x7f9250138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.171:6789/0 conn(0x7f92500a4820 legacy=0x7f92501388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 monclient: found mon.b 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f925013c0d0 con 0x7f925013e200 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 5 monclient: authenticate success, global_id 7310 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: _renew_subs 2024-04-26T00:05:05.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f92500a1e00 con 0x7f925013e200 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: _renew_subs 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f925013bdf0 con 0x7f925013e200 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9248001d30 con 0x7f925013e200 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f92480051b0 con 0x7f925013e200 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f924cd99640 4 set_mon_vals no callback set 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.523+0000 7f923effd640 10 monclient: dump: 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.523 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f9254a36640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92340065d0 con 0x7f9234002870 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9248005350 con 0x7f925013e200 2024-04-26T00:05:05.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f9248045410 con 0x7f925013e200 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2482600510 0 0) 0x7f92340065d0 con 0x7f9234002870 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient(hunting): my global_id is 7506 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9250139e00 con 0x7f9234002870 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1522821483 0 0) 0x7f9250139e00 con 0x7f9234002870 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92340065d0 con 0x7f9234002870 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9240001560 con 0x7f9234002870 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f924dd9b640 10 monclient: get_auth_request con 0x7f9230037e60 auth_method 0 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient: dump: 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.525 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4037819998 0 0) 0x7f92340065d0 con 0x7f9234002870 2024-04-26T00:05:05.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f923400a160 con 0x7f9234002870 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9240001560 con 0x7f9234002870 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.106:6789/0 conn(0x7f9234002870 legacy=0x7f9234004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.527+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.106:6789/0 conn(0x7f9234002870 legacy=0x7f9234004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f9254a36640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9234009e50 con 0x7f9234009110 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3828266772 0 0) 0x7f9234009e50 con 0x7f9234009110 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f923effd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f923effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f923effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f923effd640 10 monclient(hunting): my global_id is 7515 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.531+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92340065d0 con 0x7f9234009110 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2647009288 0 0) 0x7f92340065d0 con 0x7f9234009110 2024-04-26T00:05:05.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9234009e50 con 0x7f9234009110 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9240004da0 con 0x7f9234009110 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 10 monclient: dump: 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.528 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 624184370 0 0) 0x7f9234009e50 con 0x7f9234009110 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f923400c3e0 con 0x7f9234009110 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7567 (unknown 0 0 1462294015) 0x7f92400070f0 con 0x7f9234009110 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.106:6789/0 conn(0x7f9234009110 legacy=0x7f92340095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f923effd640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.106:6789/0 conn(0x7f9234009110 legacy=0x7f92340095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 624095, 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:05.530 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.531 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.532 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:05.533 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:05.534 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.535 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:05.536 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.538 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:05.539 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:05.541 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.542 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:05.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:05.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.547 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:05.548 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:05.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.171:6812/722422047 conn(0x7f9230037e60 legacy=0x7f923003a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 10 monclient: shutdown 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 >> v1:172.21.15.106:6790/0 conn(0x7f925013e200 legacy=0x7f92501d4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f924ed9d640 1 -- 172.21.15.106:0/987981370 reap_dead start 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f924ed9d640 1 -- 172.21.15.106:0/987981370 reap_dead start 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 shutdown_connections 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 >> 172.21.15.106:0/987981370 conn(0x7f92500a9e20 msgr2=0x7f9250067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 shutdown_connections 2024-04-26T00:05:05.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.535+0000 7f9254a36640 1 -- 172.21.15.106:0/987981370 wait complete. 2024-04-26T00:05:05.550 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:05.551 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:05:05.551 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: get_monmap_and_config 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: monmap: 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:05.690541+0000 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:05.690541+0000 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.665 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.666 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 Processor -- start 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- start start 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: init 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: _add_conns ranks=[6,5,0,2,4,7,3,1,8] 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient(hunting): picked mon.noname-d con 0x7f9d6c0a1290 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient(hunting): picked mon.noname-h con 0x7f9d6c09f770 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient(hunting): picked mon.noname-a con 0x7f9d6c09fb70 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c0727a0 con 0x7f9d6c09fb70 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c0724c0 con 0x7f9d6c09f770 2024-04-26T00:05:05.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c072a80 con 0x7f9d6c0a1290 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient(hunting): authenticate will time out at 1561.217610s 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6ad9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9d6c09fb70 0x7f9d6c13de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41106/0 (socket says 172.21.15.106:41106) 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6ad9d640 1 -- 172.21.15.106:0/678128766 learned_addr learned my addr 172.21.15.106:0/678128766 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6a59c640 1 --1- 172.21.15.106:0/678128766 >> v1:172.21.15.106:6792/0 conn(0x7f9d6c0a1290 0x7f9d6c0a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:40140/0 (socket says 172.21.15.106:40140) 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 351567473 0 0) 0x7f9d640014a0 con 0x7f9d6c09fb70 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): my global_id is 7524 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d54003530 con 0x7f9d6c09fb70 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1449992708 0 0) 0x7f9d6c072a80 con 0x7f9d6c0a1290 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient(hunting): my global_id is 7449 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d640014a0 con 0x7f9d6c0a1290 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3848050767 0 0) 0x7f9d54003530 con 0x7f9d6c09fb70 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 >> v1:172.21.15.106:6792/0 conn(0x7f9d6c0a1290 legacy=0x7f9d6c0a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 >> v1:172.21.15.171:6791/0 conn(0x7f9d6c09f770 legacy=0x7f9d6c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 monclient: found mon.noname-a 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c06bfc0 con 0x7f9d6c09fb70 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d64001d10 con 0x7f9d6c09fb70 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 5 monclient: authenticate success, global_id 7524 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: dump: 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.672 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d64001f70 con 0x7f9d6c09fb70 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 1 -- 172.21.15.106:0/678128766 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d64004f70 con 0x7f9d6c09fb70 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 4 set_mon_vals no callback set 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d6959a640 10 monclient: dump: 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.673 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 10 monclient: shutdown 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- 172.21.15.106:0/678128766 >> v1:172.21.15.106:6789/0 conn(0x7f9d6c09fb70 legacy=0x7f9d6c13de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- 172.21.15.106:0/678128766 shutdown_connections 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- 172.21.15.106:0/678128766 >> 172.21.15.106:0/678128766 conn(0x7f9d6c06b210 msgr2=0x7f9d6c06b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- 172.21.15.106:0/678128766 shutdown_connections 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.687+0000 7f9d70e3e640 1 -- 172.21.15.106:0/678128766 wait complete. 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: monmap: 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.675 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.676 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 Processor -- start 2024-04-26T00:05:05.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 -- start start 2024-04-26T00:05:05.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: init 2024-04-26T00:05:05.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: _add_conns ranks=[4,0,2,1,3,5,6,7,8] 2024-04-26T00:05:05.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient(hunting): picked mon.noname-c con 0x7f9d6c09f770 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient(hunting): picked mon.noname-a con 0x7f9d6c09fb70 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient(hunting): picked mon.noname-b con 0x7f9d6c0a1290 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c13c540 con 0x7f9d6c09fb70 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c0a1f00 con 0x7f9d6c0a1290 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d6c071860 con 0x7f9d6c09f770 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient(hunting): authenticate will time out at 1561.221395s 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d69d9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9d6c09fb70 0x7f9d6c13a8c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41108/0 (socket says 172.21.15.106:41108) 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d69d9b640 1 -- 172.21.15.106:0/310688891 learned_addr learned my addr 172.21.15.106:0/310688891 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d6a59c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9d6c09f770 0x7f9d6c13ec50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55052/0 (socket says 172.21.15.106:55052) 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3243448754 0 0) 0x7f9d6c071860 con 0x7f9d6c09f770 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): my global_id is 145912 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d4c003530 con 0x7f9d6c09f770 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1551262047 0 0) 0x7f9d6c13c540 con 0x7f9d6c09fb70 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): my global_id is 7533 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d6c071860 con 0x7f9d6c09fb70 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3259634972 0 0) 0x7f9d6c0a1f00 con 0x7f9d6c0a1290 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): my global_id is 7319 2024-04-26T00:05:05.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d6c13c540 con 0x7f9d6c0a1290 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 395110283 0 0) 0x7f9d4c003530 con 0x7f9d6c09f770 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d6c0a1f00 con 0x7f9d6c09f770 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2276684594 0 0) 0x7f9d6c071860 con 0x7f9d6c09fb70 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d4c003530 con 0x7f9d6c09fb70 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d5c001970 con 0x7f9d6c09f770 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): dump: 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.684 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d60001b70 con 0x7f9d6c09fb70 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): dump: 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.686 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 904942022 0 0) 0x7f9d6c13c540 con 0x7f9d6c0a1290 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d6c071860 con 0x7f9d6c0a1290 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d64004eb0 con 0x7f9d6c0a1290 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): dump: 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.687 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.688 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.690 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.690 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3834853550 0 0) 0x7f9d6c0a1f00 con 0x7f9d6c09f770 2024-04-26T00:05:05.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.106:6790/0 conn(0x7f9d6c0a1290 legacy=0x7f9d6c13afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.106:6789/0 conn(0x7f9d6c09fb70 legacy=0x7f9d6c13a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 monclient: found mon.c 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6c136270 con 0x7f9d6c09f770 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 5 monclient: authenticate success, global_id 145912 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: _renew_subs 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6c13b6e0 con 0x7f9d6c09f770 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: _renew_subs 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9d6c13e830 con 0x7f9d6c09f770 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9d5c004aa0 con 0x7f9d6c09f770 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d5c001ba0 con 0x7f9d6c09f770 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d68d99640 4 set_mon_vals no callback set 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:05.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: dump: 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.693 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9d5c004f90 con 0x7f9d6c09f770 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d500065d0 con 0x7f9d50002870 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f9d5c0451a0 con 0x7f9d6c09f770 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226072561 0 0) 0x7f9d500065d0 con 0x7f9d50002870 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient(hunting): my global_id is 7328 2024-04-26T00:05:05.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d6c0a1f00 con 0x7f9d50002870 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d6ad9d640 10 monclient: get_auth_request con 0x7f9d4c0380e0 auth_method 0 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1361168787 0 0) 0x7f9d6c0a1f00 con 0x7f9d50002870 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d500065d0 con 0x7f9d50002870 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d60003e80 con 0x7f9d50002870 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.691+0000 7f9d5affd640 10 monclient: dump: 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.695 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.695+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 40684183 0 0) 0x7f9d500065d0 con 0x7f9d50002870 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.695+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9d5000a160 con 0x7f9d50002870 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.695+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9d60004390 con 0x7f9d50002870 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.695+0000 7f9d5affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.695+0000 7f9d5affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:05.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.695+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.106:6790/0 conn(0x7f9d50002870 legacy=0x7f9d50004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.695+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.106:6790/0 conn(0x7f9d50002870 legacy=0x7f9d50004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d70e3e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9d50009e30 con 0x7f9d500090f0 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375861052 0 0) 0x7f9d50009e30 con 0x7f9d500090f0 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient(hunting): my global_id is 7337 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9d500065d0 con 0x7f9d500090f0 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2451806486 0 0) 0x7f9d500065d0 con 0x7f9d500090f0 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9d50009e30 con 0x7f9d500090f0 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9d60005d60 con 0x7f9d500090f0 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:05.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient: dump: 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.698 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 922109585 0 0) 0x7f9d50009e30 con 0x7f9d500090f0 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9d5000c3a0 con 0x7f9d500090f0 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 252450026) 0x7f9d600067e0 con 0x7f9d500090f0 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.106:6790/0 conn(0x7f9d500090f0 legacy=0x7f9d50009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.699+0000 7f9d5affd640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.106:6790/0 conn(0x7f9d500090f0 legacy=0x7f9d50009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:05.699 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 624263, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:05.700 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.701 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.702 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:05.703 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.704 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.705 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:05.706 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.707 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.708 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:05.709 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.710 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.711 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.714 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.716 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.717 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:05.718 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.171:6812/722422047 conn(0x7f9d4c0380e0 legacy=0x7f9d4c03a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 10 monclient: shutdown 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 >> v1:172.21.15.106:6791/0 conn(0x7f9d6c09f770 legacy=0x7f9d6c13ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d6ad9d640 1 -- 172.21.15.106:0/310688891 reap_dead start 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d6ad9d640 1 -- 172.21.15.106:0/310688891 reap_dead start 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 shutdown_connections 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 >> 172.21.15.106:0/310688891 conn(0x7f9d6c06b210 msgr2=0x7f9d6c0a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 shutdown_connections 2024-04-26T00:05:05.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.703+0000 7f9d70e3e640 1 -- 172.21.15.106:0/310688891 wait complete. 2024-04-26T00:05:05.720 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:05.720 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:05:05.720 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:05:05.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: get_monmap_and_config 2024-04-26T00:05:05.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.833 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: monmap: 2024-04-26T00:05:05.833 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:05.858917+0000 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:05.858917+0000 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.834 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 Processor -- start 2024-04-26T00:05:05.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- start start 2024-04-26T00:05:05.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: init 2024-04-26T00:05:05.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: _add_conns ranks=[3,4,6,5,1,8,2,7,0] 2024-04-26T00:05:05.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient(hunting): picked mon.noname-g con 0x7f34200716e0 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient(hunting): picked mon.noname-c con 0x7f3420135e50 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient(hunting): picked mon.noname-d con 0x7f342013bdd0 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34201362a0 con 0x7f34200716e0 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34200723f0 con 0x7f3420135e50 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342006bcc0 con 0x7f342013bdd0 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient(hunting): authenticate will time out at 1561.386063s 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341e59c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f3420135e50 0x7f342013a6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55066/0 (socket says 172.21.15.106:55066) 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341e59c640 1 -- 172.21.15.106:0/3865465712 learned_addr learned my addr 172.21.15.106:0/3865465712 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1496572782 0 0) 0x7f34200723f0 con 0x7f3420135e50 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): my global_id is 145921 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3408003530 con 0x7f3420135e50 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499769874 0 0) 0x7f342006bcc0 con 0x7f342013bdd0 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient(hunting): my global_id is 7458 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34200723f0 con 0x7f342013bdd0 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 784375376 0 0) 0x7f34200723f0 con 0x7f342013bdd0 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 >> v1:172.21.15.106:6791/0 conn(0x7f3420135e50 legacy=0x7f342013a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 >> v1:172.21.15.171:6790/0 conn(0x7f34200716e0 legacy=0x7f3420135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 monclient: found mon.noname-d 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3420135390 con 0x7f342013bdd0 2024-04-26T00:05:05.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3418001ac0 con 0x7f342013bdd0 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 5 monclient: authenticate success, global_id 7458 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: dump: 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.845 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3418001d20 con 0x7f342013bdd0 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 1 -- 172.21.15.106:0/3865465712 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3418003ce0 con 0x7f342013bdd0 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f341dd9b640 10 monclient: dump: 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.847 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 4 set_mon_vals no callback set 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 10 monclient: shutdown 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- 172.21.15.106:0/3865465712 >> v1:172.21.15.106:6792/0 conn(0x7f342013bdd0 legacy=0x7f342013e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- 172.21.15.106:0/3865465712 shutdown_connections 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- 172.21.15.106:0/3865465712 >> 172.21.15.106:0/3865465712 conn(0x7f34200a7240 msgr2=0x7f34200a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- 172.21.15.106:0/3865465712 shutdown_connections 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.855+0000 7f34251ef640 1 -- 172.21.15.106:0/3865465712 wait complete. 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: build_initial_monmap 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: monmap: 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:05.848 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 Processor -- start 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 -- start start 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: init 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: _add_conns ranks=[1,4,6,8,0,5,3,7,2] 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient(hunting): picked mon.noname-f con 0x7f34200716e0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient(hunting): picked mon.noname-c con 0x7f3420135e50 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient(hunting): picked mon.noname-d con 0x7f342013bdd0 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34200a0920 con 0x7f34200716e0 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342009eb80 con 0x7f3420135e50 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f342009ee60 con 0x7f342013bdd0 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient(hunting): authenticate will time out at 1561.389152s 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f341f59e640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f342013bdd0 0x7f34201d2a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:40168/0 (socket says 172.21.15.106:40168) 2024-04-26T00:05:05.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f341f59e640 1 -- 172.21.15.106:0/1036799858 learned_addr learned my addr 172.21.15.106:0/1036799858 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1704738330 0 0) 0x7f342009ee60 con 0x7f342013bdd0 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): my global_id is 7467 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f340c003530 con 0x7f342013bdd0 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454329953 0 0) 0x7f342009eb80 con 0x7f3420135e50 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): my global_id is 145930 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342009ee60 con 0x7f3420135e50 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1285468825 0 0) 0x7f340c003530 con 0x7f342013bdd0 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f342009eb80 con 0x7f342013bdd0 2024-04-26T00:05:05.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3418003980 con 0x7f342013bdd0 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): dump: 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.852 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 380132775 0 0) 0x7f342009ee60 con 0x7f3420135e50 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f340c003530 con 0x7f3420135e50 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3414001440 con 0x7f3420135e50 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): dump: 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.853 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3066787866 0 0) 0x7f3410001120 con 0x7f34200716e0 2024-04-26T00:05:05.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): my global_id is 224236 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342009ee60 con 0x7f34200716e0 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 374737081 0 0) 0x7f342009eb80 con 0x7f342013bdd0 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.106:6791/0 conn(0x7f3420135e50 legacy=0x7f34201caee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.171:6789/0 conn(0x7f34200716e0 legacy=0x7f34201ca7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: _finish_hunting 0 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 monclient: found mon.d 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34201cb5f0 con 0x7f342013bdd0 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: _finish_auth 0 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: _check_auth_tickets 2024-04-26T00:05:05.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 5 monclient: authenticate success, global_id 7467 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: _renew_subs 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34200a03f0 con 0x7f342013bdd0 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: _renew_subs 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3420135060 con 0x7f342013bdd0 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3418004030 con 0x7f342013bdd0 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f34180045a0 con 0x7f342013bdd0 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: dump: 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.856 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f341d59a640 4 set_mon_vals no callback set 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f34180047c0 con 0x7f342013bdd0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f34180455c0 con 0x7f342013bdd0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f342013f860 con 0x7f342009f5e0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f341ed9d640 10 monclient: get_auth_request con 0x7f340c037f30 auth_method 0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684133256 0 0) 0x7f342013f860 con 0x7f342009f5e0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient(hunting): my global_id is 145939 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342009eb80 con 0x7f342009f5e0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4055206461 0 0) 0x7f342009eb80 con 0x7f342009f5e0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f342013f860 con 0x7f342009f5e0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3414004b30 con 0x7f342009f5e0 2024-04-26T00:05:05.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 10 monclient: dump: 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.859 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.859+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4240835434 0 0) 0x7f342013f860 con 0x7f342009f5e0 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.863+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3420075890 con 0x7f342009f5e0 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.863+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3414004e50 con 0x7f342009f5e0 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.863+0000 7f34077fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.863+0000 7f34077fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.863+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.106:6791/0 conn(0x7f342009f5e0 legacy=0x7f34200623f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.863+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.106:6791/0 conn(0x7f342009f5e0 legacy=0x7f34200623f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:05.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3420137ba0 con 0x7f342002d180 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2974992201 0 0) 0x7f3420137ba0 con 0x7f342002d180 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient(hunting): my global_id is 145948 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f342013f860 con 0x7f342002d180 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1801215309 0 0) 0x7f342013f860 con 0x7f342002d180 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3420137ba0 con 0x7f342002d180 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3414005710 con 0x7f342002d180 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:05.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient: dump: 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:05.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1783995125 0 0) 0x7f3420137ba0 con 0x7f342002d180 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f342002d560 con 0x7f342002d180 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 3713469601) 0x7f3414005970 con 0x7f342002d180 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.106:6791/0 conn(0x7f342002d180 legacy=0x7f3420137490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34077fe640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.106:6791/0 conn(0x7f342002d180 legacy=0x7f3420137490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:05.864 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 369398, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:05.865 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.866 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.867 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:05.868 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:05.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.870 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.871 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.872 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:05.873 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.874 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.875 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:05.876 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.877 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.878 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:05.879 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.880 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:05.882 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:05.883 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:05.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:05.883 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:05.883 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.171:6812/722422047 conn(0x7f340c037f30 legacy=0x7f340c03a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 10 monclient: shutdown 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 >> v1:172.21.15.106:6792/0 conn(0x7f342013bdd0 legacy=0x7f34201d2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f341f59e640 1 -- 172.21.15.106:0/1036799858 reap_dead start 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f341f59e640 1 -- 172.21.15.106:0/1036799858 reap_dead start 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 shutdown_connections 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 >> 172.21.15.106:0/1036799858 conn(0x7f34200a7240 msgr2=0x7f342013e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 shutdown_connections 2024-04-26T00:05:05.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:05.867+0000 7f34251ef640 1 -- 172.21.15.106:0/1036799858 wait complete. 2024-04-26T00:05:05.885 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:05.885 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:05:05.885 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:05:06.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: get_monmap_and_config 2024-04-26T00:05:06.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: monmap: 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:06.027023+0000 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:06.027023+0000 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.002 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.003 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.003 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 Processor -- start 2024-04-26T00:05:06.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- start start 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: init 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: _add_conns ranks=[0,3,5,6,7,1,2,4,8] 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient(hunting): picked mon.noname-a con 0x7f9478135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient(hunting): picked mon.noname-g con 0x7f94781353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient(hunting): picked mon.noname-h con 0x7f947813bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f947806f2d0 con 0x7f9478135870 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9478072330 con 0x7f94781353b0 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9478072610 con 0x7f947813bdf0 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient(hunting): authenticate will time out at 1561.554188s 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947df63640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9478135870 0x7f9478135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41116/0 (socket says 172.21.15.106:41116) 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947df63640 1 -- 172.21.15.106:0/880394269 learned_addr learned my addr 172.21.15.106:0/880394269 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1378781079 0 0) 0x7f947806f2d0 con 0x7f9478135870 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient(hunting): my global_id is 7542 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9464003530 con 0x7f9478135870 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2547189816 0 0) 0x7f9464003530 con 0x7f9478135870 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 >> v1:172.21.15.171:6791/0 conn(0x7f947813bdf0 legacy=0x7f947813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 >> v1:172.21.15.171:6790/0 conn(0x7f94781353b0 legacy=0x7f947813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 monclient: found mon.noname-a 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94780a3260 con 0x7f9478135870 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9474001b40 con 0x7f9478135870 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: dump: 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.012 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 5 monclient: authenticate success, global_id 7542 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9474001ea0 con 0x7f9478135870 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 1 -- 172.21.15.106:0/880394269 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f94740020d0 con 0x7f9478135870 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 4 set_mon_vals no callback set 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:06.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f947cf61640 10 monclient: dump: 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.014 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 10 monclient: shutdown 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- 172.21.15.106:0/880394269 >> v1:172.21.15.106:6789/0 conn(0x7f9478135870 legacy=0x7f9478135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- 172.21.15.106:0/880394269 shutdown_connections 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- 172.21.15.106:0/880394269 >> 172.21.15.106:0/880394269 conn(0x7f94780a64e0 msgr2=0x7f94780a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- 172.21.15.106:0/880394269 shutdown_connections 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.023+0000 7f94801c7640 1 -- 172.21.15.106:0/880394269 wait complete. 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: monmap: 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:06.015 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 Processor -- start 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 -- start start 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: init 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: _add_conns ranks=[4,7,0,8,5,6,1,2,3] 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient(hunting): picked mon.noname-c con 0x7f94781353b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient(hunting): picked mon.noname-i con 0x7f9478135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient(hunting): picked mon.noname-a con 0x7f947813bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9478070d00 con 0x7f947813bdf0 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f94781348d0 con 0x7f94781353b0 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f947809f470 con 0x7f9478135870 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient(hunting): authenticate will time out at 1561.557084s 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f947df63640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f94781353b0 0x7f9478133ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55114/0 (socket says 172.21.15.106:55114) 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f947df63640 1 -- 172.21.15.106:0/42068749 learned_addr learned my addr 172.21.15.106:0/42068749 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f947e764640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f947813bdf0 0x7f94781d4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41132/0 (socket says 172.21.15.106:41132) 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136335045 0 0) 0x7f94781348d0 con 0x7f94781353b0 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): my global_id is 145957 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f945c003530 con 0x7f94781353b0 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2024323334 0 0) 0x7f9478070d00 con 0x7f947813bdf0 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): my global_id is 7551 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94781348d0 con 0x7f947813bdf0 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 829144977 0 0) 0x7f945c003530 con 0x7f94781353b0 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9478070d00 con 0x7f94781353b0 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9474001b00 con 0x7f94781353b0 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:06.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.019 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1545961634 0 0) 0x7f94781348d0 con 0x7f947813bdf0 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f945c003530 con 0x7f947813bdf0 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f94700018c0 con 0x7f947813bdf0 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.020 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3176430616 0 0) 0x7f947809f470 con 0x7f9478135870 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): my global_id is 145789 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94781348d0 con 0x7f9478135870 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 447850869 0 0) 0x7f9478070d00 con 0x7f94781353b0 2024-04-26T00:05:06.021 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.171:6792/0 conn(0x7f9478135870 legacy=0x7f94781341c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.106:6789/0 conn(0x7f947813bdf0 legacy=0x7f94781d4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 monclient: found mon.c 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f947809f930 con 0x7f94781353b0 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 5 monclient: authenticate success, global_id 145957 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: _renew_subs 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9478070a20 con 0x7f94781353b0 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: _renew_subs 2024-04-26T00:05:06.022 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f947806f5d0 con 0x7f94781353b0 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9474001ea0 con 0x7f94781353b0 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f94740020d0 con 0x7f94781353b0 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946ffff640 4 set_mon_vals no callback set 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: dump: 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.023 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f94600065d0 con 0x7f9460002870 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f94740102d0 con 0x7f94781353b0 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f94740456e0 con 0x7f94781353b0 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 410226049 0 0) 0x7f94600065d0 con 0x7f9460002870 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.024 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient(hunting): my global_id is 7476 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9478070d00 con 0x7f9460002870 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f947e764640 10 monclient: get_auth_request con 0x7f945c037d30 auth_method 0 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 137950337 0 0) 0x7f9478070d00 con 0x7f9460002870 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f94600065d0 con 0x7f9460002870 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f94680018c0 con 0x7f9460002870 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 10 monclient: dump: 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.025 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1745846064 0 0) 0x7f94600065d0 con 0x7f9460002870 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.027+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f946000a160 con 0x7f9460002870 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.031+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9468001d10 con 0x7f9460002870 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.031+0000 7f946e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.031+0000 7f946e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:06.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.031+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.106:6792/0 conn(0x7f9460002870 legacy=0x7f9460004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.031+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.106:6792/0 conn(0x7f9460002870 legacy=0x7f9460004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:06.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9460009e30 con 0x7f94600090f0 2024-04-26T00:05:06.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185762812 0 0) 0x7f9460009e30 con 0x7f94600090f0 2024-04-26T00:05:06.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient(hunting): my global_id is 7485 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f94600065d0 con 0x7f94600090f0 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1141975548 0 0) 0x7f94600065d0 con 0x7f94600090f0 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9460009e30 con 0x7f94600090f0 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9468003b30 con 0x7f94600090f0 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient: dump: 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.029 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4124681323 0 0) 0x7f9460009e30 con 0x7f94600090f0 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f946000c3a0 con 0x7f94600090f0 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1783760226) 0x7f9468003e30 con 0x7f94600090f0 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.106:6792/0 conn(0x7f94600090f0 legacy=0x7f9460009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f946e7fc640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.106:6792/0 conn(0x7f94600090f0 legacy=0x7f9460009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 624575, 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:06.031 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.032 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.033 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:06.034 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.035 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.038 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:06.041 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.043 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.044 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:06.045 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.046 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.047 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.048 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:06.049 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:06.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.171:6812/722422047 conn(0x7f945c037d30 legacy=0x7f945c03a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 10 monclient: shutdown 2024-04-26T00:05:06.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 >> v1:172.21.15.106:6791/0 conn(0x7f94781353b0 legacy=0x7f9478133ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f947e764640 1 -- 172.21.15.106:0/42068749 reap_dead start 2024-04-26T00:05:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f947e764640 1 -- 172.21.15.106:0/42068749 reap_dead start 2024-04-26T00:05:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 shutdown_connections 2024-04-26T00:05:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 >> 172.21.15.106:0/42068749 conn(0x7f94780a64e0 msgr2=0x7f94780a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 shutdown_connections 2024-04-26T00:05:06.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.035+0000 7f94801c7640 1 -- 172.21.15.106:0/42068749 wait complete. 2024-04-26T00:05:06.051 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:06.051 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:05:06.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:05:06.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.187+0000 7f0237686640 10 monclient: get_monmap_and_config 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.187+0000 7f0237686640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.187+0000 7f0237686640 10 monclient: monmap: 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:06.194149+0000 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:06.194149+0000 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.169 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.170 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.170 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 Processor -- start 2024-04-26T00:05:06.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- start start 2024-04-26T00:05:06.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: init 2024-04-26T00:05:06.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: _add_conns ranks=[2,1,0,3,8,4,5,7,6] 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient(hunting): picked mon.noname-b con 0x7f0230137c40 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient(hunting): picked mon.noname-f con 0x7f023009fca0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient(hunting): picked mon.noname-a con 0x7f0230137570 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023006ee10 con 0x7f0230137570 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02300a2220 con 0x7f023009fca0 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023006f0f0 con 0x7f0230137c40 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient(hunting): authenticate will time out at 1561.721352s 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0235422640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f0230137c40 0x7f02300a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43828/0 (socket says 172.21.15.106:43828) 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0235422640 1 -- 172.21.15.106:0/1410137784 learned_addr learned my addr 172.21.15.106:0/1410137784 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4097841706 0 0) 0x7f02280014a0 con 0x7f0230137570 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): my global_id is 7560 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f021c003530 con 0x7f0230137570 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1687197222 0 0) 0x7f023006f0f0 con 0x7f0230137c40 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient(hunting): my global_id is 7346 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02280014a0 con 0x7f0230137c40 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3990559089 0 0) 0x7f021c003530 con 0x7f0230137570 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 >> v1:172.21.15.106:6790/0 conn(0x7f0230137c40 legacy=0x7f02300a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 >> v1:172.21.15.171:6789/0 conn(0x7f023009fca0 legacy=0x7f02300a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 monclient: found mon.noname-a 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:06.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023006f3d0 con 0x7f0230137570 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0228001d10 con 0x7f0230137570 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 5 monclient: authenticate success, global_id 7560 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: dump: 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.180 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0228001f80 con 0x7f0230137570 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 1 -- 172.21.15.106:0/1410137784 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0228003cc0 con 0x7f0230137570 2024-04-26T00:05:06.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 4 set_mon_vals no callback set 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0227fff640 10 monclient: dump: 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.182 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: shutdown 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- 172.21.15.106:0/1410137784 >> v1:172.21.15.106:6789/0 conn(0x7f0230137570 legacy=0x7f02301408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- 172.21.15.106:0/1410137784 shutdown_connections 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- 172.21.15.106:0/1410137784 >> 172.21.15.106:0/1410137784 conn(0x7f02300a64e0 msgr2=0x7f02300a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- 172.21.15.106:0/1410137784 shutdown_connections 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- 172.21.15.106:0/1410137784 wait complete. 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: monmap: 2024-04-26T00:05:06.183 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 Processor -- start 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 1 -- start start 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.191+0000 7f0237686640 10 monclient: init 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient: _add_conns ranks=[1,8,2,4,3,0,5,6,7] 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient(hunting): picked mon.noname-f con 0x7f023009fca0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient(hunting): picked mon.noname-e con 0x7f0230137570 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient(hunting): picked mon.noname-b con 0x7f0230137c40 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0230122980 con 0x7f023009fca0 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0230123040 con 0x7f0230137c40 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02301247d0 con 0x7f0230137570 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient(hunting): authenticate will time out at 1561.724447s 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0234c21640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0230137570 0x7f02301d15b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:57804/0 (socket says 172.21.15.106:57804) 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0234c21640 1 -- 172.21.15.106:0/2629649187 learned_addr learned my addr 172.21.15.106:0/2629649187 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0235c23640 1 --1- 172.21.15.106:0/2629649187 >> v1:172.21.15.106:6790/0 conn(0x7f0230137c40 0x7f02301d4ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43842/0 (socket says 172.21.15.106:43842) 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1531667579 0 0) 0x7f02301247d0 con 0x7f0230137570 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): my global_id is 224198 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0214003530 con 0x7f0230137570 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064729425 0 0) 0x7f0230123040 con 0x7f0230137c40 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): my global_id is 7355 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02301247d0 con 0x7f0230137c40 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 398631545 0 0) 0x7f0214003530 con 0x7f0230137570 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0230123040 con 0x7f0230137570 2024-04-26T00:05:06.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3826948574 0 0) 0x7f0230122980 con 0x7f023009fca0 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): my global_id is 224254 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0214003530 con 0x7f023009fca0 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f022c001b30 con 0x7f0230137570 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): dump: 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.187 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1781496848 0 0) 0x7f02301247d0 con 0x7f0230137c40 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0230122980 con 0x7f0230137c40 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0228001cd0 con 0x7f0230137c40 2024-04-26T00:05:06.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): dump: 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.189 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 352802834 0 0) 0x7f0230123040 con 0x7f0230137570 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.106:6790/0 conn(0x7f0230137c40 legacy=0x7f02301d4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.171:6789/0 conn(0x7f023009fca0 legacy=0x7f02301cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 monclient: found mon.e 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0230072970 con 0x7f0230137570 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 5 monclient: authenticate success, global_id 224198 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient: _renew_subs 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02300724d0 con 0x7f0230137570 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient: _renew_subs 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f02301244f0 con 0x7f0230137570 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f022c0038d0 con 0x7f0230137570 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f022c003e40 con 0x7f0230137570 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f02277fe640 4 set_mon_vals no callback set 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: dump: 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.191 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02100065d0 con 0x7f0210002870 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f022c004060 con 0x7f0230137570 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f022c045200 con 0x7f0230137570 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3386962433 0 0) 0x7f02100065d0 con 0x7f0210002870 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient(hunting): my global_id is 224207 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0230123040 con 0x7f0210002870 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0235c23640 10 monclient: get_auth_request con 0x7f0214037f20 auth_method 0 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3877158279 0 0) 0x7f0230123040 con 0x7f0210002870 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02100065d0 con 0x7f0210002870 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02200017d0 con 0x7f0210002870 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:06.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: dump: 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.194 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2686238382 0 0) 0x7f02100065d0 con 0x7f0210002870 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f021000a160 con 0x7f0210002870 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0220001ca0 con 0x7f0210002870 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.106:6793/0 conn(0x7f0210002870 legacy=0x7f0210004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.195+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.106:6793/0 conn(0x7f0210002870 legacy=0x7f0210004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:06.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0210009e50 con 0x7f0210009110 2024-04-26T00:05:06.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752783541 0 0) 0x7f0210009e50 con 0x7f0210009110 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient(hunting): my global_id is 224216 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02100065d0 con 0x7f0210009110 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 273603973 0 0) 0x7f02100065d0 con 0x7f0210009110 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0210009e50 con 0x7f0210009110 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0220004da0 con 0x7f0210009110 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient: dump: 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.197 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 339897907 0 0) 0x7f0210009e50 con 0x7f0210009110 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f021000c3e0 con 0x7f0210009110 2024-04-26T00:05:06.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 1697191617) 0x7f02200058e0 con 0x7f0210009110 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.106:6793/0 conn(0x7f0210009110 legacy=0x7f02100095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0225ffb640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.106:6793/0 conn(0x7f0210009110 legacy=0x7f02100095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 19435, 2024-04-26T00:05:06.199 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:06.200 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.201 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:06.202 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.203 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:06.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.205 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.209 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.210 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:06.213 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.217 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:06.217 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.171:6812/722422047 conn(0x7f0214037f20 legacy=0x7f021403a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 10 monclient: shutdown 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 >> v1:172.21.15.106:6793/0 conn(0x7f0230137570 legacy=0x7f02301d15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0235c23640 1 -- 172.21.15.106:0/2629649187 reap_dead start 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0235c23640 1 -- 172.21.15.106:0/2629649187 reap_dead start 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 shutdown_connections 2024-04-26T00:05:06.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 >> 172.21.15.106:0/2629649187 conn(0x7f02300a64e0 msgr2=0x7f0230136ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 shutdown_connections 2024-04-26T00:05:06.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.203+0000 7f0237686640 1 -- 172.21.15.106:0/2629649187 wait complete. 2024-04-26T00:05:06.219 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:06.219 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:05:06.219 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: get_monmap_and_config 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: monmap: 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:06.358591+0000 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:06.358591+0000 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.333 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.334 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 Processor -- start 2024-04-26T00:05:06.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- start start 2024-04-26T00:05:06.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: init 2024-04-26T00:05:06.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: _add_conns ranks=[0,7,4,6,3,2,8,5,1] 2024-04-26T00:05:06.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient(hunting): picked mon.noname-a con 0x7fe390137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:06.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient(hunting): picked mon.noname-i con 0x7fe3900a0b20 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient(hunting): picked mon.noname-c con 0x7fe390138220 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900a2750 con 0x7fe390137730 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900a2a30 con 0x7fe390138220 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900a2d10 con 0x7fe3900a0b20 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient(hunting): authenticate will time out at 1561.885697s 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe395b28640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fe390138220 0x7fe390140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55128/0 (socket says 172.21.15.106:55128) 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe395b28640 1 -- 172.21.15.106:0/1553107508 learned_addr learned my addr 172.21.15.106:0/1553107508 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe395327640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe390137730 0x7fe390137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:41152/0 (socket says 172.21.15.106:41152) 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3317309332 0 0) 0x7fe3900a2a30 con 0x7fe390138220 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): my global_id is 145966 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe378003530 con 0x7fe390138220 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751770720 0 0) 0x7fe3900a2750 con 0x7fe390137730 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient(hunting): my global_id is 7569 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3900a2a30 con 0x7fe390137730 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3374974423 0 0) 0x7fe378003530 con 0x7fe390138220 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 >> v1:172.21.15.171:6792/0 conn(0x7fe3900a0b20 legacy=0x7fe39013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 >> v1:172.21.15.106:6789/0 conn(0x7fe390137730 legacy=0x7fe390137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 monclient: found mon.noname-c 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3900a4680 con 0x7fe390138220 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3880017c0 con 0x7fe390138220 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 5 monclient: authenticate success, global_id 145966 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: dump: 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.345 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe388001a60 con 0x7fe390138220 2024-04-26T00:05:06.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 1 -- 172.21.15.106:0/1553107508 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe388004bf0 con 0x7fe390138220 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 4 set_mon_vals no callback set 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe38ffff640 10 monclient: dump: 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.347 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 10 monclient: shutdown 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- 172.21.15.106:0/1553107508 >> v1:172.21.15.106:6791/0 conn(0x7fe390138220 legacy=0x7fe390140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- 172.21.15.106:0/1553107508 shutdown_connections 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- 172.21.15.106:0/1553107508 >> 172.21.15.106:0/1553107508 conn(0x7fe3900a6b80 msgr2=0x7fe3900a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- 172.21.15.106:0/1553107508 shutdown_connections 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.355+0000 7fe39758b640 1 -- 172.21.15.106:0/1553107508 wait complete. 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: monmap: 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.349 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 Processor -- start 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 -- start start 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: init 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: _add_conns ranks=[3,6,1,7,0,2,5,8,4] 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient(hunting): picked mon.noname-g con 0x7fe3900a0b20 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient(hunting): picked mon.noname-d con 0x7fe390137730 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient(hunting): picked mon.noname-f con 0x7fe390138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39009e500 con 0x7fe390138220 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3900a07c0 con 0x7fe3900a0b20 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe39009ef30 con 0x7fe390137730 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient(hunting): authenticate will time out at 1561.889007s 2024-04-26T00:05:06.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe394b26640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe390137730 0x7fe3901c91d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:40202/0 (socket says 172.21.15.106:40202) 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe394b26640 1 -- 172.21.15.106:0/3547181950 learned_addr learned my addr 172.21.15.106:0/3547181950 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264435555 0 0) 0x7fe39009ef30 con 0x7fe390137730 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): my global_id is 7494 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe37c003530 con 0x7fe390137730 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1494108261 0 0) 0x7fe37c003530 con 0x7fe390137730 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe39009ef30 con 0x7fe390137730 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe384001b30 con 0x7fe390137730 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): dump: 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.351 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4178781096 0 0) 0x7fe39009e500 con 0x7fe390138220 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): my global_id is 224263 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe37c003530 con 0x7fe390138220 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923653719 0 0) 0x7fe3900a07c0 con 0x7fe3900a0b20 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): my global_id is 214428 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe39009e500 con 0x7fe3900a0b20 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1093889304 0 0) 0x7fe39009ef30 con 0x7fe390137730 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.171:6790/0 conn(0x7fe3900a0b20 legacy=0x7fe3900a00b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.171:6789/0 conn(0x7fe390138220 legacy=0x7fe3901d4500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 monclient: found mon.d 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe39009f3f0 con 0x7fe390137730 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 5 monclient: authenticate success, global_id 7494 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: _renew_subs 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe39009e740 con 0x7fe390137730 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: _renew_subs 2024-04-26T00:05:06.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3901c9ab0 con 0x7fe390137730 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe384003950 con 0x7fe390137730 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe384003e40 con 0x7fe390137730 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38f7fe640 4 set_mon_vals no callback set 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: dump: 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.355 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3700065d0 con 0x7fe370002870 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe384003fe0 con 0x7fe390137730 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fe3840452c0 con 0x7fe390137730 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 376452719 0 0) 0x7fe3700065d0 con 0x7fe370002870 2024-04-26T00:05:06.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient(hunting): my global_id is 224272 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe39009ef30 con 0x7fe370002870 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe395b28640 10 monclient: get_auth_request con 0x7fe37c0379f0 auth_method 0 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3841617326 0 0) 0x7fe39009ef30 con 0x7fe370002870 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3700065d0 con 0x7fe370002870 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3800018a0 con 0x7fe370002870 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.359+0000 7fe38dffb640 10 monclient: dump: 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.357 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.363+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3199024494 0 0) 0x7fe3700065d0 con 0x7fe370002870 2024-04-26T00:05:06.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.363+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe37000a160 con 0x7fe370002870 2024-04-26T00:05:06.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.363+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe380001a00 con 0x7fe370002870 2024-04-26T00:05:06.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.363+0000 7fe38dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.363+0000 7fe38dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:06.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.363+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.171:6789/0 conn(0x7fe370002870 legacy=0x7fe370004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.363+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.171:6789/0 conn(0x7fe370002870 legacy=0x7fe370004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe39758b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe370009e50 con 0x7fe370009110 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3633849172 0 0) 0x7fe370009e50 con 0x7fe370009110 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe38dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe38dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe38dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe38dffb640 10 monclient(hunting): my global_id is 224281 2024-04-26T00:05:06.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.367+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3700065d0 con 0x7fe370009110 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3703691377 0 0) 0x7fe3700065d0 con 0x7fe370009110 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe370009e50 con 0x7fe370009110 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe380005160 con 0x7fe370009110 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 10 monclient: dump: 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.361 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3331839429 0 0) 0x7fe370009e50 con 0x7fe370009110 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe37000c3e0 con 0x7fe370009110 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 2793026802) 0x7fe380007520 con 0x7fe370009110 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.171:6789/0 conn(0x7fe370009110 legacy=0x7fe3700095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe38dffb640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.171:6789/0 conn(0x7fe370009110 legacy=0x7fe3700095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 19607, 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:06.363 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.364 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.365 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.366 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.367 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.368 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:06.369 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.371 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.372 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:06.373 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.374 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:06.375 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.376 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.377 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.378 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.379 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:06.380 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.171:6812/722422047 conn(0x7fe37c0379f0 legacy=0x7fe37c039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 10 monclient: shutdown 2024-04-26T00:05:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 >> v1:172.21.15.106:6792/0 conn(0x7fe390137730 legacy=0x7fe3901c91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe395b28640 1 -- 172.21.15.106:0/3547181950 reap_dead start 2024-04-26T00:05:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe395b28640 1 -- 172.21.15.106:0/3547181950 reap_dead start 2024-04-26T00:05:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 shutdown_connections 2024-04-26T00:05:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 >> 172.21.15.106:0/3547181950 conn(0x7fe3900a6b80 msgr2=0x7fe3900a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 shutdown_connections 2024-04-26T00:05:06.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.371+0000 7fe39758b640 1 -- 172.21.15.106:0/3547181950 wait complete. 2024-04-26T00:05:06.382 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:06.382 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:05:06.382 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:05:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient: get_monmap_and_config 2024-04-26T00:05:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient: monmap: 2024-04-26T00:05:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.503 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:06.528548+0000 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:06.528548+0000 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.504 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.505 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.505 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 1 Processor -- start 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 1 -- start start 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient: init 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient: _add_conns ranks=[6,5,8,0,7,1,2,4,3] 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient(hunting): picked mon.noname-d con 0x7f0d080a1290 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient(hunting): picked mon.noname-h con 0x7f0d0809f770 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:06.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient(hunting): picked mon.noname-e con 0x7f0d0809fb70 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d080727a0 con 0x7f0d0809f770 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d080724c0 con 0x7f0d080a1290 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d08072a80 con 0x7f0d0809fb70 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.523+0000 7f0d0e4d2640 10 monclient(hunting): authenticate will time out at 1562.055989s 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0ca6f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0d0809fb70 0x7f0d0813de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:57830/0 (socket says 172.21.15.106:57830) 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d07fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f0d080a1290 0x7f0d080a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:40204/0 (socket says 172.21.15.106:40204) 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0ca6f640 1 -- 172.21.15.106:0/3970666100 learned_addr learned my addr 172.21.15.106:0/3970666100 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1820052174 0 0) 0x7f0d08072a80 con 0x7f0d0809fb70 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): my global_id is 224225 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cf4003530 con 0x7f0d0809fb70 2024-04-26T00:05:06.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 704894220 0 0) 0x7f0d080724c0 con 0x7f0d080a1290 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): my global_id is 7503 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d08072a80 con 0x7f0d080a1290 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3411282833 0 0) 0x7f0cf0001120 con 0x7f0d0809f770 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient(hunting): my global_id is 7385 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d080724c0 con 0x7f0d0809f770 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3408444915 0 0) 0x7f0cf4003530 con 0x7f0d0809fb70 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 >> v1:172.21.15.106:6792/0 conn(0x7f0d080a1290 legacy=0x7f0d080a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 >> v1:172.21.15.171:6791/0 conn(0x7f0d0809f770 legacy=0x7f0d0813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 monclient: found mon.noname-e 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0806bfc0 con 0x7f0d0809fb70 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0d000017c0 con 0x7f0d0809fb70 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: dump: 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.518 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 5 monclient: authenticate success, global_id 224225 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0d00001a20 con 0x7f0d0809fb70 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 1 -- 172.21.15.106:0/3970666100 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0d00004bf0 con 0x7f0d0809fb70 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d06ffd640 10 monclient: dump: 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.520 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 4 set_mon_vals no callback set 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: shutdown 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/3970666100 >> v1:172.21.15.106:6793/0 conn(0x7f0d0809fb70 legacy=0x7f0d0813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/3970666100 shutdown_connections 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/3970666100 >> 172.21.15.106:0/3970666100 conn(0x7f0d0806b210 msgr2=0x7f0d0806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/3970666100 shutdown_connections 2024-04-26T00:05:06.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/3970666100 wait complete. 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: monmap: 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.522 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 Processor -- start 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- start start 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: init 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: _add_conns ranks=[8,7,0,5,4,6,1,3,2] 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient(hunting): picked mon.noname-e con 0x7f0d0809f770 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient(hunting): picked mon.noname-i con 0x7f0d0809fb70 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient(hunting): picked mon.noname-a con 0x7f0d080a1290 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d081cb2c0 con 0x7f0d080a1290 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d080a1f00 con 0x7f0d0809fb70 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d0813e700 con 0x7f0d0809f770 2024-04-26T00:05:06.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient(hunting): authenticate will time out at 1562.059043s 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d07fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0d0809f770 0x7f0d081ca4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:57832/0 (socket says 172.21.15.106:57832) 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d07fff640 1 -- 172.21.15.106:0/1663340866 learned_addr learned my addr 172.21.15.106:0/1663340866 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3769987674 0 0) 0x7f0d0813e700 con 0x7f0d0809f770 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): my global_id is 224234 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ce8003530 con 0x7f0d0809f770 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640210166 0 0) 0x7f0d081cb2c0 con 0x7f0d080a1290 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): my global_id is 7578 2024-04-26T00:05:06.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d0813e700 con 0x7f0d080a1290 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3065997446 0 0) 0x7f0ce8003530 con 0x7f0d0809f770 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0d081cb2c0 con 0x7f0d0809f770 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0cf8001e00 con 0x7f0d0809f770 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): dump: 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.525 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 318441099 0 0) 0x7f0d0813e700 con 0x7f0d080a1290 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ce8003530 con 0x7f0d080a1290 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0d00004b30 con 0x7f0d080a1290 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): dump: 2024-04-26T00:05:06.526 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951925947 0 0) 0x7f0d080a1f00 con 0x7f0d0809fb70 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient(hunting): my global_id is 145807 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d0813e700 con 0x7f0d0809fb70 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3434648805 0 0) 0x7f0d081cb2c0 con 0x7f0d0809f770 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.171:6792/0 conn(0x7f0d0809fb70 legacy=0x7f0d081cabb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.106:6789/0 conn(0x7f0d080a1290 legacy=0x7f0d081d2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 monclient: found mon.e 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0813e9e0 con 0x7f0d0809f770 2024-04-26T00:05:06.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d04ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 5 monclient: authenticate success, global_id 224234 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: _renew_subs 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.527+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0d0813cf60 con 0x7f0d0809f770 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d0e4d2640 10 monclient: _renew_subs 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d0e4d2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0d0813f190 con 0x7f0d0809f770 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0cf8004e20 con 0x7f0d0809f770 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0cf8005310 con 0x7f0d0809f770 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d067fc640 4 set_mon_vals no callback set 2024-04-26T00:05:06.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: dump: 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.530 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0cf80100b0 con 0x7f0d0809f770 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d0e4d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0cec0065d0 con 0x7f0cec002870 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f0cf8045500 con 0x7f0d0809f770 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d0ca6f640 10 monclient: get_auth_request con 0x7f0ce8037f30 auth_method 0 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1566806259 0 0) 0x7f0cec0065d0 con 0x7f0cec002870 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient(hunting): my global_id is 214437 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d081cb2c0 con 0x7f0cec002870 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4265941514 0 0) 0x7f0d081cb2c0 con 0x7f0cec002870 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cec0065d0 con 0x7f0cec002870 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0cf0001ac0 con 0x7f0cec002870 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: dump: 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.532 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1079646806 0 0) 0x7f0cec0065d0 con 0x7f0cec002870 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0cec00a160 con 0x7f0cec002870 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0cf0003600 con 0x7f0cec002870 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.171:6790/0 conn(0x7f0cec002870 legacy=0x7f0cec004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.531+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.171:6790/0 conn(0x7f0cec002870 legacy=0x7f0cec004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d0e4d2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0cec009e30 con 0x7f0cec0090f0 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794158153 0 0) 0x7f0cec009e30 con 0x7f0cec0090f0 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient(hunting): my global_id is 214446 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0cec0065d0 con 0x7f0cec0090f0 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 547295507 0 0) 0x7f0cec0065d0 con 0x7f0cec0090f0 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0cec009e30 con 0x7f0cec0090f0 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0cf0003ce0 con 0x7f0cec0090f0 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient: dump: 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.536 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2715564323 0 0) 0x7f0cec009e30 con 0x7f0cec0090f0 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0cec00c3a0 con 0x7f0cec0090f0 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 3375498838) 0x7f0cf0005da0 con 0x7f0cec0090f0 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.171:6790/0 conn(0x7f0cec0090f0 legacy=0x7f0cec009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.539+0000 7f0d04ff9640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.171:6790/0 conn(0x7f0cec0090f0 legacy=0x7f0cec009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:06.537 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 136962, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:06.538 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.539 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.540 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:06.541 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.542 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:06.543 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.545 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.546 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.547 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:06.548 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.549 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.550 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.551 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.552 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.553 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.554 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:06.555 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:06.556 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:06.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.171:6812/722422047 conn(0x7f0ce8037f30 legacy=0x7f0ce803a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 10 monclient: shutdown 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 >> v1:172.21.15.106:6793/0 conn(0x7f0d0809f770 legacy=0x7f0d081ca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0ca6f640 1 -- 172.21.15.106:0/1663340866 reap_dead start 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0ca6f640 1 -- 172.21.15.106:0/1663340866 reap_dead start 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 shutdown_connections 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 >> 172.21.15.106:0/1663340866 conn(0x7f0d0806b210 msgr2=0x7f0d080a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 shutdown_connections 2024-04-26T00:05:06.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.543+0000 7f0d0e4d2640 1 -- 172.21.15.106:0/1663340866 wait complete. 2024-04-26T00:05:06.558 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:06.559 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:05:06.559 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:05:06.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.707+0000 7f2079be7640 10 monclient: get_monmap_and_config 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.707+0000 7f2079be7640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.707+0000 7f2079be7640 10 monclient: monmap: 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:06.713264+0000 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:06.713264+0000 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.688 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.689 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.689 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.707+0000 7f2079be7640 1 Processor -- start 2024-04-26T00:05:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.707+0000 7f2079be7640 1 -- start start 2024-04-26T00:05:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.707+0000 7f2079be7640 10 monclient: init 2024-04-26T00:05:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: _add_conns ranks=[6,8,3,0,7,4,2,5,1] 2024-04-26T00:05:06.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): picked mon.noname-d con 0x7f2074134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): picked mon.noname-e con 0x7f20740a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): picked mon.noname-g con 0x7f207413e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207406dd40 con 0x7f207413e200 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20740a2b10 con 0x7f2074134970 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20740a2df0 con 0x7f20740a4820 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): authenticate will time out at 1562.240142s 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2072ffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f20740a4820 0x7f207413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:57834/0 (socket says 172.21.15.106:57834) 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2072ffd640 1 -- 172.21.15.106:0/3818611647 learned_addr learned my addr 172.21.15.106:0/3818611647 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1816012532 0 0) 0x7f20740a2df0 con 0x7f20740a4820 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): my global_id is 224243 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f205c003530 con 0x7f20740a4820 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 382913340 0 0) 0x7f20740a2b10 con 0x7f2074134970 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient(hunting): my global_id is 7512 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20740a2df0 con 0x7f2074134970 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1343968374 0 0) 0x7f205c003530 con 0x7f20740a4820 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 >> v1:172.21.15.106:6792/0 conn(0x7f2074134970 legacy=0x7f2074134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 >> v1:172.21.15.171:6790/0 conn(0x7f207413e200 legacy=0x7f20741405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 monclient: found mon.noname-e 2024-04-26T00:05:06.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740a30d0 con 0x7f20740a4820 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20680017c0 con 0x7f20740a4820 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: dump: 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.698 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 5 monclient: authenticate success, global_id 224243 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2068001a20 con 0x7f20740a4820 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 4 set_mon_vals no callback set 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 1 -- 172.21.15.106:0/3818611647 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2068004bf0 con 0x7f20740a4820 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20727fc640 10 monclient: dump: 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.700 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: shutdown 2024-04-26T00:05:06.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- 172.21.15.106:0/3818611647 >> v1:172.21.15.106:6793/0 conn(0x7f20740a4820 legacy=0x7f207413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- 172.21.15.106:0/3818611647 shutdown_connections 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- 172.21.15.106:0/3818611647 >> 172.21.15.106:0/3818611647 conn(0x7f20740a9e20 msgr2=0x7f20740aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- 172.21.15.106:0/3818611647 shutdown_connections 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- 172.21.15.106:0/3818611647 wait complete. 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: monmap: 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.702 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 Processor -- start 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- start start 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: init 2024-04-26T00:05:06.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient: _add_conns ranks=[6,5,7,3,0,1,8,4,2] 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): picked mon.noname-d con 0x7f20740a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): picked mon.noname-h con 0x7f2074134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): picked mon.noname-i con 0x7f207413e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207413afb0 con 0x7f2074134970 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207412d350 con 0x7f20740a4820 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20741398c0 con 0x7f207413e200 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f2079be7640 10 monclient(hunting): authenticate will time out at 1562.243643s 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20737fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f20740a4820 0x7f207412c530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:40224/0 (socket says 172.21.15.106:40224) 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.711+0000 7f20737fe640 1 -- 172.21.15.106:0/1770168431 learned_addr learned my addr 172.21.15.106:0/1770168431 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3850032800 0 0) 0x7f207412d350 con 0x7f20740a4820 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): my global_id is 7521 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2060003530 con 0x7f20740a4820 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4176730781 0 0) 0x7f207413afb0 con 0x7f2074134970 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): my global_id is 7394 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f207412d350 con 0x7f2074134970 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 171408340 0 0) 0x7f2060003530 con 0x7f20740a4820 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f207413afb0 con 0x7f20740a4820 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20640015e0 con 0x7f20740a4820 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): dump: 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.706 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2579771063 0 0) 0x7f20741398c0 con 0x7f207413e200 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): my global_id is 145816 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2060003530 con 0x7f207413e200 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1875479457 0 0) 0x7f207413afb0 con 0x7f20740a4820 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.171:6792/0 conn(0x7f207413e200 legacy=0x7f20741d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.171:6791/0 conn(0x7f2074134970 legacy=0x7f207412cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 monclient: found mon.d 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20740a1e00 con 0x7f20740a4820 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 5 monclient: authenticate success, global_id 7521 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 10 monclient: _renew_subs 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:06.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f207413acd0 con 0x7f20740a4820 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 10 monclient: _renew_subs 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f207413bcc0 con 0x7f20740a4820 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2064003930 con 0x7f20740a4820 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2064003e20 con 0x7f20740a4820 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2071ffb640 4 set_mon_vals no callback set 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: dump: 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.709 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2064003fc0 con 0x7f20740a4820 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f20540065d0 con 0x7f2054002870 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f20640451d0 con 0x7f20740a4820 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f2072ffd640 10 monclient: get_auth_request con 0x7f20600379b0 auth_method 0 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036603072 0 0) 0x7f20540065d0 con 0x7f2054002870 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient(hunting): my global_id is 7403 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f207413afb0 con 0x7f2054002870 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3921881314 0 0) 0x7f207413afb0 con 0x7f2054002870 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20540065d0 con 0x7f2054002870 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f206c001be0 con 0x7f2054002870 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: dump: 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.712 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.713 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 940384816 0 0) 0x7f20540065d0 con 0x7f2054002870 2024-04-26T00:05:06.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f205400a160 con 0x7f2054002870 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f206c001fb0 con 0x7f2054002870 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.171:6791/0 conn(0x7f2054002870 legacy=0x7f2054004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.715+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.171:6791/0 conn(0x7f2054002870 legacy=0x7f2054004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f2079be7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2054009e50 con 0x7f2054009110 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902227130 0 0) 0x7f2054009e50 con 0x7f2054009110 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient(hunting): my global_id is 7412 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20540065d0 con 0x7f2054009110 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2780618523 0 0) 0x7f20540065d0 con 0x7f2054009110 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2054009e50 con 0x7f2054009110 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f206c003eb0 con 0x7f2054009110 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient: dump: 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.715 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1617244665 0 0) 0x7f2054009e50 con 0x7f2054009110 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f205400c3e0 con 0x7f2054009110 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3430763333) 0x7f206c005380 con 0x7f2054009110 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:06.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.171:6791/0 conn(0x7f2054009110 legacy=0x7f20540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.723+0000 7f205bfff640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.171:6791/0 conn(0x7f2054009110 legacy=0x7f20540095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 625226, 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:06.717 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.718 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.719 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.720 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:06.721 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.722 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.723 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.724 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:06.725 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.726 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.727 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.728 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.729 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:06.730 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.732 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.733 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.734 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:05:06.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.736 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.736 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:06.736 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.171:6812/722422047 conn(0x7f20600379b0 legacy=0x7f2060039e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 10 monclient: shutdown 2024-04-26T00:05:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 >> v1:172.21.15.106:6792/0 conn(0x7f20740a4820 legacy=0x7f207412c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2073fff640 1 -- 172.21.15.106:0/1770168431 reap_dead start 2024-04-26T00:05:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2073fff640 1 -- 172.21.15.106:0/1770168431 reap_dead start 2024-04-26T00:05:06.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 shutdown_connections 2024-04-26T00:05:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 >> 172.21.15.106:0/1770168431 conn(0x7f20740a9e20 msgr2=0x7f2074130b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 shutdown_connections 2024-04-26T00:05:06.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.727+0000 7f2079be7640 1 -- 172.21.15.106:0/1770168431 wait complete. 2024-04-26T00:05:06.738 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:06.738 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:05:06.738 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: get_monmap_and_config 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: monmap: 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:06.875178+0000 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:06.875178+0000 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.850 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.851 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.851 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.851 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.851 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.851 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.851 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.851 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 Processor -- start 2024-04-26T00:05:06.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- start start 2024-04-26T00:05:06.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: init 2024-04-26T00:05:06.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: _add_conns ranks=[2,5,3,1,6,8,7,0,4] 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient(hunting): picked mon.noname-b con 0x7f7128135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient(hunting): picked mon.noname-h con 0x7f71281353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient(hunting): picked mon.noname-g con 0x7f712813bdf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712806f2d0 con 0x7f7128135870 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7128072330 con 0x7f712813bdf0 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7128072610 con 0x7f71281353b0 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient(hunting): authenticate will time out at 1562.402341s 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7126ffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7128135870 0x7f7128135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43844/0 (socket says 172.21.15.106:43844) 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7126ffd640 1 -- 172.21.15.106:0/3115181294 learned_addr learned my addr 172.21.15.106:0/3115181294 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2112338630 0 0) 0x7f712806f2d0 con 0x7f7128135870 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient(hunting): my global_id is 7364 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7110003530 con 0x7f7128135870 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 861559722 0 0) 0x7f7110003530 con 0x7f7128135870 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 >> v1:172.21.15.171:6791/0 conn(0x7f71281353b0 legacy=0x7f712813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 >> v1:172.21.15.171:6790/0 conn(0x7f712813bdf0 legacy=0x7f712813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 monclient: found mon.noname-b 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71280a3260 con 0x7f7128135870 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f71180017c0 con 0x7f7128135870 2024-04-26T00:05:06.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: dump: 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.862 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 5 monclient: authenticate success, global_id 7364 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7118001ab0 con 0x7f7128135870 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 1 -- 172.21.15.106:0/3115181294 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7118004bf0 con 0x7f7128135870 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 4 set_mon_vals no callback set 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f7125ffb640 10 monclient: dump: 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.863 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.864 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.864 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.864 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.864 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.864 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.864 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.864 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 10 monclient: shutdown 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- 172.21.15.106:0/3115181294 >> v1:172.21.15.106:6790/0 conn(0x7f7128135870 legacy=0x7f7128135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- 172.21.15.106:0/3115181294 shutdown_connections 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- 172.21.15.106:0/3115181294 >> 172.21.15.106:0/3115181294 conn(0x7f71280a64e0 msgr2=0x7f71280a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- 172.21.15.106:0/3115181294 shutdown_connections 2024-04-26T00:05:06.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.871+0000 7f712d8bf640 1 -- 172.21.15.106:0/3115181294 wait complete. 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: build_initial_monmap 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: monmap: 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:06.866 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 Processor -- start 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 -- start start 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: init 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: _add_conns ranks=[4,2,3,0,8,1,5,6,7] 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient(hunting): picked mon.noname-c con 0x7f71281353b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:06.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient(hunting): picked mon.noname-b con 0x7f7128135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient(hunting): picked mon.noname-g con 0x7f712813bdf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7128132590 con 0x7f7128135870 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7128131830 con 0x7f712813bdf0 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f712809e6f0 con 0x7f71281353b0 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient(hunting): authenticate will time out at 1562.405179s 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f71267fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7128135870 0x7f71281cf440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43856/0 (socket says 172.21.15.106:43856) 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f71267fc640 1 -- 172.21.15.106:0/2752100507 learned_addr learned my addr 172.21.15.106:0/2752100507 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743292304 0 0) 0x7f7128132590 con 0x7f7128135870 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): my global_id is 7373 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7114003530 con 0x7f7128135870 2024-04-26T00:05:06.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605262002 0 0) 0x7f712809e6f0 con 0x7f71281353b0 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): my global_id is 145975 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7128132590 con 0x7f71281353b0 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 621775028 0 0) 0x7f7114003530 con 0x7f7128135870 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f712809e6f0 con 0x7f7128135870 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f711c001ee0 con 0x7f7128135870 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): dump: 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.869 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1532633892 0 0) 0x7f7128132590 con 0x7f71281353b0 2024-04-26T00:05:06.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7114003530 con 0x7f71281353b0 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7118004b30 con 0x7f71281353b0 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): dump: 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.871 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4161033210 0 0) 0x7f712809e6f0 con 0x7f7128135870 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.106:6791/0 conn(0x7f71281353b0 legacy=0x7f71281ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.171:6790/0 conn(0x7f712813bdf0 legacy=0x7f71281d2b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 monclient: found mon.b 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7128131cf0 con 0x7f7128135870 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: _finish_auth 0 2024-04-26T00:05:06.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 5 monclient: authenticate success, global_id 7373 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: _renew_subs 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7128131fd0 con 0x7f7128135870 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: _renew_subs 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f71281311f0 con 0x7f7128135870 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f711c003c50 con 0x7f7128135870 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f711c0041c0 con 0x7f7128135870 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f71257fa640 4 set_mon_vals no callback set 2024-04-26T00:05:06.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: dump: 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.874 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f71080065d0 con 0x7f7108002870 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f711c004360 con 0x7f7128135870 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f711c045620 con 0x7f7128135870 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f71277fe640 10 monclient: get_auth_request con 0x7f7114037cd0 auth_method 0 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650880838 0 0) 0x7f71080065d0 con 0x7f7108002870 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient(hunting): my global_id is 145825 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f712809e6f0 con 0x7f7108002870 2024-04-26T00:05:06.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 316013978 0 0) 0x7f712809e6f0 con 0x7f7108002870 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f71080065d0 con 0x7f7108002870 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7118004ef0 con 0x7f7108002870 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.875+0000 7f710ffff640 10 monclient: dump: 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.876 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.879+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 315999842 0 0) 0x7f71080065d0 con 0x7f7108002870 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.879+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f710800a160 con 0x7f7108002870 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.879+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f71180050b0 con 0x7f7108002870 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.879+0000 7f710ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.879+0000 7f710ffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.879+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.171:6792/0 conn(0x7f7108002870 legacy=0x7f7108004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.879+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.171:6792/0 conn(0x7f7108002870 legacy=0x7f7108004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f712d8bf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7108009e50 con 0x7f7108009110 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 211126329 0 0) 0x7f7108009e50 con 0x7f7108009110 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f710ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f710ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f710ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f710ffff640 10 monclient(hunting): my global_id is 145834 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.883+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f71080065d0 con 0x7f7108009110 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2708996129 0 0) 0x7f71080065d0 con 0x7f7108009110 2024-04-26T00:05:06.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7108009e50 con 0x7f7108009110 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f71180057d0 con 0x7f7108009110 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 10 monclient: dump: 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:06.880 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1195943672 0 0) 0x7f7108009e50 con 0x7f7108009110 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f710800c3e0 con 0x7f7108009110 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2777323443) 0x7f7118007b70 con 0x7f7108009110 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.171:6792/0 conn(0x7f7108009110 legacy=0x7f71080095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f710ffff640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.171:6792/0 conn(0x7f7108009110 legacy=0x7f71080095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 72, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 370420, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:06.882 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.883 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.884 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:06.885 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:06.886 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.889 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.890 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:06.891 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.892 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.893 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.894 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.895 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:06.896 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.897 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:06.898 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.899 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:06.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:06.901 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:06.901 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:06.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.171:6812/722422047 conn(0x7f7114037cd0 legacy=0x7f711403a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 10 monclient: shutdown 2024-04-26T00:05:06.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:06.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 >> v1:172.21.15.106:6790/0 conn(0x7f7128135870 legacy=0x7f71281cf440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:06.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f71277fe640 1 -- 172.21.15.106:0/2752100507 reap_dead start 2024-04-26T00:05:06.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f71277fe640 1 -- 172.21.15.106:0/2752100507 reap_dead start 2024-04-26T00:05:06.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 shutdown_connections 2024-04-26T00:05:06.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 >> 172.21.15.106:0/2752100507 conn(0x7f71280a64e0 msgr2=0x7f71280a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:06.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 shutdown_connections 2024-04-26T00:05:06.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:06.887+0000 7f712d8bf640 1 -- 172.21.15.106:0/2752100507 wait complete. 2024-04-26T00:05:06.903 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:05:06.903 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['d'] 2024-04-26T00:05:06.904 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T00:05:06.904 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-04-26T00:05:06.904 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-04-26T00:05:06.904 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-04-26T00:05:06.904 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:05:06.917 INFO:tasks.ceph.mon.d:Stopped 2024-04-26T00:05:06.918 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-04-26T00:05:06.918 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:05:07.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient: get_monmap_and_config 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient: build_initial_monmap 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient: monmap: 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:07.100208+0000 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:07.100208+0000 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:07.075 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:07.076 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:07.076 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 1 Processor -- start 2024-04-26T00:05:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 1 -- start start 2024-04-26T00:05:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient: init 2024-04-26T00:05:07.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient: _add_conns ranks=[4,8,1,2,0,5,6,7,3] 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient(hunting): picked mon.noname-c con 0x7f40640a1c30 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient(hunting): picked mon.noname-e con 0x7f40640a2010 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient(hunting): picked mon.noname-f con 0x7f406413dc40 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406409c5b0 con 0x7f406413dc40 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f406409c2d0 con 0x7f40640a1c30 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40640a3a70 con 0x7f40640a2010 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406c504640 10 monclient(hunting): authenticate will time out at 1562.627403s 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f4069a9f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f40640a2010 0x7f40640a23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:57852/0 (socket says 172.21.15.106:57852) 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f406a2a0640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f40640a1c30 0x7f406409aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55142/0 (socket says 172.21.15.106:55142) 2024-04-26T00:05:07.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:07.095+0000 7f4069a9f640 1 -- 172.21.15.106:0/1905203290 learned_addr learned my addr 172.21.15.106:0/1905203290 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:10.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient(hunting): tick 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 1 monclient(hunting): continuing hunt 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6793/0 conn(0x7f40640a2010 legacy=0x7f40640a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6791/0 conn(0x7f40640a1c30 legacy=0x7f406409aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6789/0 conn(0x7f406413dc40 legacy=0x7f4064140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient: _add_conns ranks=[7,2,5,6,0,3] 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-i con 0x7f40500037f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-b con 0x7f4050007480 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-h con 0x7f405000b1f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4064144780 con 0x7f4050007480 2024-04-26T00:05:10.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405000ffe0 con 0x7f405000b1f0 2024-04-26T00:05:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050011270 con 0x7f40500037f0 2024-04-26T00:05:10.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:10.099+0000 7f4063fff640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient(hunting): tick 2024-04-26T00:05:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:05:13.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 1 monclient(hunting): continuing hunt 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6792/0 conn(0x7f40500037f0 legacy=0x7f4050005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6791/0 conn(0x7f405000b1f0 legacy=0x7f405000d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6790/0 conn(0x7f4050007480 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 reap_dead start 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient: _add_conns ranks=[0,3,6] 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-a con 0x7f4050010430 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 reap_dead start 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-g con 0x7f4050011440 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-d con 0x7f4050011820 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050012500 con 0x7f4050010430 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050011e30 con 0x7f4050011440 2024-04-26T00:05:13.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050012090 con 0x7f4050011820 2024-04-26T00:05:13.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f4063fff640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:13.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.099+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:13.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.303+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:13.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:13.707+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:14.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:14.511+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient(hunting): tick 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 1 monclient(hunting): continuing hunt 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6790/0 conn(0x7f4050011440 legacy=0x7f405000d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6789/0 conn(0x7f4050010430 legacy=0x7f4050010870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient: _add_conns ranks=[5,6,8,2,1,0,3,7,4] 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-h con 0x7f4050005e90 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-d con 0x7f4050011820 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:16.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-e con 0x7f405000f650 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:16.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050005bf0 con 0x7f4050005e90 2024-04-26T00:05:16.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050012090 con 0x7f4050011820 2024-04-26T00:05:16.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405000fc00 con 0x7f405000f650 2024-04-26T00:05:16.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4063fff640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:16.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.099+0000 7f4069a9f640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:16.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.303+0000 7f4069a9f640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:16.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:16.707+0000 7f4069a9f640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:17.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:17.511+0000 7f4069a9f640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient(hunting): tick 2024-04-26T00:05:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:05:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 1 monclient(hunting): continuing hunt 2024-04-26T00:05:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:05:19.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6793/0 conn(0x7f405000f650 legacy=0x7f4050017860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6792/0 conn(0x7f4050011820 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6791/0 conn(0x7f4050005e90 legacy=0x7f405000ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient: _add_conns ranks=[2,0,4,7,1,3] 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 reap_dead start 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-b con 0x7f4050019040 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-a con 0x7f405000f650 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-c con 0x7f4050010870 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405001bfb0 con 0x7f405000f650 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050012090 con 0x7f4050019040 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050010c90 con 0x7f4050010870 2024-04-26T00:05:19.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:19.099+0000 7f4063fff640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:22.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient(hunting): tick 2024-04-26T00:05:22.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 1 monclient(hunting): continuing hunt 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6791/0 conn(0x7f4050010870 legacy=0x7f405000d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6790/0 conn(0x7f4050019040 legacy=0x7f405001b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6789/0 conn(0x7f405000f650 legacy=0x7f405000ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient: _add_conns ranks=[3,1,7] 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-g con 0x7f405000de60 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-f con 0x7f405000e2a0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-i con 0x7f4050016920 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405001bbe0 con 0x7f405000e2a0 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405001f8c0 con 0x7f405000de60 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050020ae0 con 0x7f4050016920 2024-04-26T00:05:22.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:22.099+0000 7f4063fff640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient(hunting): tick 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 1 monclient(hunting): continuing hunt 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6792/0 conn(0x7f4050016920 legacy=0x7f405001d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6790/0 conn(0x7f405000de60 legacy=0x7f4050009940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6789/0 conn(0x7f405000e2a0 legacy=0x7f405000e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient: _add_conns ranks=[4,0,1,7,3,2,8,6,5] 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-c con 0x7f4050010870 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-a con 0x7f405000f650 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f406aaa1640 1 -- 172.21.15.106:0/1905203290 reap_dead start 2024-04-26T00:05:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient(hunting): picked mon.noname-f con 0x7f405001fc10 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4050021d50 con 0x7f405000f650 2024-04-26T00:05:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40500207a0 con 0x7f405001fc10 2024-04-26T00:05:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405000e6b0 con 0x7f4050010870 2024-04-26T00:05:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:25.103+0000 7f4063fff640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:26.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.671+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2019999588 0 0) 0x7f4050021d50 con 0x7f405000f650 2024-04-26T00:05:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.671+0000 7f406929e640 10 monclient(hunting): _negotiate 2024-04-26T00:05:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.671+0000 7f406929e640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.671+0000 7f406929e640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.671+0000 7f406929e640 10 monclient(hunting): my global_id is 7587 2024-04-26T00:05:26.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.671+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f404c003530 con 0x7f405000f650 2024-04-26T00:05:26.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 882594629 0 0) 0x7f404c003530 con 0x7f405000f650 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6791/0 conn(0x7f4050010870 legacy=0x7f405000d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.171:6789/0 conn(0x7f405001fc10 legacy=0x7f405001fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: _finish_hunting 0 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 monclient: found mon.noname-a 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4050016920 con 0x7f405000f650 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: _finish_auth 0 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: _check_auth_tickets 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4058001ac0 con 0x7f405000f650 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:26.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: dump: 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:26.657 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406c504640 5 monclient: authenticate success, global_id 7587 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406c504640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4058001d20 con 0x7f405000f650 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 1 -- 172.21.15.106:0/1905203290 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4058001fd0 con 0x7f405000f650 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406929e640 10 monclient: dump: 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:26.658 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:26.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406c504640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:26.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.675+0000 7f406c504640 4 set_mon_vals no callback set 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient: shutdown 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- 172.21.15.106:0/1905203290 >> v1:172.21.15.106:6789/0 conn(0x7f405000f650 legacy=0x7f405000ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- 172.21.15.106:0/1905203290 shutdown_connections 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- 172.21.15.106:0/1905203290 >> 172.21.15.106:0/1905203290 conn(0x7f40640a2d20 msgr2=0x7f40640a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- 172.21.15.106:0/1905203290 shutdown_connections 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- 172.21.15.106:0/1905203290 wait complete. 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient: build_initial_monmap 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient: monmap: 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:26.662 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 Processor -- start 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- start start 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient: init 2024-04-26T00:05:26.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient: _add_conns ranks=[7,6,1,8,4,0,5,3,2] 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient(hunting): picked mon.noname-i con 0x7f405000f650 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient(hunting): picked mon.noname-d con 0x7f4050010870 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient(hunting): picked mon.noname-f con 0x7f405001fc10 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40641360d0 con 0x7f405001fc10 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4064135df0 con 0x7f4050010870 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4064134320 con 0x7f405000f650 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f406c504640 10 monclient(hunting): authenticate will time out at 1582.211741s 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.679+0000 7f4069a9f640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f4050010870 legacy=0x7f40641d16c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.683+0000 7f406aaa1640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f405001fc10 0x7f40641d4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:37592/0 (socket says 172.21.15.106:37592) 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.683+0000 7f406a2a0640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f405000f650 0x7f4064137b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:33614/0 (socket says 172.21.15.106:33614) 2024-04-26T00:05:26.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.683+0000 7f406aaa1640 1 -- 172.21.15.106:0/973685183 learned_addr learned my addr 172.21.15.106:0/973685183 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087198975 0 0) 0x7f40500207a0 con 0x7f405001fc10 2024-04-26T00:05:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:05:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 10 monclient(hunting): my global_id is 224290 2024-04-26T00:05:26.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4050021d10 con 0x7f405001fc10 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 546839732 0 0) 0x7f4050021d10 con 0x7f405001fc10 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40500207a0 con 0x7f405001fc10 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f405c001870 con 0x7f405001fc10 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.699+0000 7f4062ffd640 10 monclient(hunting): dump: 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:26.681 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:26.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1740614578 0 0) 0x7f40500207a0 con 0x7f405001fc10 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 >> v1:172.21.15.171:6792/0 conn(0x7f405000f650 legacy=0x7f4064137b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 >> v1:172.21.15.106:6792/0 conn(0x7f4050010870 legacy=0x7f40641d16c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 monclient: found mon.f 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4064131d20 con 0x7f405001fc10 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: _finish_auth 0 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 5 monclient: authenticate success, global_id 224290 2024-04-26T00:05:26.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 10 monclient: _renew_subs 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4064134320 con 0x7f405001fc10 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 10 monclient: _renew_subs 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4064136e10 con 0x7f405001fc10 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f405c001d40 con 0x7f405001fc10 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f405c0039c0 con 0x7f405001fc10 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4068a9d640 4 set_mon_vals no callback set 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 10 monclient: dump: 2024-04-26T00:05:26.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:26.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f405c003be0 con 0x7f405001fc10 2024-04-26T00:05:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4044005090 con 0x7f405001fc10 2024-04-26T00:05:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f405c044de0 con 0x7f405001fc10 2024-04-26T00:05:26.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.703+0000 7f406a2a0640 10 monclient: get_auth_request con 0x7f405003d0a0 auth_method 0 2024-04-26T00:05:26.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.719+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f40641360d0 con 0x7f405001fc10 2024-04-26T00:05:26.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.719+0000 7f4062ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:26.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.719+0000 7f4062ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:26.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:05:26.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:05:26.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:05:26.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4044005380 con 0x7f405001fc10 2024-04-26T00:05:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f4062ffd640 1 -- 172.21.15.106:0/973685183 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2738 (unknown 254746657 0 1359235058) 0x7f406409c5b0 con 0x7f405001fc10 2024-04-26T00:05:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f4062ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:05:26.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f4062ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:26.922 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":78,"quorum":[0,1,2,3,4,5,7,8],"quorum_names":["a","f","b","g","c","h","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:05:26.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 >> v1:172.21.15.171:6812/722422047 conn(0x7f405003d0a0 legacy=0x7f405003f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:26.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 10 monclient: shutdown 2024-04-26T00:05:26.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:26.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 >> v1:172.21.15.171:6789/0 conn(0x7f405001fc10 legacy=0x7f40641d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:26.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 shutdown_connections 2024-04-26T00:05:26.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 >> 172.21.15.106:0/973685183 conn(0x7f40640a2d20 msgr2=0x7f40640a4020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 shutdown_connections 2024-04-26T00:05:26.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:26.943+0000 7f406c504640 1 -- 172.21.15.106:0/973685183 wait complete. 2024-04-26T00:05:26.941 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-04-26T00:05:26.941 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-04-26T00:05:26.941 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:05:27.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.079+0000 7fc33b8ba640 10 monclient: get_monmap_and_config 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.079+0000 7fc33b8ba640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: monmap: 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:27.086363+0000 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:27.086363+0000 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.061 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.062 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.062 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.062 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.062 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.062 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.062 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 Processor -- start 2024-04-26T00:05:27.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- start start 2024-04-26T00:05:27.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: init 2024-04-26T00:05:27.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: _add_conns ranks=[1,0,8,4,3,5,2,6,7] 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient(hunting): picked mon.noname-f con 0x7fc334135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient(hunting): picked mon.noname-a con 0x7fc3341353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient(hunting): picked mon.noname-e con 0x7fc33413bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc33406f2d0 con 0x7fc3341353b0 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc334072330 con 0x7fc334135870 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc334072610 con 0x7fc33413bdf0 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient(hunting): authenticate will time out at 1582.613513s 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc338e55640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc3341353b0 0x7fc33413a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58238/0 (socket says 172.21.15.106:58238) 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc338e55640 1 -- 172.21.15.106:0/993056394 learned_addr learned my addr 172.21.15.106:0/993056394 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc339e57640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc33413bdf0 0x7fc33413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:38686/0 (socket says 172.21.15.106:38686) 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 692215437 0 0) 0x7fc33406f2d0 con 0x7fc3341353b0 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): my global_id is 7596 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc31c003530 con 0x7fc3341353b0 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921051065 0 0) 0x7fc334072610 con 0x7fc33413bdf0 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient(hunting): my global_id is 224252 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc33406f2d0 con 0x7fc33413bdf0 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2157067203 0 0) 0x7fc31c003530 con 0x7fc3341353b0 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 >> v1:172.21.15.106:6793/0 conn(0x7fc33413bdf0 legacy=0x7fc33413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 >> v1:172.21.15.171:6789/0 conn(0x7fc334135870 legacy=0x7fc334135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 monclient: found mon.noname-a 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3340a3260 con 0x7fc3341353b0 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc328001b40 con 0x7fc3341353b0 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 5 monclient: authenticate success, global_id 7596 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: dump: 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.073 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.074 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc328001e60 con 0x7fc3341353b0 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 1 -- 172.21.15.106:0/993056394 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3280020d0 con 0x7fc3341353b0 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc333fff640 10 monclient: dump: 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.075 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.076 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 4 set_mon_vals no callback set 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: shutdown 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- 172.21.15.106:0/993056394 >> v1:172.21.15.106:6789/0 conn(0x7fc3341353b0 legacy=0x7fc33413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- 172.21.15.106:0/993056394 shutdown_connections 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- 172.21.15.106:0/993056394 >> 172.21.15.106:0/993056394 conn(0x7fc3340a64e0 msgr2=0x7fc3340a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- 172.21.15.106:0/993056394 shutdown_connections 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 1 -- 172.21.15.106:0/993056394 wait complete. 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.083+0000 7fc33b8ba640 10 monclient: monmap: 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:27.077 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 Processor -- start 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 -- start start 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient: init 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient: _add_conns ranks=[8,3,2,0,1,6,4,5,7] 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient(hunting): picked mon.noname-e con 0x7fc3341353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient(hunting): picked mon.noname-g con 0x7fc334135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient(hunting): picked mon.noname-b con 0x7fc33413bdf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc334132e20 con 0x7fc33413bdf0 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc334134e30 con 0x7fc334135870 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc334135110 con 0x7fc3341353b0 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient(hunting): authenticate will time out at 1582.616769s 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc339656640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc3341353b0 0x7fc33413b190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:38696/0 (socket says 172.21.15.106:38696) 2024-04-26T00:05:27.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc339656640 1 -- 172.21.15.106:0/551840184 learned_addr learned my addr 172.21.15.106:0/551840184 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3182506208 0 0) 0x7fc334135110 con 0x7fc3341353b0 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): my global_id is 224261 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc320003530 con 0x7fc3341353b0 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655273884 0 0) 0x7fc334132e20 con 0x7fc33413bdf0 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): my global_id is 7382 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc334135110 con 0x7fc33413bdf0 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3379808728 0 0) 0x7fc334135110 con 0x7fc33413bdf0 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc334132e20 con 0x7fc33413bdf0 2024-04-26T00:05:27.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2938032961 0 0) 0x7fc320003530 con 0x7fc3341353b0 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc334135110 con 0x7fc3341353b0 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc32c0018f0 con 0x7fc33413bdf0 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): dump: 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.081 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc324001a40 con 0x7fc3341353b0 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): dump: 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.082 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931545957 0 0) 0x7fc334134e30 con 0x7fc334135870 2024-04-26T00:05:27.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): my global_id is 214473 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc320003530 con 0x7fc334135870 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 81815956 0 0) 0x7fc334132e20 con 0x7fc33413bdf0 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.106:6793/0 conn(0x7fc3341353b0 legacy=0x7fc33413b190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.171:6790/0 conn(0x7fc334135870 legacy=0x7fc3341cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 monclient: found mon.b 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3341336d0 con 0x7fc33413bdf0 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 5 monclient: authenticate success, global_id 7382 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient: _renew_subs 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc33413b8a0 con 0x7fc33413bdf0 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient: _renew_subs 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3341c9f40 con 0x7fc33413bdf0 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc32c001c80 con 0x7fc33413bdf0 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc32c004de0 con 0x7fc33413bdf0 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:27.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc3337fe640 4 set_mon_vals no callback set 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: dump: 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.086 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3140065d0 con 0x7fc314002870 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc32c00fb80 con 0x7fc33413bdf0 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1505284097 0 0) 0x7fc3140065d0 con 0x7fc314002870 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient(hunting): my global_id is 7605 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc334132e20 con 0x7fc314002870 2024-04-26T00:05:27.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fc32c044fe0 con 0x7fc33413bdf0 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2953103944 0 0) 0x7fc334132e20 con 0x7fc314002870 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3140065d0 con 0x7fc314002870 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc324003c90 con 0x7fc314002870 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: dump: 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.088 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc338e55640 10 monclient: get_auth_request con 0x7fc320037da0 auth_method 0 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1049338563 0 0) 0x7fc3140065d0 con 0x7fc314002870 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc31400a160 con 0x7fc314002870 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc3240040f0 con 0x7fc314002870 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:27.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.106:6789/0 conn(0x7fc314002870 legacy=0x7fc314004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.087+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.106:6789/0 conn(0x7fc314002870 legacy=0x7fc314004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc314009e30 con 0x7fc3140090f0 2024-04-26T00:05:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3004993663 0 0) 0x7fc314009e30 con 0x7fc3140090f0 2024-04-26T00:05:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient(hunting): my global_id is 7614 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3140065d0 con 0x7fc3140090f0 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 875754575 0 0) 0x7fc3140065d0 con 0x7fc3140090f0 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc314009e30 con 0x7fc3140090f0 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc324005af0 con 0x7fc3140090f0 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient: dump: 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.092 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 287268847 0 0) 0x7fc314009e30 con 0x7fc3140090f0 2024-04-26T00:05:27.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc31400c3a0 con 0x7fc3140090f0 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 3123093059) 0x7fc324007020 con 0x7fc3140090f0 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.106:6789/0 conn(0x7fc3140090f0 legacy=0x7fc314009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc331ffb640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.106:6789/0 conn(0x7fc3140090f0 legacy=0x7fc314009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:27.094 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 645654, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:27.095 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:27.096 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:27.097 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.098 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:27.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:27.101 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:27.103 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.108 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.109 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:27.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:27.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:27.113 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:27.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.171:6812/722422047 conn(0x7fc320037da0 legacy=0x7fc32003a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 10 monclient: shutdown 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 >> v1:172.21.15.106:6790/0 conn(0x7fc33413bdf0 legacy=0x7fc3341d2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc339e57640 1 -- 172.21.15.106:0/551840184 reap_dead start 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc339e57640 1 -- 172.21.15.106:0/551840184 reap_dead start 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 shutdown_connections 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 >> 172.21.15.106:0/551840184 conn(0x7fc3340a64e0 msgr2=0x7fc3340a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 shutdown_connections 2024-04-26T00:05:27.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.095+0000 7fc33b8ba640 1 -- 172.21.15.106:0/551840184 wait complete. 2024-04-26T00:05:27.115 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:27.115 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-04-26T00:05:27.116 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:05:27.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.251+0000 7f8adafba640 10 monclient: get_monmap_and_config 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.251+0000 7f8adafba640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.251+0000 7f8adafba640 10 monclient: monmap: 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:27.258294+0000 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:27.258294+0000 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.233 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.234 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.234 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 Processor -- start 2024-04-26T00:05:27.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- start start 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient: init 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient: _add_conns ranks=[7,3,1,0,8,2,4,6,5] 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient(hunting): picked mon.noname-i con 0x7f8ad4134820 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient(hunting): picked mon.noname-g con 0x7f8ad40725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient(hunting): picked mon.noname-f con 0x7f8ad413ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad4071270 con 0x7f8ad413ace0 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad40714e0 con 0x7f8ad40725d0 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad40729f0 con 0x7f8ad4134820 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient(hunting): authenticate will time out at 1582.785468s 2024-04-26T00:05:27.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad9557640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f8ad413ace0 0x7f8ad413d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:37616/0 (socket says 172.21.15.106:37616) 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad9557640 1 -- 172.21.15.106:0/3721673536 learned_addr learned my addr 172.21.15.106:0/3721673536 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3507008846 0 0) 0x7f8ac4001120 con 0x7f8ad40725d0 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): my global_id is 214482 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac0005740 con 0x7f8ad40725d0 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 299402877 0 0) 0x7f8ad4071270 con 0x7f8ad413ace0 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): my global_id is 224308 2024-04-26T00:05:27.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ac4001120 con 0x7f8ad413ace0 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211437673 0 0) 0x7f8ad40729f0 con 0x7f8ad4134820 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient(hunting): my global_id is 145843 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad4071270 con 0x7f8ad4134820 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3660834255 0 0) 0x7f8ac4001120 con 0x7f8ad413ace0 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 >> v1:172.21.15.171:6792/0 conn(0x7f8ad4134820 legacy=0x7f8ad4134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 >> v1:172.21.15.171:6790/0 conn(0x7f8ad40725d0 legacy=0x7f8ad41395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 monclient: found mon.noname-f 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad40717c0 con 0x7f8ad413ace0 2024-04-26T00:05:27.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8acc001b20 con 0x7f8ad413ace0 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: dump: 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.246 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 5 monclient: authenticate success, global_id 224308 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8acc001e80 con 0x7f8ad413ace0 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:27.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 4 set_mon_vals no callback set 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 1 -- 172.21.15.106:0/3721673536 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8acc004f70 con 0x7f8ad413ace0 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8ad37fe640 10 monclient: dump: 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.248 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 10 monclient: shutdown 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- 172.21.15.106:0/3721673536 >> v1:172.21.15.171:6789/0 conn(0x7f8ad413ace0 legacy=0x7f8ad413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- 172.21.15.106:0/3721673536 shutdown_connections 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- 172.21.15.106:0/3721673536 >> 172.21.15.106:0/3721673536 conn(0x7f8ad40a64e0 msgr2=0x7f8ad40a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- 172.21.15.106:0/3721673536 shutdown_connections 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.255+0000 7f8adafba640 1 -- 172.21.15.106:0/3721673536 wait complete. 2024-04-26T00:05:27.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: monmap: 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.250 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 Processor -- start 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 -- start start 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: init 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: _add_conns ranks=[6,8,2,1,4,3,7,5,0] 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient(hunting): picked mon.noname-d con 0x7f8ad40725d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient(hunting): picked mon.noname-e con 0x7f8ad4134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient(hunting): picked mon.noname-b con 0x7f8ad413ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad41304d0 con 0x7f8ad413ace0 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad41307b0 con 0x7f8ad40725d0 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ad4130a90 con 0x7f8ad4134820 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient(hunting): authenticate will time out at 1582.789238s 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad8d56640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f8ad40725d0 legacy=0x7f8ad41c9380 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad9557640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f8ad413ace0 0x7f8ad41d4e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:53646/0 (socket says 172.21.15.106:53646) 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad9557640 1 -- 172.21.15.106:0/2687763281 learned_addr learned my addr 172.21.15.106:0/2687763281 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad3fff640 1 --1- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6793/0 conn(0x7f8ad4134820 0x7f8ad41d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:38702/0 (socket says 172.21.15.106:38702) 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472260057 0 0) 0x7f8ad4130a90 con 0x7f8ad4134820 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): my global_id is 224270 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab4003530 con 0x7f8ad4134820 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2353461232 0 0) 0x7f8ad41304d0 con 0x7f8ad413ace0 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): my global_id is 7391 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad4130a90 con 0x7f8ad413ace0 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3351813459 0 0) 0x7f8ab4003530 con 0x7f8ad4134820 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ad41304d0 con 0x7f8ad4134820 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ac4001c50 con 0x7f8ad4134820 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): dump: 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.253 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2886607130 0 0) 0x7f8ad4130a90 con 0x7f8ad413ace0 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ab4003530 con 0x7f8ad413ace0 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8acc001ae0 con 0x7f8ad413ace0 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:27.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): dump: 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.255 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2086126374 0 0) 0x7f8ad41304d0 con 0x7f8ad4134820 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6792/0 conn(0x7f8ad40725d0 legacy=0x7f8ad41c9380 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6790/0 conn(0x7f8ad413ace0 legacy=0x7f8ad41d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 monclient: found mon.e 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ad412e8f0 con 0x7f8ad4134820 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 5 monclient: authenticate success, global_id 224270 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: _renew_subs 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8ad4133b50 con 0x7f8ad4134820 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: _renew_subs 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f8ad41c9a90 con 0x7f8ad4134820 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8ac40038d0 con 0x7f8ad4134820 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8ac4003e40 con 0x7f8ad4134820 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad2ffd640 4 set_mon_vals no callback set 2024-04-26T00:05:27.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: dump: 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.258 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8ab80065d0 con 0x7f8ab8002870 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8ac4003fe0 con 0x7f8ad4134820 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f8ac4044f30 con 0x7f8ad4134820 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334263312 0 0) 0x7f8ab80065d0 con 0x7f8ab8002870 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient(hunting): my global_id is 7400 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ad41304d0 con 0x7f8ab8002870 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1154859939 0 0) 0x7f8ad41304d0 con 0x7f8ab8002870 2024-04-26T00:05:27.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ab80065d0 con 0x7f8ab8002870 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8abc001830 con 0x7f8ab8002870 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad9557640 10 monclient: get_auth_request con 0x7f8ab4037c60 auth_method 0 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.259+0000 7f8ad17fa640 10 monclient: dump: 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.260 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.263+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2750622487 0 0) 0x7f8ab80065d0 con 0x7f8ab8002870 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.263+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ab800a160 con 0x7f8ab8002870 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.263+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8abc001ca0 con 0x7f8ab8002870 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.263+0000 7f8ad17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.263+0000 7f8ad17fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.263+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6790/0 conn(0x7f8ab8002870 legacy=0x7f8ab8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.263+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6790/0 conn(0x7f8ab8002870 legacy=0x7f8ab8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8adafba640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8ab8009e30 con 0x7f8ab80090f0 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4277176411 0 0) 0x7f8ab8009e30 con 0x7f8ab80090f0 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient(hunting): my global_id is 7409 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ab80065d0 con 0x7f8ab80090f0 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2120464024 0 0) 0x7f8ab80065d0 con 0x7f8ab80090f0 2024-04-26T00:05:27.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ab8009e30 con 0x7f8ab80090f0 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8abc003c50 con 0x7f8ab80090f0 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient: dump: 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.264 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 461099451 0 0) 0x7f8ab8009e30 con 0x7f8ab80090f0 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ab800c3a0 con 0x7f8ab80090f0 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7724 (unknown 0 0 3732229595) 0x7f8abc003f00 con 0x7f8ab80090f0 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6790/0 conn(0x7f8ab80090f0 legacy=0x7f8ab8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad17fa640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6790/0 conn(0x7f8ab80090f0 legacy=0x7f8ab8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 645830, 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:27.266 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.267 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.268 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:27.269 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:27.270 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:27.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.273 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:27.275 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.276 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.278 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:27.281 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.282 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.283 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:27.284 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.171:6812/722422047 conn(0x7f8ab4037c60 legacy=0x7f8ab403a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8adafba640 10 monclient: shutdown 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8adafba640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 >> v1:172.21.15.106:6793/0 conn(0x7f8ad4134820 legacy=0x7f8ad41d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad9557640 1 -- 172.21.15.106:0/2687763281 reap_dead start 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.267+0000 7f8ad9557640 1 -- 172.21.15.106:0/2687763281 reap_dead start 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.271+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 shutdown_connections 2024-04-26T00:05:27.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.271+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 >> 172.21.15.106:0/2687763281 conn(0x7f8ad40a64e0 msgr2=0x7f8ad40a1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.271+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 shutdown_connections 2024-04-26T00:05:27.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.271+0000 7f8adafba640 1 -- 172.21.15.106:0/2687763281 wait complete. 2024-04-26T00:05:27.287 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:27.287 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-04-26T00:05:27.287 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: get_monmap_and_config 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: monmap: 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:27.426698+0000 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:27.426698+0000 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.401 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.402 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 Processor -- start 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- start start 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: init 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: _add_conns ranks=[5,3,0,6,2,7,1,4,8] 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient(hunting): picked mon.noname-h con 0x7f01c40a16f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient(hunting): picked mon.noname-g con 0x7f01c409bf70 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient(hunting): picked mon.noname-a con 0x7f01c40a21e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:27.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c409cc80 con 0x7f01c40a21e0 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c409a9a0 con 0x7f01c409bf70 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c409f9c0 con 0x7f01c40a16f0 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient(hunting): authenticate will time out at 1582.953864s 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c998b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f01c40a21e0 0x7f01c413e0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58262/0 (socket says 172.21.15.106:58262) 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c998b640 1 -- 172.21.15.106:0/1136527070 learned_addr learned my addr 172.21.15.106:0/1136527070 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100774009 0 0) 0x7f01c409cc80 con 0x7f01c40a21e0 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient(hunting): my global_id is 7623 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01ac003530 con 0x7f01c40a21e0 2024-04-26T00:05:27.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2634182562 0 0) 0x7f01ac003530 con 0x7f01c40a21e0 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 >> v1:172.21.15.171:6791/0 conn(0x7f01c40a16f0 legacy=0x7f01c40a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 >> v1:172.21.15.171:6790/0 conn(0x7f01c409bf70 legacy=0x7f01c413a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 monclient: found mon.noname-a 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c40a3150 con 0x7f01c40a21e0 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01b4001b40 con 0x7f01c40a21e0 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 5 monclient: authenticate success, global_id 7623 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: dump: 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.412 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01b4001da0 con 0x7f01c40a21e0 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 4 set_mon_vals no callback set 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 1 -- 172.21.15.106:0/1136527070 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01b4004f70 con 0x7f01c40a21e0 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:27.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01c3fff640 10 monclient: dump: 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 10 monclient: shutdown 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- 172.21.15.106:0/1136527070 >> v1:172.21.15.106:6789/0 conn(0x7f01c40a21e0 legacy=0x7f01c413e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- 172.21.15.106:0/1136527070 shutdown_connections 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- 172.21.15.106:0/1136527070 >> 172.21.15.106:0/1136527070 conn(0x7f01c40a62e0 msgr2=0x7f01c40a27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- 172.21.15.106:0/1136527070 shutdown_connections 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.423+0000 7f01cb3ee640 1 -- 172.21.15.106:0/1136527070 wait complete. 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: monmap: 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:27.415 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 Processor -- start 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 -- start start 2024-04-26T00:05:27.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: init 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: _add_conns ranks=[8,1,0,6,4,3,2,7,5] 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient(hunting): picked mon.noname-e con 0x7f01c409bf70 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient(hunting): picked mon.noname-f con 0x7f01c40a16f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient(hunting): picked mon.noname-a con 0x7f01c40a21e0 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c413e490 con 0x7f01c40a21e0 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c409c950 con 0x7f01c40a16f0 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01c411cb00 con 0x7f01c409bf70 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient(hunting): authenticate will time out at 1582.957167s 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c918a640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f01c409bf70 0x7f01c41c6f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:38706/0 (socket says 172.21.15.106:38706) 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c998b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f01c40a21e0 0x7f01c41d2340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58268/0 (socket says 172.21.15.106:58268) 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c918a640 1 -- 172.21.15.106:0/809805672 learned_addr learned my addr 172.21.15.106:0/809805672 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 177173527 0 0) 0x7f01c411cb00 con 0x7f01c409bf70 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): my global_id is 224279 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01b0003530 con 0x7f01c409bf70 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640708148 0 0) 0x7f01c413e490 con 0x7f01c40a21e0 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): my global_id is 7632 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c411cb00 con 0x7f01c40a21e0 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3365412314 0 0) 0x7f01b0003530 con 0x7f01c409bf70 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01c413e490 con 0x7f01c409bf70 2024-04-26T00:05:27.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01bc001a50 con 0x7f01c409bf70 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): dump: 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.419 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1558289388 0 0) 0x7f01c411cb00 con 0x7f01c40a21e0 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01b0003530 con 0x7f01c40a21e0 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01b4001a40 con 0x7f01c40a21e0 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): dump: 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.420 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493699079 0 0) 0x7f01c409c950 con 0x7f01c40a16f0 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): my global_id is 224317 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c411cb00 con 0x7f01c40a16f0 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3022395490 0 0) 0x7f01c413e490 con 0x7f01c409bf70 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.171:6789/0 conn(0x7f01c40a16f0 legacy=0x7f01c4135a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.106:6789/0 conn(0x7f01c40a21e0 legacy=0x7f01c41d2340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 monclient: found mon.e 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01c411cde0 con 0x7f01c409bf70 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 5 monclient: authenticate success, global_id 224279 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: _renew_subs 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f01c4136130 con 0x7f01c409bf70 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: _renew_subs 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f01c413f3e0 con 0x7f01c409bf70 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01bc003950 con 0x7f01c409bf70 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01bc003ec0 con 0x7f01c409bf70 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c37fe640 4 set_mon_vals no callback set 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: dump: 2024-04-26T00:05:27.423 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.424 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f01a40065d0 con 0x7f01a4002870 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f01bc0040e0 con 0x7f01c409bf70 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f01bc045230 con 0x7f01c409bf70 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629515790 0 0) 0x7f01a40065d0 con 0x7f01a4002870 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient(hunting): my global_id is 145984 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01c413e490 con 0x7f01a4002870 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3954844649 0 0) 0x7f01c413e490 con 0x7f01a4002870 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01a40065d0 con 0x7f01a4002870 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01b80018c0 con 0x7f01a4002870 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c998b640 10 monclient: get_auth_request con 0x7f01b0037de0 auth_method 0 2024-04-26T00:05:27.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 10 monclient: dump: 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.426 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 240769599 0 0) 0x7f01a40065d0 con 0x7f01a4002870 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.427+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f01a400a160 con 0x7f01a4002870 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.431+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f01b8001cf0 con 0x7f01a4002870 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.431+0000 7f01c1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.431+0000 7f01c1ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.431+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.106:6791/0 conn(0x7f01a4002870 legacy=0x7f01a4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.431+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.106:6791/0 conn(0x7f01a4002870 legacy=0x7f01a4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f01a4009e50 con 0x7f01a4009110 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3491992523 0 0) 0x7f01a4009e50 con 0x7f01a4009110 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient(hunting): my global_id is 145993 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f01a40065d0 con 0x7f01a4009110 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1280888451 0 0) 0x7f01a40065d0 con 0x7f01a4009110 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f01a4009e50 con 0x7f01a4009110 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01b8003bb0 con 0x7f01a4009110 2024-04-26T00:05:27.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient: dump: 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.430 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1699371141 0 0) 0x7f01a4009e50 con 0x7f01a4009110 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f01a400c3e0 con 0x7f01a4009110 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7894 (unknown 0 0 2133668546) 0x7f01b8003fa0 con 0x7f01a4009110 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.106:6791/0 conn(0x7f01a4009110 legacy=0x7f01a40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c1ffb640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.106:6791/0 conn(0x7f01a4009110 legacy=0x7f01a40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.431 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 390966, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:27.432 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.433 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.434 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:27.435 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.436 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:27.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.440 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.441 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:27.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:27.445 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.446 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.448 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:05:27.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:27.450 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:27.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.171:6812/722422047 conn(0x7f01b0037de0 legacy=0x7f01b003a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 10 monclient: shutdown 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 >> v1:172.21.15.106:6793/0 conn(0x7f01c409bf70 legacy=0x7f01c41c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c998b640 1 -- 172.21.15.106:0/809805672 reap_dead start 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01c998b640 1 -- 172.21.15.106:0/809805672 reap_dead start 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 shutdown_connections 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 >> 172.21.15.106:0/809805672 conn(0x7f01c40a62e0 msgr2=0x7f01c40a4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 shutdown_connections 2024-04-26T00:05:27.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.435+0000 7f01cb3ee640 1 -- 172.21.15.106:0/809805672 wait complete. 2024-04-26T00:05:27.452 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:27.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-04-26T00:05:27.453 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:05:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.587+0000 7fb5451ef640 10 monclient: get_monmap_and_config 2024-04-26T00:05:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.587+0000 7fb5451ef640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.587+0000 7fb5451ef640 10 monclient: monmap: 2024-04-26T00:05:27.568 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:27.594198+0000 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:27.594198+0000 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.569 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 Processor -- start 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- start start 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: init 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: _add_conns ranks=[7,4,0,1,2,5,6,8,3] 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient(hunting): picked mon.noname-i con 0x7fb540134760 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient(hunting): picked mon.noname-c con 0x7fb5400a0d70 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient(hunting): picked mon.noname-a con 0x7fb54013df70 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54006b910 con 0x7fb54013df70 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb54009fac0 con 0x7fb5400a0d70 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb5400a0080 con 0x7fb540134760 2024-04-26T00:05:27.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient(hunting): authenticate will time out at 1583.121351s 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53e59c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fb5400a0d70 0x7fb54013c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:37220/0 (socket says 172.21.15.106:37220) 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53e59c640 1 -- 172.21.15.106:0/4152532156 learned_addr learned my addr 172.21.15.106:0/4152532156 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283918928 0 0) 0x7fb54009fac0 con 0x7fb5400a0d70 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): my global_id is 146002 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb528003530 con 0x7fb5400a0d70 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595993307 0 0) 0x7fb54006b910 con 0x7fb54013df70 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient(hunting): my global_id is 7641 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb54009fac0 con 0x7fb54013df70 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1379034704 0 0) 0x7fb528003530 con 0x7fb5400a0d70 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 >> v1:172.21.15.171:6792/0 conn(0x7fb540134760 legacy=0x7fb540134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 >> v1:172.21.15.106:6789/0 conn(0x7fb54013df70 legacy=0x7fb540140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 monclient: found mon.noname-c 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb54009f280 con 0x7fb5400a0d70 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb5340017c0 con 0x7fb5400a0d70 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 5 monclient: authenticate success, global_id 146002 2024-04-26T00:05:27.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: dump: 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.580 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb534001ae0 con 0x7fb5400a0d70 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 1 -- 172.21.15.106:0/4152532156 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb534004bf0 con 0x7fb5400a0d70 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 4 set_mon_vals no callback set 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb53dd9b640 10 monclient: dump: 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.581 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: shutdown 2024-04-26T00:05:27.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- 172.21.15.106:0/4152532156 >> v1:172.21.15.106:6791/0 conn(0x7fb5400a0d70 legacy=0x7fb54013c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- 172.21.15.106:0/4152532156 shutdown_connections 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- 172.21.15.106:0/4152532156 >> 172.21.15.106:0/4152532156 conn(0x7fb5400a7240 msgr2=0x7fb5400a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- 172.21.15.106:0/4152532156 shutdown_connections 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- 172.21.15.106:0/4152532156 wait complete. 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: monmap: 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.583 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 Processor -- start 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 1 -- start start 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.591+0000 7fb5451ef640 10 monclient: init 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient: _add_conns ranks=[6,0,1,5,2,4,8,7,3] 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient(hunting): picked mon.noname-d con 0x7fb5400a0d70 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:27.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient(hunting): picked mon.noname-a con 0x7fb540134760 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient(hunting): picked mon.noname-f con 0x7fb54013df70 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb540139760 con 0x7fb540134760 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb540072930 con 0x7fb54013df70 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb540072500 con 0x7fb5400a0d70 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb53ed9d640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7fb5400a0d70 legacy=0x7fb540135aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient(hunting): authenticate will time out at 1583.124252s 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb53e59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb540134760 0x7fb5401361b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58278/0 (socket says 172.21.15.106:58278) 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb53e59c640 1 -- 172.21.15.106:0/2217915182 learned_addr learned my addr 172.21.15.106:0/2217915182 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3490265006 0 0) 0x7fb540139760 con 0x7fb540134760 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): my global_id is 7650 2024-04-26T00:05:27.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb52c003530 con 0x7fb540134760 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3272704728 0 0) 0x7fb52c003530 con 0x7fb540134760 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb540139760 con 0x7fb540134760 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb534004b30 con 0x7fb540134760 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): dump: 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.586 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2629901152 0 0) 0x7fb540139760 con 0x7fb540134760 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.106:6792/0 conn(0x7fb5400a0d70 legacy=0x7fb540135aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.171:6789/0 conn(0x7fb54013df70 legacy=0x7fb5401d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 monclient: found mon.a 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb540139480 con 0x7fb540134760 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 5 monclient: authenticate success, global_id 7650 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient: _renew_subs 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb54013d030 con 0x7fb540134760 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient: _renew_subs 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb540136a90 con 0x7fb540134760 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb534001ae0 con 0x7fb540134760 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb534001d10 con 0x7fb540134760 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb53d59a640 4 set_mon_vals no callback set 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: dump: 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.589 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb5200065d0 con 0x7fb520002870 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb5340100e0 con 0x7fb540134760 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7fb534045230 con 0x7fb540134760 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3383385883 0 0) 0x7fb5200065d0 con 0x7fb520002870 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient(hunting): my global_id is 224288 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb540139760 con 0x7fb520002870 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3675181871 0 0) 0x7fb540139760 con 0x7fb520002870 2024-04-26T00:05:27.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb5200065d0 con 0x7fb520002870 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb530001820 con 0x7fb520002870 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: dump: 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.591 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb53f59e640 10 monclient: get_auth_request con 0x7fb52c0376c0 auth_method 0 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3541245218 0 0) 0x7fb5200065d0 con 0x7fb520002870 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb52000a160 con 0x7fb520002870 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb5300057d0 con 0x7fb520002870 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.106:6793/0 conn(0x7fb520002870 legacy=0x7fb520004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.595+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.106:6793/0 conn(0x7fb520002870 legacy=0x7fb520004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb520009e50 con 0x7fb520009110 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1600074462 0 0) 0x7fb520009e50 con 0x7fb520009110 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient(hunting): my global_id is 224297 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb5200065d0 con 0x7fb520009110 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 699971387 0 0) 0x7fb5200065d0 con 0x7fb520009110 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb520009e50 con 0x7fb520009110 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb530003bb0 con 0x7fb520009110 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:27.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient: dump: 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.595 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4226064260 0 0) 0x7fb520009e50 con 0x7fb520009110 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb52000c3e0 con 0x7fb520009110 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7723 (unknown 0 0 299892763) 0x7fb530005980 con 0x7fb520009110 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.106:6793/0 conn(0x7fb520009110 legacy=0x7fb5200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5277fe640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.106:6793/0 conn(0x7fb520009110 legacy=0x7fb5200095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:27.596 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 40835, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.597 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.598 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.599 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:27.600 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.601 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:27.602 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.606 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.608 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.611 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.616 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:27.617 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:27.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.171:6812/722422047 conn(0x7fb52c0376c0 legacy=0x7fb52c039b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 10 monclient: shutdown 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 >> v1:172.21.15.106:6789/0 conn(0x7fb540134760 legacy=0x7fb5401361b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb53f59e640 1 -- 172.21.15.106:0/2217915182 reap_dead start 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb53f59e640 1 -- 172.21.15.106:0/2217915182 reap_dead start 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 shutdown_connections 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 >> 172.21.15.106:0/2217915182 conn(0x7fb5400a7240 msgr2=0x7fb5400a1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 shutdown_connections 2024-04-26T00:05:27.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.603+0000 7fb5451ef640 1 -- 172.21.15.106:0/2217915182 wait complete. 2024-04-26T00:05:27.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:27.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-04-26T00:05:27.620 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient: get_monmap_and_config 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient: monmap: 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:27.756639+0000 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:27.756639+0000 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.731 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.732 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.732 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.732 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.732 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.732 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.732 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 1 Processor -- start 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 1 -- start start 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient: init 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient: _add_conns ranks=[0,4,7,2,6,8,1,5,3] 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient(hunting): picked mon.noname-a con 0x7f5110137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient(hunting): picked mon.noname-c con 0x7f51100a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient(hunting): picked mon.noname-i con 0x7f5110138220 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100a2750 con 0x7f5110137730 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100a2a30 con 0x7f51100a0b20 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100a2d10 con 0x7f5110138220 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f511702b640 10 monclient(hunting): authenticate will time out at 1583.283651s 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f5114dc7640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5110137730 0x7f5110137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58294/0 (socket says 172.21.15.106:58294) 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f510ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f51100a0b20 0x7f511013ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:37222/0 (socket says 172.21.15.106:37222) 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.751+0000 7f5114dc7640 1 -- 172.21.15.106:0/4004879526 learned_addr learned my addr 172.21.15.106:0/4004879526 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1865197090 0 0) 0x7f51100a2a30 con 0x7f51100a0b20 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): my global_id is 146011 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f8003530 con 0x7f51100a0b20 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3641473354 0 0) 0x7f51100a2750 con 0x7f5110137730 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient(hunting): my global_id is 7659 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51100a2a30 con 0x7f5110137730 2024-04-26T00:05:27.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2551946852 0 0) 0x7f50f8003530 con 0x7f51100a0b20 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 >> v1:172.21.15.171:6792/0 conn(0x7f5110138220 legacy=0x7f5110140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 >> v1:172.21.15.106:6789/0 conn(0x7f5110137730 legacy=0x7f5110137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 monclient: found mon.noname-c 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51100a4680 con 0x7f51100a0b20 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51040017c0 con 0x7f51100a0b20 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 5 monclient: authenticate success, global_id 146011 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: dump: 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.743 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5104001ae0 con 0x7f51100a0b20 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 1 -- 172.21.15.106:0/4004879526 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5104004b30 con 0x7f51100a0b20 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510f7fe640 10 monclient: dump: 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.744 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 4 set_mon_vals no callback set 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient: shutdown 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- 172.21.15.106:0/4004879526 >> v1:172.21.15.106:6791/0 conn(0x7f51100a0b20 legacy=0x7f511013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- 172.21.15.106:0/4004879526 shutdown_connections 2024-04-26T00:05:27.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- 172.21.15.106:0/4004879526 >> 172.21.15.106:0/4004879526 conn(0x7f51100a6b80 msgr2=0x7f51100a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- 172.21.15.106:0/4004879526 shutdown_connections 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- 172.21.15.106:0/4004879526 wait complete. 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient: monmap: 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.746 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 Processor -- start 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- start start 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient: init 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient: _add_conns ranks=[3,1,6,5,4,8,2,0,7] 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient(hunting): picked mon.noname-g con 0x7f51100a0b20 addr v1:172.21.15.171:6790/0 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient(hunting): picked mon.noname-f con 0x7f5110137730 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient(hunting): picked mon.noname-d con 0x7f5110138220 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100a1e20 con 0x7f5110137730 2024-04-26T00:05:27.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f511009cd20 con 0x7f51100a0b20 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51100a19d0 con 0x7f5110138220 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f511702b640 10 monclient(hunting): authenticate will time out at 1583.286921s 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f51155c8640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f5110138220 legacy=0x7f5110134a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510ffff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f5110137730 0x7f5110134310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:37656/0 (socket says 172.21.15.106:37656) 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510ffff640 1 -- 172.21.15.106:0/2757075678 learned_addr learned my addr 172.21.15.106:0/2757075678 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428368239 0 0) 0x7f511009cd20 con 0x7f51100a0b20 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): my global_id is 214500 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50fc003530 con 0x7f51100a0b20 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1914076185 0 0) 0x7f51100a4680 con 0x7f5110137730 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 10 monclient(hunting): my global_id is 224335 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.755+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f511009cd20 con 0x7f5110137730 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1999812217 0 0) 0x7f50fc003530 con 0x7f51100a0b20 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f51100a4680 con 0x7f51100a0b20 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5100001560 con 0x7f51100a0b20 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): dump: 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.749 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2113677111 0 0) 0x7f511009cd20 con 0x7f5110137730 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50fc003530 con 0x7f5110137730 2024-04-26T00:05:27.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5104001780 con 0x7f5110137730 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): dump: 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.751 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2940268805 0 0) 0x7f51100a4680 con 0x7f51100a0b20 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.106:6792/0 conn(0x7f5110138220 legacy=0x7f5110134a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.171:6789/0 conn(0x7f5110137730 legacy=0x7f5110134310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 monclient: found mon.g 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f511009aa30 con 0x7f51100a0b20 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 5 monclient: authenticate success, global_id 214500 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 10 monclient: _renew_subs 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f511009ca40 con 0x7f51100a0b20 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 10 monclient: _renew_subs 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f511009b880 con 0x7f51100a0b20 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5100004aa0 con 0x7f51100a0b20 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5100004f90 con 0x7f51100a0b20 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510effd640 4 set_mon_vals no callback set 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: dump: 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.753 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.754 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50f00065d0 con 0x7f50f0002870 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f510000fd30 con 0x7f51100a0b20 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f5100045110 con 0x7f51100a0b20 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147232403 0 0) 0x7f50f00065d0 con 0x7f50f0002870 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient(hunting): my global_id is 224344 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51100a4680 con 0x7f50f0002870 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f51155c8640 10 monclient: get_auth_request con 0x7f50fc037d80 auth_method 0 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4281114684 0 0) 0x7f51100a4680 con 0x7f50f0002870 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50f00065d0 con 0x7f50f0002870 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5104004e40 con 0x7f50f0002870 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 10 monclient: dump: 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.756 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.757 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.757 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1039215068 0 0) 0x7f50f00065d0 con 0x7f50f0002870 2024-04-26T00:05:27.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.759+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50f000a160 con 0x7f50f0002870 2024-04-26T00:05:27.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.763+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5104007140 con 0x7f50f0002870 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.763+0000 7f510d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.763+0000 7f510d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.763+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.171:6789/0 conn(0x7f50f0002870 legacy=0x7f50f0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.763+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.171:6789/0 conn(0x7f50f0002870 legacy=0x7f50f0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f511702b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50f0009e30 con 0x7f50f00090f0 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 883849784 0 0) 0x7f50f0009e30 con 0x7f50f00090f0 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 10 monclient(hunting): my global_id is 224353 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f00065d0 con 0x7f50f00090f0 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 481307884 0 0) 0x7f50f00065d0 con 0x7f50f00090f0 2024-04-26T00:05:27.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50f0009e30 con 0x7f50f00090f0 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f51040057a0 con 0x7f50f00090f0 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 10 monclient: dump: 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.760 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3126528582 0 0) 0x7f50f0009e30 con 0x7f50f00090f0 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.767+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f50f000c3a0 con 0x7f50f00090f0 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7723 (unknown 0 0 932436130) 0x7f510400a160 con 0x7f50f00090f0 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f510d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f510d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.171:6789/0 conn(0x7f50f00090f0 legacy=0x7f50f0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f510d7fa640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.171:6789/0 conn(0x7f50f00090f0 legacy=0x7f50f0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 41003, 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:27.762 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.763 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.764 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.765 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.766 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:27.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.770 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:27.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.776 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.778 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.779 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:27.780 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.171:6812/722422047 conn(0x7f50fc037d80 legacy=0x7f50fc03a240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 10 monclient: shutdown 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 >> v1:172.21.15.171:6790/0 conn(0x7f51100a0b20 legacy=0x7f5110133c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f51155c8640 1 -- 172.21.15.106:0/2757075678 reap_dead start 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f51155c8640 1 -- 172.21.15.106:0/2757075678 reap_dead start 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 shutdown_connections 2024-04-26T00:05:27.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 >> 172.21.15.106:0/2757075678 conn(0x7f51100a6b80 msgr2=0x7f51100a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 shutdown_connections 2024-04-26T00:05:27.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.771+0000 7f511702b640 1 -- 172.21.15.106:0/2757075678 wait complete. 2024-04-26T00:05:27.782 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:27.782 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon g 2024-04-26T00:05:27.782 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:05:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient: get_monmap_and_config 2024-04-26T00:05:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient: monmap: 2024-04-26T00:05:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:27.920780+0000 2024-04-26T00:05:27.895 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:27.920780+0000 2024-04-26T00:05:27.896 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.896 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.896 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.896 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.896 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.896 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.896 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.897 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.897 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 1 Processor -- start 2024-04-26T00:05:27.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 1 -- start start 2024-04-26T00:05:27.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient: init 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient: _add_conns ranks=[2,1,7,8,0,6,5,4,3] 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient(hunting): picked mon.noname-b con 0x7f4f68137c40 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient(hunting): picked mon.noname-f con 0x7f4f6809fca0 addr v1:172.21.15.171:6789/0 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient(hunting): picked mon.noname-i con 0x7f4f68137570 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6806ee10 con 0x7f4f6809fca0 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f680a2220 con 0x7f4f68137c40 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f6806f0f0 con 0x7f4f68137570 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.915+0000 7f4f6fe49640 10 monclient(hunting): authenticate will time out at 1583.447895s 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6dbe5640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f4f68137c40 0x7f4f680a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:53662/0 (socket says 172.21.15.106:53662) 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6dbe5640 1 -- 172.21.15.106:0/1560886734 learned_addr learned my addr 172.21.15.106:0/1560886734 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603594557 0 0) 0x7f4f680a2220 con 0x7f4f68137c40 2024-04-26T00:05:27.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient(hunting): my global_id is 7418 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f54003530 con 0x7f4f68137c40 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2602363743 0 0) 0x7f4f54003530 con 0x7f4f68137c40 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 >> v1:172.21.15.171:6792/0 conn(0x7f4f68137570 legacy=0x7f4f681408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 >> v1:172.21.15.171:6789/0 conn(0x7f4f6809fca0 legacy=0x7f4f680a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 monclient: found mon.noname-b 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f6806f3d0 con 0x7f4f68137c40 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f640017c0 con 0x7f4f68137c40 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: dump: 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.908 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 5 monclient: authenticate success, global_id 7418 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f64001ab0 con 0x7f4f68137c40 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 1 -- 172.21.15.106:0/1560886734 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f64004bf0 con 0x7f4f68137c40 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 4 set_mon_vals no callback set 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:27.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6cbe3640 10 monclient: dump: 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.910 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: shutdown 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- 172.21.15.106:0/1560886734 >> v1:172.21.15.106:6790/0 conn(0x7f4f68137c40 legacy=0x7f4f680a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- 172.21.15.106:0/1560886734 shutdown_connections 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- 172.21.15.106:0/1560886734 >> 172.21.15.106:0/1560886734 conn(0x7f4f680a64e0 msgr2=0x7f4f680a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- 172.21.15.106:0/1560886734 shutdown_connections 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- 172.21.15.106:0/1560886734 wait complete. 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: build_initial_monmap 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: monmap: 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:27.911 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:27.912 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 Processor -- start 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- start start 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: init 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: _add_conns ranks=[8,2,4,5,0,3,6,1,7] 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient(hunting): picked mon.noname-e con 0x7f4f6809fca0 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient(hunting): picked mon.noname-b con 0x7f4f68137570 addr v1:172.21.15.106:6790/0 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient(hunting): picked mon.noname-c con 0x7f4f68137c40 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f681229c0 con 0x7f4f68137570 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f680724d0 con 0x7f4f68137c40 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f68072970 con 0x7f4f6809fca0 2024-04-26T00:05:27.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient(hunting): authenticate will time out at 1583.450725s 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6dbe5640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f4f6809fca0 0x7f4f681cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:38744/0 (socket says 172.21.15.106:38744) 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6dbe5640 1 -- 172.21.15.106:0/2191273401 learned_addr learned my addr 172.21.15.106:0/2191273401 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211182193 0 0) 0x7f4f68072970 con 0x7f4f6809fca0 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): my global_id is 224306 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f4c003530 con 0x7f4f6809fca0 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 957580803 0 0) 0x7f4f681229c0 con 0x7f4f68137570 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): my global_id is 7427 2024-04-26T00:05:27.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f68072970 con 0x7f4f68137570 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4105583555 0 0) 0x7f4f680724d0 con 0x7f4f68137c40 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): my global_id is 146020 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f681229c0 con 0x7f4f68137c40 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1202533986 0 0) 0x7f4f4c003530 con 0x7f4f6809fca0 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f680724d0 con 0x7f4f6809fca0 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f640018a0 con 0x7f4f6809fca0 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.915 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:27.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3811883636 0 0) 0x7f4f68072970 con 0x7f4f68137570 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f4c003530 con 0x7f4f68137570 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f58001a20 con 0x7f4f68137570 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.917 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2183219414 0 0) 0x7f4f681229c0 con 0x7f4f68137c40 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f68072970 con 0x7f4f68137c40 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f60001bd0 con 0x7f4f68137c40 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:27.918 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2156480796 0 0) 0x7f4f680724d0 con 0x7f4f6809fca0 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.106:6791/0 conn(0x7f4f68137c40 legacy=0x7f4f681d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.106:6790/0 conn(0x7f4f68137570 legacy=0x7f4f681d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 monclient: found mon.e 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f681226e0 con 0x7f4f6809fca0 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 5 monclient: authenticate success, global_id 224306 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: _renew_subs 2024-04-26T00:05:27.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f68120b30 con 0x7f4f6809fca0 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: _renew_subs 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f681235c0 con 0x7f4f6809fca0 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f64001ab0 con 0x7f4f6809fca0 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f64001180 con 0x7f4f6809fca0 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5f7fe640 4 set_mon_vals no callback set 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.919+0000 7f4f5e7fc640 10 monclient: dump: 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.921 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.922 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f6fe49640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f500065d0 con 0x7f4f50002870 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4f6400fd20 con 0x7f4f6809fca0 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f4f640450d0 con 0x7f4f6809fca0 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f6e3e6640 10 monclient: get_auth_request con 0x7f4f4c0381a0 auth_method 0 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 185032340 0 0) 0x7f4f500065d0 con 0x7f4f50002870 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient(hunting): my global_id is 214509 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f680724d0 con 0x7f4f50002870 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 539004351 0 0) 0x7f4f680724d0 con 0x7f4f50002870 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f500065d0 con 0x7f4f50002870 2024-04-26T00:05:27.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f58003960 con 0x7f4f50002870 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient: dump: 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.924 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2863112708 0 0) 0x7f4f500065d0 con 0x7f4f50002870 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f5000a160 con 0x7f4f50002870 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4f58003d60 con 0x7f4f50002870 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.171:6790/0 conn(0x7f4f50002870 legacy=0x7f4f50004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.923+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.171:6790/0 conn(0x7f4f50002870 legacy=0x7f4f50004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f6fe49640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f50009e30 con 0x7f4f500090f0 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110460317 0 0) 0x7f4f50009e30 con 0x7f4f500090f0 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient(hunting): my global_id is 214518 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f500065d0 con 0x7f4f500090f0 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2320908421 0 0) 0x7f4f500065d0 con 0x7f4f500090f0 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f50009e30 con 0x7f4f500090f0 2024-04-26T00:05:27.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f58004650 con 0x7f4f500090f0 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient: dump: 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:27.928 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 604796705 0 0) 0x7f4f50009e30 con 0x7f4f500090f0 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f5000c3a0 con 0x7f4f500090f0 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7554 (unknown 0 0 3646271163) 0x7f4f580047f0 con 0x7f4f500090f0 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.171:6790/0 conn(0x7f4f500090f0 legacy=0x7f4f50009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.931+0000 7f4f5e7fc640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.171:6790/0 conn(0x7f4f500090f0 legacy=0x7f4f50009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:27.929 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 158353, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:27.930 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.931 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.932 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:27.933 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:27.934 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:27.936 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:27.938 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:27.940 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.943 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.945 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.946 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:27.947 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:27.948 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:27.948 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:27.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:27.948 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:27.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:27.948 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:27.948 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:27.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.171:6812/722422047 conn(0x7f4f4c0381a0 legacy=0x7f4f4c03a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 10 monclient: shutdown 2024-04-26T00:05:27.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 >> v1:172.21.15.106:6793/0 conn(0x7f4f6809fca0 legacy=0x7f4f681cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6e3e6640 1 -- 172.21.15.106:0/2191273401 reap_dead start 2024-04-26T00:05:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6e3e6640 1 -- 172.21.15.106:0/2191273401 reap_dead start 2024-04-26T00:05:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 shutdown_connections 2024-04-26T00:05:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 >> 172.21.15.106:0/2191273401 conn(0x7f4f680a64e0 msgr2=0x7f4f680a0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 shutdown_connections 2024-04-26T00:05:27.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:27.935+0000 7f4f6fe49640 1 -- 172.21.15.106:0/2191273401 wait complete. 2024-04-26T00:05:27.950 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:27.951 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-04-26T00:05:27.951 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: get_monmap_and_config 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: build_initial_monmap 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: monmap: 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:28.091415+0000 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:28.091415+0000 2024-04-26T00:05:28.066 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:28.067 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 Processor -- start 2024-04-26T00:05:28.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- start start 2024-04-26T00:05:28.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: init 2024-04-26T00:05:28.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:28.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: _add_conns ranks=[8,6,5,1,0,7,3,4,2] 2024-04-26T00:05:28.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient(hunting): picked mon.noname-e con 0x7f7f84135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient(hunting): picked mon.noname-d con 0x7f7f841353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient(hunting): picked mon.noname-h con 0x7f7f8413bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f8406f2d0 con 0x7f7f8413bdf0 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f84072330 con 0x7f7f841353b0 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f84072610 con 0x7f7f84135870 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient(hunting): authenticate will time out at 1583.618552s 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f892ae640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f7f841353b0 legacy=0x7f7f8413a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f89aaf640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f7f84135870 0x7f7f84135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:38746/0 (socket says 172.21.15.106:38746) 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f89aaf640 1 -- 172.21.15.106:0/2457268913 learned_addr learned my addr 172.21.15.106:0/2457268913 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3134266995 0 0) 0x7f7f84072610 con 0x7f7f84135870 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient(hunting): my global_id is 224315 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f70003530 con 0x7f7f84135870 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2859054728 0 0) 0x7f7f70003530 con 0x7f7f84135870 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 >> v1:172.21.15.106:6792/0 conn(0x7f7f841353b0 legacy=0x7f7f8413a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 >> v1:172.21.15.171:6791/0 conn(0x7f7f8413bdf0 legacy=0x7f7f8413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: _finish_hunting 0 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 monclient: found mon.noname-e 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f840a3260 con 0x7f7f84135870 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: _finish_auth 0 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: _check_auth_tickets 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f80001800 con 0x7f7f84135870 2024-04-26T00:05:28.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: dump: 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.081 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 5 monclient: authenticate success, global_id 224315 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f80001b10 con 0x7f7f84135870 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 1 -- 172.21.15.106:0/2457268913 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f80004bf0 con 0x7f7f84135870 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f88aad640 10 monclient: dump: 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.082 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.083 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 4 set_mon_vals no callback set 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 10 monclient: shutdown 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- 172.21.15.106:0/2457268913 >> v1:172.21.15.106:6793/0 conn(0x7f7f84135870 legacy=0x7f7f84135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- 172.21.15.106:0/2457268913 shutdown_connections 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- 172.21.15.106:0/2457268913 >> 172.21.15.106:0/2457268913 conn(0x7f7f840a64e0 msgr2=0x7f7f840a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- 172.21.15.106:0/2457268913 shutdown_connections 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.087+0000 7f7f8bd13640 1 -- 172.21.15.106:0/2457268913 wait complete. 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: build_initial_monmap 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: monmap: 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:28.084 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 Processor -- start 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 -- start start 2024-04-26T00:05:28.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: init 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: _add_conns ranks=[4,8,0,3,5,1,7,6,2] 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient(hunting): picked mon.noname-c con 0x7f7f841353b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient(hunting): picked mon.noname-e con 0x7f7f84135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient(hunting): picked mon.noname-a con 0x7f7f8413bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f841cd7b0 con 0x7f7f8413bdf0 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f84070500 con 0x7f7f841353b0 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f840707e0 con 0x7f7f84135870 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient(hunting): authenticate will time out at 1583.621366s 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f89aaf640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f7f841353b0 0x7f7f841cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:37230/0 (socket says 172.21.15.106:37230) 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f89aaf640 1 -- 172.21.15.106:0/3088010235 learned_addr learned my addr 172.21.15.106:0/3088010235 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3326861313 0 0) 0x7f7f84070500 con 0x7f7f841353b0 2024-04-26T00:05:28.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): my global_id is 146029 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f68003530 con 0x7f7f841353b0 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2945265150 0 0) 0x7f7f841cd7b0 con 0x7f7f8413bdf0 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): my global_id is 7668 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f84070500 con 0x7f7f8413bdf0 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482354501 0 0) 0x7f7f840707e0 con 0x7f7f84135870 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): my global_id is 224324 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f841cd7b0 con 0x7f7f84135870 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1017700658 0 0) 0x7f7f68003530 con 0x7f7f841353b0 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f840707e0 con 0x7f7f841353b0 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f800017c0 con 0x7f7f841353b0 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.088 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3922431738 0 0) 0x7f7f84070500 con 0x7f7f8413bdf0 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f68003530 con 0x7f7f8413bdf0 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3095436135 0 0) 0x7f7f841cd7b0 con 0x7f7f84135870 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f84070500 con 0x7f7f84135870 2024-04-26T00:05:28.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f7c001c00 con 0x7f7f8413bdf0 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.090 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f74004120 con 0x7f7f84135870 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.091 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3828269787 0 0) 0x7f7f840707e0 con 0x7f7f841353b0 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.106:6793/0 conn(0x7f7f84135870 legacy=0x7f7f841cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.106:6789/0 conn(0x7f7f8413bdf0 legacy=0x7f7f841d4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 monclient: found mon.c 2024-04-26T00:05:28.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f8406f730 con 0x7f7f841353b0 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 5 monclient: authenticate success, global_id 146029 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: _renew_subs 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7f84134ac0 con 0x7f7f841353b0 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: _renew_subs 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f7f8409dff0 con 0x7f7f841353b0 2024-04-26T00:05:28.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7f80000ff0 con 0x7f7f841353b0 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f800054f0 con 0x7f7f841353b0 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 10 monclient: dump: 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.094 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7b7fe640 4 set_mon_vals no callback set 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f84075890 con 0x7f7f8413cb40 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7f80010290 con 0x7f7f841353b0 2024-04-26T00:05:28.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f7f80045300 con 0x7f7f841353b0 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.091+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080999609 0 0) 0x7f7f84075890 con 0x7f7f8413cb40 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient(hunting): my global_id is 7439 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f840707e0 con 0x7f7f8413cb40 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f8a2b0640 10 monclient: get_auth_request con 0x7f7f68038300 auth_method 0 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 574826880 0 0) 0x7f7f840707e0 con 0x7f7f8413cb40 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f84075890 con 0x7f7f8413cb40 2024-04-26T00:05:28.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f74004880 con 0x7f7f8413cb40 2024-04-26T00:05:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient: dump: 2024-04-26T00:05:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.097 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.098 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.099 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.099 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1451528382 0 0) 0x7f7f84075890 con 0x7f7f8413cb40 2024-04-26T00:05:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7f84062e50 con 0x7f7f8413cb40 2024-04-26T00:05:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7f74007480 con 0x7f7f8413cb40 2024-04-26T00:05:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:28.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:28.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.171:6791/0 conn(0x7f7f8413cb40 legacy=0x7f7f8413cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.095+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.171:6791/0 conn(0x7f7f8413cb40 legacy=0x7f7f8413cf20 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.099+0000 7f7f8bd13640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.099+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7f8409f470 con 0x7f7f8413d630 2024-04-26T00:05:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1494214793 0 0) 0x7f7f8409f470 con 0x7f7f8413d630 2024-04-26T00:05:28.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient(hunting): my global_id is 7448 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7f84075890 con 0x7f7f8413d630 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2592744948 0 0) 0x7f7f84075890 con 0x7f7f8413d630 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7f8409f470 con 0x7f7f8413d630 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7f740055f0 con 0x7f7f8413d630 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient: dump: 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.103 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1245103228 0 0) 0x7f7f8409f470 con 0x7f7f8413d630 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f7f8409ea90 con 0x7f7f8413d630 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7554 (unknown 0 0 4079211885) 0x7f7f74007630 con 0x7f7f8413d630 2024-04-26T00:05:28.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.171:6791/0 conn(0x7f7f8413d630 legacy=0x7f7f841da330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f7a7fc640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.171:6791/0 conn(0x7f7f8413d630 legacy=0x7f7f841da330 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 646605, 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:28.105 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:28.106 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:28.107 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:28.108 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:28.109 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:28.110 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.111 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:28.112 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.116 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.117 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:28.119 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:28.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.121 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:28.122 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.123 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:28.123 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:28.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.171:6812/722422047 conn(0x7f7f68038300 legacy=0x7f7f6803a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 10 monclient: shutdown 2024-04-26T00:05:28.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:28.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 >> v1:172.21.15.106:6791/0 conn(0x7f7f841353b0 legacy=0x7f7f841cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8a2b0640 1 -- 172.21.15.106:0/3088010235 reap_dead start 2024-04-26T00:05:28.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8a2b0640 1 -- 172.21.15.106:0/3088010235 reap_dead start 2024-04-26T00:05:28.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 shutdown_connections 2024-04-26T00:05:28.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 >> 172.21.15.106:0/3088010235 conn(0x7f7f840a64e0 msgr2=0x7f7f8412e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:28.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 shutdown_connections 2024-04-26T00:05:28.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.103+0000 7f7f8bd13640 1 -- 172.21.15.106:0/3088010235 wait complete. 2024-04-26T00:05:28.125 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:28.125 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-04-26T00:05:28.125 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:05:28.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.251+0000 7f5b1c141640 10 monclient: get_monmap_and_config 2024-04-26T00:05:28.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.251+0000 7f5b1c141640 10 monclient: build_initial_monmap 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.251+0000 7f5b1c141640 10 monclient: monmap: 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:05:28.257927+0000 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:05:28.257927+0000 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:28.233 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:28.234 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:28.234 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:28.234 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 Processor -- start 2024-04-26T00:05:28.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- start start 2024-04-26T00:05:28.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: init 2024-04-26T00:05:28.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:28.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: _add_conns ranks=[0,7,5,1,8,6,4,3,2] 2024-04-26T00:05:28.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): picked mon.noname-a con 0x7f5b14071f20 addr v1:172.21.15.106:6789/0 2024-04-26T00:05:28.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): picked mon.noname-i con 0x7f5b14071450 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:28.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): picked mon.noname-h con 0x7f5b14071870 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:28.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1406ee40 con 0x7f5b14071f20 2024-04-26T00:05:28.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b140700f0 con 0x7f5b14071870 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b140703d0 con 0x7f5b14071450 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): authenticate will time out at 1583.784781s 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b19edd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5b14071f20 0x7f5b14072300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58298/0 (socket says 172.21.15.106:58298) 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b19edd640 1 -- 172.21.15.106:0/1294034093 learned_addr learned my addr 172.21.15.106:0/1294034093 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049035652 0 0) 0x7f5b1406ee40 con 0x7f5b14071f20 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient(hunting): my global_id is 7677 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b00003530 con 0x7f5b14071f20 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1093351780 0 0) 0x7f5b00003530 con 0x7f5b14071f20 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 >> v1:172.21.15.171:6792/0 conn(0x7f5b14071450 legacy=0x7f5b14140ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 >> v1:172.21.15.171:6791/0 conn(0x7f5b14071870 legacy=0x7f5b14144410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: _finish_hunting 0 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 monclient: found mon.noname-a 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b140706b0 con 0x7f5b14071f20 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: _finish_auth 0 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: _check_auth_tickets 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 5 monclient: authenticate success, global_id 7677 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b100017c0 con 0x7f5b14071f20 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: dump: 2024-04-26T00:05:28.243 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.244 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b10001ab0 con 0x7f5b14071f20 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: get_monmap_and_config success 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 4 set_mon_vals no callback set 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 1 -- 172.21.15.106:0/1294034093 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b10004bf0 con 0x7f5b14071f20 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b18edb640 10 monclient: dump: 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.245 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: shutdown 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- 172.21.15.106:0/1294034093 >> v1:172.21.15.106:6789/0 conn(0x7f5b14071f20 legacy=0x7f5b14072300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- 172.21.15.106:0/1294034093 shutdown_connections 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- 172.21.15.106:0/1294034093 >> 172.21.15.106:0/1294034093 conn(0x7f5b140a64e0 msgr2=0x7f5b140a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- 172.21.15.106:0/1294034093 shutdown_connections 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- 172.21.15.106:0/1294034093 wait complete. 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: build_initial_monmap 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: monmap: 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:05:28.247 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 Processor -- start 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- start start 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: init 2024-04-26T00:05:28.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: _reopen_session rank -1 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient: _add_conns ranks=[5,7,6,4,0,1,8,3,2] 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): picked mon.noname-h con 0x7f5b14071450 addr v1:172.21.15.171:6791/0 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): picked mon.noname-i con 0x7f5b14071870 addr v1:172.21.15.171:6792/0 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): picked mon.noname-d con 0x7f5b14071f20 addr v1:172.21.15.106:6792/0 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b14072b60 con 0x7f5b14071450 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b1406f490 con 0x7f5b14071f20 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b14141ca0 con 0x7f5b14071870 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): _renew_subs 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1c141640 10 monclient(hunting): authenticate will time out at 1583.787898s 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.255+0000 7f5b1a6de640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f5b14071f20 legacy=0x7f5b141d8d70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b196dc640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f5b14071870 0x7f5b14141590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:33660/0 (socket says 172.21.15.106:33660) 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b196dc640 1 -- 172.21.15.106:0/3820883632 learned_addr learned my addr 172.21.15.106:0/3820883632 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:05:28.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1743453557 0 0) 0x7f5b14141ca0 con 0x7f5b14071870 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): my global_id is 145879 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af8003530 con 0x7f5b14071870 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3433019303 0 0) 0x7f5b140706b0 con 0x7f5b14071450 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): my global_id is 7466 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b14141ca0 con 0x7f5b14071450 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3557172594 0 0) 0x7f5b14141ca0 con 0x7f5b14071450 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b140706b0 con 0x7f5b14071450 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b10001780 con 0x7f5b14071450 2024-04-26T00:05:28.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.251 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3864796284 0 0) 0x7f5af8003530 con 0x7f5b14071870 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b14141ca0 con 0x7f5b14071870 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b04001a50 con 0x7f5b14071870 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): dump: 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.252 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3376531385 0 0) 0x7f5b140706b0 con 0x7f5b14071450 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.171:6792/0 conn(0x7f5b14071870 legacy=0x7f5b14141590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.106:6792/0 conn(0x7f5b14071f20 legacy=0x7f5b141d8d70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 monclient: found mon.h 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b14144ac0 con 0x7f5b14071450 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 5 monclient: authenticate success, global_id 7466 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 10 monclient: _renew_subs 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:05:28.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b14144da0 con 0x7f5b14071450 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 10 monclient: _renew_subs 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b141456f0 con 0x7f5b14071450 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b10001ab0 con 0x7f5b14071450 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0bfff640 4 set_mon_vals no callback set 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b10001ce0 con 0x7f5b14071450 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: dump: 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.255 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5afc0065d0 con 0x7f5afc002870 2024-04-26T00:05:28.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573586020 0 0) 0x7f5afc0065d0 con 0x7f5afc002870 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient(hunting): my global_id is 145888 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b140706b0 con 0x7f5afc002870 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5b10010050 con 0x7f5b14071450 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(253..253 src has 138..253) ==== 6817+0+0 (unknown 2894832619 0 0) 0x7f5b10045130 con 0x7f5b14071450 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1855700953 0 0) 0x7f5b140706b0 con 0x7f5afc002870 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5afc0065d0 con 0x7f5afc002870 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b04003b50 con 0x7f5afc002870 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 10 monclient: dump: 2024-04-26T00:05:28.257 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.258 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b1a6de640 10 monclient: get_auth_request con 0x7f5af8037cf0 auth_method 0 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2306408906 0 0) 0x7f5afc0065d0 con 0x7f5afc002870 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.259+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5afc00a160 con 0x7f5afc002870 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.263+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5b040057d0 con 0x7f5afc002870 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.263+0000 7f5b0a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.263+0000 7f5b0a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.263+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.171:6792/0 conn(0x7f5afc002870 legacy=0x7f5afc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.263+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.171:6792/0 conn(0x7f5afc002870 legacy=0x7f5afc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:28.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b1c141640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5afc009e30 con 0x7f5afc0090f0 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341800286 0 0) 0x7f5afc009e30 con 0x7f5afc0090f0 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 10 monclient(hunting): my global_id is 145897 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5afc0065d0 con 0x7f5afc0090f0 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2445540319 0 0) 0x7f5afc0065d0 con 0x7f5afc0090f0 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5afc009e30 con 0x7f5afc0090f0 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b04004370 con 0x7f5afc0090f0 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 10 monclient: dump: 2024-04-26T00:05:28.261 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:05:28.262 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2436442296 0 0) 0x7f5afc009e30 con 0x7f5afc0090f0 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.267+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5afc00c3a0 con 0x7f5afc0090f0 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7554 (unknown 0 0 518244046) 0x7f5b04007b40 con 0x7f5afc0090f0 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b0a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b0a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.171:6792/0 conn(0x7f5afc0090f0 legacy=0x7f5afc009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b0a7fc640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.171:6792/0 conn(0x7f5afc0090f0 legacy=0x7f5afc009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:05:28.263 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 78, 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 391799, 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:05:28.264 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:28.265 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:28.266 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:28.267 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:05:28.268 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:05:28.269 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.270 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:05:28.272 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:05:28.274 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:05:28.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.278 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:05:28.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:05:28.281 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:05:28.281 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.281 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.281 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:05:28.282 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:05:28.283 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:05:28.284 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:05:28.285 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:05:28.285 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:05:28.285 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:05:28.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.171:6812/722422047 conn(0x7f5af8037cf0 legacy=0x7f5af803a1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 10 monclient: shutdown 2024-04-26T00:05:28.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:05:28.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 >> v1:172.21.15.171:6791/0 conn(0x7f5b14071450 legacy=0x7f5b14140e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:05:28.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1a6de640 1 -- 172.21.15.106:0/3820883632 reap_dead start 2024-04-26T00:05:28.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1a6de640 1 -- 172.21.15.106:0/3820883632 reap_dead start 2024-04-26T00:05:28.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 shutdown_connections 2024-04-26T00:05:28.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 >> 172.21.15.106:0/3820883632 conn(0x7f5b140a64e0 msgr2=0x7f5b1413ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:05:28.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 shutdown_connections 2024-04-26T00:05:28.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:05:28.271+0000 7f5b1c141640 1 -- 172.21.15.106:0/3820883632 wait complete. 2024-04-26T00:05:28.287 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:05:28.287 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-26T00:06:58.288 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-04-26T00:06:58.289 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-04-26T00:06:58.289 INFO:tasks.ceph.mon.d:Restarting daemon 2024-04-26T00:06:58.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-04-26T00:06:58.293 INFO:tasks.ceph.mon.d:Started 2024-04-26T00:06:58.293 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:06:58.293 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:06:58.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient: get_monmap_and_config 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient: build_initial_monmap 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient: monmap: 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:58.447165+0000 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:58.447165+0000 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:58.422 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 1 Processor -- start 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 1 -- start start 2024-04-26T00:06:58.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient: init 2024-04-26T00:06:58.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:58.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient: _add_conns ranks=[8,7,1,3,5,0,2,6,4] 2024-04-26T00:06:58.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient(hunting): picked mon.noname-e con 0x7f45a4134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient(hunting): picked mon.noname-i con 0x7f45a40a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient(hunting): picked mon.noname-f con 0x7f45a413e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a406dd40 con 0x7f45a413e200 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a40a2b10 con 0x7f45a40a4820 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a40a2df0 con 0x7f45a4134970 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a89a1640 10 monclient(hunting): authenticate will time out at 1673.974335s 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a259c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f45a4134970 0x7f45a4134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45898/0 (socket says 172.21.15.106:45898) 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.445+0000 7f45a259c640 1 -- 172.21.15.106:0/3956146954 learned_addr learned my addr 172.21.15.106:0/3956146954 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161707131 0 0) 0x7f45a40a2df0 con 0x7f45a4134970 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient(hunting): my global_id is 224333 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4590003530 con 0x7f45a4134970 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4064829254 0 0) 0x7f4590003530 con 0x7f45a4134970 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 >> v1:172.21.15.171:6792/0 conn(0x7f45a40a4820 legacy=0x7f45a413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 >> v1:172.21.15.171:6789/0 conn(0x7f45a413e200 legacy=0x7f45a41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: _finish_hunting 0 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 monclient: found mon.noname-e 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40a30d0 con 0x7f45a4134970 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: _finish_auth 0 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: _check_auth_tickets 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f459c001b40 con 0x7f45a4134970 2024-04-26T00:06:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: dump: 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 5 monclient: authenticate success, global_id 224333 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f459c001e30 con 0x7f45a4134970 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 4 set_mon_vals no callback set 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 1 -- 172.21.15.106:0/3956146954 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f459c004f70 con 0x7f45a4134970 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a159a640 10 monclient: dump: 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.430 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient: shutdown 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- 172.21.15.106:0/3956146954 >> v1:172.21.15.106:6793/0 conn(0x7f45a4134970 legacy=0x7f45a4134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- 172.21.15.106:0/3956146954 shutdown_connections 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- 172.21.15.106:0/3956146954 >> 172.21.15.106:0/3956146954 conn(0x7f45a40a9e20 msgr2=0x7f45a40aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- 172.21.15.106:0/3956146954 shutdown_connections 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- 172.21.15.106:0/3956146954 wait complete. 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient: build_initial_monmap 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient: monmap: 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.432 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 Processor -- start 2024-04-26T00:06:58.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- start start 2024-04-26T00:06:58.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient: init 2024-04-26T00:06:58.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient: _add_conns ranks=[4,7,2,1,6,8,3,0,5] 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient(hunting): picked mon.noname-c con 0x7f45a40a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient(hunting): picked mon.noname-i con 0x7f45a413e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient(hunting): picked mon.noname-b con 0x7f45a413c740 addr v1:172.21.15.106:6790/0 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a413bc80 con 0x7f45a413c740 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a41343c0 con 0x7f45a40a4820 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45a40a1e00 con 0x7f45a413e200 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a89a1640 10 monclient(hunting): authenticate will time out at 1673.979535s 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a2d9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f45a413c740 0x7f45a41d48d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52444/0 (socket says 172.21.15.106:52444) 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.449+0000 7f45a2d9d640 1 -- 172.21.15.106:0/3877599583 learned_addr learned my addr 172.21.15.106:0/3877599583 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 577951213 0 0) 0x7f45a41343c0 con 0x7f45a40a4820 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): my global_id is 146038 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4584003530 con 0x7f45a40a4820 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 139274275 0 0) 0x7f45a413bc80 con 0x7f45a413c740 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): my global_id is 7436 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45a41343c0 con 0x7f45a413c740 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1773940233 0 0) 0x7f4584003530 con 0x7f45a40a4820 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45a413bc80 con 0x7f45a40a4820 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f459c004eb0 con 0x7f45a40a4820 2024-04-26T00:06:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): dump: 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2773770596 0 0) 0x7f45a41343c0 con 0x7f45a413c740 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4584003530 con 0x7f45a413c740 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f458c001940 con 0x7f45a413c740 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient(hunting): dump: 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 438297402 0 0) 0x7f45a413bc80 con 0x7f45a40a4820 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 >> v1:172.21.15.171:6792/0 conn(0x7f45a413e200 legacy=0x7f45a4133cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 >> v1:172.21.15.106:6790/0 conn(0x7f45a413c740 legacy=0x7f45a41d48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient: _finish_hunting 0 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 monclient: found mon.c 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45a40a1a40 con 0x7f45a40a4820 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient: _finish_auth 0 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient: _check_auth_tickets 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a89a1640 5 monclient: authenticate success, global_id 146038 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a89a1640 10 monclient: _renew_subs 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a89a1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45a4139c00 con 0x7f45a40a4820 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a89a1640 10 monclient: _renew_subs 2024-04-26T00:06:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a89a1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f45a413bf60 con 0x7f45a40a4820 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f459c001e30 con 0x7f45a40a4820 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f459affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.453+0000 7f45a0d99640 4 set_mon_vals no callback set 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f45a89a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f459c002060 con 0x7f45a40a4820 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f45a89a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f45a89a1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4588005090 con 0x7f45a40a4820 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f459affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f459affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f459affd640 10 monclient: dump: 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.444 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f459c010470 con 0x7f45a40a4820 2024-04-26T00:06:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f459c045570 con 0x7f45a40a4820 2024-04-26T00:06:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.457+0000 7f45a1d9b640 10 monclient: get_auth_request con 0x7f4584037ed0 auth_method 0 2024-04-26T00:06:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.461+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f459c015c80 con 0x7f45a40a4820 2024-04-26T00:06:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.461+0000 7f459affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.461+0000 7f459affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:58.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.681+0000 7f45a89a1640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:06:58.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.681+0000 7f45a89a1640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:06:58.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.681+0000 7f45a89a1640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.681+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f4588005380 con 0x7f45a40a4820 2024-04-26T00:06:58.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.681+0000 7f459affd640 1 -- 172.21.15.106:0/3877599583 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 3661017822) 0x7f459c015580 con 0x7f45a40a4820 2024-04-26T00:06:58.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f459affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:06:58.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f459affd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:58.660 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":80,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:06:58.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 >> v1:172.21.15.171:6812/722422047 conn(0x7f4584037ed0 legacy=0x7f458403a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 10 monclient: shutdown 2024-04-26T00:06:58.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:58.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 >> v1:172.21.15.106:6791/0 conn(0x7f45a40a4820 legacy=0x7f45a41335a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 shutdown_connections 2024-04-26T00:06:58.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 >> 172.21.15.106:0/3877599583 conn(0x7f45a40a9e20 msgr2=0x7f45a40a8b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:58.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 shutdown_connections 2024-04-26T00:06:58.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.685+0000 7f45a89a1640 1 -- 172.21.15.106:0/3877599583 wait complete. 2024-04-26T00:06:58.679 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:06:58.679 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:06:58.679 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:06:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.821+0000 7fe6a78f4640 10 monclient: get_monmap_and_config 2024-04-26T00:06:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: build_initial_monmap 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: monmap: 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:58.826407+0000 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:58.826407+0000 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:58.802 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 Processor -- start 2024-04-26T00:06:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- start start 2024-04-26T00:06:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: init 2024-04-26T00:06:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: _add_conns ranks=[3,6,8,7,0,1,5,2,4] 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient(hunting): picked mon.noname-g con 0x7fe6a0134820 addr v1:172.21.15.171:6790/0 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient(hunting): picked mon.noname-d con 0x7fe6a00725d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient(hunting): picked mon.noname-e con 0x7fe6a013ace0 addr v1:172.21.15.106:6793/0 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a0071270 con 0x7fe6a0134820 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00714e0 con 0x7fe6a00725d0 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a00729f0 con 0x7fe6a013ace0 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient(hunting): authenticate will time out at 1674.353506s 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a5e91640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fe6a013ace0 0x7fe6a013d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45902/0 (socket says 172.21.15.106:45902) 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a5e91640 1 -- 172.21.15.106:0/1495172263 learned_addr learned my addr 172.21.15.106:0/1495172263 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2054347887 0 0) 0x7fe6a00729f0 con 0x7fe6a013ace0 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient(hunting): my global_id is 224342 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe68c005740 con 0x7fe6a013ace0 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3363576593 0 0) 0x7fe68c005740 con 0x7fe6a013ace0 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 >> v1:172.21.15.106:6792/0 conn(0x7fe6a00725d0 legacy=0x7fe6a01395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 >> v1:172.21.15.171:6790/0 conn(0x7fe6a0134820 legacy=0x7fe6a0134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: _finish_hunting 0 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 monclient: found mon.noname-e 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a00717c0 con 0x7fe6a013ace0 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: _finish_auth 0 2024-04-26T00:06:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: _check_auth_tickets 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe698001ba0 con 0x7fe6a013ace0 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: dump: 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 5 monclient: authenticate success, global_id 224342 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe698001eb0 con 0x7fe6a013ace0 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 1 -- 172.21.15.106:0/1495172263 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe698004f70 con 0x7fe6a013ace0 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe697fff640 10 monclient: dump: 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 4 set_mon_vals no callback set 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: shutdown 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- 172.21.15.106:0/1495172263 >> v1:172.21.15.106:6793/0 conn(0x7fe6a013ace0 legacy=0x7fe6a013d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- 172.21.15.106:0/1495172263 shutdown_connections 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- 172.21.15.106:0/1495172263 >> 172.21.15.106:0/1495172263 conn(0x7fe6a00a64e0 msgr2=0x7fe6a00a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- 172.21.15.106:0/1495172263 shutdown_connections 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 1 -- 172.21.15.106:0/1495172263 wait complete. 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: build_initial_monmap 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.825+0000 7fe6a78f4640 10 monclient: monmap: 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 1 Processor -- start 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 1 -- start start 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient: init 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient: _add_conns ranks=[7,4,6,5,1,3,0,2,8] 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient(hunting): picked mon.noname-i con 0x7fe6a00725d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient(hunting): picked mon.noname-c con 0x7fe6a0134820 addr v1:172.21.15.106:6791/0 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient(hunting): picked mon.noname-d con 0x7fe6a013ace0 addr v1:172.21.15.106:6792/0 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a009d050 con 0x7fe6a0134820 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a0133c10 con 0x7fe6a013ace0 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a009ca90 con 0x7fe6a00725d0 2024-04-26T00:06:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a78f4640 10 monclient(hunting): authenticate will time out at 1674.356671s 2024-04-26T00:06:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a4e8f640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fe6a0134820 0x7fe6a01cd3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41068/0 (socket says 172.21.15.106:41068) 2024-04-26T00:06:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a4e8f640 1 -- 172.21.15.106:0/546268294 learned_addr learned my addr 172.21.15.106:0/546268294 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.829+0000 7fe6a5e91640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe6a013ace0 0x7fe6a01d0b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53100/0 (socket says 172.21.15.106:53100) 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292671316 0 0) 0x7fe6a0133c10 con 0x7fe6a013ace0 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): my global_id is 244104 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe684003530 con 0x7fe6a013ace0 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4132642022 0 0) 0x7fe6a009d050 con 0x7fe6a0134820 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): my global_id is 146047 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6a0133c10 con 0x7fe6a0134820 2024-04-26T00:06:58.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3075108802 0 0) 0x7fe684003530 con 0x7fe6a013ace0 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6a009d050 con 0x7fe6a013ace0 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe698001b60 con 0x7fe6a013ace0 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): dump: 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.821 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2590006493 0 0) 0x7fe6a0133c10 con 0x7fe6a0134820 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe684003530 con 0x7fe6a0134820 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe690001a60 con 0x7fe6a0134820 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:58.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): dump: 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.823 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2069797702 0 0) 0x7fe6a009d050 con 0x7fe6a013ace0 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.171:6792/0 conn(0x7fe6a00725d0 legacy=0x7fe6a01293a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.106:6791/0 conn(0x7fe6a0134820 legacy=0x7fe6a01cd3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 monclient: found mon.d 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a009bba0 con 0x7fe6a013ace0 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: _finish_auth 0 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 5 monclient: authenticate success, global_id 244104 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 10 monclient: _renew_subs 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:06:58.824 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a009f170 con 0x7fe6a013ace0 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 10 monclient: _renew_subs 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fe6a0133330 con 0x7fe6a013ace0 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe698001eb0 con 0x7fe6a013ace0 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe698004f90 con 0x7fe6a013ace0 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: dump: 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.825 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6977fe640 4 set_mon_vals no callback set 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:58.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe698010120 con 0x7fe6a013ace0 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe6800065d0 con 0x7fe680002870 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7fe698045320 con 0x7fe6a013ace0 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422490122 0 0) 0x7fe6800065d0 con 0x7fe680002870 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient(hunting): my global_id is 7686 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6a009d050 con 0x7fe680002870 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe6a4e8f640 10 monclient: get_auth_request con 0x7fe684037e60 auth_method 0 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4046815632 0 0) 0x7fe6a009d050 con 0x7fe680002870 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe6800065d0 con 0x7fe680002870 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe69c0017f0 con 0x7fe680002870 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.827 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: dump: 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.828 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 198623689 0 0) 0x7fe6800065d0 con 0x7fe680002870 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe68000a160 con 0x7fe680002870 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe69c001d40 con 0x7fe680002870 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.106:6789/0 conn(0x7fe680002870 legacy=0x7fe680004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.833+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.106:6789/0 conn(0x7fe680002870 legacy=0x7fe680004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe680009e50 con 0x7fe680009110 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1025847246 0 0) 0x7fe680009e50 con 0x7fe680009110 2024-04-26T00:06:58.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient(hunting): my global_id is 7695 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe6800065d0 con 0x7fe680009110 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1217214700 0 0) 0x7fe6800065d0 con 0x7fe680009110 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe680009e50 con 0x7fe680009110 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe69c003b50 con 0x7fe680009110 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient: dump: 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.830 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2612678997 0 0) 0x7fe680009e50 con 0x7fe680009110 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe68000c3e0 con 0x7fe680009110 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7737 (unknown 0 0 3175548198) 0x7fe69c003f00 con 0x7fe680009110 2024-04-26T00:06:58.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.106:6789/0 conn(0x7fe680009110 legacy=0x7fe6800095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe695ffb640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.106:6789/0 conn(0x7fe680009110 legacy=0x7fe6800095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 737400, 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:06:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:06:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:06:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:06:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:06:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:06:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:58.855 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:58.856 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:06:58.856 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:06:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.171:6812/722422047 conn(0x7fe684037e60 legacy=0x7fe68403a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 10 monclient: shutdown 2024-04-26T00:06:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:58.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 >> v1:172.21.15.106:6792/0 conn(0x7fe6a013ace0 legacy=0x7fe6a01d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a5e91640 1 -- 172.21.15.106:0/546268294 reap_dead start 2024-04-26T00:06:58.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a5e91640 1 -- 172.21.15.106:0/546268294 reap_dead start 2024-04-26T00:06:58.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 shutdown_connections 2024-04-26T00:06:58.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 >> 172.21.15.106:0/546268294 conn(0x7fe6a00a64e0 msgr2=0x7fe6a00a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:58.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 shutdown_connections 2024-04-26T00:06:58.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.841+0000 7fe6a78f4640 1 -- 172.21.15.106:0/546268294 wait complete. 2024-04-26T00:06:58.858 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:06:58.858 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:06:58.859 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: get_monmap_and_config 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: build_initial_monmap 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: monmap: 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:58.998787+0000 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:58.998787+0000 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:58.974 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 Processor -- start 2024-04-26T00:06:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 -- start start 2024-04-26T00:06:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: init 2024-04-26T00:06:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: _add_conns ranks=[8,6,5,0,7,1,4,3,2] 2024-04-26T00:06:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient(hunting): picked mon.noname-e con 0x7f2394135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient(hunting): picked mon.noname-d con 0x7f23941353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient(hunting): picked mon.noname-h con 0x7f239413bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239406f2d0 con 0x7f239413bdf0 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2394072330 con 0x7f23941353b0 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2394072610 con 0x7f2394135870 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient(hunting): authenticate will time out at 1674.526465s 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f2398d52640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f2394135870 0x7f2394135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45912/0 (socket says 172.21.15.106:45912) 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f2398d52640 1 -- 172.21.15.106:0/4025406839 learned_addr learned my addr 172.21.15.106:0/4025406839 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790948078 0 0) 0x7f2394072610 con 0x7f2394135870 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): my global_id is 224351 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2384003530 con 0x7f2394135870 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200354808 0 0) 0x7f2394072330 con 0x7f23941353b0 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient(hunting): my global_id is 244113 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2394072610 con 0x7f23941353b0 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2235504484 0 0) 0x7f2394072610 con 0x7f23941353b0 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 >> v1:172.21.15.106:6793/0 conn(0x7f2394135870 legacy=0x7f2394135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 >> v1:172.21.15.171:6791/0 conn(0x7f239413bdf0 legacy=0x7f239413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: _finish_hunting 0 2024-04-26T00:06:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 monclient: found mon.noname-d 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23940a3260 con 0x7f23941353b0 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: _finish_auth 0 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: _check_auth_tickets 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2388001740 con 0x7f23941353b0 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: dump: 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 5 monclient: authenticate success, global_id 244113 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23880019a0 con 0x7f23941353b0 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 4 set_mon_vals no callback set 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 1 -- 172.21.15.106:0/4025406839 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2388003960 con 0x7f23941353b0 2024-04-26T00:06:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f23937fe640 10 monclient: dump: 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 10 monclient: shutdown 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 -- 172.21.15.106:0/4025406839 >> v1:172.21.15.106:6792/0 conn(0x7f23941353b0 legacy=0x7f239413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 -- 172.21.15.106:0/4025406839 shutdown_connections 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:58.997+0000 7f239afb6640 1 -- 172.21.15.106:0/4025406839 >> 172.21.15.106:0/4025406839 conn(0x7f23940a64e0 msgr2=0x7f23940a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- 172.21.15.106:0/4025406839 shutdown_connections 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- 172.21.15.106:0/4025406839 wait complete. 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: build_initial_monmap 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: monmap: 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 Processor -- start 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- start start 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: init 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: _add_conns ranks=[5,3,4,1,8,7,6,0,2] 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient(hunting): picked mon.noname-h con 0x7f23941353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient(hunting): picked mon.noname-g con 0x7f2394135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient(hunting): picked mon.noname-c con 0x7f239413bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:06:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f239409f930 con 0x7f2394135870 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2394132450 con 0x7f239413bdf0 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2394134580 con 0x7f23941353b0 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient(hunting): authenticate will time out at 1674.529433s 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f2399553640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f239413bdf0 0x7f23941d49e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41084/0 (socket says 172.21.15.106:41084) 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f2399553640 1 -- 172.21.15.106:0/1130143241 learned_addr learned my addr 172.21.15.106:0/1130143241 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3246441586 0 0) 0x7f2394132450 con 0x7f239413bdf0 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): my global_id is 146056 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2378003530 con 0x7f239413bdf0 2024-04-26T00:06:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3562031971 0 0) 0x7f2378003530 con 0x7f239413bdf0 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2394132450 con 0x7f239413bdf0 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f238c001d50 con 0x7f239413bdf0 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): dump: 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2718364659 0 0) 0x7f2394134580 con 0x7f23941353b0 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): my global_id is 7484 2024-04-26T00:06:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2378003530 con 0x7f23941353b0 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532776522 0 0) 0x7f23940a3260 con 0x7f2394135870 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): my global_id is 214536 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2394134580 con 0x7f2394135870 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 800232516 0 0) 0x7f2394132450 con 0x7f239413bdf0 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.171:6791/0 conn(0x7f23941353b0 legacy=0x7f2394131630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.171:6790/0 conn(0x7f2394135870 legacy=0x7f2394131d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: _finish_hunting 0 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 monclient: found mon.c 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2394134860 con 0x7f239413bdf0 2024-04-26T00:06:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: _finish_auth 0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: _check_auth_tickets 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 5 monclient: authenticate success, global_id 146056 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: _renew_subs 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2394132e20 con 0x7f239413bdf0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: _renew_subs 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2394134fe0 con 0x7f239413bdf0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f238c003cd0 con 0x7f239413bdf0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f238c004240 con 0x7f239413bdf0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f2392ffd640 4 set_mon_vals no callback set 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: dump: 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f23740065d0 con 0x7f2374002870 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f238c0043e0 con 0x7f239413bdf0 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f238c045470 con 0x7f239413bdf0 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981159514 0 0) 0x7f23740065d0 con 0x7f2374002870 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient(hunting): my global_id is 7445 2024-04-26T00:06:58.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2394132450 con 0x7f2374002870 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2184905047 0 0) 0x7f2394132450 con 0x7f2374002870 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23740065d0 con 0x7f2374002870 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f23800015a0 con 0x7f2374002870 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f2393fff640 10 monclient: get_auth_request con 0x7f23780379f0 auth_method 0 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.001+0000 7f23917fa640 10 monclient: dump: 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:58.999 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.005+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 289808278 0 0) 0x7f23740065d0 con 0x7f2374002870 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.005+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f237400a160 con 0x7f2374002870 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.005+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f23800015a0 con 0x7f2374002870 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.005+0000 7f23917fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.005+0000 7f23917fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:59.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.005+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374002870 legacy=0x7f2374004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.005+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374002870 legacy=0x7f2374004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f239afb6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2374009e50 con 0x7f2374009110 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2523482695 0 0) 0x7f2374009e50 con 0x7f2374009110 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): my global_id is 7454 2024-04-26T00:06:59.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23740065d0 con 0x7f2374009110 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1577120780 0 0) 0x7f23740065d0 con 0x7f2374009110 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2374009e50 con 0x7f2374009110 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2380004d20 con 0x7f2374009110 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient: dump: 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.004 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 84779695 0 0) 0x7f2374009e50 con 0x7f2374009110 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f237400c3e0 con 0x7f2374009110 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f2398d52640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374009110 legacy=0x7f23740095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f2398d52640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374009110 legacy=0x7f23740095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f2398d52640 1 --1- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374009110 0x7f23740095a0 :-1 s=OPENED pgs=677 cs=1 l=1).handle_message read tag failed 2024-04-26T00:06:59.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f2398d52640 1 --1- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374009110 0x7f23740095a0 :-1 s=OPENED pgs=677 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374009110 legacy=0x7f23740095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f2374009110 legacy=0x7f23740095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2374009e50 con 0x7f23780413a0 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393258059 0 0) 0x7f2374009e50 con 0x7f23780413a0 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient(hunting): my global_id is 7463 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23740065d0 con 0x7f23780413a0 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3906452324 0 0) 0x7f23740065d0 con 0x7f23780413a0 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2374009e50 con 0x7f23780413a0 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2380005640 con 0x7f23780413a0 2024-04-26T00:06:59.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.009+0000 7f23917fa640 10 monclient: dump: 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.007 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2436401817 0 0) 0x7f2374009e50 con 0x7f23780413a0 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f23800015a0 con 0x7f23780413a0 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2760484348) 0x7f2380006a30 con 0x7f23780413a0 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f23917fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f23917fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f23780413a0 legacy=0x7f2378041780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f23917fa640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6790/0 conn(0x7f23780413a0 legacy=0x7f2378041780 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f2399553640 1 -- 172.21.15.106:0/1130143241 reap_dead start 2024-04-26T00:06:59.009 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:06:59.009 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:59.009 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 737576, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:06:59.010 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:06:59.011 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:06:59.012 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.012 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.012 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.012 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.012 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.012 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.012 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.013 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.013 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.013 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.013 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.013 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.014 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.015 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.016 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.017 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:06:59.020 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.023 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:06:59.024 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.024 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.025 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.025 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.025 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.026 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.026 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.026 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.027 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:06:59.028 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.031 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.032 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:06:59.033 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:06:59.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.171:6812/722422047 conn(0x7f23780379f0 legacy=0x7f2378039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 10 monclient: shutdown 2024-04-26T00:06:59.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 >> v1:172.21.15.106:6791/0 conn(0x7f239413bdf0 legacy=0x7f23941d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 shutdown_connections 2024-04-26T00:06:59.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 >> 172.21.15.106:0/1130143241 conn(0x7f23940a64e0 msgr2=0x7f239413b3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 shutdown_connections 2024-04-26T00:06:59.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.013+0000 7f239afb6640 1 -- 172.21.15.106:0/1130143241 wait complete. 2024-04-26T00:06:59.036 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:06:59.036 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:06:59.036 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:06:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: get_monmap_and_config 2024-04-26T00:06:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: monmap: 2024-04-26T00:06:59.157 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:59.182532+0000 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:59.182532+0000 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.158 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 Processor -- start 2024-04-26T00:06:59.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- start start 2024-04-26T00:06:59.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: init 2024-04-26T00:06:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: _add_conns ranks=[5,8,7,2,3,1,0,4,6] 2024-04-26T00:06:59.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient(hunting): picked mon.noname-h con 0x7f50f8134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient(hunting): picked mon.noname-e con 0x7f50f80a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient(hunting): picked mon.noname-i con 0x7f50f813e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f806dd40 con 0x7f50f8134970 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f80a2b10 con 0x7f50f813e200 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f80a2df0 con 0x7f50f80a4820 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient(hunting): authenticate will time out at 1674.709635s 2024-04-26T00:06:59.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fd691640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f50f80a4820 0x7f50f813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45924/0 (socket says 172.21.15.106:45924) 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fd691640 1 -- 172.21.15.106:0/1226130082 learned_addr learned my addr 172.21.15.106:0/1226130082 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312780484 0 0) 0x7f50f80a2df0 con 0x7f50f80a4820 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient(hunting): my global_id is 224360 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e0003530 con 0x7f50f80a4820 2024-04-26T00:06:59.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1466400795 0 0) 0x7f50e0003530 con 0x7f50f80a4820 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 >> v1:172.21.15.171:6792/0 conn(0x7f50f813e200 legacy=0x7f50f81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 >> v1:172.21.15.171:6791/0 conn(0x7f50f8134970 legacy=0x7f50f8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 monclient: found mon.noname-e 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f80a30d0 con 0x7f50f80a4820 2024-04-26T00:06:59.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50ec0017c0 con 0x7f50f80a4820 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 5 monclient: authenticate success, global_id 224360 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: dump: 2024-04-26T00:06:59.177 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.178 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50ec001ab0 con 0x7f50f80a4820 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 1 -- 172.21.15.106:0/1226130082 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50ec004bf0 con 0x7f50f80a4820 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 4 set_mon_vals no callback set 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f50fce90640 10 monclient: dump: 2024-04-26T00:06:59.180 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.181 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: shutdown 2024-04-26T00:06:59.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- 172.21.15.106:0/1226130082 >> v1:172.21.15.106:6793/0 conn(0x7f50f80a4820 legacy=0x7f50f813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- 172.21.15.106:0/1226130082 shutdown_connections 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- 172.21.15.106:0/1226130082 >> 172.21.15.106:0/1226130082 conn(0x7f50f80a9e20 msgr2=0x7f50f80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- 172.21.15.106:0/1226130082 shutdown_connections 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 1 -- 172.21.15.106:0/1226130082 wait complete. 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.181+0000 7f51000f6640 10 monclient: monmap: 2024-04-26T00:06:59.183 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.184 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 Processor -- start 2024-04-26T00:06:59.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 -- start start 2024-04-26T00:06:59.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient: init 2024-04-26T00:06:59.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient: _add_conns ranks=[4,0,3,5,8,7,2,1,6] 2024-04-26T00:06:59.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient(hunting): picked mon.noname-c con 0x7f50f80a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:06:59.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient(hunting): picked mon.noname-a con 0x7f50f8134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient(hunting): picked mon.noname-g con 0x7f50f813e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f809e2b0 con 0x7f50f8134970 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f80a1e00 con 0x7f50f813e200 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50f80a1a40 con 0x7f50f80a4820 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient(hunting): authenticate will time out at 1674.712555s 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50fde92640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f50f80a4820 0x7f50f809fcf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41094/0 (socket says 172.21.15.106:41094) 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50fde92640 1 -- 172.21.15.106:0/277026637 learned_addr learned my addr 172.21.15.106:0/277026637 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50fd691640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f50f8134970 0x7f50f81d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40552/0 (socket says 172.21.15.106:40552) 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2699301154 0 0) 0x7f50f809e2b0 con 0x7f50f8134970 2024-04-26T00:06:59.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): my global_id is 7704 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50e4003530 con 0x7f50f8134970 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3328116425 0 0) 0x7f50f80a1a40 con 0x7f50f80a4820 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): my global_id is 146065 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f809e2b0 con 0x7f50f80a4820 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3862413292 0 0) 0x7f50e4003530 con 0x7f50f8134970 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50f80a1a40 con 0x7f50f8134970 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50ec004b30 con 0x7f50f8134970 2024-04-26T00:06:59.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): dump: 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.189 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4225968354 0 0) 0x7f50f809e2b0 con 0x7f50f80a4820 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50e4003530 con 0x7f50f80a4820 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50e8001d60 con 0x7f50f80a4820 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): dump: 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.191 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635049991 0 0) 0x7f50f80a1e00 con 0x7f50f813e200 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): my global_id is 214545 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f809e2b0 con 0x7f50f813e200 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1461487291 0 0) 0x7f50f80a1a40 con 0x7f50f8134970 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.106:6791/0 conn(0x7f50f80a4820 legacy=0x7f50f809fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.171:6790/0 conn(0x7f50f813e200 legacy=0x7f50f81d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 monclient: found mon.a 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50f81ccb10 con 0x7f50f8134970 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 5 monclient: authenticate success, global_id 7704 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient: _renew_subs 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f50f809dfd0 con 0x7f50f8134970 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient: _renew_subs 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f50f80a0400 con 0x7f50f8134970 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50ec001860 con 0x7f50f8134970 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50ec0051a0 con 0x7f50f8134970 2024-04-26T00:06:59.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f7fff640 4 set_mon_vals no callback set 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: dump: 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.194 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50d80065d0 con 0x7f50d8002870 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3898434255 0 0) 0x7f50d80065d0 con 0x7f50d8002870 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient(hunting): my global_id is 146074 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50f80a1a40 con 0x7f50d8002870 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f50ec00ff40 con 0x7f50f8134970 2024-04-26T00:06:59.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f50ec045220 con 0x7f50f8134970 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1254396671 0 0) 0x7f50f80a1a40 con 0x7f50d8002870 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50d80065d0 con 0x7f50d8002870 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50e80020d0 con 0x7f50d8002870 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: dump: 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.196 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50fe693640 10 monclient: get_auth_request con 0x7f50e4037e40 auth_method 0 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1821750799 0 0) 0x7f50d80065d0 con 0x7f50d8002870 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f50d800a160 con 0x7f50d8002870 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f50e8005b50 con 0x7f50d8002870 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.106:6791/0 conn(0x7f50d8002870 legacy=0x7f50d8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.185+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.106:6791/0 conn(0x7f50d8002870 legacy=0x7f50d8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50d8009e30 con 0x7f50d80090f0 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385073893 0 0) 0x7f50d8009e30 con 0x7f50d80090f0 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient(hunting): my global_id is 146083 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50d80065d0 con 0x7f50d80090f0 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3358289991 0 0) 0x7f50d80065d0 con 0x7f50d80090f0 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50d8009e30 con 0x7f50d80090f0 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50e8004650 con 0x7f50d80090f0 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient: dump: 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.199 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1320711283 0 0) 0x7f50d8009e30 con 0x7f50d80090f0 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f50d800c3a0 con 0x7f50d80090f0 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 2869522814) 0x7f50e8007ef0 con 0x7f50d80090f0 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.106:6791/0 conn(0x7f50d80090f0 legacy=0x7f50d8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50f67fc640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.106:6791/0 conn(0x7f50d80090f0 legacy=0x7f50d8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.200 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 482724, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:06:59.201 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.202 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.203 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:06:59.204 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.205 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.209 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.212 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.215 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.217 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:06:59.219 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.171:6812/722422047 conn(0x7f50e4037e40 legacy=0x7f50e403a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 10 monclient: shutdown 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 >> v1:172.21.15.106:6789/0 conn(0x7f50f8134970 legacy=0x7f50f81d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50fe693640 1 -- 172.21.15.106:0/277026637 reap_dead start 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f50fe693640 1 -- 172.21.15.106:0/277026637 reap_dead start 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 shutdown_connections 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 >> 172.21.15.106:0/277026637 conn(0x7f50f80a9e20 msgr2=0x7f50f8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 shutdown_connections 2024-04-26T00:06:59.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.193+0000 7f51000f6640 1 -- 172.21.15.106:0/277026637 wait complete. 2024-04-26T00:06:59.222 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:06:59.222 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:06:59.222 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:06:59.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.365+0000 7f4666aea640 10 monclient: get_monmap_and_config 2024-04-26T00:06:59.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.365+0000 7f4666aea640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.365+0000 7f4666aea640 10 monclient: monmap: 2024-04-26T00:06:59.344 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.344 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:59.370071+0000 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:59.370071+0000 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.345 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 Processor -- start 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- start start 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: init 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: _add_conns ranks=[7,6,3,2,4,0,8,1,5] 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient(hunting): picked mon.noname-i con 0x7f4660070cb0 addr v1:172.21.15.171:6792/0 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient(hunting): picked mon.noname-d con 0x7f4660071ea0 addr v1:172.21.15.106:6792/0 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient(hunting): picked mon.noname-g con 0x7f4660070550 addr v1:172.21.15.171:6790/0 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46600a42d0 con 0x7f4660070550 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46600a17c0 con 0x7f4660071ea0 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4660072550 con 0x7f4660070cb0 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient(hunting): authenticate will time out at 1674.897367s 2024-04-26T00:06:59.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4660071ea0 0x7f466013a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53116/0 (socket says 172.21.15.106:53116) 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465ffff640 1 -- 172.21.15.106:0/2278822481 learned_addr learned my addr 172.21.15.106:0/2278822481 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3625318013 0 0) 0x7f46600a17c0 con 0x7f4660071ea0 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient(hunting): my global_id is 244122 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4648003530 con 0x7f4660071ea0 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3275672158 0 0) 0x7f4648003530 con 0x7f4660071ea0 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 >> v1:172.21.15.171:6792/0 conn(0x7f4660070cb0 legacy=0x7f4660071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 >> v1:172.21.15.171:6790/0 conn(0x7f4660070550 legacy=0x7f466013dee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 monclient: found mon.noname-d 2024-04-26T00:06:59.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:06:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46600a3800 con 0x7f4660071ea0 2024-04-26T00:06:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46500017c0 con 0x7f4660071ea0 2024-04-26T00:06:59.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 5 monclient: authenticate success, global_id 244122 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: dump: 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.359 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4650001b20 con 0x7f4660071ea0 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 4 set_mon_vals no callback set 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 1 -- 172.21.15.106:0/2278822481 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4650001d50 con 0x7f4660071ea0 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:06:59.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f465f7fe640 10 monclient: dump: 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.361 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: shutdown 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- 172.21.15.106:0/2278822481 >> v1:172.21.15.106:6792/0 conn(0x7f4660071ea0 legacy=0x7f466013a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- 172.21.15.106:0/2278822481 shutdown_connections 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- 172.21.15.106:0/2278822481 >> 172.21.15.106:0/2278822481 conn(0x7f46600a8450 msgr2=0x7f46600a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- 172.21.15.106:0/2278822481 shutdown_connections 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- 172.21.15.106:0/2278822481 wait complete. 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: monmap: 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.362 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.363 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 Processor -- start 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 1 -- start start 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.369+0000 7f4666aea640 10 monclient: init 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient: _add_conns ranks=[1,4,3,0,2,7,5,6,8] 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient(hunting): picked mon.noname-f con 0x7f4660070550 addr v1:172.21.15.171:6789/0 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient(hunting): picked mon.noname-c con 0x7f4660070cb0 addr v1:172.21.15.106:6791/0 2024-04-26T00:06:59.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient(hunting): picked mon.noname-g con 0x7f4660071ea0 addr v1:172.21.15.171:6790/0 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466013c440 con 0x7f4660070550 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466013d9f0 con 0x7f4660071ea0 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f466013de90 con 0x7f4660070cb0 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient(hunting): authenticate will time out at 1674.900321s 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f4660070cb0 0x7f46601cf390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41120/0 (socket says 172.21.15.106:41120) 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465ffff640 1 -- 172.21.15.106:0/1486171929 learned_addr learned my addr 172.21.15.106:0/1486171929 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1933758893 0 0) 0x7f466013de90 con 0x7f4660070cb0 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): my global_id is 146092 2024-04-26T00:06:59.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f464c003530 con 0x7f4660070cb0 2024-04-26T00:06:59.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1718655527 0 0) 0x7f464c003530 con 0x7f4660070cb0 2024-04-26T00:06:59.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f466013de90 con 0x7f4660070cb0 2024-04-26T00:06:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4650001780 con 0x7f4660070cb0 2024-04-26T00:06:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:06:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): dump: 2024-04-26T00:06:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.367 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.368 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.369 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4039084299 0 0) 0x7f466013c440 con 0x7f4660070550 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): my global_id is 224371 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f464c003530 con 0x7f4660070550 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1279781506 0 0) 0x7f466013de90 con 0x7f4660070cb0 2024-04-26T00:06:59.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.171:6790/0 conn(0x7f4660071ea0 legacy=0x7f46601d2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.171:6789/0 conn(0x7f4660070550 legacy=0x7f46601ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 monclient: found mon.c 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f466013e170 con 0x7f4660070cb0 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 5 monclient: authenticate success, global_id 146092 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient: _renew_subs 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f466013d200 con 0x7f4660070cb0 2024-04-26T00:06:59.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient: _renew_subs 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f46601ca200 con 0x7f4660070cb0 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4650001b20 con 0x7f4660070cb0 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f46500010b0 con 0x7f4660070cb0 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465effd640 4 set_mon_vals no callback set 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: dump: 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.372 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46400065d0 con 0x7f4640002870 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f465000feb0 con 0x7f4660070cb0 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4664886640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f4640002870 legacy=0x7f4640004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4664886640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f4640002870 legacy=0x7f4640004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4664886640 1 --1- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f4640002870 0x7f4640004d10 :-1 s=OPENED pgs=664 cs=1 l=1).handle_message read tag failed 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4664886640 1 --1- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f4640002870 0x7f4640004d10 :-1 s=OPENED pgs=664 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f4640002870 legacy=0x7f4640004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f4640002870 legacy=0x7f4640004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f466013de90 con 0x7f464c03b470 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f4650045140 con 0x7f4660070cb0 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f4664886640 10 monclient: get_auth_request con 0x7f464c0377a0 auth_method 0 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3030734175 0 0) 0x7f466013de90 con 0x7f464c03b470 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient(hunting): my global_id is 244131 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f466013d9f0 con 0x7f464c03b470 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 848465043 0 0) 0x7f466013d9f0 con 0x7f464c03b470 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f466013de90 con 0x7f464c03b470 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4658001c30 con 0x7f464c03b470 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: dump: 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.375 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 87673581 0 0) 0x7f466013de90 con 0x7f464c03b470 2024-04-26T00:06:59.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f464c040050 con 0x7f464c03b470 2024-04-26T00:06:59.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4658002060 con 0x7f464c03b470 2024-04-26T00:06:59.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:59.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f464c03b470 legacy=0x7f464c03d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.373+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f464c03b470 legacy=0x7f464c03d860 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f464000c4f0 con 0x7f46400090b0 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3584719691 0 0) 0x7f464000c4f0 con 0x7f46400090b0 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient(hunting): my global_id is 244140 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f466013de90 con 0x7f46400090b0 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3535641697 0 0) 0x7f466013de90 con 0x7f46400090b0 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f464000c4f0 con 0x7f46400090b0 2024-04-26T00:06:59.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4658003eb0 con 0x7f46400090b0 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient: dump: 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.380 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2538380918 0 0) 0x7f464000c4f0 con 0x7f46400090b0 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4640009c90 con 0x7f46400090b0 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7562 (unknown 0 0 1781131975) 0x7f4658006200 con 0x7f46400090b0 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f46400090b0 legacy=0x7f4640009540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f465d7fa640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6792/0 conn(0x7f46400090b0 legacy=0x7f4640009540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4665087640 1 -- 172.21.15.106:0/1486171929 reap_dead start 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 987, 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:06:59.382 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.383 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.384 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:06:59.385 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:06:59.386 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:06:59.387 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.388 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:06:59.389 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:59.390 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.391 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.392 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.393 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:06:59.394 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.395 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.396 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:06:59.397 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:59.398 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.399 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.400 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.401 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.401 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.401 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.401 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:06:59.401 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:06:59.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.171:6812/722422047 conn(0x7f464c0377a0 legacy=0x7f464c039c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 10 monclient: shutdown 2024-04-26T00:06:59.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 >> v1:172.21.15.106:6791/0 conn(0x7f4660070cb0 legacy=0x7f46601cf390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 shutdown_connections 2024-04-26T00:06:59.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 >> 172.21.15.106:0/1486171929 conn(0x7f46600a8450 msgr2=0x7f46601385f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 shutdown_connections 2024-04-26T00:06:59.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.381+0000 7f4666aea640 1 -- 172.21.15.106:0/1486171929 wait complete. 2024-04-26T00:06:59.403 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:06:59.403 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:06:59.404 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:06:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: get_monmap_and_config 2024-04-26T00:06:59.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: monmap: 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:59.542490+0000 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:59.542490+0000 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.517 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.518 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.518 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 Processor -- start 2024-04-26T00:06:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- start start 2024-04-26T00:06:59.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: init 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: _add_conns ranks=[0,4,1,8,6,5,3,7,2] 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient(hunting): picked mon.noname-a con 0x7fd830137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient(hunting): picked mon.noname-c con 0x7fd8300a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient(hunting): picked mon.noname-f con 0x7fd830138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300a2750 con 0x7fd830137730 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300a2a30 con 0x7fd830138220 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8300a2d10 con 0x7fd8300a0b20 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient(hunting): authenticate will time out at 1675.069627s 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82f7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fd8300a0b20 0x7fd83013ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41124/0 (socket says 172.21.15.106:41124) 2024-04-26T00:06:59.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82f7fe640 1 -- 172.21.15.106:0/3687050674 learned_addr learned my addr 172.21.15.106:0/3687050674 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1330553216 0 0) 0x7fd8300a2d10 con 0x7fd8300a0b20 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): my global_id is 146101 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd818003530 con 0x7fd8300a0b20 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 126131540 0 0) 0x7fd8300a2750 con 0x7fd830137730 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient(hunting): my global_id is 7713 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8300a2d10 con 0x7fd830137730 2024-04-26T00:06:59.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4099889268 0 0) 0x7fd818003530 con 0x7fd8300a0b20 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 >> v1:172.21.15.171:6789/0 conn(0x7fd830138220 legacy=0x7fd830140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 >> v1:172.21.15.106:6789/0 conn(0x7fd830137730 legacy=0x7fd830137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 monclient: found mon.noname-c 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300a4680 con 0x7fd8300a0b20 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8200016f0 con 0x7fd8300a0b20 2024-04-26T00:06:59.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: dump: 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.530 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 5 monclient: authenticate success, global_id 146101 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd820001a10 con 0x7fd8300a0b20 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 1 -- 172.21.15.106:0/3687050674 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd820004bf0 con 0x7fd8300a0b20 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:06:59.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd82effd640 10 monclient: dump: 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.532 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 4 set_mon_vals no callback set 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: shutdown 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- 172.21.15.106:0/3687050674 >> v1:172.21.15.106:6791/0 conn(0x7fd8300a0b20 legacy=0x7fd83013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- 172.21.15.106:0/3687050674 shutdown_connections 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- 172.21.15.106:0/3687050674 >> 172.21.15.106:0/3687050674 conn(0x7fd8300a6b80 msgr2=0x7fd8300a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- 172.21.15.106:0/3687050674 shutdown_connections 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 1 -- 172.21.15.106:0/3687050674 wait complete. 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.541+0000 7fd8364d6640 10 monclient: monmap: 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.533 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.534 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 Processor -- start 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 -- start start 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient: init 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient: _add_conns ranks=[1,0,2,8,3,4,6,5,7] 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient(hunting): picked mon.noname-f con 0x7fd8300a0b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient(hunting): picked mon.noname-a con 0x7fd830137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient(hunting): picked mon.noname-b con 0x7fd830138220 addr v1:172.21.15.106:6790/0 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83009eb00 con 0x7fd830137730 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83009ede0 con 0x7fd8300a0b20 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd83009c810 con 0x7fd830138220 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient(hunting): authenticate will time out at 1675.072731s 2024-04-26T00:06:59.535 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82f7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd830137730 0x7fd83009c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40570/0 (socket says 172.21.15.106:40570) 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82f7fe640 1 -- 172.21.15.106:0/702045092 learned_addr learned my addr 172.21.15.106:0/702045092 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1928690617 0 0) 0x7fd83009eb00 con 0x7fd830137730 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): my global_id is 7722 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd81c003530 con 0x7fd830137730 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3047445424 0 0) 0x7fd83009c810 con 0x7fd830138220 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): my global_id is 7472 2024-04-26T00:06:59.536 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd83009eb00 con 0x7fd830138220 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3269044261 0 0) 0x7fd81c003530 con 0x7fd830137730 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd83009c810 con 0x7fd830137730 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd820004b30 con 0x7fd830137730 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): dump: 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.537 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:59.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1464988478 0 0) 0x7fd83009eb00 con 0x7fd830138220 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd81c003530 con 0x7fd830138220 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd828001bf0 con 0x7fd830138220 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): dump: 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.539 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1753628487 0 0) 0x7fd83009ede0 con 0x7fd8300a0b20 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): my global_id is 224389 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd83009eb00 con 0x7fd8300a0b20 2024-04-26T00:06:59.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1932817493 0 0) 0x7fd83009c810 con 0x7fd830137730 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.106:6790/0 conn(0x7fd830138220 legacy=0x7fd8301d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.171:6789/0 conn(0x7fd8300a0b20 legacy=0x7fd83009b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 monclient: found mon.a 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8300a1e20 con 0x7fd830137730 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 5 monclient: authenticate success, global_id 7722 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient: _renew_subs 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8300a19d0 con 0x7fd830137730 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient: _renew_subs 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd83009e540 con 0x7fd830137730 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd820001a10 con 0x7fd830137730 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd820005230 con 0x7fd830137730 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82e7fc640 4 set_mon_vals no callback set 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: dump: 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.542 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd8100065d0 con 0x7fd810002870 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd82000ffd0 con 0x7fd830137730 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7fd820045170 con 0x7fd830137730 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3593776679 0 0) 0x7fd8100065d0 con 0x7fd810002870 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient(hunting): my global_id is 224369 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd83009c810 con 0x7fd810002870 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1775276378 0 0) 0x7fd83009c810 con 0x7fd810002870 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8100065d0 con 0x7fd810002870 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd824001520 con 0x7fd810002870 2024-04-26T00:06:59.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: dump: 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.545 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd834a73640 10 monclient: get_auth_request con 0x7fd81c037e40 auth_method 0 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1326937812 0 0) 0x7fd8100065d0 con 0x7fd810002870 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd81000a160 con 0x7fd810002870 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd824001520 con 0x7fd810002870 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.106:6793/0 conn(0x7fd810002870 legacy=0x7fd810004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.545+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.106:6793/0 conn(0x7fd810002870 legacy=0x7fd810004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd810009e50 con 0x7fd810009110 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1706920121 0 0) 0x7fd810009e50 con 0x7fd810009110 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient(hunting): my global_id is 224378 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8100065d0 con 0x7fd810009110 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 978969661 0 0) 0x7fd8100065d0 con 0x7fd810009110 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd810009e50 con 0x7fd810009110 2024-04-26T00:06:59.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd824003bb0 con 0x7fd810009110 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient: dump: 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.549 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1140330684 0 0) 0x7fd810009e50 con 0x7fd810009110 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd81000c3e0 con 0x7fd810009110 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2060816928) 0x7fd824003f30 con 0x7fd810009110 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:59.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.106:6793/0 conn(0x7fd810009110 legacy=0x7fd8100095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd82cff9640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.106:6793/0 conn(0x7fd810009110 legacy=0x7fd8100095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 132785, 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:06:59.551 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:06:59.552 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:06:59.553 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.554 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:06:59.555 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.556 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.557 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.558 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.559 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.560 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.561 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.562 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.563 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.564 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.565 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.566 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.567 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.568 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.569 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.570 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.571 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.571 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.571 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.571 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.571 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.571 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:06:59.571 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:06:59.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.171:6812/722422047 conn(0x7fd81c037e40 legacy=0x7fd81c03a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 10 monclient: shutdown 2024-04-26T00:06:59.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 >> v1:172.21.15.106:6789/0 conn(0x7fd830137730 legacy=0x7fd83009c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd834a73640 1 -- 172.21.15.106:0/702045092 reap_dead start 2024-04-26T00:06:59.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd834a73640 1 -- 172.21.15.106:0/702045092 reap_dead start 2024-04-26T00:06:59.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 shutdown_connections 2024-04-26T00:06:59.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 >> 172.21.15.106:0/702045092 conn(0x7fd8300a6b80 msgr2=0x7fd8300a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 shutdown_connections 2024-04-26T00:06:59.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.553+0000 7fd8364d6640 1 -- 172.21.15.106:0/702045092 wait complete. 2024-04-26T00:06:59.573 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:06:59.573 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:06:59.574 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:06:59.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: get_monmap_and_config 2024-04-26T00:06:59.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: monmap: 2024-04-26T00:06:59.685 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.685 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.685 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:59.711157+0000 2024-04-26T00:06:59.685 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:59.711157+0000 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.686 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 Processor -- start 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 -- start start 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: init 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: _add_conns ranks=[6,1,2,4,0,7,3,5,8] 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient(hunting): picked mon.noname-d con 0x7f74f8135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient(hunting): picked mon.noname-f con 0x7f74f81353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient(hunting): picked mon.noname-b con 0x7f74f813bdf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f806f2d0 con 0x7f74f81353b0 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f8072330 con 0x7f74f813bdf0 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f8072610 con 0x7f74f8135870 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient(hunting): authenticate will time out at 1675.238315s 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74fda87640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f74f813bdf0 0x7f74f813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52508/0 (socket says 172.21.15.106:52508) 2024-04-26T00:06:59.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74fda87640 1 -- 172.21.15.106:0/2791160774 learned_addr learned my addr 172.21.15.106:0/2791160774 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3082262625 0 0) 0x7f74f8072330 con 0x7f74f813bdf0 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): my global_id is 7481 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74e4003530 con 0x7f74f813bdf0 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3780354461 0 0) 0x7f74f8072610 con 0x7f74f8135870 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient(hunting): my global_id is 244149 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f8072330 con 0x7f74f8135870 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 375874711 0 0) 0x7f74e4003530 con 0x7f74f813bdf0 2024-04-26T00:06:59.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 >> v1:172.21.15.106:6792/0 conn(0x7f74f8135870 legacy=0x7f74f8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 >> v1:172.21.15.171:6789/0 conn(0x7f74f81353b0 legacy=0x7f74f813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 monclient: found mon.noname-b 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f80a3260 con 0x7f74f813bdf0 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74f0001b40 con 0x7f74f813bdf0 2024-04-26T00:06:59.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: dump: 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.698 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 5 monclient: authenticate success, global_id 7481 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74f0001da0 con 0x7f74f813bdf0 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 1 -- 172.21.15.106:0/2791160774 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74f0004f70 con 0x7f74f813bdf0 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 4 set_mon_vals no callback set 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74effff640 10 monclient: dump: 2024-04-26T00:06:59.699 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.700 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 10 monclient: shutdown 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 -- 172.21.15.106:0/2791160774 >> v1:172.21.15.106:6790/0 conn(0x7f74f813bdf0 legacy=0x7f74f813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 -- 172.21.15.106:0/2791160774 shutdown_connections 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.709+0000 7f74ff4ea640 1 -- 172.21.15.106:0/2791160774 >> 172.21.15.106:0/2791160774 conn(0x7f74f80a64e0 msgr2=0x7f74f80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- 172.21.15.106:0/2791160774 shutdown_connections 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- 172.21.15.106:0/2791160774 wait complete. 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: monmap: 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:59.701 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.702 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 Processor -- start 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- start start 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: init 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: _add_conns ranks=[0,4,3,1,5,2,6,8,7] 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient(hunting): picked mon.noname-a con 0x7f74f81353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient(hunting): picked mon.noname-c con 0x7f74f8135870 addr v1:172.21.15.106:6791/0 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient(hunting): picked mon.noname-g con 0x7f74f813bdf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f8132280 con 0x7f74f81353b0 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f81cae60 con 0x7f74f813bdf0 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74f8133d40 con 0x7f74f8135870 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.703 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient(hunting): authenticate will time out at 1675.241651s 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74fd286640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f74f81353b0 0x7f74f81ca040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40586/0 (socket says 172.21.15.106:40586) 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74fca85640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f74f8135870 0x7f74f81ca750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41138/0 (socket says 172.21.15.106:41138) 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74fd286640 1 -- 172.21.15.106:0/298264632 learned_addr learned my addr 172.21.15.106:0/298264632 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570665204 0 0) 0x7f74f8133d40 con 0x7f74f8135870 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): my global_id is 146110 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74dc003530 con 0x7f74f8135870 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 606403797 0 0) 0x7f74f8132280 con 0x7f74f81353b0 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.704 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): my global_id is 7731 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f8133d40 con 0x7f74f81353b0 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1301084265 0 0) 0x7f74dc003530 con 0x7f74f8135870 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74f8132280 con 0x7f74f8135870 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74f4001a60 con 0x7f74f8135870 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): dump: 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.705 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753042301 0 0) 0x7f74f81cae60 con 0x7f74f813bdf0 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): my global_id is 214572 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74dc003530 con 0x7f74f813bdf0 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4092752721 0 0) 0x7f74f8133d40 con 0x7f74f81353b0 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74f81cae60 con 0x7f74f81353b0 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74e8001a20 con 0x7f74f81353b0 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient(hunting): dump: 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.707 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2270980811 0 0) 0x7f74f81cae60 con 0x7f74f81353b0 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.106:6791/0 conn(0x7f74f8135870 legacy=0x7f74f81ca750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.171:6790/0 conn(0x7f74f813bdf0 legacy=0x7f74f81d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 monclient: found mon.a 2024-04-26T00:06:59.708 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74f8134020 con 0x7f74f81353b0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 5 monclient: authenticate success, global_id 7731 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: _renew_subs 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f74f81330a0 con 0x7f74f81353b0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: _renew_subs 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f74f81351e0 con 0x7f74f81353b0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f74e80038d0 con 0x7f74f81353b0 2024-04-26T00:06:59.709 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74e8003dc0 con 0x7f74f81353b0 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ef7fe640 4 set_mon_vals no callback set 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 10 monclient: dump: 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.710 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f74d80065d0 con 0x7f74d8002870 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f74e8003f60 con 0x7f74f81353b0 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.713+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f74e8045020 con 0x7f74f81353b0 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74fda87640 10 monclient: get_auth_request con 0x7f74dc037e90 auth_method 0 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 44640784 0 0) 0x7f74d80065d0 con 0x7f74d8002870 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient(hunting): my global_id is 224407 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74f81cae60 con 0x7f74d8002870 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3532622754 0 0) 0x7f74f81cae60 con 0x7f74d8002870 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74d80065d0 con 0x7f74d8002870 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74f4003e80 con 0x7f74d8002870 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient: dump: 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.712 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1372459227 0 0) 0x7f74d80065d0 con 0x7f74d8002870 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74d800a160 con 0x7f74d8002870 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f74f40041d0 con 0x7f74d8002870 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:59.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.171:6789/0 conn(0x7f74d8002870 legacy=0x7f74d8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.717+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.171:6789/0 conn(0x7f74d8002870 legacy=0x7f74d8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.721+0000 7f74ff4ea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.721+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f74d8009e30 con 0x7f74d80090f0 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 295663520 0 0) 0x7f74d8009e30 con 0x7f74d80090f0 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient(hunting): my global_id is 224416 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74d80065d0 con 0x7f74d80090f0 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 226892191 0 0) 0x7f74d80065d0 con 0x7f74d80090f0 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74d8009e30 con 0x7f74d80090f0 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74f4005b10 con 0x7f74d80090f0 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient: dump: 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.717 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1314937772 0 0) 0x7f74d8009e30 con 0x7f74d80090f0 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f74d800c3a0 con 0x7f74d80090f0 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 513656749) 0x7f74f4006fc0 con 0x7f74d80090f0 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.171:6789/0 conn(0x7f74d80090f0 legacy=0x7f74d8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74edffb640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.171:6789/0 conn(0x7f74d80090f0 legacy=0x7f74d8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:06:59.718 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 132961, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:06:59.719 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.720 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.721 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:06:59.722 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:06:59.723 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.724 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:06:59.725 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:59.726 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.727 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:06:59.728 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.729 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.730 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.731 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.732 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.733 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.734 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.735 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.736 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.737 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.738 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.739 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.739 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.739 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:06:59.739 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:06:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.171:6812/722422047 conn(0x7f74dc037e90 legacy=0x7f74dc03a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 10 monclient: shutdown 2024-04-26T00:06:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 >> v1:172.21.15.106:6789/0 conn(0x7f74f81353b0 legacy=0x7f74f81ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74fda87640 1 -- 172.21.15.106:0/298264632 reap_dead start 2024-04-26T00:06:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74fda87640 1 -- 172.21.15.106:0/298264632 reap_dead start 2024-04-26T00:06:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 shutdown_connections 2024-04-26T00:06:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 >> 172.21.15.106:0/298264632 conn(0x7f74f80a64e0 msgr2=0x7f74f812e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 shutdown_connections 2024-04-26T00:06:59.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.725+0000 7f74ff4ea640 1 -- 172.21.15.106:0/298264632 wait complete. 2024-04-26T00:06:59.741 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:06:59.741 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:06:59.741 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient: get_monmap_and_config 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient: monmap: 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:06:59.883910+0000 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:06:59.883910+0000 2024-04-26T00:06:59.858 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.859 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 1 Processor -- start 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 1 -- start start 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient: init 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient: _add_conns ranks=[8,6,7,3,1,5,2,4,0] 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient(hunting): picked mon.noname-e con 0x7f78a406e3e0 addr v1:172.21.15.106:6793/0 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient(hunting): picked mon.noname-d con 0x7f78a406fba0 addr v1:172.21.15.106:6792/0 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient(hunting): picked mon.noname-i con 0x7f78a406eed0 addr v1:172.21.15.171:6792/0 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a4070f80 con 0x7f78a406fba0 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a4071e00 con 0x7f78a406eed0 2024-04-26T00:06:59.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a40709c0 con 0x7f78a406e3e0 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient(hunting): authenticate will time out at 1675.411085s 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78a8f5f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f78a406e3e0 0x7f78a406e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45948/0 (socket says 172.21.15.106:45948) 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789bfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f78a406fba0 0x7f78a41391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53156/0 (socket says 172.21.15.106:53156) 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78a8f5f640 1 -- 172.21.15.106:0/3943665622 learned_addr learned my addr 172.21.15.106:0/3943665622 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 453819468 0 0) 0x7f78a40709c0 con 0x7f78a406e3e0 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): my global_id is 224387 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f788c003530 con 0x7f78a406e3e0 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362201110 0 0) 0x7f7894001120 con 0x7f78a406fba0 2024-04-26T00:06:59.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient(hunting): my global_id is 244158 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78a40709c0 con 0x7f78a406fba0 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498114726 0 0) 0x7f788c003530 con 0x7f78a406e3e0 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 >> v1:172.21.15.171:6792/0 conn(0x7f78a406eed0 legacy=0x7f78a413c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 >> v1:172.21.15.106:6792/0 conn(0x7f78a406fba0 legacy=0x7f78a41391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 monclient: found mon.noname-e 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a4070ca0 con 0x7f78a406e3e0 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a00017c0 con 0x7f78a406e3e0 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: dump: 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.876 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 5 monclient: authenticate success, global_id 224387 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78a0001a30 con 0x7f78a406e3e0 2024-04-26T00:06:59.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 10 monclient: get_monmap_and_config success 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f78ab1c3640 4 set_mon_vals no callback set 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 1 -- 172.21.15.106:0/3943665622 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a0004bf0 con 0x7f78a406e3e0 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.881+0000 7f789b7fe640 10 monclient: dump: 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.878 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: shutdown 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/3943665622 >> v1:172.21.15.106:6793/0 conn(0x7f78a406e3e0 legacy=0x7f78a406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/3943665622 shutdown_connections 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/3943665622 >> 172.21.15.106:0/3943665622 conn(0x7f78a40a64e0 msgr2=0x7f78a40a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/3943665622 shutdown_connections 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/3943665622 wait complete. 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: build_initial_monmap 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: monmap: 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:06:59.880 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 Processor -- start 2024-04-26T00:06:59.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- start start 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: init 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: _reopen_session rank -1 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: _add_conns ranks=[8,7,3,5,4,6,0,2,1] 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient(hunting): picked mon.noname-e con 0x7f78a406e3e0 addr v1:172.21.15.106:6793/0 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient(hunting): picked mon.noname-i con 0x7f78a406eed0 addr v1:172.21.15.171:6792/0 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient(hunting): picked mon.noname-g con 0x7f78a406fba0 addr v1:172.21.15.171:6790/0 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a41a2a50 con 0x7f78a406fba0 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a41a4d40 con 0x7f78a406eed0 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78a41a44a0 con 0x7f78a406e3e0 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient(hunting): _renew_subs 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient(hunting): authenticate will time out at 1675.413855s 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78a8f5f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f78a406e3e0 0x7f78a41b7360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45964/0 (socket says 172.21.15.106:45964) 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78a8f5f640 1 -- 172.21.15.106:0/4071507759 learned_addr learned my addr 172.21.15.106:0/4071507759 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:06:59.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2300649930 0 0) 0x7f78a41a44a0 con 0x7f78a406e3e0 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): my global_id is 224396 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7890003530 con 0x7f78a406e3e0 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3799402564 0 0) 0x7f7890003530 con 0x7f78a406e3e0 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78a41a44a0 con 0x7f78a406e3e0 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a0004b30 con 0x7f78a406e3e0 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): dump: 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.883 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.884 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 358223930 0 0) 0x7f78a41a44a0 con 0x7f78a406e3e0 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.171:6792/0 conn(0x7f78a406eed0 legacy=0x7f78a41cf3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.171:6790/0 conn(0x7f78a406fba0 legacy=0x7f78a41d2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: _finish_hunting 0 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 monclient: found mon.e 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78a41a37d0 con 0x7f78a406e3e0 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: _finish_auth 0 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: _check_auth_tickets 2024-04-26T00:06:59.885 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 5 monclient: authenticate success, global_id 224396 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: _renew_subs 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78a41c6d20 con 0x7f78a406e3e0 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: _renew_subs 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f78a41b7a70 con 0x7f78a406e3e0 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f78a00011c0 con 0x7f78a406e3e0 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78a0001d40 con 0x7f78a406e3e0 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f789affd640 4 set_mon_vals no callback set 2024-04-26T00:06:59.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 10 monclient: dump: 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.887 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f78a0010130 con 0x7f78a406e3e0 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f78840065d0 con 0x7f7884002870 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.885+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f78a00452f0 con 0x7f78a406e3e0 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78a9760640 10 monclient: get_auth_request con 0x7f7890037a80 auth_method 0 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1387342318 0 0) 0x7f78840065d0 con 0x7f7884002870 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient(hunting): my global_id is 214590 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78a41a44a0 con 0x7f7884002870 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3582051470 0 0) 0x7f78a41a44a0 con 0x7f7884002870 2024-04-26T00:06:59.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78840065d0 con 0x7f7884002870 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78940016d0 con 0x7f7884002870 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient: dump: 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.889 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1972406606 0 0) 0x7f78840065d0 con 0x7f7884002870 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f788400a160 con 0x7f7884002870 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7894001be0 con 0x7f7884002870 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.171:6790/0 conn(0x7f7884002870 legacy=0x7f7884004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.889+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.171:6790/0 conn(0x7f7884002870 legacy=0x7f7884004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.893+0000 7f78ab1c3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:06:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.893+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7884009e50 con 0x7f7884009110 2024-04-26T00:06:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 466384131 0 0) 0x7f7884009e50 con 0x7f7884009110 2024-04-26T00:06:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient(hunting): _negotiate 2024-04-26T00:06:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:06:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:06:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient(hunting): my global_id is 214599 2024-04-26T00:06:59.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78840065d0 con 0x7f7884009110 2024-04-26T00:06:59.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 13753488 0 0) 0x7f78840065d0 con 0x7f7884009110 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7884009e50 con 0x7f7884009110 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7894004de0 con 0x7f7884009110 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient: dump: 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:06:59.893 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3283777153 0 0) 0x7f7884009e50 con 0x7f7884009110 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f788400c3e0 con 0x7f7884009110 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1086446573) 0x7f7894005820 con 0x7f7884009110 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.171:6790/0 conn(0x7f7884009110 legacy=0x7f78840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78997fa640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.171:6790/0 conn(0x7f7884009110 legacy=0x7f78840095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 250320, 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:06:59.895 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.896 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.897 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:06:59.898 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:06:59.899 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:06:59.900 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.901 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:06:59.902 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:06:59.903 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.904 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.905 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.906 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.907 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:06:59.908 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.909 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:06:59.910 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:06:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:06:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:06:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.911 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.914 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:06:59.915 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:06:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:06:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:06:59.916 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:06:59.916 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:06:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.171:6812/722422047 conn(0x7f7890037a80 legacy=0x7f7890039f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 10 monclient: shutdown 2024-04-26T00:06:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:06:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 >> v1:172.21.15.106:6793/0 conn(0x7f78a406e3e0 legacy=0x7f78a41b7360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:06:59.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78a9760640 1 -- 172.21.15.106:0/4071507759 reap_dead start 2024-04-26T00:06:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78a9760640 1 -- 172.21.15.106:0/4071507759 reap_dead start 2024-04-26T00:06:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 shutdown_connections 2024-04-26T00:06:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 >> 172.21.15.106:0/4071507759 conn(0x7f78a40a64e0 msgr2=0x7f78a40a4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:06:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 shutdown_connections 2024-04-26T00:06:59.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:06:59.897+0000 7f78ab1c3640 1 -- 172.21.15.106:0/4071507759 wait complete. 2024-04-26T00:06:59.918 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:06:59.918 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:06:59.918 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:07:00.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: get_monmap_and_config 2024-04-26T00:07:00.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: build_initial_monmap 2024-04-26T00:07:00.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: monmap: 2024-04-26T00:07:00.049 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:00.049 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.049 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:00.074699+0000 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:00.074699+0000 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 Processor -- start 2024-04-26T00:07:00.050 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- start start 2024-04-26T00:07:00.051 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: init 2024-04-26T00:07:00.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: _add_conns ranks=[6,4,2,3,5,0,8,1,7] 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient(hunting): picked mon.noname-d con 0x7f7820137730 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient(hunting): picked mon.noname-c con 0x7f78200a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient(hunting): picked mon.noname-b con 0x7f7820138220 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78200a2750 con 0x7f7820138220 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78200a2a30 con 0x7f78200a0b20 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f782590d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7820138220 0x7f7820140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52516/0 (socket says 172.21.15.106:52516) 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f782510c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f7820137730 0x7f7820137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53162/0 (socket says 172.21.15.106:53162) 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f782590d640 1 -- 172.21.15.106:0/3374918155 learned_addr learned my addr 172.21.15.106:0/3374918155 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- 172.21.15.106:0/3374918155 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78200a2d10 con 0x7f7820137730 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:00.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient(hunting): authenticate will time out at 1675.602027s 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1153457397 0 0) 0x7f78200a2750 con 0x7f7820138220 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): my global_id is 7490 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f780c003530 con 0x7f7820138220 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2374538330 0 0) 0x7f78200a2a30 con 0x7f78200a0b20 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): my global_id is 146119 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78200a2750 con 0x7f78200a0b20 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592480016 0 0) 0x7f78200a2d10 con 0x7f7820137730 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.059 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient(hunting): my global_id is 244167 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78200a2a30 con 0x7f7820137730 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 321371963 0 0) 0x7f78200a2750 con 0x7f78200a0b20 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 >> v1:172.21.15.106:6792/0 conn(0x7f7820137730 legacy=0x7f7820137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 >> v1:172.21.15.106:6790/0 conn(0x7f7820138220 legacy=0x7f7820140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: _finish_hunting 0 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 monclient: found mon.noname-c 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78200a4680 con 0x7f78200a0b20 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: _finish_auth 0 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: _check_auth_tickets 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:00.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7814001720 con 0x7f78200a0b20 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: dump: 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.061 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 5 monclient: authenticate success, global_id 146119 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7814001a80 con 0x7f78200a0b20 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 1 -- 172.21.15.106:0/3374918155 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7814003960 con 0x7f78200a0b20 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 4 set_mon_vals no callback set 2024-04-26T00:07:00.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7813fff640 10 monclient: dump: 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.063 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: shutdown 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- 172.21.15.106:0/3374918155 >> v1:172.21.15.106:6791/0 conn(0x7f78200a0b20 legacy=0x7f782013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- 172.21.15.106:0/3374918155 shutdown_connections 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- 172.21.15.106:0/3374918155 >> 172.21.15.106:0/3374918155 conn(0x7f78200a6b80 msgr2=0x7f78200a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- 172.21.15.106:0/3374918155 shutdown_connections 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 1 -- 172.21.15.106:0/3374918155 wait complete. 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: build_initial_monmap 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.073+0000 7f7827370640 10 monclient: monmap: 2024-04-26T00:07:00.064 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:00.065 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 Processor -- start 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 -- start start 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient: init 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient: _add_conns ranks=[6,3,7,5,4,2,0,8,1] 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient(hunting): picked mon.noname-d con 0x7f78200a0b20 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient(hunting): picked mon.noname-g con 0x7f7820137730 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient(hunting): picked mon.noname-i con 0x7f7820138220 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78201ccdd0 con 0x7f7820137730 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78200a19d0 con 0x7f78200a0b20 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f782009f3f0 con 0x7f7820138220 2024-04-26T00:07:00.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient(hunting): authenticate will time out at 1675.604658s 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f782510c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f78200a0b20 0x7f78201cbfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53174/0 (socket says 172.21.15.106:53174) 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f782510c640 1 -- 172.21.15.106:0/3342691997 learned_addr learned my addr 172.21.15.106:0/3342691997 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4071612290 0 0) 0x7f78200a19d0 con 0x7f78200a0b20 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): my global_id is 244176 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7804003530 con 0x7f78200a0b20 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 16995840 0 0) 0x7f7804003530 con 0x7f78200a0b20 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78200a19d0 con 0x7f78200a0b20 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f781c001b60 con 0x7f78200a0b20 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:00.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): dump: 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.068 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 985433721 0 0) 0x7f78200a19d0 con 0x7f78200a0b20 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.171:6792/0 conn(0x7f7820138220 legacy=0x7f78201d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.171:6790/0 conn(0x7f7820137730 legacy=0x7f78201cc6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 monclient: found mon.d 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f782009e6e0 con 0x7f78200a0b20 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: _finish_auth 0 2024-04-26T00:07:00.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 5 monclient: authenticate success, global_id 244176 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient: _renew_subs 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f78200a03f0 con 0x7f78200a0b20 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient: _renew_subs 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f78200a0850 con 0x7f78200a0b20 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f781c004aa0 con 0x7f78200a0b20 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f781c004f90 con 0x7f78200a0b20 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f78137fe640 4 set_mon_vals no callback set 2024-04-26T00:07:00.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: dump: 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.071 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f781c00fd30 con 0x7f78200a0b20 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f78000065d0 con 0x7f7800002870 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f781c045260 con 0x7f78200a0b20 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f782590d640 10 monclient: get_auth_request con 0x7f78040377d0 auth_method 0 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 617784921 0 0) 0x7f78000065d0 con 0x7f7800002870 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient(hunting): my global_id is 7502 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78200a19d0 con 0x7f7800002870 2024-04-26T00:07:00.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2496338762 0 0) 0x7f78200a19d0 con 0x7f7800002870 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78000065d0 con 0x7f7800002870 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78140039c0 con 0x7f7800002870 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 10 monclient: dump: 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.073 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2903480137 0 0) 0x7f78000065d0 con 0x7f7800002870 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.077+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f780000a160 con 0x7f7800002870 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.081+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f78140015f0 con 0x7f7800002870 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.081+0000 7f7811ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.081+0000 7f7811ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.081+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.171:6791/0 conn(0x7f7800002870 legacy=0x7f7800004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.081+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.171:6791/0 conn(0x7f7800002870 legacy=0x7f7800004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:00.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7800009e50 con 0x7f7800009110 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 629148156 0 0) 0x7f7800009e50 con 0x7f7800009110 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient(hunting): my global_id is 7511 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78000065d0 con 0x7f7800009110 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1400762644 0 0) 0x7f78000065d0 con 0x7f7800009110 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7800009e50 con 0x7f7800009110 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7814004000 con 0x7f7800009110 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:07:00.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient: dump: 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.077 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3689437148 0 0) 0x7f7800009e50 con 0x7f7800009110 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f780000c3e0 con 0x7f7800009110 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2728195168) 0x7f7814006280 con 0x7f7800009110 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.171:6791/0 conn(0x7f7800009110 legacy=0x7f78000095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7811ffb640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.171:6791/0 conn(0x7f7800009110 legacy=0x7f78000095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:00.078 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 738596, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:00.079 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:00.080 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:00.081 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:00.082 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:00.083 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.085 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.086 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.091 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:00.093 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:00.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.097 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:00.097 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:00.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.171:6812/722422047 conn(0x7f78040377d0 legacy=0x7f7804039c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 10 monclient: shutdown 2024-04-26T00:07:00.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:00.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 >> v1:172.21.15.106:6792/0 conn(0x7f78200a0b20 legacy=0x7f78201cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f782590d640 1 -- 172.21.15.106:0/3342691997 reap_dead start 2024-04-26T00:07:00.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f782590d640 1 -- 172.21.15.106:0/3342691997 reap_dead start 2024-04-26T00:07:00.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 shutdown_connections 2024-04-26T00:07:00.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 >> 172.21.15.106:0/3342691997 conn(0x7f78200a6b80 msgr2=0x7f78200a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:00.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 shutdown_connections 2024-04-26T00:07:00.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.093+0000 7f7827370640 1 -- 172.21.15.106:0/3342691997 wait complete. 2024-04-26T00:07:00.099 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:00.099 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:07:00.100 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:07:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.225+0000 7fa669e66640 10 monclient: get_monmap_and_config 2024-04-26T00:07:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.225+0000 7fa669e66640 10 monclient: build_initial_monmap 2024-04-26T00:07:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.225+0000 7fa669e66640 10 monclient: monmap: 2024-04-26T00:07:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:00.204 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:00.230307+0000 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:00.230307+0000 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:00.205 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 Processor -- start 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- start start 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient: init 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient: _add_conns ranks=[1,3,5,2,6,7,0,4,8] 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient(hunting): picked mon.noname-f con 0x7fa664135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient(hunting): picked mon.noname-g con 0x7fa6641353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient(hunting): picked mon.noname-h con 0x7fa66413bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66406f2d0 con 0x7fa664135870 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa664072330 con 0x7fa6641353b0 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa664072610 con 0x7fa66413bdf0 2024-04-26T00:07:00.213 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient(hunting): authenticate will time out at 1675.757400s 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa6637fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fa664135870 0x7fa664135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:36844/0 (socket says 172.21.15.106:36844) 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa6637fe640 1 -- 172.21.15.106:0/257358844 learned_addr learned my addr 172.21.15.106:0/257358844 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609697367 0 0) 0x7fa664072330 con 0x7fa6641353b0 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): my global_id is 214617 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa650003530 con 0x7fa6641353b0 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 518212723 0 0) 0x7fa66406f2d0 con 0x7fa664135870 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.214 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): my global_id is 224425 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa664072330 con 0x7fa664135870 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845692365 0 0) 0x7fa664072610 con 0x7fa66413bdf0 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient(hunting): my global_id is 7520 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66406f2d0 con 0x7fa66413bdf0 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2188140864 0 0) 0x7fa664072330 con 0x7fa664135870 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 >> v1:172.21.15.171:6791/0 conn(0x7fa66413bdf0 legacy=0x7fa66413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 >> v1:172.21.15.171:6790/0 conn(0x7fa6641353b0 legacy=0x7fa66413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 monclient: found mon.noname-f 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:00.215 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6640a3260 con 0x7fa664135870 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: _finish_auth 0 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa6540017a0 con 0x7fa664135870 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: dump: 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.216 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 5 monclient: authenticate success, global_id 224425 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa654001b00 con 0x7fa664135870 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 1 -- 172.21.15.106:0/257358844 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa654004bf0 con 0x7fa664135870 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:00.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 4 set_mon_vals no callback set 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa662ffd640 10 monclient: dump: 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.218 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 10 monclient: shutdown 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- 172.21.15.106:0/257358844 >> v1:172.21.15.171:6789/0 conn(0x7fa664135870 legacy=0x7fa664135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- 172.21.15.106:0/257358844 shutdown_connections 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- 172.21.15.106:0/257358844 >> 172.21.15.106:0/257358844 conn(0x7fa6640a64e0 msgr2=0x7fa6640a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- 172.21.15.106:0/257358844 shutdown_connections 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.229+0000 7fa669e66640 1 -- 172.21.15.106:0/257358844 wait complete. 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: build_initial_monmap 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: monmap: 2024-04-26T00:07:00.219 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:00.220 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 Processor -- start 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 -- start start 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: init 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: _add_conns ranks=[0,3,1,6,7,5,8,4,2] 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient(hunting): picked mon.noname-a con 0x7fa6641353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient(hunting): picked mon.noname-g con 0x7fa664135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient(hunting): picked mon.noname-f con 0x7fa66413bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66409f930 con 0x7fa6641353b0 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa66409f470 con 0x7fa66413bdf0 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6641c7590 con 0x7fa664135870 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient(hunting): authenticate will time out at 1675.761278s 2024-04-26T00:07:00.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa6637fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fa6641353b0 0x7fa66413b340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40612/0 (socket says 172.21.15.106:40612) 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa6637fe640 1 -- 172.21.15.106:0/2458581015 learned_addr learned my addr 172.21.15.106:0/2458581015 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2534392322 0 0) 0x7fa66409f930 con 0x7fa6641353b0 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): my global_id is 7740 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa644003530 con 0x7fa6641353b0 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4086145032 0 0) 0x7fa644003530 con 0x7fa6641353b0 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa66409f930 con 0x7fa6641353b0 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa654001760 con 0x7fa6641353b0 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): dump: 2024-04-26T00:07:00.222 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966363048 0 0) 0x7fa6641c7590 con 0x7fa664135870 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient(hunting): my global_id is 214626 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa644003530 con 0x7fa664135870 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2763798925 0 0) 0x7fa66409f930 con 0x7fa6641353b0 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6790/0 conn(0x7fa664135870 legacy=0x7fa6641cf370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6789/0 conn(0x7fa66413bdf0 legacy=0x7fa6641d2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 monclient: found mon.a 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa664133200 con 0x7fa6641353b0 2024-04-26T00:07:00.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: _finish_auth 0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 5 monclient: authenticate success, global_id 7740 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: _renew_subs 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa664134c50 con 0x7fa6641353b0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: _renew_subs 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa6641c6fd0 con 0x7fa6641353b0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa654001cb0 con 0x7fa6641353b0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa654001ac0 con 0x7fa6641353b0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:00.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa6627fc640 4 set_mon_vals no callback set 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 10 monclient: dump: 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.226 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa6480065d0 con 0x7fa648002870 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa6540100f0 con 0x7fa6641353b0 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7fa654045440 con 0x7fa6641353b0 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa65affd640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa648002870 legacy=0x7fa648004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa65affd640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa648002870 legacy=0x7fa648004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa65affd640 1 --1- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa648002870 0x7fa648004d10 :-1 s=OPENED pgs=406 cs=1 l=1).handle_message read tag failed 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa65affd640 1 --1- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa648002870 0x7fa648004d10 :-1 s=OPENED pgs=406 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa648002870 legacy=0x7fa648004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa648002870 legacy=0x7fa648004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa66409f930 con 0x7fa644040e90 2024-04-26T00:07:00.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.233+0000 7fa663fff640 10 monclient: get_auth_request con 0x7fa6440376c0 auth_method 0 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 43042506 0 0) 0x7fa66409f930 con 0x7fa644040e90 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient(hunting): my global_id is 145951 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66409f470 con 0x7fa644040e90 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2889887321 0 0) 0x7fa66409f470 con 0x7fa644040e90 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa66409f930 con 0x7fa644040e90 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa64c001ad0 con 0x7fa644040e90 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient: dump: 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.228 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1754381361 0 0) 0x7fa66409f930 con 0x7fa644040e90 2024-04-26T00:07:00.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa644045b70 con 0x7fa644040e90 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa64c0057b0 con 0x7fa644040e90 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa644040e90 legacy=0x7fa6440432b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.237+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa644040e90 legacy=0x7fa6440432b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.241+0000 7fa669e66640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.241+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa648009e30 con 0x7fa6480090f0 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2843236406 0 0) 0x7fa648009e30 con 0x7fa6480090f0 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient(hunting): my global_id is 145960 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa66409f930 con 0x7fa6480090f0 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1593271850 0 0) 0x7fa66409f930 con 0x7fa6480090f0 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa648009e30 con 0x7fa6480090f0 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa64c003c30 con 0x7fa6480090f0 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient: dump: 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.232 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2629418142 0 0) 0x7fa648009e30 con 0x7fa6480090f0 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa64800c3a0 con 0x7fa6480090f0 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2250864607) 0x7fa64c005960 con 0x7fa6480090f0 2024-04-26T00:07:00.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa6480090f0 legacy=0x7fa648009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa660ff9640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6792/0 conn(0x7fa6480090f0 legacy=0x7fa648009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa663fff640 1 -- 172.21.15.106:0/2458581015 reap_dead start 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:00.234 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 483778, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:00.235 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:00.236 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:00.237 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:00.238 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:00.239 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.240 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:00.241 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.242 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.243 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:00.244 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.245 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:00.246 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.247 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:00.248 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.249 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.250 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:00.251 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:00.252 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.171:6812/722422047 conn(0x7fa6440376c0 legacy=0x7fa644039b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 10 monclient: shutdown 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 >> v1:172.21.15.106:6789/0 conn(0x7fa6641353b0 legacy=0x7fa66413b340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 shutdown_connections 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 >> 172.21.15.106:0/2458581015 conn(0x7fa6640a64e0 msgr2=0x7fa6640a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 shutdown_connections 2024-04-26T00:07:00.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.245+0000 7fa669e66640 1 -- 172.21.15.106:0/2458581015 wait complete. 2024-04-26T00:07:00.254 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:00.254 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:07:00.254 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:07:00.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient: get_monmap_and_config 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient: build_initial_monmap 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient: monmap: 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:00.384716+0000 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:00.384716+0000 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:00.359 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:00.360 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:00.360 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 1 Processor -- start 2024-04-26T00:07:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 1 -- start start 2024-04-26T00:07:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient: init 2024-04-26T00:07:00.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient: _add_conns ranks=[0,2,3,8,1,5,7,6,4] 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient(hunting): picked mon.noname-a con 0x7fe888137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient(hunting): picked mon.noname-b con 0x7fe8880a0b20 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient(hunting): picked mon.noname-g con 0x7fe888138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880a2750 con 0x7fe888137730 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880a2a30 con 0x7fe8880a0b20 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880a2d10 con 0x7fe888138220 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe88e640640 10 monclient(hunting): authenticate will time out at 1675.911589s 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe8877fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fe8880a0b20 0x7fe88813ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52524/0 (socket says 172.21.15.106:52524) 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe887fff640 1 --1- 172.21.15.106:0/2034050645 >> v1:172.21.15.106:6789/0 conn(0x7fe888137730 0x7fe888137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40622/0 (socket says 172.21.15.106:40622) 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.381+0000 7fe8877fe640 1 -- 172.21.15.106:0/2034050645 learned_addr learned my addr 172.21.15.106:0/2034050645 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2240902551 0 0) 0x7fe8880a2750 con 0x7fe888137730 2024-04-26T00:07:00.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): my global_id is 7749 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe870003530 con 0x7fe888137730 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2101682560 0 0) 0x7fe8880a2a30 con 0x7fe8880a0b20 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient(hunting): my global_id is 7499 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8880a2750 con 0x7fe8880a0b20 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3941881048 0 0) 0x7fe870003530 con 0x7fe888137730 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 >> v1:172.21.15.171:6790/0 conn(0x7fe888138220 legacy=0x7fe888140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 >> v1:172.21.15.106:6790/0 conn(0x7fe8880a0b20 legacy=0x7fe88813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:00.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 monclient: found mon.noname-a 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8880a4680 con 0x7fe888137730 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: _finish_auth 0 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe8780016f0 con 0x7fe888137730 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: dump: 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.368 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 5 monclient: authenticate success, global_id 7749 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8780019d0 con 0x7fe888137730 2024-04-26T00:07:00.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 1 -- 172.21.15.106:0/2034050645 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe878004b30 con 0x7fe888137730 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe886ffd640 10 monclient: dump: 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.370 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 4 set_mon_vals no callback set 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: shutdown 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2034050645 >> v1:172.21.15.106:6789/0 conn(0x7fe888137730 legacy=0x7fe888137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2034050645 shutdown_connections 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2034050645 >> 172.21.15.106:0/2034050645 conn(0x7fe8880a6b80 msgr2=0x7fe8880a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2034050645 shutdown_connections 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2034050645 wait complete. 2024-04-26T00:07:00.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: build_initial_monmap 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: monmap: 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:00.372 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 Processor -- start 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- start start 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: init 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _add_conns ranks=[0,1,6,4,2,3,7,5,8] 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient(hunting): picked mon.noname-a con 0x7fe8880a0b20 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient(hunting): picked mon.noname-f con 0x7fe888137730 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:00.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient(hunting): picked mon.noname-d con 0x7fe888138220 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8881c9ae0 con 0x7fe8880a0b20 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8880a19d0 con 0x7fe888137730 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe88809fa00 con 0x7fe888138220 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient(hunting): authenticate will time out at 1675.914336s 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe887fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe8880a0b20 0x7fe8881c8cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40624/0 (socket says 172.21.15.106:40624) 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe887fff640 1 -- 172.21.15.106:0/2499070270 learned_addr learned my addr 172.21.15.106:0/2499070270 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2362725766 0 0) 0x7fe8881c9ae0 con 0x7fe8880a0b20 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): my global_id is 7758 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe874003530 con 0x7fe8880a0b20 2024-04-26T00:07:00.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3911557276 0 0) 0x7fe88809fa00 con 0x7fe888138220 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): my global_id is 244185 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8881c9ae0 con 0x7fe888138220 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1945748130 0 0) 0x7fe874003530 con 0x7fe8880a0b20 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe88809fa00 con 0x7fe8880a0b20 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 747974667 0 0) 0x7fe8881c9ae0 con 0x7fe888138220 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe874003530 con 0x7fe888138220 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe878001370 con 0x7fe8880a0b20 2024-04-26T00:07:00.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:00.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:00.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): dump: 2024-04-26T00:07:00.376 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.377 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe880001cc0 con 0x7fe888138220 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient(hunting): dump: 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.378 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3855197698 0 0) 0x7fe88809fa00 con 0x7fe8880a0b20 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 >> v1:172.21.15.106:6792/0 conn(0x7fe888138220 legacy=0x7fe8881d4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 >> v1:172.21.15.171:6789/0 conn(0x7fe888137730 legacy=0x7fe8881c93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 monclient: found mon.a 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.379 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88809e0d0 con 0x7fe8880a0b20 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: _finish_auth 0 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 5 monclient: authenticate success, global_id 7758 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _renew_subs 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe88809e770 con 0x7fe8880a0b20 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _renew_subs 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe8880a0630 con 0x7fe8880a0b20 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe8780019d0 con 0x7fe8880a0b20 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe8780051c0 con 0x7fe8880a0b20 2024-04-26T00:07:00.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe8867fc640 4 set_mon_vals no callback set 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe884ff9640 10 monclient: dump: 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:00.381 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.385+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe868005090 con 0x7fe8880a0b20 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.389+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe87800ff60 con 0x7fe8880a0b20 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.389+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7fe8780451c0 con 0x7fe8880a0b20 2024-04-26T00:07:00.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.389+0000 7fe8877fe640 10 monclient: get_auth_request con 0x7fe874037e90 auth_method 0 2024-04-26T00:07:00.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.393+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe8780157f0 con 0x7fe8880a0b20 2024-04-26T00:07:00.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.393+0000 7fe884ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:00.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.393+0000 7fe884ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.601+0000 7fe88e640640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:07:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.601+0000 7fe88e640640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:07:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.601+0000 7fe88e640640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.601+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe868005b90 con 0x7fe8880a0b20 2024-04-26T00:07:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.601+0000 7fe884ff9640 1 -- 172.21.15.106:0/2499070270 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fe87801dca0 con 0x7fe8880a0b20 2024-04-26T00:07:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.601+0000 7fe884ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:07:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.601+0000 7fe884ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:00.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 >> v1:172.21.15.171:6812/722422047 conn(0x7fe874037e90 legacy=0x7fe87403a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 10 monclient: shutdown 2024-04-26T00:07:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:00.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=23,config=2,health=12,kv=11,logm=52} crc {auth=2269420710,config=692619927,health=3486549131,kv=3662208445,logm=3571485570}) 2024-04-26T00:07:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 >> v1:172.21.15.106:6789/0 conn(0x7fe8880a0b20 legacy=0x7fe8881c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:00.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=29,config=2,health=10,kv=10,logm=49} crc {auth=3108079169,config=692619927,health=3235411106,kv=2164322725,logm=1166818978}) 2024-04-26T00:07:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 shutdown_connections 2024-04-26T00:07:00.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 >> 172.21.15.106:0/2499070270 conn(0x7fe8880a6b80 msgr2=0x7fe8880a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:00.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=283156029,config=692619927,health=3486549131,kv=2103812669,logm=1493018605}) 2024-04-26T00:07:00.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=1200836528,config=692619927,health=3486549131,kv=369529968,logm=4206604625}) 2024-04-26T00:07:00.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 shutdown_connections 2024-04-26T00:07:00.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=29,config=2,health=11,kv=11,logm=47} crc {auth=1553082678,config=692619927,health=2252153260,kv=2486284834,logm=2468091222}) 2024-04-26T00:07:00.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:00.605+0000 7fe88e640640 1 -- 172.21.15.106:0/2499070270 wait complete. 2024-04-26T00:07:00.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=30,config=1,health=11,kv=12,logm=46} crc {auth=3184151220,config=1228700967,health=1845603359,kv=1996692365,logm=3620253982}) 2024-04-26T00:07:00.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=29,config=2,health=9,kv=11,logm=49} crc {auth=3108079169,config=692619927,health=150611749,kv=3727837291,logm=2750263360}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=813279920,config=692619927,health=3486549131,kv=2490975962,logm=2296116659}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.605+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=3267882428,config=692619927,health=3524079528,kv=1996692365,logm=382523601}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3883989539}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=704392773}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=640044115}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=338873754}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2688541776}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3388434558}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2297155088}) 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1681062230}) 2024-04-26T00:07:00.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.609+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3322645909}) 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3061394445}) 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3070699148}) 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1061986397}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1489316809}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1182195628}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3146385794}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3350990919}) 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3844993343}) 2024-04-26T00:07:00.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.613+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3824320421}) 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=899399001}) 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2747538462}) 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3795892251}) 2024-04-26T00:07:00.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=893728279}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4064302663}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=736749143}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1098872676}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1128748479}) 2024-04-26T00:07:00.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.617+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=726423710}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=795478919}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1643084807}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=734446565}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2766068074}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4148145688}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2777593233}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1730873659}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2789582502}) 2024-04-26T00:07:00.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.621+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1057921423}) 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2553126338}) 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2761615456}) 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4282362471}) 2024-04-26T00:07:00.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2493518012}) 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2068167162}) 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2283578101}) 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445678423}) 2024-04-26T00:07:00.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344086424}) 2024-04-26T00:07:00.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3069461910}) 2024-04-26T00:07:00.606 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2659293761}) 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2654704057}) 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2097497355}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1087400332}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3285073659}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2512789584}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2123091906}) 2024-04-26T00:07:00.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3454269169}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.625+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1820164839}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4090128528}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=438984540}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2615608973}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3612042052}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=258062218}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3727467277}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1834040476}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=433763211}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.629+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=73567503}) 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1858999598}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1334872739}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2378735569}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1805779593}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3272711693}) 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1040213694}) 2024-04-26T00:07:00.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=432875226}) 2024-04-26T00:07:00.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1271987581}) 2024-04-26T00:07:00.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.633+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=384851410}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2313234565}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=809061999}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1087905178}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3150931577}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2902721039}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1129650479}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3134579164}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=783437082}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1897315347}) 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=309876085}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=25860277}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4173120658}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=221231116}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2576161545}) 2024-04-26T00:07:00.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=49180012}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3020933784}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=564200254}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.637+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=628671294}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2717983718}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2480754935}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2169006474}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1614291238}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2144668347}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=119381727}) 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2272961628}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=546884172}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4082183512}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1768508539}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3891888860}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1187367801}) 2024-04-26T00:07:00.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1206473692}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=455004643}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=358410084}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2223056480}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2107584505}) 2024-04-26T00:07:00.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.641+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2757385795}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2518897973}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1683552282}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1405349033}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1700804727}) 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=701957880}) 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1740850677}) 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=448380067}) 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=910214809}) 2024-04-26T00:07:00.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.645+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2904504235}) 2024-04-26T00:07:00.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3469766569}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=548025124}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3243503450}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2020535232}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=128281657}) 2024-04-26T00:07:00.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1991459927}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3879960103}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1404986695}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.649+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2879714979}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=614717410}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3642736865}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4016131231}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2213848350}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2415210841}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=603116992}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2708655975}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3934742955}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3456541674}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.653+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1831251146}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=811999716}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3131737607}) 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2827258832}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3537397568}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=351842805}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4110575581}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2030617828}) 2024-04-26T00:07:00.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3276144812}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2098365190}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1470799248}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3608310363}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2586361374}) 2024-04-26T00:07:00.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2457051906}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1576989869}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=771456926}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198053001}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.657+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3097167263}) 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1635979576}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4233807206}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2959765806}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4035162458}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3147485710}) 2024-04-26T00:07:00.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4100190356}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2931744995}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3444049642}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.661+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=302799078}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1713405454}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2489367416}) 2024-04-26T00:07:00.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1268714690}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2380502429}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1848985995}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4120783514}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3737910304}) 2024-04-26T00:07:00.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2776500994}) 2024-04-26T00:07:00.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4133354410}) 2024-04-26T00:07:00.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2995689509}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=679429778}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1575535594}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3976566473}) 2024-04-26T00:07:00.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2484370011}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2866073942}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3490011238}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3853965804}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.665+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2075543096}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2474234557}) 2024-04-26T00:07:00.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2049238021}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=438522844}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2494564640}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1720954190}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3622370130}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2921598970}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2342159868}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1187294829}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3635575138}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1968447428}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1063730504}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3237184738}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1423637652}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=66790721}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=701462139}) 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1251652241}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.669+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=174124244}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3676894932}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3059043389}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=611292867}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=584089770}) 2024-04-26T00:07:00.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1608949372}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1171715282}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2191570037}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3426597218}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.673+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2487440540}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1419196215}) 2024-04-26T00:07:00.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2597140703}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=683849509}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3899416656}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1332052870}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1773128424}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2250952785}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4252450589}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4097347407}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3659202806}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1660134991}) 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=809842826}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1566504704}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=188068755}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1746985761}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4285298675}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4086685288}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.677+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3377458815}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=167194526}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3256293337}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1502899774}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4003007977}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2404540938}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1164042682}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2428002748}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2786923520}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.681+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2712306792}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3781997472}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=175272167}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3622721567}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4176949735}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4163850074}) 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3684149223}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2548661689}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=652123214}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.685+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=541676912}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=976433183}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=66340100}) 2024-04-26T00:07:00.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1823925666}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1123617871}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3786797991}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3011840605}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2742857267}) 2024-04-26T00:07:00.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=50465667}) 2024-04-26T00:07:00.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=976511882}) 2024-04-26T00:07:00.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=279884198}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3200385685}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=896720109}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2149131554}) 2024-04-26T00:07:00.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.689+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1422776861}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4190672159}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3910992128}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3947251691}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2816789326}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3629654167}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2310828504}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1354439660}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4232083834}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4280344682}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1781553112}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1751229015}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3538404831}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.693+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1212221379}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2485380190}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=219794427}) 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2673583553}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1859477698}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2519669029}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3693954269}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1540570573}) 2024-04-26T00:07:00.750 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3117709245}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3592572224}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1390047056}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1817757121}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1377322661}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=286087107}) 2024-04-26T00:07:00.751 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1690013540}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3671843225}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2894113303}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=168222275}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.697+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2678501223}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.752 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1092586694}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1708084604}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1845091490}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2888284802}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2898360279}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.753 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3484368323}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3546561764}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1289292724}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.701+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3085906639}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=963263201}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1059748001}) 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.754 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1220287964}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3636090316}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2383919217}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=21761983}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3549725774}) 2024-04-26T00:07:00.755 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956949603}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2226395753}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1094142008}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2718210695}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1189184510}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.756 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=498332287}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1676134285}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2800231130}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4126916880}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684910298}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.705+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2710175037}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.757 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=769640961}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1927853363}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1926135097}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2241617998}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2179457674}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.758 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3432656568}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367571077}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=169305350}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.709+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=669433642}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3679055556}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=782628386}) 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.759 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1178383576}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1612688037}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=874541688}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2304250016}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.760 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2863217066}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=653565425}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3347620248}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2644899516}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1317933063}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=168502923}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.761 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3567304155}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=14748291}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3251502943}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=831874928}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3492005417}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.713+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3596496405}) 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.762 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4052096583}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3081582867}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2477066934}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=31130225}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=532623978}) 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.763 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2969568145}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3627117561}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1033437756}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=200113124}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2641745761}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=53272841}) 2024-04-26T00:07:00.764 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1478478147}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2293236514}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3452000789}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2808512270}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4292957363}) 2024-04-26T00:07:00.765 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1141758436}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.717+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=411356618}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2009926520}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2754831350}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3893811335}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.766 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4021231516}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3105575708}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4039428615}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3807688374}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3294374933}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1773782864}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.767 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2075823139}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2378846280}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=273928342}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1370347682}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4041236412}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.768 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2065460171}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2289517730}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3958296385}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.721+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=684018920}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2206055110}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1988705127}) 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.769 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=26933727}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4178424010}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1307867194}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1273017875}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4147629488}) 2024-04-26T00:07:00.770 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4291202825}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.725+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=396828291}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2715854963}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3356999677}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2302213364}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.771 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3161532725}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2484212070}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=744080785}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2496972106}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3788150307}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3443360503}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.772 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3915505810}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=103507707}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1493022924}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=889562503}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4235174880}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.773 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=470753747}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2132985026}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=596142178}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.729+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=389848876}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1835519350}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=913178333}) 2024-04-26T00:07:00.774 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2830457360}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1120174736}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1302986797}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=921017865}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=885817269}) 2024-04-26T00:07:00.775 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1563731450}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2147780623}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1487494092}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1067725325}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=737479494}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4130384773}) 2024-04-26T00:07:00.776 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1616286637}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3111499635}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1287213552}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3790498220}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.733+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3229129455}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=833263049}) 2024-04-26T00:07:00.777 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3347189523}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=919628545}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1907629178}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=840832289}) 2024-04-26T00:07:00.778 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2124361737}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3334498186}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2037146849}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.737+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2615552716}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3762738182}) 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.779 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3718277091}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4097423236}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=771046570}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4083082429}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3380801805}) 2024-04-26T00:07:00.780 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3324123714}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1706648973}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3243646102}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.741+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3472195080}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=259157268}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3412174645}) 2024-04-26T00:07:00.781 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1382246579}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2349877303}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2285943137}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=73192535}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051908970}) 2024-04-26T00:07:00.782 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=588098347}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1719296323}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2912688473}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=114701059}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1652988154}) 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.783 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=590302972}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=22338831}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2777181728}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1766895215}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.745+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2694725479}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=176011802}) 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.784 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2767057556}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3898088156}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4045097173}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3423357074}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2181309190}) 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.785 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2498580657}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2559630102}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3672734086}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=781898664}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3731564117}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1909940802}) 2024-04-26T00:07:00.786 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4028619318}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3650834365}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2880944480}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1879036729}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=789446348}) 2024-04-26T00:07:00.787 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.749+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4135788432}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=584234575}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3827594081}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1964911321}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3359179687}) 2024-04-26T00:07:00.788 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=459209315}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3731961294}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1729998149}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248735826}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=167620525}) 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.789 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3159415094}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3982591910}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2762659711}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2576024793}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=403914356}) 2024-04-26T00:07:00.790 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3414439536}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=512330039}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3962256332}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.753+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2625015621}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=836588381}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2040548370}) 2024-04-26T00:07:00.791 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3518241124}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2802868750}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=832109204}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3595251070}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2183651434}) 2024-04-26T00:07:00.792 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3850687071}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2908204473}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1472617630}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=205199067}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1322591383}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.793 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1822320714}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=99001632}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1170069518}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2592137499}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2310052799}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.757+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=125999476}) 2024-04-26T00:07:00.794 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3343050209}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2577536785}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3096371250}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1245624224}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=329670374}) 2024-04-26T00:07:00.795 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2993232146}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=702859489}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=102379790}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2567225901}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1885714661}) 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.796 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=76985512}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2444483720}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1320351308}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1983815388}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=593826029}) 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.797 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3185402161}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4073017628}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.761+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2016102913}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2306976989}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4211213810}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=97124325}) 2024-04-26T00:07:00.798 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1935138931}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4283329473}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2967131943}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2654430518}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717733651}) 2024-04-26T00:07:00.799 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=125933855}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=372533693}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2914189455}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=510307531}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4201564002}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.800 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3894789049}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=292800677}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4250725419}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1799334450}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.765+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=115672085}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1275700131}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.801 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1556832299}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1469453517}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3230781207}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=108821124}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4240368854}) 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.802 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3771563279}) 2024-04-26T00:07:00.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1987835700}) 2024-04-26T00:07:00.803 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=703927737}) 2024-04-26T00:07:00.879 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.879 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.879 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2246463157}) 2024-04-26T00:07:00.879 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3714489699}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=415606169}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1159354257}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2850300002}) 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.880 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3483808369}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=193228735}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1023956676}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.769+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3173922564}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3196030939}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=84106216}) 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.881 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3495551903}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1841566526}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4020039429}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3920626856}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1220403871}) 2024-04-26T00:07:00.882 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1306002959}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2674373863}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3207253944}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2975666345}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1628319582}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.883 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=520449643}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1621193588}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=123045089}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1284678624}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3439205208}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.773+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4089257841}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.884 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2902766808}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=900896953}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4158968290}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4237725521}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1264514119}) 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.885 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=924109785}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3182877877}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4062510370}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3772676742}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=446884831}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=697617881}) 2024-04-26T00:07:00.886 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3037861185}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=138309592}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4098501110}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1455014350}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.887 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1395331874}) 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156567391}) 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.777+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2604353990}) 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1563628869}) 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=434195108}) 2024-04-26T00:07:00.888 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2330554215}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=37989413}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3919668229}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3913355401}) 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.889 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3895816030}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2706033316}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1036486818}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=742744802}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1912836800}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1830626716}) 2024-04-26T00:07:00.890 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2273163963}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1458118706}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2837793098}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2567698622}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3695372505}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.781+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2206573970}) 2024-04-26T00:07:00.891 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=246313544}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=644939638}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2341524457}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=601652816}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3820109094}) 2024-04-26T00:07:00.892 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3018887639}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3104360830}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2397775449}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3314704165}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3667499614}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3954228793}) 2024-04-26T00:07:00.893 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1845080415}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3654267721}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2424385603}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3165589495}) 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.894 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3738727938}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1007967751}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.785+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2768788566}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=672467888}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1278281317}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3001331135}) 2024-04-26T00:07:00.895 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2941677732}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=972075021}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=501471818}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2350528374}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1391158144}) 2024-04-26T00:07:00.896 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1888175989}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1445480676}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3077765542}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1773421006}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=260655478}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.897 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1705479567}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1047665876}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4150093200}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1844839215}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.789+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=263011095}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=54070776}) 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.898 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3720805498}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1956942181}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3465825363}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4053709376}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3058035375}) 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.899 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1084834654}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=901377629}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1092158438}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1499526591}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1418510611}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1245947150}) 2024-04-26T00:07:00.900 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3926241358}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1015890009}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=313417275}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3565295959}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=714312086}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.793+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3089999525}) 2024-04-26T00:07:00.901 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3040207508}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4235516390}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=733604843}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=585111017}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.902 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1879001145}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2924753773}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1055689569}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2731875942}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1777329629}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4013530572}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.903 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1953421497}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3371024516}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3253961101}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=11801261}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1350949661}) 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.904 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4229727764}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.797+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512507951}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2141096761}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3759298630}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2556272236}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1393580099}) 2024-04-26T00:07:00.905 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3710388328}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2083890673}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=490260267}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2021072658}) 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.906 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4289388815}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2825940144}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3521031924}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1829074990}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3417957845}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1394549393}) 2024-04-26T00:07:00.907 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1008445696}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1772007803}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2768075760}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2177536004}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.801+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2364079038}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.908 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1834610354}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2273196648}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=143996015}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=329723442}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2743850740}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.909 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3169627882}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1891837113}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4282557947}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=769770623}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2834876324}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1676248780}) 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.910 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4226702323}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=329699916}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2122255615}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4109631352}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4063980339}) 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.911 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=430312864}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.805+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2757731614}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=385323017}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=771602638}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2846152554}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2649786790}) 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.912 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=446532280}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2279979801}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4086005024}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2471033471}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2400188936}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.913 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=691606976}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1080605252}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2382695650}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=211459760}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1756727030}) 2024-04-26T00:07:00.914 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2223734683}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3817450014}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521065473}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.809+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=890267214}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=795190064}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.915 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=852021886}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=833080275}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=174071437}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3250942014}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2746069249}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3172496813}) 2024-04-26T00:07:00.916 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=491131539}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=801152630}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3229629696}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1624380673}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2947881660}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2217873998}) 2024-04-26T00:07:00.917 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4261762594}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4210390080}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3535005451}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3974215375}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2179137033}) 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.918 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4006539886}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1670209584}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2290762906}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=609350558}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2840832170}) 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.919 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2139756597}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.813+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1636729654}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=369709746}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3909689171}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2117034946}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=808879982}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.920 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1292923073}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4108282838}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1767151802}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=371854240}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1738883209}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=222255112}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=668320832}) 2024-04-26T00:07:00.921 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1937361667}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=499448402}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2574761918}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=212054449}) 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.922 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4255256617}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2263666308}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1636570229}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3987792372}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.817+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2296297827}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1974943329}) 2024-04-26T00:07:00.923 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2204156706}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2944571404}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=421095165}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2513817078}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2166400586}) 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.924 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2368509168}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2250922089}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=523956889}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=119858304}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3738648057}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2481664498}) 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.925 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3891928581}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1678052461}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=711246439}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=701858909}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3537412616}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.821+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2916249459}) 2024-04-26T00:07:00.926 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1570550033}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3832013077}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=309432740}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1630455734}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.927 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2761588739}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2893199732}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3008733124}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3127860795}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2567173483}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1395961077}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2186041025}) 2024-04-26T00:07:00.928 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3287292276}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1728026632}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3689639437}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2239197025}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.929 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3003073397}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1240542284}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.825+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=410361604}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1466487678}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4032083347}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4263080169}) 2024-04-26T00:07:00.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2649520011}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1430948017}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=854835918}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=645964648}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2973927875}) 2024-04-26T00:07:00.931 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2689667375}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1516524541}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4029660235}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3742332702}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3739691737}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=345526339}) 2024-04-26T00:07:00.932 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=740468209}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2778431503}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=73150813}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.829+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3691702238}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3200193646}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.933 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=36950097}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2296159350}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=257091674}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2279069896}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2806283315}) 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.934 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3727507438}) 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2600772658}) 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3124909863}) 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4221597122}) 2024-04-26T00:07:00.935 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.937 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1381955224}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1697186317}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2163484084}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1865312593}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3925803682}) 2024-04-26T00:07:00.938 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=519974091}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1487406250}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1569032202}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=92,mdsmap=3,mgr=5} crc {logm=2279021078,mdsmap=2840952586,mgr=1354568027}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=88,mdsmap=3,mgr=8,mgr_command_descs=1} crc {logm=3233067224,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=93,mdsmap=2,mgr=5} crc {logm=2391348481,mdsmap=1401145748,mgr=3169905386}) 2024-04-26T00:07:00.939 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=95,mdsmap=3,mgr=2} crc {logm=513817042,mdsmap=2840952586,mgr=3839228081}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=91,mdsmap=3,mgr=6} crc {logm=3788930458,mdsmap=2840952586,mgr=1720525354}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=91,mdsmap=2,mgr=7} crc {logm=1353793727,mdsmap=3140514009,mgr=3816727542}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.833+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=93,mdsmap=3,mgr=4} crc {logm=3224650994,mdsmap=2840952586,mgr=1658179704}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.837+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.837+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=94,mdsmap=3,mgr=3} crc {logm=3629651398,mdsmap=2840952586,mgr=3499985706}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.837+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=89,mdsmap=3,mgr=7,mgr_command_descs=1} crc {logm=2271007796,mdsmap=2840952586,mgr=3312120796,mgr_command_descs=3057339438}) 2024-04-26T00:07:00.940 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgrstat=10,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {mgr=1524621246,mgr_command_descs=3057339438,mgrstat=1844589252,mon_config_key=809949667,monmap=375078350,osd_metadata=2319416810,osd_pg_creating=4127804811,osdmap=1001831753}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=51} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1844589252,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=3306163133}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=50} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2684239674,mon_config_key=1003196044,monmap=828017138,osd_metadata=1249858579,osd_pg_creating=4127804811,osdmap=3299624661}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=4,osdmap=53} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1844589253,mon_config_key=914247793,monmap=828017138,osd_metadata=1641788751,osdmap=212674036}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.941 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1844589252,mon_config_key=3171172827,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=525032535}) 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mgr=4,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {mgr=3731975086,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3465175317,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=520271755}) 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2571577213,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=4127804811,osdmap=4179961065}) 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=10,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=55} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2053486185,mon_config_key=3430297671,monmap=828017138,osd_metadata=224540228,osd_pg_creating=4127804811,osdmap=3059324745}) 2024-04-26T00:07:00.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:07:00.845+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mgr=5,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=53} crc {mgr=1524621246,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=791646337,mon_config_key=651340629,monmap=828017138,osd_metadata=2918934446,osd_pg_creating=4127804811,osdmap=3206495040}) 2024-04-26T00:07:01.606 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:07:01.607 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:07:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient: get_monmap_and_config 2024-04-26T00:07:01.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient: build_initial_monmap 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient: monmap: 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:01.767382+0000 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:01.767382+0000 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:01.742 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:01.743 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:01.743 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 1 Processor -- start 2024-04-26T00:07:01.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 1 -- start start 2024-04-26T00:07:01.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient: init 2024-04-26T00:07:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient: _add_conns ranks=[2,8,1,3,6,7,5,0,4] 2024-04-26T00:07:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient(hunting): picked mon.noname-b con 0x7f1300135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient(hunting): picked mon.noname-e con 0x7f13001353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient(hunting): picked mon.noname-f con 0x7f130013bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:01.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130006f2d0 con 0x7f130013bdf0 2024-04-26T00:07:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1300072330 con 0x7f1300135870 2024-04-26T00:07:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1300072610 con 0x7f13001353b0 2024-04-26T00:07:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient(hunting): authenticate will time out at 1677.294722s 2024-04-26T00:07:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fe59c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f1300135870 0x7f1300135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52540/0 (socket says 172.21.15.106:52540) 2024-04-26T00:07:01.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fe59c640 1 -- 172.21.15.106:0/1122840173 learned_addr learned my addr 172.21.15.106:0/1122840173 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fdd9b640 1 --1- 172.21.15.106:0/1122840173 >> v1:172.21.15.106:6793/0 conn(0x7f13001353b0 0x7f130013a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45978/0 (socket says 172.21.15.106:45978) 2024-04-26T00:07:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203640180 0 0) 0x7f1300072330 con 0x7f1300135870 2024-04-26T00:07:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): _negotiate 2024-04-26T00:07:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:01.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): my global_id is 7508 2024-04-26T00:07:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12ec003530 con 0x7f1300135870 2024-04-26T00:07:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 775802216 0 0) 0x7f1300072610 con 0x7f13001353b0 2024-04-26T00:07:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): _negotiate 2024-04-26T00:07:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:01.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient(hunting): my global_id is 224405 2024-04-26T00:07:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1300072330 con 0x7f13001353b0 2024-04-26T00:07:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3944919228 0 0) 0x7f12ec003530 con 0x7f1300135870 2024-04-26T00:07:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 >> v1:172.21.15.106:6793/0 conn(0x7f13001353b0 legacy=0x7f130013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 >> v1:172.21.15.171:6789/0 conn(0x7f130013bdf0 legacy=0x7f130013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: _finish_hunting 0 2024-04-26T00:07:01.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 monclient: found mon.noname-b 2024-04-26T00:07:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:07:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13000a3260 con 0x7f1300135870 2024-04-26T00:07:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: _finish_auth 0 2024-04-26T00:07:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: _check_auth_tickets 2024-04-26T00:07:01.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f12e80017c0 con 0x7f1300135870 2024-04-26T00:07:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 5 monclient: authenticate success, global_id 7508 2024-04-26T00:07:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:01.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: dump: 2024-04-26T00:07:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:01.761 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:01.762 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:01.763 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:01.763 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:01.763 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:01.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:01.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12e8001a20 con 0x7f1300135870 2024-04-26T00:07:01.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:01.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:01.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 1 -- 172.21.15.106:0/1122840173 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f12e8004bf0 con 0x7f1300135870 2024-04-26T00:07:01.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:01.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f1304e55640 4 set_mon_vals no callback set 2024-04-26T00:07:01.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:01.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.765+0000 7f12fd59a640 10 monclient: dump: 2024-04-26T00:07:01.764 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:01.764 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:01.765 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.765 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.765 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:01.765 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:01.765 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:01.765 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:01.765 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:01.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: shutdown 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/1122840173 >> v1:172.21.15.106:6790/0 conn(0x7f1300135870 legacy=0x7f1300135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/1122840173 shutdown_connections 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/1122840173 >> 172.21.15.106:0/1122840173 conn(0x7f13000a64e0 msgr2=0x7f13000a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/1122840173 shutdown_connections 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/1122840173 wait complete. 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: build_initial_monmap 2024-04-26T00:07:01.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: monmap: 2024-04-26T00:07:01.768 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:01.768 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:01.768 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:01.768 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:01.768 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:01.768 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:01.768 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:01.769 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:01.769 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:01.769 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:01.769 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:01.769 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:01.769 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:01.769 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:01.770 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:01.770 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:01.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 Processor -- start 2024-04-26T00:07:01.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- start start 2024-04-26T00:07:01.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: init 2024-04-26T00:07:01.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:01.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _add_conns ranks=[0,3,8,4,5,1,6,7,2] 2024-04-26T00:07:01.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient(hunting): picked mon.noname-a con 0x7f13001353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:01.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient(hunting): picked mon.noname-g con 0x7f1300135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:01.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient(hunting): picked mon.noname-e con 0x7f130013bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:01.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1300134a00 con 0x7f13001353b0 2024-04-26T00:07:01.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130009f470 con 0x7f1300135870 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f130009f930 con 0x7f130013bdf0 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient(hunting): authenticate will time out at 1677.297701s 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12fe59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f13001353b0 0x7f1300133be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40644/0 (socket says 172.21.15.106:40644) 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12fed9d640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f130013bdf0 0x7f13001d49e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45990/0 (socket says 172.21.15.106:45990) 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12fe59c640 1 -- 172.21.15.106:0/3062978364 learned_addr learned my addr 172.21.15.106:0/3062978364 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1147947389 0 0) 0x7f130009f930 con 0x7f130013bdf0 2024-04-26T00:07:01.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): my global_id is 224414 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f12e0003530 con 0x7f130013bdf0 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2934765078 0 0) 0x7f1300134a00 con 0x7f13001353b0 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:01.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): my global_id is 7767 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f130009f930 con 0x7f13001353b0 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1850463800 0 0) 0x7f12e0003530 con 0x7f130013bdf0 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1300134a00 con 0x7f130013bdf0 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f12f8001cc0 con 0x7f130013bdf0 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:07:01.774 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:01.775 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:01.775 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.775 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.775 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:01.775 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:01.775 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:01.775 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:01.776 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:01.776 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:01.776 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:01.776 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:01.776 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:01.776 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:01.776 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:01.777 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:01.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:01.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 710129601 0 0) 0x7f130009f930 con 0x7f13001353b0 2024-04-26T00:07:01.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f12e0003530 con 0x7f13001353b0 2024-04-26T00:07:01.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f12e8004b30 con 0x7f13001353b0 2024-04-26T00:07:01.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:01.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:01.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:07:01.778 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:01.778 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:01.778 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.778 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.778 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:01.779 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1141265964 0 0) 0x7f1300134a00 con 0x7f130013bdf0 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 >> v1:172.21.15.171:6790/0 conn(0x7f1300135870 legacy=0x7f13001342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 >> v1:172.21.15.106:6789/0 conn(0x7f13001353b0 legacy=0x7f1300133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 monclient: found mon.e 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1300070810 con 0x7f130013bdf0 2024-04-26T00:07:01.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 5 monclient: authenticate success, global_id 224414 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _renew_subs 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1300070af0 con 0x7f130013bdf0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _renew_subs 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f130009dd40 con 0x7f130013bdf0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f12f80039a0 con 0x7f130013bdf0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f12f8003e90 con 0x7f130013bdf0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12fcd99640 4 set_mon_vals no callback set 2024-04-26T00:07:01.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 10 monclient: dump: 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:01.782 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f12f8004030 con 0x7f130013bdf0 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f12f8045320 con 0x7f130013bdf0 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12e4005090 con 0x7f130013bdf0 2024-04-26T00:07:01.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.769+0000 7f12fe59c640 10 monclient: get_auth_request con 0x7f12e0037e60 auth_method 0 2024-04-26T00:07:01.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.777+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f12f8015890 con 0x7f130013bdf0 2024-04-26T00:07:01.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.777+0000 7f12f6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:01.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:01.777+0000 7f12f6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.017+0000 7f1304e55640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:07:01.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.017+0000 7f1304e55640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.017+0000 7f1304e55640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.017+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f12e4005380 con 0x7f130013bdf0 2024-04-26T00:07:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.017+0000 7f12f6ffd640 1 -- 172.21.15.106:0/3062978364 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2189958382) 0x7f12f8019540 con 0x7f130013bdf0 2024-04-26T00:07:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.017+0000 7f12f6ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:01.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.017+0000 7f12f6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:01.995 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":80,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 >> v1:172.21.15.171:6812/722422047 conn(0x7f12e0037e60 legacy=0x7f12e003a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 10 monclient: shutdown 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 >> v1:172.21.15.106:6793/0 conn(0x7f130013bdf0 legacy=0x7f13001d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 shutdown_connections 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 >> 172.21.15.106:0/3062978364 conn(0x7f13000a64e0 msgr2=0x7f13000a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 shutdown_connections 2024-04-26T00:07:01.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.021+0000 7f1304e55640 1 -- 172.21.15.106:0/3062978364 wait complete. 2024-04-26T00:07:02.013 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:07:02.013 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T00:07:02.013 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:07:02.013 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:07:02.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient: get_monmap_and_config 2024-04-26T00:07:02.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient: monmap: 2024-04-26T00:07:02.129 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:02.155428+0000 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:02.155428+0000 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.130 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.131 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 1 Processor -- start 2024-04-26T00:07:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 1 -- start start 2024-04-26T00:07:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient: init 2024-04-26T00:07:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient: _add_conns ranks=[2,3,1,8,0,5,6,4,7] 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient(hunting): picked mon.noname-b con 0x7f215c09d360 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient(hunting): picked mon.noname-g con 0x7f215c09d740 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient(hunting): picked mon.noname-f con 0x7f215c09db20 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c136140 con 0x7f215c09db20 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c0a2200 con 0x7f215c09d360 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c0a3020 con 0x7f215c09d740 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f2161f12640 10 monclient(hunting): authenticate will time out at 1677.683403s 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215b7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f215c09d360 0x7f215c135a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52544/0 (socket says 172.21.15.106:52544) 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215b7fe640 1 -- 172.21.15.106:0/2426584969 learned_addr learned my addr 172.21.15.106:0/2426584969 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 75432299 0 0) 0x7f215c0a2200 con 0x7f215c09d360 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215affd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215affd640 10 monclient(hunting): my global_id is 7517 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.153+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2148003530 con 0x7f215c09d360 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1488497378 0 0) 0x7f2148003530 con 0x7f215c09d360 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 >> v1:172.21.15.171:6790/0 conn(0x7f215c09d740 legacy=0x7f215c13a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 >> v1:172.21.15.171:6789/0 conn(0x7f215c09db20 legacy=0x7f215c13de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 monclient: found mon.noname-b 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c0a3300 con 0x7f215c09d360 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 5 monclient: authenticate success, global_id 7517 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f214c0017c0 con 0x7f215c09d360 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: dump: 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.141 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f214c001ab0 con 0x7f215c09d360 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 4 set_mon_vals no callback set 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 1 -- 172.21.15.106:0/2426584969 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f214c004bf0 con 0x7f215c09d360 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215affd640 10 monclient: dump: 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.143 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: shutdown 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- 172.21.15.106:0/2426584969 >> v1:172.21.15.106:6790/0 conn(0x7f215c09d360 legacy=0x7f215c135a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- 172.21.15.106:0/2426584969 shutdown_connections 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- 172.21.15.106:0/2426584969 >> 172.21.15.106:0/2426584969 conn(0x7f215c0a6fe0 msgr2=0x7f215c0a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- 172.21.15.106:0/2426584969 shutdown_connections 2024-04-26T00:07:02.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- 172.21.15.106:0/2426584969 wait complete. 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: monmap: 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.145 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 Processor -- start 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- start start 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: init 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: _add_conns ranks=[7,4,0,6,3,8,2,5,1] 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient(hunting): picked mon.noname-i con 0x7f215c09d360 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient(hunting): picked mon.noname-c con 0x7f215c09d740 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:02.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient(hunting): picked mon.noname-a con 0x7f215c09db20 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c1339e0 con 0x7f215c09db20 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c134d20 con 0x7f215c09d740 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f215c0a2430 con 0x7f215c09d360 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient(hunting): authenticate will time out at 1677.686358s 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2153fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f215c09d740 0x7f215c1cf9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41166/0 (socket says 172.21.15.106:41166) 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2153fff640 1 -- 172.21.15.106:0/49845620 learned_addr learned my addr 172.21.15.106:0/49845620 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1639208159 0 0) 0x7f215c134d20 con 0x7f215c09d740 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): my global_id is 146128 2024-04-26T00:07:02.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f213c003530 con 0x7f215c09d740 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124163169 0 0) 0x7f215c136140 con 0x7f215c09db20 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): my global_id is 7776 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f215c134d20 con 0x7f215c09db20 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 102965524 0 0) 0x7f213c003530 con 0x7f215c09d740 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f215c136140 con 0x7f215c09d740 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3364475872 0 0) 0x7f215c134d20 con 0x7f215c09db20 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f213c003530 con 0x7f215c09db20 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2148462135 0 0) 0x7f215c0a2430 con 0x7f215c09d360 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): my global_id is 145969 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f215c134d20 con 0x7f215c09d360 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2144001ae0 con 0x7f215c09d740 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): dump: 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.149 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2154001b70 con 0x7f215c09db20 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.150 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient(hunting): dump: 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.151 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2515546730 0 0) 0x7f213c003530 con 0x7f215c09db20 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.171:6792/0 conn(0x7f215c09d360 legacy=0x7f215c1ca9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.106:6791/0 conn(0x7f215c09d740 legacy=0x7f215c1cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 monclient: found mon.a 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c1329c0 con 0x7f215c09db20 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 5 monclient: authenticate success, global_id 7776 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: _renew_subs 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f215c134a40 con 0x7f215c09db20 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: _renew_subs 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f215c131f90 con 0x7f215c09db20 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2154001d50 con 0x7f215c09db20 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2154003ce0 con 0x7f215c09db20 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f2158ff9640 10 monclient: dump: 2024-04-26T00:07:02.153 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.154 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.157+0000 7f215a7fc640 4 set_mon_vals no callback set 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2161f12640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f21400065d0 con 0x7f2140002870 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2154003f80 con 0x7f215c09db20 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f2154044030 con 0x7f215c09db20 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514701131 0 0) 0x7f21400065d0 con 0x7f2140002870 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient(hunting): my global_id is 7785 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f213c003530 con 0x7f2140002870 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2153fff640 10 monclient: get_auth_request con 0x7f213c037ed0 auth_method 0 2024-04-26T00:07:02.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2739742182 0 0) 0x7f213c003530 con 0x7f2140002870 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21400065d0 con 0x7f2140002870 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f214c001440 con 0x7f2140002870 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient: dump: 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.156 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2198461571 0 0) 0x7f21400065d0 con 0x7f2140002870 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f214000a160 con 0x7f2140002870 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f214c001730 con 0x7f2140002870 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.106:6789/0 conn(0x7f2140002870 legacy=0x7f2140004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.161+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.106:6789/0 conn(0x7f2140002870 legacy=0x7f2140004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.159 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2161f12640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:02.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2140009e50 con 0x7f2140009110 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 258615243 0 0) 0x7f2140009e50 con 0x7f2140009110 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 10 monclient(hunting): my global_id is 7794 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21400065d0 con 0x7f2140009110 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2073655540 0 0) 0x7f21400065d0 con 0x7f2140009110 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2140009e50 con 0x7f2140009110 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f214c005000 con 0x7f2140009110 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 10 monclient: dump: 2024-04-26T00:07:02.162 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.163 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1836749080 0 0) 0x7f2140009e50 con 0x7f2140009110 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.165+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f214000c3e0 con 0x7f2140009110 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7737 (unknown 0 0 1332725873) 0x7f214c0071e0 con 0x7f2140009110 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2158ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2158ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.106:6789/0 conn(0x7f2140009110 legacy=0x7f21400095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2158ff9640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.106:6789/0 conn(0x7f2140009110 legacy=0x7f21400095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:02.164 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 740728, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:02.165 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.166 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.167 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:02.168 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.169 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:02.171 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.173 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:02.175 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:02.177 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.178 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:02.179 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:02.180 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.181 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.182 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 4 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:02.183 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.171:6812/722422047 conn(0x7f213c037ed0 legacy=0x7f213c03a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 10 monclient: shutdown 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 >> v1:172.21.15.106:6789/0 conn(0x7f215c09db20 legacy=0x7f215c1d30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f215bfff640 1 -- 172.21.15.106:0/49845620 reap_dead start 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f215bfff640 1 -- 172.21.15.106:0/49845620 reap_dead start 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 shutdown_connections 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 >> 172.21.15.106:0/49845620 conn(0x7f215c0a6fe0 msgr2=0x7f215c06baa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 shutdown_connections 2024-04-26T00:07:02.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.169+0000 7f2161f12640 1 -- 172.21.15.106:0/49845620 wait complete. 2024-04-26T00:07:02.185 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:02.186 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:07:02.186 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:07:02.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.309+0000 7f9c6d4e9640 10 monclient: get_monmap_and_config 2024-04-26T00:07:02.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.309+0000 7f9c6d4e9640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.309+0000 7f9c6d4e9640 10 monclient: monmap: 2024-04-26T00:07:02.288 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.288 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.288 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:02.314237+0000 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:02.314237+0000 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.289 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 Processor -- start 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- start start 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: init 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: _add_conns ranks=[0,1,8,7,2,3,4,6,5] 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient(hunting): picked mon.noname-a con 0x7f9c68134820 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient(hunting): picked mon.noname-f con 0x7f9c680725d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient(hunting): picked mon.noname-e con 0x7f9c6813ace0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:02.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c68071270 con 0x7f9c68134820 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c680714e0 con 0x7f9c680725d0 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c680729f0 con 0x7f9c6813ace0 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient(hunting): authenticate will time out at 1677.841304s 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c66ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9c68134820 0x7f9c68134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40698/0 (socket says 172.21.15.106:40698) 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c66ffd640 1 -- 172.21.15.106:0/1395659784 learned_addr learned my addr 172.21.15.106:0/1395659784 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746687351 0 0) 0x7f9c68071270 con 0x7f9c68134820 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): my global_id is 7803 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c50003530 con 0x7f9c68134820 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798661712 0 0) 0x7f9c680729f0 con 0x7f9c6813ace0 2024-04-26T00:07:02.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient(hunting): my global_id is 224423 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c68071270 con 0x7f9c6813ace0 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3412343866 0 0) 0x7f9c50003530 con 0x7f9c68134820 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 >> v1:172.21.15.106:6793/0 conn(0x7f9c6813ace0 legacy=0x7f9c6813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 >> v1:172.21.15.171:6789/0 conn(0x7f9c680725d0 legacy=0x7f9c681395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 monclient: found mon.noname-a 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c680717c0 con 0x7f9c68134820 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c580017c0 con 0x7f9c68134820 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 5 monclient: authenticate success, global_id 7803 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: dump: 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.300 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c58001aa0 con 0x7f9c68134820 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 1 -- 172.21.15.106:0/1395659784 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c58004bf0 con 0x7f9c68134820 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c65ffb640 10 monclient: dump: 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.301 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 4 set_mon_vals no callback set 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: shutdown 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/1395659784 >> v1:172.21.15.106:6789/0 conn(0x7f9c68134820 legacy=0x7f9c68134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/1395659784 shutdown_connections 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/1395659784 >> 172.21.15.106:0/1395659784 conn(0x7f9c680a64e0 msgr2=0x7f9c680a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/1395659784 shutdown_connections 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/1395659784 wait complete. 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: monmap: 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.304 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 Processor -- start 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 1 -- start start 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.313+0000 7f9c6d4e9640 10 monclient: init 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient: _add_conns ranks=[3,1,4,6,5,7,8,2,0] 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient(hunting): picked mon.noname-g con 0x7f9c680725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient(hunting): picked mon.noname-f con 0x7f9c68134820 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient(hunting): picked mon.noname-c con 0x7f9c6813ace0 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6812dea0 con 0x7f9c68134820 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c6809f7b0 con 0x7f9c680725d0 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c680706a0 con 0x7f9c6813ace0 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient(hunting): authenticate will time out at 1677.844235s 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c677fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9c6813ace0 0x7f9c681d4650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41168/0 (socket says 172.21.15.106:41168) 2024-04-26T00:07:02.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c677fe640 1 -- 172.21.15.106:0/2690281271 learned_addr learned my addr 172.21.15.106:0/2690281271 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411437603 0 0) 0x7f9c680706a0 con 0x7f9c6813ace0 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): my global_id is 146137 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c54003530 con 0x7f9c6813ace0 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1455908234 0 0) 0x7f9c54003530 con 0x7f9c6813ace0 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c680706a0 con 0x7f9c6813ace0 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c60001dc0 con 0x7f9c6813ace0 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): dump: 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.306 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4226013667 0 0) 0x7f9c6812dea0 con 0x7f9c68134820 2024-04-26T00:07:02.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): my global_id is 224479 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c54003530 con 0x7f9c68134820 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1387681742 0 0) 0x7f9c680706a0 con 0x7f9c6813ace0 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.171:6790/0 conn(0x7f9c680725d0 legacy=0x7f9c6812d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.171:6789/0 conn(0x7f9c68134820 legacy=0x7f9c6812d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 monclient: found mon.c 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c6812ecd0 con 0x7f9c6813ace0 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 5 monclient: authenticate success, global_id 146137 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient: _renew_subs 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c6809c510 con 0x7f9c6813ace0 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient: _renew_subs 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c681d5d70 con 0x7f9c6813ace0 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c60003cd0 con 0x7f9c6813ace0 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c600041c0 con 0x7f9c6813ace0 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c657fa640 4 set_mon_vals no callback set 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: dump: 2024-04-26T00:07:02.309 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c480065d0 con 0x7f9c48002870 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9c600043e0 con 0x7f9c6813ace0 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f9c600453b0 con 0x7f9c6813ace0 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593623243 0 0) 0x7f9c480065d0 con 0x7f9c48002870 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient(hunting): my global_id is 7526 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c680706a0 con 0x7f9c48002870 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c667fc640 10 monclient: get_auth_request con 0x7f9c54037760 auth_method 0 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 527443928 0 0) 0x7f9c680706a0 con 0x7f9c48002870 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c480065d0 con 0x7f9c48002870 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c58001440 con 0x7f9c48002870 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: dump: 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.312 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1483163929 0 0) 0x7f9c480065d0 con 0x7f9c48002870 2024-04-26T00:07:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c4800a160 con 0x7f9c48002870 2024-04-26T00:07:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9c58001730 con 0x7f9c48002870 2024-04-26T00:07:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.106:6790/0 conn(0x7f9c48002870 legacy=0x7f9c48004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.317+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.106:6790/0 conn(0x7f9c48002870 legacy=0x7f9c48004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9c48009e50 con 0x7f9c48009110 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2324364387 0 0) 0x7f9c48009e50 con 0x7f9c48009110 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient(hunting): my global_id is 7535 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c480065d0 con 0x7f9c48009110 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1957389038 0 0) 0x7f9c480065d0 con 0x7f9c48009110 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c48009e50 con 0x7f9c48009110 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c58005000 con 0x7f9c48009110 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:02.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient: dump: 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.316 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 416494347 0 0) 0x7f9c48009e50 con 0x7f9c48009110 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9c4800c3e0 con 0x7f9c48009110 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3864892937) 0x7f9c58007260 con 0x7f9c48009110 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.106:6790/0 conn(0x7f9c48009110 legacy=0x7f9c480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c4f7fe640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.106:6790/0 conn(0x7f9c48009110 legacy=0x7f9c480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:02.317 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 740888, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.318 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.319 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.320 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:02.321 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.322 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.323 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:02.324 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.325 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.326 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.327 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.328 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.330 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.331 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.332 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.334 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:02.335 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:02.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.171:6812/722422047 conn(0x7f9c54037760 legacy=0x7f9c54039c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 10 monclient: shutdown 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 >> v1:172.21.15.106:6791/0 conn(0x7f9c6813ace0 legacy=0x7f9c681d4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c677fe640 1 -- 172.21.15.106:0/2690281271 reap_dead start 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c677fe640 1 -- 172.21.15.106:0/2690281271 reap_dead start 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 shutdown_connections 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 >> 172.21.15.106:0/2690281271 conn(0x7f9c680a64e0 msgr2=0x7f9c680a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 shutdown_connections 2024-04-26T00:07:02.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.325+0000 7f9c6d4e9640 1 -- 172.21.15.106:0/2690281271 wait complete. 2024-04-26T00:07:02.337 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:02.338 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:07:02.338 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.473+0000 7f6493ada640 10 monclient: get_monmap_and_config 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.473+0000 7f6493ada640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.473+0000 7f6493ada640 10 monclient: monmap: 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:02.476856+0000 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:02.476856+0000 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.451 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.452 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.473+0000 7f6493ada640 1 Processor -- start 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.473+0000 7f6493ada640 1 -- start start 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.473+0000 7f6493ada640 10 monclient: init 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient: _add_conns ranks=[5,7,1,4,3,8,0,6,2] 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient(hunting): picked mon.noname-h con 0x7f648c134760 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient(hunting): picked mon.noname-i con 0x7f648c0a0d70 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:02.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient(hunting): picked mon.noname-f con 0x7f648c13df70 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c06b910 con 0x7f648c13df70 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c09fac0 con 0x7f648c134760 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c0a0080 con 0x7f648c0a0d70 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient(hunting): authenticate will time out at 1678.004486s 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6492077640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f648c13df70 0x7f648c140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:36894/0 (socket says 172.21.15.106:36894) 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6492077640 1 -- 172.21.15.106:0/2127711027 learned_addr learned my addr 172.21.15.106:0/2127711027 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6491075640 1 --1- 172.21.15.106:0/2127711027 >> v1:172.21.15.171:6792/0 conn(0x7f648c0a0d70 0x7f648c13c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:46968/0 (socket says 172.21.15.106:46968) 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3974688033 0 0) 0x7f648c0a0080 con 0x7f648c0a0d70 2024-04-26T00:07:02.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): my global_id is 145978 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6478003530 con 0x7f648c0a0d70 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 691200679 0 0) 0x7f648c06b910 con 0x7f648c13df70 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): my global_id is 224488 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648c0a0080 con 0x7f648c13df70 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935605017 0 0) 0x7f648c09fac0 con 0x7f648c134760 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient(hunting): my global_id is 7529 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648c06b910 con 0x7f648c134760 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2555864760 0 0) 0x7f6478003530 con 0x7f648c0a0d70 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 >> v1:172.21.15.171:6791/0 conn(0x7f648c134760 legacy=0x7f648c134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 >> v1:172.21.15.171:6789/0 conn(0x7f648c13df70 legacy=0x7f648c140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 monclient: found mon.noname-i 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c09f280 con 0x7f648c0a0d70 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f647c0017c0 con 0x7f648c0a0d70 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: dump: 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.459 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 5 monclient: authenticate success, global_id 145978 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f647c001ae0 con 0x7f648c0a0d70 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 4 set_mon_vals no callback set 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 1 -- 172.21.15.106:0/2127711027 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f647c004b30 con 0x7f648c0a0d70 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:02.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6490874640 10 monclient: dump: 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.461 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient: shutdown 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- 172.21.15.106:0/2127711027 >> v1:172.21.15.171:6792/0 conn(0x7f648c0a0d70 legacy=0x7f648c13c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- 172.21.15.106:0/2127711027 shutdown_connections 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- 172.21.15.106:0/2127711027 >> 172.21.15.106:0/2127711027 conn(0x7f648c0a7240 msgr2=0x7f648c0a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- 172.21.15.106:0/2127711027 shutdown_connections 2024-04-26T00:07:02.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 1 -- 172.21.15.106:0/2127711027 wait complete. 2024-04-26T00:07:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.477+0000 7f6493ada640 10 monclient: monmap: 2024-04-26T00:07:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:02.468 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 Processor -- start 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 -- start start 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient: init 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient: _add_conns ranks=[8,6,1,3,4,7,2,0,5] 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient(hunting): picked mon.noname-e con 0x7f648c0a0d70 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient(hunting): picked mon.noname-d con 0x7f648c134760 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient(hunting): picked mon.noname-f con 0x7f648c13df70 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c072930 con 0x7f648c13df70 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c139620 con 0x7f648c134760 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f648c072500 con 0x7f648c0a0d70 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient(hunting): authenticate will time out at 1678.008981s 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6491075640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f648c134760 0x7f648c1d1d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53190/0 (socket says 172.21.15.106:53190) 2024-04-26T00:07:02.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6491075640 1 -- 172.21.15.106:0/1632474583 learned_addr learned my addr 172.21.15.106:0/1632474583 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3304671721 0 0) 0x7f648c139620 con 0x7f648c134760 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): my global_id is 244194 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6470003530 con 0x7f648c134760 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1739808013 0 0) 0x7f648c072500 con 0x7f648c0a0d70 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): my global_id is 224432 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648c139620 con 0x7f648c0a0d70 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 128970642 0 0) 0x7f6470003530 con 0x7f648c134760 2024-04-26T00:07:02.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f648c072500 con 0x7f648c134760 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2866235974 0 0) 0x7f648c139620 con 0x7f648c0a0d70 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6470003530 con 0x7f648c0a0d70 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f647c001780 con 0x7f648c134760 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): dump: 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.472 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927232449 0 0) 0x7f648c0a0080 con 0x7f648c13df70 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): my global_id is 224497 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648c139620 con 0x7f648c13df70 2024-04-26T00:07:02.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f64880019e0 con 0x7f648c0a0d70 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): dump: 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.474 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 922433909 0 0) 0x7f6470003530 con 0x7f648c0a0d70 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.106:6792/0 conn(0x7f648c134760 legacy=0x7f648c1d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.171:6789/0 conn(0x7f648c13df70 legacy=0x7f648c1d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 monclient: found mon.e 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f648c13d1d0 con 0x7f648c0a0d70 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 5 monclient: authenticate success, global_id 224432 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient: _renew_subs 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f648c139900 con 0x7f648c0a0d70 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6488001d40 con 0x7f648c0a0d70 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6488003c10 con 0x7f648c0a0d70 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: dump: 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.477 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6483fff640 4 set_mon_vals no callback set 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient: _renew_subs 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f648c1369a0 con 0x7f648c0a0d70 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6488003e30 con 0x7f648c0a0d70 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f648c062e50 con 0x7f648c1cd460 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f6488043f30 con 0x7f648c0a0d70 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542371683 0 0) 0x7f648c062e50 con 0x7f648c1cd460 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient(hunting): my global_id is 146146 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6470003530 con 0x7f648c1cd460 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f6492077640 10 monclient: get_auth_request con 0x7f6470037f20 auth_method 0 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1553516432 0 0) 0x7f6470003530 con 0x7f648c1cd460 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f648c062e50 con 0x7f648c1cd460 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f647c004b50 con 0x7f648c1cd460 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 10 monclient: dump: 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.479 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3084335563 0 0) 0x7f648c062e50 con 0x7f648c1cd460 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.481+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f648c137610 con 0x7f648c1cd460 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.485+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f647c007590 con 0x7f648c1cd460 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.485+0000 7f64827fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.485+0000 7f64827fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.485+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.106:6791/0 conn(0x7f648c1cd460 legacy=0x7f648c13e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.485+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.106:6791/0 conn(0x7f648c1cd460 legacy=0x7f648c13e350 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f648c139060 con 0x7f648c02d010 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897662183 0 0) 0x7f648c139060 con 0x7f648c02d010 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient(hunting): my global_id is 146155 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f648c062e50 con 0x7f648c02d010 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3572936955 0 0) 0x7f648c062e50 con 0x7f648c02d010 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f648c139060 con 0x7f648c02d010 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f647c005b20 con 0x7f648c02d010 2024-04-26T00:07:02.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient: dump: 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.482 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3396014147 0 0) 0x7f648c139060 con 0x7f648c02d010 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f648c1392a0 con 0x7f648c02d010 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 817203700) 0x7f647c006ee0 con 0x7f648c02d010 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.106:6791/0 conn(0x7f648c02d010 legacy=0x7f648c13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f64827fc640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.106:6791/0 conn(0x7f648c02d010 legacy=0x7f648c13ea60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 486019, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:02.484 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.485 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.486 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.487 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.488 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.489 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.490 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.491 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.492 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.493 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.494 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.495 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.496 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.497 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.498 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:02.499 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.501 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.502 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.503 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:02.503 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:02.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.171:6812/722422047 conn(0x7f6470037f20 legacy=0x7f647003a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 10 monclient: shutdown 2024-04-26T00:07:02.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 >> v1:172.21.15.106:6793/0 conn(0x7f648c0a0d70 legacy=0x7f648c1ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6492077640 1 -- 172.21.15.106:0/1632474583 reap_dead start 2024-04-26T00:07:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6492077640 1 -- 172.21.15.106:0/1632474583 reap_dead start 2024-04-26T00:07:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 shutdown_connections 2024-04-26T00:07:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 >> 172.21.15.106:0/1632474583 conn(0x7f648c0a7240 msgr2=0x7f648c0a2b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 shutdown_connections 2024-04-26T00:07:02.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.489+0000 7f6493ada640 1 -- 172.21.15.106:0/1632474583 wait complete. 2024-04-26T00:07:02.505 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:02.505 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:07:02.506 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:07:02.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.645+0000 7fb3707e0640 10 monclient: get_monmap_and_config 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.645+0000 7fb3707e0640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.645+0000 7fb3707e0640 10 monclient: monmap: 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:02.649707+0000 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:02.649707+0000 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.624 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.625 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.625 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 Processor -- start 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- start start 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: init 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: _add_conns ranks=[4,6,7,1,3,2,5,8,0] 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient(hunting): picked mon.noname-c con 0x7fb368134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient(hunting): picked mon.noname-d con 0x7fb3680a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient(hunting): picked mon.noname-i con 0x7fb36813e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36806dd40 con 0x7fb368134970 2024-04-26T00:07:02.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680a2b10 con 0x7fb3680a4820 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680a2df0 con 0x7fb36813e200 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient(hunting): authenticate will time out at 1678.177020s 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36e57c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fb368134970 0x7fb368134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41196/0 (socket says 172.21.15.106:41196) 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36e57c640 1 -- 172.21.15.106:0/3880891683 learned_addr learned my addr 172.21.15.106:0/3880891683 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584059715 0 0) 0x7fb3680a2b10 con 0x7fb3680a4820 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): my global_id is 244203 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb354003530 con 0x7fb3680a4820 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 194674076 0 0) 0x7fb36806dd40 con 0x7fb368134970 2024-04-26T00:07:02.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient(hunting): my global_id is 146164 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3680a2b10 con 0x7fb368134970 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2656921880 0 0) 0x7fb354003530 con 0x7fb3680a4820 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 >> v1:172.21.15.171:6792/0 conn(0x7fb36813e200 legacy=0x7fb3681405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 >> v1:172.21.15.106:6791/0 conn(0x7fb368134970 legacy=0x7fb368134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 monclient: found mon.noname-d 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3680a30d0 con 0x7fb3680a4820 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3580017c0 con 0x7fb3680a4820 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: dump: 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.636 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 5 monclient: authenticate success, global_id 244203 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb358001a70 con 0x7fb3680a4820 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 1 -- 172.21.15.106:0/3880891683 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb358003960 con 0x7fb3680a4820 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 4 set_mon_vals no callback set 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:02.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb36d57a640 10 monclient: dump: 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.638 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: shutdown 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- 172.21.15.106:0/3880891683 >> v1:172.21.15.106:6792/0 conn(0x7fb3680a4820 legacy=0x7fb36813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- 172.21.15.106:0/3880891683 shutdown_connections 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- 172.21.15.106:0/3880891683 >> 172.21.15.106:0/3880891683 conn(0x7fb3680a9e20 msgr2=0x7fb3680aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- 172.21.15.106:0/3880891683 shutdown_connections 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- 172.21.15.106:0/3880891683 wait complete. 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: monmap: 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:02.639 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 Processor -- start 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 1 -- start start 2024-04-26T00:07:02.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: init 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.649+0000 7fb3707e0640 10 monclient: _add_conns ranks=[0,8,3,2,4,7,6,5,1] 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient(hunting): picked mon.noname-a con 0x7fb3680a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient(hunting): picked mon.noname-e con 0x7fb368134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient(hunting): picked mon.noname-g con 0x7fb36813e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb368135b50 con 0x7fb3680a4820 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb36e57c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fb3680a4820 0x7fb3681cc6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40708/0 (socket says 172.21.15.106:40708) 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb36e57c640 1 -- 172.21.15.106:0/3204898549 learned_addr learned my addr 172.21.15.106:0/3204898549 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3680a1e00 con 0x7fb36813e200 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb368135870 con 0x7fb368134970 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient(hunting): authenticate will time out at 1678.180205s 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4042588403 0 0) 0x7fb368135b50 con 0x7fb3680a4820 2024-04-26T00:07:02.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): my global_id is 7812 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34c003530 con 0x7fb3680a4820 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 822370827 0 0) 0x7fb368135870 con 0x7fb368134970 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): my global_id is 224441 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb368135b50 con 0x7fb368134970 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3675501722 0 0) 0x7fb368135b50 con 0x7fb368134970 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb368135870 con 0x7fb368134970 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3620798245 0 0) 0x7fb34c003530 con 0x7fb3680a4820 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb368135b50 con 0x7fb3680a4820 2024-04-26T00:07:02.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb358001780 con 0x7fb368134970 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): dump: 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.643 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb364001ba0 con 0x7fb3680a4820 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): dump: 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.644 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000386506 0 0) 0x7fb3680a1e00 con 0x7fb36813e200 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): my global_id is 214671 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34c003530 con 0x7fb36813e200 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1468833963 0 0) 0x7fb368135870 con 0x7fb368134970 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.171:6790/0 conn(0x7fb36813e200 legacy=0x7fb3681d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.106:6789/0 conn(0x7fb3680a4820 legacy=0x7fb3681cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 monclient: found mon.e 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb36809f620 con 0x7fb368134970 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 5 monclient: authenticate success, global_id 224441 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient: _renew_subs 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb36809faa0 con 0x7fb368134970 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient: _renew_subs 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb36809e4a0 con 0x7fb368134970 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb358001a70 con 0x7fb368134970 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb358001ca0 con 0x7fb368134970 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb36cd79640 4 set_mon_vals no callback set 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: dump: 2024-04-26T00:07:02.647 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.648 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb3500065d0 con 0x7fb350002870 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb35800ee60 con 0x7fb368134970 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7fb3580441c0 con 0x7fb368134970 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3885695698 0 0) 0x7fb3500065d0 con 0x7fb350002870 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient(hunting): my global_id is 244212 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb368135870 con 0x7fb350002870 2024-04-26T00:07:02.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb36ed7d640 10 monclient: get_auth_request con 0x7fb34c037ec0 auth_method 0 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1533153813 0 0) 0x7fb368135870 con 0x7fb350002870 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3500065d0 con 0x7fb350002870 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb364004b30 con 0x7fb350002870 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: dump: 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.650 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1186245442 0 0) 0x7fb3500065d0 con 0x7fb350002870 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb35000a160 con 0x7fb350002870 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb3640058c0 con 0x7fb350002870 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.106:6792/0 conn(0x7fb350002870 legacy=0x7fb350004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.653+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.106:6792/0 conn(0x7fb350002870 legacy=0x7fb350004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.661+0000 7fb3707e0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.661+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb350009e50 con 0x7fb350009110 2024-04-26T00:07:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3396750404 0 0) 0x7fb350009e50 con 0x7fb350009110 2024-04-26T00:07:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient(hunting): my global_id is 244221 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3500065d0 con 0x7fb350009110 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3564121591 0 0) 0x7fb3500065d0 con 0x7fb350009110 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb350009e50 con 0x7fb350009110 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3640053d0 con 0x7fb350009110 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient: dump: 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.654 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1882727613 0 0) 0x7fb350009e50 con 0x7fb350009110 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb35000c3e0 con 0x7fb350009110 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 1170853440) 0x7fb364005a70 con 0x7fb350009110 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:02.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.106:6792/0 conn(0x7fb350009110 legacy=0x7fb3500095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb35effd640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.106:6792/0 conn(0x7fb350009110 legacy=0x7fb3500095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 4279, 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:02.656 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.657 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.658 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:02.659 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.660 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:02.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.662 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.663 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.664 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.667 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.668 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.669 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.670 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:02.671 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.672 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.673 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.674 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:02.674 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:02.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.171:6812/722422047 conn(0x7fb34c037ec0 legacy=0x7fb34c03a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 10 monclient: shutdown 2024-04-26T00:07:02.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 >> v1:172.21.15.106:6793/0 conn(0x7fb368134970 legacy=0x7fb3681d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb36ed7d640 1 -- 172.21.15.106:0/3204898549 reap_dead start 2024-04-26T00:07:02.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb36ed7d640 1 -- 172.21.15.106:0/3204898549 reap_dead start 2024-04-26T00:07:02.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 shutdown_connections 2024-04-26T00:07:02.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 >> 172.21.15.106:0/3204898549 conn(0x7fb3680a9e20 msgr2=0x7fb368130ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 shutdown_connections 2024-04-26T00:07:02.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.673+0000 7fb3707e0640 1 -- 172.21.15.106:0/3204898549 wait complete. 2024-04-26T00:07:02.676 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:02.676 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:07:02.677 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:07:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: get_monmap_and_config 2024-04-26T00:07:02.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: monmap: 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:02.814569+0000 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:02.814569+0000 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.789 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.790 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.790 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 Processor -- start 2024-04-26T00:07:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- start start 2024-04-26T00:07:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: init 2024-04-26T00:07:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: _add_conns ranks=[3,1,2,0,7,8,5,4,6] 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient(hunting): picked mon.noname-g con 0x7f02e4137730 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient(hunting): picked mon.noname-f con 0x7f02e40a0b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient(hunting): picked mon.noname-b con 0x7f02e4138220 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e40a2750 con 0x7f02e40a0b20 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e40a2a30 con 0x7f02e4138220 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e40a2d10 con 0x7f02e4137730 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient(hunting): authenticate will time out at 1678.341825s 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02e981a640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f02e4138220 0x7f02e4140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52570/0 (socket says 172.21.15.106:52570) 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02e981a640 1 -- 172.21.15.106:0/1191570652 learned_addr learned my addr 172.21.15.106:0/1191570652 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487923429 0 0) 0x7f02e40a2a30 con 0x7f02e4138220 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient(hunting): my global_id is 7544 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d0003530 con 0x7f02e4138220 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 22455294 0 0) 0x7f02d0003530 con 0x7f02e4138220 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 >> v1:172.21.15.171:6790/0 conn(0x7f02e4137730 legacy=0x7f02e4137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 >> v1:172.21.15.171:6789/0 conn(0x7f02e40a0b20 legacy=0x7f02e413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 monclient: found mon.noname-b 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e40a4680 con 0x7f02e4138220 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 5 monclient: authenticate success, global_id 7544 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02dc001b40 con 0x7f02e4138220 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: dump: 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.800 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02dc001ea0 con 0x7f02e4138220 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 4 set_mon_vals no callback set 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 1 -- 172.21.15.106:0/1191570652 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02dc0020d0 con 0x7f02e4138220 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02dbfff640 10 monclient: dump: 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.802 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: shutdown 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- 172.21.15.106:0/1191570652 >> v1:172.21.15.106:6790/0 conn(0x7f02e4138220 legacy=0x7f02e4140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- 172.21.15.106:0/1191570652 shutdown_connections 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- 172.21.15.106:0/1191570652 >> 172.21.15.106:0/1191570652 conn(0x7f02e40a6b80 msgr2=0x7f02e40a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- 172.21.15.106:0/1191570652 shutdown_connections 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 1 -- 172.21.15.106:0/1191570652 wait complete. 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.813+0000 7f02eb27d640 10 monclient: monmap: 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.803 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.804 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 Processor -- start 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 -- start start 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient: init 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient: _add_conns ranks=[2,6,1,0,4,7,8,5,3] 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient(hunting): picked mon.noname-b con 0x7f02e40a0b20 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient(hunting): picked mon.noname-d con 0x7f02e4137730 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient(hunting): picked mon.noname-f con 0x7f02e4138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4132470 con 0x7f02e4138220 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4132750 con 0x7f02e40a0b20 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02e4136770 con 0x7f02e4137730 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient(hunting): authenticate will time out at 1678.344677s 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02e9019640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f02e40a0b20 0x7f02e412fa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52578/0 (socket says 172.21.15.106:52578) 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02e9019640 1 -- 172.21.15.106:0/3830297121 learned_addr learned my addr 172.21.15.106:0/3830297121 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3178589751 0 0) 0x7f02e4136770 con 0x7f02e4137730 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): my global_id is 244230 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c8003530 con 0x7f02e4137730 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2121244647 0 0) 0x7f02e4132750 con 0x7f02e40a0b20 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): my global_id is 7553 2024-04-26T00:07:02.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e4136770 con 0x7f02e40a0b20 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1547155397 0 0) 0x7f02e4136770 con 0x7f02e40a0b20 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02e4132750 con 0x7f02e40a0b20 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02d4001a00 con 0x7f02e40a0b20 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): dump: 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.807 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2101015334 0 0) 0x7f02c8003530 con 0x7f02e4137730 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02e4136770 con 0x7f02e4137730 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3591187235 0 0) 0x7f02e4132470 con 0x7f02e4138220 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): my global_id is 224515 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c8003530 con 0x7f02e4138220 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02e00019e0 con 0x7f02e4137730 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): dump: 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.809 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2603905207 0 0) 0x7f02e4132750 con 0x7f02e40a0b20 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.106:6792/0 conn(0x7f02e4137730 legacy=0x7f02e41301a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.171:6789/0 conn(0x7f02e4138220 legacy=0x7f02e41d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 monclient: found mon.b 2024-04-26T00:07:02.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02e4131580 con 0x7f02e40a0b20 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 5 monclient: authenticate success, global_id 7553 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient: _renew_subs 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02e40a01d0 con 0x7f02e40a0b20 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient: _renew_subs 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f02e4130a80 con 0x7f02e40a0b20 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02d40038d0 con 0x7f02e40a0b20 2024-04-26T00:07:02.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02d4003e40 con 0x7f02e40a0b20 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02db7fe640 4 set_mon_vals no callback set 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: dump: 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.812 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02c40065d0 con 0x7f02c4002870 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f02d4004060 con 0x7f02e40a0b20 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f02d40451a0 con 0x7f02e40a0b20 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4287393571 0 0) 0x7f02c40065d0 con 0x7f02c4002870 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient(hunting): my global_id is 224450 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02e4132750 con 0x7f02c4002870 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02e981a640 10 monclient: get_auth_request con 0x7f02c8038020 auth_method 0 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4048001736 0 0) 0x7f02e4132750 con 0x7f02c4002870 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02c40065d0 con 0x7f02c4002870 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02e0003940 con 0x7f02c4002870 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: dump: 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.814 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3699963624 0 0) 0x7f02c40065d0 con 0x7f02c4002870 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f02c400a160 con 0x7f02c4002870 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f02e0003cd0 con 0x7f02c4002870 2024-04-26T00:07:02.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.106:6793/0 conn(0x7f02c4002870 legacy=0x7f02c4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.817+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.106:6793/0 conn(0x7f02c4002870 legacy=0x7f02c4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f02c4009e50 con 0x7f02c4009110 2024-04-26T00:07:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 66053736 0 0) 0x7f02c4009e50 con 0x7f02c4009110 2024-04-26T00:07:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.817 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient(hunting): my global_id is 224459 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c40065d0 con 0x7f02c4009110 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 26224915 0 0) 0x7f02c40065d0 con 0x7f02c4009110 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02c4009e50 con 0x7f02c4009110 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02e0004440 con 0x7f02c4009110 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient: dump: 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.818 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 282272584 0 0) 0x7f02c4009e50 con 0x7f02c4009110 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f02c400c3e0 con 0x7f02c4009110 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1935703426) 0x7f02e00058b0 con 0x7f02c4009110 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:02.819 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.106:6793/0 conn(0x7f02c4009110 legacy=0x7f02c40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02d9ffb640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.106:6793/0 conn(0x7f02c4009110 legacy=0x7f02c40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 136056, 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:02.820 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.821 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.822 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:02.823 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.824 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.825 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.826 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.827 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.830 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.831 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.832 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.833 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.834 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:02.835 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:02.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.837 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:02.838 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.171:6812/722422047 conn(0x7f02c8038020 legacy=0x7f02c803a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 10 monclient: shutdown 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 >> v1:172.21.15.106:6790/0 conn(0x7f02e40a0b20 legacy=0x7f02e412fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02e981a640 1 -- 172.21.15.106:0/3830297121 reap_dead start 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02e981a640 1 -- 172.21.15.106:0/3830297121 reap_dead start 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 shutdown_connections 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 >> 172.21.15.106:0/3830297121 conn(0x7f02e40a6b80 msgr2=0x7f02e412e750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 shutdown_connections 2024-04-26T00:07:02.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.825+0000 7f02eb27d640 1 -- 172.21.15.106:0/3830297121 wait complete. 2024-04-26T00:07:02.841 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:02.841 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:07:02.841 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient: get_monmap_and_config 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient: monmap: 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:02.987156+0000 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:02.987156+0000 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.961 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.962 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 1 Processor -- start 2024-04-26T00:07:02.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 1 -- start start 2024-04-26T00:07:02.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient: init 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient: _add_conns ranks=[1,6,7,3,2,4,8,0,5] 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient(hunting): picked mon.noname-f con 0x7f5e60134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient(hunting): picked mon.noname-d con 0x7f5e600a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient(hunting): picked mon.noname-i con 0x7f5e6013e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6006dd40 con 0x7f5e60134970 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e600a2b10 con 0x7f5e600a4820 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e600a2df0 con 0x7f5e6013e200 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient(hunting): authenticate will time out at 1678.514981s 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e57fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5e600a4820 0x7f5e6013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53248/0 (socket says 172.21.15.106:53248) 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e57fff640 1 -- 172.21.15.106:0/3888395775 learned_addr learned my addr 172.21.15.106:0/3888395775 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3761922353 0 0) 0x7f5e600a2b10 con 0x7f5e600a4820 2024-04-26T00:07:02.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient(hunting): my global_id is 244239 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e48003530 con 0x7f5e600a4820 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2327754959 0 0) 0x7f5e48003530 con 0x7f5e600a4820 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 >> v1:172.21.15.171:6792/0 conn(0x7f5e6013e200 legacy=0x7f5e601405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 >> v1:172.21.15.171:6789/0 conn(0x7f5e60134970 legacy=0x7f5e60134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 monclient: found mon.noname-d 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e600a30d0 con 0x7f5e600a4820 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5e5c0017c0 con 0x7f5e600a4820 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: dump: 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.972 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 5 monclient: authenticate success, global_id 244239 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e5c001ab0 con 0x7f5e600a4820 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e670b4640 4 set_mon_vals no callback set 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 1 -- 172.21.15.106:0/3888395775 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5e5c004bf0 con 0x7f5e600a4820 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:02.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.985+0000 7f5e577fe640 10 monclient: dump: 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.974 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: shutdown 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/3888395775 >> v1:172.21.15.106:6792/0 conn(0x7f5e600a4820 legacy=0x7f5e6013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/3888395775 shutdown_connections 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/3888395775 >> 172.21.15.106:0/3888395775 conn(0x7f5e600a9e20 msgr2=0x7f5e600aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/3888395775 shutdown_connections 2024-04-26T00:07:02.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/3888395775 wait complete. 2024-04-26T00:07:02.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: build_initial_monmap 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: monmap: 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:02.979 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 Processor -- start 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- start start 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: init 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: _add_conns ranks=[5,2,1,7,8,4,3,0,6] 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient(hunting): picked mon.noname-h con 0x7f5e600a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient(hunting): picked mon.noname-b con 0x7f5e60134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:02.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient(hunting): picked mon.noname-f con 0x7f5e6013e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6009e090 con 0x7f5e6013e200 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6012b330 con 0x7f5e60134970 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e6009d830 con 0x7f5e600a4820 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient(hunting): authenticate will time out at 1678.517919s 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e57fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f5e60134970 0x7f5e6012ac20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52584/0 (socket says 172.21.15.106:52584) 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e57fff640 1 -- 172.21.15.106:0/2413481633 learned_addr learned my addr 172.21.15.106:0/2413481633 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786675520 0 0) 0x7f5e6012b330 con 0x7f5e60134970 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): my global_id is 7562 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e4c003530 con 0x7f5e60134970 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3032405881 0 0) 0x7f5e4c003530 con 0x7f5e60134970 2024-04-26T00:07:02.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e6012b330 con 0x7f5e60134970 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5e5c001780 con 0x7f5e60134970 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): dump: 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.982 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3359879149 0 0) 0x7f5e6009d830 con 0x7f5e600a4820 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): my global_id is 7538 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e4c003530 con 0x7f5e600a4820 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 514246285 0 0) 0x7f5e6009e090 con 0x7f5e6013e200 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient(hunting): my global_id is 224533 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e6009d830 con 0x7f5e6013e200 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1557948437 0 0) 0x7f5e6012b330 con 0x7f5e60134970 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.171:6791/0 conn(0x7f5e600a4820 legacy=0x7f5e6012a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.171:6789/0 conn(0x7f5e6013e200 legacy=0x7f5e601d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: _finish_hunting 0 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 monclient: found mon.b 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e600a1e00 con 0x7f5e60134970 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: _finish_auth 0 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: _check_auth_tickets 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:02.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 5 monclient: authenticate success, global_id 7562 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: _renew_subs 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5e600a08e0 con 0x7f5e60134970 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: _renew_subs 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5e6009b9b0 con 0x7f5e60134970 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5e5c001ab0 con 0x7f5e60134970 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5e5c001ce0 con 0x7f5e60134970 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e56ffd640 4 set_mon_vals no callback set 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 10 monclient: dump: 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.985 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5e400065d0 con 0x7f5e40002870 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.989+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5e5c0100f0 con 0x7f5e60134970 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f5e5c045250 con 0x7f5e60134970 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e65651640 10 monclient: get_auth_request con 0x7f5e4c037a60 auth_method 0 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207241224 0 0) 0x7f5e400065d0 con 0x7f5e40002870 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient(hunting): my global_id is 224542 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e6012b330 con 0x7f5e40002870 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3632310135 0 0) 0x7f5e6012b330 con 0x7f5e40002870 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e400065d0 con 0x7f5e40002870 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5e50001930 con 0x7f5e40002870 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient: dump: 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.988 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.989 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2279065604 0 0) 0x7f5e400065d0 con 0x7f5e40002870 2024-04-26T00:07:02.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5e4000a160 con 0x7f5e40002870 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5e50004650 con 0x7f5e40002870 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.171:6789/0 conn(0x7f5e40002870 legacy=0x7f5e40004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:02.993+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.171:6789/0 conn(0x7f5e40002870 legacy=0x7f5e40004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5e40009e30 con 0x7f5e400090f0 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2542735561 0 0) 0x7f5e40009e30 con 0x7f5e400090f0 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient(hunting): my global_id is 224551 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5e400065d0 con 0x7f5e400090f0 2024-04-26T00:07:02.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2649057933 0 0) 0x7f5e400065d0 con 0x7f5e400090f0 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5e40009e30 con 0x7f5e400090f0 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5e50003bb0 con 0x7f5e400090f0 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient: dump: 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:02.992 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3419661731 0 0) 0x7f5e40009e30 con 0x7f5e400090f0 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5e4000c3a0 con 0x7f5e400090f0 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 1979211501) 0x7f5e50004880 con 0x7f5e400090f0 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.171:6789/0 conn(0x7f5e400090f0 legacy=0x7f5e40009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:02.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e557fa640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.171:6789/0 conn(0x7f5e400090f0 legacy=0x7f5e40009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 136237, 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:02.994 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.995 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.996 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.997 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:02.998 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:02.999 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.000 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.001 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.002 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.003 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:03.004 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.005 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.006 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.007 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.008 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:03.009 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.010 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.011 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.012 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:03.012 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:03.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.171:6812/722422047 conn(0x7f5e4c037a60 legacy=0x7f5e4c039f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 10 monclient: shutdown 2024-04-26T00:07:03.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 >> v1:172.21.15.106:6790/0 conn(0x7f5e60134970 legacy=0x7f5e6012ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e65651640 1 -- 172.21.15.106:0/2413481633 reap_dead start 2024-04-26T00:07:03.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e65651640 1 -- 172.21.15.106:0/2413481633 reap_dead start 2024-04-26T00:07:03.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 shutdown_connections 2024-04-26T00:07:03.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 >> 172.21.15.106:0/2413481633 conn(0x7f5e600a9e20 msgr2=0x7f5e60067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 shutdown_connections 2024-04-26T00:07:03.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.001+0000 7f5e670b4640 1 -- 172.21.15.106:0/2413481633 wait complete. 2024-04-26T00:07:03.014 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:03.014 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:07:03.014 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:07:03.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: get_monmap_and_config 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: monmap: 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:03.154601+0000 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:03.154601+0000 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.129 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.130 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.130 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.130 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 Processor -- start 2024-04-26T00:07:03.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- start start 2024-04-26T00:07:03.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: init 2024-04-26T00:07:03.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: _add_conns ranks=[7,2,8,5,6,0,1,4,3] 2024-04-26T00:07:03.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient(hunting): picked mon.noname-i con 0x7f6f24134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:03.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient(hunting): picked mon.noname-b con 0x7f6f240a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient(hunting): picked mon.noname-e con 0x7f6f2413e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2406dd40 con 0x7f6f240a4820 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240a2b10 con 0x7f6f24134970 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240a2df0 con 0x7f6f2413e200 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient(hunting): authenticate will time out at 1678.681532s 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2ad1f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f6f2413e200 0x7f6f241405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:46038/0 (socket says 172.21.15.106:46038) 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f29d1d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f6f240a4820 0x7f6f2413cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52586/0 (socket says 172.21.15.106:52586) 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2ad1f640 1 -- 172.21.15.106:0/1071019355 learned_addr learned my addr 172.21.15.106:0/1071019355 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625042693 0 0) 0x7f6f240a2df0 con 0x7f6f2413e200 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): my global_id is 224468 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f10003530 con 0x7f6f2413e200 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163380027 0 0) 0x7f6f2406dd40 con 0x7f6f240a4820 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient(hunting): my global_id is 7571 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f240a2df0 con 0x7f6f240a4820 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 334766701 0 0) 0x7f6f240a2df0 con 0x7f6f240a4820 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 >> v1:172.21.15.106:6793/0 conn(0x7f6f2413e200 legacy=0x7f6f241405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 >> v1:172.21.15.171:6792/0 conn(0x7f6f24134970 legacy=0x7f6f24134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 monclient: found mon.noname-b 2024-04-26T00:07:03.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f240a30d0 con 0x7f6f240a4820 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f200016d0 con 0x7f6f240a4820 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: dump: 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.140 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 5 monclient: authenticate success, global_id 7571 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f20001940 con 0x7f6f240a4820 2024-04-26T00:07:03.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 1 -- 172.21.15.106:0/1071019355 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f200047f0 con 0x7f6f240a4820 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 4 set_mon_vals no callback set 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2951c640 10 monclient: dump: 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.142 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: shutdown 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- 172.21.15.106:0/1071019355 >> v1:172.21.15.106:6790/0 conn(0x7f6f240a4820 legacy=0x7f6f2413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- 172.21.15.106:0/1071019355 shutdown_connections 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- 172.21.15.106:0/1071019355 >> 172.21.15.106:0/1071019355 conn(0x7f6f240a9e20 msgr2=0x7f6f240aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- 172.21.15.106:0/1071019355 shutdown_connections 2024-04-26T00:07:03.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 1 -- 172.21.15.106:0/1071019355 wait complete. 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.153+0000 7f6f2c782640 10 monclient: monmap: 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.144 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 Processor -- start 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 -- start start 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient: init 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient: _add_conns ranks=[1,5,2,3,4,8,7,6,0] 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient(hunting): picked mon.noname-f con 0x7f6f240a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient(hunting): picked mon.noname-h con 0x7f6f24134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient(hunting): picked mon.noname-b con 0x7f6f2413e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f240a1e00 con 0x7f6f240a4820 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f2413c170 con 0x7f6f2413e200 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f241396d0 con 0x7f6f24134970 2024-04-26T00:07:03.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient(hunting): authenticate will time out at 1678.685016s 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2ad1f640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f6f2413e200 0x7f6f241d45e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52598/0 (socket says 172.21.15.106:52598) 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2ad1f640 1 -- 172.21.15.106:0/2696892544 learned_addr learned my addr 172.21.15.106:0/2696892544 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873247738 0 0) 0x7f6f2413c170 con 0x7f6f2413e200 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): my global_id is 7580 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f08003530 con 0x7f6f2413e200 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2372300028 0 0) 0x7f6f08003530 con 0x7f6f2413e200 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f2413c170 con 0x7f6f2413e200 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f18001900 con 0x7f6f2413e200 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:03.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): dump: 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.147 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2945469629 0 0) 0x7f6f2413c170 con 0x7f6f2413e200 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.171:6791/0 conn(0x7f6f24134970 legacy=0x7f6f24138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.171:6789/0 conn(0x7f6f240a4820 legacy=0x7f6f241388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 monclient: found mon.b 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2413be90 con 0x7f6f2413e200 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 5 monclient: authenticate success, global_id 7580 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient: _renew_subs 2024-04-26T00:07:03.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2413a2c0 con 0x7f6f2413e200 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient: _renew_subs 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f24134130 con 0x7f6f2413e200 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f18001d30 con 0x7f6f2413e200 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f18004de0 con 0x7f6f2413e200 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: dump: 2024-04-26T00:07:03.149 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.150 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f28d1b640 4 set_mon_vals no callback set 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f0c0065d0 con 0x7f6f0c002870 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6f1800fb80 con 0x7f6f2413e200 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f6f180451a0 con 0x7f6f2413e200 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f29d1d640 10 monclient: get_auth_request con 0x7f6f08037860 auth_method 0 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2874735324 0 0) 0x7f6f0c0065d0 con 0x7f6f0c002870 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient(hunting): my global_id is 214689 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f2413c170 con 0x7f6f0c002870 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4201613106 0 0) 0x7f6f2413c170 con 0x7f6f0c002870 2024-04-26T00:07:03.151 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f0c0065d0 con 0x7f6f0c002870 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f1c001bb0 con 0x7f6f0c002870 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.157+0000 7f6f16ffd640 10 monclient: dump: 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.152 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.161+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1452282718 0 0) 0x7f6f0c0065d0 con 0x7f6f0c002870 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.161+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f0c00a160 con 0x7f6f0c002870 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.161+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6f1c001f60 con 0x7f6f0c002870 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.161+0000 7f6f16ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.161+0000 7f6f16ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.161+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.171:6790/0 conn(0x7f6f0c002870 legacy=0x7f6f0c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.161+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.171:6790/0 conn(0x7f6f0c002870 legacy=0x7f6f0c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f2c782640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f0c009e50 con 0x7f6f0c009110 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 358520661 0 0) 0x7f6f0c009e50 con 0x7f6f0c009110 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f16ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f16ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f16ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f16ffd640 10 monclient(hunting): my global_id is 214698 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.165+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f0c0065d0 con 0x7f6f0c009110 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2124957171 0 0) 0x7f6f0c0065d0 con 0x7f6f0c009110 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f0c009e50 con 0x7f6f0c009110 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f1c003ed0 con 0x7f6f0c009110 2024-04-26T00:07:03.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 10 monclient: dump: 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.156 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3422108191 0 0) 0x7f6f0c009e50 con 0x7f6f0c009110 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6f0c00c3e0 con 0x7f6f0c009110 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2786066516) 0x7f6f1c006170 con 0x7f6f0c009110 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.171:6790/0 conn(0x7f6f0c009110 legacy=0x7f6f0c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f16ffd640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.171:6790/0 conn(0x7f6f0c009110 legacy=0x7f6f0c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.157 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 253592, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:03.158 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.159 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.160 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:03.161 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.162 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.163 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.164 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.165 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.166 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.167 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:03.168 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.169 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.170 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.171 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.172 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.173 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:03.174 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:03.175 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.176 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:03.177 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:03.178 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:03.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.171:6812/722422047 conn(0x7f6f08037860 legacy=0x7f6f08039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 10 monclient: shutdown 2024-04-26T00:07:03.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 >> v1:172.21.15.106:6790/0 conn(0x7f6f2413e200 legacy=0x7f6f241d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2ad1f640 1 -- 172.21.15.106:0/2696892544 reap_dead start 2024-04-26T00:07:03.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2ad1f640 1 -- 172.21.15.106:0/2696892544 reap_dead start 2024-04-26T00:07:03.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 shutdown_connections 2024-04-26T00:07:03.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 >> 172.21.15.106:0/2696892544 conn(0x7f6f240a9e20 msgr2=0x7f6f24067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 shutdown_connections 2024-04-26T00:07:03.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.169+0000 7f6f2c782640 1 -- 172.21.15.106:0/2696892544 wait complete. 2024-04-26T00:07:03.181 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:03.181 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:07:03.181 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.317+0000 7fd713ce1640 10 monclient: get_monmap_and_config 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.317+0000 7fd713ce1640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.317+0000 7fd713ce1640 10 monclient: monmap: 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:03.322069+0000 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:03.322069+0000 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.296 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.297 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 Processor -- start 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- start start 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient: init 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient: _add_conns ranks=[3,4,1,7,5,0,6,8,2] 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient(hunting): picked mon.noname-g con 0x7fd70c135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient(hunting): picked mon.noname-c con 0x7fd70c1353b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient(hunting): picked mon.noname-f con 0x7fd70c13bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c06f2d0 con 0x7fd70c13bdf0 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c072330 con 0x7fd70c135870 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c072610 con 0x7fd70c1353b0 2024-04-26T00:07:03.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient(hunting): authenticate will time out at 1678.849187s 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd71127c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fd70c1353b0 0x7fd70c13a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41202/0 (socket says 172.21.15.106:41202) 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd71127c640 1 -- 172.21.15.106:0/684042681 learned_addr learned my addr 172.21.15.106:0/684042681 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571027489 0 0) 0x7fd70c072610 con 0x7fd70c1353b0 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient(hunting): my global_id is 146173 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f8003530 con 0x7fd70c1353b0 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3209952934 0 0) 0x7fd6f8003530 con 0x7fd70c1353b0 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 >> v1:172.21.15.171:6790/0 conn(0x7fd70c135870 legacy=0x7fd70c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 >> v1:172.21.15.171:6789/0 conn(0x7fd70c13bdf0 legacy=0x7fd70c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 monclient: found mon.noname-c 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c0a3260 con 0x7fd70c1353b0 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd6fc001800 con 0x7fd70c1353b0 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 5 monclient: authenticate success, global_id 146173 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: dump: 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.302 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6fc001aa0 con 0x7fd70c1353b0 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 1 -- 172.21.15.106:0/684042681 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd6fc004bf0 con 0x7fd70c1353b0 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 4 set_mon_vals no callback set 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd710a7b640 10 monclient: dump: 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.304 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient: shutdown 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- 172.21.15.106:0/684042681 >> v1:172.21.15.106:6791/0 conn(0x7fd70c1353b0 legacy=0x7fd70c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- 172.21.15.106:0/684042681 shutdown_connections 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- 172.21.15.106:0/684042681 >> 172.21.15.106:0/684042681 conn(0x7fd70c0a64e0 msgr2=0x7fd70c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- 172.21.15.106:0/684042681 shutdown_connections 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 -- 172.21.15.106:0/684042681 wait complete. 2024-04-26T00:07:03.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 10 monclient: monmap: 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.306 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.307 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.307 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.321+0000 7fd713ce1640 1 Processor -- start 2024-04-26T00:07:03.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 1 -- start start 2024-04-26T00:07:03.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient: init 2024-04-26T00:07:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient: _add_conns ranks=[6,3,2,4,8,7,0,5,1] 2024-04-26T00:07:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient(hunting): picked mon.noname-d con 0x7fd70c1353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient(hunting): picked mon.noname-g con 0x7fd70c135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient(hunting): picked mon.noname-b con 0x7fd70c13bdf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:03.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c09f930 con 0x7fd70c13bdf0 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c09f470 con 0x7fd70c135870 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd70c131580 con 0x7fd70c1353b0 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient(hunting): authenticate will time out at 1678.852634s 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd71227e640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd70c13bdf0 0x7fd70c1d29c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52606/0 (socket says 172.21.15.106:52606) 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd71227e640 1 -- 172.21.15.106:0/1324039671 learned_addr learned my addr 172.21.15.106:0/1324039671 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd711a7d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fd70c1353b0 0x7fd70c130760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53256/0 (socket says 172.21.15.106:53256) 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3979203450 0 0) 0x7fd70c131580 con 0x7fd70c1353b0 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): my global_id is 244248 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f0003530 con 0x7fd70c1353b0 2024-04-26T00:07:03.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2875788191 0 0) 0x7fd70c09f930 con 0x7fd70c13bdf0 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): my global_id is 7589 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd70c131580 con 0x7fd70c13bdf0 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1312993545 0 0) 0x7fd70c131580 con 0x7fd70c13bdf0 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd70c09f930 con 0x7fd70c13bdf0 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 176018984 0 0) 0x7fd6f0003530 con 0x7fd70c1353b0 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd70c131580 con 0x7fd70c1353b0 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3745441441 0 0) 0x7fd70c09f470 con 0x7fd70c135870 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): my global_id is 214716 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f0003530 con 0x7fd70c135870 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd704001c00 con 0x7fd70c13bdf0 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd71227e640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.106:6790/0 conn(0x7fd70c13bdf0 legacy=0x7fd70c1d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd71227e640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.106:6790/0 conn(0x7fd70c13bdf0 legacy=0x7fd70c1d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd71227e640 1 --1- 172.21.15.106:0/1324039671 >> v1:172.21.15.106:6790/0 conn(0x7fd70c13bdf0 0x7fd70c1d29c0 :-1 s=OPENED pgs=695 cs=1 l=1).handle_message read tag failed 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd71227e640 1 --1- 172.21.15.106:0/1324039671 >> v1:172.21.15.106:6790/0 conn(0x7fd70c13bdf0 0x7fd70c1d29c0 :-1 s=OPENED pgs=695 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): dump: 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.314 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6790/0 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd7080019e0 con 0x7fd70c1353b0 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): dump: 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.316 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2733036314 0 0) 0x7fd70c131580 con 0x7fd70c1353b0 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.171:6790/0 conn(0x7fd70c135870 legacy=0x7fd70c130e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.106:6790/0 conn(0x7fd70c13bdf0 legacy=0x7fd70c1d29c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 monclient: found mon.d 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd70c134440 con 0x7fd70c1353b0 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 5 monclient: authenticate success, global_id 244248 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient: _renew_subs 2024-04-26T00:07:03.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd70c134720 con 0x7fd70c1353b0 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient: _renew_subs 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fd70c134d10 con 0x7fd70c1353b0 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd708001d20 con 0x7fd70c1353b0 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd708003c10 con 0x7fd70c1353b0 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd703fff640 4 set_mon_vals no callback set 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: dump: 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.318 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd6f40065d0 con 0x7fd6f4002870 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd708003e30 con 0x7fd70c1353b0 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7fd7080450a0 con 0x7fd70c1353b0 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd71227e640 10 monclient: get_auth_request con 0x7fd6f0037f80 auth_method 0 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2857327669 0 0) 0x7fd6f40065d0 con 0x7fd6f4002870 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient(hunting): my global_id is 7556 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd70c131580 con 0x7fd6f4002870 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1414200001 0 0) 0x7fd70c131580 con 0x7fd6f4002870 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6f40065d0 con 0x7fd6f4002870 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd6fc0017c0 con 0x7fd6f4002870 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.325+0000 7fd7027fc640 10 monclient: dump: 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.321 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.329+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2783353036 0 0) 0x7fd6f40065d0 con 0x7fd6f4002870 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.329+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6f400a160 con 0x7fd6f4002870 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.329+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd6fc004aa0 con 0x7fd6f4002870 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.329+0000 7fd7027fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.329+0000 7fd7027fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.329+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.171:6791/0 conn(0x7fd6f4002870 legacy=0x7fd6f4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.329+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.171:6791/0 conn(0x7fd6f4002870 legacy=0x7fd6f4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd713ce1640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:03.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd6f4009e50 con 0x7fd6f4009110 2024-04-26T00:07:03.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484619044 0 0) 0x7fd6f4009e50 con 0x7fd6f4009110 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd7027fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd7027fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd7027fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd7027fc640 10 monclient(hunting): my global_id is 7565 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.333+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6f40065d0 con 0x7fd6f4009110 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2416775502 0 0) 0x7fd6f40065d0 con 0x7fd6f4009110 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6f4009e50 con 0x7fd6f4009110 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd6fc001c50 con 0x7fd6f4009110 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 10 monclient: dump: 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.324 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 61478957 0 0) 0x7fd6f4009e50 con 0x7fd6f4009110 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd6f400c3e0 con 0x7fd6f4009110 2024-04-26T00:07:03.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 3330623720) 0x7fd6fc005340 con 0x7fd6f4009110 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.171:6791/0 conn(0x7fd6f4009110 legacy=0x7fd6f40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd7027fc640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.171:6791/0 conn(0x7fd6f4009110 legacy=0x7fd6f40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:03.326 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 741840, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:03.327 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.328 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.329 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:03.330 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.331 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.332 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.335 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:03.336 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.337 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:03.340 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.341 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.342 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.343 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:03.344 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:03.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.171:6812/722422047 conn(0x7fd6f0037f80 legacy=0x7fd6f003a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 10 monclient: shutdown 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 >> v1:172.21.15.106:6792/0 conn(0x7fd70c1353b0 legacy=0x7fd70c130760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd71227e640 1 -- 172.21.15.106:0/1324039671 reap_dead start 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd71227e640 1 -- 172.21.15.106:0/1324039671 reap_dead start 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 shutdown_connections 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 >> 172.21.15.106:0/1324039671 conn(0x7fd70c0a64e0 msgr2=0x7fd70c12e1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 shutdown_connections 2024-04-26T00:07:03.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.337+0000 7fd713ce1640 1 -- 172.21.15.106:0/1324039671 wait complete. 2024-04-26T00:07:03.346 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:03.346 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:07:03.347 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:07:03.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.481+0000 7ff08f159640 10 monclient: get_monmap_and_config 2024-04-26T00:07:03.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.481+0000 7ff08f159640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.481+0000 7ff08f159640 10 monclient: monmap: 2024-04-26T00:07:03.459 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.459 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.459 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:03.485306+0000 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:03.485306+0000 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.460 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.481+0000 7ff08f159640 1 Processor -- start 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- start start 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: init 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: _add_conns ranks=[3,6,5,7,2,4,1,8,0] 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): picked mon.noname-g con 0x7ff088134760 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): picked mon.noname-d con 0x7ff0880a0d70 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:03.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): picked mon.noname-h con 0x7ff08813df70 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:03.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08806b910 con 0x7ff088134760 2024-04-26T00:07:03.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff08809fac0 con 0x7ff08813df70 2024-04-26T00:07:03.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0880a0080 con 0x7ff0880a0d70 2024-04-26T00:07:03.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): authenticate will time out at 1679.013033s 2024-04-26T00:07:03.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff087fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff0880a0d70 0x7ff08813c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53264/0 (socket says 172.21.15.106:53264) 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff087fff640 1 -- 172.21.15.106:0/2502049071 learned_addr learned my addr 172.21.15.106:0/2502049071 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 536767824 0 0) 0x7ff0880a0080 con 0x7ff0880a0d70 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient(hunting): my global_id is 244257 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff070003530 con 0x7ff0880a0d70 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1386286000 0 0) 0x7ff070003530 con 0x7ff0880a0d70 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 >> v1:172.21.15.171:6791/0 conn(0x7ff08813df70 legacy=0x7ff088140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 >> v1:172.21.15.171:6790/0 conn(0x7ff088134760 legacy=0x7ff088134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 monclient: found mon.noname-d 2024-04-26T00:07:03.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08809f280 con 0x7ff0880a0d70 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 5 monclient: authenticate success, global_id 244257 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff07c0017c0 con 0x7ff0880a0d70 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: dump: 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.472 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff07c001b20 con 0x7ff0880a0d70 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 4 set_mon_vals no callback set 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 1 -- 172.21.15.106:0/2502049071 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff07c001d50 con 0x7ff0880a0d70 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff0877fe640 10 monclient: dump: 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.474 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: shutdown 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- 172.21.15.106:0/2502049071 >> v1:172.21.15.106:6792/0 conn(0x7ff0880a0d70 legacy=0x7ff08813c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- 172.21.15.106:0/2502049071 shutdown_connections 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- 172.21.15.106:0/2502049071 >> 172.21.15.106:0/2502049071 conn(0x7ff0880a7240 msgr2=0x7ff0880a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- 172.21.15.106:0/2502049071 shutdown_connections 2024-04-26T00:07:03.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- 172.21.15.106:0/2502049071 wait complete. 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: monmap: 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.476 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 Processor -- start 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- start start 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: init 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient: _add_conns ranks=[6,0,2,3,5,1,7,4,8] 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): picked mon.noname-d con 0x7ff0880a0d70 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): picked mon.noname-a con 0x7ff088134760 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): picked mon.noname-b con 0x7ff08813df70 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff088137410 con 0x7ff088134760 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff088139700 con 0x7ff08813df70 2024-04-26T00:07:03.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff088138e60 con 0x7ff0880a0d70 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08f159640 10 monclient(hunting): authenticate will time out at 1679.015847s 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08cef5640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ff0880a0d70 0x7ff088135ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53266/0 (socket says 172.21.15.106:53266) 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff08cef5640 1 -- 172.21.15.106:0/3362776498 learned_addr learned my addr 172.21.15.106:0/3362776498 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.485+0000 7ff087fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff088134760 0x7ff0881361c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40710/0 (socket says 172.21.15.106:40710) 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3358863388 0 0) 0x7ff088139700 con 0x7ff08813df70 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): my global_id is 7598 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff074003530 con 0x7ff08813df70 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809647812 0 0) 0x7ff088137410 con 0x7ff088134760 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): my global_id is 7821 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff088139700 con 0x7ff088134760 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214169993 0 0) 0x7ff088138e60 con 0x7ff0880a0d70 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): my global_id is 244266 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff088137410 con 0x7ff0880a0d70 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3005259241 0 0) 0x7ff074003530 con 0x7ff08813df70 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff088138e60 con 0x7ff08813df70 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4136885790 0 0) 0x7ff088137410 con 0x7ff0880a0d70 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff074003530 con 0x7ff0880a0d70 2024-04-26T00:07:03.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff080001900 con 0x7ff08813df70 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): dump: 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.480 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff078001ce0 con 0x7ff0880a0d70 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): dump: 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.481 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1841795732 0 0) 0x7ff088139700 con 0x7ff088134760 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff088137410 con 0x7ff088134760 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff07c001780 con 0x7ff088134760 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): dump: 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.483 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3386987446 0 0) 0x7ff088138e60 con 0x7ff08813df70 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.106:6792/0 conn(0x7ff0880a0d70 legacy=0x7ff088135ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.106:6789/0 conn(0x7ff088134760 legacy=0x7ff0881361c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 monclient: found mon.b 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff088138440 con 0x7ff08813df70 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 5 monclient: authenticate success, global_id 7598 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 10 monclient: _renew_subs 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff08813d060 con 0x7ff08813df70 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 10 monclient: _renew_subs 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff088136aa0 con 0x7ff08813df70 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff080001cd0 con 0x7ff08813df70 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff080003c10 con 0x7ff08813df70 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff086ffd640 4 set_mon_vals no callback set 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:03.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: dump: 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.486 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0680065d0 con 0x7ff068002870 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff080003e30 con 0x7ff08813df70 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7ff080043f40 con 0x7ff08813df70 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff087fff640 10 monclient: get_auth_request con 0x7ff074038160 auth_method 0 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512849367 0 0) 0x7ff0680065d0 con 0x7ff068002870 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient(hunting): my global_id is 146014 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff088138e60 con 0x7ff068002870 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 390391857 0 0) 0x7ff088138e60 con 0x7ff068002870 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0680065d0 con 0x7ff068002870 2024-04-26T00:07:03.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff078003f90 con 0x7ff068002870 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 10 monclient: dump: 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.488 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2133352188 0 0) 0x7ff0680065d0 con 0x7ff068002870 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.489+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff06800a160 con 0x7ff068002870 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.493+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff078005b50 con 0x7ff068002870 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.493+0000 7ff0857fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.493+0000 7ff0857fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.493+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.171:6792/0 conn(0x7ff068002870 legacy=0x7ff068004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.493+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.171:6792/0 conn(0x7ff068002870 legacy=0x7ff068004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff08f159640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff068009e30 con 0x7ff0680090f0 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1036790225 0 0) 0x7ff068009e30 con 0x7ff0680090f0 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 10 monclient(hunting): my global_id is 146023 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0680065d0 con 0x7ff0680090f0 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3615103787 0 0) 0x7ff0680065d0 con 0x7ff0680090f0 2024-04-26T00:07:03.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff068009e30 con 0x7ff0680090f0 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff078005da0 con 0x7ff0680090f0 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 10 monclient: dump: 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.492 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1571395117 0 0) 0x7ff068009e30 con 0x7ff0680090f0 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.497+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff06800c3a0 con 0x7ff0680090f0 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 540808538) 0x7ff0780071d0 con 0x7ff0680090f0 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff0857fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff0857fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.171:6792/0 conn(0x7ff0680090f0 legacy=0x7ff068009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff0857fa640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.171:6792/0 conn(0x7ff0680090f0 legacy=0x7ff068009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 80, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 487030, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:07:03.494 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.495 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.496 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:03.497 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:03.498 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.499 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.500 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.501 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.502 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.503 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.504 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.505 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.506 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.507 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.508 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.509 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.510 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:03.511 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.171:6812/722422047 conn(0x7ff074038160 legacy=0x7ff07403a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 10 monclient: shutdown 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 >> v1:172.21.15.106:6790/0 conn(0x7ff08813df70 legacy=0x7ff0881d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08d6f6640 1 -- 172.21.15.106:0/3362776498 reap_dead start 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08d6f6640 1 -- 172.21.15.106:0/3362776498 reap_dead start 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 shutdown_connections 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 >> 172.21.15.106:0/3362776498 conn(0x7ff0880a7240 msgr2=0x7ff0880a1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 shutdown_connections 2024-04-26T00:07:03.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.501+0000 7ff08f159640 1 -- 172.21.15.106:0/3362776498 wait complete. 2024-04-26T00:07:03.514 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:07:03.514 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['h', 'd', 'c', 'b'] 2024-04-26T00:07:03.514 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T00:07:03.514 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2024-04-26T00:07:03.514 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h store 2024-04-26T00:07:03.514 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h sync_force --yes-i-really-mean-it 2024-04-26T00:07:03.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.653+0000 7f156e4ef640 10 monclient: get_monmap_and_config 2024-04-26T00:07:03.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.653+0000 7f156e4ef640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.653+0000 7f156e4ef640 10 monclient: monmap: 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:03.656585+0000 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:03.656585+0000 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.631 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.632 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.653+0000 7f156e4ef640 1 Processor -- start 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.653+0000 7f156e4ef640 1 -- start start 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.653+0000 7f156e4ef640 10 monclient: init 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: _add_conns ranks=[3,6,2,0,8,1,5,7,4] 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): picked mon.noname-g con 0x7f156806b210 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): picked mon.noname-d con 0x7f156806bd00 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): picked mon.noname-b con 0x7f156809b600 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15680a3010 con 0x7f156809b600 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15680a1d10 con 0x7f156806b210 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15680a05f0 con 0x7f156806bd00 2024-04-26T00:07:03.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): authenticate will time out at 1679.184491s 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156ca8c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f156809b600 0x7f156813e070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52620/0 (socket says 172.21.15.106:52620) 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156ca8c640 1 -- 172.21.15.106:0/720710332 learned_addr learned my addr 172.21.15.106:0/720710332 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833384341 0 0) 0x7f15680a3010 con 0x7f156809b600 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): my global_id is 7607 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1550003530 con 0x7f156809b600 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3568493491 0 0) 0x7f15680a05f0 con 0x7f156806bd00 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient(hunting): my global_id is 244275 2024-04-26T00:07:03.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15680a3010 con 0x7f156806bd00 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2411455306 0 0) 0x7f1550003530 con 0x7f156809b600 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 >> v1:172.21.15.106:6792/0 conn(0x7f156806bd00 legacy=0x7f156813a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 >> v1:172.21.15.171:6790/0 conn(0x7f156806b210 legacy=0x7f156806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 monclient: found mon.noname-b 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15680726b0 con 0x7f156809b600 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1560001b40 con 0x7f156809b600 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:03.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: dump: 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.642 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 5 monclient: authenticate success, global_id 7607 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1560001da0 con 0x7f156809b600 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 1 -- 172.21.15.106:0/720710332 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1560004f70 con 0x7f156809b600 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 4 set_mon_vals no callback set 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1566ffd640 10 monclient: dump: 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.643 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: shutdown 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- 172.21.15.106:0/720710332 >> v1:172.21.15.106:6790/0 conn(0x7f156809b600 legacy=0x7f156813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- 172.21.15.106:0/720710332 shutdown_connections 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- 172.21.15.106:0/720710332 >> 172.21.15.106:0/720710332 conn(0x7f15680a6fe0 msgr2=0x7f15680a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- 172.21.15.106:0/720710332 shutdown_connections 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- 172.21.15.106:0/720710332 wait complete. 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: monmap: 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.645 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 Processor -- start 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- start start 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: init 2024-04-26T00:07:03.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient: _add_conns ranks=[2,6,0,8,7,5,4,3,1] 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): picked mon.noname-b con 0x7f156806b210 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): picked mon.noname-d con 0x7f156806bd00 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): picked mon.noname-a con 0x7f156809b600 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f156809ef70 con 0x7f156809b600 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15681328f0 con 0x7f156806b210 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15680a2400 con 0x7f156806bd00 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f156e4ef640 10 monclient(hunting): authenticate will time out at 1679.187504s 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1567fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f156806b210 0x7f156809e150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52626/0 (socket says 172.21.15.106:52626) 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1567fff640 1 -- 172.21.15.106:0/1856594202 learned_addr learned my addr 172.21.15.106:0/1856594202 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f15677fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f156806bd00 0x7f156809e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53292/0 (socket says 172.21.15.106:53292) 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2179046451 0 0) 0x7f15681328f0 con 0x7f156806b210 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): my global_id is 7616 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1554003530 con 0x7f156806b210 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054855266 0 0) 0x7f15680a2400 con 0x7f156806bd00 2024-04-26T00:07:03.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): my global_id is 244284 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15681328f0 con 0x7f156806bd00 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63615574 0 0) 0x7f156809ef70 con 0x7f156809b600 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 10 monclient(hunting): my global_id is 7830 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.657+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15680a2400 con 0x7f156809b600 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3289632856 0 0) 0x7f1554003530 con 0x7f156806b210 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f156809ef70 con 0x7f156806b210 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2645197076 0 0) 0x7f15681328f0 con 0x7f156806bd00 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1554003530 con 0x7f156806bd00 2024-04-26T00:07:03.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1558001ae0 con 0x7f156806b210 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): dump: 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.650 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f155c0015c0 con 0x7f156806bd00 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): dump: 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.652 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2788744931 0 0) 0x7f156809ef70 con 0x7f156806b210 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.106:6792/0 conn(0x7f156806bd00 legacy=0x7f156809e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.106:6789/0 conn(0x7f156809b600 legacy=0x7f15681d4c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 monclient: found mon.b 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1568072b00 con 0x7f156806b210 2024-04-26T00:07:03.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 5 monclient: authenticate success, global_id 7616 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 10 monclient: _renew_subs 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f156809fdd0 con 0x7f156806b210 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 10 monclient: _renew_subs 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f1568134300 con 0x7f156806b210 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15580038d0 con 0x7f156806b210 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1558003e40 con 0x7f156806b210 2024-04-26T00:07:03.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f15667fc640 4 set_mon_vals no callback set 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: dump: 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.655 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f15480065d0 con 0x7f1548002870 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1558003fe0 con 0x7f156806b210 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f1558045130 con 0x7f156806b210 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3419859863 0 0) 0x7f15480065d0 con 0x7f1548002870 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient(hunting): my global_id is 7583 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f156809ef70 con 0x7f1548002870 2024-04-26T00:07:03.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f156ca8c640 10 monclient: get_auth_request con 0x7f1554037e20 auth_method 0 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3847842149 0 0) 0x7f156809ef70 con 0x7f1548002870 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15480065d0 con 0x7f1548002870 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f155c003940 con 0x7f1548002870 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: dump: 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.657 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2072432704 0 0) 0x7f15480065d0 con 0x7f1548002870 2024-04-26T00:07:03.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f154800a160 con 0x7f1548002870 2024-04-26T00:07:03.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f155c005790 con 0x7f1548002870 2024-04-26T00:07:03.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:03.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.171:6791/0 conn(0x7f1548002870 legacy=0x7f1548004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.661+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.171:6791/0 conn(0x7f1548002870 legacy=0x7f1548004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.669+0000 7f156e4ef640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:07:03.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.669+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1548009e60 con 0x7f1548009120 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.681+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506223966 0 0) 0x7f1548009e60 con 0x7f1548009120 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.681+0000 7f1564ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.681+0000 7f1564ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.681+0000 7f1564ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.681+0000 7f1564ff9640 10 monclient(hunting): my global_id is 7592 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.681+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15480065d0 con 0x7f1548009120 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 309626825 0 0) 0x7f15480065d0 con 0x7f1548009120 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1548009e60 con 0x7f1548009120 2024-04-26T00:07:03.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f155c0042f0 con 0x7f1548009120 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 10 monclient: dump: 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.662 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1561388539 0 0) 0x7f1548009e60 con 0x7f1548009120 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f154800c3e0 con 0x7f1548009120 2024-04-26T00:07:03.663 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f155c005a70 con 0x7f1548009120 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.171:6791/0 conn(0x7f1548009120 legacy=0x7f15480095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f1564ff9640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.171:6791/0 conn(0x7f1548009120 legacy=0x7f15480095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-26T00:07:03.664 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:03.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.171:6812/722422047 conn(0x7f1554037e20 legacy=0x7f155403a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 10 monclient: shutdown 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 >> v1:172.21.15.106:6790/0 conn(0x7f156806b210 legacy=0x7f156809e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156ca8c640 1 -- 172.21.15.106:0/1856594202 reap_dead start 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156ca8c640 1 -- 172.21.15.106:0/1856594202 reap_dead start 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 shutdown_connections 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 >> 172.21.15.106:0/1856594202 conn(0x7f15680a6fe0 msgr2=0x7f156809d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 shutdown_connections 2024-04-26T00:07:03.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.685+0000 7f156e4ef640 1 -- 172.21.15.106:0/1856594202 wait complete. 2024-04-26T00:07:03.678 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-04-26T00:07:03.678 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-04-26T00:07:03.678 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:07:03.709 INFO:tasks.ceph.mon.h:Stopped 2024-04-26T00:07:03.709 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-04-26T00:07:03.710 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d store 2024-04-26T00:07:03.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d sync_force --yes-i-really-mean-it 2024-04-26T00:07:03.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient: get_monmap_and_config 2024-04-26T00:07:03.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient: monmap: 2024-04-26T00:07:03.826 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.826 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.826 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:03.851577+0000 2024-04-26T00:07:03.827 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:03.851577+0000 2024-04-26T00:07:03.827 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.827 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.827 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.827 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.827 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.828 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.828 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.828 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.828 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.828 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.828 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.829 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 1 Processor -- start 2024-04-26T00:07:03.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 1 -- start start 2024-04-26T00:07:03.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient: init 2024-04-26T00:07:03.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient: _add_conns ranks=[5,6,8,7,1,2,3,0,4] 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient(hunting): picked mon.noname-h con 0x7f9790135870 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient(hunting): picked mon.noname-d con 0x7f97901353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient(hunting): picked mon.noname-e con 0x7f979013bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979006f2d0 con 0x7f9790135870 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9790072330 con 0x7f97901353b0 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9790072610 con 0x7f979013bdf0 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient(hunting): authenticate will time out at 1679.378760s 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9794a25640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f979013bdf0 0x7f979013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:46042/0 (socket says 172.21.15.106:46042) 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978f7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f97901353b0 0x7f979013a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:53306/0 (socket says 172.21.15.106:53306) 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9794a25640 1 -- 172.21.15.106:0/3584642284 learned_addr learned my addr 172.21.15.106:0/3584642284 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978ffff640 1 -- 172.21.15.106:0/3584642284 >> v1:172.21.15.171:6791/0 conn(0x7f9790135870 legacy=0x7f9790135c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2220201673 0 0) 0x7f9790072610 con 0x7f979013bdf0 2024-04-26T00:07:03.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): my global_id is 224477 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f977c003530 con 0x7f979013bdf0 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3866374085 0 0) 0x7f9790072330 con 0x7f97901353b0 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient(hunting): my global_id is 244293 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9790072610 con 0x7f97901353b0 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1088871520 0 0) 0x7f977c003530 con 0x7f979013bdf0 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 >> v1:172.21.15.106:6792/0 conn(0x7f97901353b0 legacy=0x7f979013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 >> v1:172.21.15.171:6791/0 conn(0x7f9790135870 legacy=0x7f9790135c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 monclient: found mon.noname-e 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97900a3260 con 0x7f979013bdf0 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 5 monclient: authenticate success, global_id 224477 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9780001800 con 0x7f979013bdf0 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: dump: 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.841 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9780001a50 con 0x7f979013bdf0 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f9796488640 4 set_mon_vals no callback set 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 1 -- 172.21.15.106:0/3584642284 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9780004bf0 con 0x7f979013bdf0 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.849+0000 7f978effd640 10 monclient: dump: 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.843 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: shutdown 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3584642284 >> v1:172.21.15.106:6793/0 conn(0x7f979013bdf0 legacy=0x7f979013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3584642284 shutdown_connections 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3584642284 >> 172.21.15.106:0/3584642284 conn(0x7f97900a64e0 msgr2=0x7f97900a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3584642284 shutdown_connections 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3584642284 wait complete. 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: build_initial_monmap 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: monmap: 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:03.845 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 Processor -- start 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- start start 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: init 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: _add_conns ranks=[4,2,8,0,6,3,1,5,7] 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient(hunting): picked mon.noname-c con 0x7f97901353b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient(hunting): picked mon.noname-b con 0x7f9790135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient(hunting): picked mon.noname-e con 0x7f979013bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:03.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97900713a0 con 0x7f9790135870 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97901cc590 con 0x7f97901353b0 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f979006fef0 con 0x7f979013bdf0 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient(hunting): authenticate will time out at 1679.381933s 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f97901353b0 0x7f9790134720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:41208/0 (socket says 172.21.15.106:41208) 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978ffff640 1 -- 172.21.15.106:0/3788773454 learned_addr learned my addr 172.21.15.106:0/3788773454 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824900973 0 0) 0x7f97901cc590 con 0x7f97901353b0 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): my global_id is 146182 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9770003560 con 0x7f97901353b0 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109409507 0 0) 0x7f979006fef0 con 0x7f979013bdf0 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): my global_id is 224486 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97901cc590 con 0x7f979013bdf0 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2962155982 0 0) 0x7f97900713a0 con 0x7f9790135870 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): my global_id is 7625 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f979006fef0 con 0x7f9790135870 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 153276099 0 0) 0x7f9770003560 con 0x7f97901353b0 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97900713a0 con 0x7f97901353b0 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2337220378 0 0) 0x7f97901cc590 con 0x7f979013bdf0 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9770003560 con 0x7f979013bdf0 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f97880046b0 con 0x7f97901353b0 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): dump: 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.849 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1494555339 0 0) 0x7f979006fef0 con 0x7f9790135870 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97901cc590 con 0x7f9790135870 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9780004b30 con 0x7f979013bdf0 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): dump: 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.850 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9778001520 con 0x7f9790135870 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): dump: 2024-04-26T00:07:03.851 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.852 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 519174932 0 0) 0x7f97900713a0 con 0x7f97901353b0 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.106:6793/0 conn(0x7f979013bdf0 legacy=0x7f97901d4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.106:6790/0 conn(0x7f9790135870 legacy=0x7f97901d11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 monclient: found mon.c 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f979009f470 con 0x7f97901353b0 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: _finish_auth 0 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 5 monclient: authenticate success, global_id 146182 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: _renew_subs 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f97900710c0 con 0x7f97901353b0 2024-04-26T00:07:03.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: _renew_subs 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9790134e30 con 0x7f97901353b0 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9788004950 con 0x7f97901353b0 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9788004ec0 con 0x7f97901353b0 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978e7fc640 4 set_mon_vals no callback set 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient: dump: 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.854 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f97740065d0 con 0x7f9774002870 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3528105929 0 0) 0x7f97740065d0 con 0x7f9774002870 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 10 monclient(hunting): my global_id is 244302 2024-04-26T00:07:03.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97900713a0 con 0x7f9774002870 2024-04-26T00:07:03.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.853+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f97880050e0 con 0x7f97901353b0 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f9788045490 con 0x7f97901353b0 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 144050433 0 0) 0x7f97900713a0 con 0x7f9774002870 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f97740065d0 con 0x7f9774002870 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9778004b30 con 0x7f9774002870 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 10 monclient: dump: 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.857 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 707365340 0 0) 0x7f97740065d0 con 0x7f9774002870 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f977400a160 con 0x7f9774002870 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f9794a25640 10 monclient: get_auth_request con 0x7f97700380f0 auth_method 0 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9778005fb0 con 0x7f9774002870 2024-04-26T00:07:03.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:03.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:03.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.106:6792/0 conn(0x7f9774002870 legacy=0x7f9774004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.857+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.106:6792/0 conn(0x7f9774002870 legacy=0x7f9774004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.861+0000 7f9796488640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:07:03.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.861+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9774009e40 con 0x7f9774009100 2024-04-26T00:07:03.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563301563 0 0) 0x7f9774009e40 con 0x7f9774009100 2024-04-26T00:07:03.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient(hunting): my global_id is 244311 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97740065d0 con 0x7f9774009100 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4160354752 0 0) 0x7f97740065d0 con 0x7f9774009100 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9774009e40 con 0x7f9774009100 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9778006850 con 0x7f9774009100 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient: dump: 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.861 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3143146888 0 0) 0x7f9774009e40 con 0x7f9774009100 2024-04-26T00:07:03.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f977400c3e0 con 0x7f9774009100 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f9778006b70 con 0x7f9774009100 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.106:6792/0 conn(0x7f9774009100 legacy=0x7f9774009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f978cff9640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.106:6792/0 conn(0x7f9774009100 legacy=0x7f9774009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-26T00:07:03.863 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:03.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.171:6812/722422047 conn(0x7f97700380f0 legacy=0x7f977003a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 10 monclient: shutdown 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 >> v1:172.21.15.106:6791/0 conn(0x7f97901353b0 legacy=0x7f9790134720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9794a25640 1 -- 172.21.15.106:0/3788773454 reap_dead start 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9794a25640 1 -- 172.21.15.106:0/3788773454 reap_dead start 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 shutdown_connections 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 >> 172.21.15.106:0/3788773454 conn(0x7f97900a64e0 msgr2=0x7f97900a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 shutdown_connections 2024-04-26T00:07:03.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:03.865+0000 7f9796488640 1 -- 172.21.15.106:0/3788773454 wait complete. 2024-04-26T00:07:03.865 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-04-26T00:07:03.866 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-04-26T00:07:03.866 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:07:03.876 INFO:tasks.ceph.mon.d:Stopped 2024-04-26T00:07:03.876 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-26T00:07:03.876 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T00:07:03.876 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T00:07:03.877 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:07:03.933 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T00:07:03.933 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-26T00:07:03.934 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b store 2024-04-26T00:07:03.934 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b sync_force --yes-i-really-mean-it 2024-04-26T00:07:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.109+0000 7f6bbba28640 10 monclient: get_monmap_and_config 2024-04-26T00:07:04.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.109+0000 7f6bbba28640 10 monclient: build_initial_monmap 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.109+0000 7f6bbba28640 10 monclient: monmap: 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:04.113667+0000 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:04.113667+0000 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:04.088 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:04.089 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:04.089 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:04.089 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:04.089 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 Processor -- start 2024-04-26T00:07:04.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- start start 2024-04-26T00:07:04.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: init 2024-04-26T00:07:04.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:04.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: _add_conns ranks=[5,6,0,7,4,1,3,2,8] 2024-04-26T00:07:04.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): picked mon.noname-h con 0x7f6bb4135870 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:04.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): picked mon.noname-d con 0x7f6bb41353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): picked mon.noname-a con 0x7f6bb413bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb406f2d0 con 0x7f6bb413bdf0 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb4072330 con 0x7f6bb4135870 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb4072610 con 0x7f6bb41353b0 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): authenticate will time out at 1679.640827s 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bb8fc3640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f6bb41353b0 legacy=0x7f6bb413a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bb9fc5640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6bb413bdf0 0x7f6bb413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40726/0 (socket says 172.21.15.106:40726) 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bb9fc5640 1 -- 172.21.15.106:0/3828893434 learned_addr learned my addr 172.21.15.106:0/3828893434 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bb97c4640 1 -- 172.21.15.106:0/3828893434 >> v1:172.21.15.171:6791/0 conn(0x7f6bb4135870 legacy=0x7f6bb4135c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:04.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3348863449 0 0) 0x7f6bb406f2d0 con 0x7f6bb413bdf0 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient(hunting): my global_id is 7839 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b9c003530 con 0x7f6bb413bdf0 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1619161859 0 0) 0x7f6b9c003530 con 0x7f6bb413bdf0 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 >> v1:172.21.15.106:6792/0 conn(0x7f6bb41353b0 legacy=0x7f6bb413a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 >> v1:172.21.15.171:6791/0 conn(0x7f6bb4135870 legacy=0x7f6bb4135c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: _finish_hunting 0 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 monclient: found mon.noname-a 2024-04-26T00:07:04.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb40a3260 con 0x7f6bb413bdf0 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: _finish_auth 0 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: _check_auth_tickets 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6ba40017c0 con 0x7f6bb413bdf0 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: dump: 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.100 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.101 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 5 monclient: authenticate success, global_id 7839 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6ba4001b20 con 0x7f6bb413bdf0 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 4 set_mon_vals no callback set 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 1 -- 172.21.15.106:0/3828893434 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6ba4001d50 con 0x7f6bb413bdf0 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6babfff640 10 monclient: dump: 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.102 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: shutdown 2024-04-26T00:07:04.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- 172.21.15.106:0/3828893434 >> v1:172.21.15.106:6789/0 conn(0x7f6bb413bdf0 legacy=0x7f6bb413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- 172.21.15.106:0/3828893434 shutdown_connections 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- 172.21.15.106:0/3828893434 >> 172.21.15.106:0/3828893434 conn(0x7f6bb40a64e0 msgr2=0x7f6bb40a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- 172.21.15.106:0/3828893434 shutdown_connections 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- 172.21.15.106:0/3828893434 wait complete. 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: build_initial_monmap 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: monmap: 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:04.104 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 Processor -- start 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- start start 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: init 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient: _add_conns ranks=[8,7,1,3,0,5,4,2,6] 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): picked mon.noname-e con 0x7f6bb41353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:04.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): picked mon.noname-i con 0x7f6bb4135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): picked mon.noname-f con 0x7f6bb413bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb4134fd0 con 0x7f6bb413bdf0 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb409f930 con 0x7f6bb4135870 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6bb4134cf0 con 0x7f6bb41353b0 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bbba28640 10 monclient(hunting): authenticate will time out at 1679.643673s 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bb97c4640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f6bb41353b0 0x7f6bb413ade0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:46074/0 (socket says 172.21.15.106:46074) 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6bb97c4640 1 -- 172.21.15.106:0/3251155727 learned_addr learned my addr 172.21.15.106:0/3251155727 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.113+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2855681849 0 0) 0x7f6bb4134cf0 con 0x7f6bb41353b0 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:04.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): my global_id is 224495 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ba0003530 con 0x7f6bb41353b0 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1660273254 0 0) 0x7f6ba0003530 con 0x7f6bb41353b0 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6bb4134cf0 con 0x7f6bb41353b0 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6bb0004370 con 0x7f6bb41353b0 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): dump: 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.107 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3498574585 0 0) 0x7f6bb4134cf0 con 0x7f6bb41353b0 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.171:6792/0 conn(0x7f6bb4135870 legacy=0x7f6bb41cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.171:6789/0 conn(0x7f6bb413bdf0 legacy=0x7f6bb41d25b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:07:04.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 monclient: found mon.e 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bb4133590 con 0x7f6bb41353b0 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 5 monclient: authenticate success, global_id 224495 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 10 monclient: _renew_subs 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:04.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6bb413b4f0 con 0x7f6bb41353b0 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 10 monclient: _renew_subs 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f6bb41c9da0 con 0x7f6bb41353b0 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6bb0004680 con 0x7f6bb41353b0 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6bb0004bf0 con 0x7f6bb41353b0 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: dump: 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.110 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bab7fe640 4 set_mon_vals no callback set 2024-04-26T00:07:04.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6b940065d0 con 0x7f6b94002870 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6bb0004e50 con 0x7f6bb41353b0 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f6bb00452d0 con 0x7f6bb41353b0 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1786154219 0 0) 0x7f6b940065d0 con 0x7f6b94002870 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient(hunting): my global_id is 7634 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6bb4134cf0 con 0x7f6b94002870 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6bb9fc5640 10 monclient: get_auth_request con 0x7f6ba0037860 auth_method 0 2024-04-26T00:07:04.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3915260875 0 0) 0x7f6bb4134cf0 con 0x7f6b94002870 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b940065d0 con 0x7f6b94002870 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6bac004400 con 0x7f6b94002870 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: dump: 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.113 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2988134332 0 0) 0x7f6b940065d0 con 0x7f6b94002870 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6b9400a160 con 0x7f6b94002870 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6bac006850 con 0x7f6b94002870 2024-04-26T00:07:04.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.106:6790/0 conn(0x7f6b94002870 legacy=0x7f6b94004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.117+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.106:6790/0 conn(0x7f6b94002870 legacy=0x7f6b94004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6b94009e60 con 0x7f6b94009120 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078565685 0 0) 0x7f6b94009e60 con 0x7f6b94009120 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient(hunting): my global_id is 7643 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6b940065d0 con 0x7f6b94009120 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 529661443 0 0) 0x7f6b940065d0 con 0x7f6b94009120 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6b94009e60 con 0x7f6b94009120 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6bac004e90 con 0x7f6b94009120 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient: dump: 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.118 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 427591531 0 0) 0x7f6b94009e60 con 0x7f6b94009120 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f6b9400c3e0 con 0x7f6b94009120 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f6bac006360 con 0x7f6b94009120 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.106:6790/0 conn(0x7f6b94009120 legacy=0x7f6b940095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6ba9ffb640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.106:6790/0 conn(0x7f6b94009120 legacy=0x7f6b940095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:04.119 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-26T00:07:04.120 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-26T00:07:04.120 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.171:6812/722422047 conn(0x7f6ba0037860 legacy=0x7f6ba0039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 10 monclient: shutdown 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 >> v1:172.21.15.106:6793/0 conn(0x7f6bb41353b0 legacy=0x7f6bb413ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bb9fc5640 1 -- 172.21.15.106:0/3251155727 reap_dead start 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bb9fc5640 1 -- 172.21.15.106:0/3251155727 reap_dead start 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 shutdown_connections 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 >> 172.21.15.106:0/3251155727 conn(0x7f6bb40a64e0 msgr2=0x7f6bb40a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:04.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 shutdown_connections 2024-04-26T00:07:04.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.125+0000 7f6bbba28640 1 -- 172.21.15.106:0/3251155727 wait complete. 2024-04-26T00:07:04.122 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T00:07:04.122 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T00:07:04.122 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:07:04.136 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T00:07:04.137 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-04-26T00:07:04.137 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:07:04.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient: get_monmap_and_config 2024-04-26T00:07:04.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient: build_initial_monmap 2024-04-26T00:07:04.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient: monmap: 2024-04-26T00:07:04.290 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:04.316473+0000 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:04.316473+0000 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:04.291 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:04.292 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 1 Processor -- start 2024-04-26T00:07:04.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 1 -- start start 2024-04-26T00:07:04.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient: init 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient: _add_conns ranks=[4,8,2,7,5,1,6,0,3] 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient(hunting): picked mon.noname-c con 0x7fc7bc0720e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient(hunting): picked mon.noname-e con 0x7fc7bc137b10 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient(hunting): picked mon.noname-b con 0x7fc7bc0724c0 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7bc0a4390 con 0x7fc7bc0724c0 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7bc06cbb0 con 0x7fc7bc0720e0 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7bc06cff0 con 0x7fc7bc137b10 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c17d6640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fc7bc0720e0 legacy=0x7fc7bc0a3570 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:04.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c1fd7640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7fc7bc0724c0 legacy=0x7fc7bc140980 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c3a3a640 10 monclient(hunting): authenticate will time out at 1679.843861s 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c0fd5640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc7bc137b10 0x7fc7bc0a3c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:46076/0 (socket says 172.21.15.106:46076) 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.313+0000 7fc7c0fd5640 1 -- 172.21.15.106:0/530838454 learned_addr learned my addr 172.21.15.106:0/530838454 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1388249491 0 0) 0x7fc7bc06cff0 con 0x7fc7bc137b10 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient(hunting): my global_id is 224504 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a4003530 con 0x7fc7bc137b10 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3174100655 0 0) 0x7fc7a4003530 con 0x7fc7bc137b10 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 >> v1:172.21.15.106:6791/0 conn(0x7fc7bc0720e0 legacy=0x7fc7bc0a3570 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:04.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 >> v1:172.21.15.106:6790/0 conn(0x7fc7bc0724c0 legacy=0x7fc7bc140980 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: _finish_hunting 0 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 monclient: found mon.noname-e 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc0705f0 con 0x7fc7bc137b10 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: _finish_auth 0 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: _check_auth_tickets 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 5 monclient: authenticate success, global_id 224504 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7b0001820 con 0x7fc7bc137b10 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: dump: 2024-04-26T00:07:04.301 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.302 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7b0001ac0 con 0x7fc7bc137b10 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 4 set_mon_vals no callback set 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 1 -- 172.21.15.106:0/530838454 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7b0004bf0 con 0x7fc7bc137b10 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7bbfff640 10 monclient: dump: 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.303 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient: shutdown 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:04.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/530838454 >> v1:172.21.15.106:6793/0 conn(0x7fc7bc137b10 legacy=0x7fc7bc0a3c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/530838454 shutdown_connections 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/530838454 >> 172.21.15.106:0/530838454 conn(0x7fc7bc0a8450 msgr2=0x7fc7bc0a4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/530838454 shutdown_connections 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/530838454 wait complete. 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient: build_initial_monmap 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient: monmap: 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:04.305 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 Processor -- start 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- start start 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient: init 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient: _add_conns ranks=[6,3,5,2,1,7,0,4,8] 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient(hunting): picked mon.noname-d con 0x7fc7bc0720e0 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:04.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient(hunting): picked mon.noname-g con 0x7fc7bc0724c0 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient(hunting): picked mon.noname-h con 0x7fc7bc137b10 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7bc123c90 con 0x7fc7bc0724c0 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7bc06d950 con 0x7fc7bc137b10 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c17d6640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7fc7bc0720e0 legacy=0x7fc7bc1cc120 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc7bc1239b0 con 0x7fc7bc0720e0 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c3a3a640 10 monclient(hunting): authenticate will time out at 1679.846603s 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c1fd7640 1 -- >> v1:172.21.15.171:6791/0 conn(0x7fc7bc137b10 legacy=0x7fc7bc1d42c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c0fd5640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fc7bc0724c0 0x7fc7bc1362d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:56024/0 (socket says 172.21.15.106:56024) 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7c0fd5640 1 -- 172.21.15.106:0/623106803 learned_addr learned my addr 172.21.15.106:0/623106803 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1197272162 0 0) 0x7fc7bc123c90 con 0x7fc7bc0724c0 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:04.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): my global_id is 214743 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc7a8003530 con 0x7fc7bc0724c0 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 294990733 0 0) 0x7fc7a8003530 con 0x7fc7bc0724c0 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc7bc123c90 con 0x7fc7bc0724c0 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7b00017e0 con 0x7fc7bc0724c0 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): dump: 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.308 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.317+0000 7fc7b9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2532854449 0 0) 0x7fc7bc123c90 con 0x7fc7bc0724c0 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 >> v1:172.21.15.106:6792/0 conn(0x7fc7bc0720e0 legacy=0x7fc7bc1cc120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:04.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 >> v1:172.21.15.171:6791/0 conn(0x7fc7bc137b10 legacy=0x7fc7bc1d42c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 monclient: found mon.g 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7bc122250 con 0x7fc7bc0724c0 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 5 monclient: authenticate success, global_id 214743 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 10 monclient: _renew_subs 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc7bc1369e0 con 0x7fc7bc0724c0 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 10 monclient: _renew_subs 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:04.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc7bc1d59e0 con 0x7fc7bc0724c0 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc7b0001ac0 con 0x7fc7bc0724c0 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc7b0001cf0 con 0x7fc7bc0724c0 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7bb7fe640 4 set_mon_vals no callback set 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 10 monclient: dump: 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:04.311 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc79c005090 con 0x7fc7bc0724c0 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc7b0010050 con 0x7fc7bc0724c0 2024-04-26T00:07:04.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7fc7b0045370 con 0x7fc7bc0724c0 2024-04-26T00:07:04.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.321+0000 7fc7c17d6640 10 monclient: get_auth_request con 0x7fc7a80376a0 auth_method 0 2024-04-26T00:07:04.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.333+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc7b00159a0 con 0x7fc7bc0724c0 2024-04-26T00:07:04.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.333+0000 7fc7b9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:04.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.333+0000 7fc7b9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:04.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.549+0000 7fc7c3a3a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:07:04.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.549+0000 7fc7c3a3a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:04.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.549+0000 7fc7c3a3a640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.549+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 --> v1:172.21.15.171:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fc79c005380 con 0x7fc7bc0724c0 2024-04-26T00:07:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.549+0000 7fc7b9ffb640 1 -- 172.21.15.106:0/623106803 <== mon.3 v1:172.21.15.171:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1800138430) 0x7fc7b00152a0 con 0x7fc7bc0724c0 2024-04-26T00:07:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.549+0000 7fc7b9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:04.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.549+0000 7fc7b9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:04.527 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":80,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":6,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:07:04.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 >> v1:172.21.15.171:6812/722422047 conn(0x7fc7a80376a0 legacy=0x7fc7a8039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 10 monclient: shutdown 2024-04-26T00:07:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 >> v1:172.21.15.171:6790/0 conn(0x7fc7bc0724c0 legacy=0x7fc7bc1362d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 shutdown_connections 2024-04-26T00:07:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 >> 172.21.15.106:0/623106803 conn(0x7fc7bc0a8450 msgr2=0x7fc7bc0a68f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 shutdown_connections 2024-04-26T00:07:04.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:04.553+0000 7fc7c3a3a640 1 -- 172.21.15.106:0/623106803 wait complete. 2024-04-26T00:07:07.544 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:07:07.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient: get_monmap_and_config 2024-04-26T00:07:07.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient: build_initial_monmap 2024-04-26T00:07:07.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient: monmap: 2024-04-26T00:07:07.670 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:07.670 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:07.696187+0000 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:07.696187+0000 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:07.671 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:07.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 1 Processor -- start 2024-04-26T00:07:07.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 1 -- start start 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient: init 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient: _add_conns ranks=[0,5,7,4,6,3,8,1,2] 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient(hunting): picked mon.noname-a con 0x7f1a80135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient(hunting): picked mon.noname-h con 0x7f1a801353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient(hunting): picked mon.noname-i con 0x7f1a8013bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8006f2d0 con 0x7f1a80135870 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a80072330 con 0x7f1a801353b0 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a80072610 con 0x7f1a8013bdf0 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a87b01640 10 monclient(hunting): authenticate will time out at 1683.223899s 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.693+0000 7f1a8509c640 1 -- >> v1:172.21.15.171:6791/0 conn(0x7f1a801353b0 legacy=0x7f1a8013a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8589d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1a80135870 0x7f1a80135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:35632/0 (socket says 172.21.15.106:35632) 2024-04-26T00:07:07.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8589d640 1 -- 172.21.15.106:0/1561925400 learned_addr learned my addr 172.21.15.106:0/1561925400 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 670055073 0 0) 0x7f1a8006f2d0 con 0x7f1a80135870 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient(hunting): _negotiate 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient(hunting): my global_id is 7848 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a6c003530 con 0x7f1a80135870 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 19599831 0 0) 0x7f1a6c003530 con 0x7f1a80135870 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 >> v1:172.21.15.171:6792/0 conn(0x7f1a8013bdf0 legacy=0x7f1a8013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 >> v1:172.21.15.171:6791/0 conn(0x7f1a801353b0 legacy=0x7f1a8013a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: _finish_hunting 0 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 monclient: found mon.noname-a 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:07.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a800a3260 con 0x7f1a80135870 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: _finish_auth 0 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: _check_auth_tickets 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a7c0017c0 con 0x7f1a80135870 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: dump: 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:07.681 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 5 monclient: authenticate success, global_id 7848 2024-04-26T00:07:07.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a7c001b20 con 0x7f1a80135870 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 1 -- 172.21.15.106:0/1561925400 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a7c004bf0 con 0x7f1a80135870 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 4 set_mon_vals no callback set 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8489b640 10 monclient: dump: 2024-04-26T00:07:07.683 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:07.684 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:07.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: shutdown 2024-04-26T00:07:07.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:07.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- 172.21.15.106:0/1561925400 >> v1:172.21.15.106:6789/0 conn(0x7f1a80135870 legacy=0x7f1a80135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:07.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- 172.21.15.106:0/1561925400 shutdown_connections 2024-04-26T00:07:07.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- 172.21.15.106:0/1561925400 >> 172.21.15.106:0/1561925400 conn(0x7f1a800a64e0 msgr2=0x7f1a800a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:07.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- 172.21.15.106:0/1561925400 shutdown_connections 2024-04-26T00:07:07.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- 172.21.15.106:0/1561925400 wait complete. 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: build_initial_monmap 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: monmap: 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:07.686 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 Processor -- start 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- start start 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: init 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: _add_conns ranks=[2,0,1,7,5,6,3,4,8] 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient(hunting): picked mon.noname-b con 0x7f1a801353b0 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient(hunting): picked mon.noname-a con 0x7f1a80135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:07.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient(hunting): picked mon.noname-f con 0x7f1a8013bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8009f470 con 0x7f1a80135870 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8011d910 con 0x7f1a8013bdf0 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8589d640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f1a801353b0 legacy=0x7f1a80134810 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a8011dbf0 con 0x7f1a801353b0 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient(hunting): authenticate will time out at 1683.226816s 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8509c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1a80135870 0x7f1a801d12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:35640/0 (socket says 172.21.15.106:35640) 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a8509c640 1 -- 172.21.15.106:0/3028786915 learned_addr learned my addr 172.21.15.106:0/3028786915 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385149386 0 0) 0x7f1a8009f470 con 0x7f1a80135870 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:07.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): my global_id is 7857 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a64003530 con 0x7f1a80135870 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 206024357 0 0) 0x7f1a64003530 con 0x7f1a80135870 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a8009f470 con 0x7f1a80135870 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a70004330 con 0x7f1a80135870 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): dump: 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:07.689 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 714635948 0 0) 0x7f1a8009f470 con 0x7f1a80135870 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 >> v1:172.21.15.106:6790/0 conn(0x7f1a801353b0 legacy=0x7f1a80134810 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:07.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 >> v1:172.21.15.171:6789/0 conn(0x7f1a8013bdf0 legacy=0x7f1a801d4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: _finish_hunting 0 2024-04-26T00:07:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 monclient: found mon.a 2024-04-26T00:07:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a80134f20 con 0x7f1a80135870 2024-04-26T00:07:07.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: _finish_auth 0 2024-04-26T00:07:07.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: _check_auth_tickets 2024-04-26T00:07:07.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:07.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 5 monclient: authenticate success, global_id 7857 2024-04-26T00:07:07.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: _renew_subs 2024-04-26T00:07:07.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:07.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a801cc1b0 con 0x7f1a80135870 2024-04-26T00:07:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: _renew_subs 2024-04-26T00:07:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a8009e040 con 0x7f1a80135870 2024-04-26T00:07:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a70004690 con 0x7f1a80135870 2024-04-26T00:07:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1a70004c00 con 0x7f1a80135870 2024-04-26T00:07:07.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a77fff640 4 set_mon_vals no callback set 2024-04-26T00:07:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.697+0000 7f1a767fc640 10 monclient: dump: 2024-04-26T00:07:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:07.694 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:07.695 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:07.696 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:07.696 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.701+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1a70004da0 con 0x7f1a80135870 2024-04-26T00:07:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.701+0000 7f1a87b01640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.701+0000 7f1a87b01640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.701+0000 7f1a87b01640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.701+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a68005090 con 0x7f1a80135870 2024-04-26T00:07:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.701+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f1a70045230 con 0x7f1a80135870 2024-04-26T00:07:07.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.701+0000 7f1a8589d640 10 monclient: get_auth_request con 0x7f1a64037800 auth_method 0 2024-04-26T00:07:07.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.705+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1a70015860 con 0x7f1a80135870 2024-04-26T00:07:07.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.705+0000 7f1a767fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:07.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.705+0000 7f1a767fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:07.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:07:07.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:07.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:07.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1a68005380 con 0x7f1a80135870 2024-04-26T00:07:07.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a767fc640 1 -- 172.21.15.106:0/3028786915 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 1424199359) 0x7f1a70015160 con 0x7f1a80135870 2024-04-26T00:07:07.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a767fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:07.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a767fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:07.894 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":80,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:07:07.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 >> v1:172.21.15.171:6812/722422047 conn(0x7f1a64037800 legacy=0x7f1a64039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:07.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 10 monclient: shutdown 2024-04-26T00:07:07.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:07.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 >> v1:172.21.15.106:6789/0 conn(0x7f1a80135870 legacy=0x7f1a801d12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:07.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 shutdown_connections 2024-04-26T00:07:07.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.917+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 >> 172.21.15.106:0/3028786915 conn(0x7f1a800a64e0 msgr2=0x7f1a8013a720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:07.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.921+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 shutdown_connections 2024-04-26T00:07:07.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:07.921+0000 7f1a87b01640 1 -- 172.21.15.106:0/3028786915 wait complete. 2024-04-26T00:07:10.911 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient: get_monmap_and_config 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient: build_initial_monmap 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient: monmap: 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:11.063942+0000 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:11.063942+0000 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:11.038 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:11.039 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 1 Processor -- start 2024-04-26T00:07:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 1 -- start start 2024-04-26T00:07:11.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient: init 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient: _add_conns ranks=[1,7,6,8,5,4,3,2,0] 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient(hunting): picked mon.noname-f con 0x7f23d8135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient(hunting): picked mon.noname-i con 0x7f23d81353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient(hunting): picked mon.noname-d con 0x7f23d813bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d806f2d0 con 0x7f23d8135870 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d8072330 con 0x7f23d813bdf0 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d8072610 con 0x7f23d81353b0 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23dcbfd640 10 monclient(hunting): authenticate will time out at 1686.591619s 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.061+0000 7f23d6d9d640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f23d813bdf0 legacy=0x7f23d813e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.065+0000 7f23cdd9b640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f23d81353b0 0x7f23d813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:60194/0 (socket says 172.21.15.106:60194) 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.065+0000 7f23cdd9b640 1 -- 172.21.15.106:0/784912987 learned_addr learned my addr 172.21.15.106:0/784912987 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:11.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.065+0000 7f23d659c640 1 --1- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6789/0 conn(0x7f23d8135870 0x7f23d8135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:56472/0 (socket says 172.21.15.106:56472) 2024-04-26T00:07:11.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.265+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6792/0 conn(0x7f23d813bdf0 legacy=0x7f23d813e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:11.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:11.669+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6792/0 conn(0x7f23d813bdf0 legacy=0x7f23d813e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:12.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:12.473+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6792/0 conn(0x7f23d813bdf0 legacy=0x7f23d813e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:14.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient(hunting): tick 2024-04-26T00:07:14.040 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 1 monclient(hunting): continuing hunt 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6792/0 conn(0x7f23d81353b0 legacy=0x7f23d813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6792/0 conn(0x7f23d813bdf0 legacy=0x7f23d813e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6789/0 conn(0x7f23d8135870 legacy=0x7f23d8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient: _add_conns ranks=[5,8,2,3,0,4] 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient(hunting): picked mon.noname-h con 0x7f23b80037d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient(hunting): picked mon.noname-e con 0x7f23b80073c0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient(hunting): picked mon.noname-b con 0x7f23b800b130 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d80a3260 con 0x7f23b800b130 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d8072330 con 0x7f23b80037d0 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b8011000 con 0x7f23b80073c0 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.060+0000 7f23d4d99640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:14.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.064+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6790/0 conn(0x7f23b800b130 legacy=0x7f23b800d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:14.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.064+0000 7f23d659c640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6791/0 conn(0x7f23b80037d0 legacy=0x7f23b8005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:14.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.268+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6790/0 conn(0x7f23b800b130 legacy=0x7f23b800d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:14.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.268+0000 7f23d659c640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6791/0 conn(0x7f23b80037d0 legacy=0x7f23b8005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:14.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.672+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6790/0 conn(0x7f23b800b130 legacy=0x7f23b800d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:14.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:14.672+0000 7f23d659c640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6791/0 conn(0x7f23b80037d0 legacy=0x7f23b8005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:15.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:15.476+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6790/0 conn(0x7f23b800b130 legacy=0x7f23b800d5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:15.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:15.476+0000 7f23d659c640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6791/0 conn(0x7f23b80037d0 legacy=0x7f23b8005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:16.815 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=110 2024-04-26T00:07:16.815 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 110 -ne 110 ]] 2024-04-26T00:07:16.815 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:07:16.815 INFO:tasks.workunit.client.0.smithi171.stderr:+ export CEPH_ARGS= 2024-04-26T00:07:16.815 INFO:tasks.workunit.client.0.smithi171.stderr:+ CEPH_ARGS= 2024-04-26T00:07:16.815 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph auth del client.foo 2024-04-26T00:07:16.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.950+0000 7f09aa1ed640 10 monclient: get_monmap_and_config 2024-04-26T00:07:16.928 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.950+0000 7f09aa1ed640 10 monclient: build_initial_monmap 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient: monmap: 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:07:16.954525+0000 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:07:16.954525+0000 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:16.929 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:16.930 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:16.930 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:16.930 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 1 Processor -- start 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 1 -- start start 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient: init 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient: _add_conns ranks=[3,0,2,6,4,5,1,7,8] 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient(hunting): picked mon.noname-g con 0x7f09a409d3f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient(hunting): picked mon.noname-a con 0x7f09a409dee0 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:16.931 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient(hunting): picked mon.noname-b con 0x7f09a409fa10 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a40a1a00 con 0x7f09a409dee0 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a4072f30 con 0x7f09a409fa10 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a409f030 con 0x7f09a409d3f0 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09aa1ed640 10 monclient(hunting): authenticate will time out at 1687.661550s 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09a37fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f09a409d3f0 0x7f09a409d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.171:37422/0 (socket says 172.21.15.171:37422) 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09a37fe640 1 -- 172.21.15.171:0/1623993767 learned_addr learned my addr 172.21.15.171:0/1623993767 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:07:16.932 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:16.954+0000 7f09a3fff640 1 -- 172.21.15.171:0/1623993767 >> v1:172.21.15.106:6790/0 conn(0x7f09a409fa10 legacy=0x7f09a413d240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient(hunting): tick 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 1 monclient(hunting): continuing hunt 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6793/0 conn(0x7f23b80073c0 legacy=0x7f23b8009860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6791/0 conn(0x7f23b80037d0 legacy=0x7f23b8005c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6790/0 conn(0x7f23b800b130 legacy=0x7f23b800d5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 reap_dead start 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient: _add_conns ranks=[0,3,4] 2024-04-26T00:07:17.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 reap_dead start 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient(hunting): picked mon.noname-a con 0x7f23b8010040 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient(hunting): picked mon.noname-g con 0x7f23b8010480 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient(hunting): picked mon.noname-c con 0x7f23b8010a80 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23b8012290 con 0x7f23b8010040 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d80a3260 con 0x7f23b8010480 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d8072330 con 0x7f23b8010a80 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d4d99640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:17.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.064+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6791/0 conn(0x7f23b8010a80 legacy=0x7f23b800d520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:17.132 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:17.158+0000 7f09a3fff640 1 -- 172.21.15.171:0/1623993767 >> v1:172.21.15.106:6790/0 conn(0x7f09a409fa10 legacy=0x7f09a413d240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:17.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.268+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6791/0 conn(0x7f23b8010a80 legacy=0x7f23b800d520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:17.537 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:17.562+0000 7f09a3fff640 1 -- 172.21.15.171:0/1623993767 >> v1:172.21.15.106:6790/0 conn(0x7f09a409fa10 legacy=0x7f09a413d240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:17.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:17.672+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6791/0 conn(0x7f23b8010a80 legacy=0x7f23b800d520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:18.341 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.365+0000 7f09a3fff640 1 -- 172.21.15.171:0/1623993767 >> v1:172.21.15.106:6790/0 conn(0x7f09a409fa10 legacy=0x7f09a413d240 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:18.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.476+0000 7f23d6d9d640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6791/0 conn(0x7f23b8010a80 legacy=0x7f23b800d520 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.716+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255780152 0 0) 0x7f23b8012290 con 0x7f23b8010040 2024-04-26T00:07:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.716+0000 7f23d5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:07:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.716+0000 7f23d5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.716+0000 7f23d5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.716+0000 7f23d5d9b640 10 monclient(hunting): my global_id is 7875 2024-04-26T00:07:18.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.716+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23c4003530 con 0x7f23b8010040 2024-04-26T00:07:18.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.717+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 516943792 0 0) 0x7f09a40a1a00 con 0x7f09a409dee0 2024-04-26T00:07:18.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.717+0000 7f09a27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:18.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.717+0000 7f09a27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:18.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.717+0000 7f09a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:18.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.717+0000 7f09a27fc640 10 monclient(hunting): my global_id is 7866 2024-04-26T00:07:18.697 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.717+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f098c005740 con 0x7f09a409dee0 2024-04-26T00:07:18.698 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 740191078 0 0) 0x7f098c005740 con 0x7f09a409dee0 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 >> v1:172.21.15.171:6790/0 conn(0x7f09a409d3f0 legacy=0x7f09a409d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 >> v1:172.21.15.106:6790/0 conn(0x7f09a409fa10 legacy=0x7f09a413d240 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 1 monclient: found mon.noname-a 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a409e790 con 0x7f09a409dee0 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: _finish_auth 0 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09aa1ed640 5 monclient: authenticate success, global_id 7866 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f09980017a0 con 0x7f09a409dee0 2024-04-26T00:07:18.699 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: dump: 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.700 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.701 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:07:18.701 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09aa1ed640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0998001a50 con 0x7f09a409dee0 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.721+0000 7f09a27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 4 set_mon_vals no callback set 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09a27fc640 1 -- 172.21.15.171:0/1623993767 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0998003960 con 0x7f09a409dee0 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09a27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09a27fc640 10 monclient: dump: 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:07:18.707 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:07:18.708 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient: shutdown 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- 172.21.15.171:0/1623993767 >> v1:172.21.15.106:6789/0 conn(0x7f09a409dee0 legacy=0x7f09a4139b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- 172.21.15.171:0/1623993767 shutdown_connections 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- 172.21.15.171:0/1623993767 >> 172.21.15.171:0/1623993767 conn(0x7f09a40a6860 msgr2=0x7f09a40a29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- 172.21.15.171:0/1623993767 shutdown_connections 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- 172.21.15.171:0/1623993767 wait complete. 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient: build_initial_monmap 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient: monmap: 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:18.709 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 Processor -- start 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- start start 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient: init 2024-04-26T00:07:18.710 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient: _add_conns ranks=[5,1,8,4,0,6,7,3,2] 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient(hunting): picked mon.noname-h con 0x7f09a409d3f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient(hunting): picked mon.noname-f con 0x7f09a409dee0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient(hunting): picked mon.noname-e con 0x7f09a409fa10 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a40a1ef0 con 0x7f09a409dee0 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a41a9ee0 con 0x7f09a409d3f0 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09a41aa1c0 con 0x7f09a409fa10 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09aa1ed640 10 monclient(hunting): authenticate will time out at 1689.435815s 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.725+0000 7f09a37fe640 1 -- >> v1:172.21.15.171:6791/0 conn(0x7f09a409d3f0 legacy=0x7f09a41cc100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.729+0000 7f09a2ffd640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f09a409dee0 0x7f09a41bc7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.171:53622/0 (socket says 172.21.15.171:53622) 2024-04-26T00:07:18.711 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.729+0000 7f09a2ffd640 1 -- 172.21.15.171:0/97818046 learned_addr learned my addr 172.21.15.171:0/97818046 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:07:18.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3681709055 0 0) 0x7f23c4003530 con 0x7f23b8010040 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6791/0 conn(0x7f23b8010a80 legacy=0x7f23b800d520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.171:6790/0 conn(0x7f23b8010480 legacy=0x7f23b80097e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 1 monclient: found mon.noname-a 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23b80112e0 con 0x7f23b8010040 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 10 monclient: _finish_auth 0 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f23c00017c0 con 0x7f23b8010040 2024-04-26T00:07:18.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23d5d9b640 10 monclient: dump: 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.719 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23dcbfd640 5 monclient: authenticate success, global_id 7875 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.720+0000 7f23dcbfd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23c0001a20 con 0x7f23b8010040 2024-04-26T00:07:18.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23d5d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 4 set_mon_vals no callback set 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23d5d9b640 1 -- 172.21.15.106:0/784912987 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f23c0004b30 con 0x7f23b8010040 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23d5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23d5d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23d5d9b640 10 monclient: dump: 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.722 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 10 monclient: shutdown 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:18.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 1 -- 172.21.15.106:0/784912987 >> v1:172.21.15.106:6789/0 conn(0x7f23b8010040 legacy=0x7f23b8005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 1 -- 172.21.15.106:0/784912987 shutdown_connections 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 1 -- 172.21.15.106:0/784912987 >> 172.21.15.106:0/784912987 conn(0x7f23d80a64e0 msgr2=0x7f23d80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 1 -- 172.21.15.106:0/784912987 shutdown_connections 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 1 -- 172.21.15.106:0/784912987 wait complete. 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 10 monclient: build_initial_monmap 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 10 monclient: monmap: 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:18.724 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:18.725 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 1 Processor -- start 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 1 -- start start 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.724+0000 7f23dcbfd640 10 monclient: init 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 10 monclient: _add_conns ranks=[7,1,2,4,8,3,0,6,5] 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 10 monclient(hunting): picked mon.noname-i con 0x7f23b8010040 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 10 monclient(hunting): picked mon.noname-f con 0x7f23b8010480 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 10 monclient(hunting): picked mon.noname-b con 0x7f23b8010a80 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d8121a40 con 0x7f23b8010480 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d8120590 con 0x7f23b8010a80 2024-04-26T00:07:18.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f23d809f930 con 0x7f23b8010040 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23dcbfd640 10 monclient(hunting): authenticate will time out at 1694.256708s 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23d659c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f23b8010040 0x7f23d8134360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:54628/0 (socket says 172.21.15.106:54628) 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23d659c640 1 -- 172.21.15.106:0/3494792171 learned_addr learned my addr 172.21.15.106:0/3494792171 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23d6d9d640 1 -- 172.21.15.106:0/3494792171 >> v1:172.21.15.106:6790/0 conn(0x7f23b8010a80 legacy=0x7f23d81d4d60 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.728+0000 7f23cdd9b640 1 --1- 172.21.15.106:0/3494792171 >> v1:172.21.15.171:6789/0 conn(0x7f23b8010480 0x7f23d81d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:46990/0 (socket says 172.21.15.106:46990) 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2859614269 0 0) 0x7f23d8121a40 con 0x7f23b8010480 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:18.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): my global_id is 224596 2024-04-26T00:07:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23b8012250 con 0x7f23b8010480 2024-04-26T00:07:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2355477186 0 0) 0x7f23b8012250 con 0x7f23b8010480 2024-04-26T00:07:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f23d8121a40 con 0x7f23b8010480 2024-04-26T00:07:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f23c80018d0 con 0x7f23b8010480 2024-04-26T00:07:18.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): dump: 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.729 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643764894 0 0) 0x7f23d809f930 con 0x7f23b8010040 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient(hunting): my global_id is 146041 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f23b8012250 con 0x7f23b8010040 2024-04-26T00:07:18.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 406655820 0 0) 0x7f23d8121a40 con 0x7f23b8010480 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 >> v1:172.21.15.171:6792/0 conn(0x7f23b8010040 legacy=0x7f23d8134360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 >> v1:172.21.15.106:6790/0 conn(0x7f23b8010a80 legacy=0x7f23d81d4d60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 monclient: found mon.f 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23d81202e0 con 0x7f23b8010480 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: _finish_auth 0 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:18.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 5 monclient: authenticate success, global_id 224596 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 10 monclient: _renew_subs 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f23d8121760 con 0x7f23b8010480 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 10 monclient: _renew_subs 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f23d8134c40 con 0x7f23b8010480 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f23c80047f0 con 0x7f23b8010480 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f23c8004d60 con 0x7f23b8010480 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23d559a640 4 set_mon_vals no callback set 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23cf7fe640 10 monclient: dump: 2024-04-26T00:07:18.732 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.733 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.732+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23d8134ed0 con 0x7f23b8010480 2024-04-26T00:07:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.736+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f23c8004f80 con 0x7f23b8010480 2024-04-26T00:07:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.736+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f23c8044fa0 con 0x7f23b8010480 2024-04-26T00:07:18.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.736+0000 7f23d659c640 10 monclient: get_auth_request con 0x7f23b80399e0 auth_method 0 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730026963 0 0) 0x7f09a41aa1c0 con 0x7f09a409fa10 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): my global_id is 224513 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0990003560 con 0x7f09a409fa10 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223116528 0 0) 0x7f09a409e790 con 0x7f09a409dee0 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:18.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): my global_id is 224587 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09a41aa1c0 con 0x7f09a409dee0 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3500023402 0 0) 0x7f0990003560 con 0x7f09a409fa10 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09a409e790 con 0x7f09a409fa10 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f099c004680 con 0x7f09a409fa10 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): dump: 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.736 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3139743205 0 0) 0x7f09a41aa1c0 con 0x7f09a409dee0 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0990003560 con 0x7f09a409dee0 2024-04-26T00:07:18.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0998001760 con 0x7f09a409dee0 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient(hunting): dump: 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.738 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2802507394 0 0) 0x7f09a409e790 con 0x7f09a409fa10 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 >> v1:172.21.15.171:6791/0 conn(0x7f09a409d3f0 legacy=0x7f09a41cc100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 >> v1:172.21.15.171:6789/0 conn(0x7f09a409dee0 legacy=0x7f09a41bc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 monclient: found mon.e 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:18.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a41a9c00 con 0x7f09a409fa10 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: _finish_auth 0 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 5 monclient: authenticate success, global_id 224513 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 10 monclient: _renew_subs 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09a41a8780 con 0x7f09a409fa10 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 10 monclient: _renew_subs 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f09a41bd0c0 con 0x7f09a409fa10 2024-04-26T00:07:18.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f099c004ad0 con 0x7f09a409fa10 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f099c004fc0 con 0x7f09a409fa10 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09a1ffb640 4 set_mon_vals no callback set 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 10 monclient: dump: 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:18.741 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f099c005160 con 0x7f09a409fa10 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0984005090 con 0x7f09a409fa10 2024-04-26T00:07:18.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f099c045300 con 0x7f09a409fa10 2024-04-26T00:07:18.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.733+0000 7f09a37fe640 10 monclient: get_auth_request con 0x7f0990037e50 auth_method 0 2024-04-26T00:07:18.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.749+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f099c0158d0 con 0x7f09a409fa10 2024-04-26T00:07:18.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.749+0000 7f098bfff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:18.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.749+0000 7f098bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:18.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.740+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f23c80155d0 con 0x7f23b8010480 2024-04-26T00:07:18.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.740+0000 7f23cf7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:18.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.740+0000 7f23cf7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:18.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:07:18.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:18.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:18.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f23d8075890 con 0x7f23b8010480 2024-04-26T00:07:18.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23cf7fe640 1 -- 172.21.15.106:0/3494792171 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2720 (unknown 254746657 0 1521087440) 0x7f23c8014ed0 con 0x7f23b8010480 2024-04-26T00:07:18.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23cf7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:07:18.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23cf7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:18.938 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":84,"quorum":[0,1,3,7,8],"quorum_names":["a","f","g","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:07:18.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 >> v1:172.21.15.171:6812/722422047 conn(0x7f23b80399e0 legacy=0x7f23b803bea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 10 monclient: shutdown 2024-04-26T00:07:18.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:18.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 >> v1:172.21.15.171:6789/0 conn(0x7f23b8010480 legacy=0x7f23d81d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:18.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 shutdown_connections 2024-04-26T00:07:18.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.960+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 >> 172.21.15.106:0/3494792171 conn(0x7f23d80a64e0 msgr2=0x7f23d813a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:18.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.964+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 shutdown_connections 2024-04-26T00:07:18.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:18.964+0000 7f23dcbfd640 1 -- 172.21.15.106:0/3494792171 wait complete. 2024-04-26T00:07:18.943 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.965+0000 7f09aa1ed640 10 start_mon_command cmd=[{"prefix": "auth del", "entity": "client.foo"}] 2024-04-26T00:07:18.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.965+0000 7f09aa1ed640 10 monclient: _send_command 2 [{"prefix": "auth del", "entity": "client.foo"}] 2024-04-26T00:07:18.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.965+0000 7f09aa1ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:18.944 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.965+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "auth del", "entity": "client.foo"} v 0) -- 0x7f0984005380 con 0x7f09a409fa10 2024-04-26T00:07:18.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.973+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.foo"}]=0 v32) ==== 80+0+0 (unknown 3614833482 0 0) 0x7f099c0151d0 con 0x7f09a409fa10 2024-04-26T00:07:18.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.973+0000 7f098bfff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "auth del", "entity": "client.foo"}] 2024-04-26T00:07:18.950 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:18.973+0000 7f098bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:18.956 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-04-26T00:07:18.957 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-04-26T00:07:18.957 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.096+0000 7ff62c95c640 10 monclient: get_monmap_and_config 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.096+0000 7ff62c95c640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.096+0000 7ff62c95c640 10 monclient: monmap: 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:19.102037+0000 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:19.102037+0000 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.076 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.077 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.077 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 Processor -- start 2024-04-26T00:07:19.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- start start 2024-04-26T00:07:19.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: init 2024-04-26T00:07:19.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: _add_conns ranks=[4,0,8,7,2,5,3,1,6] 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient(hunting): picked mon.noname-c con 0x7ff628135870 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient(hunting): picked mon.noname-a con 0x7ff6281353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient(hunting): picked mon.noname-e con 0x7ff62813bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62806f2d0 con 0x7ff6281353b0 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff628072330 con 0x7ff628135870 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff628072610 con 0x7ff62813bdf0 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient(hunting): authenticate will time out at 1694.629163s 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62659c640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff628135870 legacy=0x7ff628135c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff61dd9b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff6281353b0 0x7ff62813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40566/0 (socket says 172.21.15.106:40566) 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff61dd9b640 1 -- 172.21.15.106:0/3866385376 learned_addr learned my addr 172.21.15.106:0/3866385376 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307266731 0 0) 0x7ff62806f2d0 con 0x7ff6281353b0 2024-04-26T00:07:19.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): my global_id is 7884 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff614003530 con 0x7ff6281353b0 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556234888 0 0) 0x7ff628072610 con 0x7ff62813bdf0 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient(hunting): my global_id is 224522 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff62806f2d0 con 0x7ff62813bdf0 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2895779281 0 0) 0x7ff614003530 con 0x7ff6281353b0 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 >> v1:172.21.15.106:6793/0 conn(0x7ff62813bdf0 legacy=0x7ff62813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 >> v1:172.21.15.106:6791/0 conn(0x7ff628135870 legacy=0x7ff628135c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 monclient: found mon.noname-a 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6280a3260 con 0x7ff6281353b0 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 5 monclient: authenticate success, global_id 7884 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff6100017c0 con 0x7ff6281353b0 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: dump: 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.087 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff610001ae0 con 0x7ff6281353b0 2024-04-26T00:07:19.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 1 -- 172.21.15.106:0/3866385376 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff610004bf0 con 0x7ff6281353b0 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 4 set_mon_vals no callback set 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff625d9b640 10 monclient: dump: 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.089 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: shutdown 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- 172.21.15.106:0/3866385376 >> v1:172.21.15.106:6789/0 conn(0x7ff6281353b0 legacy=0x7ff62813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- 172.21.15.106:0/3866385376 shutdown_connections 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- 172.21.15.106:0/3866385376 >> 172.21.15.106:0/3866385376 conn(0x7ff6280a64e0 msgr2=0x7ff6280a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- 172.21.15.106:0/3866385376 shutdown_connections 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- 172.21.15.106:0/3866385376 wait complete. 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: monmap: 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:19.091 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 Processor -- start 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 1 -- start start 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.100+0000 7ff62c95c640 10 monclient: init 2024-04-26T00:07:19.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient: _add_conns ranks=[0,6,4,5,7,8,2,1,3] 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient(hunting): picked mon.noname-a con 0x7ff6281353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient(hunting): picked mon.noname-d con 0x7ff628135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient(hunting): picked mon.noname-c con 0x7ff62813bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff628129f30 con 0x7ff6281353b0 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62809d670 con 0x7ff62813bdf0 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff62809f470 con 0x7ff628135870 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61dd9b640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7ff628135870 legacy=0x7ff628129820 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff626d9d640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7ff62813bdf0 legacy=0x7ff6281d03c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient(hunting): authenticate will time out at 1694.632173s 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62659c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff6281353b0 0x7ff628129110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40580/0 (socket says 172.21.15.106:40580) 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62659c640 1 -- 172.21.15.106:0/3640802600 learned_addr learned my addr 172.21.15.106:0/3640802600 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687873739 0 0) 0x7ff628129f30 con 0x7ff6281353b0 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): my global_id is 7893 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff608003530 con 0x7ff6281353b0 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2296195301 0 0) 0x7ff608003530 con 0x7ff6281353b0 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff628129f30 con 0x7ff6281353b0 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff618004300 con 0x7ff6281353b0 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): dump: 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.094 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:19.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3918881702 0 0) 0x7ff628129f30 con 0x7ff6281353b0 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.106:6792/0 conn(0x7ff628135870 legacy=0x7ff628129820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.106:6791/0 conn(0x7ff62813bdf0 legacy=0x7ff6281d03c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 monclient: found mon.a 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6281312d0 con 0x7ff6281353b0 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 5 monclient: authenticate success, global_id 7893 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient: _renew_subs 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff62809e190 con 0x7ff6281353b0 2024-04-26T00:07:19.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient: _renew_subs 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ff62809cd70 con 0x7ff6281353b0 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff6180045f0 con 0x7ff6281353b0 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff618004b60 con 0x7ff6281353b0 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62559a640 4 set_mon_vals no callback set 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: dump: 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.097 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff60c0065d0 con 0x7ff60c002870 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff618004d00 con 0x7ff6281353b0 2024-04-26T00:07:19.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7ff618045220 con 0x7ff6281353b0 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 695628378 0 0) 0x7ff60c0065d0 con 0x7ff60c002870 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient(hunting): my global_id is 7902 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff628129f30 con 0x7ff60c002870 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3231822809 0 0) 0x7ff628129f30 con 0x7ff60c002870 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff60c0065d0 con 0x7ff60c002870 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff610001220 con 0x7ff60c002870 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff626d9d640 10 monclient: get_auth_request con 0x7ff6080377e0 auth_method 0 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: dump: 2024-04-26T00:07:19.099 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.100 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3561683155 0 0) 0x7ff60c0065d0 con 0x7ff60c002870 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff60c00a160 con 0x7ff60c002870 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff610001ce0 con 0x7ff60c002870 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.106:6789/0 conn(0x7ff60c002870 legacy=0x7ff60c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.104+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.106:6789/0 conn(0x7ff60c002870 legacy=0x7ff60c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff60c009e30 con 0x7ff60c0090f0 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3252277792 0 0) 0x7ff60c009e30 con 0x7ff60c0090f0 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient(hunting): my global_id is 7911 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff60c0065d0 con 0x7ff60c0090f0 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2951554451 0 0) 0x7ff60c0065d0 con 0x7ff60c0090f0 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff60c009e30 con 0x7ff60c0090f0 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff610004ba0 con 0x7ff60c0090f0 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:19.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient: dump: 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.104 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3070434915 0 0) 0x7ff60c009e30 con 0x7ff60c0090f0 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff60c00c3a0 con 0x7ff60c0090f0 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7693 (unknown 0 0 2113153282) 0x7ff610007440 con 0x7ff60c0090f0 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.106:6789/0 conn(0x7ff60c0090f0 legacy=0x7ff60c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff61f7fe640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.106:6789/0 conn(0x7ff60c0090f0 legacy=0x7ff60c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 84, 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 757672, 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:19.106 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.107 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.108 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:19.109 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.110 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.111 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.112 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:19.113 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.115 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.117 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.118 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:19.119 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.120 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.122 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 6 2024-04-26T00:07:19.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.124 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:19.124 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.171:6812/722422047 conn(0x7ff6080377e0 legacy=0x7ff608039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 10 monclient: shutdown 2024-04-26T00:07:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 >> v1:172.21.15.106:6789/0 conn(0x7ff6281353b0 legacy=0x7ff628129110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff626d9d640 1 -- 172.21.15.106:0/3640802600 reap_dead start 2024-04-26T00:07:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff626d9d640 1 -- 172.21.15.106:0/3640802600 reap_dead start 2024-04-26T00:07:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 shutdown_connections 2024-04-26T00:07:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 >> 172.21.15.106:0/3640802600 conn(0x7ff6280a64e0 msgr2=0x7ff6280a3830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 shutdown_connections 2024-04-26T00:07:19.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.112+0000 7ff62c95c640 1 -- 172.21.15.106:0/3640802600 wait complete. 2024-04-26T00:07:19.126 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:07:19.126 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-04-26T00:07:19.126 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:07:19.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.125+0000 7f09aa1ed640 10 start_mon_command cmd=[{"prefix": "auth del", "entity": "client.foo"}] 2024-04-26T00:07:19.133 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.125+0000 7f09aa1ed640 10 monclient: _send_command 3 [{"prefix": "auth del", "entity": "client.foo"}] 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.125+0000 7f09aa1ed640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.125+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "auth del", "entity": "client.foo"} v 0) -- 0x7f0984002220 con 0x7f09a409fa10 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.125+0000 7f098bfff640 1 -- 172.21.15.171:0/97818046 <== mon.8 v1:172.21.15.106:6793/0 11 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.foo"}]=0 v32) ==== 80+0+0 (unknown 3614833482 0 0) 0x7f099c019520 con 0x7f09a409fa10 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.125+0000 7f098bfff640 10 monclient: handle_mon_command_ack 3 [{"prefix": "auth del", "entity": "client.foo"}] 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.125+0000 7f098bfff640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 >> v1:172.21.15.171:6812/722422047 conn(0x7f0990037e50 legacy=0x7f099003a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 10 monclient: shutdown 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 >> v1:172.21.15.106:6793/0 conn(0x7f09a409fa10 legacy=0x7f09a41d44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 shutdown_connections 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 >> 172.21.15.171:0/97818046 conn(0x7f09a40a6860 msgr2=0x7f09a41bf820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 shutdown_connections 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:07:19.129+0000 7f09aa1ed640 1 -- 172.21.15.171:0/97818046 wait complete. 2024-04-26T00:07:19.134 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status' 13 2024-04-26T00:07:19.135 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status' 2024-04-26T00:07:19.135 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:07:19.135 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status 2024-04-26T00:07:19.135 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status 2024-04-26T00:07:19.135 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.foo.keyring --user foo quorum_status 2024-04-26T00:07:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.272+0000 7ff069e1c640 10 monclient: get_monmap_and_config 2024-04-26T00:07:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.272+0000 7ff069e1c640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.272+0000 7ff069e1c640 10 monclient: monmap: 2024-04-26T00:07:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.251 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:19.277322+0000 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:19.277322+0000 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.252 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.253 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.253 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.272+0000 7ff069e1c640 1 Processor -- start 2024-04-26T00:07:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.272+0000 7ff069e1c640 1 -- start start 2024-04-26T00:07:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.272+0000 7ff069e1c640 10 monclient: init 2024-04-26T00:07:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: _add_conns ranks=[8,6,0,2,7,3,1,5,4] 2024-04-26T00:07:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): picked mon.noname-e con 0x7ff0640a1290 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:19.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): picked mon.noname-d con 0x7ff06409f770 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): picked mon.noname-a con 0x7ff06409fb70 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0640727a0 con 0x7ff06409fb70 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0640724c0 con 0x7ff06409f770 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff064072a80 con 0x7ff0640a1290 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): authenticate will time out at 1694.804510s 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff062ffd640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7ff06409f770 legacy=0x7ff06413a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff063fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff06409fb70 0x7ff06413de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40616/0 (socket says 172.21.15.106:40616) 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff063fff640 1 -- 172.21.15.106:0/1278939656 learned_addr learned my addr 172.21.15.106:0/1278939656 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0637fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7ff0640a1290 0x7ff0640a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:41596/0 (socket says 172.21.15.106:41596) 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2036088029 0 0) 0x7ff05c0014a0 con 0x7ff06409fb70 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): my global_id is 7920 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff04c003530 con 0x7ff06409fb70 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2509522671 0 0) 0x7ff064072a80 con 0x7ff0640a1290 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient(hunting): my global_id is 224531 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff05c0014a0 con 0x7ff0640a1290 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2770845649 0 0) 0x7ff04c003530 con 0x7ff06409fb70 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 >> v1:172.21.15.106:6793/0 conn(0x7ff0640a1290 legacy=0x7ff0640a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 >> v1:172.21.15.106:6792/0 conn(0x7ff06409f770 legacy=0x7ff06413a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 monclient: found mon.noname-a 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06406bfc0 con 0x7ff06409fb70 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff05c001d10 con 0x7ff06409fb70 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 5 monclient: authenticate success, global_id 7920 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:19.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: dump: 2024-04-26T00:07:19.266 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.266 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.266 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.266 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.266 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.266 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.266 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff05c002030 con 0x7ff06409fb70 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 1 -- 172.21.15.106:0/1278939656 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff05c004f70 con 0x7ff06409fb70 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0627fc640 10 monclient: dump: 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.268 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 4 set_mon_vals no callback set 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: shutdown 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- 172.21.15.106:0/1278939656 >> v1:172.21.15.106:6789/0 conn(0x7ff06409fb70 legacy=0x7ff06413de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- 172.21.15.106:0/1278939656 shutdown_connections 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- 172.21.15.106:0/1278939656 >> 172.21.15.106:0/1278939656 conn(0x7ff06406b210 msgr2=0x7ff06406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- 172.21.15.106:0/1278939656 shutdown_connections 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- 172.21.15.106:0/1278939656 wait complete. 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: monmap: 2024-04-26T00:07:19.270 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.271 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 Processor -- start 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- start start 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: init 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient: _add_conns ranks=[6,2,8,3,5,1,4,7,0] 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): picked mon.noname-d con 0x7ff06409f770 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): picked mon.noname-b con 0x7ff06409fb70 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): picked mon.noname-e con 0x7ff0640a1290 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06413c590 con 0x7ff06409fb70 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff0637fe640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7ff06409f770 legacy=0x7ff06413a8c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff06413e880 con 0x7ff06409f770 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff062ffd640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7ff06409fb70 legacy=0x7ff06413afd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff064071860 con 0x7ff0640a1290 2024-04-26T00:07:19.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff069e1c640 10 monclient(hunting): authenticate will time out at 1694.807625s 2024-04-26T00:07:19.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff063fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7ff0640a1290 0x7ff0641d24f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:41612/0 (socket says 172.21.15.106:41612) 2024-04-26T00:07:19.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff063fff640 1 -- 172.21.15.106:0/180989147 learned_addr learned my addr 172.21.15.106:0/180989147 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2621744032 0 0) 0x7ff064071860 con 0x7ff0640a1290 2024-04-26T00:07:19.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff04bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff04bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff04bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff04bfff640 10 monclient(hunting): my global_id is 224540 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.276+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff050003530 con 0x7ff0640a1290 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 437966249 0 0) 0x7ff050003530 con 0x7ff0640a1290 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff064071860 con 0x7ff0640a1290 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff05c004eb0 con 0x7ff0640a1290 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): dump: 2024-04-26T00:07:19.274 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.275 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.276 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.276 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.276 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.276 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.276 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:19.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3041951705 0 0) 0x7ff064071860 con 0x7ff0640a1290 2024-04-26T00:07:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.106:6792/0 conn(0x7ff06409f770 legacy=0x7ff06413a8c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.106:6790/0 conn(0x7ff06409fb70 legacy=0x7ff06413afd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 monclient: found mon.e 2024-04-26T00:07:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:19.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0640a1f00 con 0x7ff0640a1290 2024-04-26T00:07:19.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 5 monclient: authenticate success, global_id 224540 2024-04-26T00:07:19.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 10 monclient: _renew_subs 2024-04-26T00:07:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff06413b6e0 con 0x7ff0640a1290 2024-04-26T00:07:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 10 monclient: _renew_subs 2024-04-26T00:07:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:07:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff06413d0f0 con 0x7ff0640a1290 2024-04-26T00:07:19.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff05c005530 con 0x7ff0640a1290 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff05c002030 con 0x7ff0640a1290 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff061ffb640 4 set_mon_vals no callback set 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: dump: 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.280 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff0440065d0 con 0x7ff044002870 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff05c010620 con 0x7ff0640a1290 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7ff05c0456f0 con 0x7ff0640a1290 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142018685 0 0) 0x7ff0440065d0 con 0x7ff044002870 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient(hunting): my global_id is 224549 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff064071860 con 0x7ff044002870 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4082009541 0 0) 0x7ff064071860 con 0x7ff044002870 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0440065d0 con 0x7ff044002870 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff062ffd640 10 monclient: get_auth_request con 0x7ff050037840 auth_method 0 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff058001740 con 0x7ff044002870 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: dump: 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.283 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 16671721 0 0) 0x7ff0440065d0 con 0x7ff044002870 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff04400a160 con 0x7ff044002870 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff058001b50 con 0x7ff044002870 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.106:6793/0 conn(0x7ff044002870 legacy=0x7ff044004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.280+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.106:6793/0 conn(0x7ff044002870 legacy=0x7ff044004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:19.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff044009e10 con 0x7ff0440090f0 2024-04-26T00:07:19.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3687317910 0 0) 0x7ff044009e10 con 0x7ff0440090f0 2024-04-26T00:07:19.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient(hunting): my global_id is 224558 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0440065d0 con 0x7ff0440090f0 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 860723834 0 0) 0x7ff0440065d0 con 0x7ff0440090f0 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff044009e10 con 0x7ff0440090f0 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff058004d20 con 0x7ff0440090f0 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient: dump: 2024-04-26T00:07:19.287 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.288 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.288 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.288 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.288 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.288 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.288 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.288 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1052806258 0 0) 0x7ff044009e10 con 0x7ff0440090f0 2024-04-26T00:07:19.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff04400c390 con 0x7ff0440090f0 2024-04-26T00:07:19.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7691 (unknown 0 0 526096335) 0x7ff058007090 con 0x7ff0440090f0 2024-04-26T00:07:19.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:19.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:19.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.106:6793/0 conn(0x7ff0440090f0 legacy=0x7ff044009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff04bfff640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.106:6793/0 conn(0x7ff0440090f0 legacy=0x7ff044009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.290 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 84, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 152520, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:07:19.291 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.292 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.293 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:19.294 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.295 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.296 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:19.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.297 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:19.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.297 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:19.297 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:19.297 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.298 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.298 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.298 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:19.298 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.298 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.299 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.299 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.299 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.301 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.302 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:19.304 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.305 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.306 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:19.308 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.309 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.310 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.310 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:19.310 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:19.310 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.311 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.312 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.313 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.314 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.314 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:19.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.314 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:19.314 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:19.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.171:6812/722422047 conn(0x7ff050037840 legacy=0x7ff050039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 10 monclient: shutdown 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 >> v1:172.21.15.106:6793/0 conn(0x7ff0640a1290 legacy=0x7ff0641d24f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff063fff640 1 -- 172.21.15.106:0/180989147 reap_dead start 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff063fff640 1 -- 172.21.15.106:0/180989147 reap_dead start 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 shutdown_connections 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 >> 172.21.15.106:0/180989147 conn(0x7ff06406b210 msgr2=0x7ff0640a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 shutdown_connections 2024-04-26T00:07:19.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.288+0000 7ff069e1c640 1 -- 172.21.15.106:0/180989147 wait complete. 2024-04-26T00:07:19.318 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:07:19.318 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon f 2024-04-26T00:07:19.318 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:07:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: get_monmap_and_config 2024-04-26T00:07:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: monmap: 2024-04-26T00:07:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:19.454887+0000 2024-04-26T00:07:19.429 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:19.454887+0000 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.430 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.431 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 Processor -- start 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- start start 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: init 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: _add_conns ranks=[8,3,7,0,4,1,2,5,6] 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient(hunting): picked mon.noname-e con 0x7f986c134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient(hunting): picked mon.noname-g con 0x7f986c0725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient(hunting): picked mon.noname-i con 0x7f986c13ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:19.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c071270 con 0x7f986c0725d0 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c0714e0 con 0x7f986c13ace0 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c0729f0 con 0x7f986c134820 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient(hunting): authenticate will time out at 1694.982242s 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986b7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f986c134820 0x7f986c134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:41632/0 (socket says 172.21.15.106:41632) 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986b7fe640 1 -- 172.21.15.106:0/2930067486 learned_addr learned my addr 172.21.15.106:0/2930067486 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2546396117 0 0) 0x7f986c0729f0 con 0x7f986c134820 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient(hunting): my global_id is 224567 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9858003530 con 0x7f986c134820 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4131366697 0 0) 0x7f9858003530 con 0x7f986c134820 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 >> v1:172.21.15.171:6792/0 conn(0x7f986c13ace0 legacy=0x7f986c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 >> v1:172.21.15.171:6790/0 conn(0x7f986c0725d0 legacy=0x7f986c1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 monclient: found mon.noname-e 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c0717c0 con 0x7f986c134820 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 5 monclient: authenticate success, global_id 224567 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9864001820 con 0x7f986c134820 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: dump: 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.444 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9864001b30 con 0x7f986c134820 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 1 -- 172.21.15.106:0/2930067486 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9864004bf0 con 0x7f986c134820 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 4 set_mon_vals no callback set 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f986a7fc640 10 monclient: dump: 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.446 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 10 monclient: shutdown 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- 172.21.15.106:0/2930067486 >> v1:172.21.15.106:6793/0 conn(0x7f986c134820 legacy=0x7f986c134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- 172.21.15.106:0/2930067486 shutdown_connections 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- 172.21.15.106:0/2930067486 >> 172.21.15.106:0/2930067486 conn(0x7f986c0a64e0 msgr2=0x7f986c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- 172.21.15.106:0/2930067486 shutdown_connections 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.452+0000 7f9871b5f640 1 -- 172.21.15.106:0/2930067486 wait complete. 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: monmap: 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:19.448 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 Processor -- start 2024-04-26T00:07:19.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 -- start start 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: init 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: _add_conns ranks=[2,5,1,0,4,3,7,6,8] 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient(hunting): picked mon.noname-b con 0x7f986c0725d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient(hunting): picked mon.noname-h con 0x7f986c134820 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient(hunting): picked mon.noname-f con 0x7f986c13ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f986b7fe640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f986c0725d0 legacy=0x7f986c134c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c135a20 con 0x7f986c13ace0 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c072c60 con 0x7f986c0725d0 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f986c136c20 con 0x7f986c134820 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient(hunting): authenticate will time out at 1694.985065s 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f986affd640 1 -- >> v1:172.21.15.171:6791/0 conn(0x7f986c134820 legacy=0x7f986c135310 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:19.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f986bfff640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f986c13ace0 0x7f986c1d2b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:46996/0 (socket says 172.21.15.106:46996) 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f986bfff640 1 -- 172.21.15.106:0/1123099075 learned_addr learned my addr 172.21.15.106:0/1123099075 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2554627579 0 0) 0x7f986c135a20 con 0x7f986c13ace0 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): my global_id is 224614 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f984c003530 con 0x7f986c13ace0 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1534298757 0 0) 0x7f984c003530 con 0x7f986c13ace0 2024-04-26T00:07:19.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f986c135a20 con 0x7f986c13ace0 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f985c001a00 con 0x7f986c13ace0 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): dump: 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.452 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 554615121 0 0) 0x7f986c135a20 con 0x7f986c13ace0 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.171:6791/0 conn(0x7f986c134820 legacy=0x7f986c135310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.106:6790/0 conn(0x7f986c0725d0 legacy=0x7f986c134c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 monclient: found mon.f 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f986c1374c0 con 0x7f986c13ace0 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 5 monclient: authenticate success, global_id 224614 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: _renew_subs 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f986c135d30 con 0x7f986c13ace0 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: _renew_subs 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f986c137ea0 con 0x7f986c13ace0 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f985c0038d0 con 0x7f986c13ace0 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f985c003e40 con 0x7f986c13ace0 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9869ffb640 4 set_mon_vals no callback set 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 10 monclient: dump: 2024-04-26T00:07:19.455 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.456 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f98500065d0 con 0x7f9850002870 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.456+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f985c003fe0 con 0x7f986c13ace0 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f985c0451b0 con 0x7f986c13ace0 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 914669294 0 0) 0x7f98500065d0 con 0x7f9850002870 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient(hunting): my global_id is 224623 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f986c135a20 con 0x7f9850002870 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f986affd640 10 monclient: get_auth_request con 0x7f984c0376a0 auth_method 0 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1557815240 0 0) 0x7f986c135a20 con 0x7f9850002870 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f98500065d0 con 0x7f9850002870 2024-04-26T00:07:19.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f98640017e0 con 0x7f9850002870 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient: dump: 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.458 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3611242600 0 0) 0x7f98500065d0 con 0x7f9850002870 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f985000a160 con 0x7f9850002870 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9864001220 con 0x7f9850002870 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:19.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.171:6789/0 conn(0x7f9850002870 legacy=0x7f9850004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.460+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.171:6789/0 conn(0x7f9850002870 legacy=0x7f9850004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.464+0000 7f9871b5f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.464+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9850009e30 con 0x7f98500090f0 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896123070 0 0) 0x7f9850009e30 con 0x7f98500090f0 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient(hunting): my global_id is 224632 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f98500065d0 con 0x7f98500090f0 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 611595681 0 0) 0x7f98500065d0 con 0x7f98500090f0 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9850009e30 con 0x7f98500090f0 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9864005000 con 0x7f98500090f0 2024-04-26T00:07:19.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient: dump: 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.462 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2279832728 0 0) 0x7f9850009e30 con 0x7f98500090f0 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f985000c3a0 con 0x7f98500090f0 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7691 (unknown 0 0 3481310990) 0x7f9864007280 con 0x7f98500090f0 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.171:6789/0 conn(0x7f98500090f0 legacy=0x7f9850009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9863fff640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.171:6789/0 conn(0x7f98500090f0 legacy=0x7f9850009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 84, 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 152705, 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.464 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.465 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.466 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:19.467 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.468 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:19.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:19.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.479 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.480 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:19.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:19.482 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:19.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.171:6812/722422047 conn(0x7f984c0376a0 legacy=0x7f984c039b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 10 monclient: shutdown 2024-04-26T00:07:19.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 >> v1:172.21.15.171:6789/0 conn(0x7f986c13ace0 legacy=0x7f986c1d2b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f986bfff640 1 -- 172.21.15.106:0/1123099075 reap_dead start 2024-04-26T00:07:19.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f986bfff640 1 -- 172.21.15.106:0/1123099075 reap_dead start 2024-04-26T00:07:19.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 shutdown_connections 2024-04-26T00:07:19.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 >> 172.21.15.106:0/1123099075 conn(0x7f986c0a64e0 msgr2=0x7f986c0a1520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 shutdown_connections 2024-04-26T00:07:19.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.468+0000 7f9871b5f640 1 -- 172.21.15.106:0/1123099075 wait complete. 2024-04-26T00:07:19.485 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:07:19.485 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2024-04-26T00:07:19.485 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:07:19.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.612+0000 7f0ae6dce640 10 monclient: get_monmap_and_config 2024-04-26T00:07:19.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.612+0000 7f0ae6dce640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.612+0000 7f0ae6dce640 10 monclient: monmap: 2024-04-26T00:07:19.592 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:19.618060+0000 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:19.618060+0000 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.593 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 Processor -- start 2024-04-26T00:07:19.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- start start 2024-04-26T00:07:19.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient: init 2024-04-26T00:07:19.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient: _add_conns ranks=[6,3,4,0,1,8,2,7,5] 2024-04-26T00:07:19.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient(hunting): picked mon.noname-d con 0x7f0ae0135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:19.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient(hunting): picked mon.noname-g con 0x7f0ae01353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:19.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient(hunting): picked mon.noname-c con 0x7f0ae013bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae006f2d0 con 0x7f0ae01353b0 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae0072330 con 0x7f0ae013bdf0 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae0072610 con 0x7f0ae0135870 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient(hunting): authenticate will time out at 1695.144977s 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae4b6a640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f0ae0135870 legacy=0x7f0ae0135c50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae536b640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f0ae013bdf0 legacy=0x7f0ae013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f0ae01353b0 0x7f0ae013a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:58740/0 (socket says 172.21.15.106:58740) 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adffff640 1 -- 172.21.15.106:0/3341753316 learned_addr learned my addr 172.21.15.106:0/3341753316 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2577707705 0 0) 0x7f0ae006f2d0 con 0x7f0ae01353b0 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient(hunting): my global_id is 214761 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ad0003530 con 0x7f0ae01353b0 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4082457958 0 0) 0x7f0ad0003530 con 0x7f0ae01353b0 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 >> v1:172.21.15.106:6792/0 conn(0x7f0ae0135870 legacy=0x7f0ae0135c50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 >> v1:172.21.15.106:6791/0 conn(0x7f0ae013bdf0 legacy=0x7f0ae013e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 monclient: found mon.noname-g 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae00a3260 con 0x7f0ae01353b0 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0acc0017c0 con 0x7f0ae01353b0 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: dump: 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.606 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 5 monclient: authenticate success, global_id 214761 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0acc001b20 con 0x7f0ae01353b0 2024-04-26T00:07:19.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 4 set_mon_vals no callback set 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 1 -- 172.21.15.106:0/3341753316 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0acc001d50 con 0x7f0ae01353b0 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0adf7fe640 10 monclient: dump: 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.608 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient: shutdown 2024-04-26T00:07:19.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- 172.21.15.106:0/3341753316 >> v1:172.21.15.171:6790/0 conn(0x7f0ae01353b0 legacy=0x7f0ae013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- 172.21.15.106:0/3341753316 shutdown_connections 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- 172.21.15.106:0/3341753316 >> 172.21.15.106:0/3341753316 conn(0x7f0ae00a64e0 msgr2=0x7f0ae00a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- 172.21.15.106:0/3341753316 shutdown_connections 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 -- 172.21.15.106:0/3341753316 wait complete. 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 10 monclient: monmap: 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.610 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.616+0000 7f0ae6dce640 1 Processor -- start 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 1 -- start start 2024-04-26T00:07:19.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient: init 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient: _add_conns ranks=[7,3,5,1,2,0,6,4,8] 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient(hunting): picked mon.noname-i con 0x7f0ae01353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient(hunting): picked mon.noname-g con 0x7f0ae0135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient(hunting): picked mon.noname-h con 0x7f0ae013bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae01350f0 con 0x7f0ae0135870 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae012e070 con 0x7f0ae013bdf0 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ae013ecd0 con 0x7f0ae01353b0 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient(hunting): authenticate will time out at 1695.148535s 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae536b640 1 -- >> v1:172.21.15.171:6791/0 conn(0x7f0ae013bdf0 legacy=0x7f0ae012d960 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:19.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0adffff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f0ae0135870 0x7f0ae012d250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:58746/0 (socket says 172.21.15.106:58746) 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0adffff640 1 -- 172.21.15.106:0/200945484 learned_addr learned my addr 172.21.15.106:0/200945484 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207528477 0 0) 0x7f0ae01350f0 con 0x7f0ae0135870 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): my global_id is 214770 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac4003530 con 0x7f0ae0135870 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441172092 0 0) 0x7f0ae013ecd0 con 0x7f0ae01353b0 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): my global_id is 146068 2024-04-26T00:07:19.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae01350f0 con 0x7f0ae01353b0 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 854782361 0 0) 0x7f0ac4003530 con 0x7f0ae0135870 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ae013ecd0 con 0x7f0ae0135870 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0acc001780 con 0x7f0ae0135870 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): dump: 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.614 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3932420616 0 0) 0x7f0ae01350f0 con 0x7f0ae01353b0 2024-04-26T00:07:19.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ac4003530 con 0x7f0ae01353b0 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ad4004120 con 0x7f0ae01353b0 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): dump: 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.616 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 424780138 0 0) 0x7f0ae013ecd0 con 0x7f0ae0135870 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6792/0 conn(0x7f0ae01353b0 legacy=0x7f0ae01349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6791/0 conn(0x7f0ae013bdf0 legacy=0x7f0ae012d960 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 monclient: found mon.g 2024-04-26T00:07:19.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ae0133bb0 con 0x7f0ae0135870 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 5 monclient: authenticate success, global_id 214770 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient: _renew_subs 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ae0133e90 con 0x7f0ae0135870 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient: _renew_subs 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:07:19.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ae01d5660 con 0x7f0ae0135870 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0acc001b20 con 0x7f0ae0135870 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0acc001cf0 con 0x7f0ae0135870 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0adeffd640 4 set_mon_vals no callback set 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient: dump: 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.619 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.620 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ac00065d0 con 0x7f0ac0002870 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0acc00ff50 con 0x7f0ae0135870 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f0acc0452e0 con 0x7f0ae0135870 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2556273859 0 0) 0x7f0ac00065d0 con 0x7f0ac0002870 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 10 monclient(hunting): my global_id is 214779 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.620+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae013ecd0 con 0x7f0ac0002870 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0ae536b640 10 monclient: get_auth_request con 0x7f0ac4037e40 auth_method 0 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 28028694 0 0) 0x7f0ae013ecd0 con 0x7f0ac0002870 2024-04-26T00:07:19.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ac00065d0 con 0x7f0ac0002870 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ad4004980 con 0x7f0ac0002870 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 10 monclient: dump: 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.622 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2125317828 0 0) 0x7f0ac00065d0 con 0x7f0ac0002870 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ac000a160 con 0x7f0ac0002870 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0ad4004d20 con 0x7f0ac0002870 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:19.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6790/0 conn(0x7f0ac0002870 legacy=0x7f0ac0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.624+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6790/0 conn(0x7f0ac0002870 legacy=0x7f0ac0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.628+0000 7f0ae6dce640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:19.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.628+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ac0009e50 con 0x7f0ac0009110 2024-04-26T00:07:19.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 479676333 0 0) 0x7f0ac0009e50 con 0x7f0ac0009110 2024-04-26T00:07:19.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient(hunting): my global_id is 214788 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ac00065d0 con 0x7f0ac0009110 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1316866034 0 0) 0x7f0ac00065d0 con 0x7f0ac0009110 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ac0009e50 con 0x7f0ac0009110 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ad4005500 con 0x7f0ac0009110 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient: dump: 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.626 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.627 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4098335802 0 0) 0x7f0ac0009e50 con 0x7f0ac0009110 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ac000c3e0 con 0x7f0ac0009110 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7861 (unknown 0 0 3211653504) 0x7f0ad40068c0 con 0x7f0ac0009110 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6790/0 conn(0x7f0ac0009110 legacy=0x7f0ac00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0add7fa640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6790/0 conn(0x7f0ac0009110 legacy=0x7f0ac00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.628 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 84, 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 270055, 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:19.629 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.630 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.631 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:19.632 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:19.633 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.634 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.636 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.637 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:19.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.639 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.640 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:19.640 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.640 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.642 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.643 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.644 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.645 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.646 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.647 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.648 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.649 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.650 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:19.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:19.652 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6812/722422047 conn(0x7f0ac4037e40 legacy=0x7f0ac403a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 10 monclient: shutdown 2024-04-26T00:07:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 >> v1:172.21.15.171:6790/0 conn(0x7f0ae0135870 legacy=0x7f0ae012d250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae536b640 1 -- 172.21.15.106:0/200945484 reap_dead start 2024-04-26T00:07:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae536b640 1 -- 172.21.15.106:0/200945484 reap_dead start 2024-04-26T00:07:19.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 shutdown_connections 2024-04-26T00:07:19.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 >> 172.21.15.106:0/200945484 conn(0x7f0ae00a64e0 msgr2=0x7f0ae00a0740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 shutdown_connections 2024-04-26T00:07:19.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.632+0000 7f0ae6dce640 1 -- 172.21.15.106:0/200945484 wait complete. 2024-04-26T00:07:19.655 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:07:19.655 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon i 2024-04-26T00:07:19.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.796+0000 7f2123abd640 10 monclient: get_monmap_and_config 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.796+0000 7f2123abd640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.796+0000 7f2123abd640 10 monclient: monmap: 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:07:19.802308+0000 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:07:19.802308+0000 2024-04-26T00:07:19.776 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.777 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 Processor -- start 2024-04-26T00:07:19.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- start start 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: init 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: _add_conns ranks=[6,0,5,7,8,4,3,1,2] 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient(hunting): picked mon.noname-d con 0x7f211c134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient(hunting): picked mon.noname-a con 0x7f211c0a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient(hunting): picked mon.noname-h con 0x7f211c13e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c06dd40 con 0x7f211c0a4820 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c0a2b10 con 0x7f211c13e200 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2121859640 1 -- >> v1:172.21.15.106:6792/0 conn(0x7f211c134970 legacy=0x7f211c134d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6792/0 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c0a2df0 con 0x7f211c134970 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient(hunting): authenticate will time out at 1695.329595s 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2121058640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f211c0a4820 0x7f211c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40626/0 (socket says 172.21.15.106:40626) 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2121058640 1 -- 172.21.15.106:0/1740302247 learned_addr learned my addr 172.21.15.106:0/1740302247 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f212205a640 1 -- 172.21.15.106:0/1740302247 >> v1:172.21.15.171:6791/0 conn(0x7f211c13e200 legacy=0x7f211c1405f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107484239 0 0) 0x7f211c06dd40 con 0x7f211c0a4820 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient(hunting): my global_id is 7929 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2108003530 con 0x7f211c0a4820 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1322549301 0 0) 0x7f2108003530 con 0x7f211c0a4820 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 >> v1:172.21.15.106:6792/0 conn(0x7f211c134970 legacy=0x7f211c134d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 >> v1:172.21.15.171:6791/0 conn(0x7f211c13e200 legacy=0x7f211c1405f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 monclient: found mon.noname-a 2024-04-26T00:07:19.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c0a30d0 con 0x7f211c0a4820 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f210c0017c0 con 0x7f211c0a4820 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 5 monclient: authenticate success, global_id 7929 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: dump: 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.787 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f210c001ab0 con 0x7f211c0a4820 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: get_monmap_and_config success 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 1 -- 172.21.15.106:0/1740302247 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f210c004bf0 con 0x7f211c0a4820 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 4 set_mon_vals no callback set 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2120857640 10 monclient: dump: 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.789 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: shutdown 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- 172.21.15.106:0/1740302247 >> v1:172.21.15.106:6789/0 conn(0x7f211c0a4820 legacy=0x7f211c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- 172.21.15.106:0/1740302247 shutdown_connections 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- 172.21.15.106:0/1740302247 >> 172.21.15.106:0/1740302247 conn(0x7f211c0a9e20 msgr2=0x7f211c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- 172.21.15.106:0/1740302247 shutdown_connections 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- 172.21.15.106:0/1740302247 wait complete. 2024-04-26T00:07:19.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: build_initial_monmap 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: monmap: 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:07:19.791 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 Processor -- start 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 1 -- start start 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.800+0000 7f2123abd640 10 monclient: init 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient: _reopen_session rank -1 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient: _add_conns ranks=[7,4,5,2,8,0,1,3,6] 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient(hunting): picked mon.noname-i con 0x7f211c0a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient(hunting): picked mon.noname-c con 0x7f211c134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient(hunting): picked mon.noname-h con 0x7f211c13e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c13be20 con 0x7f211c134970 2024-04-26T00:07:19.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c1396d0 con 0x7f211c13e200 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f211c139b50 con 0x7f211c0a4820 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient(hunting): _renew_subs 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2121058640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f211c134970 legacy=0x7f211c138fc0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient(hunting): authenticate will time out at 1695.332299s 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f212205a640 1 -- >> v1:172.21.15.171:6791/0 conn(0x7f211c13e200 legacy=0x7f211c1d45e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6791/0 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2121859640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f211c0a4820 0x7f211c1388b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:54652/0 (socket says 172.21.15.106:54652) 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2121859640 1 -- 172.21.15.106:0/457915693 learned_addr learned my addr 172.21.15.106:0/457915693 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321006745 0 0) 0x7f211c139b50 con 0x7f211c0a4820 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): my global_id is 146077 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2100003530 con 0x7f211c0a4820 2024-04-26T00:07:19.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2682499891 0 0) 0x7f2100003530 con 0x7f211c0a4820 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f211c139b50 con 0x7f211c0a4820 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2118005470 con 0x7f211c0a4820 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): dump: 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.794 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 686495181 0 0) 0x7f211c139b50 con 0x7f211c0a4820 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.171:6791/0 conn(0x7f211c13e200 legacy=0x7f211c1d45e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.106:6791/0 conn(0x7f211c134970 legacy=0x7f211c138fc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: _finish_hunting 0 2024-04-26T00:07:19.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 monclient: found mon.i 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f211c0a1e00 con 0x7f211c0a4820 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: _finish_auth 0 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: _check_auth_tickets 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 5 monclient: authenticate success, global_id 146077 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient: _renew_subs 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f211c0a1a40 con 0x7f211c0a4820 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient: _renew_subs 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f211c137a20 con 0x7f211c0a4820 2024-04-26T00:07:19.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2118004030 con 0x7f211c0a4820 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21180045a0 con 0x7f211c0a4820 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2113fff640 4 set_mon_vals no callback set 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient: dump: 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.797 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f21040065d0 con 0x7f2104002870 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f21180047c0 con 0x7f211c0a4820 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(253..253 src has 228..253) ==== 6817+0+0 (unknown 3543751760 0 0) 0x7f2118045350 con 0x7f211c0a4820 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626554850 0 0) 0x7f21040065d0 con 0x7f2104002870 2024-04-26T00:07:19.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 10 monclient(hunting): my global_id is 146086 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f211c139b50 con 0x7f2104002870 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f212205a640 10 monclient: get_auth_request con 0x7f2100037790 auth_method 0 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.804+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3653178249 0 0) 0x7f211c139b50 con 0x7f2104002870 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21040065d0 con 0x7f2104002870 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f210c001220 con 0x7f2104002870 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 10 monclient: dump: 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.799 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3939738810 0 0) 0x7f21040065d0 con 0x7f2104002870 2024-04-26T00:07:19.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f210400a160 con 0x7f2104002870 2024-04-26T00:07:19.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f210c001440 con 0x7f2104002870 2024-04-26T00:07:19.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:07:19.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:07:19.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.171:6792/0 conn(0x7f2104002870 legacy=0x7f2104004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.808+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.171:6792/0 conn(0x7f2104002870 legacy=0x7f2104004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.812+0000 7f2123abd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.812+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2104009e30 con 0x7f21040090f0 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3096610594 0 0) 0x7f2104009e30 con 0x7f21040090f0 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient(hunting): _negotiate 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient(hunting): my global_id is 146095 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21040065d0 con 0x7f21040090f0 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1104556081 0 0) 0x7f21040065d0 con 0x7f21040090f0 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2104009e30 con 0x7f21040090f0 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f210c0017e0 con 0x7f21040090f0 2024-04-26T00:07:19.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient: dump: 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:07:19.804 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3061360424 0 0) 0x7f2104009e30 con 0x7f21040090f0 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f210400c3a0 con 0x7f21040090f0 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7521 (unknown 0 0 2094904062) 0x7f210c007480 con 0x7f21040090f0 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.171:6792/0 conn(0x7f21040090f0 legacy=0x7f2104009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f21127fc640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.171:6792/0 conn(0x7f21040090f0 legacy=0x7f2104009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 84, 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 503349, 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:07:19.806 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.807 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.808 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:07:19.809 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:07:19.810 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.811 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:07:19.812 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:07:19.813 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:07:19.814 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:07:19.816 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.818 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:07:19.820 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:07:19.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.822 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:07:19.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:07:19.824 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:07:19.824 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.171:6812/722422047 conn(0x7f2100037790 legacy=0x7f2100039c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 10 monclient: shutdown 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 >> v1:172.21.15.171:6792/0 conn(0x7f211c0a4820 legacy=0x7f211c1388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f212205a640 1 -- 172.21.15.106:0/457915693 reap_dead start 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f212205a640 1 -- 172.21.15.106:0/457915693 reap_dead start 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 shutdown_connections 2024-04-26T00:07:19.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 >> 172.21.15.106:0/457915693 conn(0x7f211c0a9e20 msgr2=0x7f211c1308a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:07:19.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 shutdown_connections 2024-04-26T00:07:19.826 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:07:19.816+0000 7f2123abd640 1 -- 172.21.15.106:0/457915693 wait complete. 2024-04-26T00:07:19.826 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:07:19.826 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-26T00:08:37.244 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:08:37.245 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:08:37.245 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:08:37.245 INFO:tasks.workunit.client.0.smithi171.stderr:+ c=''\''allow command service with prefix=list, allow command quorum_status'\''' 2024-04-26T00:08:37.245 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph auth get-or-create client.bar mon '\''allow command service with prefix=list, allow command quorum_status'\'' > /tmp/cephtest-mon-caps-madness.bar.keyring' 0 2024-04-26T00:08:37.245 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph auth get-or-create client.bar mon '\''allow command service with prefix=list, allow command quorum_status'\'' > /tmp/cephtest-mon-caps-madness.bar.keyring' 2024-04-26T00:08:37.245 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=0 2024-04-26T00:08:37.245 INFO:tasks.workunit.client.0.smithi171.stdout:ceph auth get-or-create client.bar mon 'allow command service with prefix=list, allow command quorum_status' > /tmp/cephtest-mon-caps-madness.bar.keyring 2024-04-26T00:08:37.246 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph auth get-or-create client.bar mon ''\''allow' command service with prefix=list, allow command 'quorum_status'\''' '>' /tmp/cephtest-mon-caps-madness.bar.keyring 2024-04-26T00:08:37.246 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph auth get-or-create client.bar mon ''\''allow' command service with prefix=list, allow command 'quorum_status'\''' '>' /tmp/cephtest-mon-caps-madness.bar.keyring 2024-04-26T00:08:40.756 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=0 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 0 -ne 0 ]] 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status' 0 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status' 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=0 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status 2024-04-26T00:08:40.757 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status 2024-04-26T00:08:41.265 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=0 2024-04-26T00:08:41.265 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 0 -ne 0 ]] 2024-04-26T00:08:41.265 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:08:41.265 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth ls' 13 2024-04-26T00:08:41.265 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth ls' 2024-04-26T00:08:41.265 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:08:41.266 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth ls 2024-04-26T00:08:41.266 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth ls 2024-04-26T00:08:41.266 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth ls 2024-04-26T00:08:41.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:08:41.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:08:41.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:08:41.616 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth export' 13 2024-04-26T00:08:41.617 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth export' 2024-04-26T00:08:41.617 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:08:41.617 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth export 2024-04-26T00:08:41.617 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth export 2024-04-26T00:08:41.617 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth export 2024-04-26T00:08:44.992 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:08:44.992 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:08:44.992 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:08:44.993 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth del client.foo' 13 2024-04-26T00:08:44.993 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth del client.foo' 2024-04-26T00:08:44.993 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:08:44.993 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth del client.foo 2024-04-26T00:08:44.993 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth del client.foo 2024-04-26T00:08:44.993 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar auth del client.foo 2024-04-26T00:08:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:08:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:08:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:08:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar osd dump' 13 2024-04-26T00:08:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar osd dump' 2024-04-26T00:08:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:08:45.346 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar osd dump 2024-04-26T00:08:45.347 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar osd dump 2024-04-26T00:08:45.347 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar osd dump 2024-04-26T00:08:45.624 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:08:45.624 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stderr:+ export CEPH_ARGS=--rados-mon-op-timeout=300 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stderr:+ CEPH_ARGS=--rados-mon-op-timeout=300 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar pg dump' 110 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar pg dump' 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=110 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar pg dump 2024-04-26T00:08:45.625 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar pg dump 2024-04-26T00:08:45.626 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar pg dump 2024-04-26T00:08:49.826 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-04-26T00:08:49.827 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2024-04-26T00:08:49.827 INFO:tasks.ceph.mon.h:Restarting daemon 2024-04-26T00:08:49.827 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-04-26T00:08:49.830 INFO:tasks.ceph.mon.h:Started 2024-04-26T00:08:49.830 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-04-26T00:08:49.831 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-04-26T00:08:49.831 INFO:tasks.ceph.mon.d:Restarting daemon 2024-04-26T00:08:49.831 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-04-26T00:08:49.834 INFO:tasks.ceph.mon.d:Started 2024-04-26T00:08:49.834 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T00:08:49.834 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-26T00:08:49.834 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T00:08:49.834 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T00:08:49.836 INFO:tasks.ceph.mon.c:Started 2024-04-26T00:08:49.836 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T00:08:49.836 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-26T00:08:49.837 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T00:08:49.837 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T00:08:49.839 INFO:tasks.ceph.mon.b:Started 2024-04-26T00:08:49.839 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:08:49.839 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:08:49.939 INFO:tasks.ceph.mon.d.smithi106.stderr:2024-04-26T00:08:49.959+0000 7fa25edf8c80 -1 mon.d@-1(???).log v0 log_external_backlog rewinding external_log_to from 454 -> 0 (sync_force? mon rebuild?) 2024-04-26T00:08:49.942 INFO:tasks.ceph.mon.h.smithi171.stderr:2024-04-26T00:08:49.964+0000 7f2d76daec80 -1 mon.h@-1(???).log v0 log_external_backlog rewinding external_log_to from 454 -> 0 (sync_force? mon rebuild?) 2024-04-26T00:08:49.943 INFO:tasks.ceph.mon.b.smithi106.stderr:2024-04-26T00:08:49.963+0000 7f40c205ec80 -1 mon.b@-1(???).log v0 log_external_backlog rewinding external_log_to from 454 -> 0 (sync_force? mon rebuild?) 2024-04-26T00:08:49.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient: get_monmap_and_config 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient: build_initial_monmap 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient: monmap: 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:49.995598+0000 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:49.995598+0000 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:49.969 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:49.970 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:49.970 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:49.970 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:49.970 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:49.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 1 Processor -- start 2024-04-26T00:08:49.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 1 -- start start 2024-04-26T00:08:49.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient: init 2024-04-26T00:08:49.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient: _add_conns ranks=[0,2,5,3,7,6,8,4,1] 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient(hunting): picked mon.noname-a con 0x7fd30c134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient(hunting): picked mon.noname-b con 0x7fd30c0a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient(hunting): picked mon.noname-h con 0x7fd30c13e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c06dd40 con 0x7fd30c134970 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c0a2b10 con 0x7fd30c0a4820 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd30bfff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd30c0a4820 0x7fd30c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:39732/0 (socket says 172.21.15.106:39732) 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd30bfff640 1 -- 172.21.15.106:0/3703945854 learned_addr learned my addr 172.21.15.106:0/3703945854 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 1 -- 172.21.15.106:0/3703945854 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c0a2df0 con 0x7fd30c13e200 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd312af9640 10 monclient(hunting): authenticate will time out at 1785.522731s 2024-04-26T00:08:49.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:49.991+0000 7fd310895640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd30c134970 0x7fd30c134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34738/0 (socket says 172.21.15.106:34738) 2024-04-26T00:08:52.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient(hunting): tick 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 1 monclient(hunting): continuing hunt 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 1 -- 172.21.15.106:0/3703945854 >> v1:172.21.15.171:6791/0 conn(0x7fd30c13e200 legacy=0x7fd30c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 1 -- 172.21.15.106:0/3703945854 >> v1:172.21.15.106:6790/0 conn(0x7fd30c0a4820 legacy=0x7fd30c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 1 -- 172.21.15.106:0/3703945854 >> v1:172.21.15.106:6789/0 conn(0x7fd30c134970 legacy=0x7fd30c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient: _add_conns ranks=[4,7,6,1,3,8] 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient(hunting): picked mon.noname-c con 0x7fd2ec0037f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient(hunting): picked mon.noname-i con 0x7fd2ec007480 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient(hunting): picked mon.noname-d con 0x7fd2ec00b1d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 1 -- 172.21.15.106:0/3703945854 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c0a30d0 con 0x7fd2ec0037f0 2024-04-26T00:08:52.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 1 -- 172.21.15.106:0/3703945854 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ec00ffe0 con 0x7fd2ec00b1d0 2024-04-26T00:08:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 1 -- 172.21.15.106:0/3703945854 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2ec011270 con 0x7fd2ec007480 2024-04-26T00:08:52.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:52.991+0000 7fd30a7fc640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:54.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.006+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479580600 0 0) 0x7fd2ec011270 con 0x7fd2ec007480 2024-04-26T00:08:54.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.006+0000 7fd30b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:54.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.006+0000 7fd30b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:54.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.006+0000 7fd30b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:54.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.006+0000 7fd30b7fe640 10 monclient(hunting): my global_id is 146230 2024-04-26T00:08:54.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.006+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2f8003530 con 0x7fd2ec007480 2024-04-26T00:08:54.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 306653310 0 0) 0x7fd2f8003530 con 0x7fd2ec007480 2024-04-26T00:08:54.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 >> v1:172.21.15.106:6792/0 conn(0x7fd2ec00b1d0 legacy=0x7fd2ec00d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:54.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 >> v1:172.21.15.106:6791/0 conn(0x7fd2ec0037f0 legacy=0x7fd2ec005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:54.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:08:54.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 monclient: found mon.noname-i 2024-04-26T00:08:54.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2ec012560 con 0x7fd2ec007480 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd2f4001800 con 0x7fd2ec007480 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd311096640 1 -- 172.21.15.106:0/3703945854 reap_dead start 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: dump: 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:54.999 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.000 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd312af9640 5 monclient: authenticate success, global_id 146230 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd312af9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd2f4001aa0 con 0x7fd2ec007480 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 1 -- 172.21.15.106:0/3703945854 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd2f4001cd0 con 0x7fd2ec007480 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd30b7fe640 10 monclient: dump: 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.001 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd312af9640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:55.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.018+0000 7fd312af9640 4 set_mon_vals no callback set 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 10 monclient: shutdown 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 1 -- 172.21.15.106:0/3703945854 >> v1:172.21.15.171:6792/0 conn(0x7fd2ec007480 legacy=0x7fd2ec009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 1 -- 172.21.15.106:0/3703945854 shutdown_connections 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 1 -- 172.21.15.106:0/3703945854 >> 172.21.15.106:0/3703945854 conn(0x7fd30c0a9e20 msgr2=0x7fd30c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 1 -- 172.21.15.106:0/3703945854 shutdown_connections 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 1 -- 172.21.15.106:0/3703945854 wait complete. 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 10 monclient: monmap: 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:55.004 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.022+0000 7fd312af9640 1 Processor -- start 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 1 -- start start 2024-04-26T00:08:55.005 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient: init 2024-04-26T00:08:55.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient: _add_conns ranks=[4,0,3,6,8,2,1,7,5] 2024-04-26T00:08:55.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient(hunting): picked mon.noname-c con 0x7fd2ec007480 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:55.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient(hunting): picked mon.noname-a con 0x7fd30c13d000 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:55.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient(hunting): picked mon.noname-g con 0x7fd30c1d2fa0 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c138de0 con 0x7fd30c13d000 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c1390c0 con 0x7fd30c1d2fa0 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd30c13d400 con 0x7fd2ec007480 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient(hunting): authenticate will time out at 1790.557734s 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd310895640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fd2ec007480 0x7fd30c13c8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:43500/0 (socket says 172.21.15.106:43500) 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd30bfff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd30c13d000 0x7fd30c1d1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:34754/0 (socket says 172.21.15.106:34754) 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd310895640 1 -- 172.21.15.106:0/2823817195 learned_addr learned my addr 172.21.15.106:0/2823817195 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2276061033 0 0) 0x7fd30c13d400 con 0x7fd2ec007480 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): my global_id is 254101 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2ec009020 con 0x7fd2ec007480 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254013129 0 0) 0x7fd30c1390c0 con 0x7fd30c1d2fa0 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): my global_id is 214896 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd30c13d400 con 0x7fd30c1d2fa0 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1533089432 0 0) 0x7fd2ec009020 con 0x7fd2ec007480 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd30c1390c0 con 0x7fd2ec007480 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3040019f0 con 0x7fd2ec007480 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): dump: 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.011 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:55.012 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3932412961 0 0) 0x7fd30c13d400 con 0x7fd30c1d2fa0 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd2ec009020 con 0x7fd30c1d2fa0 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd2fc001b50 con 0x7fd30c1d2fa0 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient(hunting): dump: 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.013 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1443583458 0 0) 0x7fd30c1390c0 con 0x7fd2ec007480 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 >> v1:172.21.15.171:6790/0 conn(0x7fd30c1d2fa0 legacy=0x7fd30c1d5390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 >> v1:172.21.15.106:6789/0 conn(0x7fd30c13d000 legacy=0x7fd30c1d1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 monclient: found mon.c 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd30c0a1e00 con 0x7fd2ec007480 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 5 monclient: authenticate success, global_id 254101 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient: _renew_subs 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd30c0a1a40 con 0x7fd2ec007480 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient: _renew_subs 2024-04-26T00:08:55.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd30c1334a0 con 0x7fd2ec007480 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd304004aa0 con 0x7fd2ec007480 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd304005010 con 0x7fd2ec007480 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd30affd640 4 set_mon_vals no callback set 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.026+0000 7fd3097fa640 10 monclient: dump: 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.016 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.030+0000 7fd312af9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.030+0000 7fd312af9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.030+0000 7fd312af9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.030+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f0005090 con 0x7fd2ec007480 2024-04-26T00:08:55.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.030+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd30400fdb0 con 0x7fd2ec007480 2024-04-26T00:08:55.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.030+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fd3040450d0 con 0x7fd2ec007480 2024-04-26T00:08:55.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.030+0000 7fd30bfff640 10 monclient: get_auth_request con 0x7fd2ec039430 auth_method 0 2024-04-26T00:08:55.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.034+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd3040156a0 con 0x7fd2ec007480 2024-04-26T00:08:55.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.034+0000 7fd3097fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.034+0000 7fd3097fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:55.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:08:55.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:08:55.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd2f0005380 con 0x7fd2ec007480 2024-04-26T00:08:55.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd3097fa640 1 -- 172.21.15.106:0/2823817195 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 543131621) 0x7fd304019350 con 0x7fd2ec007480 2024-04-26T00:08:55.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd3097fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:08:55.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd3097fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:55.249 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":88,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:08:55.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 >> v1:172.21.15.171:6812/722422047 conn(0x7fd2ec039430 legacy=0x7fd2ec03b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 10 monclient: shutdown 2024-04-26T00:08:55.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 >> v1:172.21.15.106:6791/0 conn(0x7fd2ec007480 legacy=0x7fd30c13c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 shutdown_connections 2024-04-26T00:08:55.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 >> 172.21.15.106:0/2823817195 conn(0x7fd30c0a9e20 msgr2=0x7fd30c1351e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 shutdown_connections 2024-04-26T00:08:55.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.270+0000 7fd312af9640 1 -- 172.21.15.106:0/2823817195 wait complete. 2024-04-26T00:08:55.265 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:08:55.265 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:08:55.265 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:08:55.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.406+0000 7f5b0de52640 10 monclient: get_monmap_and_config 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.406+0000 7f5b0de52640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.406+0000 7f5b0de52640 10 monclient: monmap: 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:55.413430+0000 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:55.413430+0000 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.387 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.388 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.388 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.388 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.388 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.388 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.388 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.388 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.406+0000 7f5b0de52640 1 Processor -- start 2024-04-26T00:08:55.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.406+0000 7f5b0de52640 1 -- start start 2024-04-26T00:08:55.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.406+0000 7f5b0de52640 10 monclient: init 2024-04-26T00:08:55.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: _add_conns ranks=[8,1,7,0,3,5,6,4,2] 2024-04-26T00:08:55.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): picked mon.noname-e con 0x7f5b08135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): picked mon.noname-f con 0x7f5b081353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): picked mon.noname-i con 0x7f5b0813bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0806f2d0 con 0x7f5b081353b0 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b08072330 con 0x7f5b0813bdf0 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b08072610 con 0x7f5b08135870 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): authenticate will time out at 1790.940570s 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b077fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f5b08135870 0x7f5b08135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:41080/0 (socket says 172.21.15.106:41080) 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b077fe640 1 -- 172.21.15.106:0/4239154042 learned_addr learned my addr 172.21.15.106:0/4239154042 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1847447184 0 0) 0x7f5b08072610 con 0x7f5b08135870 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient(hunting): my global_id is 224702 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af0003530 con 0x7f5b08135870 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2473256691 0 0) 0x7f5af0003530 con 0x7f5b08135870 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 >> v1:172.21.15.171:6792/0 conn(0x7f5b0813bdf0 legacy=0x7f5b0813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 >> v1:172.21.15.171:6789/0 conn(0x7f5b081353b0 legacy=0x7f5b0813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 monclient: found mon.noname-e 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b080a3260 con 0x7f5b08135870 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 5 monclient: authenticate success, global_id 224702 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5af8001800 con 0x7f5b08135870 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: dump: 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.399 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.400 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5af8001aa0 con 0x7f5b08135870 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 1 -- 172.21.15.106:0/4239154042 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5af8004bf0 con 0x7f5b08135870 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 4 set_mon_vals no callback set 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b067fc640 10 monclient: dump: 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.401 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.402 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: shutdown 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- 172.21.15.106:0/4239154042 >> v1:172.21.15.106:6793/0 conn(0x7f5b08135870 legacy=0x7f5b08135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- 172.21.15.106:0/4239154042 shutdown_connections 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- 172.21.15.106:0/4239154042 >> 172.21.15.106:0/4239154042 conn(0x7f5b080a64e0 msgr2=0x7f5b080a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- 172.21.15.106:0/4239154042 shutdown_connections 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- 172.21.15.106:0/4239154042 wait complete. 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: monmap: 2024-04-26T00:08:55.403 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.404 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 Processor -- start 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- start start 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: init 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient: _add_conns ranks=[5,6,3,0,2,4,8,7,1] 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): picked mon.noname-h con 0x7f5b081353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:55.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): picked mon.noname-d con 0x7f5b08135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): picked mon.noname-g con 0x7f5b0813bdf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b08070880 con 0x7f5b0813bdf0 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b08134a00 con 0x7f5b081353b0 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b0809e2d0 con 0x7f5b08135870 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b0de52640 10 monclient(hunting): authenticate will time out at 1790.943509s 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b06ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5b08135870 0x7f5b081342f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38074/0 (socket says 172.21.15.106:38074) 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5b06ffd640 1 -- 172.21.15.106:0/3163182110 learned_addr learned my addr 172.21.15.106:0/3163182110 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2795004574 0 0) 0x7f5b0809e2d0 con 0x7f5b08135870 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5aeffff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5aeffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5aeffff640 10 monclient(hunting): my global_id is 254103 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.410+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5af4003530 con 0x7f5b08135870 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3226727424 0 0) 0x7f5af4003530 con 0x7f5b08135870 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b0809e2d0 con 0x7f5b08135870 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5afc001ac0 con 0x7f5b08135870 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): dump: 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.408 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1779624394 0 0) 0x7f5b0809e2d0 con 0x7f5b08135870 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.171:6791/0 conn(0x7f5b081353b0 legacy=0x7f5b08133be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.171:6790/0 conn(0x7f5b0813bdf0 legacy=0x7f5b081d49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 monclient: found mon.d 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b0809f930 con 0x7f5b08135870 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 5 monclient: authenticate success, global_id 254103 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 10 monclient: _renew_subs 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b080705a0 con 0x7f5b08135870 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 10 monclient: _renew_subs 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b0813ba80 con 0x7f5b08135870 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5afc0038d0 con 0x7f5b08135870 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5afc003e40 con 0x7f5b08135870 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b05ffb640 4 set_mon_vals no callback set 2024-04-26T00:08:55.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:55.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: dump: 2024-04-26T00:08:55.412 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.412 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.412 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.412 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.412 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.413 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.414 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.414 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5afc004060 con 0x7f5b08135870 2024-04-26T00:08:55.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ae80065d0 con 0x7f5ae8002870 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5afc045260 con 0x7f5b08135870 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 279318180 0 0) 0x7f5ae80065d0 con 0x7f5ae8002870 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient(hunting): my global_id is 8100 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b0809e2d0 con 0x7f5ae8002870 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5b07fff640 10 monclient: get_auth_request con 0x7f5af40378a0 auth_method 0 2024-04-26T00:08:55.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2492399278 0 0) 0x7f5b0809e2d0 con 0x7f5ae8002870 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ae80065d0 con 0x7f5ae8002870 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5af8004bf0 con 0x7f5ae8002870 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: dump: 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.417 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.417 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.417 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.417 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 722777835 0 0) 0x7f5ae80065d0 con 0x7f5ae8002870 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5ae800a160 con 0x7f5ae8002870 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5af8001640 con 0x7f5ae8002870 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.106:6789/0 conn(0x7f5ae8002870 legacy=0x7f5ae8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.414+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.106:6789/0 conn(0x7f5ae8002870 legacy=0x7f5ae8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.418+0000 7f5b0de52640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:55.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.418+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5ae8009e30 con 0x7f5ae80090f0 2024-04-26T00:08:55.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647219937 0 0) 0x7f5ae8009e30 con 0x7f5ae80090f0 2024-04-26T00:08:55.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient(hunting): my global_id is 8109 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ae80065d0 con 0x7f5ae80090f0 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1555009426 0 0) 0x7f5ae80065d0 con 0x7f5ae80090f0 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5ae8009e30 con 0x7f5ae80090f0 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5af8005000 con 0x7f5ae80090f0 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient: dump: 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.422 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 97204572 0 0) 0x7f5ae8009e30 con 0x7f5ae80090f0 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5ae800c3a0 con 0x7f5ae80090f0 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7737 (unknown 0 0 4098374214) 0x7f5af8007220 con 0x7f5ae80090f0 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:55.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.106:6789/0 conn(0x7f5ae80090f0 legacy=0x7f5ae8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5aeffff640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.106:6789/0 conn(0x7f5ae80090f0 legacy=0x7f5ae8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 853982, 2024-04-26T00:08:55.424 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:55.425 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:55.426 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:55.427 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:55.428 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:55.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.430 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.433 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.434 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.443 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.446 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:55.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.449 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.449 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.449 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 5 2024-04-26T00:08:55.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.449 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:55.450 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:55.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.171:6812/722422047 conn(0x7f5af40378a0 legacy=0x7f5af4039d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 10 monclient: shutdown 2024-04-26T00:08:55.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 >> v1:172.21.15.106:6792/0 conn(0x7f5b08135870 legacy=0x7f5b081342f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b07fff640 1 -- 172.21.15.106:0/3163182110 reap_dead start 2024-04-26T00:08:55.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b07fff640 1 -- 172.21.15.106:0/3163182110 reap_dead start 2024-04-26T00:08:55.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 shutdown_connections 2024-04-26T00:08:55.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 >> 172.21.15.106:0/3163182110 conn(0x7f5b080a64e0 msgr2=0x7f5b0812e490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 shutdown_connections 2024-04-26T00:08:55.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.422+0000 7f5b0de52640 1 -- 172.21.15.106:0/3163182110 wait complete. 2024-04-26T00:08:55.452 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:55.452 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:08:55.453 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:08:55.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.586+0000 7f7867b1c640 10 monclient: get_monmap_and_config 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.586+0000 7f7867b1c640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient: monmap: 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:55.594360+0000 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:55.594360+0000 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.568 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.569 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 Processor -- start 2024-04-26T00:08:55.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- start start 2024-04-26T00:08:55.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient: init 2024-04-26T00:08:55.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient: _add_conns ranks=[1,2,0,7,4,8,5,3,6] 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient(hunting): picked mon.noname-f con 0x7f786009fe70 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient(hunting): picked mon.noname-b con 0x7f78600a0250 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient(hunting): picked mon.noname-a con 0x7f786013ad60 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7860131ac0 con 0x7f786013ad60 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786009bf70 con 0x7f786009fe70 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f78600a0670 con 0x7f78600a0250 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient(hunting): authenticate will time out at 1791.121702s 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78650b7640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f78600a0250 0x7f7860139640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34764/0 (socket says 172.21.15.106:34764) 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78660b9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f786013ad60 0x7f786013d150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42804/0 (socket says 172.21.15.106:42804) 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78650b7640 1 -- 172.21.15.106:0/2012623342 learned_addr learned my addr 172.21.15.106:0/2012623342 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896586263 0 0) 0x7f7860131ac0 con 0x7f786013ad60 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): my global_id is 8118 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f784c003530 con 0x7f786013ad60 2024-04-26T00:08:55.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1353059413 0 0) 0x7f78600a0670 con 0x7f78600a0250 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient(hunting): my global_id is 254099 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7860131ac0 con 0x7f78600a0250 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 744415773 0 0) 0x7f784c003530 con 0x7f786013ad60 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 >> v1:172.21.15.106:6790/0 conn(0x7f78600a0250 legacy=0x7f7860139640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 >> v1:172.21.15.171:6789/0 conn(0x7f786009fe70 legacy=0x7f78601313b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 monclient: found mon.noname-a 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f786006c580 con 0x7f786013ad60 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 5 monclient: authenticate success, global_id 8118 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7858001b40 con 0x7f786013ad60 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:55.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: dump: 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.582 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7858001e60 con 0x7f786013ad60 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:55.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 4 set_mon_vals no callback set 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 1 -- 172.21.15.106:0/2012623342 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7858004eb0 con 0x7f786013ad60 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f78648b6640 10 monclient: dump: 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.584 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 10 monclient: shutdown 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- 172.21.15.106:0/2012623342 >> v1:172.21.15.106:6789/0 conn(0x7f786013ad60 legacy=0x7f786013d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- 172.21.15.106:0/2012623342 shutdown_connections 2024-04-26T00:08:55.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- 172.21.15.106:0/2012623342 >> 172.21.15.106:0/2012623342 conn(0x7f78600a6220 msgr2=0x7f78600a6600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- 172.21.15.106:0/2012623342 shutdown_connections 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.590+0000 7f7867b1c640 1 -- 172.21.15.106:0/2012623342 wait complete. 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: monmap: 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:55.586 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.587 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 Processor -- start 2024-04-26T00:08:55.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 -- start start 2024-04-26T00:08:55.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: init 2024-04-26T00:08:55.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: _add_conns ranks=[5,3,4,1,7,8,2,0,6] 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient(hunting): picked mon.noname-h con 0x7f786009fe70 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient(hunting): picked mon.noname-g con 0x7f78600a0250 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient(hunting): picked mon.noname-c con 0x7f786013ad60 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786009bd60 con 0x7f78600a0250 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7860135f80 con 0x7f786013ad60 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f786009c1b0 con 0x7f786009fe70 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient(hunting): authenticate will time out at 1791.124894s 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78660b9640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f786013ad60 0x7f78601d0520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40196/0 (socket says 172.21.15.106:40196) 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78660b9640 1 -- 172.21.15.106:0/2648064939 learned_addr learned my addr 172.21.15.106:0/2648064939 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 664750958 0 0) 0x7f7860135f80 con 0x7f786013ad60 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): my global_id is 254110 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7844003530 con 0x7f786013ad60 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3654693585 0 0) 0x7f7844003530 con 0x7f786013ad60 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7860135f80 con 0x7f786013ad60 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7858001b00 con 0x7f786013ad60 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): dump: 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.590 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1007535737 0 0) 0x7f7860135f80 con 0x7f786013ad60 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.171:6791/0 conn(0x7f786009fe70 legacy=0x7f78601c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.171:6790/0 conn(0x7f78600a0250 legacy=0x7f78601397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 monclient: found mon.c 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7860072160 con 0x7f786013ad60 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 5 monclient: authenticate success, global_id 254110 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: _renew_subs 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7860136260 con 0x7f786013ad60 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: _renew_subs 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f786013a090 con 0x7f786013ad60 2024-04-26T00:08:55.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7858001540 con 0x7f786013ad60 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78580053d0 con 0x7f786013ad60 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7857fff640 4 set_mon_vals no callback set 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: dump: 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.593 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7858010170 con 0x7f786013ad60 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f78480065d0 con 0x7f7848002870 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f7858045530 con 0x7f786013ad60 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 607118467 0 0) 0x7f78480065d0 con 0x7f7848002870 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient(hunting): my global_id is 254108 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7860135f80 con 0x7f7848002870 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78650b7640 10 monclient: get_auth_request con 0x7f78440378b0 auth_method 0 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2240673314 0 0) 0x7f7860135f80 con 0x7f7848002870 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f78480065d0 con 0x7f7848002870 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f78500017f0 con 0x7f7848002870 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: dump: 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.595 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3664572784 0 0) 0x7f78480065d0 con 0x7f7848002870 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f784800a160 con 0x7f7848002870 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7850001c20 con 0x7f7848002870 2024-04-26T00:08:55.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:55.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.106:6790/0 conn(0x7f7848002870 legacy=0x7f7848004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.594+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.106:6790/0 conn(0x7f7848002870 legacy=0x7f7848004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:55.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7848009e50 con 0x7f7848009110 2024-04-26T00:08:55.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910606609 0 0) 0x7f7848009e50 con 0x7f7848009110 2024-04-26T00:08:55.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient(hunting): my global_id is 254117 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78480065d0 con 0x7f7848009110 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1659557591 0 0) 0x7f78480065d0 con 0x7f7848009110 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7848009e50 con 0x7f7848009110 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7850003b50 con 0x7f7848009110 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient: dump: 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.599 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2978573613 0 0) 0x7f7848009e50 con 0x7f7848009110 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f784800c3e0 con 0x7f7848009110 2024-04-26T00:08:55.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 25597384) 0x7f7850003df0 con 0x7f7848009110 2024-04-26T00:08:55.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:55.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:55.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.106:6790/0 conn(0x7f7848009110 legacy=0x7f78480095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78567fc640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.106:6790/0 conn(0x7f7848009110 legacy=0x7f78480095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 5659, 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:55.602 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.603 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.604 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:55.605 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:55.606 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.607 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:55.608 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.609 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.610 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:55.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.616 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:55.618 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.619 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:55.620 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.171:6812/722422047 conn(0x7f78440378b0 legacy=0x7f7844039d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 10 monclient: shutdown 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 >> v1:172.21.15.106:6791/0 conn(0x7f786013ad60 legacy=0x7f78601d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78660b9640 1 -- 172.21.15.106:0/2648064939 reap_dead start 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f78660b9640 1 -- 172.21.15.106:0/2648064939 reap_dead start 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 shutdown_connections 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 >> 172.21.15.106:0/2648064939 conn(0x7f78600a6220 msgr2=0x7f78600a2cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 shutdown_connections 2024-04-26T00:08:55.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.602+0000 7f7867b1c640 1 -- 172.21.15.106:0/2648064939 wait complete. 2024-04-26T00:08:55.623 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:55.623 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:08:55.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:08:55.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.750+0000 7f3b3bab3640 10 monclient: get_monmap_and_config 2024-04-26T00:08:55.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.750+0000 7f3b3bab3640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.750+0000 7f3b3bab3640 10 monclient: monmap: 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:55.758222+0000 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:55.758222+0000 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.732 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.733 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.733 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 Processor -- start 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- start start 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: init 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: _add_conns ranks=[4,0,6,2,1,5,7,8,3] 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient(hunting): picked mon.noname-c con 0x7f3b34137c40 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient(hunting): picked mon.noname-a con 0x7f3b3409fca0 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient(hunting): picked mon.noname-d con 0x7f3b34137570 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3406ee10 con 0x7f3b3409fca0 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b340a2220 con 0x7f3b34137c40 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b3406f0f0 con 0x7f3b34137570 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient(hunting): authenticate will time out at 1791.285385s 2024-04-26T00:08:55.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3984f640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f3b34137c40 0x7f3b340a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40202/0 (socket says 172.21.15.106:40202) 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3984f640 1 -- 172.21.15.106:0/2505510587 learned_addr learned my addr 172.21.15.106:0/2505510587 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1705295652 0 0) 0x7f3b340a2220 con 0x7f3b34137c40 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): my global_id is 254119 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b20003530 con 0x7f3b34137c40 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001157389 0 0) 0x7f3b3406f0f0 con 0x7f3b34137570 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): my global_id is 254112 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b340a2220 con 0x7f3b34137570 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1591879120 0 0) 0x7f3b24001050 con 0x7f3b3409fca0 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient(hunting): my global_id is 8127 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b3406f0f0 con 0x7f3b3409fca0 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 589067300 0 0) 0x7f3b20003530 con 0x7f3b34137c40 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 >> v1:172.21.15.106:6792/0 conn(0x7f3b34137570 legacy=0x7f3b341408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 >> v1:172.21.15.106:6789/0 conn(0x7f3b3409fca0 legacy=0x7f3b340a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 monclient: found mon.noname-c 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b3406f3d0 con 0x7f3b34137c40 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 5 monclient: authenticate success, global_id 254119 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b300017c0 con 0x7f3b34137c40 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: dump: 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.745 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:55.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b30001a70 con 0x7f3b34137c40 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 4 set_mon_vals no callback set 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 1 -- 172.21.15.106:0/2505510587 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b30004bf0 con 0x7f3b34137c40 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3884d640 10 monclient: dump: 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.747 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: shutdown 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2505510587 >> v1:172.21.15.106:6791/0 conn(0x7f3b34137c40 legacy=0x7f3b340a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2505510587 shutdown_connections 2024-04-26T00:08:55.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2505510587 >> 172.21.15.106:0/2505510587 conn(0x7f3b340a64e0 msgr2=0x7f3b340a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2505510587 shutdown_connections 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2505510587 wait complete. 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: monmap: 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.749 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 Processor -- start 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 1 -- start start 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.754+0000 7f3b3bab3640 10 monclient: init 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient: _add_conns ranks=[1,0,2,5,4,8,3,7,6] 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient(hunting): picked mon.noname-f con 0x7f3b3409fca0 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient(hunting): picked mon.noname-a con 0x7f3b34137570 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient(hunting): picked mon.noname-b con 0x7f3b34137c40 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:55.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b341248c0 con 0x7f3b34137570 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b34123130 con 0x7f3b3409fca0 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b34072970 con 0x7f3b34137c40 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient(hunting): authenticate will time out at 1791.288438s 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3904e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3b34137570 0x7f3b341d1590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42818/0 (socket says 172.21.15.106:42818) 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3904e640 1 -- 172.21.15.106:0/2236697183 learned_addr learned my addr 172.21.15.106:0/2236697183 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320531944 0 0) 0x7f3b341248c0 con 0x7f3b34137570 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): my global_id is 8136 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b18003530 con 0x7f3b34137570 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728503050 0 0) 0x7f3b34072970 con 0x7f3b34137c40 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): my global_id is 254126 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b341248c0 con 0x7f3b34137c40 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2586544915 0 0) 0x7f3b18003530 con 0x7f3b34137570 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b34072970 con 0x7f3b34137570 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b24001680 con 0x7f3b34137570 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): dump: 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.752 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2099533880 0 0) 0x7f3b341248c0 con 0x7f3b34137c40 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b18003530 con 0x7f3b34137c40 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b2c0017a0 con 0x7f3b34137c40 2024-04-26T00:08:55.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): dump: 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.754 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2197340497 0 0) 0x7f3b34123130 con 0x7f3b3409fca0 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): my global_id is 224767 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b341248c0 con 0x7f3b3409fca0 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 219017009 0 0) 0x7f3b34072970 con 0x7f3b34137570 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.106:6790/0 conn(0x7f3b34137c40 legacy=0x7f3b341d4cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.171:6789/0 conn(0x7f3b3409fca0 legacy=0x7f3b341cc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 monclient: found mon.a 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b340724d0 con 0x7f3b34137570 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 5 monclient: authenticate success, global_id 8136 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient: _renew_subs 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3b341245e0 con 0x7f3b34137570 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient: _renew_subs 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3b341252f0 con 0x7f3b34137570 2024-04-26T00:08:55.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3b24003930 con 0x7f3b34137570 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b24003e20 con 0x7f3b34137570 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2bfff640 4 set_mon_vals no callback set 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: dump: 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.757 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3b1c0065d0 con 0x7f3b1c002870 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3b24003fc0 con 0x7f3b34137570 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f3b240450d0 con 0x7f3b34137570 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3845698919 0 0) 0x7f3b1c0065d0 con 0x7f3b1c002870 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient(hunting): my global_id is 254128 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b34072970 con 0x7f3b1c002870 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 254779773 0 0) 0x7f3b34072970 con 0x7f3b1c002870 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b1c0065d0 con 0x7f3b1c002870 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b30001780 con 0x7f3b1c002870 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: dump: 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.759 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b3a050640 10 monclient: get_auth_request con 0x7f3b18037e40 auth_method 0 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1892138235 0 0) 0x7f3b1c0065d0 con 0x7f3b1c002870 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3b1c00a160 con 0x7f3b1c002870 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3b30001780 con 0x7f3b1c002870 2024-04-26T00:08:55.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:55.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.106:6791/0 conn(0x7f3b1c002870 legacy=0x7f3b1c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.758+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.106:6791/0 conn(0x7f3b1c002870 legacy=0x7f3b1c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:55.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3b1c009e30 con 0x7f3b1c0090f0 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478381121 0 0) 0x7f3b1c009e30 con 0x7f3b1c0090f0 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient(hunting): my global_id is 254137 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3b1c0065d0 con 0x7f3b1c0090f0 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3169573139 0 0) 0x7f3b1c0065d0 con 0x7f3b1c0090f0 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3b1c009e30 con 0x7f3b1c0090f0 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3b30004e60 con 0x7f3b1c0090f0 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient: dump: 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.763 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3800745623 0 0) 0x7f3b1c009e30 con 0x7f3b1c0090f0 2024-04-26T00:08:55.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3b1c00c3a0 con 0x7f3b1c0090f0 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 4161460286) 0x7f3b300063b0 con 0x7f3b1c0090f0 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.106:6791/0 conn(0x7f3b1c0090f0 legacy=0x7f3b1c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b2a7fc640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.106:6791/0 conn(0x7f3b1c0090f0 legacy=0x7f3b1c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:55.765 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 5819, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.766 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.767 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:55.769 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.770 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:55.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.774 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:55.776 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.779 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:55.780 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.782 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.783 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.784 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:55.784 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:55.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.171:6812/722422047 conn(0x7f3b18037e40 legacy=0x7f3b1803a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 10 monclient: shutdown 2024-04-26T00:08:55.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 >> v1:172.21.15.106:6789/0 conn(0x7f3b34137570 legacy=0x7f3b341d1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3a050640 1 -- 172.21.15.106:0/2236697183 reap_dead start 2024-04-26T00:08:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3a050640 1 -- 172.21.15.106:0/2236697183 reap_dead start 2024-04-26T00:08:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 shutdown_connections 2024-04-26T00:08:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 >> 172.21.15.106:0/2236697183 conn(0x7f3b340a64e0 msgr2=0x7f3b34070660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 shutdown_connections 2024-04-26T00:08:55.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.766+0000 7f3b3bab3640 1 -- 172.21.15.106:0/2236697183 wait complete. 2024-04-26T00:08:55.786 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:55.786 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:08:55.787 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:08:55.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: get_monmap_and_config 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: monmap: 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:55.918584+0000 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:55.918584+0000 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.892 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.893 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.893 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.893 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.893 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 Processor -- start 2024-04-26T00:08:55.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- start start 2024-04-26T00:08:55.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: init 2024-04-26T00:08:55.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: _add_conns ranks=[8,1,3,2,7,4,5,6,0] 2024-04-26T00:08:55.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient(hunting): picked mon.noname-e con 0x7fbe84137730 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient(hunting): picked mon.noname-f con 0x7fbe840a0b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient(hunting): picked mon.noname-g con 0x7fbe84138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840a2750 con 0x7fbe840a0b20 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840a2a30 con 0x7fbe84138220 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840a2d10 con 0x7fbe84137730 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient(hunting): authenticate will time out at 1791.445665s 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe89924640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fbe84137730 0x7fbe84137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35532/0 (socket says 172.21.15.106:35532) 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe89924640 1 -- 172.21.15.106:0/2685127713 learned_addr learned my addr 172.21.15.106:0/2685127713 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2946554724 0 0) 0x7fbe840a2d10 con 0x7fbe84137730 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient(hunting): my global_id is 224711 2024-04-26T00:08:55.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe70003530 con 0x7fbe84137730 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2993915696 0 0) 0x7fbe70003530 con 0x7fbe84137730 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 >> v1:172.21.15.171:6790/0 conn(0x7fbe84138220 legacy=0x7fbe84140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 >> v1:172.21.15.171:6789/0 conn(0x7fbe840a0b20 legacy=0x7fbe8413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 monclient: found mon.noname-e 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe840a4680 con 0x7fbe84137730 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe7c0017c0 con 0x7fbe84137730 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: dump: 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.903 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 5 monclient: authenticate success, global_id 224711 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe7c001b20 con 0x7fbe84137730 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 4 set_mon_vals no callback set 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 1 -- 172.21.15.106:0/2685127713 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe7c004bf0 con 0x7fbe84137730 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe88922640 10 monclient: dump: 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.904 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: shutdown 2024-04-26T00:08:55.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- 172.21.15.106:0/2685127713 >> v1:172.21.15.106:6793/0 conn(0x7fbe84137730 legacy=0x7fbe84137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- 172.21.15.106:0/2685127713 shutdown_connections 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- 172.21.15.106:0/2685127713 >> 172.21.15.106:0/2685127713 conn(0x7fbe840a6b80 msgr2=0x7fbe840a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- 172.21.15.106:0/2685127713 shutdown_connections 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- 172.21.15.106:0/2685127713 wait complete. 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: build_initial_monmap 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: monmap: 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:55.906 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 Processor -- start 2024-04-26T00:08:55.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 1 -- start start 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.914+0000 7fbe8bb88640 10 monclient: init 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient: _add_conns ranks=[8,1,2,0,5,6,3,7,4] 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient(hunting): picked mon.noname-e con 0x7fbe840a0b20 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient(hunting): picked mon.noname-f con 0x7fbe84137730 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient(hunting): picked mon.noname-b con 0x7fbe84138220 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe84132590 con 0x7fbe84137730 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe840a19d0 con 0x7fbe84138220 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe841322b0 con 0x7fbe840a0b20 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe89924640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fbe840a0b20 0x7fbe8412f8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35540/0 (socket says 172.21.15.106:35540) 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient(hunting): authenticate will time out at 1791.448392s 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe89924640 1 -- 172.21.15.106:0/964997000 learned_addr learned my addr 172.21.15.106:0/964997000 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3955437280 0 0) 0x7fbe841322b0 con 0x7fbe840a0b20 2024-04-26T00:08:55.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): my global_id is 224720 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe68003530 con 0x7fbe840a0b20 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1150658614 0 0) 0x7fbe840a19d0 con 0x7fbe84138220 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): my global_id is 254135 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe841322b0 con 0x7fbe84138220 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3056947447 0 0) 0x7fbe841322b0 con 0x7fbe84138220 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe840a19d0 con 0x7fbe84138220 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3377074816 0 0) 0x7fbe68003530 con 0x7fbe840a0b20 2024-04-26T00:08:55.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe841322b0 con 0x7fbe840a0b20 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe80001870 con 0x7fbe84138220 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): dump: 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.910 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe7c001780 con 0x7fbe840a0b20 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:55.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): dump: 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.912 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3175150950 0 0) 0x7fbe840a2750 con 0x7fbe84137730 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): my global_id is 224785 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe68003530 con 0x7fbe84137730 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2832322731 0 0) 0x7fbe840a19d0 con 0x7fbe84138220 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.106:6793/0 conn(0x7fbe840a0b20 legacy=0x7fbe8412f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.171:6789/0 conn(0x7fbe84137730 legacy=0x7fbe84130000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 monclient: found mon.b 2024-04-26T00:08:55.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe84132f70 con 0x7fbe84138220 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 5 monclient: authenticate success, global_id 254135 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient: _renew_subs 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe841364b0 con 0x7fbe84138220 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient: _renew_subs 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe841308e0 con 0x7fbe84138220 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe80003620 con 0x7fbe84138220 2024-04-26T00:08:55.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe80003b90 con 0x7fbe84138220 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe77fff640 4 set_mon_vals no callback set 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: dump: 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.915 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbe6c0065d0 con 0x7fbe6c002870 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbe80003db0 con 0x7fbe84138220 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fbe80043ef0 con 0x7fbe84138220 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564385805 0 0) 0x7fbe6c0065d0 con 0x7fbe6c002870 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient(hunting): my global_id is 254121 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe840a19d0 con 0x7fbe6c002870 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 146973384 0 0) 0x7fbe840a19d0 con 0x7fbe6c002870 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe6c0065d0 con 0x7fbe6c002870 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe7c001b20 con 0x7fbe6c002870 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: dump: 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe89123640 10 monclient: get_auth_request con 0x7fbe68037df0 auth_method 0 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 544506537 0 0) 0x7fbe6c0065d0 con 0x7fbe6c002870 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbe6c00a160 con 0x7fbe6c002870 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbe7c005240 con 0x7fbe6c002870 2024-04-26T00:08:55.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:55.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:55.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.106:6792/0 conn(0x7fbe6c002870 legacy=0x7fbe6c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.918+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.106:6792/0 conn(0x7fbe6c002870 legacy=0x7fbe6c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:55.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbe6c009e50 con 0x7fbe6c009110 2024-04-26T00:08:55.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993255630 0 0) 0x7fbe6c009e50 con 0x7fbe6c009110 2024-04-26T00:08:55.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient(hunting): my global_id is 254130 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe6c0065d0 con 0x7fbe6c009110 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 499166897 0 0) 0x7fbe6c0065d0 con 0x7fbe6c009110 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe6c009e50 con 0x7fbe6c009110 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbe7c0059a0 con 0x7fbe6c009110 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient: dump: 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:55.921 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3564339580 0 0) 0x7fbe6c009e50 con 0x7fbe6c009110 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbe6c00c3e0 con 0x7fbe6c009110 2024-04-26T00:08:55.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2104945545) 0x7fbe7c007e50 con 0x7fbe6c009110 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.106:6792/0 conn(0x7fbe6c009110 legacy=0x7fbe6c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe767fc640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.106:6792/0 conn(0x7fbe6c009110 legacy=0x7fbe6c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 5987, 2024-04-26T00:08:55.923 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:55.924 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:55.925 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:55.927 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:55.928 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.930 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:55.931 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.932 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.934 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:55.936 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:55.938 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.939 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.940 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:55.941 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.171:6812/722422047 conn(0x7fbe68037df0 legacy=0x7fbe6803a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 10 monclient: shutdown 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 >> v1:172.21.15.106:6790/0 conn(0x7fbe84138220 legacy=0x7fbe841d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8a125640 1 -- 172.21.15.106:0/964997000 reap_dead start 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8a125640 1 -- 172.21.15.106:0/964997000 reap_dead start 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 shutdown_connections 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 >> 172.21.15.106:0/964997000 conn(0x7fbe840a6b80 msgr2=0x7fbe8412e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 shutdown_connections 2024-04-26T00:08:55.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:55.926+0000 7fbe8bb88640 1 -- 172.21.15.106:0/964997000 wait complete. 2024-04-26T00:08:55.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:55.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:08:55.944 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:08:56.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.074+0000 7fdceb1d3640 10 monclient: get_monmap_and_config 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.074+0000 7fdceb1d3640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient: monmap: 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:56.082505+0000 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:56.082505+0000 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.056 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.057 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.057 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 Processor -- start 2024-04-26T00:08:56.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- start start 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient: init 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient: _add_conns ranks=[5,4,2,6,1,8,0,7,3] 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient(hunting): picked mon.noname-h con 0x7fdce4067b80 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient(hunting): picked mon.noname-c con 0x7fdce40a22d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient(hunting): picked mon.noname-b con 0x7fdce40a2750 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce409f970 con 0x7fdce40a2750 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce406c670 con 0x7fdce40a22d0 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce409ba70 con 0x7fdce4067b80 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient(hunting): authenticate will time out at 1791.609885s 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce3fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fdce40a22d0 0x7fdce413abd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40232/0 (socket says 172.21.15.106:40232) 2024-04-26T00:08:56.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce3fff640 1 -- 172.21.15.106:0/2511747996 learned_addr learned my addr 172.21.15.106:0/2511747996 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290856046 0 0) 0x7fdce406c670 con 0x7fdce40a22d0 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): my global_id is 254146 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcd4003530 con 0x7fdce40a22d0 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4184048128 0 0) 0x7fdce409f970 con 0x7fdce40a2750 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient(hunting): my global_id is 254144 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce406c670 con 0x7fdce40a2750 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 563900586 0 0) 0x7fdcd4003530 con 0x7fdce40a22d0 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 >> v1:172.21.15.171:6791/0 conn(0x7fdce4067b80 legacy=0x7fdce40a1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 >> v1:172.21.15.106:6790/0 conn(0x7fdce40a2750 legacy=0x7fdce413e300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 monclient: found mon.noname-c 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce409fdb0 con 0x7fdce40a22d0 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcd00016f0 con 0x7fdce40a22d0 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 5 monclient: authenticate success, global_id 254146 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: dump: 2024-04-26T00:08:56.068 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.069 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcd00019a0 con 0x7fdce40a22d0 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 1 -- 172.21.15.106:0/2511747996 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcd0004bf0 con 0x7fdce40a22d0 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 4 set_mon_vals no callback set 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdce37fe640 10 monclient: dump: 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.070 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 10 monclient: shutdown 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2511747996 >> v1:172.21.15.106:6791/0 conn(0x7fdce40a22d0 legacy=0x7fdce413abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2511747996 shutdown_connections 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2511747996 >> 172.21.15.106:0/2511747996 conn(0x7fdce406b3e0 msgr2=0x7fdce406b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2511747996 shutdown_connections 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.078+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2511747996 wait complete. 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: monmap: 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.072 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 Processor -- start 2024-04-26T00:08:56.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 -- start start 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: init 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: _add_conns ranks=[8,6,0,2,4,1,7,5,3] 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient(hunting): picked mon.noname-e con 0x7fdce4067b80 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient(hunting): picked mon.noname-d con 0x7fdce40a22d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient(hunting): picked mon.noname-a con 0x7fdce40a2750 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce411da90 con 0x7fdce40a2750 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce4072c70 con 0x7fdce40a22d0 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdce409e860 con 0x7fdce4067b80 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient(hunting): authenticate will time out at 1791.613091s 2024-04-26T00:08:56.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce8f6f640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fdce4067b80 0x7fdce41340f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35554/0 (socket says 172.21.15.106:35554) 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce3fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fdce40a22d0 0x7fdce41d1480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45746/0 (socket says 172.21.15.106:45746) 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce9770640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdce40a2750 0x7fdce41d4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42834/0 (socket says 172.21.15.106:42834) 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce8f6f640 1 -- 172.21.15.106:0/2242043067 learned_addr learned my addr 172.21.15.106:0/2242043067 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1187247977 0 0) 0x7fdce409e860 con 0x7fdce4067b80 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): my global_id is 224729 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc8003560 con 0x7fdce4067b80 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2993945017 0 0) 0x7fdce411da90 con 0x7fdce40a2750 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): my global_id is 8145 2024-04-26T00:08:56.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce409e860 con 0x7fdce40a2750 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 884584571 0 0) 0x7fdce4072c70 con 0x7fdce40a22d0 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): my global_id is 254139 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce411da90 con 0x7fdce40a22d0 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3315173006 0 0) 0x7fdcc8003560 con 0x7fdce4067b80 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdce4072c70 con 0x7fdce4067b80 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcd8001940 con 0x7fdce4067b80 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): dump: 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.076 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:56.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2340705667 0 0) 0x7fdce409e860 con 0x7fdce40a2750 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcc8003560 con 0x7fdce40a2750 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcdc001ce0 con 0x7fdce40a2750 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): dump: 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.078 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2857885836 0 0) 0x7fdce411da90 con 0x7fdce40a22d0 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdce409e860 con 0x7fdce40a22d0 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcd00016b0 con 0x7fdce40a22d0 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): dump: 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.079 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1432599106 0 0) 0x7fdce4072c70 con 0x7fdce4067b80 2024-04-26T00:08:56.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.106:6792/0 conn(0x7fdce40a22d0 legacy=0x7fdce41d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.106:6789/0 conn(0x7fdce40a2750 legacy=0x7fdce41d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 monclient: found mon.e 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdce411d1f0 con 0x7fdce4067b80 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 5 monclient: authenticate success, global_id 224729 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: _renew_subs 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdce411d4d0 con 0x7fdce4067b80 2024-04-26T00:08:56.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: _renew_subs 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdce4134800 con 0x7fdce4067b80 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdcd8001ce0 con 0x7fdce4067b80 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcd8003c10 con 0x7fdce4067b80 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: dump: 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.082 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce2ffd640 4 set_mon_vals no callback set 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdcc40065d0 con 0x7fdcc4002870 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdcd8003db0 con 0x7fdce4067b80 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fdcd8044f20 con 0x7fdce4067b80 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 896323550 0 0) 0x7fdcc40065d0 con 0x7fdcc4002870 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient(hunting): my global_id is 224738 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdce4072c70 con 0x7fdcc4002870 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3325081177 0 0) 0x7fdce4072c70 con 0x7fdcc4002870 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcc40065d0 con 0x7fdcc4002870 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcd0001110 con 0x7fdcc4002870 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 10 monclient: dump: 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.085 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce9770640 10 monclient: get_auth_request con 0x7fdcc8038240 auth_method 0 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 35538444 0 0) 0x7fdcc40065d0 con 0x7fdcc4002870 2024-04-26T00:08:56.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.082+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdcc400a160 con 0x7fdcc4002870 2024-04-26T00:08:56.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.086+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdcd0007480 con 0x7fdcc4002870 2024-04-26T00:08:56.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.086+0000 7fdce17fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.086+0000 7fdce17fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:56.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.086+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.106:6793/0 conn(0x7fdcc4002870 legacy=0x7fdcc4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.086+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.106:6793/0 conn(0x7fdcc4002870 legacy=0x7fdcc4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdcc4009e50 con 0x7fdcc4009110 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3355086650 0 0) 0x7fdcc4009e50 con 0x7fdcc4009110 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient(hunting): my global_id is 224747 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdcc40065d0 con 0x7fdcc4009110 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1254032437 0 0) 0x7fdcc40065d0 con 0x7fdcc4009110 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdcc4009e50 con 0x7fdcc4009110 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdcd0005640 con 0x7fdcc4009110 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient: dump: 2024-04-26T00:08:56.089 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.090 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2556175424 0 0) 0x7fdcc4009e50 con 0x7fdcc4009110 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdcc400c3e0 con 0x7fdcc4009110 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3409221086) 0x7fdcd0007630 con 0x7fdcc4009110 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.106:6793/0 conn(0x7fdcc4009110 legacy=0x7fdcc40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce17fa640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.106:6793/0 conn(0x7fdcc4009110 legacy=0x7fdcc40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:56.091 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 249322, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.092 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.093 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:56.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.096 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.097 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:56.099 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.100 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:56.102 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.104 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.105 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.108 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:56.110 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:56.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.171:6812/722422047 conn(0x7fdcc8038240 legacy=0x7fdcc803a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 10 monclient: shutdown 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 >> v1:172.21.15.106:6793/0 conn(0x7fdce4067b80 legacy=0x7fdce41340f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce9770640 1 -- 172.21.15.106:0/2242043067 reap_dead start 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdce9770640 1 -- 172.21.15.106:0/2242043067 reap_dead start 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 shutdown_connections 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 >> 172.21.15.106:0/2242043067 conn(0x7fdce406b3e0 msgr2=0x7fdce40710f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 shutdown_connections 2024-04-26T00:08:56.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.090+0000 7fdceb1d3640 1 -- 172.21.15.106:0/2242043067 wait complete. 2024-04-26T00:08:56.112 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:56.112 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:08:56.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:08:56.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: get_monmap_and_config 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: monmap: 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:56.246620+0000 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:56.246620+0000 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.220 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.221 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.221 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 Processor -- start 2024-04-26T00:08:56.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- start start 2024-04-26T00:08:56.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: init 2024-04-26T00:08:56.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: _add_conns ranks=[8,3,0,5,6,4,1,2,7] 2024-04-26T00:08:56.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient(hunting): picked mon.noname-e con 0x7f9570135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:56.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient(hunting): picked mon.noname-g con 0x7f95701353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient(hunting): picked mon.noname-a con 0x7f957013bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957006f2d0 con 0x7f957013bdf0 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9570072330 con 0x7f95701353b0 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9570072610 con 0x7f9570135870 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient(hunting): authenticate will time out at 1791.773534s 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f95750f0640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f957013bdf0 0x7f957013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42840/0 (socket says 172.21.15.106:42840) 2024-04-26T00:08:56.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f95750f0640 1 -- 172.21.15.106:0/1814008849 learned_addr learned my addr 172.21.15.106:0/1814008849 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1725863478 0 0) 0x7f957006f2d0 con 0x7f957013bdf0 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): my global_id is 8154 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9558003530 con 0x7f957013bdf0 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288565552 0 0) 0x7f9570072610 con 0x7f9570135870 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient(hunting): my global_id is 224756 2024-04-26T00:08:56.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957006f2d0 con 0x7f9570135870 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1127967286 0 0) 0x7f957006f2d0 con 0x7f9570135870 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 >> v1:172.21.15.171:6790/0 conn(0x7f95701353b0 legacy=0x7f957013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 >> v1:172.21.15.106:6789/0 conn(0x7f957013bdf0 legacy=0x7f957013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 monclient: found mon.noname-e 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95700a3260 con 0x7f9570135870 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 5 monclient: authenticate success, global_id 224756 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9560001800 con 0x7f9570135870 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: dump: 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.234 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.235 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.235 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.235 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.235 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9560001a60 con 0x7f9570135870 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 1 -- 172.21.15.106:0/1814008849 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9560003960 con 0x7f9570135870 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 4 set_mon_vals no callback set 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:56.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f956f7fe640 10 monclient: dump: 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.237 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: shutdown 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- 172.21.15.106:0/1814008849 >> v1:172.21.15.106:6793/0 conn(0x7f9570135870 legacy=0x7f9570135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- 172.21.15.106:0/1814008849 shutdown_connections 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- 172.21.15.106:0/1814008849 >> 172.21.15.106:0/1814008849 conn(0x7f95700a64e0 msgr2=0x7f95700a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- 172.21.15.106:0/1814008849 shutdown_connections 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 1 -- 172.21.15.106:0/1814008849 wait complete. 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.242+0000 7f9576b53640 10 monclient: monmap: 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:56.238 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 Processor -- start 2024-04-26T00:08:56.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 -- start start 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient: init 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient: _add_conns ranks=[8,6,7,2,5,4,0,1,3] 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient(hunting): picked mon.noname-e con 0x7f95701353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient(hunting): picked mon.noname-d con 0x7f9570135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient(hunting): picked mon.noname-i con 0x7f957013bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f957009f470 con 0x7f9570135870 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9570133110 con 0x7f957013bdf0 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9570135120 con 0x7f95701353b0 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient(hunting): authenticate will time out at 1791.776607s 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9570135870 0x7f95701cf290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45758/0 (socket says 172.21.15.106:45758) 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956ffff640 1 -- 172.21.15.106:0/552404010 learned_addr learned my addr 172.21.15.106:0/552404010 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3167718706 0 0) 0x7f9570135120 con 0x7f95701353b0 2024-04-26T00:08:56.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): my global_id is 224765 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f955c003530 con 0x7f95701353b0 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2628329138 0 0) 0x7f957009f470 con 0x7f9570135870 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): my global_id is 254148 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9570135120 con 0x7f9570135870 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 487504398 0 0) 0x7f955c003530 con 0x7f95701353b0 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f957009f470 con 0x7f95701353b0 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9560001700 con 0x7f95701353b0 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): dump: 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.242 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3339761562 0 0) 0x7f9570135120 con 0x7f9570135870 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f955c003530 con 0x7f9570135870 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9564001a20 con 0x7f9570135870 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): dump: 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.243 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727728692 0 0) 0x7f9570133110 con 0x7f957013bdf0 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): my global_id is 146248 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9570135120 con 0x7f957013bdf0 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 225155240 0 0) 0x7f957009f470 con 0x7f95701353b0 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.171:6792/0 conn(0x7f957013bdf0 legacy=0x7f95701d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.106:6792/0 conn(0x7f9570135870 legacy=0x7f95701cf290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 monclient: found mon.e 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9570134b60 con 0x7f95701353b0 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 5 monclient: authenticate success, global_id 224765 2024-04-26T00:08:56.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient: _renew_subs 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9570133e90 con 0x7f95701353b0 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient: _renew_subs 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f957013b970 con 0x7f95701353b0 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f95600019a0 con 0x7f95701353b0 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9560003a20 con 0x7f95701353b0 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956effd640 4 set_mon_vals no callback set 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: dump: 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.246 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f95500065d0 con 0x7f9550002870 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f956000eba0 con 0x7f95701353b0 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f9560043f10 con 0x7f95701353b0 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3144906193 0 0) 0x7f95500065d0 con 0x7f9550002870 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient(hunting): my global_id is 224794 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f957009f470 con 0x7f9550002870 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f95750f0640 10 monclient: get_auth_request con 0x7f955c037fb0 auth_method 0 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3391109974 0 0) 0x7f957009f470 con 0x7f9550002870 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f95500065d0 con 0x7f9550002870 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9564003e80 con 0x7f9550002870 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:08:56.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 10 monclient: dump: 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.249 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4227765057 0 0) 0x7f95500065d0 con 0x7f9550002870 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.246+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f955000a160 con 0x7f9550002870 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.250+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9564004170 con 0x7f9550002870 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.250+0000 7f956d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.250+0000 7f956d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.250+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.171:6789/0 conn(0x7f9550002870 legacy=0x7f9550004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.250+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.171:6789/0 conn(0x7f9550002870 legacy=0x7f9550004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f9576b53640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9550009e30 con 0x7f95500090f0 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1619217301 0 0) 0x7f9550009e30 con 0x7f95500090f0 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 10 monclient(hunting): my global_id is 224803 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f95500065d0 con 0x7f95500090f0 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2660884710 0 0) 0x7f95500065d0 con 0x7f95500090f0 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9550009e30 con 0x7f95500090f0 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9564005b10 con 0x7f95500090f0 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 10 monclient: dump: 2024-04-26T00:08:56.256 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.257 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2695116318 0 0) 0x7f9550009e30 con 0x7f95500090f0 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.254+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f955000c3a0 con 0x7f95500090f0 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3764222001) 0x7f9564007e40 con 0x7f95500090f0 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f956d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f956d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.171:6789/0 conn(0x7f95500090f0 legacy=0x7f9550009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f956d7fa640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.171:6789/0 conn(0x7f95500090f0 legacy=0x7f9550009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:56.258 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 249491, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:56.259 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.260 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.261 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:56.262 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.263 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:56.264 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.265 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:56.266 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.268 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.269 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.271 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.272 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:56.274 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.275 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.276 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.277 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:56.277 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:56.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.171:6812/722422047 conn(0x7f955c037fb0 legacy=0x7f955c03a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 10 monclient: shutdown 2024-04-26T00:08:56.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 >> v1:172.21.15.106:6793/0 conn(0x7f95701353b0 legacy=0x7f957013b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f95750f0640 1 -- 172.21.15.106:0/552404010 reap_dead start 2024-04-26T00:08:56.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f95750f0640 1 -- 172.21.15.106:0/552404010 reap_dead start 2024-04-26T00:08:56.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 shutdown_connections 2024-04-26T00:08:56.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 >> 172.21.15.106:0/552404010 conn(0x7f95700a64e0 msgr2=0x7f95700a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 shutdown_connections 2024-04-26T00:08:56.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.258+0000 7f9576b53640 1 -- 172.21.15.106:0/552404010 wait complete. 2024-04-26T00:08:56.279 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:56.279 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:08:56.279 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: get_monmap_and_config 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: monmap: 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:56.419001+0000 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:56.419001+0000 2024-04-26T00:08:56.392 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.393 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 Processor -- start 2024-04-26T00:08:56.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 -- start start 2024-04-26T00:08:56.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: init 2024-04-26T00:08:56.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: _add_conns ranks=[8,6,0,2,4,3,1,7,5] 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient(hunting): picked mon.noname-e con 0x7fb330134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient(hunting): picked mon.noname-d con 0x7fb3300725d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient(hunting): picked mon.noname-a con 0x7fb33013ace0 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb330071270 con 0x7fb33013ace0 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3300714e0 con 0x7fb3300725d0 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3300729f0 con 0x7fb330134820 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient(hunting): authenticate will time out at 1791.946334s 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32e59c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fb330134820 0x7fb330134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35594/0 (socket says 172.21.15.106:35594) 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32e59c640 1 -- 172.21.15.106:0/2631557780 learned_addr learned my addr 172.21.15.106:0/2631557780 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2041545137 0 0) 0x7fb318001120 con 0x7fb3300725d0 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): my global_id is 254157 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb31c003530 con 0x7fb3300725d0 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2427587289 0 0) 0x7fb3300729f0 con 0x7fb330134820 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): my global_id is 224774 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb318001120 con 0x7fb330134820 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1518291567 0 0) 0x7fb330071270 con 0x7fb33013ace0 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient(hunting): my global_id is 8163 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3300729f0 con 0x7fb33013ace0 2024-04-26T00:08:56.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3061451131 0 0) 0x7fb31c003530 con 0x7fb3300725d0 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 >> v1:172.21.15.106:6793/0 conn(0x7fb330134820 legacy=0x7fb330134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 >> v1:172.21.15.106:6789/0 conn(0x7fb33013ace0 legacy=0x7fb33013d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 monclient: found mon.noname-d 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3300717c0 con 0x7fb3300725d0 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb318001990 con 0x7fb3300725d0 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:08:56.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: dump: 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.406 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 5 monclient: authenticate success, global_id 254157 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb318001bf0 con 0x7fb3300725d0 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 1 -- 172.21.15.106:0/2631557780 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb318003960 con 0x7fb3300725d0 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 4 set_mon_vals no callback set 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb32d59a640 10 monclient: dump: 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.407 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 10 monclient: shutdown 2024-04-26T00:08:56.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 -- 172.21.15.106:0/2631557780 >> v1:172.21.15.106:6792/0 conn(0x7fb3300725d0 legacy=0x7fb3301395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 -- 172.21.15.106:0/2631557780 shutdown_connections 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.414+0000 7fb334dd3640 1 -- 172.21.15.106:0/2631557780 >> 172.21.15.106:0/2631557780 conn(0x7fb3300a64e0 msgr2=0x7fb3300a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- 172.21.15.106:0/2631557780 shutdown_connections 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- 172.21.15.106:0/2631557780 wait complete. 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: monmap: 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.409 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 Processor -- start 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- start start 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: init 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: _add_conns ranks=[2,8,3,5,4,7,0,6,1] 2024-04-26T00:08:56.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient(hunting): picked mon.noname-b con 0x7fb3300725d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient(hunting): picked mon.noname-e con 0x7fb330134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient(hunting): picked mon.noname-g con 0x7fb33013ace0 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb330133dc0 con 0x7fb3300725d0 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb330132910 con 0x7fb33013ace0 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb330133ae0 con 0x7fb330134820 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient(hunting): authenticate will time out at 1791.949615s 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb32dd9b640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fb330134820 0x7fb3301d1600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35608/0 (socket says 172.21.15.106:35608) 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb32dd9b640 1 -- 172.21.15.106:0/4171506565 learned_addr learned my addr 172.21.15.106:0/4171506565 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3264569147 0 0) 0x7fb330133ae0 con 0x7fb330134820 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): my global_id is 224783 2024-04-26T00:08:56.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb310003530 con 0x7fb330134820 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104604658 0 0) 0x7fb330133dc0 con 0x7fb3300725d0 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): my global_id is 254153 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb330133ae0 con 0x7fb3300725d0 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1219112655 0 0) 0x7fb330133ae0 con 0x7fb3300725d0 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb330133dc0 con 0x7fb3300725d0 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 250557264 0 0) 0x7fb310003530 con 0x7fb330134820 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb330133ae0 con 0x7fb330134820 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb3280017b0 con 0x7fb3300725d0 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): dump: 2024-04-26T00:08:56.412 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.413 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb318001890 con 0x7fb330134820 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient(hunting): dump: 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3820712601 0 0) 0x7fb330133dc0 con 0x7fb3300725d0 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.106:6793/0 conn(0x7fb330134820 legacy=0x7fb3301d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.171:6790/0 conn(0x7fb33013ace0 legacy=0x7fb3301d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 monclient: found mon.b 2024-04-26T00:08:56.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb33009eec0 con 0x7fb3300725d0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 5 monclient: authenticate success, global_id 254153 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: _renew_subs 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb33009f170 con 0x7fb3300725d0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: _renew_subs 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fb3301cc6b0 con 0x7fb3300725d0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb328001ac0 con 0x7fb3300725d0 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb328005160 con 0x7fb3300725d0 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb32cd99640 4 set_mon_vals no callback set 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 10 monclient: dump: 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.417 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb32800ff00 con 0x7fb3300725d0 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb3140065d0 con 0x7fb314002870 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fb3280453e0 con 0x7fb3300725d0 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.418+0000 7fb32ed9d640 10 monclient: get_auth_request con 0x7fb310037cb0 auth_method 0 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146839050 0 0) 0x7fb3140065d0 con 0x7fb314002870 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient(hunting): my global_id is 214941 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb330133dc0 con 0x7fb314002870 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2050714058 0 0) 0x7fb330133dc0 con 0x7fb314002870 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3140065d0 con 0x7fb314002870 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb318003fb0 con 0x7fb314002870 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient: dump: 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.420 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.420 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.420 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.420 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.420 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.420 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2927457192 0 0) 0x7fb3140065d0 con 0x7fb314002870 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb31400a160 con 0x7fb314002870 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb318001bf0 con 0x7fb314002870 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.171:6790/0 conn(0x7fb314002870 legacy=0x7fb314004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.422+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.171:6790/0 conn(0x7fb314002870 legacy=0x7fb314004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.426+0000 7fb334dd3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.426+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb314009e50 con 0x7fb314009110 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 584140217 0 0) 0x7fb314009e50 con 0x7fb314009110 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient(hunting): my global_id is 214950 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3140065d0 con 0x7fb314009110 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3800831325 0 0) 0x7fb3140065d0 con 0x7fb314009110 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb314009e50 con 0x7fb314009110 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb318004810 con 0x7fb314009110 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient: dump: 2024-04-26T00:08:56.423 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.424 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 695985681 0 0) 0x7fb314009e50 con 0x7fb314009110 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb31400c3e0 con 0x7fb314009110 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 3735006566) 0x7fb318004a20 con 0x7fb314009110 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.171:6790/0 conn(0x7fb314009110 legacy=0x7fb3140095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb326ffd640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.171:6790/0 conn(0x7fb314009110 legacy=0x7fb3140095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.425 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 366854, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:56.426 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.427 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.428 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.429 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.430 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:56.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.432 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:56.438 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.439 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.440 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.443 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.444 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:56.445 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.171:6812/722422047 conn(0x7fb310037cb0 legacy=0x7fb31003a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 10 monclient: shutdown 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 >> v1:172.21.15.106:6790/0 conn(0x7fb3300725d0 legacy=0x7fb33009e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb32ed9d640 1 -- 172.21.15.106:0/4171506565 reap_dead start 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb32ed9d640 1 -- 172.21.15.106:0/4171506565 reap_dead start 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 shutdown_connections 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 >> 172.21.15.106:0/4171506565 conn(0x7fb3300a64e0 msgr2=0x7fb3300a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 shutdown_connections 2024-04-26T00:08:56.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.430+0000 7fb334dd3640 1 -- 172.21.15.106:0/4171506565 wait complete. 2024-04-26T00:08:56.447 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:56.448 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:08:56.448 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:08:56.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.582+0000 7fbcde3ea640 10 monclient: get_monmap_and_config 2024-04-26T00:08:56.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.582+0000 7fbcde3ea640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.582+0000 7fbcde3ea640 10 monclient: monmap: 2024-04-26T00:08:56.563 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:56.590033+0000 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:56.590033+0000 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.564 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 Processor -- start 2024-04-26T00:08:56.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- start start 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: init 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: _add_conns ranks=[4,1,7,3,8,0,5,6,2] 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient(hunting): picked mon.noname-c con 0x7fbcd8134760 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient(hunting): picked mon.noname-f con 0x7fbcd80a0d70 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient(hunting): picked mon.noname-i con 0x7fbcd813df70 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd806b910 con 0x7fbcd80a0d70 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd809fac0 con 0x7fbcd8134760 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd80a0080 con 0x7fbcd813df70 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient(hunting): authenticate will time out at 1792.117263s 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd7fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fbcd8134760 0x7fbcd8134b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40236/0 (socket says 172.21.15.106:40236) 2024-04-26T00:08:56.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd7fff640 1 -- 172.21.15.106:0/3576851998 learned_addr learned my addr 172.21.15.106:0/3576851998 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1493196466 0 0) 0x7fbcd809fac0 con 0x7fbcd8134760 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient(hunting): my global_id is 254155 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcc4003530 con 0x7fbcd8134760 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1885271518 0 0) 0x7fbcc4003530 con 0x7fbcd8134760 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 >> v1:172.21.15.171:6792/0 conn(0x7fbcd813df70 legacy=0x7fbcd8140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 >> v1:172.21.15.171:6789/0 conn(0x7fbcd80a0d70 legacy=0x7fbcd813c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 monclient: found mon.noname-c 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:08:56.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd809f280 con 0x7fbcd8134760 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 5 monclient: authenticate success, global_id 254155 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc80017c0 con 0x7fbcd8134760 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: dump: 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.575 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcc8001b20 con 0x7fbcd8134760 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 1 -- 172.21.15.106:0/3576851998 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc8001d50 con 0x7fbcd8134760 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 4 set_mon_vals no callback set 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcd77fe640 10 monclient: dump: 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.577 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: shutdown 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- 172.21.15.106:0/3576851998 >> v1:172.21.15.106:6791/0 conn(0x7fbcd8134760 legacy=0x7fbcd8134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- 172.21.15.106:0/3576851998 shutdown_connections 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- 172.21.15.106:0/3576851998 >> 172.21.15.106:0/3576851998 conn(0x7fbcd80a7240 msgr2=0x7fbcd80a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- 172.21.15.106:0/3576851998 shutdown_connections 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- 172.21.15.106:0/3576851998 wait complete. 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: monmap: 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.579 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 Processor -- start 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 1 -- start start 2024-04-26T00:08:56.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.586+0000 7fbcde3ea640 10 monclient: init 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient: _add_conns ranks=[6,1,2,4,5,7,0,3,8] 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient(hunting): picked mon.noname-d con 0x7fbcd80a0d70 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient(hunting): picked mon.noname-f con 0x7fbcd8134760 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient(hunting): picked mon.noname-b con 0x7fbcd813df70 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd813a710 con 0x7fbcd8134760 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd8072930 con 0x7fbcd813df70 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbcd813a010 con 0x7fbcd80a0d70 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient(hunting): authenticate will time out at 1792.120306s 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd7fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fbcd80a0d70 0x7fbcd8136610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45774/0 (socket says 172.21.15.106:45774) 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd7fff640 1 -- 172.21.15.106:0/2273451848 learned_addr learned my addr 172.21.15.106:0/2273451848 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1890266463 0 0) 0x7fbcd813a010 con 0x7fbcd80a0d70 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): my global_id is 254166 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcb8003530 con 0x7fbcd80a0d70 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402506789 0 0) 0x7fbcd80a0080 con 0x7fbcd813df70 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): my global_id is 254162 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd813a010 con 0x7fbcd813df70 2024-04-26T00:08:56.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1023569293 0 0) 0x7fbcb8003530 con 0x7fbcd80a0d70 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcd80a0080 con 0x7fbcd80a0d70 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc8001780 con 0x7fbcd80a0d70 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): dump: 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.583 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2313887423 0 0) 0x7fbcd813a010 con 0x7fbcd813df70 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcb8003530 con 0x7fbcd813df70 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcd0001bf0 con 0x7fbcd813df70 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): dump: 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.584 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.585 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 874838465 0 0) 0x7fbcd806b910 con 0x7fbcd8134760 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): my global_id is 224821 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd813a010 con 0x7fbcd8134760 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1953792066 0 0) 0x7fbcd80a0080 con 0x7fbcd80a0d70 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.106:6790/0 conn(0x7fbcd813df70 legacy=0x7fbcd81d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.171:6789/0 conn(0x7fbcd8134760 legacy=0x7fbcd8136d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 monclient: found mon.d 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:56.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcd813a2f0 con 0x7fbcd80a0d70 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 5 monclient: authenticate success, global_id 254166 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient: _renew_subs 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbcd8072500 con 0x7fbcd80a0d70 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient: _renew_subs 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbcd813dd90 con 0x7fbcd80a0d70 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbcc8001b20 con 0x7fbcd80a0d70 2024-04-26T00:08:56.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc8001d50 con 0x7fbcd80a0d70 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd6ffd640 4 set_mon_vals no callback set 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: dump: 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.588 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcbc0065d0 con 0x7fbcbc002870 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbcc800ff50 con 0x7fbcd80a0d70 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fbcc8045400 con 0x7fbcd80a0d70 2024-04-26T00:08:56.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcdc987640 10 monclient: get_auth_request con 0x7fbcb8037e90 auth_method 0 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3961192227 0 0) 0x7fbcbc0065d0 con 0x7fbcbc002870 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient(hunting): my global_id is 254129 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcd80a0080 con 0x7fbcbc002870 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4075683646 0 0) 0x7fbcd80a0080 con 0x7fbcbc002870 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcbc0065d0 con 0x7fbcbc002870 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc0001880 con 0x7fbcbc002870 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 10 monclient: dump: 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.590 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2086941855 0 0) 0x7fbcbc0065d0 con 0x7fbcbc002870 2024-04-26T00:08:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.590+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbcbc00a160 con 0x7fbcbc002870 2024-04-26T00:08:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.594+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbcc0004650 con 0x7fbcbc002870 2024-04-26T00:08:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.594+0000 7fbcd57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.594+0000 7fbcd57fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.594+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.171:6791/0 conn(0x7fbcbc002870 legacy=0x7fbcbc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.594+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.171:6791/0 conn(0x7fbcbc002870 legacy=0x7fbcbc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcde3ea640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbcbc009e50 con 0x7fbcbc009110 2024-04-26T00:08:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74010356 0 0) 0x7fbcbc009e50 con 0x7fbcbc009110 2024-04-26T00:08:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 10 monclient(hunting): my global_id is 254138 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbcbc0065d0 con 0x7fbcbc009110 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2563437913 0 0) 0x7fbcbc0065d0 con 0x7fbcbc009110 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbcbc009e50 con 0x7fbcbc009110 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbcc0001b30 con 0x7fbcbc009110 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.598+0000 7fbcd57fa640 10 monclient: dump: 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.594 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 470701515 0 0) 0x7fbcbc009e50 con 0x7fbcbc009110 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbcbc00c3e0 con 0x7fbcbc009110 2024-04-26T00:08:56.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2645866898) 0x7fbcc0004850 con 0x7fbcbc009110 2024-04-26T00:08:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcd57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcd57fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.171:6791/0 conn(0x7fbcbc009110 legacy=0x7fbcbc0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcd57fa640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.171:6791/0 conn(0x7fbcbc009110 legacy=0x7fbcbc0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.596 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:56.596 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 6659, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:56.597 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.598 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.599 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:56.600 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.601 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.604 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.607 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:56.609 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:56.610 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.613 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:56.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.615 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.616 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:56.616 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:56.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.171:6812/722422047 conn(0x7fbcb8037e90 legacy=0x7fbcb803a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 10 monclient: shutdown 2024-04-26T00:08:56.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 >> v1:172.21.15.106:6792/0 conn(0x7fbcd80a0d70 legacy=0x7fbcd8136610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcdc987640 1 -- 172.21.15.106:0/2273451848 reap_dead start 2024-04-26T00:08:56.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcdc987640 1 -- 172.21.15.106:0/2273451848 reap_dead start 2024-04-26T00:08:56.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 shutdown_connections 2024-04-26T00:08:56.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 >> 172.21.15.106:0/2273451848 conn(0x7fbcd80a7240 msgr2=0x7fbcd80a1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 shutdown_connections 2024-04-26T00:08:56.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.602+0000 7fbcde3ea640 1 -- 172.21.15.106:0/2273451848 wait complete. 2024-04-26T00:08:56.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:56.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:08:56.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:08:56.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.766+0000 7fc25210f640 10 monclient: get_monmap_and_config 2024-04-26T00:08:56.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.766+0000 7fc25210f640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.766+0000 7fc25210f640 10 monclient: monmap: 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:56.774106+0000 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:56.774106+0000 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.749 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.749 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.749 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.749 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.749 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 Processor -- start 2024-04-26T00:08:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- start start 2024-04-26T00:08:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient: init 2024-04-26T00:08:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient: _add_conns ranks=[3,0,4,2,7,5,6,8,1] 2024-04-26T00:08:56.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient(hunting): picked mon.noname-g con 0x7fc24c12dc60 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient(hunting): picked mon.noname-a con 0x7fc24c09ce30 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient(hunting): picked mon.noname-c con 0x7fc24c13dfa0 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c12e750 con 0x7fc24c09ce30 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c09beb0 con 0x7fc24c12dc60 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c09c190 con 0x7fc24c13dfa0 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient(hunting): authenticate will time out at 1792.301380s 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24affd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc24c09ce30 0x7fc24c13c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42854/0 (socket says 172.21.15.106:42854) 2024-04-26T00:08:56.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24affd640 1 -- 172.21.15.106:0/3232452890 learned_addr learned my addr 172.21.15.106:0/3232452890 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24bfff640 1 --1- 172.21.15.106:0/3232452890 >> v1:172.21.15.106:6791/0 conn(0x7fc24c13dfa0 0x7fc24c140390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40250/0 (socket says 172.21.15.106:40250) 2024-04-26T00:08:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966244410 0 0) 0x7fc24c09c190 con 0x7fc24c13dfa0 2024-04-26T00:08:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): my global_id is 254164 2024-04-26T00:08:56.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc238003530 con 0x7fc24c13dfa0 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1281224908 0 0) 0x7fc24c12e750 con 0x7fc24c09ce30 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): my global_id is 8172 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c09c190 con 0x7fc24c09ce30 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1776330108 0 0) 0x7fc24c09beb0 con 0x7fc24c12dc60 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient(hunting): my global_id is 214959 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c12e750 con 0x7fc24c12dc60 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 950761626 0 0) 0x7fc238003530 con 0x7fc24c13dfa0 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 >> v1:172.21.15.171:6790/0 conn(0x7fc24c12dc60 legacy=0x7fc24c12e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 >> v1:172.21.15.106:6789/0 conn(0x7fc24c09ce30 legacy=0x7fc24c13c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 monclient: found mon.noname-c 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c09c470 con 0x7fc24c13dfa0 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc244001a70 con 0x7fc24c13dfa0 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: dump: 2024-04-26T00:08:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.770 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 5 monclient: authenticate success, global_id 254164 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc244001d20 con 0x7fc24c13dfa0 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 1 -- 172.21.15.106:0/3232452890 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc244004eb0 con 0x7fc24c13dfa0 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc24a7fc640 10 monclient: dump: 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.772 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 4 set_mon_vals no callback set 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 10 monclient: shutdown 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- 172.21.15.106:0/3232452890 >> v1:172.21.15.106:6791/0 conn(0x7fc24c13dfa0 legacy=0x7fc24c140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- 172.21.15.106:0/3232452890 shutdown_connections 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- 172.21.15.106:0/3232452890 >> 172.21.15.106:0/3232452890 conn(0x7fc24c06b3e0 msgr2=0x7fc24c06b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- 172.21.15.106:0/3232452890 shutdown_connections 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.770+0000 7fc25210f640 1 -- 172.21.15.106:0/3232452890 wait complete. 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: monmap: 2024-04-26T00:08:56.773 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.774 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 Processor -- start 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 -- start start 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: init 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: _add_conns ranks=[3,0,7,1,5,2,6,4,8] 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient(hunting): picked mon.noname-g con 0x7fc24c09ce30 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient(hunting): picked mon.noname-a con 0x7fc24c12dc60 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient(hunting): picked mon.noname-i con 0x7fc24c13dfa0 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c09ff10 con 0x7fc24c12dc60 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c12cfa0 con 0x7fc24c09ce30 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc24c09da30 con 0x7fc24c13dfa0 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient(hunting): authenticate will time out at 1792.305070s 2024-04-26T00:08:56.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc24affd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fc24c12dc60 0x7fc24c1d1520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42862/0 (socket says 172.21.15.106:42862) 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc24affd640 1 -- 172.21.15.106:0/347678322 learned_addr learned my addr 172.21.15.106:0/347678322 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448321743 0 0) 0x7fc24c09ff10 con 0x7fc24c12dc60 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): my global_id is 8181 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc22c003530 con 0x7fc24c12dc60 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2233508831 0 0) 0x7fc24c12cfa0 con 0x7fc24c09ce30 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): my global_id is 214968 2024-04-26T00:08:56.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c09ff10 con 0x7fc24c09ce30 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3474038780 0 0) 0x7fc24c09da30 con 0x7fc24c13dfa0 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): my global_id is 146266 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c12cfa0 con 0x7fc24c13dfa0 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2751364022 0 0) 0x7fc22c003530 con 0x7fc24c12dc60 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc24c09da30 con 0x7fc24c12dc60 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc234001560 con 0x7fc24c12dc60 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:56.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): dump: 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.778 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2588201474 0 0) 0x7fc24c09ff10 con 0x7fc24c09ce30 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc22c003530 con 0x7fc24c09ce30 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc23c001a20 con 0x7fc24c09ce30 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): dump: 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.779 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.780 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.780 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.780 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.780 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.780 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.780 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.780 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.781 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.781 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.781 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.781 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.781 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1749415799 0 0) 0x7fc24c12cfa0 con 0x7fc24c13dfa0 2024-04-26T00:08:56.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc24c09ff10 con 0x7fc24c13dfa0 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc244004eb0 con 0x7fc24c13dfa0 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient(hunting): dump: 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.782 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2367762691 0 0) 0x7fc24c09da30 con 0x7fc24c12dc60 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.171:6792/0 conn(0x7fc24c13dfa0 legacy=0x7fc24c1d4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.171:6790/0 conn(0x7fc24c09ce30 legacy=0x7fc24c09f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 monclient: found mon.a 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:56.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc24c09dd10 con 0x7fc24c12dc60 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 5 monclient: authenticate success, global_id 8181 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: _renew_subs 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc24c136a50 con 0x7fc24c12dc60 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: _renew_subs 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fc24c12bb70 con 0x7fc24c12dc60 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc234004aa0 con 0x7fc24c12dc60 2024-04-26T00:08:56.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc234004f90 con 0x7fc24c12dc60 2024-04-26T00:08:56.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:56.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc249ffb640 4 set_mon_vals no callback set 2024-04-26T00:08:56.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 10 monclient: dump: 2024-04-26T00:08:56.785 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.785 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.786 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.786 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.786 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.786 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.786 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.786 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.786 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc23400fd30 con 0x7fc24c12dc60 2024-04-26T00:08:56.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fc234045140 con 0x7fc24c12dc60 2024-04-26T00:08:56.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc2300065d0 con 0x7fc230002870 2024-04-26T00:08:56.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.774+0000 7fc24b7fe640 10 monclient: get_auth_request con 0x7fc22c038250 auth_method 0 2024-04-26T00:08:56.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4027603978 0 0) 0x7fc2300065d0 con 0x7fc230002870 2024-04-26T00:08:56.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient(hunting): my global_id is 146275 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc24c09da30 con 0x7fc230002870 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 995233896 0 0) 0x7fc24c09da30 con 0x7fc230002870 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2300065d0 con 0x7fc230002870 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc244001a50 con 0x7fc230002870 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient: dump: 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.789 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.790 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.791 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.791 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.791 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 147104231 0 0) 0x7fc2300065d0 con 0x7fc230002870 2024-04-26T00:08:56.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc23000a160 con 0x7fc230002870 2024-04-26T00:08:56.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc2440071e0 con 0x7fc230002870 2024-04-26T00:08:56.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:56.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.171:6792/0 conn(0x7fc230002870 legacy=0x7fc230004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.778+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.171:6792/0 conn(0x7fc230002870 legacy=0x7fc230004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:56.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc230009e50 con 0x7fc230009110 2024-04-26T00:08:56.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2252228104 0 0) 0x7fc230009e50 con 0x7fc230009110 2024-04-26T00:08:56.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient(hunting): my global_id is 146284 2024-04-26T00:08:56.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2300065d0 con 0x7fc230009110 2024-04-26T00:08:56.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1156536513 0 0) 0x7fc2300065d0 con 0x7fc230009110 2024-04-26T00:08:56.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc230009e50 con 0x7fc230009110 2024-04-26T00:08:56.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc244005810 con 0x7fc230009110 2024-04-26T00:08:56.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:08:56.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient: dump: 2024-04-26T00:08:56.797 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.797 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.797 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.797 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.797 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.797 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1119842924 0 0) 0x7fc230009e50 con 0x7fc230009110 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc23000c3e0 con 0x7fc230009110 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1518310821) 0x7fc24400a180 con 0x7fc230009110 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:56.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.171:6792/0 conn(0x7fc230009110 legacy=0x7fc2300095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc243fff640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.171:6792/0 conn(0x7fc230009110 legacy=0x7fc2300095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 600324, 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:56.799 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.800 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.801 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:56.802 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:56.803 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:56.804 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:56.806 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.807 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.808 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.809 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.810 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:56.812 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.813 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:56.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:56.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:56.816 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.171:6812/722422047 conn(0x7fc22c038250 legacy=0x7fc22c03a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 10 monclient: shutdown 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 >> v1:172.21.15.106:6789/0 conn(0x7fc24c12dc60 legacy=0x7fc24c1d1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc24bfff640 1 -- 172.21.15.106:0/347678322 reap_dead start 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 shutdown_connections 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 >> 172.21.15.106:0/347678322 conn(0x7fc24c06b3e0 msgr2=0x7fc24c1374b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 shutdown_connections 2024-04-26T00:08:56.818 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.790+0000 7fc25210f640 1 -- 172.21.15.106:0/347678322 wait complete. 2024-04-26T00:08:56.819 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:56.819 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:08:56.819 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:08:56.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.950+0000 7f9b1a467640 10 monclient: get_monmap_and_config 2024-04-26T00:08:56.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.950+0000 7f9b1a467640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.950+0000 7f9b1a467640 10 monclient: monmap: 2024-04-26T00:08:56.930 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.930 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.930 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:56.957066+0000 2024-04-26T00:08:56.930 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:56.957066+0000 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.931 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.950+0000 7f9b1a467640 1 Processor -- start 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.950+0000 7f9b1a467640 1 -- start start 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.950+0000 7f9b1a467640 10 monclient: init 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _add_conns ranks=[0,7,3,2,5,4,1,6,8] 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): picked mon.noname-a con 0x7f9b14134760 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): picked mon.noname-i con 0x7f9b140a0d70 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): picked mon.noname-g con 0x7f9b1413df70 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1406b910 con 0x7f9b14134760 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b1409fac0 con 0x7f9b1413df70 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b140a0080 con 0x7f9b140a0d70 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): authenticate will time out at 1792.484198s 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b13fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9b14134760 0x7f9b14134b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42878/0 (socket says 172.21.15.106:42878) 2024-04-26T00:08:56.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b13fff640 1 -- 172.21.15.106:0/1160888109 learned_addr learned my addr 172.21.15.106:0/1160888109 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229788365 0 0) 0x7f9b1406b910 con 0x7f9b14134760 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient(hunting): my global_id is 8190 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b00003530 con 0x7f9b14134760 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3438805871 0 0) 0x7f9b00003530 con 0x7f9b14134760 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 >> v1:172.21.15.171:6792/0 conn(0x7f9b140a0d70 legacy=0x7f9b1413c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 >> v1:172.21.15.171:6790/0 conn(0x7f9b1413df70 legacy=0x7f9b14140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 monclient: found mon.noname-a 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1409f280 con 0x7f9b14134760 2024-04-26T00:08:56.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 5 monclient: authenticate success, global_id 8190 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9afc0017c0 con 0x7f9b14134760 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: dump: 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.940 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9afc001b20 con 0x7f9b14134760 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 4 set_mon_vals no callback set 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 1 -- 172.21.15.106:0/1160888109 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9afc001d50 con 0x7f9b14134760 2024-04-26T00:08:56.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b12ffd640 10 monclient: dump: 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.942 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: shutdown 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- 172.21.15.106:0/1160888109 >> v1:172.21.15.106:6789/0 conn(0x7f9b14134760 legacy=0x7f9b14134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- 172.21.15.106:0/1160888109 shutdown_connections 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- 172.21.15.106:0/1160888109 >> 172.21.15.106:0/1160888109 conn(0x7f9b140a7240 msgr2=0x7f9b140a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- 172.21.15.106:0/1160888109 shutdown_connections 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- 172.21.15.106:0/1160888109 wait complete. 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: build_initial_monmap 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: monmap: 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:56.943 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 Processor -- start 2024-04-26T00:08:56.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- start start 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: init 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _add_conns ranks=[4,1,7,3,8,2,5,0,6] 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): picked mon.noname-c con 0x7f9b140a0d70 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): picked mon.noname-f con 0x7f9b14134760 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): picked mon.noname-i con 0x7f9b1413df70 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b14139af0 con 0x7f9b14134760 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b14072930 con 0x7f9b140a0d70 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b141393f0 con 0x7f9b1413df70 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient(hunting): authenticate will time out at 1792.487092s 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b13fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9b140a0d70 0x7f9b141359f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40266/0 (socket says 172.21.15.106:40266) 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b13fff640 1 -- 172.21.15.106:0/2886412580 learned_addr learned my addr 172.21.15.106:0/2886412580 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1852014874 0 0) 0x7f9b1409f280 con 0x7f9b140a0d70 2024-04-26T00:08:56.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): my global_id is 254173 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af4003530 con 0x7f9b140a0d70 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 459626508 0 0) 0x7f9af4003530 con 0x7f9b140a0d70 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9b1409f280 con 0x7f9b140a0d70 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9afc001780 con 0x7f9b140a0d70 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.946 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931861089 0 0) 0x7f9b141393f0 con 0x7f9b1413df70 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:56.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient(hunting): my global_id is 146302 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9af4003530 con 0x7f9b1413df70 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3469132903 0 0) 0x7f9b1409f280 con 0x7f9b140a0d70 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 >> v1:172.21.15.171:6792/0 conn(0x7f9b1413df70 legacy=0x7f9b141d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 >> v1:172.21.15.171:6789/0 conn(0x7f9b14134760 legacy=0x7f9b14136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 monclient: found mon.c 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b14072500 con 0x7f9b140a0d70 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient: _finish_auth 0 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b10ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 5 monclient: authenticate success, global_id 254173 2024-04-26T00:08:56.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _renew_subs 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9b141396d0 con 0x7f9b140a0d70 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _renew_subs 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.954+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9b14136810 con 0x7f9b140a0d70 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9afc005010 con 0x7f9b140a0d70 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9afc005500 con 0x7f9b140a0d70 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b127fc640 4 set_mon_vals no callback set 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 10 monclient: dump: 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:56.949 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:56.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9afc0102a0 con 0x7f9b140a0d70 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b1a467640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b1a467640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b1a467640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f9afc045310 con 0x7f9b140a0d70 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9af8005090 con 0x7f9b140a0d70 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.958+0000 7f9b137fe640 10 monclient: get_auth_request con 0x7f9af4037870 auth_method 0 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.962+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9b14072930 con 0x7f9b140a0d70 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.962+0000 7f9b10ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:56.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:56.962+0000 7f9b10ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:57.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.186+0000 7f9b1a467640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:08:57.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.186+0000 7f9b1a467640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:08:57.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.186+0000 7f9b1a467640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:57.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.186+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f9af8005b90 con 0x7f9b140a0d70 2024-04-26T00:08:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f9b10ff9640 1 -- 172.21.15.106:0/2886412580 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f9afc015aa0 con 0x7f9b140a0d70 2024-04-26T00:08:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f9b10ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:08:57.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f9b10ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:57.169 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=29,config=2,health=12,kv=11,logm=46} crc {auth=1112997330,config=692619927,health=2705715716,kv=4113770424,logm=4106596398}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=26,config=2,health=12,kv=10,logm=50} crc {auth=1343491987,config=692619927,health=2705715716,kv=3123767853,logm=2650189562}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=24,config=1,health=12,kv=12,logm=51} crc {auth=3476802390,config=3678701417,health=2705715716,kv=1996692365,logm=1149003380}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=53483596,config=692619927,health=446106456,kv=1996692365,logm=3940106635}) 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.170 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=29,config=2,health=12,kv=12,logm=45} crc {auth=1112997330,config=692619927,health=1748367016,kv=1996692365,logm=2499749044}) 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=28,config=2,health=12,kv=11,logm=47} crc {auth=1509900719,config=692619927,health=2705715716,kv=1480003351,logm=1380148790}) 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=29,config=2,health=12,kv=11,logm=46} crc {auth=1112997330,config=692619927,health=2969498745,kv=372875433,logm=1237432016}) 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=26,config=2,health=12,kv=12,logm=48} crc {auth=2767735674,config=692619927,health=2705715716,kv=1996692365,logm=1024152950}) 2024-04-26T00:08:57.171 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.190+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=28,config=2,health=12,kv=11,logm=47} crc {auth=428375770,config=692619927,health=2705715716,kv=2486284834,logm=3921982692}) 2024-04-26T00:08:57.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 >> v1:172.21.15.171:6812/722422047 conn(0x7f9af4037870 legacy=0x7f9af4039d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:57.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 10 monclient: shutdown 2024-04-26T00:08:57.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:57.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 >> v1:172.21.15.106:6791/0 conn(0x7f9b140a0d70 legacy=0x7f9b141359f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:57.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 shutdown_connections 2024-04-26T00:08:57.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 >> 172.21.15.106:0/2886412580 conn(0x7f9b140a7240 msgr2=0x7f9b140a5f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:57.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 shutdown_connections 2024-04-26T00:08:57.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f9b1a467640 1 -- 172.21.15.106:0/2886412580 wait complete. 2024-04-26T00:08:57.175 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.175 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3845434979}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1690774328}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=8255385}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3235090835}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2144821541}) 2024-04-26T00:08:57.176 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4078453226}) 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1032597843}) 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=914505505}) 2024-04-26T00:08:57.177 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.194+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3890788216}) 2024-04-26T00:08:57.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3329508964}) 2024-04-26T00:08:57.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1828160533}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3125942684}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=799605594}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2377505926}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2728287918}) 2024-04-26T00:08:57.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.181 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.181 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=54603856}) 2024-04-26T00:08:57.181 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.181 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3589403776}) 2024-04-26T00:08:57.181 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.198+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=978611493}) 2024-04-26T00:08:57.185 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.185 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.185 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3778658016}) 2024-04-26T00:08:57.185 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1882690529}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2094167212}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2888545830}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2264689941}) 2024-04-26T00:08:57.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3238218112}) 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=399037349}) 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=532013493}) 2024-04-26T00:08:57.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.206+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1388276703}) 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3864758857}) 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3729734657}) 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.190 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=368905296}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=803603315}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=545586747}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2421663995}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=129426528}) 2024-04-26T00:08:57.191 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.192 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3597688761}) 2024-04-26T00:08:57.192 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.210+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2168460205}) 2024-04-26T00:08:57.193 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:08:57.195 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.195 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.195 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=570683922}) 2024-04-26T00:08:57.195 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.195 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2514029852}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=999570207}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2723847872}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2576100539}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=676938882}) 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.196 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.197 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2210133724}) 2024-04-26T00:08:57.197 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.197 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3747721687}) 2024-04-26T00:08:57.197 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.214+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2975504416}) 2024-04-26T00:08:57.201 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1601962092}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2121449664}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3486072235}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2469571291}) 2024-04-26T00:08:57.202 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2434489135}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=733598454}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1348010356}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1021041669}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.218+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=542166076}) 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.203 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1179170768}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3538504528}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=423595533}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=403776141}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3602760711}) 2024-04-26T00:08:57.204 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2544445745}) 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3002838625}) 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2290877908}) 2024-04-26T00:08:57.205 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1514550043}) 2024-04-26T00:08:57.211 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.211 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.211 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1734666431}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4016143923}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.222+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=262915027}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1569401992}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.212 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=422551365}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2124532690}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1802318165}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1165777316}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2380647668}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.213 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1986473737}) 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=776267802}) 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2771097343}) 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.214 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2316214486}) 2024-04-26T00:08:57.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3731202827}) 2024-04-26T00:08:57.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1328221692}) 2024-04-26T00:08:57.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=471187306}) 2024-04-26T00:08:57.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.217 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1562500001}) 2024-04-26T00:08:57.217 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.226+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=842007181}) 2024-04-26T00:08:57.217 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.217 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=417157481}) 2024-04-26T00:08:57.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3918637164}) 2024-04-26T00:08:57.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3739996806}) 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3455054969}) 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1409338801}) 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=357789242}) 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.220 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1785500890}) 2024-04-26T00:08:57.220 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.220 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1083307313}) 2024-04-26T00:08:57.220 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.230+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=827431732}) 2024-04-26T00:08:57.241 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4247180118}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2755854641}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2307208792}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3474946341}) 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.242 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3916591659}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=920652605}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1427569027}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3635158129}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.234+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3386566463}) 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.243 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3407939416}) 2024-04-26T00:08:57.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=456595574}) 2024-04-26T00:08:57.244 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3951859380}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1535005266}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=678315938}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4048238848}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=680765109}) 2024-04-26T00:08:57.245 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2272424726}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.238+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3785240617}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=879781435}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4060008737}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3504708730}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.246 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2540074480}) 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3632385633}) 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3952148928}) 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=532451227}) 2024-04-26T00:08:57.247 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2210890676}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.242+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3348872035}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1741018524}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=843396625}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4065073565}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2015757510}) 2024-04-26T00:08:57.248 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=325802788}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2147060466}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1550022675}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1379364829}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=499975136}) 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2732599931}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1777472213}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3667392187}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=179066196}) 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=665586026}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1601671475}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=656141524}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794585290}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.246+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=483660609}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3014358846}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4090430028}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=188954121}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1485959779}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2484571849}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2878578589}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2550467747}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1626070805}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.250+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2171879557}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1219221935}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3908647596}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=507804796}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3329999640}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1052501460}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2665628220}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=832316080}) 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3980747007}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.254+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4169560474}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=491455740}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=716452890}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1707772628}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1101321174}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=809970317}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1356121079}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4199683886}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3800529765}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=508363913}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4008846798}) 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2163418135}) 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.258+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1093131096}) 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1402414548}) 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2448999467}) 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=723493641}) 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1146551136}) 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=517062777}) 2024-04-26T00:08:57.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=691391180}) 2024-04-26T00:08:57.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2274414951}) 2024-04-26T00:08:57.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2527624150}) 2024-04-26T00:08:57.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3939453536}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3433288321}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=184001829}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3871485539}) 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155443949}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=800002080}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.262+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3553277622}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3060709315}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1592659635}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=528692558}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1557126233}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3325604041}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2770175839}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2230719007}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2854349054}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.266+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2686436555}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3457515080}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1758758155}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1288764113}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=430838636}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3979812022}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=57774262}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3599739825}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1028354368}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3337859463}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=812086529}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1459898692}) 2024-04-26T00:08:57.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2804300972}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3929429448}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1133242634}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2661842656}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1271871621}) 2024-04-26T00:08:57.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2884121760}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.270+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=89859867}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2549417409}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2884832589}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1261844270}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2777506039}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=308480538}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2943660126}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=13670132}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=302415688}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.274+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3061169139}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3731852130}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4122312139}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=366736096}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=746005885}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=899909388}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1583507676}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2761517245}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2711846110}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1972802022}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4162329602}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2164358389}) 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1823645509}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=885788613}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3321782243}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4289570252}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=235184556}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1210988132}) 2024-04-26T00:08:57.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.278+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2654269196}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2454795328}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2635428810}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2039412596}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2395812425}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2221677416}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=644546237}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3912372534}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4070009715}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.282+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=312645572}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1110584366}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2440980822}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=129433579}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1459209628}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2052050341}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=675109455}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=634712811}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4268248367}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.286+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3080064631}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3159724147}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2310635237}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=696353709}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1805167537}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3907802164}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4177785409}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=783253452}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1856985769}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=225069225}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3938209034}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2532405016}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=324077664}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2164865785}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3998131052}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2512177933}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=478650890}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4171519875}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.290+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1109891750}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3232760801}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1294937294}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2539858291}) 2024-04-26T00:08:57.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2845481914}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1432230812}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=415194311}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3959118216}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=448756480}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=998323871}) 2024-04-26T00:08:57.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3846878612}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4256142368}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=43978806}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1858100870}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1227085287}) 2024-04-26T00:08:57.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2560499074}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=120291256}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3126436713}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.294+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=347737770}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2660251556}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=403402950}) 2024-04-26T00:08:57.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2148574657}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2673980804}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3904857802}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3845151640}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1631502464}) 2024-04-26T00:08:57.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4139678130}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=696212520}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3372674132}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2787561005}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.298+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2215805442}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1589159651}) 2024-04-26T00:08:57.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3237074373}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1751438192}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3634817379}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=697147480}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=617132126}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2201444681}) 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3387867237}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3858819360}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3326972326}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4037246791}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3824155026}) 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2189662090}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=133281537}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.302+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=74386745}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2261619940}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1247323879}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3183863962}) 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2791796091}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=713561833}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2883003031}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3285793535}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=859565126}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1467337067}) 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2135619128}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3948864522}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4017298027}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2728785742}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3053857388}) 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3548980771}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=515023304}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702359599}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.306+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=598707878}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1769897513}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1744153258}) 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2955846463}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1764794710}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=821896527}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4241071469}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2987515139}) 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3659318156}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3085607241}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1417058910}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3418481126}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=714309165}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2430858129}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=753811115}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=204028623}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=513370523}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1107885890}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.310+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3619659488}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1717665367}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2998999193}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3917949636}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=955617647}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1319612178}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1116956929}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=709549729}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3733493705}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3071231014}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3922304391}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3079263865}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4043192558}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.314+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3564141464}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=864302406}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4006993624}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2843498384}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4150584469}) 2024-04-26T00:08:57.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2070214394}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1669529611}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=101339063}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3066901182}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2984246633}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=904927492}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4108930188}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=526835338}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2088011712}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.318+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4107041714}) 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3189479545}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3542135327}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=616624923}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=783200208}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3070004238}) 2024-04-26T00:08:57.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=417033309}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4242522778}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3957828258}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2400739659}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1997875774}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1275123400}) 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1036772776}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2872670633}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3425788388}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2741750078}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3773106671}) 2024-04-26T00:08:57.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1795087842}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.322+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2047838032}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=57907207}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2076577273}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2404275661}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2189841200}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1768099122}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2522854125}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1755859345}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697776297}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4187700358}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1787438080}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=667476222}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3934075901}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3986732707}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3685789915}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2888248495}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4266229009}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2754086076}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.326+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4001985782}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1746011769}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3233485054}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2049883039}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4157548399}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1938833945}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3466856065}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2436971137}) 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2503935305}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.330+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=788018955}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=616861217}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2836080085}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1543009039}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3434538764}) 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3213380618}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1555624743}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3764355047}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3495700116}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=238486936}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=13432826}) 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=734076777}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2944000195}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3262039763}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1359533705}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3051042737}) 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2086845439}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=809775524}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.334+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=203862605}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3179240386}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4147577107}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2007877193}) 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2878820900}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2016467304}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2823119186}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375368459}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=350622948}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=690906941}) 2024-04-26T00:08:57.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1529473842}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2644410410}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4139976955}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3230344604}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1610123824}) 2024-04-26T00:08:57.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=343573700}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4273639091}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1517098064}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.338+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1824415367}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2237945236}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1076472463}) 2024-04-26T00:08:57.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4060613334}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3485212189}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3749163635}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2560141865}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=561249801}) 2024-04-26T00:08:57.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1527402489}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.342+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4108098201}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3797963553}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3115348976}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2078526602}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2871851676}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3082499619}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3474603301}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4269925279}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=904080539}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3775058322}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=175040777}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2373824034}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1920793597}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=155048794}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4030227797}) 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4021694217}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3392871113}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230414115}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.346+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2582391562}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1541125423}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2609290147}) 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3555560069}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=430538582}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1802611921}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2073799468}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=91679747}) 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2419392767}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.350+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2317257082}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=628868756}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3415592334}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=128263639}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1129784073}) 2024-04-26T00:08:57.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3003526058}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2258469211}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=767407596}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2420668829}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3114295792}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3549145128}) 2024-04-26T00:08:57.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3953296565}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1867983997}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=55228674}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2140960140}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3354012780}) 2024-04-26T00:08:57.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=864588448}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=105536838}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.354+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3112014974}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2145390919}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3025588785}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2277316104}) 2024-04-26T00:08:57.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3218462329}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2464971458}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3338590721}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3897425610}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=492134457}) 2024-04-26T00:08:57.527 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1405315010}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=648029720}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1868113565}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2683074593}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1233953624}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.528 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=146933676}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1661452384}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3202488194}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3686197542}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.358+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3614357081}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1851080392}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.529 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2225989883}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1842089189}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2221801733}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3965410064}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1957320836}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.530 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2620663557}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=531322281}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2618229776}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2167399260}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.362+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1524652958}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=197282931}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.531 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3007680880}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2391600265}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=418206809}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=882364319}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=620242974}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4025012585}) 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.532 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3484791385}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1676084845}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3809426283}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3600183582}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2394986035}) 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.533 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3907465143}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3155780636}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1226390645}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.366+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=12970849}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=279580247}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2521995480}) 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.534 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4158867395}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=107282474}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2896186008}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=737900103}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2366003639}) 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.535 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2222260616}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3104051503}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3683889329}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1863666164}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2405503779}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=683463633}) 2024-04-26T00:08:57.536 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1297042648}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4183503049}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4243342769}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1521182841}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.370+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2712741716}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2439648325}) 2024-04-26T00:08:57.537 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=160594778}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1602216570}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=513462034}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=550312281}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2133316786}) 2024-04-26T00:08:57.538 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=363442407}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1294707346}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=575078677}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=197648307}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=907500490}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.539 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2834045890}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1949866568}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1564882645}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3117562408}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1856438258}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=872559215}) 2024-04-26T00:08:57.540 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.374+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=694881581}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=781567547}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2396503195}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=785854885}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1425373332}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.541 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=505411384}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=676613027}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2009277078}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1272628080}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2429619359}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2733541131}) 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.542 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=500602029}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1482488762}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3315806384}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1676118246}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2936996635}) 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.543 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3071921461}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581380968}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.378+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2546601953}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2893433300}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2563688988}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3031216080}) 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.544 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=979303645}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=184129377}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2434877551}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3578168552}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2156282401}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4288283733}) 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.545 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=363874822}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=773907167}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=687498673}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=467109123}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3890563248}) 2024-04-26T00:08:57.546 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4268476725}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3065617815}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3459057315}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.382+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2507382707}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=388229993}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3007124350}) 2024-04-26T00:08:57.547 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4014189115}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1847819834}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3538808090}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2211052704}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1589315173}) 2024-04-26T00:08:57.548 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=402503416}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2415735482}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2986846548}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1306439200}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2428310948}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1046048878}) 2024-04-26T00:08:57.549 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1090621493}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2718855868}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=974138211}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1894679434}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.386+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=680398087}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.550 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1124344012}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3386810455}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3354982637}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3925504637}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2943549459}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.551 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1003193325}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1633634412}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2544896762}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=382853872}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2763035256}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.390+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4282284760}) 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.552 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=795791681}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=719690638}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=753259974}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1408265980}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1096789283}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=744048934}) 2024-04-26T00:08:57.553 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2886272138}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2205964683}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3888997305}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4278249255}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2321582003}) 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.554 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1841605069}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3010179551}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3116119073}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4103220857}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.394+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3393859172}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1928427948}) 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.555 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=425565099}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1204755130}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2458995420}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3182931867}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3865542497}) 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.556 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3646906093}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1431498395}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.398+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1838477059}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2342507591}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2044308059}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2850456343}) 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.557 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2941326745}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1652543444}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3362855608}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4214023950}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3835358492}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1505123485}) 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.558 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=61600904}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2066887091}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2105052996}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3166945754}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2583281136}) 2024-04-26T00:08:57.559 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=224171880}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=840636807}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2747585355}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.402+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=848435534}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3473034079}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=386747591}) 2024-04-26T00:08:57.560 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4173893919}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3182486614}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=164661420}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1525123942}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=877716405}) 2024-04-26T00:08:57.561 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1031989465}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1332346197}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=703608337}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1152829556}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3049968420}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.562 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1392315551}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=288823153}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=789881939}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3025939778}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3623797926}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.406+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=827771930}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.563 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=763673061}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2347697185}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1287009457}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3375897299}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3783419064}) 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.564 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=690373077}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3705367203}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3625331282}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2438866167}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3581628539}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2457662067}) 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.565 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2854936766}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=789752090}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3968971102}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3338800319}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.410+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3866875975}) 2024-04-26T00:08:57.566 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3324372725}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1493599325}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3943353196}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3780299681}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2864077997}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4279998705}) 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.567 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=852800273}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2913367114}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=671326772}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2301975623}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.414+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2958332953}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1163514409}) 2024-04-26T00:08:57.568 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1720242452}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3608577617}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1685732505}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3084741702}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2592215885}) 2024-04-26T00:08:57.569 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1043671068}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2794100718}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2285326255}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=316275502}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2936881204}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1049729073}) 2024-04-26T00:08:57.570 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4059124459}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2633119721}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3335892332}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1358489170}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4230485512}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2294211627}) 2024-04-26T00:08:57.571 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.418+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2419153493}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2569519777}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3884407353}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3317910778}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3454215489}) 2024-04-26T00:08:57.572 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1970149674}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4279611516}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1864416828}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2571489643}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1050071220}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.573 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1186307744}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3850798374}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3188486894}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3558035461}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3638775588}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.574 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=29462164}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3533127253}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.422+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3531523211}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=174413894}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3635726467}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1921950661}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.575 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1893517308}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3567447027}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3232838950}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=656005122}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=90947636}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3877321275}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.576 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3538521917}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=466764724}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3525353854}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3665538423}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1261856839}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.577 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=882712332}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3841438039}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2451679769}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.426+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=263375929}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4134835518}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=728550209}) 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.578 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=106845709}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1656734317}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=716903761}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1752253294}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2775832557}) 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.579 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4029943436}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2727349417}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=825257444}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1235018579}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1220162395}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4242275466}) 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.580 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3549754162}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3131111567}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3085463742}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3475601735}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.430+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=132122574}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=928853993}) 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.581 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=841666961}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2656270745}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=318131800}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=711239359}) 2024-04-26T00:08:57.582 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3418004192}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1546091808}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2874742113}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.434+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1887776562}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1647082316}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3672295955}) 2024-04-26T00:08:57.583 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3376790932}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=668196431}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2006449423}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1957359029}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1737443442}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3285829448}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=724172916}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1663482143}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=742043993}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=298077251}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1505687922}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3900035958}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1331616076}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2719305194}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2911857115}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.438+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4137745956}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1581168505}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=520133955}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3364050945}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2164011630}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4036356342}) 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4197485501}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=74551999}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2215403121}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4014304784}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3030529224}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1588363765}) 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2068687709}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1515580113}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1403841784}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3948508469}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2618617731}) 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2002120874}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.442+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=672762674}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1759978619}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2948970106}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4059237002}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=350864476}) 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1104903151}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1358853030}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3730860054}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1196782065}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=561150060}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2247040083}) 2024-04-26T00:08:57.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3014162114}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1726596398}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=821902904}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3908329960}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=89509475}) 2024-04-26T00:08:57.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3413406958}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=702846346}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.446+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1186882395}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1229761899}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3355602780}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1450890830}) 2024-04-26T00:08:57.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2497677577}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=805816396}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2112674921}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3835387502}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3885076833}) 2024-04-26T00:08:57.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1414758404}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2531911278}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2638951543}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2582976906}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=534278094}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2761071610}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=412005687}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=9166765}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2693292591}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.450+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2347502592}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1413909930}) 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3382109104}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3697496633}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1483992014}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=898495684}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1931899463}) 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4201128907}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=701658680}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=653711021}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3546934276}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2906021033}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1032211613}) 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=643054019}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3007136995}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=258603192}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4223369158}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3493642127}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.454+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1176447933}) 2024-04-26T00:08:57.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=956182269}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=316585774}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1480485008}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3452601477}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3908816850}) 2024-04-26T00:08:57.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1010766102}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3147884845}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563825403}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4243770514}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3687729801}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4034030246}) 2024-04-26T00:08:57.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2476100639}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1020777926}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3017495587}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2654304123}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=447742952}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2733141777}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.458+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1477299541}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2337390733}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4185281638}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4083687115}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=710223809}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2091529061}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2866030853}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3247596914}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1779180123}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3796691189}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1463220219}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=315427783}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1445970190}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1135217016}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=585818196}) 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2160884148}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2903103597}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=332322351}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.462+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=498457698}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=392079060}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3595326493}) 2024-04-26T00:08:57.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4210954384}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=293789650}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1063238700}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1892117983}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3084137199}) 2024-04-26T00:08:57.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650827650}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3822512413}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3033050304}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1138585728}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2018533322}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=954925321}) 2024-04-26T00:08:57.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1547319111}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1892992070}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2702765878}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2214295380}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.466+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1754576586}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3484857484}) 2024-04-26T00:08:57.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3515633076}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2197667500}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3535540497}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=700955267}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3542915422}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=535088457}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2998573904}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3482198875}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1799267171}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1591045120}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2324021067}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3043911983}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3620866252}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=623553752}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2339228447}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3507801233}) 2024-04-26T00:08:57.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.470+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1605255313}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=324606077}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1094489995}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3836385202}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1146379458}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2350607768}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=405043108}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1011909485}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4134519288}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2643479742}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1873066980}) 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2699352693}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1950509867}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3756816176}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4073986742}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2624428189}) 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2439705076}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3080989947}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.474+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3243429323}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3282775764}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3840907019}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3615245422}) 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3328751371}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3604199555}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2437368253}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3077099063}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3321802407}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=672383333}) 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=528029844}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2853674539}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1288812903}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=835152549}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4525762}) 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=688099494}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2665663023}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1520144434}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.478+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=29630477}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1444144324}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1406552961}) 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1632713012}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1865022004}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1017225288}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3582045062}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3430799449}) 2024-04-26T00:08:57.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1203633976}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1864798040}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2481780926}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=52449043}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=604619259}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3150472111}) 2024-04-26T00:08:57.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=366819336}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1094134020}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4010467826}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3035865888}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.482+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=357570631}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3877585931}) 2024-04-26T00:08:57.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3921729569}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1351380318}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1748686361}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3221145145}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=812967917}) 2024-04-26T00:08:57.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=415017928}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1032015860}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1924849594}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3320977213}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=495653558}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3844187325}) 2024-04-26T00:08:57.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3190958123}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=66672383}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2655719100}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=990839752}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1140356975}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.486+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=486546447}) 2024-04-26T00:08:57.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3235843566}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3295271736}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2424865803}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4144932128}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=263368318}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3003466938}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=915529873}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3155004745}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4145694979}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=371945464}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2369092456}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2223627741}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3227083609}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1271813809}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3939465569}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1275915494}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3413740095}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.490+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=109569136}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1243664627}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=106784141}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1909884037}) 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3942352887}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2388550036}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2341300442}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=936892020}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1753544619}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3246971793}) 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=519094630}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=176603078}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=614809179}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2712614007}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4091242020}) 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2409966682}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2513047770}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=272013046}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.494+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2019292566}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=8,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=3,osd_metadata=5,osdmap=54} crc {logm=3072559128,mdsmap=1401145748,mgr=3261276571,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3092537503,mon_config_key=809949667,monmap=828017138,osd_metadata=1939088786,osdmap=3119177646}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=6,mon_config_key=9,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=55} crc {logm=2175487544,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=838490186,mon_config_key=3034661034,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=998577210}) 2024-04-26T00:08:57.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=9,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=51} crc {logm=2180340864,mdsmap=2840952586,mgr=2375242210,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3092537503,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=405412874}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=9,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=6,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=53} crc {logm=2180340864,mdsmap=1401145748,mgr=119571008,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3694909753,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=3042210651}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=9,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=50} crc {logm=2180340864,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=4245899301,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=2137336827}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=9,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=6,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=53} crc {logm=2180340864,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1654571417,mon_config_key=3430297671,monmap=375078350,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=3379843797}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=9,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=51} crc {logm=2180340864,mdsmap=2840952586,mgr=1247598456,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1354150355,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=2102325774}) 2024-04-26T00:08:57.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=8,mdsmap=2,mgr=8,mgr_metadata=1,mgrstat=8,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=54} crc {logm=23449100,mdsmap=1401145748,mgr=1156056737,mgr_metadata=177654402,mgrstat=1108174235,mon_config_key=1003196044,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1420523618}) 2024-04-26T00:08:57.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.498+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=7,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=11,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=53} crc {logm=734153524,mdsmap=2840952586,mgr=2375242210,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3092537503,mon_config_key=809949667,monmap=375078350,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=2153854217}) 2024-04-26T00:08:57.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.510+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:08:57.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.510+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=5} crc {osdmap=3084497416}) 2024-04-26T00:08:57.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:08:57.510+0000 7f5cf9f98640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=4} crc {osdmap=1730155538}) 2024-04-26T00:08:58.194 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:08:58.194 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:08:58.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient: get_monmap_and_config 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient: build_initial_monmap 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient: monmap: 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:58.367988+0000 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:58.367988+0000 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:58.342 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 1 Processor -- start 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 1 -- start start 2024-04-26T00:08:58.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient: init 2024-04-26T00:08:58.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient: _add_conns ranks=[1,0,6,3,8,5,2,7,4] 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient(hunting): picked mon.noname-f con 0x7fbaa8137c40 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient(hunting): picked mon.noname-a con 0x7fbaa809fca0 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient(hunting): picked mon.noname-d con 0x7fbaa8137570 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa806ee10 con 0x7fbaa809fca0 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa80a2220 con 0x7fbaa8137c40 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa806f0f0 con 0x7fbaa8137570 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient(hunting): authenticate will time out at 1793.894966s 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fba9e59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbaa809fca0 0x7fbaa80a1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42890/0 (socket says 172.21.15.106:42890) 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa759e640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fbaa8137570 0x7fbaa81408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45790/0 (socket says 172.21.15.106:45790) 2024-04-26T00:08:58.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fba9e59c640 1 -- 172.21.15.106:0/1747965894 learned_addr learned my addr 172.21.15.106:0/1747965894 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977372174 0 0) 0x7fba90001120 con 0x7fbaa809fca0 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): my global_id is 8199 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba94003530 con 0x7fbaa809fca0 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3739050420 0 0) 0x7fbaa806f0f0 con 0x7fbaa8137570 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient(hunting): my global_id is 254175 2024-04-26T00:08:58.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba90001120 con 0x7fbaa8137570 2024-04-26T00:08:58.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3158440038 0 0) 0x7fba94003530 con 0x7fbaa809fca0 2024-04-26T00:08:58.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 >> v1:172.21.15.106:6792/0 conn(0x7fbaa8137570 legacy=0x7fbaa81408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 >> v1:172.21.15.171:6789/0 conn(0x7fbaa8137c40 legacy=0x7fbaa80a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: _finish_hunting 0 2024-04-26T00:08:58.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 monclient: found mon.noname-a 2024-04-26T00:08:58.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:58.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa806f3d0 con 0x7fbaa809fca0 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: _finish_auth 0 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: _check_auth_tickets 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fba90001990 con 0x7fbaa809fca0 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 5 monclient: authenticate success, global_id 8199 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: dump: 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.355 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fba90001bc0 con 0x7fbaa809fca0 2024-04-26T00:08:58.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 1 -- 172.21.15.106:0/1747965894 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fba90004bf0 con 0x7fbaa809fca0 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaad160640 4 set_mon_vals no callback set 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.362+0000 7fbaa659c640 10 monclient: dump: 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.357 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: shutdown 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- 172.21.15.106:0/1747965894 >> v1:172.21.15.106:6789/0 conn(0x7fbaa809fca0 legacy=0x7fbaa80a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- 172.21.15.106:0/1747965894 shutdown_connections 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- 172.21.15.106:0/1747965894 >> 172.21.15.106:0/1747965894 conn(0x7fbaa80a64e0 msgr2=0x7fbaa80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- 172.21.15.106:0/1747965894 shutdown_connections 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- 172.21.15.106:0/1747965894 wait complete. 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: build_initial_monmap 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: monmap: 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:58.359 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 Processor -- start 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- start start 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: init 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: _add_conns ranks=[5,2,0,4,3,6,7,1,8] 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient(hunting): picked mon.noname-h con 0x7fbaa809fca0 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:58.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient(hunting): picked mon.noname-b con 0x7fbaa8137570 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient(hunting): picked mon.noname-a con 0x7fbaa8137c40 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa8122a30 con 0x7fbaa8137c40 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa81214c0 con 0x7fbaa8137570 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaa80724d0 con 0x7fbaa809fca0 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient(hunting): authenticate will time out at 1793.898083s 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaa759e640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fbaa8137c40 0x7fbaa81d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42906/0 (socket says 172.21.15.106:42906) 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaa759e640 1 -- 172.21.15.106:0/4269556906 learned_addr learned my addr 172.21.15.106:0/4269556906 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105505391 0 0) 0x7fbaa8122a30 con 0x7fbaa8137c40 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): my global_id is 8208 2024-04-26T00:08:58.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88003530 con 0x7fbaa8137c40 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4292804435 0 0) 0x7fbaa81214c0 con 0x7fbaa8137570 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): my global_id is 254171 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbaa8122a30 con 0x7fbaa8137570 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 817307786 0 0) 0x7fbaa8122a30 con 0x7fbaa8137570 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbaa81214c0 con 0x7fbaa8137570 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 371568032 0 0) 0x7fba88003530 con 0x7fbaa8137c40 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbaa8122a30 con 0x7fbaa8137c40 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fba90001950 con 0x7fbaa8137570 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:58.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): dump: 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.363 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbaa00018a0 con 0x7fbaa8137c40 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): dump: 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.364 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3810054163 0 0) 0x7fbaa80724d0 con 0x7fbaa809fca0 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient(hunting): my global_id is 254147 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba88003530 con 0x7fbaa809fca0 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3319323262 0 0) 0x7fbaa8122a30 con 0x7fbaa8137c40 2024-04-26T00:08:58.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 >> v1:172.21.15.171:6791/0 conn(0x7fbaa809fca0 legacy=0x7fbaa8131030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 >> v1:172.21.15.106:6790/0 conn(0x7fbaa8137570 legacy=0x7fbaa81d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 monclient: found mon.a 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaa8120740 con 0x7fbaa8137c40 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: _finish_auth 0 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:08:58.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 5 monclient: authenticate success, global_id 8208 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: _renew_subs 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbaa8122750 con 0x7fbaa8137c40 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: _renew_subs 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbaa8131910 con 0x7fbaa8137c40 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbaa0004e20 con 0x7fbaa8137c40 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbaa0005310 con 0x7fbaa8137c40 2024-04-26T00:08:58.367 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fbaa5d9b640 4 set_mon_vals no callback set 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 10 monclient: dump: 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.368 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.366+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbaa00100b0 con 0x7fbaa8137c40 2024-04-26T00:08:58.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.370+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fbaa00454a0 con 0x7fbaa8137c40 2024-04-26T00:08:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.370+0000 7fbaad160640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.370+0000 7fbaad160640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.370+0000 7fbaad160640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.370+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba8c005090 con 0x7fbaa8137c40 2024-04-26T00:08:58.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.370+0000 7fbaa6d9d640 10 monclient: get_auth_request con 0x7fba88037e50 auth_method 0 2024-04-26T00:08:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.374+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fbaa0015a70 con 0x7fbaa8137c40 2024-04-26T00:08:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.374+0000 7fba9ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:58.371 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.374+0000 7fba9ffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.594+0000 7fbaad160640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.594+0000 7fbaad160640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.594+0000 7fbaad160640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.594+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fba8c005380 con 0x7fbaa8137c40 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fba9ffff640 1 -- 172.21.15.106:0/4269556906 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2028022229) 0x7fbaa0015370 con 0x7fbaa8137c40 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fba9ffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fba9ffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:58.576 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":88,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:08:58.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 >> v1:172.21.15.171:6812/722422047 conn(0x7fba88037e50 legacy=0x7fba8803a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 10 monclient: shutdown 2024-04-26T00:08:58.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:58.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 >> v1:172.21.15.106:6789/0 conn(0x7fbaa8137c40 legacy=0x7fbaa81d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 shutdown_connections 2024-04-26T00:08:58.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 >> 172.21.15.106:0/4269556906 conn(0x7fbaa80a64e0 msgr2=0x7fbaa8070520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:58.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 shutdown_connections 2024-04-26T00:08:58.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.598+0000 7fbaad160640 1 -- 172.21.15.106:0/4269556906 wait complete. 2024-04-26T00:08:58.594 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:08:58.594 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T00:08:58.594 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:08:58.594 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:08:58.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.738+0000 7f445bc64640 10 monclient: get_monmap_and_config 2024-04-26T00:08:58.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.738+0000 7f445bc64640 10 monclient: build_initial_monmap 2024-04-26T00:08:58.719 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.738+0000 7f445bc64640 10 monclient: monmap: 2024-04-26T00:08:58.719 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:58.719 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.719 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:58.745074+0000 2024-04-26T00:08:58.719 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:58.745074+0000 2024-04-26T00:08:58.719 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:58.720 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:58.721 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:58.721 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:58.721 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.738+0000 7f445bc64640 1 Processor -- start 2024-04-26T00:08:58.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.738+0000 7f445bc64640 1 -- start start 2024-04-26T00:08:58.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.738+0000 7f445bc64640 10 monclient: init 2024-04-26T00:08:58.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:58.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: _add_conns ranks=[2,3,1,4,0,8,6,7,5] 2024-04-26T00:08:58.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): picked mon.noname-b con 0x7f4454134820 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): picked mon.noname-g con 0x7f44540725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): picked mon.noname-f con 0x7f445413ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4454071270 con 0x7f445413ace0 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540714e0 con 0x7f4454134820 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540729f0 con 0x7f44540725d0 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): authenticate will time out at 1794.272554s 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f4459a00640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f4454134820 0x7f4454134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34834/0 (socket says 172.21.15.106:34834) 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f4459a00640 1 -- 172.21.15.106:0/3376300136 learned_addr learned my addr 172.21.15.106:0/3376300136 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208863400 0 0) 0x7f4450001120 con 0x7f4454134820 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient(hunting): my global_id is 254180 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4440003530 con 0x7f4454134820 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 297534635 0 0) 0x7f4440003530 con 0x7f4454134820 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 >> v1:172.21.15.171:6790/0 conn(0x7f44540725d0 legacy=0x7f44541395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 >> v1:172.21.15.171:6789/0 conn(0x7f445413ace0 legacy=0x7f445413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: _finish_hunting 0 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 monclient: found mon.noname-b 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44540717c0 con 0x7f4454134820 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: _finish_auth 0 2024-04-26T00:08:58.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: _check_auth_tickets 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 5 monclient: authenticate success, global_id 254180 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4450001990 con 0x7f4454134820 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: dump: 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.737 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4450001cf0 con 0x7f4454134820 2024-04-26T00:08:58.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 1 -- 172.21.15.106:0/3376300136 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4450004c70 con 0x7f4454134820 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 4 set_mon_vals no callback set 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f44589fe640 10 monclient: dump: 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.739 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: shutdown 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- 172.21.15.106:0/3376300136 >> v1:172.21.15.106:6790/0 conn(0x7f4454134820 legacy=0x7f4454134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- 172.21.15.106:0/3376300136 shutdown_connections 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- 172.21.15.106:0/3376300136 >> 172.21.15.106:0/3376300136 conn(0x7f44540a64e0 msgr2=0x7f44540a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- 172.21.15.106:0/3376300136 shutdown_connections 2024-04-26T00:08:58.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- 172.21.15.106:0/3376300136 wait complete. 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: build_initial_monmap 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: monmap: 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:58.741 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:58.742 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 Processor -- start 2024-04-26T00:08:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- start start 2024-04-26T00:08:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: init 2024-04-26T00:08:58.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient: _add_conns ranks=[0,3,5,6,1,2,8,4,7] 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): picked mon.noname-a con 0x7f44540725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): picked mon.noname-g con 0x7f4454134820 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): picked mon.noname-h con 0x7f445413ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4454132140 con 0x7f44540725d0 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44541338d0 con 0x7f4454134820 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44540706a0 con 0x7f445413ace0 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f445bc64640 10 monclient(hunting): authenticate will time out at 1794.275499s 2024-04-26T00:08:58.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f4459a00640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f44540725d0 0x7f445412a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42918/0 (socket says 172.21.15.106:42918) 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f4459a00640 1 -- 172.21.15.106:0/1193533995 learned_addr learned my addr 172.21.15.106:0/1193533995 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469100079 0 0) 0x7f4454132140 con 0x7f44540725d0 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f444a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f444a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f444a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f444a7fc640 10 monclient(hunting): my global_id is 8217 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.742+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4438003530 con 0x7f44540725d0 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2393216689 0 0) 0x7f4438003530 con 0x7f44540725d0 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4454132140 con 0x7f44540725d0 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4450004b30 con 0x7f44540725d0 2024-04-26T00:08:58.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): dump: 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.745 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3122649150 0 0) 0x7f4454132140 con 0x7f44540725d0 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.171:6791/0 conn(0x7f445413ace0 legacy=0x7f44541d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.171:6790/0 conn(0x7f4454134820 legacy=0x7f44541d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 monclient: found mon.a 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4454133310 con 0x7f44540725d0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 5 monclient: authenticate success, global_id 8217 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 10 monclient: _renew_subs 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44541335f0 con 0x7f44540725d0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 10 monclient: _renew_subs 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4454133cf0 con 0x7f44540725d0 2024-04-26T00:08:58.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f44500010b0 con 0x7f44540725d0 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4450001cf0 con 0x7f44540725d0 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444bfff640 4 set_mon_vals no callback set 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: dump: 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f443c0065d0 con 0x7f443c002870 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4450010120 con 0x7f44540725d0 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f44500452f0 con 0x7f44540725d0 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4009057973 0 0) 0x7f443c0065d0 con 0x7f443c002870 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient(hunting): my global_id is 8226 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4454132140 con 0x7f443c002870 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f445a201640 10 monclient: get_auth_request con 0x7f4438037930 auth_method 0 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3261275051 0 0) 0x7f4454132140 con 0x7f443c002870 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f443c0065d0 con 0x7f443c002870 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4444001900 con 0x7f443c002870 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: dump: 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.750 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1269513747 0 0) 0x7f443c0065d0 con 0x7f443c002870 2024-04-26T00:08:58.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f443c00a160 con 0x7f443c002870 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4444001cf0 con 0x7f443c002870 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.106:6789/0 conn(0x7f443c002870 legacy=0x7f443c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.746+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.106:6789/0 conn(0x7f443c002870 legacy=0x7f443c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f443c009e30 con 0x7f443c0090f0 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2195203400 0 0) 0x7f443c009e30 con 0x7f443c0090f0 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient(hunting): my global_id is 8235 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f443c0065d0 con 0x7f443c0090f0 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2659947579 0 0) 0x7f443c0065d0 con 0x7f443c0090f0 2024-04-26T00:08:58.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f443c009e30 con 0x7f443c0090f0 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4444003bc0 con 0x7f443c0090f0 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient: dump: 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.753 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 52922964 0 0) 0x7f443c009e30 con 0x7f443c0090f0 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f443c00c3a0 con 0x7f443c0090f0 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7737 (unknown 0 0 2403257328) 0x7f4444003f00 con 0x7f443c0090f0 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:58.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.106:6789/0 conn(0x7f443c0090f0 legacy=0x7f443c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f444a7fc640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.106:6789/0 conn(0x7f443c0090f0 legacy=0x7f443c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:58.755 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:58.755 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:58.755 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:58.755 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:08:58.755 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:58.755 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 857314, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:58.756 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:58.757 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:58.758 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:58.759 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:58.760 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:58.760 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:58.760 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:58.760 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:58.760 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:58.760 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:58.760 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:58.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:58.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:58.765 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.766 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.774 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:58.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:58.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:58.775 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:58.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:58.776 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.776 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.776 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.776 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.777 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:58.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:58.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.777 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:58.777 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:58.777 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:58.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.778 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.778 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:58.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.778 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:58.778 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:58.778 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:58.779 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 6 2024-04-26T00:08:58.780 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.780 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.780 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:58.780 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:58.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.171:6812/722422047 conn(0x7f4438037930 legacy=0x7f4438039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 10 monclient: shutdown 2024-04-26T00:08:58.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:58.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 >> v1:172.21.15.106:6789/0 conn(0x7f44540725d0 legacy=0x7f445412a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445a201640 1 -- 172.21.15.106:0/1193533995 reap_dead start 2024-04-26T00:08:58.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445a201640 1 -- 172.21.15.106:0/1193533995 reap_dead start 2024-04-26T00:08:58.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 shutdown_connections 2024-04-26T00:08:58.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 >> 172.21.15.106:0/1193533995 conn(0x7f44540a64e0 msgr2=0x7f445406e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:58.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 shutdown_connections 2024-04-26T00:08:58.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.754+0000 7f445bc64640 1 -- 172.21.15.106:0/1193533995 wait complete. 2024-04-26T00:08:58.782 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:58.782 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:08:58.783 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:08:58.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.922+0000 7efdf1a10640 10 monclient: get_monmap_and_config 2024-04-26T00:08:58.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.922+0000 7efdf1a10640 10 monclient: build_initial_monmap 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.922+0000 7efdf1a10640 10 monclient: monmap: 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:58.929920+0000 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:58.929920+0000 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:58.918 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 Processor -- start 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- start start 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: init 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: _add_conns ranks=[8,1,3,4,7,0,2,6,5] 2024-04-26T00:08:58.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient(hunting): picked mon.noname-e con 0x7efdec137c40 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient(hunting): picked mon.noname-f con 0x7efdec09fca0 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient(hunting): picked mon.noname-g con 0x7efdec137570 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec06ee10 con 0x7efdec09fca0 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec0a2220 con 0x7efdec137570 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec06f0f0 con 0x7efdec137c40 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient(hunting): authenticate will time out at 1794.457061s 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdeaffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7efdec137c40 0x7efdec0a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35618/0 (socket says 172.21.15.106:35618) 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdeaffd640 1 -- 172.21.15.106:0/2707961219 learned_addr learned my addr 172.21.15.106:0/2707961219 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265489046 0 0) 0x7efdec06f0f0 con 0x7efdec137c40 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient(hunting): my global_id is 224792 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdd8003530 con 0x7efdec137c40 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 824205260 0 0) 0x7efdd8003530 con 0x7efdec137c40 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 >> v1:172.21.15.171:6790/0 conn(0x7efdec137570 legacy=0x7efdec1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 >> v1:172.21.15.171:6789/0 conn(0x7efdec09fca0 legacy=0x7efdec0a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 monclient: found mon.noname-e 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec06f3d0 con 0x7efdec137c40 2024-04-26T00:08:58.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdd40017c0 con 0x7efdec137c40 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: dump: 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 5 monclient: authenticate success, global_id 224792 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdd4001ab0 con 0x7efdec137c40 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 1 -- 172.21.15.106:0/2707961219 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdd4004bf0 con 0x7efdec137c40 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 4 set_mon_vals no callback set 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:58.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdea7fc640 10 monclient: dump: 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.925 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.926 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.926 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.926 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: shutdown 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- 172.21.15.106:0/2707961219 >> v1:172.21.15.106:6793/0 conn(0x7efdec137c40 legacy=0x7efdec0a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- 172.21.15.106:0/2707961219 shutdown_connections 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- 172.21.15.106:0/2707961219 >> 172.21.15.106:0/2707961219 conn(0x7efdec0a64e0 msgr2=0x7efdec0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- 172.21.15.106:0/2707961219 shutdown_connections 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- 172.21.15.106:0/2707961219 wait complete. 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: build_initial_monmap 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: monmap: 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:58.927 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:58.928 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 Processor -- start 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 1 -- start start 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.926+0000 7efdf1a10640 10 monclient: init 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient: _add_conns ranks=[2,5,3,4,8,1,0,7,6] 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient(hunting): picked mon.noname-b con 0x7efdec09fca0 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient(hunting): picked mon.noname-h con 0x7efdec137570 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient(hunting): picked mon.noname-g con 0x7efdec137c40 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:58.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec1229d0 con 0x7efdec09fca0 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec120b80 con 0x7efdec137c40 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdec072970 con 0x7efdec137570 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient(hunting): authenticate will time out at 1794.460206s 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdeaffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7efdec09fca0 0x7efdec1cc990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34840/0 (socket says 172.21.15.106:34840) 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdeaffd640 1 -- 172.21.15.106:0/134199247 learned_addr learned my addr 172.21.15.106:0/134199247 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1878940730 0 0) 0x7efdec1229d0 con 0x7efdec09fca0 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): my global_id is 254189 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdcc003530 con 0x7efdec09fca0 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1661072396 0 0) 0x7efdcc003530 con 0x7efdec09fca0 2024-04-26T00:08:58.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdec1229d0 con 0x7efdec09fca0 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdd4001780 con 0x7efdec09fca0 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.931 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2279401961 0 0) 0x7efdec120b80 con 0x7efdec137c40 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): my global_id is 215004 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdcc003530 con 0x7efdec137c40 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 492406644 0 0) 0x7efdec1229d0 con 0x7efdec09fca0 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.171:6791/0 conn(0x7efdec137570 legacy=0x7efdec1d1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.171:6790/0 conn(0x7efdec137c40 legacy=0x7efdec1d4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 monclient: found mon.b 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdec0724d0 con 0x7efdec09fca0 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: _finish_auth 0 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 5 monclient: authenticate success, global_id 254189 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient: _renew_subs 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efdec1226f0 con 0x7efdec09fca0 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient: _renew_subs 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:58.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efdec1235d0 con 0x7efdec09fca0 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efdd4001ab0 con 0x7efdec09fca0 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efdd4001ce0 con 0x7efdec09fca0 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde9ffb640 4 set_mon_vals no callback set 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: dump: 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.934 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efdd00065d0 con 0x7efdd0002870 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7efdd4010050 con 0x7efdec09fca0 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7efdd4045130 con 0x7efdec09fca0 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172163041 0 0) 0x7efdd00065d0 con 0x7efdd0002870 2024-04-26T00:08:58.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient(hunting): my global_id is 254198 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdec1229d0 con 0x7efdd0002870 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efdeb7fe640 10 monclient: get_auth_request con 0x7efdcc037840 auth_method 0 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4031153920 0 0) 0x7efdec1229d0 con 0x7efdd0002870 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdd00065d0 con 0x7efdd0002870 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efddc001870 con 0x7efdd0002870 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: dump: 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.936 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1026415573 0 0) 0x7efdd00065d0 con 0x7efdd0002870 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efdd000a160 con 0x7efdd0002870 2024-04-26T00:08:58.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efddc001ca0 con 0x7efdd0002870 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.106:6790/0 conn(0x7efdd0002870 legacy=0x7efdd0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.930+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.106:6790/0 conn(0x7efdd0002870 legacy=0x7efdd0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efdd0009e10 con 0x7efdd00090f0 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3812815114 0 0) 0x7efdd0009e10 con 0x7efdd00090f0 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient(hunting): my global_id is 254207 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdd00065d0 con 0x7efdd00090f0 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2954250603 0 0) 0x7efdd00065d0 con 0x7efdd00090f0 2024-04-26T00:08:58.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efdd0009e10 con 0x7efdd00090f0 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efddc003c00 con 0x7efdd00090f0 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient: dump: 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:58.939 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 69867965 0 0) 0x7efdd0009e10 con 0x7efdd00090f0 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efdd000c390 con 0x7efdd00090f0 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 3258051732) 0x7efddc004010 con 0x7efdd00090f0 2024-04-26T00:08:58.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.106:6790/0 conn(0x7efdd00090f0 legacy=0x7efdd0009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efde8ff9640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.106:6790/0 conn(0x7efdd00090f0 legacy=0x7efdd0009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:58.941 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 8995, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:08:58.942 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:58.943 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:58.945 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:58.946 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:58.948 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.949 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:58.950 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.951 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.952 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:58.953 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.954 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:58.955 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.956 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:58.958 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:58.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:58.960 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:58.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.171:6812/722422047 conn(0x7efdcc037840 legacy=0x7efdcc039d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 10 monclient: shutdown 2024-04-26T00:08:58.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:58.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 >> v1:172.21.15.106:6790/0 conn(0x7efdec09fca0 legacy=0x7efdec1cc990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:58.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdeb7fe640 1 -- 172.21.15.106:0/134199247 reap_dead start 2024-04-26T00:08:58.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdeb7fe640 1 -- 172.21.15.106:0/134199247 reap_dead start 2024-04-26T00:08:58.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 shutdown_connections 2024-04-26T00:08:58.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 >> 172.21.15.106:0/134199247 conn(0x7efdec0a64e0 msgr2=0x7efdec06fb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:58.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 shutdown_connections 2024-04-26T00:08:58.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:58.938+0000 7efdf1a10640 1 -- 172.21.15.106:0/134199247 wait complete. 2024-04-26T00:08:58.963 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:58.963 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:08:58.963 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:08:59.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: get_monmap_and_config 2024-04-26T00:08:59.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: monmap: 2024-04-26T00:08:59.084 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:59.111277+0000 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:59.111277+0000 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.085 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 Processor -- start 2024-04-26T00:08:59.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- start start 2024-04-26T00:08:59.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: init 2024-04-26T00:08:59.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: _add_conns ranks=[4,1,3,0,2,8,6,5,7] 2024-04-26T00:08:59.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient(hunting): picked mon.noname-c con 0x7f66fc134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:59.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient(hunting): picked mon.noname-f con 0x7f66fc0a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient(hunting): picked mon.noname-g con 0x7f66fc13e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66fc06dd40 con 0x7f66fc0a4820 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66fc0a2b10 con 0x7f66fc13e200 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66fc0a2df0 con 0x7f66fc134970 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient(hunting): authenticate will time out at 1794.638319s 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66fa59c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f66fc134970 0x7f66fc134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40278/0 (socket says 172.21.15.106:40278) 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66fa59c640 1 -- 172.21.15.106:0/3797230932 learned_addr learned my addr 172.21.15.106:0/3797230932 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528420865 0 0) 0x7f66fc0a2df0 con 0x7f66fc134970 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient(hunting): my global_id is 254182 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e4003530 con 0x7f66fc134970 2024-04-26T00:08:59.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1581350767 0 0) 0x7f66e4003530 con 0x7f66fc134970 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 >> v1:172.21.15.171:6790/0 conn(0x7f66fc13e200 legacy=0x7f66fc1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 >> v1:172.21.15.171:6789/0 conn(0x7f66fc0a4820 legacy=0x7f66fc13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 monclient: found mon.noname-c 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc0a30d0 con 0x7f66fc134970 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66ec0017c0 con 0x7f66fc134970 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:59.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: dump: 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.095 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 5 monclient: authenticate success, global_id 254182 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66ec001ab0 con 0x7f66fc134970 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 1 -- 172.21.15.106:0/3797230932 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66ec004bf0 con 0x7f66fc134970 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f66f959a640 10 monclient: dump: 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.096 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 4 set_mon_vals no callback set 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 10 monclient: shutdown 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- 172.21.15.106:0/3797230932 >> v1:172.21.15.106:6791/0 conn(0x7f66fc134970 legacy=0x7f66fc134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- 172.21.15.106:0/3797230932 shutdown_connections 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- 172.21.15.106:0/3797230932 >> 172.21.15.106:0/3797230932 conn(0x7f66fc0a9e20 msgr2=0x7f66fc0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- 172.21.15.106:0/3797230932 shutdown_connections 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.106+0000 7f6700c10640 1 -- 172.21.15.106:0/3797230932 wait complete. 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: monmap: 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.098 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 Processor -- start 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 -- start start 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: init 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: _add_conns ranks=[5,1,0,4,2,8,7,6,3] 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient(hunting): picked mon.noname-h con 0x7f66fc0a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient(hunting): picked mon.noname-f con 0x7f66fc134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient(hunting): picked mon.noname-a con 0x7f66fc13e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66fc09e0c0 con 0x7f66fc13e200 2024-04-26T00:08:59.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66fc09e3a0 con 0x7f66fc134970 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66fc0a1e00 con 0x7f66fc0a4820 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient(hunting): authenticate will time out at 1794.641395s 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66fad9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f66fc13e200 0x7f66fc1d5050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42944/0 (socket says 172.21.15.106:42944) 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66fad9d640 1 -- 172.21.15.106:0/1049532122 learned_addr learned my addr 172.21.15.106:0/1049532122 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2468484679 0 0) 0x7f66fc09e0c0 con 0x7f66fc13e200 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): my global_id is 8244 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66dc003530 con 0x7f66fc13e200 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4171289815 0 0) 0x7f66dc003530 con 0x7f66fc13e200 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66fc09e0c0 con 0x7f66fc13e200 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66f4001d20 con 0x7f66fc13e200 2024-04-26T00:08:59.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): dump: 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.101 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1223717854 0 0) 0x7f66fc09e3a0 con 0x7f66fc134970 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): my global_id is 224875 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66dc003530 con 0x7f66fc134970 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067419608 0 0) 0x7f66fc0a1e00 con 0x7f66fc0a4820 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): my global_id is 254174 2024-04-26T00:08:59.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66fc09e3a0 con 0x7f66fc0a4820 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1460657763 0 0) 0x7f66fc09e0c0 con 0x7f66fc13e200 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.171:6791/0 conn(0x7f66fc0a4820 legacy=0x7f66fc09fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.171:6789/0 conn(0x7f66fc134970 legacy=0x7f66fc1d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 monclient: found mon.a 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66fc0a1a40 con 0x7f66fc13e200 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 5 monclient: authenticate success, global_id 8244 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: _renew_subs 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f66fc09e680 con 0x7f66fc13e200 2024-04-26T00:08:59.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: _renew_subs 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f66fc1cc860 con 0x7f66fc13e200 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66f4003cd0 con 0x7f66fc13e200 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66f8d99640 4 set_mon_vals no callback set 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66f4004240 con 0x7f66fc13e200 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: dump: 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.104 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f66e00065d0 con 0x7f66e0002870 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f66f4004460 con 0x7f66fc13e200 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f66f40455d0 con 0x7f66fc13e200 2024-04-26T00:08:59.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3640471871 0 0) 0x7f66e00065d0 con 0x7f66e0002870 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient(hunting): my global_id is 254191 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66fc09e0c0 con 0x7f66e0002870 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66f9d9b640 10 monclient: get_auth_request con 0x7f66dc037a40 auth_method 0 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2532919545 0 0) 0x7f66fc09e0c0 con 0x7f66e0002870 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66e00065d0 con 0x7f66e0002870 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66ec0047f0 con 0x7f66e0002870 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 10 monclient: dump: 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.106 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.107 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.110 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1154609137 0 0) 0x7f66e00065d0 con 0x7f66e0002870 2024-04-26T00:08:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.110+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66e000a160 con 0x7f66e0002870 2024-04-26T00:08:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.114+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f66ec004b90 con 0x7f66e0002870 2024-04-26T00:08:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.114+0000 7f66eaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.114+0000 7f66eaffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.114+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.106:6791/0 conn(0x7f66e0002870 legacy=0x7f66e0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.114+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.106:6791/0 conn(0x7f66e0002870 legacy=0x7f66e0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:59.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f66e0009e30 con 0x7f66e00090f0 2024-04-26T00:08:59.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951169270 0 0) 0x7f66e0009e30 con 0x7f66e00090f0 2024-04-26T00:08:59.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient(hunting): my global_id is 254200 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e00065d0 con 0x7f66e00090f0 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2191151255 0 0) 0x7f66e00065d0 con 0x7f66e00090f0 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66e0009e30 con 0x7f66e00090f0 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66ec005000 con 0x7f66e00090f0 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient: dump: 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.114 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 172457339 0 0) 0x7f66e0009e30 con 0x7f66e00090f0 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f66e000c3a0 con 0x7f66e00090f0 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 1603661838) 0x7f66ec006570 con 0x7f66e00090f0 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.106:6791/0 conn(0x7f66e00090f0 legacy=0x7f66e0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66eaffd640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.106:6791/0 conn(0x7f66e00090f0 legacy=0x7f66e0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9171, 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:59.116 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.117 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.118 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:59.119 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.120 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.123 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.125 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.126 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:59.127 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.129 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.132 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:59.133 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.171:6812/722422047 conn(0x7f66dc037a40 legacy=0x7f66dc039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 10 monclient: shutdown 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 >> v1:172.21.15.106:6789/0 conn(0x7f66fc13e200 legacy=0x7f66fc1d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66fad9d640 1 -- 172.21.15.106:0/1049532122 reap_dead start 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f66fad9d640 1 -- 172.21.15.106:0/1049532122 reap_dead start 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 shutdown_connections 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.118+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 >> 172.21.15.106:0/1049532122 conn(0x7f66fc0a9e20 msgr2=0x7f66fc067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.122+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 shutdown_connections 2024-04-26T00:08:59.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.122+0000 7f6700c10640 1 -- 172.21.15.106:0/1049532122 wait complete. 2024-04-26T00:08:59.136 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:59.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:08:59.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:08:59.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: get_monmap_and_config 2024-04-26T00:08:59.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: monmap: 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:59.275124+0000 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:59.275124+0000 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.249 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.250 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 Processor -- start 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 -- start start 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: init 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: _add_conns ranks=[6,7,0,4,5,1,2,3,8] 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient(hunting): picked mon.noname-d con 0x7f41e40a5070 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient(hunting): picked mon.noname-i con 0x7f41e4072710 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient(hunting): picked mon.noname-a con 0x7f41e4072b70 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e4137d60 con 0x7f41e4072b70 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e406cf90 con 0x7f41e40a5070 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e406e240 con 0x7f41e4072710 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient(hunting): authenticate will time out at 1794.802349s 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e8c98640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f41e4072b70 0x7f41e41400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42960/0 (socket says 172.21.15.106:42960) 2024-04-26T00:08:59.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e3fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f41e40a5070 0x7f41e4137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45798/0 (socket says 172.21.15.106:45798) 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e8c98640 1 -- 172.21.15.106:0/3153273870 learned_addr learned my addr 172.21.15.106:0/3153273870 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1589658162 0 0) 0x7f41e406cf90 con 0x7f41e40a5070 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): my global_id is 254184 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41d0003530 con 0x7f41e40a5070 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846240394 0 0) 0x7f41e4137d60 con 0x7f41e4072b70 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): my global_id is 8253 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e406cf90 con 0x7f41e4072b70 2024-04-26T00:08:59.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2528221160 0 0) 0x7f41e406e240 con 0x7f41e4072710 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient(hunting): my global_id is 146311 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e4137d60 con 0x7f41e4072710 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4089436845 0 0) 0x7f41d0003530 con 0x7f41e40a5070 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 >> v1:172.21.15.171:6792/0 conn(0x7f41e4072710 legacy=0x7f41e413c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 >> v1:172.21.15.106:6789/0 conn(0x7f41e4072b70 legacy=0x7f41e41400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 monclient: found mon.noname-d 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e4070560 con 0x7f41e40a5070 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41cc0017c0 con 0x7f41e40a5070 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: dump: 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.260 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 5 monclient: authenticate success, global_id 254184 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41cc001a20 con 0x7f41e40a5070 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 1 -- 172.21.15.106:0/3153273870 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41cc004b30 con 0x7f41e40a5070 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41e2ffd640 10 monclient: dump: 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.261 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 4 set_mon_vals no callback set 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 10 monclient: shutdown 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 -- 172.21.15.106:0/3153273870 >> v1:172.21.15.106:6792/0 conn(0x7f41e40a5070 legacy=0x7f41e4137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 -- 172.21.15.106:0/3153273870 shutdown_connections 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.270+0000 7f41ea6fb640 1 -- 172.21.15.106:0/3153273870 >> 172.21.15.106:0/3153273870 conn(0x7f41e40a83a0 msgr2=0x7f41e40a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- 172.21.15.106:0/3153273870 shutdown_connections 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- 172.21.15.106:0/3153273870 wait complete. 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: monmap: 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.263 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 Processor -- start 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- start start 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: init 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: _add_conns ranks=[0,6,2,3,1,5,7,4,8] 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient(hunting): picked mon.noname-a con 0x7f41e4072710 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient(hunting): picked mon.noname-d con 0x7f41e4072b70 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient(hunting): picked mon.noname-b con 0x7f41e40a5070 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e41328e0 con 0x7f41e4072710 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e41cd650 con 0x7f41e40a5070 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41e41332c0 con 0x7f41e4072b70 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient(hunting): authenticate will time out at 1794.805521s 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e3fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f41e4072710 0x7f41e41cc830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42976/0 (socket says 172.21.15.106:42976) 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e3fff640 1 -- 172.21.15.106:0/427071750 learned_addr learned my addr 172.21.15.106:0/427071750 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1732612487 0 0) 0x7f41e41328e0 con 0x7f41e4072710 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): my global_id is 8262 2024-04-26T00:08:59.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c4003530 con 0x7f41e4072710 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239443339 0 0) 0x7f41e41332c0 con 0x7f41e4072b70 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): my global_id is 254193 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e41328e0 con 0x7f41e4072b70 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3920846339 0 0) 0x7f41e41cd650 con 0x7f41e40a5070 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): my global_id is 254216 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e41332c0 con 0x7f41e40a5070 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3518759569 0 0) 0x7f41c4003530 con 0x7f41e4072710 2024-04-26T00:08:59.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41e41cd650 con 0x7f41e4072710 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 813679511 0 0) 0x7f41e41332c0 con 0x7f41e40a5070 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41c4003530 con 0x7f41e40a5070 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41cc0016c0 con 0x7f41e4072710 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.267 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41dc0018a0 con 0x7f41e40a5070 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.268 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2053403303 0 0) 0x7f41e41328e0 con 0x7f41e4072b70 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41e41332c0 con 0x7f41e4072b70 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41d40019e0 con 0x7f41e4072b70 2024-04-26T00:08:59.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.270 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 322414666 0 0) 0x7f41e41cd650 con 0x7f41e4072710 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.106:6792/0 conn(0x7f41e4072b70 legacy=0x7f41e41ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.106:6790/0 conn(0x7f41e40a5070 legacy=0x7f41e41d4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 monclient: found mon.a 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41e4133880 con 0x7f41e4072710 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 5 monclient: authenticate success, global_id 8262 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: _renew_subs 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41e41335a0 con 0x7f41e4072710 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: _renew_subs 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f41e41318c0 con 0x7f41e4072710 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f41cc0011a0 con 0x7f41e4072710 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41cc001920 con 0x7f41e4072710 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e27fc640 4 set_mon_vals no callback set 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient: dump: 2024-04-26T00:08:59.272 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.273 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41c80065d0 con 0x7f41c8002870 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f41cc00fce0 con 0x7f41e4072710 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f41cc045050 con 0x7f41e4072710 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1673369057 0 0) 0x7f41c80065d0 con 0x7f41c8002870 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 10 monclient(hunting): my global_id is 254202 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.274+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41e41cd650 con 0x7f41c8002870 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3337410957 0 0) 0x7f41e41cd650 con 0x7f41c8002870 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41c80065d0 con 0x7f41c8002870 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41d4001d30 con 0x7f41c8002870 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 10 monclient: dump: 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.275 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e8c98640 10 monclient: get_auth_request con 0x7f41c4038120 auth_method 0 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2606588892 0 0) 0x7f41c80065d0 con 0x7f41c8002870 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f41c800a160 con 0x7f41c8002870 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f41d4003ce0 con 0x7f41c8002870 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.106:6792/0 conn(0x7f41c8002870 legacy=0x7f41c8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.278+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.106:6792/0 conn(0x7f41c8002870 legacy=0x7f41c8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.282+0000 7f41ea6fb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.282+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f41c8009e30 con 0x7f41c80090f0 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1426373834 0 0) 0x7f41c8009e30 con 0x7f41c80090f0 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient(hunting): my global_id is 254211 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41c80065d0 con 0x7f41c80090f0 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2162858778 0 0) 0x7f41c80065d0 con 0x7f41c80090f0 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41c8009e30 con 0x7f41c80090f0 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f41d40045e0 con 0x7f41c80090f0 2024-04-26T00:08:59.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient: dump: 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.279 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1808039223 0 0) 0x7f41c8009e30 con 0x7f41c80090f0 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f41c800c3a0 con 0x7f41c80090f0 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7563 (unknown 0 0 2015986863) 0x7f41d4005990 con 0x7f41c80090f0 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.106:6792/0 conn(0x7f41c80090f0 legacy=0x7f41c8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.294+0000 7f41e0ff9640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.106:6792/0 conn(0x7f41c80090f0 legacy=0x7f41c8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:59.280 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9355, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:59.281 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.282 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:59.284 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.285 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.287 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.288 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:59.289 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.291 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.292 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.293 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.294 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.295 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.298 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:59.298 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.171:6812/722422047 conn(0x7f41c4038120 legacy=0x7f41c403a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 10 monclient: shutdown 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 >> v1:172.21.15.106:6789/0 conn(0x7f41e4072710 legacy=0x7f41e41cc830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41e8c98640 1 -- 172.21.15.106:0/427071750 reap_dead start 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41e8c98640 1 -- 172.21.15.106:0/427071750 reap_dead start 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 shutdown_connections 2024-04-26T00:08:59.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 >> 172.21.15.106:0/427071750 conn(0x7f41e40a83a0 msgr2=0x7f41e40a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 shutdown_connections 2024-04-26T00:08:59.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.298+0000 7f41ea6fb640 1 -- 172.21.15.106:0/427071750 wait complete. 2024-04-26T00:08:59.300 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:59.300 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:08:59.300 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:08:59.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: get_monmap_and_config 2024-04-26T00:08:59.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: monmap: 2024-04-26T00:08:59.413 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.413 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:59.438954+0000 2024-04-26T00:08:59.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:59.438954+0000 2024-04-26T00:08:59.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.414 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.414 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.414 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.415 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.415 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.415 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.415 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 Processor -- start 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- start start 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: init 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: _add_conns ranks=[8,1,3,7,4,6,0,5,2] 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient(hunting): picked mon.noname-e con 0x7fc404135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient(hunting): picked mon.noname-f con 0x7fc4041353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient(hunting): picked mon.noname-g con 0x7fc40413bdf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc40406f2d0 con 0x7fc4041353b0 2024-04-26T00:08:59.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc404072330 con 0x7fc40413bdf0 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc404072610 con 0x7fc404135870 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient(hunting): authenticate will time out at 1794.966262s 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc408c82640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc404135870 0x7fc404135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35622/0 (socket says 172.21.15.106:35622) 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc408c82640 1 -- 172.21.15.106:0/4135100766 learned_addr learned my addr 172.21.15.106:0/4135100766 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233191899 0 0) 0x7fc404072610 con 0x7fc404135870 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient(hunting): my global_id is 224801 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3f0003530 con 0x7fc404135870 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3948020685 0 0) 0x7fc3f0003530 con 0x7fc404135870 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 >> v1:172.21.15.171:6790/0 conn(0x7fc40413bdf0 legacy=0x7fc40413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 >> v1:172.21.15.171:6789/0 conn(0x7fc4041353b0 legacy=0x7fc40413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 monclient: found mon.noname-e 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4040a3260 con 0x7fc404135870 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3fc001800 con 0x7fc404135870 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 5 monclient: authenticate success, global_id 224801 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:59.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: dump: 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.428 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.429 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3fc001b10 con 0x7fc404135870 2024-04-26T00:08:59.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:59.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 1 -- 172.21.15.106:0/4135100766 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3fc004bf0 con 0x7fc404135870 2024-04-26T00:08:59.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 4 set_mon_vals no callback set 2024-04-26T00:08:59.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc4037fe640 10 monclient: dump: 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.431 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 10 monclient: shutdown 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- 172.21.15.106:0/4135100766 >> v1:172.21.15.106:6793/0 conn(0x7fc404135870 legacy=0x7fc404135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- 172.21.15.106:0/4135100766 shutdown_connections 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- 172.21.15.106:0/4135100766 >> 172.21.15.106:0/4135100766 conn(0x7fc4040a64e0 msgr2=0x7fc4040a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- 172.21.15.106:0/4135100766 shutdown_connections 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.434+0000 7fc40aee6640 1 -- 172.21.15.106:0/4135100766 wait complete. 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: monmap: 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.432 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 Processor -- start 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 -- start start 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: init 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: _add_conns ranks=[5,2,1,6,0,7,3,8,4] 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient(hunting): picked mon.noname-h con 0x7fc4041353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient(hunting): picked mon.noname-b con 0x7fc404135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient(hunting): picked mon.noname-f con 0x7fc40413bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc404071360 con 0x7fc40413bdf0 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc404070da0 con 0x7fc404135870 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc404134860 con 0x7fc4041353b0 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient(hunting): authenticate will time out at 1794.969313s 2024-04-26T00:08:59.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc403fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc404135870 0x7fc404134150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34874/0 (socket says 172.21.15.106:34874) 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc403fff640 1 -- 172.21.15.106:0/3392889764 learned_addr learned my addr 172.21.15.106:0/3392889764 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3695458535 0 0) 0x7fc404070da0 con 0x7fc404135870 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): my global_id is 254225 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e4003530 con 0x7fc404135870 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 880288543 0 0) 0x7fc3e4003530 con 0x7fc404135870 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc404070da0 con 0x7fc404135870 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3ec001de0 con 0x7fc404135870 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): dump: 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.435 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.436 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2356134248 0 0) 0x7fc404072330 con 0x7fc40413bdf0 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): my global_id is 224893 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e4003530 con 0x7fc40413bdf0 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199618261 0 0) 0x7fc404134860 con 0x7fc4041353b0 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): my global_id is 254183 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc404072330 con 0x7fc4041353b0 2024-04-26T00:08:59.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2099735045 0 0) 0x7fc404070da0 con 0x7fc404135870 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.171:6791/0 conn(0x7fc4041353b0 legacy=0x7fc404133a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.171:6789/0 conn(0x7fc40413bdf0 legacy=0x7fc4041d4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 monclient: found mon.b 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc404134db0 con 0x7fc404135870 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 5 monclient: authenticate success, global_id 254225 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: _renew_subs 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:59.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc40409f930 con 0x7fc404135870 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: _renew_subs 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fc404070ac0 con 0x7fc404135870 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3ec003cd0 con 0x7fc404135870 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3ec004240 con 0x7fc404135870 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc402ffd640 4 set_mon_vals no callback set 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: dump: 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.439 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3e80065d0 con 0x7fc3e8002870 2024-04-26T00:08:59.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc3ec004460 con 0x7fc404135870 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fc3ec045490 con 0x7fc404135870 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3376472234 0 0) 0x7fc3e80065d0 con 0x7fc3e8002870 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient(hunting): my global_id is 224810 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc404070da0 con 0x7fc3e8002870 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc409483640 10 monclient: get_auth_request con 0x7fc3e4037a40 auth_method 0 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2715012410 0 0) 0x7fc404070da0 con 0x7fc3e8002870 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3e80065d0 con 0x7fc3e8002870 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3fc004b30 con 0x7fc3e8002870 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:59.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.438+0000 7fc4017fa640 10 monclient: dump: 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.442 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.442+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4178451365 0 0) 0x7fc3e80065d0 con 0x7fc3e8002870 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.442+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3e800a160 con 0x7fc3e8002870 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.442+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc3fc001510 con 0x7fc3e8002870 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.442+0000 7fc4017fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.442+0000 7fc4017fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.442+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.106:6793/0 conn(0x7fc3e8002870 legacy=0x7fc3e8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.442+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.106:6793/0 conn(0x7fc3e8002870 legacy=0x7fc3e8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc3e8009e50 con 0x7fc3e8009110 2024-04-26T00:08:59.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1087400565 0 0) 0x7fc3e8009e50 con 0x7fc3e8009110 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient(hunting): my global_id is 224819 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3e80065d0 con 0x7fc3e8009110 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3676301994 0 0) 0x7fc3e80065d0 con 0x7fc3e8009110 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3e8009e50 con 0x7fc3e8009110 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc3fc005000 con 0x7fc3e8009110 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient: dump: 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.446 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3709351211 0 0) 0x7fc3e8009e50 con 0x7fc3e8009110 2024-04-26T00:08:59.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc3e800c3e0 con 0x7fc3e8009110 2024-04-26T00:08:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 3438728982) 0x7fc3fc0072e0 con 0x7fc3e8009110 2024-04-26T00:08:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.106:6793/0 conn(0x7fc3e8009110 legacy=0x7fc3e80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc4017fa640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.106:6793/0 conn(0x7fc3e8009110 legacy=0x7fc3e80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.448 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:59.448 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 252678, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:59.449 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.450 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.451 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:59.452 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.453 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.454 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.455 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.456 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.457 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.458 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.459 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.461 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:59.463 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.465 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.466 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.467 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:59.468 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.171:6812/722422047 conn(0x7fc3e4037a40 legacy=0x7fc3e4039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 10 monclient: shutdown 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 >> v1:172.21.15.106:6790/0 conn(0x7fc404135870 legacy=0x7fc404134150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc409483640 1 -- 172.21.15.106:0/3392889764 reap_dead start 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc409483640 1 -- 172.21.15.106:0/3392889764 reap_dead start 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 shutdown_connections 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 >> 172.21.15.106:0/3392889764 conn(0x7fc4040a64e0 msgr2=0x7fc4040a2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 shutdown_connections 2024-04-26T00:08:59.470 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.446+0000 7fc40aee6640 1 -- 172.21.15.106:0/3392889764 wait complete. 2024-04-26T00:08:59.471 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:59.471 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:08:59.471 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:08:59.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient: get_monmap_and_config 2024-04-26T00:08:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient: monmap: 2024-04-26T00:08:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:59.611297+0000 2024-04-26T00:08:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:59.611297+0000 2024-04-26T00:08:59.585 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.586 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.587 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.587 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 1 Processor -- start 2024-04-26T00:08:59.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 1 -- start start 2024-04-26T00:08:59.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient: init 2024-04-26T00:08:59.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient: _add_conns ranks=[4,3,8,1,7,2,6,0,5] 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient(hunting): picked mon.noname-c con 0x7f613c134760 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient(hunting): picked mon.noname-g con 0x7f613c0a0d70 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient(hunting): picked mon.noname-e con 0x7f613c13df70 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c06b910 con 0x7f613c0a0d70 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c09fac0 con 0x7f613c134760 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c0a0080 con 0x7f613c13df70 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient(hunting): authenticate will time out at 1795.138996s 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613bfff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f613c13df70 0x7f613c140360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35652/0 (socket says 172.21.15.106:35652) 2024-04-26T00:08:59.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613bfff640 1 -- 172.21.15.106:0/322020173 learned_addr learned my addr 172.21.15.106:0/322020173 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3029806769 0 0) 0x7f613c0a0080 con 0x7f613c13df70 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): my global_id is 224828 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6128003530 con 0x7f613c13df70 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 96397592 0 0) 0x7f613c09fac0 con 0x7f613c134760 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient(hunting): my global_id is 254209 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c0a0080 con 0x7f613c134760 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2462383267 0 0) 0x7f6128003530 con 0x7f613c13df70 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 >> v1:172.21.15.106:6791/0 conn(0x7f613c134760 legacy=0x7f613c134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 >> v1:172.21.15.171:6790/0 conn(0x7f613c0a0d70 legacy=0x7f613c13c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 monclient: found mon.noname-e 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c09f280 con 0x7f613c13df70 2024-04-26T00:08:59.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134001b40 con 0x7f613c13df70 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: dump: 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.601 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.602 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 5 monclient: authenticate success, global_id 224828 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6134001e20 con 0x7f613c13df70 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f6142057640 4 set_mon_vals no callback set 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 1 -- 172.21.15.106:0/322020173 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134004f70 con 0x7f613c13df70 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.606+0000 7f613affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f613affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f613affd640 10 monclient: dump: 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.603 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: shutdown 2024-04-26T00:08:59.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- 172.21.15.106:0/322020173 >> v1:172.21.15.106:6793/0 conn(0x7f613c13df70 legacy=0x7f613c140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- 172.21.15.106:0/322020173 shutdown_connections 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- 172.21.15.106:0/322020173 >> 172.21.15.106:0/322020173 conn(0x7f613c0a7240 msgr2=0x7f613c0a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- 172.21.15.106:0/322020173 shutdown_connections 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- 172.21.15.106:0/322020173 wait complete. 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: monmap: 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:59.605 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 Processor -- start 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- start start 2024-04-26T00:08:59.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: init 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: _add_conns ranks=[8,6,4,0,3,2,5,1,7] 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient(hunting): picked mon.noname-e con 0x7f613c0a0d70 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient(hunting): picked mon.noname-d con 0x7f613c134760 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient(hunting): picked mon.noname-c con 0x7f613c13df70 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c072930 con 0x7f613c13df70 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c1394b0 con 0x7f613c134760 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f613c139790 con 0x7f613c0a0d70 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient(hunting): authenticate will time out at 1795.142114s 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f613b7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f613c0a0d70 0x7f613c1ccd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35656/0 (socket says 172.21.15.106:35656) 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f613b7fe640 1 -- 172.21.15.106:0/1639808601 learned_addr learned my addr 172.21.15.106:0/1639808601 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395491934 0 0) 0x7f613c1394b0 con 0x7f613c134760 2024-04-26T00:08:59.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): my global_id is 254220 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f611c003530 con 0x7f613c134760 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683189760 0 0) 0x7f613c09f280 con 0x7f613c13df70 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): my global_id is 254218 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c1394b0 con 0x7f613c13df70 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 294438937 0 0) 0x7f613c139790 con 0x7f613c0a0d70 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): my global_id is 224837 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c09f280 con 0x7f613c0a0d70 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 980398749 0 0) 0x7f611c003530 con 0x7f613c134760 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f613c139790 con 0x7f613c134760 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61240019e0 con 0x7f613c134760 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1866014290 0 0) 0x7f613c1394b0 con 0x7f613c13df70 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f611c003530 con 0x7f613c13df70 2024-04-26T00:08:59.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6134004eb0 con 0x7f613c13df70 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.611 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3024210305 0 0) 0x7f613c09f280 con 0x7f613c0a0d70 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f613c1394b0 con 0x7f613c0a0d70 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f612c001940 con 0x7f613c0a0d70 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient(hunting): dump: 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.612 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3173824413 0 0) 0x7f613c139790 con 0x7f613c134760 2024-04-26T00:08:59.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.106:6793/0 conn(0x7f613c0a0d70 legacy=0x7f613c1ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.106:6791/0 conn(0x7f613c13df70 legacy=0x7f613c1d5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 monclient: found mon.d 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f613c072500 con 0x7f613c134760 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 5 monclient: authenticate success, global_id 254220 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: _renew_subs 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f613c1374a0 con 0x7f613c134760 2024-04-26T00:08:59.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61240038d0 con 0x7f613c134760 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: _renew_subs 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f613c13d060 con 0x7f613c134760 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6124003e40 con 0x7f613c134760 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f6138ff9640 10 monclient: dump: 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.615 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.610+0000 7f613a7fc640 4 set_mon_vals no callback set 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6142057640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f61240040a0 con 0x7f613c134760 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f61200065d0 con 0x7f6120002870 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f6124044080 con 0x7f613c134760 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f613bfff640 10 monclient: get_auth_request con 0x7f611c0381d0 auth_method 0 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236567429 0 0) 0x7f61200065d0 con 0x7f6120002870 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient(hunting): my global_id is 224902 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f613c139790 con 0x7f6120002870 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 986650891 0 0) 0x7f613c139790 con 0x7f6120002870 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61200065d0 con 0x7f6120002870 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f612c003960 con 0x7f6120002870 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient: dump: 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.618 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.619 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2836225820 0 0) 0x7f61200065d0 con 0x7f6120002870 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f612000a160 con 0x7f6120002870 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f612c0057d0 con 0x7f6120002870 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.171:6789/0 conn(0x7f6120002870 legacy=0x7f6120004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.614+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.171:6789/0 conn(0x7f6120002870 legacy=0x7f6120004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:59.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6120009e30 con 0x7f61200090f0 2024-04-26T00:08:59.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131629268 0 0) 0x7f6120009e30 con 0x7f61200090f0 2024-04-26T00:08:59.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient(hunting): my global_id is 224911 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61200065d0 con 0x7f61200090f0 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2630690339 0 0) 0x7f61200065d0 con 0x7f61200090f0 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6120009e30 con 0x7f61200090f0 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f612c004240 con 0x7f61200090f0 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:08:59.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient: dump: 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.624 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 447429571 0 0) 0x7f6120009e30 con 0x7f61200090f0 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f612000c3a0 con 0x7f61200090f0 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7735 (unknown 0 0 2959765863) 0x7f612c005980 con 0x7f61200090f0 2024-04-26T00:08:59.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.171:6789/0 conn(0x7f61200090f0 legacy=0x7f6120009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6138ff9640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.171:6789/0 conn(0x7f61200090f0 legacy=0x7f6120009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:59.626 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 252859, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.627 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.628 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.629 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:59.630 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.631 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:59.632 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.633 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.634 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.635 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.636 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:59.639 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.640 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:59.641 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.643 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:59.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:59.645 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.171:6812/722422047 conn(0x7f611c0381d0 legacy=0x7f611c03a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 10 monclient: shutdown 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 >> v1:172.21.15.106:6792/0 conn(0x7f613c134760 legacy=0x7f613c1d1d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f613bfff640 1 -- 172.21.15.106:0/1639808601 reap_dead start 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f613bfff640 1 -- 172.21.15.106:0/1639808601 reap_dead start 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 shutdown_connections 2024-04-26T00:08:59.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 >> 172.21.15.106:0/1639808601 conn(0x7f613c0a7240 msgr2=0x7f613c0a4be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 shutdown_connections 2024-04-26T00:08:59.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.622+0000 7f6142057640 1 -- 172.21.15.106:0/1639808601 wait complete. 2024-04-26T00:08:59.648 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:59.648 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:08:59.648 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:08:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: get_monmap_and_config 2024-04-26T00:08:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: monmap: 2024-04-26T00:08:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.779 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:59.794506+0000 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:59.794506+0000 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 Processor -- start 2024-04-26T00:08:59.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- start start 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: init 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: _add_conns ranks=[1,7,3,6,5,4,8,0,2] 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient(hunting): picked mon.noname-f con 0x7f42c8134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient(hunting): picked mon.noname-i con 0x7f42c80a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient(hunting): picked mon.noname-g con 0x7f42c813e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c806dd40 con 0x7f42c8134970 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c80a2b10 con 0x7f42c813e200 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c80a2df0 con 0x7f42c80a4820 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient(hunting): authenticate will time out at 1795.321581s 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c77fe640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f42c8134970 0x7f42c8134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:41080/0 (socket says 172.21.15.106:41080) 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c77fe640 1 -- 172.21.15.106:0/3756476127 learned_addr learned my addr 172.21.15.106:0/3756476127 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2298395801 0 0) 0x7f42c80a2b10 con 0x7f42c813e200 2024-04-26T00:08:59.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): my global_id is 215040 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b0003530 con 0x7f42c813e200 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224617362 0 0) 0x7f42c80a2df0 con 0x7f42c80a4820 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): my global_id is 146320 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c80a2b10 con 0x7f42c80a4820 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 240075756 0 0) 0x7f42c806dd40 con 0x7f42c8134970 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient(hunting): my global_id is 224920 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c80a2df0 con 0x7f42c8134970 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2393118601 0 0) 0x7f42b0003530 con 0x7f42c813e200 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 >> v1:172.21.15.171:6792/0 conn(0x7f42c80a4820 legacy=0x7f42c813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 >> v1:172.21.15.171:6789/0 conn(0x7f42c8134970 legacy=0x7f42c8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 monclient: found mon.noname-g 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c80a30d0 con 0x7f42c813e200 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42bc0017c0 con 0x7f42c813e200 2024-04-26T00:08:59.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: dump: 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.784 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 5 monclient: authenticate success, global_id 215040 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42bc001a20 con 0x7f42c813e200 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 4 set_mon_vals no callback set 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 1 -- 172.21.15.106:0/3756476127 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42bc003960 con 0x7f42c813e200 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42c67fc640 10 monclient: dump: 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.785 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 10 monclient: shutdown 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- 172.21.15.106:0/3756476127 >> v1:172.21.15.171:6790/0 conn(0x7f42c813e200 legacy=0x7f42c81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- 172.21.15.106:0/3756476127 shutdown_connections 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- 172.21.15.106:0/3756476127 >> 172.21.15.106:0/3756476127 conn(0x7f42c80a9e20 msgr2=0x7f42c80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- 172.21.15.106:0/3756476127 shutdown_connections 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.790+0000 7f42cdf88640 1 -- 172.21.15.106:0/3756476127 wait complete. 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: monmap: 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.787 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 Processor -- start 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 -- start start 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: init 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: _add_conns ranks=[0,3,4,1,6,5,2,8,7] 2024-04-26T00:08:59.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient(hunting): picked mon.noname-a con 0x7f42c80a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient(hunting): picked mon.noname-g con 0x7f42c8134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient(hunting): picked mon.noname-c con 0x7f42c813e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c8136e30 con 0x7f42c80a4820 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c8139330 con 0x7f42c8134970 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42c8137bb0 con 0x7f42c813e200 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient(hunting): authenticate will time out at 1795.325387s 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42c77fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f42c80a4820 0x7f42c813c880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42978/0 (socket says 172.21.15.106:42978) 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42c77fe640 1 -- 172.21.15.106:0/365287842 learned_addr learned my addr 172.21.15.106:0/365287842 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42c7fff640 1 --1- 172.21.15.106:0/365287842 >> v1:172.21.15.106:6791/0 conn(0x7f42c813e200 0x7f42c81d4e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40314/0 (socket says 172.21.15.106:40314) 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2023682949 0 0) 0x7f42c8137bb0 con 0x7f42c813e200 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): my global_id is 254227 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42b4003530 con 0x7f42c813e200 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2194645746 0 0) 0x7f42c8136e30 con 0x7f42c80a4820 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): my global_id is 8271 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c8137bb0 con 0x7f42c80a4820 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2638160040 0 0) 0x7f42c8139330 con 0x7f42c8134970 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): my global_id is 215049 2024-04-26T00:08:59.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c8136e30 con 0x7f42c8134970 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3277805902 0 0) 0x7f42b4003530 con 0x7f42c813e200 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42c8139330 con 0x7f42c813e200 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42bc0016c0 con 0x7f42c813e200 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): dump: 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.791 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3976140437 0 0) 0x7f42c8137bb0 con 0x7f42c80a4820 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42b4003530 con 0x7f42c80a4820 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42c0001c90 con 0x7f42c80a4820 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): dump: 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.792 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 327629982 0 0) 0x7f42c8139330 con 0x7f42c813e200 2024-04-26T00:08:59.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.171:6790/0 conn(0x7f42c8134970 legacy=0x7f42c81d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.106:6789/0 conn(0x7f42c80a4820 legacy=0x7f42c813c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 monclient: found mon.c 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42c80a1a40 con 0x7f42c813e200 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 5 monclient: authenticate success, global_id 254227 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: _renew_subs 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42c80a1e00 con 0x7f42c813e200 2024-04-26T00:08:59.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: _renew_subs 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f42c813cf90 con 0x7f42c813e200 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42bc001960 con 0x7f42c813e200 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42bc003f10 con 0x7f42c813e200 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42c5ffb640 4 set_mon_vals no callback set 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient: dump: 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.795 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42a80065d0 con 0x7f42a8002870 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f42bc004130 con 0x7f42c813e200 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f42bc044ea0 con 0x7f42c813e200 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605477042 0 0) 0x7f42a80065d0 con 0x7f42a8002870 2024-04-26T00:08:59.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 10 monclient(hunting): my global_id is 215058 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42c8139330 con 0x7f42a8002870 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.794+0000 7f42c6ffd640 10 monclient: get_auth_request con 0x7f42b4037f60 auth_method 0 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3337558056 0 0) 0x7f42c8139330 con 0x7f42a8002870 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42a80065d0 con 0x7f42a8002870 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42c0004eb0 con 0x7f42a8002870 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 10 monclient: dump: 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.797 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2345059242 0 0) 0x7f42a80065d0 con 0x7f42a8002870 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f42a800a160 con 0x7f42a8002870 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f42c0005200 con 0x7f42a8002870 2024-04-26T00:08:59.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.171:6790/0 conn(0x7f42a8002870 legacy=0x7f42a8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.798+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.171:6790/0 conn(0x7f42a8002870 legacy=0x7f42a8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.802+0000 7f42cdf88640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.802+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42a8009e50 con 0x7f42a8009110 2024-04-26T00:08:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1433400920 0 0) 0x7f42a8009e50 con 0x7f42a8009110 2024-04-26T00:08:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient(hunting): my global_id is 215067 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a80065d0 con 0x7f42a8009110 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 33565464 0 0) 0x7f42a80065d0 con 0x7f42a8009110 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42a8009e50 con 0x7f42a8009110 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42c0006000 con 0x7f42a8009110 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient: dump: 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.801 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1638909720 0 0) 0x7f42a8009e50 con 0x7f42a8009110 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f42a800c3e0 con 0x7f42a8009110 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7905 (unknown 0 0 3206076527) 0x7f42c0008220 con 0x7f42a8009110 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.171:6790/0 conn(0x7f42a8009110 legacy=0x7f42a80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42affff640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.171:6790/0 conn(0x7f42a8009110 legacy=0x7f42a80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 370230, 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:59.803 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.804 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.805 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:59.806 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:59.807 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:59.808 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:59.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.810 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.811 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:59.812 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.814 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.815 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.816 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.818 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.820 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.821 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.822 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:59.823 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.171:6812/722422047 conn(0x7f42b4037f60 legacy=0x7f42b403a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 10 monclient: shutdown 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 >> v1:172.21.15.106:6791/0 conn(0x7f42c813e200 legacy=0x7f42c81d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42c7fff640 1 -- 172.21.15.106:0/365287842 reap_dead start 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42c7fff640 1 -- 172.21.15.106:0/365287842 reap_dead start 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 shutdown_connections 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 >> 172.21.15.106:0/365287842 conn(0x7f42c80a9e20 msgr2=0x7f42c8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 shutdown_connections 2024-04-26T00:08:59.825 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.806+0000 7f42cdf88640 1 -- 172.21.15.106:0/365287842 wait complete. 2024-04-26T00:08:59.826 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:59.826 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:08:59.826 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:08:59.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.958+0000 7f66ab9b8640 10 monclient: get_monmap_and_config 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.958+0000 7f66ab9b8640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.958+0000 7f66ab9b8640 10 monclient: monmap: 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:08:59.965321+0000 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:08:59.965321+0000 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.939 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.958+0000 7f66ab9b8640 1 Processor -- start 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.958+0000 7f66ab9b8640 1 -- start start 2024-04-26T00:08:59.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.958+0000 7f66ab9b8640 10 monclient: init 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _add_conns ranks=[2,8,6,0,3,7,4,5,1] 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): picked mon.noname-b con 0x7f66a4071870 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): picked mon.noname-e con 0x7f66a409f120 addr v1:172.21.15.106:6793/0 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): picked mon.noname-d con 0x7f66a413ad00 addr v1:172.21.15.106:6792/0 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a409f500 con 0x7f66a4071870 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a409fe80 con 0x7f66a413ad00 2024-04-26T00:08:59.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a40a0160 con 0x7f66a409f120 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): authenticate will time out at 1795.492233s 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66a8f53640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f66a409f120 0x7f66a41395e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35662/0 (socket says 172.21.15.106:35662) 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66a8f53640 1 -- 172.21.15.106:0/3170911044 learned_addr learned my addr 172.21.15.106:0/3170911044 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66a9f55640 1 --1- 172.21.15.106:0/3170911044 >> v1:172.21.15.106:6792/0 conn(0x7f66a413ad00 0x7f66a413d0f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45838/0 (socket says 172.21.15.106:45838) 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1208741581 0 0) 0x7f66a409f500 con 0x7f66a4071870 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): my global_id is 254234 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6690003530 con 0x7f66a4071870 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 100963492 0 0) 0x7f66a409fe80 con 0x7f66a413ad00 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): my global_id is 254229 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a409f500 con 0x7f66a413ad00 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 509323573 0 0) 0x7f66a40a0160 con 0x7f66a409f120 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient(hunting): my global_id is 224846 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a409fe80 con 0x7f66a409f120 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 11944492 0 0) 0x7f6690003530 con 0x7f66a4071870 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 >> v1:172.21.15.106:6793/0 conn(0x7f66a409f120 legacy=0x7f66a41395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 >> v1:172.21.15.106:6792/0 conn(0x7f66a413ad00 legacy=0x7f66a413d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 monclient: found mon.noname-b 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a40a0440 con 0x7f66a4071870 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66a00017e0 con 0x7f66a4071870 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 5 monclient: authenticate success, global_id 254234 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: dump: 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.950 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.951 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66a0001a90 con 0x7f66a4071870 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: get_monmap_and_config success 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 4 set_mon_vals no callback set 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 1 -- 172.21.15.106:0/3170911044 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66a0003940 con 0x7f66a4071870 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6697fff640 10 monclient: dump: 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.952 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: shutdown 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- 172.21.15.106:0/3170911044 >> v1:172.21.15.106:6790/0 conn(0x7f66a4071870 legacy=0x7f66a4071c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- 172.21.15.106:0/3170911044 shutdown_connections 2024-04-26T00:08:59.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- 172.21.15.106:0/3170911044 >> 172.21.15.106:0/3170911044 conn(0x7f66a40a36e0 msgr2=0x7f66a40a3ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- 172.21.15.106:0/3170911044 shutdown_connections 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- 172.21.15.106:0/3170911044 wait complete. 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: build_initial_monmap 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: monmap: 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:08:59.954 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 Processor -- start 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- start start 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: init 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _reopen_session rank -1 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _add_conns ranks=[5,2,7,1,8,0,3,4,6] 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): picked mon.noname-h con 0x7f66a4071870 addr v1:172.21.15.171:6791/0 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): picked mon.noname-b con 0x7f66a409f120 addr v1:172.21.15.106:6790/0 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): picked mon.noname-i con 0x7f66a413ad00 addr v1:172.21.15.171:6792/0 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a40726c0 con 0x7f66a409f120 2024-04-26T00:08:59.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a409f780 con 0x7f66a4071870 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a4120c30 con 0x7f66a413ad00 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): _renew_subs 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient(hunting): authenticate will time out at 1795.495073s 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66a8f53640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f66a409f120 0x7f66a41cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34890/0 (socket says 172.21.15.106:34890) 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66a8f53640 1 -- 172.21.15.106:0/1689196073 learned_addr learned my addr 172.21.15.106:0/1689196073 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196123029 0 0) 0x7f66a40726c0 con 0x7f66a409f120 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): my global_id is 254243 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6688003530 con 0x7f66a409f120 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2122866959 0 0) 0x7f6688003530 con 0x7f66a409f120 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66a40726c0 con 0x7f66a409f120 2024-04-26T00:08:59.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6698001a20 con 0x7f66a409f120 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): dump: 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.957 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3634914470 0 0) 0x7f66a40726c0 con 0x7f66a409f120 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.171:6792/0 conn(0x7f66a413ad00 legacy=0x7f66a41d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.171:6791/0 conn(0x7f66a4071870 legacy=0x7f66a41361a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 monclient: found mon.b 2024-04-26T00:08:59.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a4120950 con 0x7f66a409f120 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient: _finish_auth 0 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 5 monclient: authenticate success, global_id 254243 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _renew_subs 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f66a411f1f0 con 0x7f66a409f120 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _renew_subs 2024-04-26T00:08:59.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f66a41bfdf0 con 0x7f66a409f120 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6698004aa0 con 0x7f66a409f120 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6698004f90 con 0x7f66a409f120 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f6695ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.962+0000 7f66977fe640 4 set_mon_vals no callback set 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient: dump: 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.960 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f66ab9b8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f66840065d0 con 0x7f6684002870 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f66980051b0 con 0x7f66a409f120 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f6698045250 con 0x7f66a409f120 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f66a9f55640 10 monclient: get_auth_request con 0x7f6688037870 auth_method 0 2024-04-26T00:08:59.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304483781 0 0) 0x7f66840065d0 con 0x7f6684002870 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient(hunting): my global_id is 254201 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a40726c0 con 0x7f6684002870 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3566870765 0 0) 0x7f66a40726c0 con 0x7f6684002870 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66840065d0 con 0x7f6684002870 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66a0003600 con 0x7f6684002870 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient: dump: 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.962 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2593503606 0 0) 0x7f66840065d0 con 0x7f6684002870 2024-04-26T00:08:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f668400a160 con 0x7f6684002870 2024-04-26T00:08:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f66a00038b0 con 0x7f6684002870 2024-04-26T00:08:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:08:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:08:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.171:6791/0 conn(0x7f6684002870 legacy=0x7f6684004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.966+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.171:6791/0 conn(0x7f6684002870 legacy=0x7f6684004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:08:59.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6684009e50 con 0x7f6684009110 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454070872 0 0) 0x7f6684009e50 con 0x7f6684009110 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient(hunting): my global_id is 254210 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66840065d0 con 0x7f6684009110 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3695175183 0 0) 0x7f66840065d0 con 0x7f6684009110 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6684009e50 con 0x7f6684009110 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66a0001790 con 0x7f6684009110 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient: dump: 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:08:59.966 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:08:59.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3097470060 0 0) 0x7f6684009e50 con 0x7f6684009110 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f668400c3e0 con 0x7f6684009110 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 760081716) 0x7f66a0004340 con 0x7f6684009110 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.171:6791/0 conn(0x7f6684009110 legacy=0x7f66840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f6695ffb640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.171:6791/0 conn(0x7f6684009110 legacy=0x7f66840095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:08:59.968 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 10031, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:08:59.969 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.970 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.971 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:08:59.972 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:08:59.973 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:08:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:08:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.974 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.975 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.976 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.977 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.978 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.979 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:08:59.980 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.981 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.982 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:08:59.983 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:08:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:08:59.984 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:08:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.985 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:08:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.986 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:08:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:08:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.988 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:08:59.989 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:08:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:08:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:08:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:08:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:08:59.990 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:08:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:08:59.991 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.992 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:08:59.993 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:08:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:08:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:08:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:08:59.994 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:08:59.994 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:08:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.171:6812/722422047 conn(0x7f6688037870 legacy=0x7f6688039d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 10 monclient: shutdown 2024-04-26T00:08:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:08:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 >> v1:172.21.15.106:6790/0 conn(0x7f66a409f120 legacy=0x7f66a41cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:08:59.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66a9f55640 1 -- 172.21.15.106:0/1689196073 reap_dead start 2024-04-26T00:08:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66a9f55640 1 -- 172.21.15.106:0/1689196073 reap_dead start 2024-04-26T00:08:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 shutdown_connections 2024-04-26T00:08:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.974+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 >> 172.21.15.106:0/1689196073 conn(0x7f66a40a36e0 msgr2=0x7f66a4067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:08:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.978+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 shutdown_connections 2024-04-26T00:08:59.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:08:59.978+0000 7f66ab9b8640 1 -- 172.21.15.106:0/1689196073 wait complete. 2024-04-26T00:08:59.998 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:08:59.998 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:08:59.998 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:09:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: get_monmap_and_config 2024-04-26T00:09:00.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: build_initial_monmap 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: monmap: 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:00.138505+0000 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:00.138505+0000 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:00.112 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:00.113 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:00.113 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 Processor -- start 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- start start 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: init 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: _add_conns ranks=[5,0,8,2,4,1,7,3,6] 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient(hunting): picked mon.noname-h con 0x7f5c68134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient(hunting): picked mon.noname-a con 0x7f5c680a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient(hunting): picked mon.noname-e con 0x7f5c6813e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6806dd40 con 0x7f5c680a4820 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c680a2b10 con 0x7f5c68134970 2024-04-26T00:09:00.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c680a2df0 con 0x7f5c6813e200 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient(hunting): authenticate will time out at 1795.665571s 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d903640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5c680a4820 0x7f5c6813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42988/0 (socket says 172.21.15.106:42988) 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d903640 1 -- 172.21.15.106:0/2130874855 learned_addr learned my addr 172.21.15.106:0/2130874855 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2988458962 0 0) 0x7f5c6806dd40 con 0x7f5c680a4820 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): my global_id is 8280 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c54003530 con 0x7f5c680a4820 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1938249448 0 0) 0x7f5c680a2df0 con 0x7f5c6813e200 2024-04-26T00:09:00.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient(hunting): my global_id is 224855 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c6806dd40 con 0x7f5c6813e200 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1762415727 0 0) 0x7f5c54003530 con 0x7f5c680a4820 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 >> v1:172.21.15.106:6793/0 conn(0x7f5c6813e200 legacy=0x7f5c681405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 >> v1:172.21.15.171:6791/0 conn(0x7f5c68134970 legacy=0x7f5c68134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: _finish_hunting 0 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 monclient: found mon.noname-a 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c680a30d0 con 0x7f5c680a4820 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: _finish_auth 0 2024-04-26T00:09:00.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: _check_auth_tickets 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c580017c0 con 0x7f5c680a4820 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: dump: 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.124 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 5 monclient: authenticate success, global_id 8280 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c58001a70 con 0x7f5c680a4820 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 1 -- 172.21.15.106:0/2130874855 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c58004bf0 con 0x7f5c680a4820 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 4 set_mon_vals no callback set 2024-04-26T00:09:00.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c6d102640 10 monclient: dump: 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.126 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.127 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: shutdown 2024-04-26T00:09:00.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- 172.21.15.106:0/2130874855 >> v1:172.21.15.106:6789/0 conn(0x7f5c680a4820 legacy=0x7f5c6813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- 172.21.15.106:0/2130874855 shutdown_connections 2024-04-26T00:09:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- 172.21.15.106:0/2130874855 >> 172.21.15.106:0/2130874855 conn(0x7f5c680a9e20 msgr2=0x7f5c680aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- 172.21.15.106:0/2130874855 shutdown_connections 2024-04-26T00:09:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- 172.21.15.106:0/2130874855 wait complete. 2024-04-26T00:09:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: build_initial_monmap 2024-04-26T00:09:00.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: monmap: 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:00.131 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 Processor -- start 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 1 -- start start 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.134+0000 7f5c70368640 10 monclient: init 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient: _add_conns ranks=[3,6,0,7,4,5,2,1,8] 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient(hunting): picked mon.noname-g con 0x7f5c680a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient(hunting): picked mon.noname-d con 0x7f5c68134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient(hunting): picked mon.noname-a con 0x7f5c6813e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c680a1e00 con 0x7f5c6813e200 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6809e2c0 con 0x7f5c680a4820 2024-04-26T00:09:00.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c6809ce10 con 0x7f5c68134970 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient(hunting): authenticate will time out at 1795.668445s 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c6e905640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5c6813e200 0x7f5c681d4e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42990/0 (socket says 172.21.15.106:42990) 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c6e905640 1 -- 172.21.15.106:0/3942646355 learned_addr learned my addr 172.21.15.106:0/3942646355 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c6d903640 1 --1- 172.21.15.106:0/3942646355 >> v1:172.21.15.106:6792/0 conn(0x7f5c68134970 0x7f5c681d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45852/0 (socket says 172.21.15.106:45852) 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2885630997 0 0) 0x7f5c6806dd40 con 0x7f5c6813e200 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): my global_id is 8289 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c4c003530 con 0x7f5c6813e200 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1189504054 0 0) 0x7f5c6809ce10 con 0x7f5c68134970 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): my global_id is 254238 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c6806dd40 con 0x7f5c68134970 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 878966973 0 0) 0x7f5c4c003530 con 0x7f5c6813e200 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c6809ce10 con 0x7f5c6813e200 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c60001d00 con 0x7f5c6813e200 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): dump: 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.134 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3936000371 0 0) 0x7f5c6806dd40 con 0x7f5c68134970 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c4c003530 con 0x7f5c68134970 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c58004b30 con 0x7f5c68134970 2024-04-26T00:09:00.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): dump: 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.136 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1894582511 0 0) 0x7f5c6809e2c0 con 0x7f5c680a4820 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): my global_id is 215076 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c6806dd40 con 0x7f5c680a4820 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 16899612 0 0) 0x7f5c6809ce10 con 0x7f5c6813e200 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.106:6792/0 conn(0x7f5c68134970 legacy=0x7f5c681d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.171:6790/0 conn(0x7f5c680a4820 legacy=0x7f5c6809fad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: _finish_hunting 0 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 monclient: found mon.a 2024-04-26T00:09:00.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c6809c2b0 con 0x7f5c6813e200 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: _finish_auth 0 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: _check_auth_tickets 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 5 monclient: authenticate success, global_id 8289 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient: _renew_subs 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5c6809dfe0 con 0x7f5c6813e200 2024-04-26T00:09:00.138 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient: _renew_subs 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5c680a03b0 con 0x7f5c6813e200 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c60001fe0 con 0x7f5c6813e200 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c6c901640 4 set_mon_vals no callback set 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c60004010 con 0x7f5c6813e200 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: dump: 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.139 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5c500065d0 con 0x7f5c50002870 2024-04-26T00:09:00.140 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5c60004230 con 0x7f5c6813e200 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5c60045420 con 0x7f5c6813e200 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c6d903640 10 monclient: get_auth_request con 0x7f5c4c037dd0 auth_method 0 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 359691208 0 0) 0x7f5c500065d0 con 0x7f5c50002870 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient(hunting): my global_id is 146338 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c6809ce10 con 0x7f5c50002870 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1263485818 0 0) 0x7f5c6809ce10 con 0x7f5c50002870 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c500065d0 con 0x7f5c50002870 2024-04-26T00:09:00.141 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c640018f0 con 0x7f5c50002870 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 10 monclient: dump: 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.142 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3876742349 0 0) 0x7f5c500065d0 con 0x7f5c50002870 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.138+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c5000a160 con 0x7f5c50002870 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.142+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5c64004650 con 0x7f5c50002870 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.142+0000 7f5c5effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.142+0000 7f5c5effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.142+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.171:6792/0 conn(0x7f5c50002870 legacy=0x7f5c50004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.143 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.142+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.171:6792/0 conn(0x7f5c50002870 legacy=0x7f5c50004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c70368640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5c50009e30 con 0x7f5c500090f0 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3400796779 0 0) 0x7f5c50009e30 con 0x7f5c500090f0 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 10 monclient(hunting): my global_id is 146347 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c500065d0 con 0x7f5c500090f0 2024-04-26T00:09:00.145 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3598512402 0 0) 0x7f5c500065d0 con 0x7f5c500090f0 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c50009e30 con 0x7f5c500090f0 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c64003c30 con 0x7f5c500090f0 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 10 monclient: dump: 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.146 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3936852994 0 0) 0x7f5c50009e30 con 0x7f5c500090f0 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.146+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5c5000c3a0 con 0x7f5c500090f0 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2557190266) 0x7f5c64003e60 con 0x7f5c500090f0 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c5effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c5effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.171:6792/0 conn(0x7f5c500090f0 legacy=0x7f5c50009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c5effd640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.171:6792/0 conn(0x7f5c500090f0 legacy=0x7f5c50009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 88, 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 603680, 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:00.148 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:00.149 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:00.150 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:00.151 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:00.152 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.153 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.154 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.155 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.156 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.157 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.158 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.159 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:00.160 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.161 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.162 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.163 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:00.164 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:00.165 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:00.166 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.171:6812/722422047 conn(0x7f5c4c037dd0 legacy=0x7f5c4c03a290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 10 monclient: shutdown 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 >> v1:172.21.15.106:6789/0 conn(0x7f5c6813e200 legacy=0x7f5c681d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c6e905640 1 -- 172.21.15.106:0/3942646355 reap_dead start 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c6e905640 1 -- 172.21.15.106:0/3942646355 reap_dead start 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 shutdown_connections 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 >> 172.21.15.106:0/3942646355 conn(0x7f5c680a9e20 msgr2=0x7f5c68067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 shutdown_connections 2024-04-26T00:09:00.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.150+0000 7f5c70368640 1 -- 172.21.15.106:0/3942646355 wait complete. 2024-04-26T00:09:00.168 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:09:00.169 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['a', 'c'] 2024-04-26T00:09:00.169 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-04-26T00:09:00.169 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a 2024-04-26T00:09:00.169 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.a store 2024-04-26T00:09:00.169 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a sync_force --yes-i-really-mean-it 2024-04-26T00:09:00.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.310+0000 7f4fb0735640 10 monclient: get_monmap_and_config 2024-04-26T00:09:00.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.310+0000 7f4fb0735640 10 monclient: build_initial_monmap 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.310+0000 7f4fb0735640 10 monclient: monmap: 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:00.316518+0000 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:00.316518+0000 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:00.290 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:00.291 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:00.291 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.310+0000 7f4fb0735640 1 Processor -- start 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.310+0000 7f4fb0735640 1 -- start start 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.310+0000 7f4fb0735640 10 monclient: init 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: _add_conns ranks=[5,0,1,4,8,7,6,3,2] 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): picked mon.noname-h con 0x7f4fa806b210 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): picked mon.noname-a con 0x7f4fa806bd00 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): picked mon.noname-f con 0x7f4fa809b600 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa80a3010 con 0x7f4fa806bd00 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa80a1d10 con 0x7f4fa809b600 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa80a05f0 con 0x7f4fa806b210 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): authenticate will time out at 1795.844305s 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fadcd0640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f4fa806bd00 0x7f4fa813a940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:42994/0 (socket says 172.21.15.106:42994) 2024-04-26T00:09:00.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fadcd0640 1 -- 172.21.15.106:0/147098577 learned_addr learned my addr 172.21.15.106:0/147098577 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3269085792 0 0) 0x7f4fa80a3010 con 0x7f4fa806bd00 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient(hunting): my global_id is 8298 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f94003530 con 0x7f4fa806bd00 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1411041291 0 0) 0x7f4f94003530 con 0x7f4fa806bd00 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 >> v1:172.21.15.171:6791/0 conn(0x7f4fa806b210 legacy=0x7f4fa806b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 >> v1:172.21.15.171:6789/0 conn(0x7f4fa809b600 legacy=0x7f4fa813e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: _finish_hunting 0 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 monclient: found mon.noname-a 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa80726b0 con 0x7f4fa806bd00 2024-04-26T00:09:00.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: _finish_auth 0 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: _check_auth_tickets 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f980017c0 con 0x7f4fa806bd00 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 5 monclient: authenticate success, global_id 8298 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: dump: 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.302 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f98001ab0 con 0x7f4fa806bd00 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:00.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 4 set_mon_vals no callback set 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 1 -- 172.21.15.106:0/147098577 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f98004bf0 con 0x7f4fa806bd00 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fad4cf640 10 monclient: dump: 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.304 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: shutdown 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- 172.21.15.106:0/147098577 >> v1:172.21.15.106:6789/0 conn(0x7f4fa806bd00 legacy=0x7f4fa813a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- 172.21.15.106:0/147098577 shutdown_connections 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- 172.21.15.106:0/147098577 >> 172.21.15.106:0/147098577 conn(0x7f4fa80a6fe0 msgr2=0x7f4fa80a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- 172.21.15.106:0/147098577 shutdown_connections 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- 172.21.15.106:0/147098577 wait complete. 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: build_initial_monmap 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: monmap: 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:00.305 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:00.306 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 Processor -- start 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- start start 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: init 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient: _add_conns ranks=[4,8,6,2,5,7,3,0,1] 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): picked mon.noname-c con 0x7f4fa806b210 addr v1:172.21.15.106:6791/0 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): picked mon.noname-e con 0x7f4fa806bd00 addr v1:172.21.15.106:6793/0 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): picked mon.noname-d con 0x7f4fa809b600 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa80a2400 con 0x7f4fa806b210 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa8072b00 con 0x7f4fa809b600 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fa811f3e0 con 0x7f4fa806bd00 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:00.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fb0735640 10 monclient(hunting): authenticate will time out at 1795.847171s 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fadcd0640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f4fa806bd00 0x7f4fa81c8df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35678/0 (socket says 172.21.15.106:35678) 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fadcd0640 1 -- 172.21.15.106:0/4107944196 learned_addr learned my addr 172.21.15.106:0/4107944196 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4fae4d1640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f4fa806b210 0x7f4fa8135a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40330/0 (socket says 172.21.15.106:40330) 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1665517066 0 0) 0x7f4fa811f3e0 con 0x7f4fa806bd00 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): my global_id is 224864 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f8c003530 con 0x7f4fa806bd00 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3913178356 0 0) 0x7f4fa80a2400 con 0x7f4fa806b210 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): my global_id is 254236 2024-04-26T00:09:00.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa811f3e0 con 0x7f4fa806b210 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1464678673 0 0) 0x7f4fa8072b00 con 0x7f4fa809b600 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): my global_id is 254247 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa80a2400 con 0x7f4fa809b600 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3577685808 0 0) 0x7f4f8c003530 con 0x7f4fa806bd00 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fa8072b00 con 0x7f4fa806bd00 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f98001780 con 0x7f4fa806bd00 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): dump: 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.309 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1608130199 0 0) 0x7f4fa811f3e0 con 0x7f4fa806b210 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f8c003530 con 0x7f4fa806b210 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 283717861 0 0) 0x7f4fa80a2400 con 0x7f4fa809b600 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4fa811f3e0 con 0x7f4fa809b600 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fa40019e0 con 0x7f4fa806b210 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): dump: 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.311 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fa0001b70 con 0x7f4fa809b600 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.314+0000 7f4f9effd640 10 monclient(hunting): dump: 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.312 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4215033037 0 0) 0x7f4fa8072b00 con 0x7f4fa806bd00 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.106:6792/0 conn(0x7f4fa809b600 legacy=0x7f4fa81d46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.106:6791/0 conn(0x7f4fa806b210 legacy=0x7f4fa8135a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: _finish_hunting 0 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 monclient: found mon.e 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fa811eb40 con 0x7f4fa806bd00 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: _finish_auth 0 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: _check_auth_tickets 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 5 monclient: authenticate success, global_id 224864 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 10 monclient: _renew_subs 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:00.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4fa8136170 con 0x7f4fa806bd00 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 10 monclient: _renew_subs 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4fa81c96d0 con 0x7f4fa806bd00 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f98001ab0 con 0x7f4fa806bd00 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4f98001ce0 con 0x7f4fa806bd00 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4faccce640 4 set_mon_vals no callback set 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: dump: 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.315 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f900065d0 con 0x7f4f90002870 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4f980100f0 con 0x7f4fa806bd00 2024-04-26T00:09:00.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f4f980453b0 con 0x7f4fa806bd00 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899481073 0 0) 0x7f4f900065d0 con 0x7f4f90002870 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient(hunting): my global_id is 8307 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4fa8072b00 con 0x7f4f90002870 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 6378753 0 0) 0x7f4fa8072b00 con 0x7f4f90002870 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4faecd2640 10 monclient: get_auth_request con 0x7f4f8c0381f0 auth_method 0 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f900065d0 con 0x7f4f90002870 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fa4003960 con 0x7f4f90002870 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: dump: 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.317 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1242734925 0 0) 0x7f4f900065d0 con 0x7f4f90002870 2024-04-26T00:09:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f9000a160 con 0x7f4f90002870 2024-04-26T00:09:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4fa40057d0 con 0x7f4f90002870 2024-04-26T00:09:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.106:6789/0 conn(0x7f4f90002870 legacy=0x7f4f90004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.318+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.106:6789/0 conn(0x7f4f90002870 legacy=0x7f4f90004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:09:00.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f90009e60 con 0x7f4f90009120 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1195884981 0 0) 0x7f4f90009e60 con 0x7f4f90009120 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient(hunting): my global_id is 8316 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f900065d0 con 0x7f4f90009120 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1396554196 0 0) 0x7f4f900065d0 con 0x7f4f90009120 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f90009e60 con 0x7f4f90009120 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4fa40042a0 con 0x7f4f90009120 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient: dump: 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.321 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3022845813 0 0) 0x7f4f90009e60 con 0x7f4f90009120 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f4f9000c3e0 con 0x7f4f90009120 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f4fa4005980 con 0x7f4f90009120 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.106:6789/0 conn(0x7f4f90009120 legacy=0x7f4f900095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4f9effd640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.106:6789/0 conn(0x7f4f90009120 legacy=0x7f4f900095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-26T00:09:00.323 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.171:6812/722422047 conn(0x7f4f8c0381f0 legacy=0x7f4f8c03a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 10 monclient: shutdown 2024-04-26T00:09:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:00.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 >> v1:172.21.15.106:6793/0 conn(0x7f4fa806bd00 legacy=0x7f4fa81c8df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4faecd2640 1 -- 172.21.15.106:0/4107944196 reap_dead start 2024-04-26T00:09:00.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4faecd2640 1 -- 172.21.15.106:0/4107944196 reap_dead start 2024-04-26T00:09:00.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 shutdown_connections 2024-04-26T00:09:00.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 >> 172.21.15.106:0/4107944196 conn(0x7f4fa80a6fe0 msgr2=0x7f4fa8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:00.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 shutdown_connections 2024-04-26T00:09:00.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.326+0000 7f4fb0735640 1 -- 172.21.15.106:0/4107944196 wait complete. 2024-04-26T00:09:00.326 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T00:09:00.327 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T00:09:00.327 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:09:00.345 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T00:09:00.345 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-04-26T00:09:00.345 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T00:09:00.346 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T00:09:00.346 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:09:00.399 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T00:09:00.399 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 7 2024-04-26T00:09:00.399 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:09:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient: get_monmap_and_config 2024-04-26T00:09:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient: build_initial_monmap 2024-04-26T00:09:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient: monmap: 2024-04-26T00:09:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:00.556 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:00.583231+0000 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:00.583231+0000 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:00.557 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:00.558 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 1 Processor -- start 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 1 -- start start 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient: init 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient: _add_conns ranks=[1,5,7,4,0,8,6,2,3] 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient(hunting): picked mon.noname-f con 0x7f02c00a16f0 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient(hunting): picked mon.noname-h con 0x7f02c009bf70 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient(hunting): picked mon.noname-i con 0x7f02c00a21e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c009cc80 con 0x7f02c00a16f0 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c009a9a0 con 0x7f02c009bf70 2024-04-26T00:09:00.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c009f9c0 con 0x7f02c00a21e0 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02c48a7640 10 monclient(hunting): authenticate will time out at 1796.110638s 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02b5d9b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f02c009bf70 0x7f02c013a980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:35942/0 (socket says 172.21.15.106:35942) 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02b5d9b640 1 -- 172.21.15.106:0/3851885123 learned_addr learned my addr 172.21.15.106:0/3851885123 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02be59c640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f02c00a16f0 0x7f02c00a1ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:41106/0 (socket says 172.21.15.106:41106) 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 243814229 0 0) 0x7f02c009a9a0 con 0x7f02c009bf70 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): my global_id is 254237 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02ac003530 con 0x7f02c009bf70 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4258446135 0 0) 0x7f02c009cc80 con 0x7f02c00a16f0 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): my global_id is 224938 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c009a9a0 con 0x7f02c00a16f0 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4208865763 0 0) 0x7f02c009f9c0 con 0x7f02c00a21e0 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 10 monclient(hunting): my global_id is 146356 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.578+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c009cc80 con 0x7f02c00a21e0 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3140057791 0 0) 0x7f02c009cc80 con 0x7f02c00a21e0 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 >> v1:172.21.15.171:6791/0 conn(0x7f02c009bf70 legacy=0x7f02c013a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 >> v1:172.21.15.171:6789/0 conn(0x7f02c00a16f0 legacy=0x7f02c00a1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: _finish_hunting 0 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 monclient: found mon.noname-i 2024-04-26T00:09:00.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c00a3150 con 0x7f02c00a21e0 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: _finish_auth 0 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: _check_auth_tickets 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02b8001990 con 0x7f02c00a21e0 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 5 monclient: authenticate success, global_id 146356 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: dump: 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.574 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:00.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02b8001bc0 con 0x7f02c00a21e0 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 4 set_mon_vals no callback set 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 1 -- 172.21.15.106:0/3851885123 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02b80039a0 con 0x7f02c00a21e0 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bdd9b640 10 monclient: dump: 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.576 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: shutdown 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- 172.21.15.106:0/3851885123 >> v1:172.21.15.171:6792/0 conn(0x7f02c00a21e0 legacy=0x7f02c013e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- 172.21.15.106:0/3851885123 shutdown_connections 2024-04-26T00:09:00.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- 172.21.15.106:0/3851885123 >> 172.21.15.106:0/3851885123 conn(0x7f02c00a62e0 msgr2=0x7f02c00a27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- 172.21.15.106:0/3851885123 shutdown_connections 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- 172.21.15.106:0/3851885123 wait complete. 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: build_initial_monmap 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: monmap: 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:00.578 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 Processor -- start 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- start start 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: init 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: _add_conns ranks=[4,2,1,7,0,8,5,6,3] 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient(hunting): picked mon.noname-c con 0x7f02c009bf70 addr v1:172.21.15.106:6791/0 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient(hunting): picked mon.noname-b con 0x7f02c00a16f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient(hunting): picked mon.noname-f con 0x7f02c00a21e0 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c0070f00 con 0x7f02c00a21e0 2024-04-26T00:09:00.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c009c950 con 0x7f02c00a16f0 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02c0071600 con 0x7f02c009bf70 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient(hunting): authenticate will time out at 1796.114587s 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02be59c640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f02c009bf70 legacy=0x7f02c0133b40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b5d9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f02c00a16f0 0x7f02c01d1340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34900/0 (socket says 172.21.15.106:34900) 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b5d9b640 1 -- 172.21.15.106:0/238395705 learned_addr learned my addr 172.21.15.106:0/238395705 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3734635429 0 0) 0x7f02c009c950 con 0x7f02c00a16f0 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): my global_id is 254252 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a0003530 con 0x7f02c00a16f0 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 263145300 0 0) 0x7f02a0003530 con 0x7f02c00a16f0 2024-04-26T00:09:00.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02c009c950 con 0x7f02c00a16f0 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02a8001cc0 con 0x7f02c00a16f0 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): dump: 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.581 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3917840988 0 0) 0x7f02c0070f00 con 0x7f02c00a21e0 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient(hunting): my global_id is 224947 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02a0003530 con 0x7f02c00a21e0 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3239780638 0 0) 0x7f02c009c950 con 0x7f02c00a16f0 2024-04-26T00:09:00.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 >> v1:172.21.15.106:6791/0 conn(0x7f02c009bf70 legacy=0x7f02c0133b40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 >> v1:172.21.15.171:6789/0 conn(0x7f02c00a21e0 legacy=0x7f02c01d4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 monclient: found mon.b 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02c011d4c0 con 0x7f02c00a16f0 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: _finish_auth 0 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 5 monclient: authenticate success, global_id 254252 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: _renew_subs 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02c0134250 con 0x7f02c00a16f0 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: _renew_subs 2024-04-26T00:09:00.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f02c0072550 con 0x7f02c00a16f0 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02a8004b20 con 0x7f02c00a16f0 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02a8005010 con 0x7f02c00a16f0 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02bd59a640 4 set_mon_vals no callback set 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.582+0000 7f02b77fe640 10 monclient: dump: 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:00.584 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.586+0000 7f02c48a7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.586+0000 7f02c48a7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.586+0000 7f02c48a7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.586+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f02a80051b0 con 0x7f02c00a16f0 2024-04-26T00:09:00.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.586+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02a4005090 con 0x7f02c00a16f0 2024-04-26T00:09:00.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.586+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f02a8045310 con 0x7f02c00a16f0 2024-04-26T00:09:00.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.586+0000 7f02be59c640 10 monclient: get_auth_request con 0x7f02a00377b0 auth_method 0 2024-04-26T00:09:00.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.590+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f02a8015940 con 0x7f02c00a16f0 2024-04-26T00:09:00.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.590+0000 7f02b77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:00.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.590+0000 7f02b77fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.806+0000 7f02c48a7640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:09:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.806+0000 7f02c48a7640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:09:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.806+0000 7f02c48a7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:09:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.806+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f02a4005380 con 0x7f02c00a16f0 2024-04-26T00:09:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02b77fe640 1 -- 172.21.15.106:0/238395705 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 3382474165) 0x7f02a8015240 con 0x7f02c00a16f0 2024-04-26T00:09:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02b77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:09:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02b77fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:00.788 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":88,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:09:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 >> v1:172.21.15.171:6812/722422047 conn(0x7f02a00377b0 legacy=0x7f02a0039c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 10 monclient: shutdown 2024-04-26T00:09:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 >> v1:172.21.15.106:6790/0 conn(0x7f02c00a16f0 legacy=0x7f02c01d1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 shutdown_connections 2024-04-26T00:09:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 >> 172.21.15.106:0/238395705 conn(0x7f02c00a62e0 msgr2=0x7f02c00a3f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 shutdown_connections 2024-04-26T00:09:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:00.810+0000 7f02c48a7640 1 -- 172.21.15.106:0/238395705 wait complete. 2024-04-26T00:09:03.806 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:09:03.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient: get_monmap_and_config 2024-04-26T00:09:03.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient: build_initial_monmap 2024-04-26T00:09:03.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient: monmap: 2024-04-26T00:09:03.933 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:03.933 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:03.960306+0000 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:03.960306+0000 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:03.934 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:03.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 1 Processor -- start 2024-04-26T00:09:03.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 1 -- start start 2024-04-26T00:09:03.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient: init 2024-04-26T00:09:03.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:03.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient: _add_conns ranks=[4,6,7,8,2,5,1,3,0] 2024-04-26T00:09:03.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient(hunting): picked mon.noname-c con 0x7f6fec134820 addr v1:172.21.15.106:6791/0 2024-04-26T00:09:03.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient(hunting): picked mon.noname-d con 0x7f6fec0725d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:03.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient(hunting): picked mon.noname-i con 0x7f6fec13ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:03.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec071270 con 0x7f6fec134820 2024-04-26T00:09:03.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec0714e0 con 0x7f6fec0725d0 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec0729f0 con 0x7f6fec13ace0 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff1229640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f6fec134820 legacy=0x7f6fec134c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff348d640 10 monclient(hunting): authenticate will time out at 1799.487546s 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff0a28640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6fec0725d0 0x7f6fec1395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:45878/0 (socket says 172.21.15.106:45878) 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6ff0a28640 1 -- 172.21.15.106:0/3976771985 learned_addr learned my addr 172.21.15.106:0/3976771985 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3179189531 0 0) 0x7f6fe0001120 con 0x7f6fec0725d0 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6febfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6febfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6febfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6febfff640 10 monclient(hunting): my global_id is 254256 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.954+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd4003530 con 0x7f6fec0725d0 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3173471674 0 0) 0x7f6fd4003530 con 0x7f6fec0725d0 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 >> v1:172.21.15.171:6792/0 conn(0x7f6fec13ace0 legacy=0x7f6fec13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:03.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 >> v1:172.21.15.106:6791/0 conn(0x7f6fec134820 legacy=0x7f6fec134c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: _finish_hunting 0 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 monclient: found mon.noname-d 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec0717c0 con 0x7f6fec0725d0 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: _finish_auth 0 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: _check_auth_tickets 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 5 monclient: authenticate success, global_id 254256 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6fe0001990 con 0x7f6fec0725d0 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: dump: 2024-04-26T00:09:03.945 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:03.946 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fe0001bf0 con 0x7f6fec0725d0 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 4 set_mon_vals no callback set 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 1 -- 172.21.15.106:0/3976771985 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6fe0004bf0 con 0x7f6fec0725d0 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6febfff640 10 monclient: dump: 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.947 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: shutdown 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/3976771985 >> v1:172.21.15.106:6792/0 conn(0x7f6fec0725d0 legacy=0x7f6fec1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:03.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/3976771985 shutdown_connections 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/3976771985 >> 172.21.15.106:0/3976771985 conn(0x7f6fec0a64e0 msgr2=0x7f6fec0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/3976771985 shutdown_connections 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/3976771985 wait complete. 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: build_initial_monmap 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: monmap: 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:03.949 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 Processor -- start 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- start start 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: init 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _add_conns ranks=[8,7,1,5,0,4,2,3,6] 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient(hunting): picked mon.noname-e con 0x7f6fec0725d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:09:03.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient(hunting): picked mon.noname-i con 0x7f6fec134820 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient(hunting): picked mon.noname-f con 0x7f6fec13ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec13fbf0 con 0x7f6fec13ace0 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec139e30 con 0x7f6fec134820 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6fec13aa00 con 0x7f6fec0725d0 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient(hunting): authenticate will time out at 1799.490296s 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff1229640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f6fec0725d0 0x7f6fec139010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35708/0 (socket says 172.21.15.106:35708) 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff1229640 1 -- 172.21.15.106:0/4294292045 learned_addr learned my addr 172.21.15.106:0/4294292045 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1163805663 0 0) 0x7f6fec13aa00 con 0x7f6fec0725d0 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): my global_id is 224873 2024-04-26T00:09:03.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd8003530 con 0x7f6fec0725d0 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1955864039 0 0) 0x7f6fd8003530 con 0x7f6fec0725d0 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fec13aa00 con 0x7f6fec0725d0 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6fe4004680 con 0x7f6fec0725d0 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): dump: 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:03.952 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1108308954 0 0) 0x7f6fec13aa00 con 0x7f6fec0725d0 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 >> v1:172.21.15.171:6792/0 conn(0x7f6fec134820 legacy=0x7f6fec139720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 >> v1:172.21.15.171:6789/0 conn(0x7f6fec13ace0 legacy=0x7f6fec1d47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 monclient: found mon.e 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:03.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fec0706a0 con 0x7f6fec0725d0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 5 monclient: authenticate success, global_id 224873 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _renew_subs 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6fec09f720 con 0x7f6fec0725d0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _renew_subs 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f6fec09ee20 con 0x7f6fec0725d0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fe40049e0 con 0x7f6fec0725d0 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:03.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6fe4004f50 con 0x7f6fec0725d0 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6feaffd640 4 set_mon_vals no callback set 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 10 monclient: dump: 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:03.955 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6fe4005170 con 0x7f6fec0725d0 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.958+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6fcc005090 con 0x7f6fec0725d0 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.962+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f6fe4045620 con 0x7f6fec0725d0 2024-04-26T00:09:03.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.962+0000 7f6ff0a28640 10 monclient: get_auth_request con 0x7f6fd80377e0 auth_method 0 2024-04-26T00:09:03.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.966+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6fe4015cc0 con 0x7f6fec0725d0 2024-04-26T00:09:03.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.966+0000 7f6fe9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:03.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:03.966+0000 7f6fe9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:04.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.178+0000 7f6ff348d640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:09:04.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.178+0000 7f6ff348d640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:09:04.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.178+0000 7f6ff348d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:09:04.157 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.178+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6fcc005380 con 0x7f6fec0725d0 2024-04-26T00:09:04.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.178+0000 7f6fe9ffb640 1 -- 172.21.15.106:0/4294292045 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2744 (unknown 254746657 0 2928327556) 0x7f6fe40155c0 con 0x7f6fec0725d0 2024-04-26T00:09:04.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.178+0000 7f6fe9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:09:04.158 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.178+0000 7f6fe9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:04.158 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":88,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":9,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 >> v1:172.21.15.171:6812/722422047 conn(0x7f6fd80377e0 legacy=0x7f6fd8039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 10 monclient: shutdown 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 >> v1:172.21.15.106:6793/0 conn(0x7f6fec0725d0 legacy=0x7f6fec139010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 shutdown_connections 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 >> 172.21.15.106:0/4294292045 conn(0x7f6fec0a64e0 msgr2=0x7f6fec13d0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 shutdown_connections 2024-04-26T00:09:04.160 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:04.182+0000 7f6ff348d640 1 -- 172.21.15.106:0/4294292045 wait complete. 2024-04-26T00:09:07.175 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient: get_monmap_and_config 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient: build_initial_monmap 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient: monmap: 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:07.327999+0000 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:07.327999+0000 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:07.301 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:07.302 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:07.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 1 Processor -- start 2024-04-26T00:09:07.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 1 -- start start 2024-04-26T00:09:07.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient: init 2024-04-26T00:09:07.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:07.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient: _add_conns ranks=[0,5,2,4,3,6,8,7,1] 2024-04-26T00:09:07.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient(hunting): picked mon.noname-a con 0x7f984c071080 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:07.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient(hunting): picked mon.noname-h con 0x7f984c072750 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient(hunting): picked mon.noname-b con 0x7f984c072b70 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c06e240 con 0x7f984c071080 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c0705a0 con 0x7f984c072b70 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c070880 con 0x7f984c072750 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f9851dfd640 10 monclient(hunting): authenticate will time out at 1802.855640s 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f984b7fe640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f984c071080 legacy=0x7f984c137650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f984bfff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f984c072b70 0x7f984c140010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34202/0 (socket says 172.21.15.106:34202) 2024-04-26T00:09:07.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.322+0000 7f984bfff640 1 -- 172.21.15.106:0/1519091571 learned_addr learned my addr 172.21.15.106:0/1519091571 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:07.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.526+0000 7f984b7fe640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6789/0 conn(0x7f984c071080 legacy=0x7f984c137650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:07.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:07.930+0000 7f984b7fe640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6789/0 conn(0x7f984c071080 legacy=0x7f984c137650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:08.711 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:08.734+0000 7f984b7fe640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6789/0 conn(0x7f984c071080 legacy=0x7f984c137650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:10.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 10 monclient(hunting): tick 2024-04-26T00:09:10.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:09:10.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 1 monclient(hunting): continuing hunt 2024-04-26T00:09:10.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.171:6791/0 conn(0x7f984c072750 legacy=0x7f984c13c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6790/0 conn(0x7f984c072b70 legacy=0x7f984c140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6789/0 conn(0x7f984c071080 legacy=0x7f984c137650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 10 monclient: _add_conns ranks=[3,8,6,7,1,4] 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 10 monclient(hunting): picked mon.noname-g con 0x7f982c0037d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 10 monclient(hunting): picked mon.noname-e con 0x7f982c007440 addr v1:172.21.15.106:6793/0 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.322+0000 7f98497fa640 10 monclient(hunting): picked mon.noname-d con 0x7f982c00b1b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c06cee0 con 0x7f982c0037d0 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c06e240 con 0x7f982c00b1b0 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c011010 con 0x7f982c007440 2024-04-26T00:09:10.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:10.326+0000 7f98497fa640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient(hunting): tick 2024-04-26T00:09:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:09:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 1 monclient(hunting): continuing hunt 2024-04-26T00:09:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:09:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6793/0 conn(0x7f982c007440 legacy=0x7f982c0098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:13.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6792/0 conn(0x7f982c00b1b0 legacy=0x7f982c00d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.171:6790/0 conn(0x7f982c0037d0 legacy=0x7f982c005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f984bfff640 1 -- 172.21.15.106:0/1519091571 reap_dead start 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient: _add_conns ranks=[1,4,7] 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f984bfff640 1 -- 172.21.15.106:0/1519091571 reap_dead start 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient(hunting): picked mon.noname-f con 0x7f982c00f060 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient(hunting): picked mon.noname-c con 0x7f982c00ff50 addr v1:172.21.15.106:6791/0 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient(hunting): picked mon.noname-i con 0x7f982c010330 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c012300 con 0x7f982c00f060 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c010860 con 0x7f982c00ff50 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f982c010ae0 con 0x7f982c010330 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f98497fa640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:13.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.326+0000 7f984affd640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6791/0 conn(0x7f982c00ff50 legacy=0x7f982c00d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:13.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.530+0000 7f984affd640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6791/0 conn(0x7f982c00ff50 legacy=0x7f982c00d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:13.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:13.934+0000 7f984affd640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6791/0 conn(0x7f982c00ff50 legacy=0x7f982c00d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:14.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:14.738+0000 7f984affd640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6791/0 conn(0x7f982c00ff50 legacy=0x7f982c00d670 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:15.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3410188029 0 0) 0x7f982c010ae0 con 0x7f982c010330 2024-04-26T00:09:15.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:15.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient(hunting): my global_id is 146383 2024-04-26T00:09:15.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9838003530 con 0x7f982c010330 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3694920875 0 0) 0x7f9838003530 con 0x7f982c010330 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.106:6791/0 conn(0x7f982c00ff50 legacy=0x7f982c00d670 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.171:6789/0 conn(0x7f982c00f060 legacy=0x7f982c00f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 monclient: found mon.noname-i 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f982c010d60 con 0x7f982c010330 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:15.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9844001640 con 0x7f982c010330 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: dump: 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:15.303 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 5 monclient: authenticate success, global_id 146383 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98440018a0 con 0x7f982c010330 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 1 -- 172.21.15.106:0/1519091571 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f98440048b0 con 0x7f982c010330 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 4 set_mon_vals no callback set 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f984a7fc640 10 monclient: dump: 2024-04-26T00:09:15.304 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:15.305 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:15.306 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:15.306 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:15.306 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:15.306 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:15.306 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:15.306 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:15.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 10 monclient: shutdown 2024-04-26T00:09:15.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:15.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 1 -- 172.21.15.106:0/1519091571 >> v1:172.21.15.171:6792/0 conn(0x7f982c010330 legacy=0x7f982c005bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:15.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 1 -- 172.21.15.106:0/1519091571 shutdown_connections 2024-04-26T00:09:15.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 1 -- 172.21.15.106:0/1519091571 >> 172.21.15.106:0/1519091571 conn(0x7f984c0a8370 msgr2=0x7f984c0a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:15.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 1 -- 172.21.15.106:0/1519091571 shutdown_connections 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.322+0000 7f9851dfd640 1 -- 172.21.15.106:0/1519091571 wait complete. 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient: build_initial_monmap 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient: monmap: 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:15.309 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 1 Processor -- start 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 1 -- start start 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient: init 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient: _add_conns ranks=[2,0,7,6,3,1,5,4,8] 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient(hunting): picked mon.noname-b con 0x7f982c00f060 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient(hunting): picked mon.noname-a con 0x7f982c00ff50 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient(hunting): picked mon.noname-i con 0x7f982c010330 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c122a90 con 0x7f982c00ff50 2024-04-26T00:09:15.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c120c40 con 0x7f982c00f060 2024-04-26T00:09:15.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c06d930 con 0x7f982c010330 2024-04-26T00:09:15.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:15.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f984affd640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f982c00ff50 legacy=0x7f984c1d17b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:15.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f9851dfd640 10 monclient(hunting): authenticate will time out at 1810.858229s 2024-04-26T00:09:15.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f984b7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f982c00f060 0x7f984c1ccb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:34212/0 (socket says 172.21.15.106:34212) 2024-04-26T00:09:15.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.326+0000 7f984b7fe640 1 -- 172.21.15.106:0/2574920507 learned_addr learned my addr 172.21.15.106:0/2574920507 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:15.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.530+0000 7f984affd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6789/0 conn(0x7f982c00ff50 legacy=0x7f984c1d17b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:15.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:15.934+0000 7f984affd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6789/0 conn(0x7f982c00ff50 legacy=0x7f984c1d17b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:16.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:16.738+0000 7f984affd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6789/0 conn(0x7f982c00ff50 legacy=0x7f984c1d17b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient(hunting): tick 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 1 monclient(hunting): continuing hunt 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.171:6792/0 conn(0x7f982c010330 legacy=0x7f984c1d4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6790/0 conn(0x7f982c00f060 legacy=0x7f984c1ccb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6789/0 conn(0x7f982c00ff50 legacy=0x7f984c1d17b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:09:18.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient: _add_conns ranks=[4,5,1,3,6,8] 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient(hunting): picked mon.noname-c con 0x7f98300037d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient(hunting): picked mon.noname-h con 0x7f98300073c0 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient(hunting): picked mon.noname-f con 0x7f983000b110 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c1207a0 con 0x7f983000b110 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f984c122a90 con 0x7f98300037d0 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9830011000 con 0x7f98300073c0 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f984b7fe640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6791/0 conn(0x7f98300037d0 legacy=0x7f9830005c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:18.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.326+0000 7f9842ffd640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:18.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.530+0000 7f984b7fe640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6791/0 conn(0x7f98300037d0 legacy=0x7f9830005c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:18.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:18.934+0000 7f984b7fe640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6791/0 conn(0x7f98300037d0 legacy=0x7f9830005c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:19.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:19.738+0000 7f984b7fe640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6791/0 conn(0x7f98300037d0 legacy=0x7f9830005c20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:20.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.358+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536872992 0 0) 0x7f984c1207a0 con 0x7f983000b110 2024-04-26T00:09:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.358+0000 7f9843fff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.358+0000 7f9843fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.358+0000 7f9843fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.358+0000 7f9843fff640 10 monclient(hunting): my global_id is 224965 2024-04-26T00:09:20.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.358+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f982c010860 con 0x7f983000b110 2024-04-26T00:09:20.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.366+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3151069815 0 0) 0x7f982c010860 con 0x7f983000b110 2024-04-26T00:09:20.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.366+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f984c1207a0 con 0x7f983000b110 2024-04-26T00:09:20.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.366+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9844001640 con 0x7f983000b110 2024-04-26T00:09:20.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.366+0000 7f9843fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.366+0000 7f9843fff640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.366+0000 7f9843fff640 10 monclient(hunting): dump: 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.347 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.366+0000 7f9843fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:20.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3322374106 0 0) 0x7f984c1207a0 con 0x7f983000b110 2024-04-26T00:09:20.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.171:6791/0 conn(0x7f98300073c0 legacy=0x7f9830009840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.106:6791/0 conn(0x7f98300037d0 legacy=0x7f9830005c20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:09:20.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: _finish_hunting 0 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 monclient: found mon.f 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f984bfff640 1 -- 172.21.15.106:0/2574920507 reap_dead start 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9830012290 con 0x7f983000b110 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: _finish_auth 0 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: _check_auth_tickets 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 5 monclient: authenticate success, global_id 224965 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 10 monclient: _renew_subs 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:09:20.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f984c1227b0 con 0x7f983000b110 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 10 monclient: _renew_subs 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f984c123690 con 0x7f983000b110 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9844001820 con 0x7f983000b110 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9844004de0 con 0x7f983000b110 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 10 monclient: dump: 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.353 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.354 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9849ffb640 4 set_mon_vals no callback set 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f984400fb80 con 0x7f983000b110 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9824005090 con 0x7f983000b110 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f9844044c40 con 0x7f983000b110 2024-04-26T00:09:20.355 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.370+0000 7f984b7fe640 10 monclient: get_auth_request con 0x7f982c039670 auth_method 0 2024-04-26T00:09:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.386+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9844015330 con 0x7f983000b110 2024-04-26T00:09:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.386+0000 7f9843fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:20.364 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.386+0000 7f9843fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:20.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.606+0000 7f9851dfd640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:09:20.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.606+0000 7f9851dfd640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:09:20.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.606+0000 7f9851dfd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:09:20.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.606+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9824005380 con 0x7f983000b110 2024-04-26T00:09:20.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9843fff640 1 -- 172.21.15.106:0/2574920507 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2732 (unknown 254746657 0 1857600272) 0x7f9844014c30 con 0x7f983000b110 2024-04-26T00:09:20.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9843fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:09:20.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9843fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:20.589 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":94,"quorum":[1,2,3,5,6,7,8],"quorum_names":["f","b","g","h","d","i","e"],"quorum_leader_name":"f","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:09:20.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.171:6812/722422047 conn(0x7f982c039670 legacy=0x7f982c03bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 10 monclient: shutdown 2024-04-26T00:09:20.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 >> v1:172.21.15.171:6789/0 conn(0x7f983000b110 legacy=0x7f983000d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 shutdown_connections 2024-04-26T00:09:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 >> 172.21.15.106:0/2574920507 conn(0x7f984c0a8370 msgr2=0x7f984c134e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 shutdown_connections 2024-04-26T00:09:20.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.610+0000 7f9851dfd640 1 -- 172.21.15.106:0/2574920507 wait complete. 2024-04-26T00:09:20.605 INFO:tasks.mon_thrash.ceph_manager:quorum is size 7 2024-04-26T00:09:20.605 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon b 2024-04-26T00:09:20.606 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: get_monmap_and_config 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: build_initial_monmap 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: monmap: 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:20.751028+0000 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:20.751028+0000 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:20.724 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:20.725 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 Processor -- start 2024-04-26T00:09:20.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- start start 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: init 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: _add_conns ranks=[2,1,7,0,6,5,4,8,3] 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient(hunting): picked mon.noname-b con 0x7f18e8135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient(hunting): picked mon.noname-f con 0x7f18e81353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient(hunting): picked mon.noname-i con 0x7f18e813bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e806f2d0 con 0x7f18e81353b0 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e8072330 con 0x7f18e8135870 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e8072610 con 0x7f18e813bdf0 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient(hunting): authenticate will time out at 1816.278219s 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18edb73640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f18e8135870 0x7f18e8135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47464/0 (socket says 172.21.15.106:47464) 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18edb73640 1 -- 172.21.15.106:0/4030239716 learned_addr learned my addr 172.21.15.106:0/4030239716 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:20.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 685224109 0 0) 0x7f18e8072330 con 0x7f18e8135870 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient(hunting): my global_id is 254261 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d0003530 con 0x7f18e8135870 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3374562165 0 0) 0x7f18d0003530 con 0x7f18e8135870 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 >> v1:172.21.15.171:6792/0 conn(0x7f18e813bdf0 legacy=0x7f18e813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 >> v1:172.21.15.171:6789/0 conn(0x7f18e81353b0 legacy=0x7f18e813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: _finish_hunting 0 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 monclient: found mon.noname-b 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e80a3260 con 0x7f18e8135870 2024-04-26T00:09:20.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: _finish_auth 0 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: _check_auth_tickets 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18d8001b40 con 0x7f18e8135870 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 5 monclient: authenticate success, global_id 254261 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: dump: 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.735 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18d8001e30 con 0x7f18e8135870 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:20.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 4 set_mon_vals no callback set 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 1 -- 172.21.15.106:0/4030239716 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18d8004f70 con 0x7f18e8135870 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18ecb71640 10 monclient: dump: 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.737 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 10 monclient: shutdown 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- 172.21.15.106:0/4030239716 >> v1:172.21.15.106:6790/0 conn(0x7f18e8135870 legacy=0x7f18e8135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- 172.21.15.106:0/4030239716 shutdown_connections 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- 172.21.15.106:0/4030239716 >> 172.21.15.106:0/4030239716 conn(0x7f18e80a64e0 msgr2=0x7f18e80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- 172.21.15.106:0/4030239716 shutdown_connections 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.746+0000 7f18efdd7640 1 -- 172.21.15.106:0/4030239716 wait complete. 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: build_initial_monmap 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: monmap: 2024-04-26T00:09:20.738 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 Processor -- start 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 -- start start 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: init 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: _add_conns ranks=[3,7,0,1,4,2,6,5,8] 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient(hunting): picked mon.noname-g con 0x7f18e81353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient(hunting): picked mon.noname-i con 0x7f18e8135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient(hunting): picked mon.noname-a con 0x7f18e813bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e81325f0 con 0x7f18e813bdf0 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e809f930 con 0x7f18e81353b0 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18e81305f0 con 0x7f18e8135870 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient(hunting): authenticate will time out at 1816.281167s 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18ee374640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f18e813bdf0 legacy=0x7f18e81d29c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:20.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18edb73640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f18e81353b0 0x7f18e812f7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:51822/0 (socket says 172.21.15.106:51822) 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18edb73640 1 -- 172.21.15.106:0/730117728 learned_addr learned my addr 172.21.15.106:0/730117728 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4227454617 0 0) 0x7f18e809f930 con 0x7f18e81353b0 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): my global_id is 215085 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18d4003530 con 0x7f18e81353b0 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1966956323 0 0) 0x7f18e81305f0 con 0x7f18e8135870 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): my global_id is 146401 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e809f930 con 0x7f18e8135870 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1998817866 0 0) 0x7f18d4003530 con 0x7f18e81353b0 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18e81305f0 con 0x7f18e81353b0 2024-04-26T00:09:20.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18d8001b00 con 0x7f18e81353b0 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): dump: 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.742 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 812179828 0 0) 0x7f18e809f930 con 0x7f18e8135870 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18d4003530 con 0x7f18e8135870 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18dc001990 con 0x7f18e8135870 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): dump: 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.743 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2104551849 0 0) 0x7f18e81305f0 con 0x7f18e81353b0 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.171:6792/0 conn(0x7f18e8135870 legacy=0x7f18e812fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.106:6789/0 conn(0x7f18e813bdf0 legacy=0x7f18e81d29c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:09:20.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 monclient: found mon.g 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e809f470 con 0x7f18e81353b0 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: _finish_auth 0 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 5 monclient: authenticate success, global_id 215085 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: _renew_subs 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f18e809e5f0 con 0x7f18e81353b0 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: _renew_subs 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:20.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f18e8130ba0 con 0x7f18e81353b0 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f18d8001e30 con 0x7f18e81353b0 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18d8002060 con 0x7f18e81353b0 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e7fff640 4 set_mon_vals no callback set 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient: dump: 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.746 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f18c80065d0 con 0x7f18c8002870 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448543542 0 0) 0x7f18c80065d0 con 0x7f18c8002870 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 10 monclient(hunting): my global_id is 254270 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18e81305f0 con 0x7f18c8002870 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.750+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 784728051 0 0) 0x7f18e81305f0 con 0x7f18c8002870 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18c80065d0 con 0x7f18c8002870 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18dc003960 con 0x7f18c8002870 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 10 monclient: dump: 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 491902824 0 0) 0x7f18c80065d0 con 0x7f18c8002870 2024-04-26T00:09:20.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f18c800a160 con 0x7f18c8002870 2024-04-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f18d8010470 con 0x7f18e81353b0 2024-04-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f18d8045670 con 0x7f18e81353b0 2024-04-26T00:09:20.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f18dc003e70 con 0x7f18c8002870 2024-04-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.106:6790/0 conn(0x7f18c8002870 legacy=0x7f18c8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.106:6790/0 conn(0x7f18c8002870 legacy=0x7f18c8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:20.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.754+0000 7f18ee374640 10 monclient: get_auth_request con 0x7f18d4038220 auth_method 0 2024-04-26T00:09:20.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:20.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f18c8009eb0 con 0x7f18c8009170 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 795312970 0 0) 0x7f18c8009eb0 con 0x7f18c8009170 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient(hunting): my global_id is 254279 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18c80065d0 con 0x7f18c8009170 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3725422647 0 0) 0x7f18c80065d0 con 0x7f18c8009170 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18c8009eb0 con 0x7f18c8009170 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18dc004650 con 0x7f18c8009170 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient: dump: 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.753 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.754 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1436486820 0 0) 0x7f18c8009eb0 con 0x7f18c8009170 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f18c800c390 con 0x7f18c8009170 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 2772577586) 0x7f18dc005a80 con 0x7f18c8009170 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.106:6790/0 conn(0x7f18c8009170 legacy=0x7f18c8009600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18e67fc640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.106:6790/0 conn(0x7f18c8009170 legacy=0x7f18c8009600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 94, 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 30815, 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:20.756 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:20.757 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:20.758 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:20.759 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:20.760 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.761 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:20.763 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:20.765 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:20.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.768 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:20.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:20.773 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:09:20.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.774 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:20.774 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:20.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.171:6812/722422047 conn(0x7f18d4038220 legacy=0x7f18d403a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 10 monclient: shutdown 2024-04-26T00:09:20.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:20.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 >> v1:172.21.15.171:6790/0 conn(0x7f18e81353b0 legacy=0x7f18e812f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18ee374640 1 -- 172.21.15.106:0/730117728 reap_dead start 2024-04-26T00:09:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18ee374640 1 -- 172.21.15.106:0/730117728 reap_dead start 2024-04-26T00:09:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 shutdown_connections 2024-04-26T00:09:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 >> 172.21.15.106:0/730117728 conn(0x7f18e80a64e0 msgr2=0x7f18e80a40c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 shutdown_connections 2024-04-26T00:09:20.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.758+0000 7f18efdd7640 1 -- 172.21.15.106:0/730117728 wait complete. 2024-04-26T00:09:20.776 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:09:20.776 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon d 2024-04-26T00:09:20.776 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:09:20.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: get_monmap_and_config 2024-04-26T00:09:20.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: build_initial_monmap 2024-04-26T00:09:20.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: monmap: 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:20.918532+0000 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:20.918532+0000 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:20.892 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:20.893 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:20.893 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 Processor -- start 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- start start 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: init 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: _add_conns ranks=[3,2,6,4,7,8,0,1,5] 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient(hunting): picked mon.noname-g con 0x7f0c44134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient(hunting): picked mon.noname-b con 0x7f0c440a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient(hunting): picked mon.noname-d con 0x7f0c4413e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4406dd40 con 0x7f0c440a4820 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440a2b10 con 0x7f0c44134970 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c440a2df0 con 0x7f0c4413e200 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient(hunting): authenticate will time out at 1816.445489s 2024-04-26T00:09:20.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c43fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f0c4413e200 0x7f0c441405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39294/0 (socket says 172.21.15.106:39294) 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c43fff640 1 -- 172.21.15.106:0/1536252340 learned_addr learned my addr 172.21.15.106:0/1536252340 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2147814347 0 0) 0x7f0c440a2df0 con 0x7f0c4413e200 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): my global_id is 254265 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c30003530 con 0x7f0c4413e200 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2672228429 0 0) 0x7f0c4406dd40 con 0x7f0c440a4820 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): my global_id is 254288 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c440a2df0 con 0x7f0c440a4820 2024-04-26T00:09:20.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 613117824 0 0) 0x7f0c440a2b10 con 0x7f0c44134970 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient(hunting): my global_id is 215094 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c4406dd40 con 0x7f0c44134970 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1709817451 0 0) 0x7f0c440a2df0 con 0x7f0c440a4820 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 >> v1:172.21.15.106:6792/0 conn(0x7f0c4413e200 legacy=0x7f0c441405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 >> v1:172.21.15.171:6790/0 conn(0x7f0c44134970 legacy=0x7f0c44134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: _finish_hunting 0 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 monclient: found mon.noname-b 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440a30d0 con 0x7f0c440a4820 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: _finish_auth 0 2024-04-26T00:09:20.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: _check_auth_tickets 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 5 monclient: authenticate success, global_id 254288 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0c2c0017a0 con 0x7f0c440a4820 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: dump: 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.906 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c2c001a00 con 0x7f0c440a4820 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:20.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 1 -- 172.21.15.106:0/1536252340 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0c2c003960 con 0x7f0c440a4820 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 4 set_mon_vals no callback set 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c427fc640 10 monclient: dump: 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.908 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: shutdown 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- 172.21.15.106:0/1536252340 >> v1:172.21.15.106:6790/0 conn(0x7f0c440a4820 legacy=0x7f0c4413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- 172.21.15.106:0/1536252340 shutdown_connections 2024-04-26T00:09:20.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- 172.21.15.106:0/1536252340 >> 172.21.15.106:0/1536252340 conn(0x7f0c440a9e20 msgr2=0x7f0c440aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- 172.21.15.106:0/1536252340 shutdown_connections 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 1 -- 172.21.15.106:0/1536252340 wait complete. 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: build_initial_monmap 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.914+0000 7f0c4a137640 10 monclient: monmap: 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:20.910 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 Processor -- start 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 -- start start 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient: init 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient: _add_conns ranks=[0,5,3,2,4,8,1,6,7] 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient(hunting): picked mon.noname-a con 0x7f0c440a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient(hunting): picked mon.noname-h con 0x7f0c44134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:20.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient(hunting): picked mon.noname-g con 0x7f0c4413e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4413c060 con 0x7f0c440a4820 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c437fe640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f0c440a4820 legacy=0x7f0c441388b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c441396d0 con 0x7f0c4413e200 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c4413a210 con 0x7f0c44134970 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient(hunting): authenticate will time out at 1816.448851s 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c43fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f0c4413e200 0x7f0c441d46c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:51832/0 (socket says 172.21.15.106:51832) 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c43fff640 1 -- 172.21.15.106:0/57799930 learned_addr learned my addr 172.21.15.106:0/57799930 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1492937090 0 0) 0x7f0c441396d0 con 0x7f0c4413e200 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): my global_id is 215103 2024-04-26T00:09:20.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c24003530 con 0x7f0c4413e200 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495604444 0 0) 0x7f0c4413a210 con 0x7f0c44134970 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): my global_id is 254246 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c441396d0 con 0x7f0c44134970 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1755752340 0 0) 0x7f0c24003530 con 0x7f0c4413e200 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c4413a210 con 0x7f0c4413e200 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0c34001970 con 0x7f0c4413e200 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:20.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): dump: 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.914 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4112319599 0 0) 0x7f0c441396d0 con 0x7f0c44134970 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c24003530 con 0x7f0c44134970 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0c2c001360 con 0x7f0c44134970 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): dump: 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.915 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2350707869 0 0) 0x7f0c4413a210 con 0x7f0c4413e200 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.171:6791/0 conn(0x7f0c44134970 legacy=0x7f0c44138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.106:6789/0 conn(0x7f0c440a4820 legacy=0x7f0c441388b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 monclient: found mon.g 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c440a1e00 con 0x7f0c4413e200 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: _finish_auth 0 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 5 monclient: authenticate success, global_id 215103 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient: _renew_subs 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:20.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0c440a1a40 con 0x7f0c4413e200 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient: _renew_subs 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0c4413ab90 con 0x7f0c4413e200 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0c34001c90 con 0x7f0c4413e200 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c41ffb640 4 set_mon_vals no callback set 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0c34004de0 con 0x7f0c4413e200 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: dump: 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.918 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c280065d0 con 0x7f0c28002870 2024-04-26T00:09:20.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319701003 0 0) 0x7f0c280065d0 con 0x7f0c28002870 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient(hunting): my global_id is 254274 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c4413a210 con 0x7f0c28002870 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2897737571 0 0) 0x7f0c4413a210 con 0x7f0c28002870 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c280065d0 con 0x7f0c28002870 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0c3c001c70 con 0x7f0c28002870 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.918+0000 7f0c3bfff640 10 monclient: dump: 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.920 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0c3400fb80 con 0x7f0c4413e200 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f0c34045140 con 0x7f0c4413e200 2024-04-26T00:09:20.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3970049215 0 0) 0x7f0c280065d0 con 0x7f0c28002870 2024-04-26T00:09:20.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c2800a160 con 0x7f0c28002870 2024-04-26T00:09:20.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c42ffd640 10 monclient: get_auth_request con 0x7f0c24037f00 auth_method 0 2024-04-26T00:09:20.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0c3c005b50 con 0x7f0c28002870 2024-04-26T00:09:20.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:20.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:20.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.106:6792/0 conn(0x7f0c28002870 legacy=0x7f0c28004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.922+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.106:6792/0 conn(0x7f0c28002870 legacy=0x7f0c28004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:20.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c4a137640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:20.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0c28009e60 con 0x7f0c28009120 2024-04-26T00:09:20.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2319884674 0 0) 0x7f0c28009e60 con 0x7f0c28009120 2024-04-26T00:09:20.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient(hunting): my global_id is 254283 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0c280065d0 con 0x7f0c28009120 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1567665111 0 0) 0x7f0c280065d0 con 0x7f0c28009120 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0c28009e60 con 0x7f0c28009120 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0c3c003f70 con 0x7f0c28009120 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient: dump: 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.924 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 529379640 0 0) 0x7f0c28009e60 con 0x7f0c28009120 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0c2800c3e0 con 0x7f0c28009120 2024-04-26T00:09:20.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 4046454818) 0x7f0c3c004340 con 0x7f0c28009120 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.106:6792/0 conn(0x7f0c28009120 legacy=0x7f0c280095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.926+0000 7f0c3bfff640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.106:6792/0 conn(0x7f0c28009120 legacy=0x7f0c280095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:09:20.926 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 94, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 30987, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:20.927 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:20.928 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:20.929 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:20.930 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:20.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:20.932 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:20.935 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:20.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:20.940 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:20.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:20.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:20.944 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.171:6812/722422047 conn(0x7f0c24037f00 legacy=0x7f0c2403a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 10 monclient: shutdown 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 >> v1:172.21.15.171:6790/0 conn(0x7f0c4413e200 legacy=0x7f0c441d46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c43fff640 1 -- 172.21.15.106:0/57799930 reap_dead start 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c43fff640 1 -- 172.21.15.106:0/57799930 reap_dead start 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 shutdown_connections 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 >> 172.21.15.106:0/57799930 conn(0x7f0c440a9e20 msgr2=0x7f0c44134dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:20.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 shutdown_connections 2024-04-26T00:09:20.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:20.930+0000 7f0c4a137640 1 -- 172.21.15.106:0/57799930 wait complete. 2024-04-26T00:09:20.947 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:09:20.947 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon e 2024-04-26T00:09:20.947 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:09:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient: get_monmap_and_config 2024-04-26T00:09:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient: monmap: 2024-04-26T00:09:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:21.087303+0000 2024-04-26T00:09:21.060 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:21.087303+0000 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.061 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 1 Processor -- start 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 1 -- start start 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient: init 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient: _add_conns ranks=[0,2,5,8,7,3,4,6,1] 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient(hunting): picked mon.noname-a con 0x7fc2800a1b20 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient(hunting): picked mon.noname-b con 0x7fc28006be40 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient(hunting): picked mon.noname-h con 0x7fc28009fd70 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2800a3400 con 0x7fc2800a1b20 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28006b9b0 con 0x7fc28006be40 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28009eaa0 con 0x7fc28009fd70 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 10 monclient(hunting): authenticate will time out at 1816.615160s 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc285f94640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7fc2800a1b20 legacy=0x7fc2800a1f00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc285793640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fc28006be40 0x7fc28013cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47496/0 (socket says 172.21.15.106:47496) 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc285793640 1 -- 172.21.15.106:0/1495134692 learned_addr learned my addr 172.21.15.106:0/1495134692 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1324714064 0 0) 0x7fc28006b9b0 con 0x7fc28006be40 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient(hunting): my global_id is 254297 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc26c003530 con 0x7fc28006be40 2024-04-26T00:09:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2471707318 0 0) 0x7fc26c003530 con 0x7fc28006be40 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 >> v1:172.21.15.171:6791/0 conn(0x7fc28009fd70 legacy=0x7fc280140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 >> v1:172.21.15.106:6789/0 conn(0x7fc2800a1b20 legacy=0x7fc2800a1f00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 monclient: found mon.noname-b 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28006b470 con 0x7fc28006be40 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 5 monclient: authenticate success, global_id 254297 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2700017c0 con 0x7fc28006be40 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: dump: 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc2881f8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc270001b20 con 0x7fc28006be40 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 4 set_mon_vals no callback set 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.082+0000 7fc284f92640 1 -- 172.21.15.106:0/1495134692 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc270001d50 con 0x7fc28006be40 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc284f92640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc284f92640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc284f92640 10 monclient: dump: 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: shutdown 2024-04-26T00:09:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1495134692 >> v1:172.21.15.106:6790/0 conn(0x7fc28006be40 legacy=0x7fc28013cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1495134692 shutdown_connections 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1495134692 >> 172.21.15.106:0/1495134692 conn(0x7fc2800a6fe0 msgr2=0x7fc2800a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1495134692 shutdown_connections 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1495134692 wait complete. 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: monmap: 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 Processor -- start 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- start start 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: init 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: _add_conns ranks=[3,6,5,7,1,8,4,0,2] 2024-04-26T00:09:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient(hunting): picked mon.noname-g con 0x7fc28006be40 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient(hunting): picked mon.noname-d con 0x7fc28009fd70 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient(hunting): picked mon.noname-h con 0x7fc2800a1b20 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2801406a0 con 0x7fc28006be40 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28013b2d0 con 0x7fc2800a1b20 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc28013ff40 con 0x7fc28009fd70 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient(hunting): authenticate will time out at 1816.618034s 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc285793640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc28009fd70 0x7fc2801d1140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39324/0 (socket says 172.21.15.106:39324) 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc285793640 1 -- 172.21.15.106:0/1896587271 learned_addr learned my addr 172.21.15.106:0/1896587271 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 767789511 0 0) 0x7fc28013ff40 con 0x7fc28009fd70 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): my global_id is 254292 2024-04-26T00:09:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc264003530 con 0x7fc28009fd70 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2862521986 0 0) 0x7fc264003530 con 0x7fc28009fd70 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc28013ff40 con 0x7fc28009fd70 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc270001780 con 0x7fc28009fd70 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): dump: 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2236296134 0 0) 0x7fc28013ff40 con 0x7fc28009fd70 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.171:6791/0 conn(0x7fc2800a1b20 legacy=0x7fc2801d4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.171:6790/0 conn(0x7fc28006be40 legacy=0x7fc28013abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 monclient: found mon.d 2024-04-26T00:09:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc28009e150 con 0x7fc28009fd70 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 5 monclient: authenticate success, global_id 254292 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: _renew_subs 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc280122520 con 0x7fc28009fd70 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: _renew_subs 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc280121810 con 0x7fc28009fd70 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc270001b20 con 0x7fc28009fd70 2024-04-26T00:09:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc270001130 con 0x7fc28009fd70 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc277fff640 4 set_mon_vals no callback set 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 10 monclient: dump: 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc27000ff50 con 0x7fc28009fd70 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc2680065d0 con 0x7fc268002870 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.086+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fc270045310 con 0x7fc28009fd70 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1133173260 0 0) 0x7fc2680065d0 con 0x7fc268002870 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient(hunting): my global_id is 224882 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc28013ff40 con 0x7fc268002870 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 340720504 0 0) 0x7fc28013ff40 con 0x7fc268002870 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2680065d0 con 0x7fc268002870 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc27c004250 con 0x7fc268002870 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc286795640 10 monclient: get_auth_request con 0x7fc2640376f0 auth_method 0 2024-04-26T00:09:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient: dump: 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.085 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3792661188 0 0) 0x7fc2680065d0 con 0x7fc268002870 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc26800a160 con 0x7fc268002870 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc27c0066a0 con 0x7fc268002870 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.106:6793/0 conn(0x7fc268002870 legacy=0x7fc268004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.090+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.106:6793/0 conn(0x7fc268002870 legacy=0x7fc268004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2881f8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc268009e50 con 0x7fc268009110 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 322241806 0 0) 0x7fc268009e50 con 0x7fc268009110 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient(hunting): my global_id is 224891 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2680065d0 con 0x7fc268009110 2024-04-26T00:09:21.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 787478374 0 0) 0x7fc2680065d0 con 0x7fc268009110 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc268009e50 con 0x7fc268009110 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc27c004ca0 con 0x7fc268009110 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient: dump: 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.089 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1727359868 0 0) 0x7fc268009e50 con 0x7fc268009110 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc26800c3e0 con 0x7fc268009110 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 1224897439) 0x7fc27c006000 con 0x7fc268009110 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:21.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.106:6793/0 conn(0x7fc268009110 legacy=0x7fc2680095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.094+0000 7fc2767fc640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.106:6793/0 conn(0x7fc268009110 legacy=0x7fc2680095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 94, 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 274326, 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:21.091 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.092 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.093 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.094 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:21.095 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.096 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:21.098 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.100 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.101 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:21.103 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.104 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.105 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.108 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:09:21.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.110 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:21.111 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:21.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.171:6812/722422047 conn(0x7fc2640376f0 legacy=0x7fc264039bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 10 monclient: shutdown 2024-04-26T00:09:21.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 >> v1:172.21.15.106:6792/0 conn(0x7fc28009fd70 legacy=0x7fc2801d1140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc286795640 1 -- 172.21.15.106:0/1896587271 reap_dead start 2024-04-26T00:09:21.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc286795640 1 -- 172.21.15.106:0/1896587271 reap_dead start 2024-04-26T00:09:21.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 shutdown_connections 2024-04-26T00:09:21.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 >> 172.21.15.106:0/1896587271 conn(0x7fc2800a6fe0 msgr2=0x7fc28009c9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 shutdown_connections 2024-04-26T00:09:21.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.098+0000 7fc2881f8640 1 -- 172.21.15.106:0/1896587271 wait complete. 2024-04-26T00:09:21.113 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:09:21.113 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon f 2024-04-26T00:09:21.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:09:21.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.254+0000 7f332f0cd640 10 monclient: get_monmap_and_config 2024-04-26T00:09:21.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.254+0000 7f332f0cd640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.254+0000 7f332f0cd640 10 monclient: monmap: 2024-04-26T00:09:21.234 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.234 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:21.261216+0000 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:21.261216+0000 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.235 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.254+0000 7f332f0cd640 1 Processor -- start 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.254+0000 7f332f0cd640 1 -- start start 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.254+0000 7f332f0cd640 10 monclient: init 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: _add_conns ranks=[8,0,7,3,1,4,2,5,6] 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): picked mon.noname-e con 0x7f3328134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): picked mon.noname-a con 0x7f33280a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): picked mon.noname-i con 0x7f332813e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f332806dd40 con 0x7f33280a4820 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33280a2b10 con 0x7f332813e200 2024-04-26T00:09:21.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33280a2df0 con 0x7f3328134970 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f3327fff640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f33280a4820 legacy=0x7f332813cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): authenticate will time out at 1816.788541s 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332ce69640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f3328134970 0x7f3328134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:60286/0 (socket says 172.21.15.106:60286) 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332ce69640 1 -- 172.21.15.106:0/2979665627 learned_addr learned my addr 172.21.15.106:0/2979665627 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958466468 0 0) 0x7f33280a2df0 con 0x7f3328134970 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient(hunting): my global_id is 224900 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3314003530 con 0x7f3328134970 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2204088962 0 0) 0x7f3314003530 con 0x7f3328134970 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 >> v1:172.21.15.171:6792/0 conn(0x7f332813e200 legacy=0x7f33281405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 >> v1:172.21.15.106:6789/0 conn(0x7f33280a4820 legacy=0x7f332813cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:21.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 monclient: found mon.noname-e 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33280a30d0 con 0x7f3328134970 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f33200017c0 con 0x7f3328134970 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: dump: 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.245 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 5 monclient: authenticate success, global_id 224900 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3320001ab0 con 0x7f3328134970 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 4 set_mon_vals no callback set 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 1 -- 172.21.15.106:0/2979665627 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3320004bf0 con 0x7f3328134970 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33277fe640 10 monclient: dump: 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.247 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: shutdown 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- 172.21.15.106:0/2979665627 >> v1:172.21.15.106:6793/0 conn(0x7f3328134970 legacy=0x7f3328134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- 172.21.15.106:0/2979665627 shutdown_connections 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- 172.21.15.106:0/2979665627 >> 172.21.15.106:0/2979665627 conn(0x7f33280a9e20 msgr2=0x7f33280aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- 172.21.15.106:0/2979665627 shutdown_connections 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- 172.21.15.106:0/2979665627 wait complete. 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: monmap: 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.249 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 Processor -- start 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- start start 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: init 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient: _add_conns ranks=[6,8,1,7,3,0,4,5,2] 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): picked mon.noname-d con 0x7f33280a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): picked mon.noname-e con 0x7f3328134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:09:21.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): picked mon.noname-f con 0x7f332813e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33281355b0 con 0x7f332813e200 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33280a1e00 con 0x7f33280a4820 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33280a1a40 con 0x7f3328134970 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332f0cd640 10 monclient(hunting): authenticate will time out at 1816.791486s 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332ce69640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f33280a4820 0x7f332809dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39338/0 (socket says 172.21.15.106:39338) 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f332ce69640 1 -- 172.21.15.106:0/1160497718 learned_addr learned my addr 172.21.15.106:0/1160497718 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3381892178 0 0) 0x7f33280a30d0 con 0x7f33280a4820 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): my global_id is 254301 2024-04-26T00:09:21.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3308003530 con 0x7f33280a4820 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1268856846 0 0) 0x7f3310003a50 con 0x7f3328134970 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 10 monclient(hunting): my global_id is 224909 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.258+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33280a30d0 con 0x7f3328134970 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 283924754 0 0) 0x7f3308003530 con 0x7f33280a4820 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3310003a50 con 0x7f33280a4820 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3320001780 con 0x7f33280a4820 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): dump: 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.254 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2352170177 0 0) 0x7f33280a30d0 con 0x7f3328134970 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3308003530 con 0x7f3328134970 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f33100043c0 con 0x7f3328134970 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): dump: 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.256 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4241103632 0 0) 0x7f33280a2b10 con 0x7f332813e200 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): my global_id is 224983 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f33280a30d0 con 0x7f332813e200 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3163270906 0 0) 0x7f3310003a50 con 0x7f33280a4820 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.106:6793/0 conn(0x7f3328134970 legacy=0x7f332809e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.171:6789/0 conn(0x7f332813e200 legacy=0x7f33281d48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 monclient: found mon.d 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3328135f20 con 0x7f33280a4820 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 5 monclient: authenticate success, global_id 254301 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 10 monclient: _renew_subs 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f332809e8f0 con 0x7f33280a4820 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 10 monclient: _renew_subs 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3328136200 con 0x7f33280a4820 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3320001ab0 con 0x7f33280a4820 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3320001ce0 con 0x7f33280a4820 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:21.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f3326ffd640 4 set_mon_vals no callback set 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: dump: 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.260 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f33200100f0 con 0x7f33280a4820 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f330c0065d0 con 0x7f330c002870 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f3320045300 con 0x7f33280a4820 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f332d66a640 10 monclient: get_auth_request con 0x7f3308037f30 auth_method 0 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3494696581 0 0) 0x7f330c0065d0 con 0x7f330c002870 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient(hunting): my global_id is 224992 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3310003a50 con 0x7f330c002870 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2967770776 0 0) 0x7f3310003a50 con 0x7f330c002870 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f330c0065d0 con 0x7f330c002870 2024-04-26T00:09:21.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3310004c20 con 0x7f330c002870 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: dump: 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.262 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1682057182 0 0) 0x7f330c0065d0 con 0x7f330c002870 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f330c00a160 con 0x7f330c002870 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3310007480 con 0x7f330c002870 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.171:6789/0 conn(0x7f330c002870 legacy=0x7f330c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.262+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.171:6789/0 conn(0x7f330c002870 legacy=0x7f330c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f332f0cd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f330c009e50 con 0x7f330c009110 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 989699433 0 0) 0x7f330c009e50 con 0x7f330c009110 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient(hunting): my global_id is 225001 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f330c0065d0 con 0x7f330c009110 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1585950914 0 0) 0x7f330c0065d0 con 0x7f330c009110 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f330c009e50 con 0x7f330c009110 2024-04-26T00:09:21.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3310005570 con 0x7f330c009110 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient: dump: 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.266 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1567109607 0 0) 0x7f330c009e50 con 0x7f330c009110 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f330c00c3e0 con 0x7f330c009110 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7715 (unknown 0 0 1949358980) 0x7f3310007630 con 0x7f330c009110 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.171:6789/0 conn(0x7f330c009110 legacy=0x7f330c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.270+0000 7f33257fa640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.171:6789/0 conn(0x7f330c009110 legacy=0x7f330c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.267 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 94, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 274507, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:21.268 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.269 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.270 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:21.271 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.272 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:21.273 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.274 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.275 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.276 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.277 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.278 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.279 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.280 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.281 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.282 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.283 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.284 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.285 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.286 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.286 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:21.286 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.171:6812/722422047 conn(0x7f3308037f30 legacy=0x7f330803a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 10 monclient: shutdown 2024-04-26T00:09:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 >> v1:172.21.15.106:6792/0 conn(0x7f33280a4820 legacy=0x7f332809dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332d66a640 1 -- 172.21.15.106:0/1160497718 reap_dead start 2024-04-26T00:09:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332d66a640 1 -- 172.21.15.106:0/1160497718 reap_dead start 2024-04-26T00:09:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 shutdown_connections 2024-04-26T00:09:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 >> 172.21.15.106:0/1160497718 conn(0x7f33280a9e20 msgr2=0x7f3328130ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 shutdown_connections 2024-04-26T00:09:21.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.274+0000 7f332f0cd640 1 -- 172.21.15.106:0/1160497718 wait complete. 2024-04-26T00:09:21.288 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:09:21.288 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon g 2024-04-26T00:09:21.289 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:09:21.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: get_monmap_and_config 2024-04-26T00:09:21.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: monmap: 2024-04-26T00:09:21.403 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.403 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.403 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:21.430532+0000 2024-04-26T00:09:21.403 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:21.430532+0000 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.404 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 Processor -- start 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- start start 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: init 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: _add_conns ranks=[8,6,0,3,5,7,1,4,2] 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient(hunting): picked mon.noname-e con 0x7fa2a40a1290 addr v1:172.21.15.106:6793/0 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient(hunting): picked mon.noname-d con 0x7fa2a409f770 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient(hunting): picked mon.noname-a con 0x7fa2a409fb70 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40727a0 con 0x7fa2a409fb70 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a40724c0 con 0x7fa2a409f770 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a4072a80 con 0x7fa2a40a1290 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient(hunting): authenticate will time out at 1816.957666s 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a3fff640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7fa2a409fb70 legacy=0x7fa2a413de00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:21.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a37fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fa2a40a1290 0x7fa2a40a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:60300/0 (socket says 172.21.15.106:60300) 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a37fe640 1 -- 172.21.15.106:0/711782644 learned_addr learned my addr 172.21.15.106:0/711782644 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2656594102 0 0) 0x7fa2a40724c0 con 0x7fa2a409f770 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): my global_id is 254310 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa290003530 con 0x7fa2a409f770 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3225982626 0 0) 0x7fa2a4072a80 con 0x7fa2a40a1290 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient(hunting): my global_id is 224918 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a40724c0 con 0x7fa2a40a1290 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2392693992 0 0) 0x7fa290003530 con 0x7fa2a409f770 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 >> v1:172.21.15.106:6793/0 conn(0x7fa2a40a1290 legacy=0x7fa2a40a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 >> v1:172.21.15.106:6789/0 conn(0x7fa2a409fb70 legacy=0x7fa2a413de00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 monclient: found mon.noname-d 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a406bfc0 con 0x7fa2a409f770 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa28c0016f0 con 0x7fa2a409f770 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 5 monclient: authenticate success, global_id 254310 2024-04-26T00:09:21.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: dump: 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.416 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa28c001990 con 0x7fa2a409f770 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 1 -- 172.21.15.106:0/711782644 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa28c003960 con 0x7fa2a409f770 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 4 set_mon_vals no callback set 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a27fc640 10 monclient: dump: 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.417 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: shutdown 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/711782644 >> v1:172.21.15.106:6792/0 conn(0x7fa2a409f770 legacy=0x7fa2a413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/711782644 shutdown_connections 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/711782644 >> 172.21.15.106:0/711782644 conn(0x7fa2a406b210 msgr2=0x7fa2a406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/711782644 shutdown_connections 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/711782644 wait complete. 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.426+0000 7fa2a9c4a640 10 monclient: monmap: 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 Processor -- start 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 -- start start 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient: init 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient: _add_conns ranks=[7,2,6,5,3,0,4,1,8] 2024-04-26T00:09:21.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient(hunting): picked mon.noname-i con 0x7fa2a409f770 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient(hunting): picked mon.noname-b con 0x7fa2a409fb70 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient(hunting): picked mon.noname-d con 0x7fa2a40a1290 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a4139280 con 0x7fa2a409fb70 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a411eec0 con 0x7fa2a40a1290 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2a4120650 con 0x7fa2a409f770 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient(hunting): authenticate will time out at 1816.960767s 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a2ffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fa2a409fb70 0x7fa2a413e090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47510/0 (socket says 172.21.15.106:47510) 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a2ffd640 1 -- 172.21.15.106:0/3961390167 learned_addr learned my addr 172.21.15.106:0/3961390167 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3117810104 0 0) 0x7fa2a411eec0 con 0x7fa2a40a1290 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): my global_id is 254319 2024-04-26T00:09:21.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa284003530 con 0x7fa2a40a1290 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794192081 0 0) 0x7fa2a406bfc0 con 0x7fa2a409fb70 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): my global_id is 254306 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a411eec0 con 0x7fa2a409fb70 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 552522082 0 0) 0x7fa284003530 con 0x7fa2a40a1290 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2a406bfc0 con 0x7fa2a40a1290 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3294547125 0 0) 0x7fa2a411eec0 con 0x7fa2a409fb70 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa284003530 con 0x7fa2a409fb70 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa294004160 con 0x7fa2a40a1290 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:09:21.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): dump: 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.423 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa28c003940 con 0x7fa2a409fb70 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): dump: 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1540155813 0 0) 0x7fa2a406bfc0 con 0x7fa2a40a1290 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.171:6792/0 conn(0x7fa2a409f770 legacy=0x7fa2a413d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.106:6790/0 conn(0x7fa2a409fb70 legacy=0x7fa2a413e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 monclient: found mon.d 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a411ec10 con 0x7fa2a40a1290 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 5 monclient: authenticate success, global_id 254319 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient: _renew_subs 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a41d3500 con 0x7fa2a40a1290 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient: _renew_subs 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2a41d38a0 con 0x7fa2a40a1290 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa294004400 con 0x7fa2a40a1290 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa294004970 con 0x7fa2a40a1290 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a1ffb640 4 set_mon_vals no callback set 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient: dump: 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.427 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa294004b50 con 0x7fa2a40a1290 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2880065d0 con 0x7fa288002870 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fa294045070 con 0x7fa2a40a1290 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa2a2ffd640 10 monclient: get_auth_request con 0x7fa284037dc0 auth_method 0 2024-04-26T00:09:21.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465882619 0 0) 0x7fa2880065d0 con 0x7fa288002870 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 10 monclient(hunting): my global_id is 215121 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.430+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a406bfc0 con 0x7fa288002870 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3241324743 0 0) 0x7fa2a406bfc0 con 0x7fa288002870 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2880065d0 con 0x7fa288002870 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa29c001bb0 con 0x7fa288002870 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 10 monclient: dump: 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.429 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2975531473 0 0) 0x7fa2880065d0 con 0x7fa288002870 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa28800a160 con 0x7fa288002870 2024-04-26T00:09:21.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa29c001f40 con 0x7fa288002870 2024-04-26T00:09:21.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:21.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.171:6790/0 conn(0x7fa288002870 legacy=0x7fa288004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.434+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.171:6790/0 conn(0x7fa288002870 legacy=0x7fa288004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.438+0000 7fa2a9c4a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:21.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.438+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa288009e50 con 0x7fa288009110 2024-04-26T00:09:21.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783370785 0 0) 0x7fa288009e50 con 0x7fa288009110 2024-04-26T00:09:21.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient(hunting): my global_id is 215130 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2880065d0 con 0x7fa288009110 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1386048744 0 0) 0x7fa2880065d0 con 0x7fa288009110 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa288009e50 con 0x7fa288009110 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa29c0050a0 con 0x7fa288009110 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient: dump: 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 130770599 0 0) 0x7fa288009e50 con 0x7fa288009110 2024-04-26T00:09:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa28800c3e0 con 0x7fa288009110 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7883 (unknown 0 0 407616114) 0x7fa29c007300 con 0x7fa288009110 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.171:6790/0 conn(0x7fa288009110 legacy=0x7fa2880095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa29bfff640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.171:6790/0 conn(0x7fa288009110 legacy=0x7fa2880095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 94, 2024-04-26T00:09:21.435 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 391865, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:21.436 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.437 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:21.438 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.439 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.440 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.441 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.442 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.445 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.446 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.449 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:21.450 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.451 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.452 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.453 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.454 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.454 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.454 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:21.454 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:21.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.171:6812/722422047 conn(0x7fa284037dc0 legacy=0x7fa28403a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 10 monclient: shutdown 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 >> v1:172.21.15.106:6792/0 conn(0x7fa2a40a1290 legacy=0x7fa2a413e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a3fff640 1 -- 172.21.15.106:0/3961390167 reap_dead start 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a3fff640 1 -- 172.21.15.106:0/3961390167 reap_dead start 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 shutdown_connections 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 >> 172.21.15.106:0/3961390167 conn(0x7fa2a406b210 msgr2=0x7fa2a4067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 shutdown_connections 2024-04-26T00:09:21.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.442+0000 7fa2a9c4a640 1 -- 172.21.15.106:0/3961390167 wait complete. 2024-04-26T00:09:21.459 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:09:21.460 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon h 2024-04-26T00:09:21.460 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.594+0000 7fdcaeccc640 10 monclient: get_monmap_and_config 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.594+0000 7fdcaeccc640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.594+0000 7fdcaeccc640 10 monclient: monmap: 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:21.602071+0000 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:21.602071+0000 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.576 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 Processor -- start 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- start start 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: init 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: _add_conns ranks=[1,4,2,3,5,0,8,7,6] 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient(hunting): picked mon.noname-f con 0x7fdca8134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient(hunting): picked mon.noname-c con 0x7fdca80a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient(hunting): picked mon.noname-b con 0x7fdca813e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca806dd40 con 0x7fdca8134970 2024-04-26T00:09:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca80a2b10 con 0x7fdca813e200 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca80a2df0 con 0x7fdca80a4820 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient(hunting): authenticate will time out at 1817.129163s 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca7fff640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7fdca80a4820 legacy=0x7fdca813cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcad269640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fdca813e200 0x7fdca81405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:47524/0 (socket says 172.21.15.106:47524) 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcad269640 1 -- 172.21.15.106:0/1783509284 learned_addr learned my addr 172.21.15.106:0/1783509284 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727646268 0 0) 0x7fdca80a2b10 con 0x7fdca813e200 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient(hunting): my global_id is 254315 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc90003530 con 0x7fdca813e200 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3097686996 0 0) 0x7fdc90003530 con 0x7fdca813e200 2024-04-26T00:09:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 >> v1:172.21.15.106:6791/0 conn(0x7fdca80a4820 legacy=0x7fdca813cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 >> v1:172.21.15.171:6789/0 conn(0x7fdca8134970 legacy=0x7fdca8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 monclient: found mon.noname-b 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca80a30d0 con 0x7fdca813e200 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdca0001b40 con 0x7fdca813e200 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: dump: 2024-04-26T00:09:21.586 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.587 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 5 monclient: authenticate success, global_id 254315 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdca0001e30 con 0x7fdca813e200 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 1 -- 172.21.15.106:0/1783509284 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdca0004f70 con 0x7fdca813e200 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdca77fe640 10 monclient: dump: 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 4 set_mon_vals no callback set 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: shutdown 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- 172.21.15.106:0/1783509284 >> v1:172.21.15.106:6790/0 conn(0x7fdca813e200 legacy=0x7fdca81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- 172.21.15.106:0/1783509284 shutdown_connections 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- 172.21.15.106:0/1783509284 >> 172.21.15.106:0/1783509284 conn(0x7fdca80a9e20 msgr2=0x7fdca80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- 172.21.15.106:0/1783509284 shutdown_connections 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- 172.21.15.106:0/1783509284 wait complete. 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: monmap: 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.590 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 Processor -- start 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 1 -- start start 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: init 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.598+0000 7fdcaeccc640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient: _add_conns ranks=[7,3,5,6,4,1,0,8,2] 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient(hunting): picked mon.noname-i con 0x7fdca80a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient(hunting): picked mon.noname-g con 0x7fdca8134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:21.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient(hunting): picked mon.noname-h con 0x7fdca813e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca81396d0 con 0x7fdca8134970 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca813d700 con 0x7fdca813e200 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdca8137c40 con 0x7fdca80a4820 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient(hunting): authenticate will time out at 1817.132102s 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca7fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fdca8134970 0x7fdca8138fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:51870/0 (socket says 172.21.15.106:51870) 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca7fff640 1 -- 172.21.15.106:0/2738463264 learned_addr learned my addr 172.21.15.106:0/2738463264 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752588092 0 0) 0x7fdca81396d0 con 0x7fdca8134970 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): my global_id is 215139 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc94003530 con 0x7fdca8134970 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2389949046 0 0) 0x7fdca813d700 con 0x7fdca813e200 2024-04-26T00:09:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): my global_id is 254273 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca81396d0 con 0x7fdca813e200 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466721434 0 0) 0x7fdca8137c40 con 0x7fdca80a4820 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): my global_id is 146428 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca813d700 con 0x7fdca80a4820 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1943892394 0 0) 0x7fdc94003530 con 0x7fdca8134970 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdca8137c40 con 0x7fdca8134970 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc9c004300 con 0x7fdca8134970 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): dump: 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.594 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2879195869 0 0) 0x7fdca81396d0 con 0x7fdca813e200 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc94003530 con 0x7fdca813e200 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdca0001b00 con 0x7fdca813e200 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): dump: 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2896326688 0 0) 0x7fdca813d700 con 0x7fdca80a4820 2024-04-26T00:09:21.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdca81396d0 con 0x7fdca80a4820 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc98001a60 con 0x7fdca80a4820 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): dump: 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.597 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2864499879 0 0) 0x7fdca8137c40 con 0x7fdca8134970 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6792/0 conn(0x7fdca80a4820 legacy=0x7fdca81388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6791/0 conn(0x7fdca813e200 legacy=0x7fdca81d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 monclient: found mon.g 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca813a6a0 con 0x7fdca8134970 2024-04-26T00:09:21.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 5 monclient: authenticate success, global_id 215139 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient: _renew_subs 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdca813b1e0 con 0x7fdca8134970 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient: _renew_subs 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdca81375c0 con 0x7fdca8134970 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdc9c0045b0 con 0x7fdca8134970 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc9c004b20 con 0x7fdca8134970 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:09:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca6ffd640 4 set_mon_vals no callback set 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient: dump: 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdc880065d0 con 0x7fdc88002870 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdc9c004d80 con 0x7fdca8134970 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fdc9c0451e0 con 0x7fdca8134970 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2317425580 0 0) 0x7fdc880065d0 con 0x7fdc88002870 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 10 monclient(hunting): my global_id is 254282 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdca8137c40 con 0x7fdc88002870 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.602+0000 7fdcad269640 10 monclient: get_auth_request con 0x7fdc94038120 auth_method 0 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1315793258 0 0) 0x7fdca8137c40 con 0x7fdc88002870 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc880065d0 con 0x7fdc88002870 2024-04-26T00:09:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc98003940 con 0x7fdc88002870 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 10 monclient: dump: 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2537467676 0 0) 0x7fdc880065d0 con 0x7fdc88002870 2024-04-26T00:09:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc8800a160 con 0x7fdc88002870 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdc98003c90 con 0x7fdc88002870 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6791/0 conn(0x7fdc88002870 legacy=0x7fdc88004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.606+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6791/0 conn(0x7fdc88002870 legacy=0x7fdc88004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.610+0000 7fdcaeccc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.610+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdc88009e30 con 0x7fdc880090f0 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124831485 0 0) 0x7fdc88009e30 con 0x7fdc880090f0 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient(hunting): my global_id is 254291 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdc880065d0 con 0x7fdc880090f0 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3030704908 0 0) 0x7fdc880065d0 con 0x7fdc880090f0 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdc88009e30 con 0x7fdc880090f0 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdc98004650 con 0x7fdc880090f0 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient: dump: 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1561124426 0 0) 0x7fdc88009e30 con 0x7fdc880090f0 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdc8800c3a0 con 0x7fdc880090f0 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 3872702496) 0x7fdc98006830 con 0x7fdc880090f0 2024-04-26T00:09:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6791/0 conn(0x7fdc880090f0 legacy=0x7fdc88009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdca57fa640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6791/0 conn(0x7fdc880090f0 legacy=0x7fdc88009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 94, 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 31671, 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:21.608 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.609 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.610 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:21.611 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.612 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:21.613 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.615 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:21.617 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:21.619 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:21.625 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6812/722422047 conn(0x7fdc94038120 legacy=0x7fdc9403a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 10 monclient: shutdown 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 >> v1:172.21.15.171:6790/0 conn(0x7fdca8134970 legacy=0x7fdca8138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcad269640 1 -- 172.21.15.106:0/2738463264 reap_dead start 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcad269640 1 -- 172.21.15.106:0/2738463264 reap_dead start 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 shutdown_connections 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 >> 172.21.15.106:0/2738463264 conn(0x7fdca80a9e20 msgr2=0x7fdca8130b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 shutdown_connections 2024-04-26T00:09:21.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.614+0000 7fdcaeccc640 1 -- 172.21.15.106:0/2738463264 wait complete. 2024-04-26T00:09:21.628 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:09:21.628 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 7 for mon i 2024-04-26T00:09:21.628 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.766+0000 7f5dbdfb6640 10 monclient: get_monmap_and_config 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.766+0000 7f5dbdfb6640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.766+0000 7f5dbdfb6640 10 monclient: monmap: 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:09:21.773928+0000 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:09:21.773928+0000 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.747 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.748 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 Processor -- start 2024-04-26T00:09:21.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- start start 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: init 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: _add_conns ranks=[6,4,3,5,1,0,2,8,7] 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient(hunting): picked mon.noname-d con 0x7f5db80a1b20 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient(hunting): picked mon.noname-c con 0x7f5db806be40 addr v1:172.21.15.106:6791/0 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient(hunting): picked mon.noname-g con 0x7f5db809fd70 addr v1:172.21.15.171:6790/0 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db80a3400 con 0x7f5db809fd70 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db806b9b0 con 0x7f5db806be40 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db809eaa0 con 0x7f5db80a1b20 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db6ffd640 1 -- >> v1:172.21.15.106:6791/0 conn(0x7f5db806be40 legacy=0x7f5db813cc60 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6791/0 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient(hunting): authenticate will time out at 1817.301173s 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db77fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5db80a1b20 0x7f5db80a1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39370/0 (socket says 172.21.15.106:39370) 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db77fe640 1 -- 172.21.15.106:0/4121535175 learned_addr learned my addr 172.21.15.106:0/4121535175 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 746599349 0 0) 0x7f5db809eaa0 con 0x7f5db80a1b20 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient(hunting): my global_id is 254328 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5da0003530 con 0x7f5db80a1b20 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 901842165 0 0) 0x7f5da0003530 con 0x7f5db80a1b20 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 >> v1:172.21.15.106:6791/0 conn(0x7f5db806be40 legacy=0x7f5db813cc60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 >> v1:172.21.15.171:6790/0 conn(0x7f5db809fd70 legacy=0x7f5db8140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 monclient: found mon.noname-d 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db806b470 con 0x7f5db80a1b20 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5da80017c0 con 0x7f5db80a1b20 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 5 monclient: authenticate success, global_id 254328 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: dump: 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5da8001b20 con 0x7f5db80a1b20 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 1 -- 172.21.15.106:0/4121535175 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5da8001d50 con 0x7f5db80a1b20 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5db67fc640 10 monclient: dump: 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.760 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: get_monmap_and_config success 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 4 set_mon_vals no callback set 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: shutdown 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/4121535175 >> v1:172.21.15.106:6792/0 conn(0x7f5db80a1b20 legacy=0x7f5db80a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/4121535175 shutdown_connections 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/4121535175 >> 172.21.15.106:0/4121535175 conn(0x7f5db80a6fe0 msgr2=0x7f5db80a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/4121535175 shutdown_connections 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/4121535175 wait complete. 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: build_initial_monmap 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: monmap: 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:09:21.761 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 Processor -- start 2024-04-26T00:09:21.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 1 -- start start 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.770+0000 7f5dbdfb6640 10 monclient: init 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient: _reopen_session rank -1 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient: _add_conns ranks=[5,0,6,2,4,3,7,1,8] 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient(hunting): picked mon.noname-h con 0x7f5db806be40 addr v1:172.21.15.171:6791/0 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient(hunting): picked mon.noname-a con 0x7f5db809fd70 addr v1:172.21.15.106:6789/0 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient(hunting): picked mon.noname-d con 0x7f5db81415c0 addr v1:172.21.15.106:6792/0 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db813fa80 con 0x7f5db809fd70 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db809e150 con 0x7f5db806be40 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5db813d790 con 0x7f5db81415c0 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient(hunting): _renew_subs 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient(hunting): authenticate will time out at 1817.304480s 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5db6ffd640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f5db809fd70 legacy=0x7f5db81d1350 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6789/0 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5db7fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5db81415c0 0x7f5db81d4a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39386/0 (socket says 172.21.15.106:39386) 2024-04-26T00:09:21.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5db7fff640 1 -- 172.21.15.106:0/1764407723 learned_addr learned my addr 172.21.15.106:0/1764407723 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2271843773 0 0) 0x7f5db813d790 con 0x7f5db81415c0 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): my global_id is 254337 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5da4003530 con 0x7f5db81415c0 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1480873057 0 0) 0x7f5da4003530 con 0x7f5db81415c0 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5db813d790 con 0x7f5db81415c0 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5db0001d90 con 0x7f5db81415c0 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): dump: 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2027170393 0 0) 0x7f5db813d790 con 0x7f5db81415c0 2024-04-26T00:09:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.171:6791/0 conn(0x7f5db806be40 legacy=0x7f5db8140eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.106:6789/0 conn(0x7f5db809fd70 legacy=0x7f5db81d1350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 monclient: found mon.d 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db813f7a0 con 0x7f5db81415c0 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: _finish_auth 0 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 5 monclient: authenticate success, global_id 254337 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient: _renew_subs 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5db813e040 con 0x7f5db81415c0 2024-04-26T00:09:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient: _renew_subs 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5db81cc1a0 con 0x7f5db81415c0 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5db0003c50 con 0x7f5db81415c0 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5db00020d0 con 0x7f5db81415c0 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5db5ffb640 4 set_mon_vals no callback set 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: dump: 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d980065d0 con 0x7f5d98002870 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5db0004140 con 0x7f5db81415c0 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5db0045380 con 0x7f5db81415c0 2024-04-26T00:09:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5db6ffd640 10 monclient: get_auth_request con 0x7f5da4037830 auth_method 0 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3151697147 0 0) 0x7f5d980065d0 con 0x7f5d98002870 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient(hunting): my global_id is 146437 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db813d790 con 0x7f5d98002870 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2835615025 0 0) 0x7f5db813d790 con 0x7f5d98002870 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d980065d0 con 0x7f5d98002870 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5da8001440 con 0x7f5d98002870 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 10 monclient: dump: 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2669074486 0 0) 0x7f5d980065d0 con 0x7f5d98002870 2024-04-26T00:09:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.774+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d9800a160 con 0x7f5d98002870 2024-04-26T00:09:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.778+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5da8001ca0 con 0x7f5d98002870 2024-04-26T00:09:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.778+0000 7f5d9ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:09:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.778+0000 7f5d9ffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:09:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.778+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.171:6792/0 conn(0x7f5d98002870 legacy=0x7f5d98004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.778+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.171:6792/0 conn(0x7f5d98002870 legacy=0x7f5d98004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5dbdfb6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:09:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d98009e50 con 0x7f5d98009110 2024-04-26T00:09:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440419666 0 0) 0x7f5d98009e50 con 0x7f5d98009110 2024-04-26T00:09:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:09:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 10 monclient(hunting): my global_id is 146446 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d980065d0 con 0x7f5d98009110 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2935387318 0 0) 0x7f5d980065d0 con 0x7f5d98009110 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d98009e50 con 0x7f5d98009110 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5da8005340 con 0x7f5d98009110 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 10 monclient: dump: 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:09:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3384874896 0 0) 0x7f5d98009e50 con 0x7f5d98009110 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.782+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d9800c3e0 con 0x7f5d98009110 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2985366872) 0x7f5da8005560 con 0x7f5d98009110 2024-04-26T00:09:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5d9ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5d9ffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.171:6792/0 conn(0x7f5d98009110 legacy=0x7f5d980095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5d9ffff640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.171:6792/0 conn(0x7f5d98009110 legacy=0x7f5d980095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 94, 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 625315, 2024-04-26T00:09:21.775 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.776 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.777 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:09:21.778 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:09:21.779 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.780 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.782 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.783 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.784 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.785 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.786 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.787 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.788 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.789 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:09:21.790 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:09:21.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:09:21.792 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.171:6812/722422047 conn(0x7f5da4037830 legacy=0x7f5da4039cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 10 monclient: shutdown 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 >> v1:172.21.15.106:6792/0 conn(0x7f5db81415c0 legacy=0x7f5db81d4a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5db7fff640 1 -- 172.21.15.106:0/1764407723 reap_dead start 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5db7fff640 1 -- 172.21.15.106:0/1764407723 reap_dead start 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 shutdown_connections 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 >> 172.21.15.106:0/1764407723 conn(0x7f5db80a6fe0 msgr2=0x7f5db8071e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:09:21.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 shutdown_connections 2024-04-26T00:09:21.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:09:21.786+0000 7f5dbdfb6640 1 -- 172.21.15.106:0/1764407723 wait complete. 2024-04-26T00:09:21.795 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 7 2024-04-26T00:09:21.795 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-26T00:10:51.796 INFO:tasks.mon_thrash.mon_thrasher:killing mon.a 2024-04-26T00:10:51.796 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.a 2024-04-26T00:10:51.796 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-26T00:10:51.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-26T00:10:51.800 INFO:tasks.ceph.mon.a:Started 2024-04-26T00:10:51.800 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-04-26T00:10:51.801 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-04-26T00:10:51.801 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-26T00:10:51.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-26T00:10:51.804 INFO:tasks.ceph.mon.c:Started 2024-04-26T00:10:51.804 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:10:51.804 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:10:51.930 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:51.957+0000 7ffa36028c80 -1 mon.a@-1(???).log v0 log_external_backlog rewinding external_log_to from 508 -> 0 (sync_force? mon rebuild?) 2024-04-26T00:10:51.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient: get_monmap_and_config 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient: build_initial_monmap 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient: monmap: 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:51.971055+0000 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:51.971055+0000 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:51.943 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:51.944 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:51.944 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:51.944 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:51.944 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:51.944 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:51.944 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 1 Processor -- start 2024-04-26T00:10:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 1 -- start start 2024-04-26T00:10:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient: init 2024-04-26T00:10:51.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient: _add_conns ranks=[1,3,4,5,7,0,8,6,2] 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient(hunting): picked mon.noname-f con 0x7f0190134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient(hunting): picked mon.noname-g con 0x7f01900a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient(hunting): picked mon.noname-c con 0x7f019013e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f019006dd40 con 0x7f0190134970 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01900a2b10 con 0x7f01900a4820 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01900a2df0 con 0x7f019013e200 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f0198414640 10 monclient(hunting): authenticate will time out at 1907.498056s 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f01969b1640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f019013e200 0x7f01901405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55694/0 (socket says 172.21.15.106:55694) 2024-04-26T00:10:51.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:51.969+0000 7f01969b1640 1 -- 172.21.15.106:0/4170318963 learned_addr learned my addr 172.21.15.106:0/4170318963 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:54.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient(hunting): tick 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 1 monclient(hunting): continuing hunt 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 1 -- 172.21.15.106:0/4170318963 >> v1:172.21.15.106:6791/0 conn(0x7f019013e200 legacy=0x7f01901405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 1 -- 172.21.15.106:0/4170318963 >> v1:172.21.15.171:6790/0 conn(0x7f01900a4820 legacy=0x7f019013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 1 -- 172.21.15.106:0/4170318963 >> v1:172.21.15.171:6789/0 conn(0x7f0190134970 legacy=0x7f0190134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient: _add_conns ranks=[2,6,5,0,8,7] 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient(hunting): picked mon.noname-b con 0x7f017c0037f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient(hunting): picked mon.noname-d con 0x7f017c007480 addr v1:172.21.15.106:6792/0 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient(hunting): picked mon.noname-h con 0x7f017c00b1f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 1 -- 172.21.15.106:0/4170318963 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01900a30d0 con 0x7f017c0037f0 2024-04-26T00:10:54.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 1 -- 172.21.15.106:0/4170318963 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c010000 con 0x7f017c00b1f0 2024-04-26T00:10:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 1 -- 172.21.15.106:0/4170318963 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f017c011270 con 0x7f017c007480 2024-04-26T00:10:54.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:54.968+0000 7f018ffff640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:56.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1868658927 0 0) 0x7f017c011270 con 0x7f017c007480 2024-04-26T00:10:56.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient(hunting): _negotiate 2024-04-26T00:10:56.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:56.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:56.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient(hunting): my global_id is 254346 2024-04-26T00:10:56.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0178003530 con 0x7f017c007480 2024-04-26T00:10:56.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2723638629 0 0) 0x7f0178003530 con 0x7f017c007480 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 >> v1:172.21.15.171:6791/0 conn(0x7f017c00b1f0 legacy=0x7f017c00d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 >> v1:172.21.15.106:6790/0 conn(0x7f017c0037f0 legacy=0x7f017c005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: _finish_hunting 0 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 monclient: found mon.noname-d 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f017c012560 con 0x7f017c007480 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: _finish_auth 0 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: _check_auth_tickets 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01969b1640 1 -- 172.21.15.106:0/4170318963 reap_dead start 2024-04-26T00:10:56.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0184001800 con 0x7f017c007480 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: dump: 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:56.962 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:56.963 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:56.965 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 5 monclient: authenticate success, global_id 254346 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0184001a60 con 0x7f017c007480 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 1 -- 172.21.15.106:0/4170318963 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0184003940 con 0x7f017c007480 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:10:56.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f01951ae640 10 monclient: dump: 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:56.967 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:56.968 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:56.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:56.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 4 set_mon_vals no callback set 2024-04-26T00:10:56.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 10 monclient: shutdown 2024-04-26T00:10:56.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 1 -- 172.21.15.106:0/4170318963 >> v1:172.21.15.106:6792/0 conn(0x7f017c007480 legacy=0x7f017c009940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 1 -- 172.21.15.106:0/4170318963 shutdown_connections 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 1 -- 172.21.15.106:0/4170318963 >> 172.21.15.106:0/4170318963 conn(0x7f01900a9e20 msgr2=0x7f01900aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 1 -- 172.21.15.106:0/4170318963 shutdown_connections 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.984+0000 7f0198414640 1 -- 172.21.15.106:0/4170318963 wait complete. 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient: build_initial_monmap 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient: monmap: 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:56.970 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 1 Processor -- start 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 1 -- start start 2024-04-26T00:10:56.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient: init 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient: _add_conns ranks=[7,5,3,1,6,4,8,0,2] 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient(hunting): picked mon.noname-i con 0x7f017c007480 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient(hunting): picked mon.noname-h con 0x7f01901ccc00 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient(hunting): picked mon.noname-g con 0x7f01901cd000 addr v1:172.21.15.171:6790/0 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01900a1a40 con 0x7f01901cd000 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01900a1e00 con 0x7f01901ccc00 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0190138400 con 0x7f017c007480 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f0198414640 10 monclient(hunting): authenticate will time out at 1912.518807s 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f01961b0640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f017c007480 0x7f01901cc4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:45518/0 (socket says 172.21.15.106:45518) 2024-04-26T00:10:56.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f01959af640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f01901ccc00 0x7f01901d1810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:34680/0 (socket says 172.21.15.106:34680) 2024-04-26T00:10:56.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:56.988+0000 7f01961b0640 1 -- 172.21.15.106:0/1297051568 learned_addr learned my addr 172.21.15.106:0/1297051568 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910216715 0 0) 0x7f0190138400 con 0x7f017c007480 2024-04-26T00:10:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): my global_id is 146455 2024-04-26T00:10:56.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f017c003550 con 0x7f017c007480 2024-04-26T00:10:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1554005741 0 0) 0x7f017c003550 con 0x7f017c007480 2024-04-26T00:10:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0190138400 con 0x7f017c007480 2024-04-26T00:10:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0188001a20 con 0x7f017c007480 2024-04-26T00:10:56.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): dump: 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:56.990 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3780851042 0 0) 0x7f0190138400 con 0x7f017c007480 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 >> v1:172.21.15.171:6791/0 conn(0x7f01901ccc00 legacy=0x7f01901d1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 >> v1:172.21.15.171:6790/0 conn(0x7f01901cd000 legacy=0x7f01901d4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:56.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: _finish_hunting 0 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 monclient: found mon.i 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0190139170 con 0x7f017c007480 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: _finish_auth 0 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: _check_auth_tickets 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 5 monclient: authenticate success, global_id 146455 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 10 monclient: _renew_subs 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:10:56.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0190137a80 con 0x7f017c007480 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 10 monclient: _renew_subs 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f0190133bd0 con 0x7f017c007480 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f01880038b0 con 0x7f017c007480 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0188003e20 con 0x7f017c007480 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018ffff640 4 set_mon_vals no callback set 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 10 monclient: dump: 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:56.993 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:56.994 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0170005090 con 0x7f017c007480 2024-04-26T00:10:56.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0188003fc0 con 0x7f017c007480 2024-04-26T00:10:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.012+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f0188045090 con 0x7f017c007480 2024-04-26T00:10:56.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.016+0000 7f01959af640 10 monclient: get_auth_request con 0x7f017c038f20 auth_method 0 2024-04-26T00:10:57.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.028+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0190133bd0 con 0x7f017c007480 2024-04-26T00:10:57.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.028+0000 7f018effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.028+0000 7f018effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.268+0000 7f0198414640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:10:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.268+0000 7f0198414640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:10:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.268+0000 7f0198414640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:10:57.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.268+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f0170005380 con 0x7f017c007480 2024-04-26T00:10:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.268+0000 7f018effd640 1 -- 172.21.15.106:0/1297051568 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 2397977548) 0x7f01880156c0 con 0x7f017c007480 2024-04-26T00:10:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.268+0000 7f018effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:10:57.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.268+0000 7f018effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:57.244 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":100,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:10:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 >> v1:172.21.15.171:6812/722422047 conn(0x7f017c038f20 legacy=0x7f017c03b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 10 monclient: shutdown 2024-04-26T00:10:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 >> v1:172.21.15.171:6792/0 conn(0x7f017c007480 legacy=0x7f01901cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 shutdown_connections 2024-04-26T00:10:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 >> 172.21.15.106:0/1297051568 conn(0x7f01900a9e20 msgr2=0x7f0190067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 shutdown_connections 2024-04-26T00:10:57.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.272+0000 7f0198414640 1 -- 172.21.15.106:0/1297051568 wait complete. 2024-04-26T00:10:57.261 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:10:57.261 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:10:57.261 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:10:57.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.400+0000 7f84472f0640 10 monclient: get_monmap_and_config 2024-04-26T00:10:57.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.400+0000 7f84472f0640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.387 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.400+0000 7f84472f0640 10 monclient: monmap: 2024-04-26T00:10:57.387 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.387 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.387 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:57.406160+0000 2024-04-26T00:10:57.387 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:57.406160+0000 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 Processor -- start 2024-04-26T00:10:57.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- start start 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient: init 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient: _add_conns ranks=[0,3,1,6,5,7,2,8,4] 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient(hunting): picked mon.noname-a con 0x7f84400a5010 addr v1:172.21.15.106:6789/0 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient(hunting): picked mon.noname-g con 0x7f84400727d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient(hunting): picked mon.noname-f con 0x7f844013e100 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8440137ee0 con 0x7f84400a5010 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844006ce30 con 0x7f844013e100 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844006d870 con 0x7f84400727d0 2024-04-26T00:10:57.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient(hunting): authenticate will time out at 1912.933602s 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f844508c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f84400a5010 0x7f84400720c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38048/0 (socket says 172.21.15.106:38048) 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f844508c640 1 -- 172.21.15.106:0/1048473655 learned_addr learned my addr 172.21.15.106:0/1048473655 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4230759430 0 0) 0x7f8440137ee0 con 0x7f84400a5010 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient(hunting): my global_id is 274104 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f842c003530 con 0x7f84400a5010 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1223739383 0 0) 0x7f842c003530 con 0x7f84400a5010 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 >> v1:172.21.15.171:6790/0 conn(0x7f84400727d0 legacy=0x7f844013c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 >> v1:172.21.15.171:6789/0 conn(0x7f844013e100 legacy=0x7f84401404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 monclient: found mon.noname-a 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844006e2c0 con 0x7f84400a5010 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f84300017c0 con 0x7f84400a5010 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 5 monclient: authenticate success, global_id 274104 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: dump: 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.391 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.392 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8430001ab0 con 0x7f84400a5010 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 4 set_mon_vals no callback set 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 1 -- 172.21.15.106:0/1048473655 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8430004bf0 con 0x7f84400a5010 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:10:57.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f8437fff640 10 monclient: dump: 2024-04-26T00:10:57.394 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.394 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.394 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.394 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.394 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.395 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient: shutdown 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- 172.21.15.106:0/1048473655 >> v1:172.21.15.106:6789/0 conn(0x7f84400a5010 legacy=0x7f84400720c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- 172.21.15.106:0/1048473655 shutdown_connections 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- 172.21.15.106:0/1048473655 >> 172.21.15.106:0/1048473655 conn(0x7f84400a8440 msgr2=0x7f84400a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- 172.21.15.106:0/1048473655 shutdown_connections 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 -- 172.21.15.106:0/1048473655 wait complete. 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 10 monclient: monmap: 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:57.396 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.397 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.404+0000 7f84472f0640 1 Processor -- start 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 1 -- start start 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient: init 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient: _add_conns ranks=[5,2,8,3,4,7,0,1,6] 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient(hunting): picked mon.noname-h con 0x7f84400727d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient(hunting): picked mon.noname-b con 0x7f84400a5010 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient(hunting): picked mon.noname-e con 0x7f844013e100 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844013cba0 con 0x7f84400a5010 2024-04-26T00:10:57.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844006da90 con 0x7f84400727d0 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f844013d220 con 0x7f844013e100 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient(hunting): authenticate will time out at 1912.936483s 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f844488b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f84400a5010 0x7f84401d1820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44196/0 (socket says 172.21.15.106:44196) 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f844588d640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f844013e100 0x7f84401d4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33352/0 (socket says 172.21.15.106:33352) 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f844488b640 1 -- 172.21.15.106:0/3409389219 learned_addr learned my addr 172.21.15.106:0/3409389219 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1358778264 0 0) 0x7f844013d220 con 0x7f844013e100 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): my global_id is 224927 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8424003530 con 0x7f844013e100 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973801002 0 0) 0x7f844013cba0 con 0x7f84400a5010 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): my global_id is 254324 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844013d220 con 0x7f84400a5010 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1360292935 0 0) 0x7f8424003530 con 0x7f844013e100 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f844013cba0 con 0x7f844013e100 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8438001d10 con 0x7f844013e100 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): dump: 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.401 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604419339 0 0) 0x7f844006da90 con 0x7f84400727d0 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): my global_id is 254318 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8424003530 con 0x7f84400727d0 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 79244540 0 0) 0x7f844013d220 con 0x7f84400a5010 2024-04-26T00:10:57.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f844006da90 con 0x7f84400a5010 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f843c001980 con 0x7f84400a5010 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): dump: 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.403 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1183049028 0 0) 0x7f844013cba0 con 0x7f844013e100 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.171:6791/0 conn(0x7f84400727d0 legacy=0x7f8440134620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.106:6790/0 conn(0x7f84400a5010 legacy=0x7f84401d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 monclient: found mon.e 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f844011f720 con 0x7f844013e100 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 5 monclient: authenticate success, global_id 224927 2024-04-26T00:10:57.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient: _renew_subs 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8440134d30 con 0x7f844013e100 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient: _renew_subs 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f844011e990 con 0x7f844013e100 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8438003c50 con 0x7f844013e100 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f84380041c0 con 0x7f844013e100 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84377fe640 4 set_mon_vals no callback set 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: dump: 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.407 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f84200065d0 con 0x7f8420002870 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8438004360 con 0x7f844013e100 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f8438045200 con 0x7f844013e100 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454365375 0 0) 0x7f84200065d0 con 0x7f8420002870 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient(hunting): my global_id is 274113 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f844013cba0 con 0x7f8420002870 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1186563271 0 0) 0x7f844013cba0 con 0x7f8420002870 2024-04-26T00:10:57.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f84200065d0 con 0x7f8420002870 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f84300047f0 con 0x7f8420002870 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: dump: 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.409 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f844488b640 10 monclient: get_auth_request con 0x7f8424037f30 auth_method 0 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2742238092 0 0) 0x7f84200065d0 con 0x7f8420002870 2024-04-26T00:10:57.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f842000a160 con 0x7f8420002870 2024-04-26T00:10:57.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8430004c20 con 0x7f8420002870 2024-04-26T00:10:57.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:57.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.106:6789/0 conn(0x7f8420002870 legacy=0x7f8420004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.408+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.106:6789/0 conn(0x7f8420002870 legacy=0x7f8420004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:57.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8420009e50 con 0x7f8420009110 2024-04-26T00:10:57.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105617650 0 0) 0x7f8420009e50 con 0x7f8420009110 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient(hunting): my global_id is 274122 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84200065d0 con 0x7f8420009110 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 82997818 0 0) 0x7f84200065d0 con 0x7f8420009110 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8420009e50 con 0x7f8420009110 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8430004e60 con 0x7f8420009110 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient: dump: 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.414 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 987191019 0 0) 0x7f8420009e50 con 0x7f8420009110 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f842000c3e0 con 0x7f8420009110 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 3675493003) 0x7f8430006330 con 0x7f8420009110 2024-04-26T00:10:57.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:57.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:57.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.106:6789/0 conn(0x7f8420009110 legacy=0x7f84200095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f8435ffb640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.106:6789/0 conn(0x7f8420009110 legacy=0x7f84200095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.416 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:57.416 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 5487, 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:57.417 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:57.418 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:10:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.419 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.420 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:57.421 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.422 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.423 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:57.424 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:57.425 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.426 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.427 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.428 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:57.429 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.430 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:57.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:57.432 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.433 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.434 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:57.435 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.436 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:57.437 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:57.438 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.439 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:57.440 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.441 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:57.442 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.443 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.444 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.445 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.446 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.447 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.448 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.449 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.450 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:57.450 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:57.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.171:6812/722422047 conn(0x7f8424037f30 legacy=0x7f842403a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 10 monclient: shutdown 2024-04-26T00:10:57.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 >> v1:172.21.15.106:6793/0 conn(0x7f844013e100 legacy=0x7f84401d4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f844588d640 1 -- 172.21.15.106:0/3409389219 reap_dead start 2024-04-26T00:10:57.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f844588d640 1 -- 172.21.15.106:0/3409389219 reap_dead start 2024-04-26T00:10:57.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 shutdown_connections 2024-04-26T00:10:57.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 >> 172.21.15.106:0/3409389219 conn(0x7f84400a8440 msgr2=0x7f84400a59f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 shutdown_connections 2024-04-26T00:10:57.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.416+0000 7f84472f0640 1 -- 172.21.15.106:0/3409389219 wait complete. 2024-04-26T00:10:57.452 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:57.453 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:10:57.453 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient: get_monmap_and_config 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient: monmap: 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:57.599438+0000 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:57.599438+0000 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.572 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 1 Processor -- start 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 1 -- start start 2024-04-26T00:10:57.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient: init 2024-04-26T00:10:57.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient: _add_conns ranks=[1,5,4,3,7,0,2,8,6] 2024-04-26T00:10:57.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient(hunting): picked mon.noname-f con 0x7f6f7c137c40 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:57.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient(hunting): picked mon.noname-h con 0x7f6f7c09fca0 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:57.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient(hunting): picked mon.noname-c con 0x7f6f7c137570 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:57.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c06ee10 con 0x7f6f7c137c40 2024-04-26T00:10:57.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c0a2220 con 0x7f6f7c137570 2024-04-26T00:10:57.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c06f0f0 con 0x7f6f7c09fca0 2024-04-26T00:10:57.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient(hunting): authenticate will time out at 1913.126545s 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f819b2640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f6f7c137570 0x7f6f7c1408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45774/0 (socket says 172.21.15.106:45774) 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f819b2640 1 -- 172.21.15.106:0/2263777655 learned_addr learned my addr 172.21.15.106:0/2263777655 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1803593491 0 0) 0x7f6f7c0a2220 con 0x7f6f7c137570 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient(hunting): my global_id is 274108 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f68003530 con 0x7f6f7c137570 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3489795815 0 0) 0x7f6f68003530 con 0x7f6f7c137570 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 >> v1:172.21.15.171:6791/0 conn(0x7f6f7c09fca0 legacy=0x7f6f7c0a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 >> v1:172.21.15.171:6789/0 conn(0x7f6f7c137c40 legacy=0x7f6f7c0a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 monclient: found mon.noname-c 2024-04-26T00:10:57.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c06f3d0 con 0x7f6f7c137570 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f74001b40 con 0x7f6f7c137570 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 5 monclient: authenticate success, global_id 274108 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: dump: 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.588 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:57.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f74001e30 con 0x7f6f7c137570 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f83415640 4 set_mon_vals no callback set 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 1 -- 172.21.15.106:0/2263777655 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f74004f70 con 0x7f6f7c137570 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.596+0000 7f6f73fff640 10 monclient: dump: 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.590 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: shutdown 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- 172.21.15.106:0/2263777655 >> v1:172.21.15.106:6791/0 conn(0x7f6f7c137570 legacy=0x7f6f7c1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- 172.21.15.106:0/2263777655 shutdown_connections 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- 172.21.15.106:0/2263777655 >> 172.21.15.106:0/2263777655 conn(0x7f6f7c0a64e0 msgr2=0x7f6f7c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- 172.21.15.106:0/2263777655 shutdown_connections 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- 172.21.15.106:0/2263777655 wait complete. 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: monmap: 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.592 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 Processor -- start 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- start start 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: init 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: _add_conns ranks=[5,4,0,6,2,7,8,1,3] 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient(hunting): picked mon.noname-h con 0x7f6f7c09fca0 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient(hunting): picked mon.noname-c con 0x7f6f7c137570 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient(hunting): picked mon.noname-a con 0x7f6f7c137c40 addr v1:172.21.15.106:6789/0 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c134560 con 0x7f6f7c137c40 2024-04-26T00:10:57.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c11e690 con 0x7f6f7c137570 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f7c072970 con 0x7f6f7c09fca0 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient(hunting): authenticate will time out at 1913.130106s 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f819b2640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6f7c137c40 0x7f6f7c1d4f80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38078/0 (socket says 172.21.15.106:38078) 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f819b2640 1 -- 172.21.15.106:0/1486352215 learned_addr learned my addr 172.21.15.106:0/1486352215 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f809b0640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f6f7c137570 0x7f6f7c1d1850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45776/0 (socket says 172.21.15.106:45776) 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1948165247 0 0) 0x7f6f7c134560 con 0x7f6f7c137c40 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): my global_id is 274131 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f60003530 con 0x7f6f7c137c40 2024-04-26T00:10:57.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 707966335 0 0) 0x7f6f7c11e690 con 0x7f6f7c137570 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): my global_id is 274117 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7c134560 con 0x7f6f7c137570 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229283751 0 0) 0x7f6f6c001090 con 0x7f6f7c09fca0 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): my global_id is 254336 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7c11e690 con 0x7f6f7c09fca0 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2530896500 0 0) 0x7f6f60003530 con 0x7f6f7c137c40 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f6c001090 con 0x7f6f7c137c40 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f74001b00 con 0x7f6f7c137c40 2024-04-26T00:10:57.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): dump: 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.596 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.597 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.597 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.597 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:57.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2627002376 0 0) 0x7f6f7c134560 con 0x7f6f7c137570 2024-04-26T00:10:57.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f60003530 con 0x7f6f7c137570 2024-04-26T00:10:57.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f78001a60 con 0x7f6f7c137570 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient(hunting): dump: 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.598 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 630094039 0 0) 0x7f6f6c001090 con 0x7f6f7c137c40 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.171:6791/0 conn(0x7f6f7c09fca0 legacy=0x7f6f7c1311d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.106:6791/0 conn(0x7f6f7c137570 legacy=0x7f6f7c1d1850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 monclient: found mon.a 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c120980 con 0x7f6f7c137c40 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 5 monclient: authenticate success, global_id 274131 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: _renew_subs 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c1bfb40 con 0x7f6f7c137c40 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f74004f90 con 0x7f6f7c137c40 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f74001fe0 con 0x7f6f7c137c40 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f71ffb640 10 monclient: dump: 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.600 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f737fe640 4 set_mon_vals no callback set 2024-04-26T00:10:57.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: _renew_subs 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f7c11eee0 con 0x7f6f7c137c40 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.600+0000 7f6f83415640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f7c075890 con 0x7f6f7c1318e0 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364818126 0 0) 0x7f6f7c075890 con 0x7f6f7c1318e0 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient(hunting): my global_id is 254333 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f6c001090 con 0x7f6f7c1318e0 2024-04-26T00:10:57.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6f74010470 con 0x7f6f7c137c40 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f6f74045480 con 0x7f6f7c137c40 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3462396582 0 0) 0x7f6f6c001090 con 0x7f6f7c1318e0 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f7c075890 con 0x7f6f7c1318e0 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f6c0018a0 con 0x7f6f7c1318e0 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient: dump: 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.603 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1679199650 0 0) 0x7f6f7c075890 con 0x7f6f7c1318e0 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6f7c0724d0 con 0x7f6f7c1318e0 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f809b0640 10 monclient: get_auth_request con 0x7f6f60037f70 auth_method 0 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6f6c001c80 con 0x7f6f7c1318e0 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:57.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.106:6790/0 conn(0x7f6f7c1318e0 legacy=0x7f6f7c06fb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.604+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.106:6790/0 conn(0x7f6f7c1318e0 legacy=0x7f6f7c06fb60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f83415640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:57.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6f7c11ddb0 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659911171 0 0) 0x7f6f7c11ddb0 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 10 monclient(hunting): my global_id is 254342 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f7c075890 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3354731011 0 0) 0x7f6f7c075890 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f7c11ddb0 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f6c003b30 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 10 monclient: dump: 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.607 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2473807254 0 0) 0x7f6f7c11ddb0 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.608+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6f7c062e50 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 989122556) 0x7f6f6c003e10 con 0x7f6f7c11d9d0 2024-04-26T00:10:57.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f71ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f71ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.106:6790/0 conn(0x7f6f7c11d9d0 legacy=0x7f6f7c070270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f71ffb640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.106:6790/0 conn(0x7f6f7c11d9d0 legacy=0x7f6f7c070270 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 127669, 2024-04-26T00:10:57.609 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:57.610 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:57.611 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:57.612 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.613 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:57.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.615 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:57.616 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.617 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.618 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.619 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.620 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.621 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.622 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.623 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.624 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.625 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.626 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.627 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:10:57.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.628 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.628 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:57.628 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.171:6812/722422047 conn(0x7f6f60037f70 legacy=0x7f6f6003a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 10 monclient: shutdown 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 >> v1:172.21.15.106:6789/0 conn(0x7f6f7c137c40 legacy=0x7f6f7c1d4f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f819b2640 1 -- 172.21.15.106:0/1486352215 reap_dead start 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f819b2640 1 -- 172.21.15.106:0/1486352215 reap_dead start 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 shutdown_connections 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 >> 172.21.15.106:0/1486352215 conn(0x7f6f7c0a64e0 msgr2=0x7f6f7c133690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 shutdown_connections 2024-04-26T00:10:57.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.612+0000 7f6f83415640 1 -- 172.21.15.106:0/1486352215 wait complete. 2024-04-26T00:10:57.631 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:57.631 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:10:57.631 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:10:57.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: get_monmap_and_config 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: monmap: 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:57.770964+0000 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:57.770964+0000 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.744 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.744 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.744 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 Processor -- start 2024-04-26T00:10:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- start start 2024-04-26T00:10:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: init 2024-04-26T00:10:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: _add_conns ranks=[5,4,6,7,3,1,8,0,2] 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient(hunting): picked mon.noname-h con 0x7f505c137730 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient(hunting): picked mon.noname-c con 0x7f505c0a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient(hunting): picked mon.noname-d con 0x7f505c138220 addr v1:172.21.15.106:6792/0 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c0a2750 con 0x7f505c0a0b20 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c0a2a30 con 0x7f505c137730 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c0a2d10 con 0x7f505c138220 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient(hunting): authenticate will time out at 1913.298213s 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505bfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f505c138220 0x7f505c140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41760/0 (socket says 172.21.15.106:41760) 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505bfff640 1 -- 172.21.15.106:0/1015522973 learned_addr learned my addr 172.21.15.106:0/1015522973 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2992270224 0 0) 0x7f505c0a2d10 con 0x7f505c138220 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): my global_id is 254355 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5048003530 con 0x7f505c138220 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099703612 0 0) 0x7f505c0a2750 con 0x7f505c0a0b20 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient(hunting): my global_id is 274126 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f505c0a2d10 con 0x7f505c0a0b20 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 15842384 0 0) 0x7f5048003530 con 0x7f505c138220 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 >> v1:172.21.15.171:6791/0 conn(0x7f505c137730 legacy=0x7f505c137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 >> v1:172.21.15.106:6791/0 conn(0x7f505c0a0b20 legacy=0x7f505c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 monclient: found mon.noname-d 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0a4680 con 0x7f505c138220 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f50540017c0 con 0x7f505c138220 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 5 monclient: authenticate success, global_id 254355 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: dump: 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.755 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5054001aa0 con 0x7f505c138220 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 1 -- 172.21.15.106:0/1015522973 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5054004bf0 con 0x7f505c138220 2024-04-26T00:10:57.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f505a7fc640 10 monclient: dump: 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.757 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 4 set_mon_vals no callback set 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 10 monclient: shutdown 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- 172.21.15.106:0/1015522973 >> v1:172.21.15.106:6792/0 conn(0x7f505c138220 legacy=0x7f505c140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- 172.21.15.106:0/1015522973 shutdown_connections 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- 172.21.15.106:0/1015522973 >> 172.21.15.106:0/1015522973 conn(0x7f505c0a6b80 msgr2=0x7f505c0a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- 172.21.15.106:0/1015522973 shutdown_connections 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.768+0000 7f5061cd3640 1 -- 172.21.15.106:0/1015522973 wait complete. 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: monmap: 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.759 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 Processor -- start 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 -- start start 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: init 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: _add_conns ranks=[2,8,5,3,7,4,1,6,0] 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient(hunting): picked mon.noname-b con 0x7f505c0a0b20 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient(hunting): picked mon.noname-e con 0x7f505c137730 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient(hunting): picked mon.noname-h con 0x7f505c138220 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c0a19d0 con 0x7f505c0a0b20 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c09f800 con 0x7f505c138220 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f505c09f520 con 0x7f505c137730 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient(hunting): authenticate will time out at 1913.301252s 2024-04-26T00:10:57.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f505b7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f505c0a0b20 0x7f505c12e700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44210/0 (socket says 172.21.15.106:44210) 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f505b7fe640 1 -- 172.21.15.106:0/1452753578 learned_addr learned my addr 172.21.15.106:0/1452753578 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938197039 0 0) 0x7f504c001650 con 0x7f505c0a0b20 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): my global_id is 254351 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f503c003530 con 0x7f505c0a0b20 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234659545 0 0) 0x7f505c09f520 con 0x7f505c137730 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): my global_id is 224936 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f504c001650 con 0x7f505c137730 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3598619428 0 0) 0x7f504c001650 con 0x7f505c137730 2024-04-26T00:10:57.761 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f505c09f520 con 0x7f505c137730 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5044001580 con 0x7f505c137730 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): dump: 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.762 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1612201110 0 0) 0x7f503c003530 con 0x7f505c0a0b20 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f504c001650 con 0x7f505c0a0b20 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f504c002040 con 0x7f505c0a0b20 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): dump: 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.763 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4043039811 0 0) 0x7f505c09f800 con 0x7f505c138220 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): my global_id is 254354 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f503c003530 con 0x7f505c138220 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2515489634 0 0) 0x7f505c09f520 con 0x7f505c137730 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.171:6791/0 conn(0x7f505c138220 legacy=0x7f505c1d4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.106:6790/0 conn(0x7f505c0a0b20 legacy=0x7f505c12e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 monclient: found mon.e 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f505c0a0540 con 0x7f505c137730 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.765 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 5 monclient: authenticate success, global_id 224936 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: _renew_subs 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f505c09db10 con 0x7f505c137730 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: _renew_subs 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f505c09ea20 con 0x7f505c137730 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f50440038b0 con 0x7f505c137730 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5044003da0 con 0x7f505c137730 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f50597fa640 4 set_mon_vals no callback set 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: dump: 2024-04-26T00:10:57.766 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.767 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f50400065d0 con 0x7f5040002870 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f504400eb40 con 0x7f505c137730 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5044043df0 con 0x7f505c137730 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788902433 0 0) 0x7f50400065d0 con 0x7f5040002870 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient(hunting): my global_id is 274135 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f505c09f520 con 0x7f5040002870 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f505bfff640 10 monclient: get_auth_request con 0x7f503c037eb0 auth_method 0 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 850065160 0 0) 0x7f505c09f520 con 0x7f5040002870 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f50400065d0 con 0x7f5040002870 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f504c004060 con 0x7f5040002870 2024-04-26T00:10:57.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 10 monclient: dump: 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.769 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2420861623 0 0) 0x7f50400065d0 con 0x7f5040002870 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.772+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f504000a160 con 0x7f5040002870 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.776+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f504c005b30 con 0x7f5040002870 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.776+0000 7f5053fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.776+0000 7f5053fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.776+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.106:6791/0 conn(0x7f5040002870 legacy=0x7f5040004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.776+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.106:6791/0 conn(0x7f5040002870 legacy=0x7f5040004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5040009e50 con 0x7f5040009110 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 499568563 0 0) 0x7f5040009e50 con 0x7f5040009110 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient(hunting): my global_id is 274144 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f50400065d0 con 0x7f5040009110 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2379828440 0 0) 0x7f50400065d0 con 0x7f5040009110 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5040009e50 con 0x7f5040009110 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f504c005ce0 con 0x7f5040009110 2024-04-26T00:10:57.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient: dump: 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.773 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3297987481 0 0) 0x7f5040009e50 con 0x7f5040009110 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f504000c3e0 con 0x7f5040009110 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 896794405) 0x7f504c007170 con 0x7f5040009110 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.106:6791/0 conn(0x7f5040009110 legacy=0x7f50400095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5053fff640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.106:6791/0 conn(0x7f5040009110 legacy=0x7f50400095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.774 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 5859, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:57.775 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.776 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.777 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:57.778 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:57.779 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:57.779 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:57.779 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:57.779 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.779 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:57.779 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.779 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.780 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.781 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.782 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.783 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.784 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.785 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.786 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.787 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.790 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.791 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:57.792 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.793 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.794 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.795 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.796 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:57.797 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:57.798 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.171:6812/722422047 conn(0x7f503c037eb0 legacy=0x7f503c03a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 10 monclient: shutdown 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 >> v1:172.21.15.106:6793/0 conn(0x7f505c137730 legacy=0x7f505c1d14b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f505bfff640 1 -- 172.21.15.106:0/1452753578 reap_dead start 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f505bfff640 1 -- 172.21.15.106:0/1452753578 reap_dead start 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 shutdown_connections 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 >> 172.21.15.106:0/1452753578 conn(0x7f505c0a6b80 msgr2=0x7f505c0a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 shutdown_connections 2024-04-26T00:10:57.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.780+0000 7f5061cd3640 1 -- 172.21.15.106:0/1452753578 wait complete. 2024-04-26T00:10:57.801 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:57.801 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:10:57.801 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:10:57.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: get_monmap_and_config 2024-04-26T00:10:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: monmap: 2024-04-26T00:10:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:57.950805+0000 2024-04-26T00:10:57.923 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:57.950805+0000 2024-04-26T00:10:57.924 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.924 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.924 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.924 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.924 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.924 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.924 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.925 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.925 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.925 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.925 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.925 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 Processor -- start 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- start start 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: init 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: _add_conns ranks=[7,2,1,0,3,5,4,8,6] 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient(hunting): picked mon.noname-i con 0x7f0ec0137730 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient(hunting): picked mon.noname-b con 0x7f0ec00a0b20 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient(hunting): picked mon.noname-f con 0x7f0ec0138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec00a2750 con 0x7f0ec0138220 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec00a2a30 con 0x7f0ec00a0b20 2024-04-26T00:10:57.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec00a2d10 con 0x7f0ec0137730 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient(hunting): authenticate will time out at 1913.477944s 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0eb67fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f0ec00a0b20 0x7f0ec013ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44214/0 (socket says 172.21.15.106:44214) 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0eb67fc640 1 -- 172.21.15.106:0/1574188068 learned_addr learned my addr 172.21.15.106:0/1574188068 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2194756148 0 0) 0x7f0ec00a2a30 con 0x7f0ec00a0b20 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient(hunting): my global_id is 254360 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea0003530 con 0x7f0ec00a0b20 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3664255367 0 0) 0x7f0ea0003530 con 0x7f0ec00a0b20 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 >> v1:172.21.15.171:6792/0 conn(0x7f0ec0137730 legacy=0x7f0ec0137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 >> v1:172.21.15.171:6789/0 conn(0x7f0ec0138220 legacy=0x7f0ec0140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 monclient: found mon.noname-b 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec00a4680 con 0x7f0ec00a0b20 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ea80017c0 con 0x7f0ec00a0b20 2024-04-26T00:10:57.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 5 monclient: authenticate success, global_id 254360 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: dump: 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.937 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0ea8001ab0 con 0x7f0ec00a0b20 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 1 -- 172.21.15.106:0/1574188068 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0ea8004bf0 con 0x7f0ec00a0b20 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 4 set_mon_vals no callback set 2024-04-26T00:10:57.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ebe7fc640 10 monclient: dump: 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.939 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: shutdown 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- 172.21.15.106:0/1574188068 >> v1:172.21.15.106:6790/0 conn(0x7f0ec00a0b20 legacy=0x7f0ec013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- 172.21.15.106:0/1574188068 shutdown_connections 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- 172.21.15.106:0/1574188068 >> 172.21.15.106:0/1574188068 conn(0x7f0ec00a6b80 msgr2=0x7f0ec00a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- 172.21.15.106:0/1574188068 shutdown_connections 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 1 -- 172.21.15.106:0/1574188068 wait complete. 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: build_initial_monmap 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.948+0000 7f0ec5750640 10 monclient: monmap: 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:57.940 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:57.941 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 Processor -- start 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 -- start start 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient: init 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient: _add_conns ranks=[4,7,8,1,0,3,2,6,5] 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient(hunting): picked mon.noname-c con 0x7f0ec00a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient(hunting): picked mon.noname-i con 0x7f0ec0137730 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient(hunting): picked mon.noname-e con 0x7f0ec0138220 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec01307d0 con 0x7f0ec00a0b20 2024-04-26T00:10:57.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec00a0880 con 0x7f0ec0137730 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ec0136460 con 0x7f0ec0138220 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient(hunting): authenticate will time out at 1913.480820s 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ebeffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f0ec00a0b20 0x7f0ec012f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45808/0 (socket says 172.21.15.106:45808) 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ebeffd640 1 -- 172.21.15.106:0/1196703031 learned_addr learned my addr 172.21.15.106:0/1196703031 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2486592726 0 0) 0x7f0ec01307d0 con 0x7f0ec00a0b20 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): my global_id is 274153 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ea4003530 con 0x7f0ec00a0b20 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3142189242 0 0) 0x7f0ec0136460 con 0x7f0ec0138220 2024-04-26T00:10:57.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): my global_id is 224945 2024-04-26T00:10:57.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ec01307d0 con 0x7f0ec0138220 2024-04-26T00:10:57.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485105912 0 0) 0x7f0ec00a0880 con 0x7f0ec0137730 2024-04-26T00:10:57.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): my global_id is 146473 2024-04-26T00:10:57.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ec0136460 con 0x7f0ec0137730 2024-04-26T00:10:57.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2002577593 0 0) 0x7f0ec01307d0 con 0x7f0ec0138220 2024-04-26T00:10:57.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ec00a0880 con 0x7f0ec0138220 2024-04-26T00:10:57.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2601331815 0 0) 0x7f0ea4003530 con 0x7f0ec00a0b20 2024-04-26T00:10:57.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ec01307d0 con 0x7f0ec00a0b20 2024-04-26T00:10:57.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0eb8001c40 con 0x7f0ec0138220 2024-04-26T00:10:57.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:10:57.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): dump: 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.947 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.948 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0eb0001a40 con 0x7f0ec00a0b20 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): dump: 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.949 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.950 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.951 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.951 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.951 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.951 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1958859794 0 0) 0x7f0ec00a0880 con 0x7f0ec0138220 2024-04-26T00:10:57.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.171:6792/0 conn(0x7f0ec0137730 legacy=0x7f0ec01300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.106:6791/0 conn(0x7f0ec00a0b20 legacy=0x7f0ec012f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 monclient: found mon.e 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ec01324d0 con 0x7f0ec0138220 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: _finish_auth 0 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 5 monclient: authenticate success, global_id 224945 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient: _renew_subs 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0ec0132a90 con 0x7f0ec0138220 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient: _renew_subs 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0ec009fdd0 con 0x7f0ec0138220 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0eb80039a0 con 0x7f0ec0138220 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0eb8003e90 con 0x7f0ec0138220 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ebdffb640 4 set_mon_vals no callback set 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: dump: 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.953 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.954 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e980065d0 con 0x7f0e98002870 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0eb8004030 con 0x7f0ec0138220 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f0eb8044170 con 0x7f0ec0138220 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1296625872 0 0) 0x7f0e980065d0 con 0x7f0e98002870 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient(hunting): my global_id is 254364 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ec00a0880 con 0x7f0e98002870 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1735540601 0 0) 0x7f0ec00a0880 con 0x7f0e98002870 2024-04-26T00:10:57.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e980065d0 con 0x7f0e98002870 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb67fc640 10 monclient: get_auth_request con 0x7f0ea4037f00 auth_method 0 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0eb0003f00 con 0x7f0e98002870 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: dump: 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.956 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 969443713 0 0) 0x7f0e980065d0 con 0x7f0e98002870 2024-04-26T00:10:57.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e9800a160 con 0x7f0e98002870 2024-04-26T00:10:57.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0eb0003f00 con 0x7f0e98002870 2024-04-26T00:10:57.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:57.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:57.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.106:6792/0 conn(0x7f0e98002870 legacy=0x7f0e98004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.952+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.106:6792/0 conn(0x7f0e98002870 legacy=0x7f0e98004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0e98009e30 con 0x7f0e980090f0 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3186587315 0 0) 0x7f0e98009e30 con 0x7f0e980090f0 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient(hunting): my global_id is 254373 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e980065d0 con 0x7f0e980090f0 2024-04-26T00:10:57.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2548625887 0 0) 0x7f0e980065d0 con 0x7f0e980090f0 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e98009e30 con 0x7f0e980090f0 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0eb0005b10 con 0x7f0e980090f0 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient: dump: 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:57.961 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 67361448 0 0) 0x7f0e98009e30 con 0x7f0e980090f0 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0e9800c3a0 con 0x7f0e980090f0 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 1671197814) 0x7f0eb0007080 con 0x7f0e980090f0 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:57.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.106:6792/0 conn(0x7f0e980090f0 legacy=0x7f0e98009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0eb7fff640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.106:6792/0 conn(0x7f0e980090f0 legacy=0x7f0e98009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 128021, 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:57.963 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.964 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.965 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.966 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:57.967 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:57.968 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.969 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.970 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:57.971 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:57.973 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.974 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.975 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.976 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.977 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.978 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.980 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.982 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:57.983 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.984 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.985 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:57.986 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:57.987 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:57.988 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:57.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.171:6812/722422047 conn(0x7f0ea4037f00 legacy=0x7f0ea403a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 10 monclient: shutdown 2024-04-26T00:10:57.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:57.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 >> v1:172.21.15.106:6793/0 conn(0x7f0ec0138220 legacy=0x7f0ec01d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:57.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ebf7fe640 1 -- 172.21.15.106:0/1196703031 reap_dead start 2024-04-26T00:10:57.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ebf7fe640 1 -- 172.21.15.106:0/1196703031 reap_dead start 2024-04-26T00:10:57.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 shutdown_connections 2024-04-26T00:10:57.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 >> 172.21.15.106:0/1196703031 conn(0x7f0ec00a6b80 msgr2=0x7f0ec012e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:57.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 shutdown_connections 2024-04-26T00:10:57.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:57.960+0000 7f0ec5750640 1 -- 172.21.15.106:0/1196703031 wait complete. 2024-04-26T00:10:57.990 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:57.990 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:10:57.991 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:10:58.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: get_monmap_and_config 2024-04-26T00:10:58.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: monmap: 2024-04-26T00:10:58.098 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.098 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.098 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:58.126490+0000 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:58.126490+0000 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.099 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 Processor -- start 2024-04-26T00:10:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- start start 2024-04-26T00:10:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: init 2024-04-26T00:10:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: _add_conns ranks=[1,8,3,6,0,7,2,5,4] 2024-04-26T00:10:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient(hunting): picked mon.noname-f con 0x7f4c000a1290 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:58.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient(hunting): picked mon.noname-e con 0x7f4c0009f770 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient(hunting): picked mon.noname-g con 0x7f4c0009fb70 addr v1:172.21.15.171:6790/0 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c000727a0 con 0x7f4c000a1290 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c000724c0 con 0x7f4c0009fb70 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c00072a80 con 0x7f4c0009f770 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient(hunting): authenticate will time out at 1913.653539s 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfeffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f4c0009f770 0x7f4c0013a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33382/0 (socket says 172.21.15.106:33382) 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfeffd640 1 -- 172.21.15.106:0/3114383867 learned_addr learned my addr 172.21.15.106:0/3114383867 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 412314043 0 0) 0x7f4c00072a80 con 0x7f4c0009f770 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient(hunting): my global_id is 224954 2024-04-26T00:10:58.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be8003530 con 0x7f4c0009f770 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2166587989 0 0) 0x7f4be8003530 con 0x7f4c0009f770 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 >> v1:172.21.15.171:6790/0 conn(0x7f4c0009fb70 legacy=0x7f4c0013de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 >> v1:172.21.15.171:6789/0 conn(0x7f4c000a1290 legacy=0x7f4c000a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 monclient: found mon.noname-e 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c0006bfc0 con 0x7f4c0009f770 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4bf40017c0 con 0x7f4c0009f770 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:10:58.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: dump: 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.110 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 5 monclient: authenticate success, global_id 224954 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4bf4001ab0 con 0x7f4c0009f770 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 4 set_mon_vals no callback set 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 1 -- 172.21.15.106:0/3114383867 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4bf4004bf0 con 0x7f4c0009f770 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4bfe7fc640 10 monclient: dump: 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.111 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: shutdown 2024-04-26T00:10:58.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- 172.21.15.106:0/3114383867 >> v1:172.21.15.106:6793/0 conn(0x7f4c0009f770 legacy=0x7f4c0013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- 172.21.15.106:0/3114383867 shutdown_connections 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- 172.21.15.106:0/3114383867 >> 172.21.15.106:0/3114383867 conn(0x7f4c0006b210 msgr2=0x7f4c0006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- 172.21.15.106:0/3114383867 shutdown_connections 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- 172.21.15.106:0/3114383867 wait complete. 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: monmap: 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.113 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 Processor -- start 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 1 -- start start 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.124+0000 7f4c05b58640 10 monclient: init 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient: _add_conns ranks=[6,3,7,8,5,0,4,2,1] 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient(hunting): picked mon.noname-d con 0x7f4c0009f770 addr v1:172.21.15.106:6792/0 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient(hunting): picked mon.noname-g con 0x7f4c0009fb70 addr v1:172.21.15.171:6790/0 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient(hunting): picked mon.noname-i con 0x7f4c000a1290 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0013c570 con 0x7f4c0009fb70 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c0013e860 con 0x7f4c0009f770 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4c001cb350 con 0x7f4c000a1290 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient(hunting): authenticate will time out at 1913.656322s 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4bff7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f4c0009f770 0x7f4c001ca530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41806/0 (socket says 172.21.15.106:41806) 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4bff7fe640 1 -- 172.21.15.106:0/4143502435 learned_addr learned my addr 172.21.15.106:0/4143502435 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956018486 0 0) 0x7f4c0013e860 con 0x7f4c0009f770 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): my global_id is 254382 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4bec003530 con 0x7f4c0009f770 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 668892533 0 0) 0x7f4bec003530 con 0x7f4c0009f770 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4c0013e860 con 0x7f4c0009f770 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4bf8001e00 con 0x7f4c0009f770 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): dump: 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.116 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3222749483 0 0) 0x7f4c0013e860 con 0x7f4c0009f770 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.171:6792/0 conn(0x7f4c000a1290 legacy=0x7f4c001d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.171:6790/0 conn(0x7f4c0009fb70 legacy=0x7f4c001cac40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 monclient: found mon.d 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c00071860 con 0x7f4c0009f770 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 5 monclient: authenticate success, global_id 254382 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient: _renew_subs 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4c000a1f00 con 0x7f4c0009f770 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient: _renew_subs 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4c00136160 con 0x7f4c0009f770 2024-04-26T00:10:58.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4bf8003c50 con 0x7f4c0009f770 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4bf80041c0 con 0x7f4c0009f770 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4bfdffb640 4 set_mon_vals no callback set 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: dump: 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.119 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4be00065d0 con 0x7f4be0002870 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f4bf80043e0 con 0x7f4c0009f770 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f4bf8045550 con 0x7f4c0009f770 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 144213401 0 0) 0x7f4be00065d0 con 0x7f4be0002870 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient(hunting): my global_id is 224963 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4c0013e860 con 0x7f4be0002870 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 41300610 0 0) 0x7f4c0013e860 con 0x7f4be0002870 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4be00065d0 con 0x7f4be0002870 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4bf4001780 con 0x7f4be0002870 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4bfffff640 10 monclient: get_auth_request con 0x7f4bec0377e0 auth_method 0 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: dump: 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.121 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2132058586 0 0) 0x7f4be00065d0 con 0x7f4be0002870 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4be000a160 con 0x7f4be0002870 2024-04-26T00:10:58.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4bf40047f0 con 0x7f4be0002870 2024-04-26T00:10:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.106:6793/0 conn(0x7f4be0002870 legacy=0x7f4be0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.128+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.106:6793/0 conn(0x7f4be0002870 legacy=0x7f4be0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:58.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4be0009e50 con 0x7f4be0009110 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1301502237 0 0) 0x7f4be0009e50 con 0x7f4be0009110 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient(hunting): my global_id is 224972 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be00065d0 con 0x7f4be0009110 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2190808331 0 0) 0x7f4be00065d0 con 0x7f4be0009110 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4be0009e50 con 0x7f4be0009110 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4bf4004b90 con 0x7f4be0009110 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient: dump: 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.125 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.126 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 958665220 0 0) 0x7f4be0009e50 con 0x7f4be0009110 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4be000c3e0 con 0x7f4be0009110 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 1166642129) 0x7f4bf40073e0 con 0x7f4be0009110 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.106:6793/0 conn(0x7f4be0009110 legacy=0x7f4be00095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4be7fff640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.106:6793/0 conn(0x7f4be0009110 legacy=0x7f4be00095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:58.127 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 371368, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:10:58.128 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.129 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:58.131 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.132 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.134 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:58.135 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.136 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.137 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.138 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.139 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.140 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:58.142 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.143 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.145 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:58.146 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:58.147 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.171:6812/722422047 conn(0x7f4bec0377e0 legacy=0x7f4bec039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 10 monclient: shutdown 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 >> v1:172.21.15.106:6792/0 conn(0x7f4c0009f770 legacy=0x7f4c001ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4bfffff640 1 -- 172.21.15.106:0/4143502435 reap_dead start 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4bfffff640 1 -- 172.21.15.106:0/4143502435 reap_dead start 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 shutdown_connections 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 >> 172.21.15.106:0/4143502435 conn(0x7f4c0006b210 msgr2=0x7f4c000a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 shutdown_connections 2024-04-26T00:10:58.148 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.136+0000 7f4c05b58640 1 -- 172.21.15.106:0/4143502435 wait complete. 2024-04-26T00:10:58.148 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:58.149 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:10:58.149 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:10:58.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: get_monmap_and_config 2024-04-26T00:10:58.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: monmap: 2024-04-26T00:10:58.262 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:58.290550+0000 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:58.290550+0000 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.263 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.264 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 Processor -- start 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- start start 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: init 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: _add_conns ranks=[2,8,6,3,7,1,4,5,0] 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient(hunting): picked mon.noname-b con 0x7f748406bd00 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient(hunting): picked mon.noname-e con 0x7f748406c7f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient(hunting): picked mon.noname-d con 0x7f74840715e0 addr v1:172.21.15.106:6792/0 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f748406e2e0 con 0x7f748406bd00 2024-04-26T00:10:58.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f748406ce30 con 0x7f74840715e0 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74840705f0 con 0x7f748406c7f0 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient(hunting): authenticate will time out at 1913.817700s 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7489db7640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f748406bd00 0x7f748406c0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44216/0 (socket says 172.21.15.106:44216) 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7489db7640 1 -- 172.21.15.106:0/1786550070 learned_addr learned my addr 172.21.15.106:0/1786550070 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f74895b6640 1 --1- 172.21.15.106:0/1786550070 >> v1:172.21.15.106:6793/0 conn(0x7f748406c7f0 0x7f7484141060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33414/0 (socket says 172.21.15.106:33414) 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103295456 0 0) 0x7f748406ce30 con 0x7f74840715e0 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): my global_id is 254391 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f746c003530 con 0x7f74840715e0 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3251528871 0 0) 0x7f748406e2e0 con 0x7f748406bd00 2024-04-26T00:10:58.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): my global_id is 254369 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f748406ce30 con 0x7f748406bd00 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322660822 0 0) 0x7f74840705f0 con 0x7f748406c7f0 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient(hunting): my global_id is 224981 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f748406e2e0 con 0x7f748406c7f0 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2434825145 0 0) 0x7f748406e2e0 con 0x7f748406c7f0 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 >> v1:172.21.15.106:6792/0 conn(0x7f74840715e0 legacy=0x7f7484144790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 >> v1:172.21.15.106:6790/0 conn(0x7f748406bd00 legacy=0x7f748406c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 monclient: found mon.noname-e 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7484072f90 con 0x7f748406c7f0 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7478001610 con 0x7f748406c7f0 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: dump: 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.275 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 5 monclient: authenticate success, global_id 224981 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:58.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7478001840 con 0x7f748406c7f0 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 4 set_mon_vals no callback set 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 1 -- 172.21.15.106:0/1786550070 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74780047f0 con 0x7f748406c7f0 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f7488db5640 10 monclient: dump: 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.277 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: shutdown 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- 172.21.15.106:0/1786550070 >> v1:172.21.15.106:6793/0 conn(0x7f748406c7f0 legacy=0x7f7484141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- 172.21.15.106:0/1786550070 shutdown_connections 2024-04-26T00:10:58.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- 172.21.15.106:0/1786550070 >> 172.21.15.106:0/1786550070 conn(0x7f748406b210 msgr2=0x7f748406b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- 172.21.15.106:0/1786550070 shutdown_connections 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 1 -- 172.21.15.106:0/1786550070 wait complete. 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.288+0000 7f748c01b640 10 monclient: monmap: 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.279 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 Processor -- start 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 -- start start 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient: init 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient: _add_conns ranks=[0,6,5,1,4,7,3,8,2] 2024-04-26T00:10:58.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient(hunting): picked mon.noname-a con 0x7f748406bd00 addr v1:172.21.15.106:6789/0 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient(hunting): picked mon.noname-d con 0x7f748406c7f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient(hunting): picked mon.noname-h con 0x7f74840715e0 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f748406d560 con 0x7f748406bd00 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74841424c0 con 0x7f74840715e0 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7484072c60 con 0x7f748406c7f0 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient(hunting): authenticate will time out at 1913.820651s 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f7489db7640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f748406bd00 0x7f7484144850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38082/0 (socket says 172.21.15.106:38082) 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f7489db7640 1 -- 172.21.15.106:0/1607817846 learned_addr learned my addr 172.21.15.106:0/1607817846 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3455277532 0 0) 0x7f7484072c60 con 0x7f748406c7f0 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): my global_id is 254400 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7470003530 con 0x7f748406c7f0 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721263396 0 0) 0x7f748406ce30 con 0x7f748406bd00 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): my global_id is 274140 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7484072c60 con 0x7f748406bd00 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3370049153 0 0) 0x7f7470003530 con 0x7f748406c7f0 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f748406ce30 con 0x7f748406c7f0 2024-04-26T00:10:58.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74780015d0 con 0x7f748406c7f0 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): dump: 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.283 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2769374505 0 0) 0x7f7484072c60 con 0x7f748406bd00 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7470003530 con 0x7f748406bd00 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f747c001de0 con 0x7f748406bd00 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): dump: 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.284 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3552531219 0 0) 0x7f748406ce30 con 0x7f748406c7f0 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.171:6791/0 conn(0x7f74840715e0 legacy=0x7f74841d87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.106:6789/0 conn(0x7f748406bd00 legacy=0x7f7484144850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 monclient: found mon.d 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74841404b0 con 0x7f748406c7f0 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 5 monclient: authenticate success, global_id 254400 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient: _renew_subs 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:10:58.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f748413f890 con 0x7f748406c7f0 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient: _renew_subs 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7484141f00 con 0x7f748406c7f0 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7478001840 con 0x7f748406c7f0 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f74780050f0 con 0x7f748406c7f0 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f7483fff640 4 set_mon_vals no callback set 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: dump: 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.287 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f74640065d0 con 0x7f7464002870 2024-04-26T00:10:58.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f747800fe90 con 0x7f748406c7f0 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f74780452a0 con 0x7f748406c7f0 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f748a5b8640 10 monclient: get_auth_request con 0x7f7470037d40 auth_method 0 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923415651 0 0) 0x7f74640065d0 con 0x7f7464002870 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient(hunting): my global_id is 225055 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f748406ce30 con 0x7f7464002870 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2310812185 0 0) 0x7f748406ce30 con 0x7f7464002870 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74640065d0 con 0x7f7464002870 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f747c0051a0 con 0x7f7464002870 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 10 monclient: dump: 2024-04-26T00:10:58.289 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.290 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1361310734 0 0) 0x7f74640065d0 con 0x7f7464002870 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.292+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f746400a160 con 0x7f7464002870 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.296+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f747c005450 con 0x7f7464002870 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.296+0000 7f74827fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.296+0000 7f74827fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.296+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.171:6789/0 conn(0x7f7464002870 legacy=0x7f7464004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.296+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.171:6789/0 conn(0x7f7464002870 legacy=0x7f7464004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.292 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f748c01b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7464009e30 con 0x7f74640090f0 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2910827968 0 0) 0x7f7464009e30 con 0x7f74640090f0 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 10 monclient(hunting): my global_id is 225064 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74640065d0 con 0x7f74640090f0 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1253342607 0 0) 0x7f74640065d0 con 0x7f74640090f0 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7464009e30 con 0x7f74640090f0 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f747c005940 con 0x7f74640090f0 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:10:58.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.300+0000 7f74827fc640 10 monclient: dump: 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.294 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2914225030 0 0) 0x7f7464009e30 con 0x7f74640090f0 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f746400c3a0 con 0x7f74640090f0 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 3837397920) 0x7f747c006340 con 0x7f74640090f0 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f74827fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f74827fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.171:6789/0 conn(0x7f74640090f0 legacy=0x7f7464009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f74827fc640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.171:6789/0 conn(0x7f74640090f0 legacy=0x7f7464009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:58.295 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 371536, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:58.296 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.297 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.298 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:58.299 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.300 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.301 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:58.303 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.304 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.305 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.306 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.307 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:58.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.310 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.312 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.313 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.314 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.314 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:58.314 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:58.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.171:6812/722422047 conn(0x7f7470037d40 legacy=0x7f747003a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 10 monclient: shutdown 2024-04-26T00:10:58.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 >> v1:172.21.15.106:6792/0 conn(0x7f748406c7f0 legacy=0x7f74841d50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748a5b8640 1 -- 172.21.15.106:0/1607817846 reap_dead start 2024-04-26T00:10:58.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748a5b8640 1 -- 172.21.15.106:0/1607817846 reap_dead start 2024-04-26T00:10:58.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 shutdown_connections 2024-04-26T00:10:58.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 >> 172.21.15.106:0/1607817846 conn(0x7f748406b210 msgr2=0x7f7484067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 shutdown_connections 2024-04-26T00:10:58.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.304+0000 7f748c01b640 1 -- 172.21.15.106:0/1607817846 wait complete. 2024-04-26T00:10:58.316 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:58.316 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:10:58.316 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:10:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient: get_monmap_and_config 2024-04-26T00:10:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient: monmap: 2024-04-26T00:10:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:58.456555+0000 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:58.456555+0000 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 1 Processor -- start 2024-04-26T00:10:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 1 -- start start 2024-04-26T00:10:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient: init 2024-04-26T00:10:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient: _add_conns ranks=[2,8,6,0,5,7,1,3,4] 2024-04-26T00:10:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient(hunting): picked mon.noname-b con 0x7f3758137c40 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:58.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient(hunting): picked mon.noname-e con 0x7f375809fca0 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient(hunting): picked mon.noname-d con 0x7f3758137570 addr v1:172.21.15.106:6792/0 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375806ee10 con 0x7f3758137c40 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37580a2220 con 0x7f3758137570 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f375806f0f0 con 0x7f375809fca0 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375cf94640 10 monclient(hunting): authenticate will time out at 1913.983746s 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375659c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f3758137c40 0x7f37580a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44228/0 (socket says 172.21.15.106:44228) 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.452+0000 7f375659c640 1 -- 172.21.15.106:0/3899292435 learned_addr learned my addr 172.21.15.106:0/3899292435 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3650132421 0 0) 0x7f3740001120 con 0x7f3758137c40 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): my global_id is 254378 2024-04-26T00:10:58.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3744003530 con 0x7f3758137c40 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526361165 0 0) 0x7f37580a2220 con 0x7f3758137570 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): my global_id is 254409 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3740001120 con 0x7f3758137570 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834303118 0 0) 0x7f375806f0f0 con 0x7f375809fca0 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient(hunting): my global_id is 224990 2024-04-26T00:10:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f37580a2220 con 0x7f375809fca0 2024-04-26T00:10:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1001190029 0 0) 0x7f3744003530 con 0x7f3758137c40 2024-04-26T00:10:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 >> v1:172.21.15.106:6793/0 conn(0x7f375809fca0 legacy=0x7f37580a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 >> v1:172.21.15.106:6792/0 conn(0x7f3758137570 legacy=0x7f37581408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 monclient: found mon.noname-b 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f375806f3d0 con 0x7f3758137c40 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3740001990 con 0x7f3758137c40 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 5 monclient: authenticate success, global_id 254378 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: dump: 2024-04-26T00:10:58.441 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.442 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3740001bc0 con 0x7f3758137c40 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 4 set_mon_vals no callback set 2024-04-26T00:10:58.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 1 -- 172.21.15.106:0/3899292435 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3740004bf0 con 0x7f3758137c40 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375559a640 10 monclient: dump: 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.444 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: shutdown 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- 172.21.15.106:0/3899292435 >> v1:172.21.15.106:6790/0 conn(0x7f3758137c40 legacy=0x7f37580a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- 172.21.15.106:0/3899292435 shutdown_connections 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- 172.21.15.106:0/3899292435 >> 172.21.15.106:0/3899292435 conn(0x7f37580a64e0 msgr2=0x7f37580a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- 172.21.15.106:0/3899292435 shutdown_connections 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- 172.21.15.106:0/3899292435 wait complete. 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: monmap: 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.446 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 Processor -- start 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- start start 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: init 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: _add_conns ranks=[4,5,1,2,7,6,0,3,8] 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient(hunting): picked mon.noname-c con 0x7f375809fca0 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient(hunting): picked mon.noname-h con 0x7f3758137570 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:58.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient(hunting): picked mon.noname-f con 0x7f3758137c40 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37581206a0 con 0x7f3758137c40 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3758122990 con 0x7f375809fca0 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3758121200 con 0x7f3758137570 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient(hunting): authenticate will time out at 1913.986864s 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375659c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f375809fca0 0x7f37581cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45818/0 (socket says 172.21.15.106:45818) 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375659c640 1 -- 172.21.15.106:0/3561407010 learned_addr learned my addr 172.21.15.106:0/3561407010 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049534540 0 0) 0x7f3758122990 con 0x7f375809fca0 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): my global_id is 274162 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3738003530 con 0x7f375809fca0 2024-04-26T00:10:58.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3904724932 0 0) 0x7f3738003530 con 0x7f375809fca0 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3758122990 con 0x7f375809fca0 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3740004b30 con 0x7f375809fca0 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): dump: 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.449 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4091999258 0 0) 0x7f3758122990 con 0x7f375809fca0 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.171:6791/0 conn(0x7f3758137570 legacy=0x7f37581d15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.171:6789/0 conn(0x7f3758137c40 legacy=0x7f37581d4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 monclient: found mon.c 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3758072970 con 0x7f375809fca0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 5 monclient: authenticate success, global_id 274162 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: _renew_subs 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f37581226b0 con 0x7f375809fca0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: _renew_subs 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f3758123370 con 0x7f375809fca0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3740001bc0 con 0x7f375809fca0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37400051a0 con 0x7f375809fca0 2024-04-26T00:10:58.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f3754d99640 4 set_mon_vals no callback set 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.456+0000 7f374effd640 10 monclient: dump: 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.452 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f375cf94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f373c0065d0 con 0x7f373c002870 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f374000ff40 con 0x7f375809fca0 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f3740045300 con 0x7f375809fca0 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f3756d9d640 10 monclient: get_auth_request con 0x7f3738037820 auth_method 0 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577770962 0 0) 0x7f373c0065d0 con 0x7f373c002870 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient(hunting): my global_id is 215184 2024-04-26T00:10:58.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3758122990 con 0x7f373c002870 2024-04-26T00:10:58.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3773847517 0 0) 0x7f3758122990 con 0x7f373c002870 2024-04-26T00:10:58.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f373c0065d0 con 0x7f373c002870 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f37480017a0 con 0x7f373c002870 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient: dump: 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.455 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1736549058 0 0) 0x7f373c0065d0 con 0x7f373c002870 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f373c00a160 con 0x7f373c002870 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3748001bc0 con 0x7f373c002870 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.171:6790/0 conn(0x7f373c002870 legacy=0x7f373c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.460+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.171:6790/0 conn(0x7f373c002870 legacy=0x7f373c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f375cf94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f373c009e50 con 0x7f373c009110 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2985907907 0 0) 0x7f373c009e50 con 0x7f373c009110 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient(hunting): my global_id is 215193 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f373c0065d0 con 0x7f373c009110 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1335934578 0 0) 0x7f373c0065d0 con 0x7f373c009110 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f373c009e50 con 0x7f373c009110 2024-04-26T00:10:58.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3748003c50 con 0x7f373c009110 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient: dump: 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.459 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1468471122 0 0) 0x7f373c009e50 con 0x7f373c009110 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f373c00c3e0 con 0x7f373c009110 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7906 (unknown 0 0 2224663723) 0x7f3748003eb0 con 0x7f373c009110 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.171:6790/0 conn(0x7f373c009110 legacy=0x7f373c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.468+0000 7f374effd640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.171:6790/0 conn(0x7f373c009110 legacy=0x7f373c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 488891, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:58.461 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.462 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.463 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.464 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.465 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:58.466 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.468 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:58.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.472 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.473 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.476 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:58.477 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:58.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:58.479 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.171:6812/722422047 conn(0x7f3738037820 legacy=0x7f3738039ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 10 monclient: shutdown 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 >> v1:172.21.15.106:6791/0 conn(0x7f375809fca0 legacy=0x7f37581cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f3756d9d640 1 -- 172.21.15.106:0/3561407010 reap_dead start 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f3756d9d640 1 -- 172.21.15.106:0/3561407010 reap_dead start 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 shutdown_connections 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 >> 172.21.15.106:0/3561407010 conn(0x7f37580a64e0 msgr2=0x7f3758070d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 shutdown_connections 2024-04-26T00:10:58.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.472+0000 7f375cf94640 1 -- 172.21.15.106:0/3561407010 wait complete. 2024-04-26T00:10:58.482 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:58.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:10:58.482 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: get_monmap_and_config 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: monmap: 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:58.619807+0000 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:58.619807+0000 2024-04-26T00:10:58.600 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.601 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 1 Processor -- start 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 1 -- start start 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: init 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: _add_conns ranks=[1,4,7,0,6,5,8,2,3] 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient(hunting): picked mon.noname-f con 0x7f969c134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient(hunting): picked mon.noname-c con 0x7f969c0a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient(hunting): picked mon.noname-i con 0x7f969c13e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c06dd40 con 0x7f969c134970 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c0a2b10 con 0x7f969c0a4820 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c0a2df0 con 0x7f969c13e200 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient(hunting): authenticate will time out at 1914.146613s 2024-04-26T00:10:58.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a191b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f969c0a4820 0x7f969c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45834/0 (socket says 172.21.15.106:45834) 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a191b640 1 -- 172.21.15.106:0/3174745491 learned_addr learned my addr 172.21.15.106:0/3174745491 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738605874 0 0) 0x7f969c0a2b10 con 0x7f969c0a4820 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient(hunting): my global_id is 274171 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9688003530 con 0x7f969c0a4820 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3586794259 0 0) 0x7f9688003530 con 0x7f969c0a4820 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 >> v1:172.21.15.171:6792/0 conn(0x7f969c13e200 legacy=0x7f969c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 >> v1:172.21.15.171:6789/0 conn(0x7f969c134970 legacy=0x7f969c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 monclient: found mon.noname-c 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:10:58.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c0a30d0 con 0x7f969c0a4820 2024-04-26T00:10:58.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f968c0017c0 con 0x7f969c0a4820 2024-04-26T00:10:58.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:10:58.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: dump: 2024-04-26T00:10:58.605 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.605 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.605 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.605 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.605 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.605 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.606 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.606 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.606 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.606 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.606 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.607 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.607 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.607 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.607 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.607 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 5 monclient: authenticate success, global_id 274171 2024-04-26T00:10:58.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:58.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f968c001ab0 con 0x7f969c0a4820 2024-04-26T00:10:58.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:58.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 4 set_mon_vals no callback set 2024-04-26T00:10:58.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 1 -- 172.21.15.106:0/3174745491 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f968c004bf0 con 0x7f969c0a4820 2024-04-26T00:10:58.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a111a640 10 monclient: dump: 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.609 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.610 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.610 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.610 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.610 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.610 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.610 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.611 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.611 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 10 monclient: shutdown 2024-04-26T00:10:58.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.616+0000 7f96a4380640 1 -- 172.21.15.106:0/3174745491 >> v1:172.21.15.106:6791/0 conn(0x7f969c0a4820 legacy=0x7f969c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- 172.21.15.106:0/3174745491 shutdown_connections 2024-04-26T00:10:58.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- 172.21.15.106:0/3174745491 >> 172.21.15.106:0/3174745491 conn(0x7f969c0a9e20 msgr2=0x7f969c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- 172.21.15.106:0/3174745491 shutdown_connections 2024-04-26T00:10:58.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- 172.21.15.106:0/3174745491 wait complete. 2024-04-26T00:10:58.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: monmap: 2024-04-26T00:10:58.615 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.615 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:58.615 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:58.615 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:58.615 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.615 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.616 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.616 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.616 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.616 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.616 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.616 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 Processor -- start 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- start start 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: init 2024-04-26T00:10:58.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: _add_conns ranks=[4,0,7,5,2,6,8,1,3] 2024-04-26T00:10:58.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient(hunting): picked mon.noname-c con 0x7f969c0a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:58.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient(hunting): picked mon.noname-a con 0x7f969c134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:10:58.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient(hunting): picked mon.noname-i con 0x7f969c13e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:58.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c09e3e0 con 0x7f969c134970 2024-04-26T00:10:58.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c09c870 con 0x7f969c0a4820 2024-04-26T00:10:58.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f969c0a1e00 con 0x7f969c13e200 2024-04-26T00:10:58.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient(hunting): authenticate will time out at 1914.149484s 2024-04-26T00:10:58.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a191b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f969c134970 0x7f969c1d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38098/0 (socket says 172.21.15.106:38098) 2024-04-26T00:10:58.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a191b640 1 -- 172.21.15.106:0/125049569 learned_addr learned my addr 172.21.15.106:0/125049569 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1899589540 0 0) 0x7f969c09e3e0 con 0x7f969c134970 2024-04-26T00:10:58.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): my global_id is 274149 2024-04-26T00:10:58.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9680003530 con 0x7f969c134970 2024-04-26T00:10:58.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 171235742 0 0) 0x7f969c09c870 con 0x7f969c0a4820 2024-04-26T00:10:58.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): my global_id is 274180 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f969c09e3e0 con 0x7f969c0a4820 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 925593146 0 0) 0x7f9680003530 con 0x7f969c134970 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f969c09c870 con 0x7f969c134970 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f968c001780 con 0x7f969c134970 2024-04-26T00:10:58.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:10:58.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): dump: 2024-04-26T00:10:58.622 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.622 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.622 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.622 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.622 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.623 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.623 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.623 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.623 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.623 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.623 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.623 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.624 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.624 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.624 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.624 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:58.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960371665 0 0) 0x7f969c0a1e00 con 0x7f969c13e200 2024-04-26T00:10:58.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): my global_id is 146500 2024-04-26T00:10:58.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9680003530 con 0x7f969c13e200 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2768021945 0 0) 0x7f969c09e3e0 con 0x7f969c0a4820 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f969c0a1e00 con 0x7f969c0a4820 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f96980019e0 con 0x7f969c0a4820 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient(hunting): dump: 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.626 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.627 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1716942569 0 0) 0x7f969c09c870 con 0x7f969c134970 2024-04-26T00:10:58.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.171:6792/0 conn(0x7f969c13e200 legacy=0x7f969c1d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.106:6791/0 conn(0x7f969c0a4820 legacy=0x7f969c09fe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 monclient: found mon.a 2024-04-26T00:10:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:10:58.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f969c0a1a40 con 0x7f969c134970 2024-04-26T00:10:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 5 monclient: authenticate success, global_id 274149 2024-04-26T00:10:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: _renew_subs 2024-04-26T00:10:58.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:10:58.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f969c1ccb10 con 0x7f969c134970 2024-04-26T00:10:58.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: _renew_subs 2024-04-26T00:10:58.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:10:58.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f969c0a0530 con 0x7f969c134970 2024-04-26T00:10:58.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f968c004b50 con 0x7f969c134970 2024-04-26T00:10:58.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f968c0051b0 con 0x7f969c134970 2024-04-26T00:10:58.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a0919640 4 set_mon_vals no callback set 2024-04-26T00:10:58.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:10:58.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 10 monclient: dump: 2024-04-26T00:10:58.632 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.632 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.633 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.633 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.633 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.633 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.633 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.633 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.634 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.634 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.634 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.634 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.634 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.634 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f96840065d0 con 0x7f9684002870 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f968c00ff50 con 0x7f969c134970 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f968c045330 con 0x7f969c134970 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.620+0000 7f96a291d640 10 monclient: get_auth_request con 0x7f9680037f40 auth_method 0 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112955102 0 0) 0x7f96840065d0 con 0x7f9684002870 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient(hunting): my global_id is 254381 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f969c09c870 con 0x7f9684002870 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 762846650 0 0) 0x7f969c09c870 con 0x7f9684002870 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96840065d0 con 0x7f9684002870 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9698003960 con 0x7f9684002870 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient: dump: 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.636 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3496577023 0 0) 0x7f96840065d0 con 0x7f9684002870 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f968400a160 con 0x7f9684002870 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9698003cf0 con 0x7f9684002870 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:58.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.171:6791/0 conn(0x7f9684002870 legacy=0x7f9684004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.624+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.171:6791/0 conn(0x7f9684002870 legacy=0x7f9684004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.628+0000 7f96a4380640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.628+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9684009e50 con 0x7f9684009110 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 385224536 0 0) 0x7f9684009e50 con 0x7f9684009110 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient(hunting): my global_id is 254390 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96840065d0 con 0x7f9684009110 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3000686684 0 0) 0x7f96840065d0 con 0x7f9684009110 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9684009e50 con 0x7f9684009110 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9698004450 con 0x7f9684009110 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:10:58.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient: dump: 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.641 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1797708819 0 0) 0x7f9684009e50 con 0x7f9684009110 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f968400c3e0 con 0x7f9684009110 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 759449493) 0x7f9698004750 con 0x7f9684009110 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.171:6791/0 conn(0x7f9684009110 legacy=0x7f96840095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f9692ffd640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.171:6791/0 conn(0x7f9684009110 legacy=0x7f96840095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.642 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 128685, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:58.643 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.644 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.645 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.646 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.646 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.646 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.646 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.646 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.647 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.647 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.647 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:58.647 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:58.647 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:58.648 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:58.648 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:58.648 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:58.648 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.648 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.648 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:58.649 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:58.649 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:58.649 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:58.649 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:58.649 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:58.650 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:58.650 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.650 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:58.650 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.650 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.650 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.651 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:58.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.652 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:58.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.652 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:58.652 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:58.652 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.653 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.653 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.653 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:58.653 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.653 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.654 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.654 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.654 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.654 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.654 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.655 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.655 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.655 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.655 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.655 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:58.655 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.656 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.657 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.657 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.657 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.657 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.657 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.657 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.657 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.658 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.659 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.660 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.661 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.662 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.663 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:58.664 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.665 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.666 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.667 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.668 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.668 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.668 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:58.668 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:58.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.171:6812/722422047 conn(0x7f9680037f40 legacy=0x7f968003a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 10 monclient: shutdown 2024-04-26T00:10:58.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.669 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 >> v1:172.21.15.106:6789/0 conn(0x7f969c134970 legacy=0x7f969c1d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a291d640 1 -- 172.21.15.106:0/125049569 reap_dead start 2024-04-26T00:10:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a291d640 1 -- 172.21.15.106:0/125049569 reap_dead start 2024-04-26T00:10:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 shutdown_connections 2024-04-26T00:10:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 >> 172.21.15.106:0/125049569 conn(0x7f969c0a9e20 msgr2=0x7f969c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 shutdown_connections 2024-04-26T00:10:58.670 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.632+0000 7f96a4380640 1 -- 172.21.15.106:0/125049569 wait complete. 2024-04-26T00:10:58.670 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:58.670 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:10:58.670 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:10:58.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.800+0000 7f93161be640 10 monclient: get_monmap_and_config 2024-04-26T00:10:58.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.800+0000 7f93161be640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: monmap: 2024-04-26T00:10:58.779 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.779 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.779 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:58.806356+0000 2024-04-26T00:10:58.779 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:58.806356+0000 2024-04-26T00:10:58.779 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 Processor -- start 2024-04-26T00:10:58.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- start start 2024-04-26T00:10:58.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: init 2024-04-26T00:10:58.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: _add_conns ranks=[4,7,8,1,6,0,3,2,5] 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient(hunting): picked mon.noname-c con 0x7f9310137c40 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient(hunting): picked mon.noname-i con 0x7f931009fca0 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient(hunting): picked mon.noname-e con 0x7f9310137570 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931006ee10 con 0x7f9310137c40 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93100a2220 con 0x7f931009fca0 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931006f0f0 con 0x7f9310137570 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient(hunting): authenticate will time out at 1914.333518s 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930ffff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f9310137570 0x7f93101408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33430/0 (socket says 172.21.15.106:33430) 2024-04-26T00:10:58.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930ffff640 1 -- 172.21.15.106:0/2255666604 learned_addr learned my addr 172.21.15.106:0/2255666604 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930f7fe640 1 --1- 172.21.15.106:0/2255666604 >> v1:172.21.15.106:6791/0 conn(0x7f9310137c40 0x7f93100a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45858/0 (socket says 172.21.15.106:45858) 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3682670640 0 0) 0x7f931006f0f0 con 0x7f9310137570 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): my global_id is 224999 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92fc003530 con 0x7f9310137570 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 651311074 0 0) 0x7f93000014a0 con 0x7f9310137c40 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient(hunting): my global_id is 274189 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f931006f0f0 con 0x7f9310137c40 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4195498545 0 0) 0x7f92fc003530 con 0x7f9310137570 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 >> v1:172.21.15.171:6792/0 conn(0x7f931009fca0 legacy=0x7f93100a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 >> v1:172.21.15.106:6791/0 conn(0x7f9310137c40 legacy=0x7f93100a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 monclient: found mon.noname-e 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931006f3d0 con 0x7f9310137570 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93080017c0 con 0x7f9310137570 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: dump: 2024-04-26T00:10:58.793 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.794 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 5 monclient: authenticate success, global_id 224999 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9308001a30 con 0x7f9310137570 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 4 set_mon_vals no callback set 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 1 -- 172.21.15.106:0/2255666604 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9308004bf0 con 0x7f9310137570 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f930e7fc640 10 monclient: dump: 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.795 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: shutdown 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- 172.21.15.106:0/2255666604 >> v1:172.21.15.106:6793/0 conn(0x7f9310137570 legacy=0x7f93101408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- 172.21.15.106:0/2255666604 shutdown_connections 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- 172.21.15.106:0/2255666604 >> 172.21.15.106:0/2255666604 conn(0x7f93100a64e0 msgr2=0x7f93100a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- 172.21.15.106:0/2255666604 shutdown_connections 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- 172.21.15.106:0/2255666604 wait complete. 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: monmap: 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.797 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.798 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.798 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.798 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.798 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.798 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.798 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.798 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 Processor -- start 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 1 -- start start 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.804+0000 7f93161be640 10 monclient: init 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient: _add_conns ranks=[8,5,2,1,0,6,7,3,4] 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient(hunting): picked mon.noname-e con 0x7f931009fca0 addr v1:172.21.15.106:6793/0 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient(hunting): picked mon.noname-h con 0x7f9310137570 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient(hunting): picked mon.noname-b con 0x7f9310137c40 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931011e690 con 0x7f9310137c40 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931011d170 con 0x7f9310137570 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9310136fd0 con 0x7f931009fca0 2024-04-26T00:10:58.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient(hunting): authenticate will time out at 1914.336473s 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f930ffff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f9310137c40 0x7f93101d4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44240/0 (socket says 172.21.15.106:44240) 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f930ffff640 1 -- 172.21.15.106:0/1601843698 learned_addr learned my addr 172.21.15.106:0/1601843698 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3387153216 0 0) 0x7f9310136fd0 con 0x7f931009fca0 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): my global_id is 225008 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f0003530 con 0x7f931009fca0 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3479081315 0 0) 0x7f931011e690 con 0x7f9310137c40 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): my global_id is 254387 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9310136fd0 con 0x7f9310137c40 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2863551314 0 0) 0x7f92f0003530 con 0x7f931009fca0 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f931011e690 con 0x7f931009fca0 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3664825349 0 0) 0x7f9310136fd0 con 0x7f9310137c40 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92f0003530 con 0x7f9310137c40 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9300001f30 con 0x7f931009fca0 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): dump: 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.801 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.802 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:58.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9308004b30 con 0x7f9310137c40 2024-04-26T00:10:58.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:58.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): dump: 2024-04-26T00:10:58.803 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.803 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.804 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 953664352 0 0) 0x7f931011e690 con 0x7f931009fca0 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.171:6791/0 conn(0x7f9310137570 legacy=0x7f93101d1830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.106:6790/0 conn(0x7f9310137c40 legacy=0x7f93101d4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 monclient: found mon.e 2024-04-26T00:10:58.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9310072970 con 0x7f931009fca0 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 5 monclient: authenticate success, global_id 225008 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient: _renew_subs 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f93100724d0 con 0x7f931009fca0 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient: _renew_subs 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:10:58.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f931011e3b0 con 0x7f931009fca0 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f93000014b0 con 0x7f931009fca0 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9300005160 con 0x7f931009fca0 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f930dffb640 4 set_mon_vals no callback set 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: dump: 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.807 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9300005300 con 0x7f931009fca0 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f9300045320 con 0x7f931009fca0 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f930ffff640 10 monclient: get_auth_request con 0x7f92f0037d10 auth_method 0 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941172904 0 0) 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient(hunting): my global_id is 146518 2024-04-26T00:10:58.809 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f931011e690 con 0x7f92f4002870 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 498290645 0 0) 0x7f931011e690 con 0x7f92f4002870 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f92f8001900 con 0x7f92f4002870 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 10 monclient: dump: 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.810 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3986626826 0 0) 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.808+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92f400a160 con 0x7f92f4002870 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.812+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f92f8004650 con 0x7f92f4002870 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.812+0000 7f9307fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.811 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.812+0000 7f9307fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.812+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.171:6792/0 conn(0x7f92f4002870 legacy=0x7f92f4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.812 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.812+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.171:6792/0 conn(0x7f92f4002870 legacy=0x7f92f4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f93161be640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1410630215 0 0) 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 10 monclient(hunting): my global_id is 146527 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f40065d0 con 0x7f92f40090f0 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3693319920 0 0) 0x7f92f40065d0 con 0x7f92f40090f0 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f92f8003c30 con 0x7f92f40090f0 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.813 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:10:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 10 monclient: dump: 2024-04-26T00:10:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.814 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2554910414 0 0) 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.816+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f92f400c3a0 con 0x7f92f40090f0 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 555831656) 0x7f92f8003c30 con 0x7f92f40090f0 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f9307fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:10:58.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f9307fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:58.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.171:6792/0 conn(0x7f92f40090f0 legacy=0x7f92f4009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.816 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f9307fff640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.171:6792/0 conn(0x7f92f40090f0 legacy=0x7f92f4009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:10:58.817 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:10:58.817 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:58.817 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:58.817 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 722349, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:10:58.818 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.819 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.820 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.820 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.820 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.820 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.820 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.820 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.821 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.821 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.821 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.821 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:10:58.821 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:10:58.821 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.821 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.822 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.822 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.822 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.822 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.822 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.822 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.823 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:10:58.824 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:10:58.824 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:10:58.824 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:10:58.824 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:10:58.824 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:10:58.824 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.824 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:10:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:10:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:10:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:10:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:10:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:10:58.825 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:10:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:10:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:10:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:10:58.826 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:10:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:10:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:10:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:10:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:10:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:10:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:10:58.827 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:10:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:10:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:10:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:10:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:10:58.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:10:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:10:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:10:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:10:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.830 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.831 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:10:58.831 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.831 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.831 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:10:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:10:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.832 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:10:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.833 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:10:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.834 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:10:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:10:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.835 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:10:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.836 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:10:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.837 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:10:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:10:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.838 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:10:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.839 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:10:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.840 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:10:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:10:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.841 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:10:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.842 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:10:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.843 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:10:58.844 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.845 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.846 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.847 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.848 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:10:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.849 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:10:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:10:58.850 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:10:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:10:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:10:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:10:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:10:58.851 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:10:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:10:58.852 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.853 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:10:58.854 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.171:6812/722422047 conn(0x7f92f0037d10 legacy=0x7f92f003a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 10 monclient: shutdown 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 >> v1:172.21.15.106:6793/0 conn(0x7f931009fca0 legacy=0x7f931012f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f930ffff640 1 -- 172.21.15.106:0/1601843698 reap_dead start 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f930ffff640 1 -- 172.21.15.106:0/1601843698 reap_dead start 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 shutdown_connections 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 >> 172.21.15.106:0/1601843698 conn(0x7f93100a64e0 msgr2=0x7f93101338a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 shutdown_connections 2024-04-26T00:10:58.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.820+0000 7f93161be640 1 -- 172.21.15.106:0/1601843698 wait complete. 2024-04-26T00:10:58.857 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:10:58.857 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:10:58.857 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:10:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.996+0000 7f7cdaacd640 10 monclient: get_monmap_and_config 2024-04-26T00:10:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.996+0000 7f7cdaacd640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:58.996+0000 7f7cdaacd640 10 monclient: monmap: 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:10:59.001454+0000 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:10:59.001454+0000 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.974 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.975 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.975 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.975 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.975 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 Processor -- start 2024-04-26T00:10:58.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- start start 2024-04-26T00:10:58.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: init 2024-04-26T00:10:58.981 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: _add_conns ranks=[6,4,1,7,8,3,2,0,5] 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): picked mon.noname-d con 0x7f7cd4134760 addr v1:172.21.15.106:6792/0 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): picked mon.noname-c con 0x7f7cd40a0d70 addr v1:172.21.15.106:6791/0 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): picked mon.noname-f con 0x7f7cd413df70 addr v1:172.21.15.171:6789/0 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd406b910 con 0x7f7cd413df70 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd409fac0 con 0x7f7cd40a0d70 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd40a0080 con 0x7f7cd4134760 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): authenticate will time out at 1914.529119s 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd8869640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f7cd4134760 0x7f7cd4134b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41828/0 (socket says 172.21.15.106:41828) 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd8869640 1 -- 172.21.15.106:0/2925814361 learned_addr learned my addr 172.21.15.106:0/2925814361 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3854194598 0 0) 0x7f7cd40a0080 con 0x7f7cd4134760 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): my global_id is 254418 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cc4003530 con 0x7f7cd4134760 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832632943 0 0) 0x7f7cd409fac0 con 0x7f7cd40a0d70 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient(hunting): my global_id is 274198 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cd40a0080 con 0x7f7cd40a0d70 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1022325424 0 0) 0x7f7cc4003530 con 0x7f7cd4134760 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 >> v1:172.21.15.106:6791/0 conn(0x7f7cd40a0d70 legacy=0x7f7cd413c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 >> v1:172.21.15.171:6789/0 conn(0x7f7cd413df70 legacy=0x7f7cd4140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 monclient: found mon.noname-d 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd409f280 con 0x7f7cd4134760 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cc80017c0 con 0x7f7cd4134760 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: dump: 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.984 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 5 monclient: authenticate success, global_id 254418 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cc8001aa0 con 0x7f7cd4134760 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: get_monmap_and_config success 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 4 set_mon_vals no callback set 2024-04-26T00:10:58.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 1 -- 172.21.15.106:0/2925814361 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cc8004bf0 con 0x7f7cd4134760 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd37fe640 10 monclient: dump: 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.986 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: shutdown 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- 172.21.15.106:0/2925814361 >> v1:172.21.15.106:6792/0 conn(0x7f7cd4134760 legacy=0x7f7cd4134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- 172.21.15.106:0/2925814361 shutdown_connections 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- 172.21.15.106:0/2925814361 >> 172.21.15.106:0/2925814361 conn(0x7f7cd40a7240 msgr2=0x7f7cd40a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- 172.21.15.106:0/2925814361 shutdown_connections 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- 172.21.15.106:0/2925814361 wait complete. 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: build_initial_monmap 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: monmap: 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:10:58.987 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 Processor -- start 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- start start 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: init 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: _reopen_session rank -1 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient: _add_conns ranks=[7,2,5,6,3,8,0,1,4] 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): picked mon.noname-i con 0x7f7cd40a0d70 addr v1:172.21.15.171:6792/0 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): picked mon.noname-b con 0x7f7cd4134760 addr v1:172.21.15.106:6790/0 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): picked mon.noname-h con 0x7f7cd413df70 addr v1:172.21.15.171:6791/0 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4139b40 con 0x7f7cd4134760 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4072930 con 0x7f7cd413df70 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd4139720 con 0x7f7cd40a0d70 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): _renew_subs 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cdaacd640 10 monclient(hunting): authenticate will time out at 1914.531855s 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd3fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f7cd4134760 0x7f7cd4136100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44244/0 (socket says 172.21.15.106:44244) 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.000+0000 7f7cd3fff640 1 -- 172.21.15.106:0/795013572 learned_addr learned my addr 172.21.15.106:0/795013572 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1762110394 0 0) 0x7f7cd40a0080 con 0x7f7cd4134760 2024-04-26T00:10:58.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): my global_id is 254396 2024-04-26T00:10:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb8003530 con 0x7f7cd4134760 2024-04-26T00:10:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 721336509 0 0) 0x7f7cb8003530 con 0x7f7cd4134760 2024-04-26T00:10:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7cd40a0080 con 0x7f7cd4134760 2024-04-26T00:10:58.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cc0001a80 con 0x7f7cd4134760 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): dump: 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.991 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1798489076 0 0) 0x7f7cd406b910 con 0x7f7cd413df70 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): my global_id is 254408 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cb8003530 con 0x7f7cd413df70 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752295603 0 0) 0x7f7cd4139720 con 0x7f7cd40a0d70 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _negotiate 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient(hunting): my global_id is 146536 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7cd406b910 con 0x7f7cd40a0d70 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3513696818 0 0) 0x7f7cd40a0080 con 0x7f7cd4134760 2024-04-26T00:10:58.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 >> v1:172.21.15.171:6792/0 conn(0x7f7cd40a0d70 legacy=0x7f7cd41359f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 >> v1:172.21.15.171:6791/0 conn(0x7f7cd413df70 legacy=0x7f7cd41d4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: _finish_hunting 0 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 monclient: found mon.b 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd4072500 con 0x7f7cd4134760 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: _finish_auth 0 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: _check_auth_tickets 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 5 monclient: authenticate success, global_id 254396 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 10 monclient: _renew_subs 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd4139440 con 0x7f7cd4134760 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 10 monclient: _renew_subs 2024-04-26T00:10:58.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7cd4136810 con 0x7f7cd4134760 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7cc0003950 con 0x7f7cd4134760 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7cc0003ec0 con 0x7f7cd4134760 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd2ffd640 4 set_mon_vals no callback set 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 10 monclient: dump: 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:10:58.995 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7cc00040e0 con 0x7f7cd4134760 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:10:58.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb4005090 con 0x7f7cd4134760 2024-04-26T00:10:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f7cc0045260 con 0x7f7cd4134760 2024-04-26T00:10:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.004+0000 7f7cd8869640 10 monclient: get_auth_request con 0x7f7cb80379f0 auth_method 0 2024-04-26T00:10:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.008+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7cd4139b40 con 0x7f7cd4134760 2024-04-26T00:10:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.008+0000 7f7cd17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:10:58.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.008+0000 7f7cd17fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:10:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.228+0000 7f7cdaacd640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:10:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.228+0000 7f7cdaacd640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:10:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.228+0000 7f7cdaacd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:10:59.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.228+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7f7cb4005b90 con 0x7f7cd4134760 2024-04-26T00:10:59.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cd17fa640 1 -- 172.21.15.106:0/795013572 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7f7cc0015890 con 0x7f7cd4134760 2024-04-26T00:10:59.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cd17fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:10:59.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cd17fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:10:59.208 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.208 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=30,config=2,health=11,kv=12,logm=45} crc {auth=1804504933,config=692619927,health=3672939049,kv=1996692365,logm=2847298744}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=30,config=2,health=12,kv=12,logm=44} crc {auth=3723034659,config=692619927,health=2309019631,kv=1996692365,logm=1761360311}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=31,config=2,health=11,kv=12,logm=44} crc {auth=937306658,config=692619927,health=312857287,kv=1996692365,logm=1110881541}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=30,config=2,health=11,kv=12,logm=45} crc {auth=1530690008,config=692619927,health=2702332338,kv=1996692365,logm=1173683519}) 2024-04-26T00:10:59.209 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=29,config=2,health=11,kv=11,logm=47} crc {auth=3098610989,config=692619927,health=2683827455,kv=2486284834,logm=2015262892}) 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=28,config=2,health=12,kv=12,logm=46} crc {auth=1334105689,config=692619927,health=2309019631,kv=1996692365,logm=3868592430}) 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=31,config=2,health=12,kv=11,logm=44} crc {auth=1141341068,config=692619927,health=2309019631,kv=2659940818,logm=1004768677}) 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=28,config=2,health=11,kv=12,logm=47} crc {auth=769758898,config=692619927,health=668177788,kv=1996692365,logm=2053025135}) 2024-04-26T00:10:59.210 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.232+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=30,config=2,health=12,kv=11,logm=45} crc {auth=4141669543,config=692619927,health=2309019631,kv=369529968,logm=1046465974}) 2024-04-26T00:10:59.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 >> v1:172.21.15.171:6812/722422047 conn(0x7f7cb80379f0 legacy=0x7f7cb8039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:59.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 10 monclient: shutdown 2024-04-26T00:10:59.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:10:59.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 >> v1:172.21.15.106:6790/0 conn(0x7f7cd4134760 legacy=0x7f7cd4136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:10:59.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 shutdown_connections 2024-04-26T00:10:59.211 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 >> 172.21.15.106:0/795013572 conn(0x7f7cd40a7240 msgr2=0x7f7cd40a1db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:10:59.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 shutdown_connections 2024-04-26T00:10:59.212 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:10:59.232+0000 7f7cdaacd640 1 -- 172.21.15.106:0/795013572 wait complete. 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3813361830}) 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3087358964}) 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3780509149}) 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.215 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=42078477}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2926984241}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2153945490}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4147113398}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=856049437}) 2024-04-26T00:10:59.216 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.236+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2103885907}) 2024-04-26T00:10:59.217 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3229801810}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=59116327}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2526247518}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1760858344}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.218 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1677612853}) 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2634924120}) 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1442731768}) 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3827479885}) 2024-04-26T00:10:59.219 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.240+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1303786116}) 2024-04-26T00:10:59.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.221 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=870088509}) 2024-04-26T00:10:59.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3716135860}) 2024-04-26T00:10:59.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.222 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2711262669}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3815760214}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=909818048}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3654726676}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2250290424}) 2024-04-26T00:10:59.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687520066}) 2024-04-26T00:10:59.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.244+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=697790172}) 2024-04-26T00:10:59.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2914298161}) 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1680195151}) 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1640208091}) 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=790174988}) 2024-04-26T00:10:59.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4194509360}) 2024-04-26T00:10:59.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=206715549}) 2024-04-26T00:10:59.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=183405116}) 2024-04-26T00:10:59.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1928560760}) 2024-04-26T00:10:59.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.248+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1548083795}) 2024-04-26T00:10:59.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3421953363}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1970193794}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1563391922}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2913180409}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3355797925}) 2024-04-26T00:10:59.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3241293734}) 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1399343162}) 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=406129052}) 2024-04-26T00:10:59.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.252+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1309719352}) 2024-04-26T00:10:59.235 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:10:59.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1331659656}) 2024-04-26T00:10:59.249 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2661939889}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=397843949}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3818092101}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3249899347}) 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.250 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1787466012}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1989925228}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1942398079}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2661773169}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1148775822}) 2024-04-26T00:10:59.251 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=536992167}) 2024-04-26T00:10:59.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1931375725}) 2024-04-26T00:10:59.252 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3421995951}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1077125050}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1805410342}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=82779710}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371052382}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.256+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2109228702}) 2024-04-26T00:10:59.253 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1659152547}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3945258252}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2557415448}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4017916931}) 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.254 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2771586656}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4041559065}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2334205142}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=360720747}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.260+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=684334489}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1325392144}) 2024-04-26T00:10:59.255 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=660647210}) 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2490882185}) 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1394428614}) 2024-04-26T00:10:59.256 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2650437513}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=75628357}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=440341243}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2534832544}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.264+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2441701225}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2991189552}) 2024-04-26T00:10:59.257 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4085900842}) 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=925559214}) 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3414123439}) 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.258 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2770565443}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3019201107}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3548779600}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=40983634}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.268+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1679512662}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2647689507}) 2024-04-26T00:10:59.259 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1739545195}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3447115279}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=130290709}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3565085565}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=900562140}) 2024-04-26T00:10:59.260 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4056371483}) 2024-04-26T00:10:59.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1650424838}) 2024-04-26T00:10:59.261 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.272+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2760450976}) 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3942191144}) 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3183808783}) 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2345389626}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3792102332}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2907177869}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4097357108}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2620191242}) 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4199120535}) 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2225897682}) 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1326785098}) 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2871470059}) 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1851656305}) 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=614154759}) 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1671553554}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3995548350}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1559144187}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=117334410}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.276+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3486927835}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3332429462}) 2024-04-26T00:10:59.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=203167126}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=634402389}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=747725712}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3543906725}) 2024-04-26T00:10:59.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2093074580}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3180341244}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315072040}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.280+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3781084684}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4259627091}) 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2650411237}) 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2576731747}) 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1921945479}) 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=220701373}) 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3145390813}) 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1699516749}) 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2573721105}) 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.284+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=593812394}) 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1949344069}) 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2831175623}) 2024-04-26T00:10:59.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=234665500}) 2024-04-26T00:10:59.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2916827463}) 2024-04-26T00:10:59.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3146966189}) 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1779571011}) 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2840606634}) 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229564432}) 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.288+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2503370136}) 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3926854019}) 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=257853807}) 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3151713191}) 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2231843078}) 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2863080711}) 2024-04-26T00:10:59.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4210637614}) 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1946319724}) 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=387609665}) 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=480411382}) 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1405614852}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1075642842}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4193117771}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=125771774}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2565922677}) 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4272275544}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2355433633}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2026637692}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.292+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2685622247}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1157343107}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1076606050}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1131995328}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2174412838}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3362856600}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3358885461}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3963618040}) 2024-04-26T00:10:59.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3201659378}) 2024-04-26T00:10:59.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.296+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4144379298}) 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2299432936}) 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2982959344}) 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1026284137}) 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1886429618}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1526619439}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=724310253}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2096794251}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3587467044}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.300+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3603821551}) 2024-04-26T00:10:59.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2719044803}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2138319211}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1552731547}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1035605864}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1136734414}) 2024-04-26T00:10:59.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1739755670}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1247357031}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3299024938}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.304+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4291122483}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1631202230}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=548889418}) 2024-04-26T00:10:59.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1034697971}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1096898715}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2122619089}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2953562891}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2777213747}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2080941417}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=577399340}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2749843322}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1348239311}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3098934320}) 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3172301459}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2041767698}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1295316624}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=997429160}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3231680696}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.308+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3240869690}) 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2828237489}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3576083025}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1744056979}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1522284638}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1337147855}) 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3363254589}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3385643148}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008427559}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.312+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=613494493}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1920936128}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1994199082}) 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2710784335}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=887385690}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1769369110}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3740452150}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1157951786}) 2024-04-26T00:10:59.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2928510237}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.316+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=784537260}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4168028129}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3184295130}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2402888807}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=808721591}) 2024-04-26T00:10:59.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3469707062}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=33406752}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=371152353}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2871898240}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3356574022}) 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=90037231}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3043404452}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1248208000}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3216480449}) 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3672287235}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3241843413}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=115022949}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=107209986}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.320+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1195413649}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2411727802}) 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1159821473}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2092565592}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1311289269}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2690564279}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=92986478}) 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1579799208}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2707824327}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.324+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=335276160}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1088334077}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=419794264}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1653454457}) 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3853234366}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3506038621}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2465773890}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3085027812}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606525690}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=207655443}) 2024-04-26T00:10:59.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3311165501}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=917655988}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3351462337}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2725359620}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=171636511}) 2024-04-26T00:10:59.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3524929942}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2777514461}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2337574108}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.328+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1941750597}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4111082372}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=286307013}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4020137013}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=860356029}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3813835843}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1946623954}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3302546044}) 2024-04-26T00:10:59.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2412418223}) 2024-04-26T00:10:59.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.332+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1821800196}) 2024-04-26T00:10:59.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4273577336}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2016423410}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2150264115}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=349452173}) 2024-04-26T00:10:59.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=15489597}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1005711079}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3750202581}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=471384118}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2953792300}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3798721705}) 2024-04-26T00:10:59.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2364091245}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3584409395}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1603278324}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3450111512}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=85571257}) 2024-04-26T00:10:59.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3844975859}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1418287954}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.336+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1317118810}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=849856345}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=383454432}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2389892442}) 2024-04-26T00:10:59.386 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1885092888}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2735587534}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1081026349}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1614579202}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3795258338}) 2024-04-26T00:10:59.387 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.340+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=247311754}) 2024-04-26T00:10:59.388 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.388 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.388 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1151785529}) 2024-04-26T00:10:59.388 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.388 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.388 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2030259000}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=347669887}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=609236042}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3300717297}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1678982882}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.389 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=35032516}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3688043193}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1714063469}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.344+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3836607024}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3047006796}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3333605932}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.390 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3052250513}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3710767093}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=431384654}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=561209961}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2251050536}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1286771693}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.391 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2607914595}) 2024-04-26T00:10:59.392 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.392 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.394 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2656764494}) 2024-04-26T00:10:59.394 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.394 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.394 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3238389619}) 2024-04-26T00:10:59.394 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3057002337}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2457793269}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=946140352}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3254679696}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1132741953}) 2024-04-26T00:10:59.395 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.348+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1189064144}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3347185831}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3800698679}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=524589795}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=93311953}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.396 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1096911667}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2821602990}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3871997196}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1924150507}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.352+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4204442204}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2654455403}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.397 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3937568696}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3188288496}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=504176796}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2243091633}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1532622928}) 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.398 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2909421356}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3236027570}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2542846809}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1715424139}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2862989313}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2643940129}) 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.399 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1052400440}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=834436049}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2630266357}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1032087855}) 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.400 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578397347}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.356+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=194022947}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=59102495}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3024776674}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1995598157}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=711262735}) 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.401 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1006988432}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1750613732}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=900355346}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2323016071}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.360+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2058243321}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.402 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=469724026}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=822932350}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3201109121}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1476363480}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3829745061}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.403 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3757984822}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4008221152}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=238746172}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=311113216}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1735971221}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1409641490}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.404 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=302933457}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3659675123}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3562221422}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2545713600}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1265721747}) 2024-04-26T00:10:59.405 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1384578768}) 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.364+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2958849371}) 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2219111954}) 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2880517155}) 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.406 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1572812356}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=192362235}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=586603203}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4210308569}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4111634373}) 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.407 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939233302}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=739957734}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3700022810}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2981925553}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3857730177}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.368+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2878023562}) 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.408 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1230691953}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2925992422}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2022544960}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1098356556}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1005451973}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.409 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2549818098}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=231338470}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=979964617}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3124846164}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2815801741}) 2024-04-26T00:10:59.410 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4037802848}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=978821326}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3852917046}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.372+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1829273737}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=932661267}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1358384253}) 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.411 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2845719281}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3667654024}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1597216482}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3009137321}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3039254685}) 2024-04-26T00:10:59.412 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1501884981}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2293193733}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1622767417}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1350540064}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2505722148}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2691572720}) 2024-04-26T00:10:59.413 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1216927844}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.376+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=31137726}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1576191923}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=885521950}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1523294386}) 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.414 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2207755465}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2378731520}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=899296646}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=998886599}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2939450938}) 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.415 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2217596643}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3273762819}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3889530162}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2555416398}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=343388066}) 2024-04-26T00:10:59.416 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1677214949}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.380+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=467192370}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1520081974}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3679734769}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.417 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2100661250}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=307928204}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=30364044}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=670329507}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4085247337}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1851945510}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.418 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2110841583}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=820178219}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2469156388}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3871790371}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2108259394}) 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.419 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1528544154}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.384+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2813460674}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=724019177}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=325934739}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1685376591}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=162714981}) 2024-04-26T00:10:59.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1846526797}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2372118798}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3229574484}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4287180977}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2609557821}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1323071108}) 2024-04-26T00:10:59.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=293463510}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=814061006}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4093704680}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2914949711}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1288395756}) 2024-04-26T00:10:59.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1364640194}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519976945}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.388+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2776394726}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1692321337}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2393988120}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2729553413}) 2024-04-26T00:10:59.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2951482209}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2463462604}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1028858826}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=220145420}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3268040654}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2776581400}) 2024-04-26T00:10:59.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3582734689}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3886114177}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.392+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4149056229}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=375380754}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3653770357}) 2024-04-26T00:10:59.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1793784176}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3796807746}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2907676140}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=72958052}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=20307083}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1545564824}) 2024-04-26T00:10:59.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1550395439}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1397257785}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3526408710}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3520142516}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2575173919}) 2024-04-26T00:10:59.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=344873643}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.396+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2789335446}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4247289902}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4231460715}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3386377063}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=474713971}) 2024-04-26T00:10:59.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3252792895}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2178017736}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=666160633}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3525533421}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.400+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=170432001}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1025515910}) 2024-04-26T00:10:59.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2944872943}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1284417810}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2750849217}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2488722636}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3259085308}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1208803744}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4059122521}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2636108776}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3424172794}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=447528878}) 2024-04-26T00:10:59.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2650743688}) 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2006470258}) 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1722253347}) 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3277999185}) 2024-04-26T00:10:59.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=714832124}) 2024-04-26T00:10:59.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=351950433}) 2024-04-26T00:10:59.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.404+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=374892304}) 2024-04-26T00:10:59.584 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1361351738}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2459455716}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=97130979}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1025738830}) 2024-04-26T00:10:59.585 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1486491835}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1396597757}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=501550983}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3415974135}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=349815892}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.586 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2766015103}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4239699853}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3204340865}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2588444558}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2338928327}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.587 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=878225254}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3165177863}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1368379815}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.408+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3297544166}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3790826474}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2830201502}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.588 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2513565131}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3332825950}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2221240566}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=450310390}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2369953466}) 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.589 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=467892390}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1580602659}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=970513668}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2420205007}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1703859291}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.590 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3917865531}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=876870156}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3866750990}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1351606266}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4294644050}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.412+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4021949085}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.591 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2880280089}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1949764368}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1977992465}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4213903178}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1200402588}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.592 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3190194873}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3611619559}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3641068571}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1804717890}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1828142713}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=692759049}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.593 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2969852972}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4172043520}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1948765857}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3540859600}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=288460126}) 2024-04-26T00:10:59.594 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638424468}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.416+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3623474761}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1807845449}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2104180401}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2627671622}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3964152241}) 2024-04-26T00:10:59.595 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3683003836}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2787069382}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=867426948}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=188069548}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2049641008}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2620558333}) 2024-04-26T00:10:59.596 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1561090231}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3788379223}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1358779230}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=624843349}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1316522550}) 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.597 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1857144094}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977903315}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.420+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1951649877}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2713310257}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3609047220}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=209641081}) 2024-04-26T00:10:59.598 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2917554030}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1866651717}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1045932601}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=709767457}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2687902786}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4081846297}) 2024-04-26T00:10:59.599 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1440941228}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2705025435}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1819966134}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=793518391}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3079501294}) 2024-04-26T00:10:59.600 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3015968127}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3637057499}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=732131592}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.424+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1988197919}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2406608412}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.601 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4078922061}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1716289711}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1853373066}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3691815777}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2627384320}) 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.602 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=320804909}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=871336242}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2611009789}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2785341033}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3899400090}) 2024-04-26T00:10:59.603 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4097358176}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3128920489}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1808280199}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=477146185}) 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.604 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2996794801}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2264641389}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.428+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1427711972}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3983343485}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=714710766}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.605 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3133439716}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2030290164}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2398085924}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=318964863}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.606 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2513012275}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4069790345}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3163054602}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2275302267}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1274515848}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3533950857}) 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.607 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3416337997}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1906482072}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1165601105}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3753648386}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4024056104}) 2024-04-26T00:10:59.608 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.432+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2106399679}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1241348488}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=695600677}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3737889979}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3705961678}) 2024-04-26T00:10:59.609 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=251278665}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3885179432}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2225710458}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1645991916}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=745929885}) 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.610 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3549434858}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2599780758}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=987740168}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4101044473}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=608817659}) 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.611 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1702155470}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2479726110}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2832372657}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3207998119}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=879391498}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1144390885}) 2024-04-26T00:10:59.612 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2575979281}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3882962934}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2454878590}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3128432246}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.436+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2700663181}) 2024-04-26T00:10:59.613 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3338793614}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1421733953}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1408877476}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3310882412}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3457387443}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.614 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3578377702}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1470615991}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=258641958}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3863464204}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=996250820}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.440+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1981104373}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.615 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1996305806}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2183676682}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1255186754}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4071691173}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1028622718}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.616 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2459323685}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=630612613}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2865973580}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.444+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2846754588}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1563298682}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1897253203}) 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.617 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=931123462}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1287659882}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2515525527}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3605496972}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.618 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4144938171}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1968142378}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2352117444}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=638378366}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4256439113}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1203400193}) 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.619 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=689091837}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1011788561}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2126044974}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2766513506}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1494774139}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.448+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=760121133}) 2024-04-26T00:10:59.620 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2745617740}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2892040565}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=157496057}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3575119182}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2479108768}) 2024-04-26T00:10:59.621 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3640392587}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1261325635}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1783612496}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=395080238}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=532338385}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.622 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3713776368}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=126160583}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3908079216}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1454217601}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1476986730}) 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.623 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367637175}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1090016982}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1928746440}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=336305201}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1813261765}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=754270977}) 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.624 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2911995518}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=880316351}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2232557580}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2375806351}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2454798406}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.456+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3854780486}) 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.625 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2380943014}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=358807671}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=469636214}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3701685521}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=585333758}) 2024-04-26T00:10:59.626 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=616427804}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2262944965}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3033283745}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1987261916}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2132592060}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4058657501}) 2024-04-26T00:10:59.627 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2962698226}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2214867259}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1934249995}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3917697918}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.628 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4034109649}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229299882}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.460+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4110696920}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2938194691}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3046761419}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1449732365}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.629 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1545790535}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1179739504}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2930132123}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1510536676}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1078301559}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3353744428}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.630 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2726915738}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.464+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3934310766}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=221548513}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=748649311}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3492293606}) 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.631 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4090296948}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1164626256}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=990127070}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2667089122}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1311804569}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.632 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1600176483}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1069763159}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=393826088}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1889430943}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=150622278}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.633 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2700754282}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2523119037}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=804722650}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1284889633}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2323885969}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3454670343}) 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.634 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3699209033}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1024090054}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3061909992}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.468+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3034413908}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1027400886}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=614827170}) 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.635 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3669141656}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2596445083}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=353166317}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3849449590}) 2024-04-26T00:10:59.637 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=500332841}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3242684300}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2064613841}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3917447639}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1572003841}) 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.638 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3506031550}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2727918845}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3465736005}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.472+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=729445803}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2200379043}) 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.639 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=911398143}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3139180311}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3977270313}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3293558655}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3189167949}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2569355510}) 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.640 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3100397912}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4027279792}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2993984593}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1337258986}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1510004454}) 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.641 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=734570727}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3811712884}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1383847591}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=484296187}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3510264547}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.642 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=820929431}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.476+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=532697527}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4244673007}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2595691906}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=553295601}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1370685878}) 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.643 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3211283292}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4059844773}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1337017789}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=523455671}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3006080249}) 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.644 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3523323321}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2249238464}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3024042241}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2410331828}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=357848672}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=571062636}) 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.645 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2081697394}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1440731000}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2978631442}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3970840882}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.480+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1867200283}) 2024-04-26T00:10:59.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=284832599}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3319541333}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1499859248}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1294862867}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3868670984}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=663025201}) 2024-04-26T00:10:59.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1192559669}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=402869606}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=711334765}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=72206570}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=607527213}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3643089072}) 2024-04-26T00:10:59.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4142136166}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2040972044}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2868761298}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=913922293}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3609674891}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3870947963}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1331941233}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.484+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2025795856}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1684909318}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=541966141}) 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=643515646}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2118164788}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=240794058}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1875407732}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2540830616}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2778213205}) 2024-04-26T00:10:59.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2779008507}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=278238118}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=940409499}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2850134246}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1494373188}) 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=629553993}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=903933117}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.488+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1074706372}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=504175507}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3815098020}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1302352179}) 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2357226895}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2104837725}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1521687322}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1965677536}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3675357457}) 2024-04-26T00:10:59.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=143361390}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309379229}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1010480845}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1036570753}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2402147081}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=547632722}) 2024-04-26T00:10:59.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=980603637}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.492+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3860913703}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1160953717}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=13036083}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1248675817}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2731200685}) 2024-04-26T00:10:59.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3563762766}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1938422227}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1606617133}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=205682815}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3069253222}) 2024-04-26T00:10:59.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3038652236}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=257744216}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1773949353}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3239504633}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3525917545}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1923989513}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3082805636}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=909118316}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2063279015}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1125582627}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2617275313}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=154944645}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.496+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=160894112}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4239987273}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4242675450}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1854907526}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1595561353}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=876261996}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=902432499}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1760290538}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332135233}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2874396082}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2364361532}) 2024-04-26T00:10:59.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3794853641}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2729861343}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=62646477}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1353632154}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2826564454}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1799973791}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2508705756}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.500+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2895145347}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=138169883}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1415527634}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2389167415}) 2024-04-26T00:10:59.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4088262176}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3787723822}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2011805713}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=916769743}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4117572955}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3259908894}) 2024-04-26T00:10:59.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2051441824}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1002167201}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2626907717}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=780748196}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2581171630}) 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=415487117}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1910931531}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2745562731}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.504+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=518700698}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2758622462}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1098099887}) 2024-04-26T00:10:59.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2391377248}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2953707914}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=211273379}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1833633345}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2337305063}) 2024-04-26T00:10:59.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3896115046}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4262899297}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=806850735}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2078629819}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2906513267}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1084411004}) 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3930133055}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2837330254}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=776500955}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2332913013}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.508+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4111529869}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4194467870}) 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3063918200}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3888007907}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2154374612}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=846563034}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3700951744}) 2024-04-26T00:10:59.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=747383320}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4235697442}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3376150056}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=289226239}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1008820960}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4017123422}) 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3600450927}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1652754291}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1442172511}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1130942776}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2822612}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.512+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2026817889}) 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4285225338}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1456680232}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1906998062}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2284711605}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3876184027}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=572371171}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3515216878}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1515253053}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=652689243}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4069428274}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2974361941}) 2024-04-26T00:10:59.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4018203270}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3239081303}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2662604638}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2044528777}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=716600221}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1229213112}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.516+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3913427377}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4217228990}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4260634260}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2682535394}) 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1098734035}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=992397288}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2925602688}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1688165444}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=423472757}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3048960983}) 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=276108927}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2925734442}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=843284116}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=25347196}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2208349698}) 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3302096975}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1455910689}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1993434043}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.520+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=181379591}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2992012107}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1765659280}) 2024-04-26T00:10:59.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1990820173}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1071017451}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3126290137}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=11159839}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2150310138}) 2024-04-26T00:10:59.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1105675778}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3553473716}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4082827641}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1637934547}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3263721232}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1160568219}) 2024-04-26T00:10:59.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2135720504}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1160414418}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3368445257}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2567236493}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.524+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1226747996}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3257019376}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1588188745}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3582377505}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=495118095}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=711002380}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4026096173}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2738271193}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3224455274}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1954031393}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3371643045}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2650710551}) 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3589454897}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2773456435}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2593515447}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=65305180}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4284805296}) 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2999235895}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1906569056}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.528+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3981408687}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1183442814}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=114670602}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4281216891}) 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4180269852}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=89323981}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2634723960}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1789162764}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=268268616}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=77967623}) 2024-04-26T00:10:59.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1619404263}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=811049899}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1823050078}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1211461112}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1045315277}) 2024-04-26T00:10:59.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=65326668}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3950811855}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.532+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3779435859}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3513414862}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3143442743}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3106375789}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2145932093}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1147147902}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3635739518}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3118649064}) 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3295535773}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2035259524}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3016216870}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3784681230}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4238282179}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2621076401}) 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2644594138}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2875853701}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1049635394}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1500497499}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.536+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3813782073}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1074315225}) 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3576865974}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3875561664}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3444473197}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=340638758}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=352185024}) 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2743771343}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1400329655}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=942922284}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1611664800}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2379821744}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=943146385}) 2024-04-26T00:10:59.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1963677934}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=122442384}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=514028861}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1769956860}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=386349608}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1080102481}) 2024-04-26T00:10:59.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=334576074}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2744593766}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1499956088}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3977710430}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=8100633}) 2024-04-26T00:10:59.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=66885833}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.540+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=994235451}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2012909449}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1205552963}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2198646228}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3196242814}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3147479591}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2283175021}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2782170456}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1292915485}) 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3506265677}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4276569553}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3874821908}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3360632041}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1729745802}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=625012590}) 2024-04-26T00:10:59.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3337045171}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2601067251}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=72141345}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=260546693}) 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1670741343}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.544+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2008497397}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2732999757}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4030529729}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=82953118}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=235707834}) 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3358819112}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1986652680}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2229137066}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1518445257}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=528805598}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1099195908}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3248221731}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2081336795}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=57843375}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=181458264}) 2024-04-26T00:10:59.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=407297198}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3662831987}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=287839188}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.548+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1306528808}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2643221192}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3596526169}) 2024-04-26T00:10:59.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=280799556}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3196477311}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3685592694}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2207895189}) 2024-04-26T00:10:59.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2454584250}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1885452291}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3240728981}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=26,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=30} crc {logm=1576599919,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=880264000,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=2146822735}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=29} crc {logm=758434024,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=4206635108,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1306330766}) 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=23,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=2,osd_metadata=6,osd_pg_creating=1,osdmap=35} crc {logm=1567104159,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654403,mgrstat=762689383,mon_config_key=552215239,monmap=3140514009,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4228429610}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=26,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=30} crc {logm=2043389464,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2133176701,mon_config_key=3610483653,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=3337957048}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=24,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,osd_metadata=6,osdmap=34} crc {logm=2738762072,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3173270213,mon_config_key=1373317375,monmap=828017138,osd_metadata=857068958,osdmap=2922802524}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=27,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=29} crc {logm=187319666,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2962810908,mon_config_key=160787317,monmap=828017138,osd_metadata=1939088786,osd_pg_creating=3530713735,osdmap=1560920960}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=26,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=30} crc {logm=2212327121,mdsmap=2840952586,mgr=4049914839,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3717415995,mon_config_key=809949667,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4173068006}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=10,mon_config_key=10,monmap=3,osd_metadata=6,osd_pg_creating=1,osdmap=33} crc {logm=3720840812,mdsmap=2840952586,mgr=3816727542,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1555519988,mon_config_key=1003196044,monmap=828017138,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=4056891611}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.552+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=25,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,osd_metadata=5,osd_pg_creating=1,osdmap=34} crc {logm=4029140602,mdsmap=2840952586,mgr=119571008,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3173270213,mon_config_key=3040045454,monmap=828017138,osd_metadata=2883694957,osd_pg_creating=3530713735,osdmap=173788064}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=26} crc {osdmap=3735904857}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=24} crc {osdmap=4231020205}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=25} crc {osdmap=555862258}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=26} crc {osdmap=392197512}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.560+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=25} crc {osdmap=1296129531}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=25} crc {osdmap=1296129531}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=24} crc {osdmap=2115102852}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=25} crc {osdmap=853125121}) 2024-04-26T00:10:59.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:10:59.564+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=25} crc {osdmap=1296129531}) 2024-04-26T00:11:00.236 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:11:00.237 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: get_monmap_and_config 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: build_initial_monmap 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: monmap: 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:00.418874+0000 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:00.418874+0000 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.391 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 Processor -- start 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- start start 2024-04-26T00:11:00.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: init 2024-04-26T00:11:00.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:00.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: _add_conns ranks=[2,6,5,1,7,0,8,3,4] 2024-04-26T00:11:00.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient(hunting): picked mon.noname-b con 0x7fd6a8134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:00.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient(hunting): picked mon.noname-d con 0x7fd6a80a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:00.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient(hunting): picked mon.noname-h con 0x7fd6a813e200 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a806dd40 con 0x7fd6a8134970 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a80a2b10 con 0x7fd6a813e200 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a80a2df0 con 0x7fd6a80a4820 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient(hunting): authenticate will time out at 1915.945671s 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6ada0c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fd6a8134970 0x7fd6a8134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44256/0 (socket says 172.21.15.106:44256) 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6ad20b640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fd6a80a4820 0x7fd6a813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41834/0 (socket says 172.21.15.106:41834) 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6ada0c640 1 -- 172.21.15.106:0/2091243046 learned_addr learned my addr 172.21.15.106:0/2091243046 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 67600087 0 0) 0x7fd6a80a2df0 con 0x7fd6a80a4820 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): my global_id is 254427 2024-04-26T00:11:00.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd694003530 con 0x7fd6a80a4820 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3715034526 0 0) 0x7fd6a806dd40 con 0x7fd6a8134970 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient(hunting): my global_id is 254405 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6a80a2df0 con 0x7fd6a8134970 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 784834027 0 0) 0x7fd694003530 con 0x7fd6a80a4820 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 >> v1:172.21.15.171:6791/0 conn(0x7fd6a813e200 legacy=0x7fd6a81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 >> v1:172.21.15.106:6790/0 conn(0x7fd6a8134970 legacy=0x7fd6a8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: _finish_hunting 0 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 monclient: found mon.noname-d 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:11:00.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a80a30d0 con 0x7fd6a80a4820 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: _finish_auth 0 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: _check_auth_tickets 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd6980017c0 con 0x7fd6a80a4820 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 5 monclient: authenticate success, global_id 254427 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: dump: 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.402 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd698001a70 con 0x7fd6a80a4820 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:00.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 4 set_mon_vals no callback set 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 1 -- 172.21.15.106:0/2091243046 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd698004b30 con 0x7fd6a80a4820 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6aca0a640 10 monclient: dump: 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.404 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: shutdown 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- 172.21.15.106:0/2091243046 >> v1:172.21.15.106:6792/0 conn(0x7fd6a80a4820 legacy=0x7fd6a813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- 172.21.15.106:0/2091243046 shutdown_connections 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- 172.21.15.106:0/2091243046 >> 172.21.15.106:0/2091243046 conn(0x7fd6a80a9e20 msgr2=0x7fd6a80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- 172.21.15.106:0/2091243046 shutdown_connections 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 -- 172.21.15.106:0/2091243046 wait complete. 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: build_initial_monmap 2024-04-26T00:11:00.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 10 monclient: monmap: 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:00.406 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.416+0000 7fd6afc70640 1 Processor -- start 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 1 -- start start 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: init 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _add_conns ranks=[3,0,1,4,8,5,2,7,6] 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient(hunting): picked mon.noname-g con 0x7fd6a80a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:00.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient(hunting): picked mon.noname-a con 0x7fd6a8134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:00.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient(hunting): picked mon.noname-f con 0x7fd6a813e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:00.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a809da70 con 0x7fd6a8134970 2024-04-26T00:11:00.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a809d450 con 0x7fd6a813e200 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6a809df60 con 0x7fd6a80a4820 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient(hunting): authenticate will time out at 1915.948632s 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6ad20b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd6a8134970 0x7fd6a809cd40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38114/0 (socket says 172.21.15.106:38114) 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6ad20b640 1 -- 172.21.15.106:0/58670892 learned_addr learned my addr 172.21.15.106:0/58670892 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4291846321 0 0) 0x7fd6a80a30d0 con 0x7fd6a8134970 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): my global_id is 274158 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd68c003530 con 0x7fd6a8134970 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 796720678 0 0) 0x7fd6a809df60 con 0x7fd6a80a4820 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): my global_id is 215202 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6a80a30d0 con 0x7fd6a80a4820 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4208286469 0 0) 0x7fd68c003530 con 0x7fd6a8134970 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6a809df60 con 0x7fd6a8134970 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd698001780 con 0x7fd6a8134970 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): dump: 2024-04-26T00:11:00.411 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.412 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2263006738 0 0) 0x7fd6a809d450 con 0x7fd6a813e200 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): my global_id is 225091 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd68c003530 con 0x7fd6a813e200 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1385511615 0 0) 0x7fd6a80a30d0 con 0x7fd6a80a4820 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6a809d450 con 0x7fd6a80a4820 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd6a4001520 con 0x7fd6a80a4820 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:11:00.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient(hunting): dump: 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.416 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1065824361 0 0) 0x7fd6a809df60 con 0x7fd6a8134970 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 >> v1:172.21.15.171:6790/0 conn(0x7fd6a80a4820 legacy=0x7fd6a809c630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 >> v1:172.21.15.171:6789/0 conn(0x7fd6a813e200 legacy=0x7fd6a81d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 monclient: found mon.a 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6a80a1a40 con 0x7fd6a8134970 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 5 monclient: authenticate success, global_id 274158 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _renew_subs 2024-04-26T00:11:00.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd6a809fce0 con 0x7fd6a8134970 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _renew_subs 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd6a80a06c0 con 0x7fd6a8134970 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd698001a70 con 0x7fd6a8134970 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd698005180 con 0x7fd6a8134970 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69ffff640 4 set_mon_vals no callback set 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 10 monclient: dump: 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.418 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:00.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:00.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd690005090 con 0x7fd6a8134970 2024-04-26T00:11:00.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd69800ff20 con 0x7fd6a8134970 2024-04-26T00:11:00.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fd698045140 con 0x7fd6a8134970 2024-04-26T00:11:00.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.420+0000 7fd6ada0c640 10 monclient: get_auth_request con 0x7fd68c037fe0 auth_method 0 2024-04-26T00:11:00.420 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.424+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fd6a809da70 con 0x7fd6a8134970 2024-04-26T00:11:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.424+0000 7fd69e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:00.421 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.424+0000 7fd69e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:00.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:11:00.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:11:00.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:00.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd690005380 con 0x7fd6a8134970 2024-04-26T00:11:00.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd69e7fc640 1 -- 172.21.15.106:0/58670892 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 3595605500) 0x7fd6980158f0 con 0x7fd6a8134970 2024-04-26T00:11:00.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd69e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:11:00.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd69e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:00.627 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":100,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:11:00.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 >> v1:172.21.15.171:6812/722422047 conn(0x7fd68c037fe0 legacy=0x7fd68c03a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 10 monclient: shutdown 2024-04-26T00:11:00.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:00.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 >> v1:172.21.15.106:6789/0 conn(0x7fd6a8134970 legacy=0x7fd6a809cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 shutdown_connections 2024-04-26T00:11:00.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 >> 172.21.15.106:0/58670892 conn(0x7fd6a80a9e20 msgr2=0x7fd6a8130b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:00.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 shutdown_connections 2024-04-26T00:11:00.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.652+0000 7fd6afc70640 1 -- 172.21.15.106:0/58670892 wait complete. 2024-04-26T00:11:00.645 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:11:00.645 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T00:11:00.645 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:11:00.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:11:00.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: get_monmap_and_config 2024-04-26T00:11:00.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: build_initial_monmap 2024-04-26T00:11:00.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: monmap: 2024-04-26T00:11:00.767 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:00.767 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.767 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:00.794536+0000 2024-04-26T00:11:00.767 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:00.794536+0000 2024-04-26T00:11:00.767 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:00.768 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.768 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:00.768 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:00.768 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:00.768 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:00.768 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:00.769 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:00.769 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:00.769 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:00.769 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:00.769 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 Processor -- start 2024-04-26T00:11:00.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- start start 2024-04-26T00:11:00.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: init 2024-04-26T00:11:00.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: _add_conns ranks=[1,6,7,4,0,2,3,8,5] 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient(hunting): picked mon.noname-f con 0x7f0a5c0a1b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient(hunting): picked mon.noname-d con 0x7f0a5c06be40 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient(hunting): picked mon.noname-i con 0x7f0a5c09fd70 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5c0a3400 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5c06b9b0 con 0x7f0a5c06be40 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5c09eaa0 con 0x7f0a5c09fd70 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:00.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient(hunting): authenticate will time out at 1916.321559s 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5b7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f0a5c06be40 0x7f0a5c13cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41848/0 (socket says 172.21.15.106:41848) 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5b7fe640 1 -- 172.21.15.106:0/269311874 learned_addr learned my addr 172.21.15.106:0/269311874 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928330823 0 0) 0x7f0a5c06b9b0 con 0x7f0a5c06be40 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient(hunting): my global_id is 254436 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a48003530 con 0x7f0a5c06be40 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 225063831 0 0) 0x7f0a48003530 con 0x7f0a5c06be40 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 >> v1:172.21.15.171:6792/0 conn(0x7f0a5c09fd70 legacy=0x7f0a5c140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 >> v1:172.21.15.171:6789/0 conn(0x7f0a5c0a1b20 legacy=0x7f0a5c0a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 monclient: found mon.noname-d 2024-04-26T00:11:00.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c06b470 con 0x7f0a5c06be40 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: _finish_auth 0 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a440017c0 con 0x7f0a5c06be40 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: dump: 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.788 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 5 monclient: authenticate success, global_id 254436 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a44001ab0 con 0x7f0a5c06be40 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 1 -- 172.21.15.106:0/269311874 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a44004bf0 con 0x7f0a5c06be40 2024-04-26T00:11:00.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 4 set_mon_vals no callback set 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a5affd640 10 monclient: dump: 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.790 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: shutdown 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- 172.21.15.106:0/269311874 >> v1:172.21.15.106:6792/0 conn(0x7f0a5c06be40 legacy=0x7f0a5c13cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- 172.21.15.106:0/269311874 shutdown_connections 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- 172.21.15.106:0/269311874 >> 172.21.15.106:0/269311874 conn(0x7f0a5c0a6fe0 msgr2=0x7f0a5c0a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- 172.21.15.106:0/269311874 shutdown_connections 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- 172.21.15.106:0/269311874 wait complete. 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: build_initial_monmap 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: monmap: 2024-04-26T00:11:00.791 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 Processor -- start 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 1 -- start start 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.792+0000 7f0a626c9640 10 monclient: init 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient: _add_conns ranks=[1,3,8,5,7,4,6,0,2] 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient(hunting): picked mon.noname-f con 0x7f0a5c06be40 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient(hunting): picked mon.noname-g con 0x7f0a5c09fd70 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient(hunting): picked mon.noname-e con 0x7f0a5c0a1b20 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5c13fcd0 con 0x7f0a5c06be40 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5c13cc60 con 0x7f0a5c09fd70 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5c072600 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient(hunting): authenticate will time out at 1916.324508s 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a60c66640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0a5c0a1b20 0x7f0a5c1d49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33438/0 (socket says 172.21.15.106:33438) 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a60c66640 1 -- 172.21.15.106:0/1746994164 learned_addr learned my addr 172.21.15.106:0/1746994164 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:00.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008800346 0 0) 0x7f0a5c072600 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): my global_id is 225017 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a3c003530 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4144065861 0 0) 0x7f0a3c003530 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a5c072600 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a4c001a70 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): dump: 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.794 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833541410 0 0) 0x7f0a5c13fcd0 con 0x7f0a5c06be40 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): my global_id is 225109 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a3c003530 con 0x7f0a5c06be40 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986242597 0 0) 0x7f0a5c13cc60 con 0x7f0a5c09fd70 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): my global_id is 215211 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a5c13fcd0 con 0x7f0a5c09fd70 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4281548800 0 0) 0x7f0a5c072600 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.171:6790/0 conn(0x7f0a5c09fd70 legacy=0x7f0a5c13c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.171:6789/0 conn(0x7f0a5c06be40 legacy=0x7f0a5c13be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 monclient: found mon.e 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c09e150 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: _finish_auth 0 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 5 monclient: authenticate success, global_id 225017 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient: _renew_subs 2024-04-26T00:11:00.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5c13d9e0 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient: _renew_subs 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0a5c13e290 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0a4c003950 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a4c003ec0 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a5a7fc640 4 set_mon_vals no callback set 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:00.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: dump: 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.799 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0a400065d0 con 0x7f0a40002870 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0a4c0040e0 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f0a4c0450c0 con 0x7f0a5c0a1b20 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1874717492 0 0) 0x7f0a400065d0 con 0x7f0a40002870 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient(hunting): my global_id is 274167 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a5c072600 con 0x7f0a40002870 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a5b7fe640 10 monclient: get_auth_request con 0x7f0a3c0379c0 auth_method 0 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3697272457 0 0) 0x7f0a5c072600 con 0x7f0a40002870 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a400065d0 con 0x7f0a40002870 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a54001a50 con 0x7f0a40002870 2024-04-26T00:11:00.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: dump: 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.801 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3261058065 0 0) 0x7f0a400065d0 con 0x7f0a40002870 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a4000a160 con 0x7f0a40002870 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0a54001ed0 con 0x7f0a40002870 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.106:6789/0 conn(0x7f0a40002870 legacy=0x7f0a40004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.796+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.106:6789/0 conn(0x7f0a40002870 legacy=0x7f0a40004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0a40009e30 con 0x7f0a400090f0 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614029901 0 0) 0x7f0a40009e30 con 0x7f0a400090f0 2024-04-26T00:11:00.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient(hunting): my global_id is 274176 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0a400065d0 con 0x7f0a400090f0 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 265030272 0 0) 0x7f0a400065d0 con 0x7f0a400090f0 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0a40009e30 con 0x7f0a400090f0 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0a54003eb0 con 0x7f0a400090f0 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient: dump: 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.803 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4149337301 0 0) 0x7f0a40009e30 con 0x7f0a400090f0 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0a4000c3a0 con 0x7f0a400090f0 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 2720126398) 0x7f0a54005da0 con 0x7f0a400090f0 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:00.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.106:6789/0 conn(0x7f0a400090f0 legacy=0x7f0a40009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a58ff9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.106:6789/0 conn(0x7f0a400090f0 legacy=0x7f0a40009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:00.805 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 8875, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:00.806 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:00.807 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:00.808 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:00.809 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:00.810 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:00.811 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:00.813 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.814 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.815 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.816 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:00.818 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.819 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:00.820 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.822 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:00.823 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.824 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:00.825 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:00.826 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:00.826 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:00.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.171:6812/722422047 conn(0x7f0a3c0379c0 legacy=0x7f0a3c039e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 10 monclient: shutdown 2024-04-26T00:11:00.828 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 >> v1:172.21.15.106:6793/0 conn(0x7f0a5c0a1b20 legacy=0x7f0a5c1d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a60c66640 1 -- 172.21.15.106:0/1746994164 reap_dead start 2024-04-26T00:11:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a60c66640 1 -- 172.21.15.106:0/1746994164 reap_dead start 2024-04-26T00:11:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 shutdown_connections 2024-04-26T00:11:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 >> 172.21.15.106:0/1746994164 conn(0x7f0a5c0a6fe0 msgr2=0x7f0a5c0a5570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:00.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 shutdown_connections 2024-04-26T00:11:00.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.804+0000 7f0a626c9640 1 -- 172.21.15.106:0/1746994164 wait complete. 2024-04-26T00:11:00.830 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:00.830 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:11:00.831 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:11:00.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: get_monmap_and_config 2024-04-26T00:11:00.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: build_initial_monmap 2024-04-26T00:11:00.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: monmap: 2024-04-26T00:11:00.947 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:00.947 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.947 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:00.974606+0000 2024-04-26T00:11:00.947 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:00.974606+0000 2024-04-26T00:11:00.947 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:00.947 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.948 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:00.948 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:00.948 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:00.948 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:00.948 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:00.948 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:00.948 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:00.949 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:00.949 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:00.949 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 Processor -- start 2024-04-26T00:11:00.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- start start 2024-04-26T00:11:00.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: init 2024-04-26T00:11:00.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:00.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: _add_conns ranks=[1,3,4,5,8,6,0,7,2] 2024-04-26T00:11:00.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient(hunting): picked mon.noname-f con 0x7f1c88137730 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:00.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient(hunting): picked mon.noname-g con 0x7f1c880a0b20 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:00.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient(hunting): picked mon.noname-c con 0x7f1c88138220 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:00.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c880a2750 con 0x7f1c88137730 2024-04-26T00:11:00.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c880a2a30 con 0x7f1c880a0b20 2024-04-26T00:11:00.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c880a2d10 con 0x7f1c88138220 2024-04-26T00:11:00.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:00.965 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient(hunting): authenticate will time out at 1916.501678s 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8cf0e640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f1c88138220 0x7f1c88140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45880/0 (socket says 172.21.15.106:45880) 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8cf0e640 1 -- 172.21.15.106:0/826219256 learned_addr learned my addr 172.21.15.106:0/826219256 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 561581517 0 0) 0x7f1c880a2d10 con 0x7f1c88138220 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient(hunting): my global_id is 274207 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c70003530 con 0x7f1c88138220 2024-04-26T00:11:00.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1009959547 0 0) 0x7f1c70003530 con 0x7f1c88138220 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 >> v1:172.21.15.171:6790/0 conn(0x7f1c880a0b20 legacy=0x7f1c8813ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 >> v1:172.21.15.171:6789/0 conn(0x7f1c88137730 legacy=0x7f1c88137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 monclient: found mon.noname-c 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880a4680 con 0x7f1c88138220 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: _finish_auth 0 2024-04-26T00:11:00.967 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c80001b40 con 0x7f1c88138220 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: dump: 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.968 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.969 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 5 monclient: authenticate success, global_id 274207 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c80001e30 con 0x7f1c88138220 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:00.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 1 -- 172.21.15.106:0/826219256 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c80004f70 con 0x7f1c88138220 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c86ffd640 10 monclient: dump: 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.971 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.972 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 4 set_mon_vals no callback set 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: shutdown 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- 172.21.15.106:0/826219256 >> v1:172.21.15.106:6791/0 conn(0x7f1c88138220 legacy=0x7f1c88140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- 172.21.15.106:0/826219256 shutdown_connections 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- 172.21.15.106:0/826219256 >> 172.21.15.106:0/826219256 conn(0x7f1c880a6b80 msgr2=0x7f1c880a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:00.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- 172.21.15.106:0/826219256 shutdown_connections 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 1 -- 172.21.15.106:0/826219256 wait complete. 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: build_initial_monmap 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.972+0000 7f1c8e971640 10 monclient: monmap: 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:00.974 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:00.975 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 Processor -- start 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 -- start start 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient: init 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient: _add_conns ranks=[8,4,2,5,6,7,3,1,0] 2024-04-26T00:11:00.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient(hunting): picked mon.noname-e con 0x7f1c880a0b20 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient(hunting): picked mon.noname-c con 0x7f1c88137730 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient(hunting): picked mon.noname-b con 0x7f1c88138220 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c881307b0 con 0x7f1c88138220 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c88131d00 con 0x7f1c88137730 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1c88130e60 con 0x7f1c880a0b20 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient(hunting): authenticate will time out at 1916.504935s 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c87fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f1c880a0b20 0x7f1c8812f990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33452/0 (socket says 172.21.15.106:33452) 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c877fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f1c88137730 0x7f1c881300a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45896/0 (socket says 172.21.15.106:45896) 2024-04-26T00:11:00.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c87fff640 1 -- 172.21.15.106:0/1813299516 learned_addr learned my addr 172.21.15.106:0/1813299516 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8cf0e640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f1c88138220 0x7f1c881d4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44258/0 (socket says 172.21.15.106:44258) 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148978648 0 0) 0x7f1c88130e60 con 0x7f1c880a0b20 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): my global_id is 225026 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c74003530 con 0x7f1c880a0b20 2024-04-26T00:11:00.978 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4063086353 0 0) 0x7f1c88131d00 con 0x7f1c88137730 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): my global_id is 274216 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c88130e60 con 0x7f1c88137730 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 996629450 0 0) 0x7f1c881307b0 con 0x7f1c88138220 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): my global_id is 254414 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c88131d00 con 0x7f1c88138220 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3815533303 0 0) 0x7f1c74003530 con 0x7f1c880a0b20 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c881307b0 con 0x7f1c880a0b20 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c7c001a50 con 0x7f1c880a0b20 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): dump: 2024-04-26T00:11:00.980 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.981 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1352345777 0 0) 0x7f1c88131d00 con 0x7f1c88138220 2024-04-26T00:11:00.982 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c74003530 con 0x7f1c88138220 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c80001b00 con 0x7f1c88138220 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): dump: 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.983 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.984 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2246934485 0 0) 0x7f1c88130e60 con 0x7f1c88137730 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c88131d00 con 0x7f1c88137730 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c78001a60 con 0x7f1c88137730 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): dump: 2024-04-26T00:11:00.985 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.986 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1845852501 0 0) 0x7f1c881307b0 con 0x7f1c880a0b20 2024-04-26T00:11:00.987 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.106:6791/0 conn(0x7f1c88137730 legacy=0x7f1c881300a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.106:6790/0 conn(0x7f1c88138220 legacy=0x7f1c881d4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 monclient: found mon.e 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c880a1e20 con 0x7f1c880a0b20 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: _finish_auth 0 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:11:00.988 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 5 monclient: authenticate success, global_id 225026 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient: _renew_subs 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1c88132cb0 con 0x7f1c880a0b20 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient: _renew_subs 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f1c88131740 con 0x7f1c880a0b20 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1c7c0038d0 con 0x7f1c880a0b20 2024-04-26T00:11:00.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c7c003dc0 con 0x7f1c880a0b20 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c867fc640 4 set_mon_vals no callback set 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: dump: 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.990 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.991 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c680065d0 con 0x7f1c68002870 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1c7c003fe0 con 0x7f1c880a0b20 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f1c7c0451c0 con 0x7f1c880a0b20 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692551936 0 0) 0x7f1c680065d0 con 0x7f1c68002870 2024-04-26T00:11:00.992 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient(hunting): my global_id is 254423 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c881307b0 con 0x7f1c68002870 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c8cf0e640 10 monclient: get_auth_request con 0x7f1c740381b0 auth_method 0 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2039677271 0 0) 0x7f1c881307b0 con 0x7f1c68002870 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c680065d0 con 0x7f1c68002870 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c78003b50 con 0x7f1c68002870 2024-04-26T00:11:00.993 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 10 monclient: dump: 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.994 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:00.995 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2150568231 0 0) 0x7f1c680065d0 con 0x7f1c68002870 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.976+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c6800a160 con 0x7f1c68002870 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.980+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f1c780057d0 con 0x7f1c68002870 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.980+0000 7f1c84ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.980+0000 7f1c84ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.980+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.106:6790/0 conn(0x7f1c68002870 legacy=0x7f1c68004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.980+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.106:6790/0 conn(0x7f1c68002870 legacy=0x7f1c68004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:00.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1c68009e50 con 0x7f1c68009110 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4275692031 0 0) 0x7f1c68009e50 con 0x7f1c68009110 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient(hunting): my global_id is 254432 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1c680065d0 con 0x7f1c68009110 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1079715559 0 0) 0x7f1c680065d0 con 0x7f1c68009110 2024-04-26T00:11:00.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1c68009e50 con 0x7f1c68009110 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1c780042f0 con 0x7f1c68009110 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient: dump: 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:00.998 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:00.999 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 548684722 0 0) 0x7f1c68009e50 con 0x7f1c68009110 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f1c6800c3e0 con 0x7f1c68009110 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 3557930953) 0x7f1c78005980 con 0x7f1c68009110 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:01.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.106:6790/0 conn(0x7f1c68009110 legacy=0x7f1c680095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c84ff9640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.106:6790/0 conn(0x7f1c68009110 legacy=0x7f1c680095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.001 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:01.001 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 131041, 2024-04-26T00:11:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:01.002 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:01.003 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.004 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.005 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.006 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.007 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.008 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:01.009 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.010 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.011 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.012 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.013 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:01.014 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.015 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.016 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.017 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.018 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.019 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:01.020 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.021 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.022 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.023 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.024 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:01.025 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.171:6812/722422047 conn(0x7f1c740381b0 legacy=0x7f1c7403a670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 10 monclient: shutdown 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 >> v1:172.21.15.106:6793/0 conn(0x7f1c880a0b20 legacy=0x7f1c8812f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8cf0e640 1 -- 172.21.15.106:0/1813299516 reap_dead start 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8cf0e640 1 -- 172.21.15.106:0/1813299516 reap_dead start 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 shutdown_connections 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 >> 172.21.15.106:0/1813299516 conn(0x7f1c880a6b80 msgr2=0x7f1c8812e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 shutdown_connections 2024-04-26T00:11:01.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:00.984+0000 7f1c8e971640 1 -- 172.21.15.106:0/1813299516 wait complete. 2024-04-26T00:11:01.028 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:01.028 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:11:01.028 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.176+0000 7f8bc8543640 10 monclient: get_monmap_and_config 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.176+0000 7f8bc8543640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.176+0000 7f8bc8543640 10 monclient: monmap: 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:01.181076+0000 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:01.181076+0000 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.153 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.154 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.154 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.176+0000 7f8bc8543640 1 Processor -- start 2024-04-26T00:11:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.176+0000 7f8bc8543640 1 -- start start 2024-04-26T00:11:01.161 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.176+0000 7f8bc8543640 10 monclient: init 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: _add_conns ranks=[5,8,2,6,1,0,3,7,4] 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): picked mon.noname-h con 0x7f8bc0135870 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): picked mon.noname-e con 0x7f8bc01353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): picked mon.noname-b con 0x7f8bc013bdf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc006f2d0 con 0x7f8bc013bdf0 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc0072330 con 0x7f8bc0135870 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc0072610 con 0x7f8bc01353b0 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): authenticate will time out at 1916.708371s 2024-04-26T00:11:01.162 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc6ae0640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f8bc013bdf0 0x7f8bc013e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44284/0 (socket says 172.21.15.106:44284) 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc6ae0640 1 -- 172.21.15.106:0/2789837139 learned_addr learned my addr 172.21.15.106:0/2789837139 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc5ade640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f8bc01353b0 0x7f8bc013a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33456/0 (socket says 172.21.15.106:33456) 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 112237962 0 0) 0x7f8bc006f2d0 con 0x7f8bc013bdf0 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): my global_id is 254441 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ba8003530 con 0x7f8bc013bdf0 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2341894351 0 0) 0x7f8bc0072610 con 0x7f8bc01353b0 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient(hunting): my global_id is 225035 2024-04-26T00:11:01.163 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc006f2d0 con 0x7f8bc01353b0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2311644203 0 0) 0x7f8ba8003530 con 0x7f8bc013bdf0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 >> v1:172.21.15.106:6793/0 conn(0x7f8bc01353b0 legacy=0x7f8bc013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 >> v1:172.21.15.171:6791/0 conn(0x7f8bc0135870 legacy=0x7f8bc0135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 monclient: found mon.noname-b 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc00a3260 con 0x7f8bc013bdf0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bb00017c0 con 0x7f8bc013bdf0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:01.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: dump: 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.165 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 5 monclient: authenticate success, global_id 254441 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bb0001aa0 con 0x7f8bc013bdf0 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 4 set_mon_vals no callback set 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 1 -- 172.21.15.106:0/2789837139 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bb0004bf0 con 0x7f8bc013bdf0 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc52dd640 10 monclient: dump: 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.166 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: shutdown 2024-04-26T00:11:01.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- 172.21.15.106:0/2789837139 >> v1:172.21.15.106:6790/0 conn(0x7f8bc013bdf0 legacy=0x7f8bc013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- 172.21.15.106:0/2789837139 shutdown_connections 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- 172.21.15.106:0/2789837139 >> 172.21.15.106:0/2789837139 conn(0x7f8bc00a64e0 msgr2=0x7f8bc00a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- 172.21.15.106:0/2789837139 shutdown_connections 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- 172.21.15.106:0/2789837139 wait complete. 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: monmap: 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.168 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 Processor -- start 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- start start 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: init 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient: _add_conns ranks=[1,3,0,7,8,5,2,4,6] 2024-04-26T00:11:01.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): picked mon.noname-f con 0x7f8bc01353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): picked mon.noname-g con 0x7f8bc0135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): picked mon.noname-a con 0x7f8bc013bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc013ed50 con 0x7f8bc013bdf0 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc0133da0 con 0x7f8bc01353b0 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bc0134080 con 0x7f8bc0135870 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc8543640 10 monclient(hunting): authenticate will time out at 1916.711205s 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc6ae0640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8bc013bdf0 0x7f8bc01d44e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38128/0 (socket says 172.21.15.106:38128) 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bc6ae0640 1 -- 172.21.15.106:0/2140026394 learned_addr learned my addr 172.21.15.106:0/2140026394 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497581625 0 0) 0x7f8bc013ed50 con 0x7f8bc013bdf0 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): my global_id is 274185 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bac003530 con 0x7f8bc013bdf0 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4114206184 0 0) 0x7f8bac003530 con 0x7f8bc013bdf0 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8bc013ed50 con 0x7f8bc013bdf0 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bb0004b30 con 0x7f8bc013bdf0 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): dump: 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.171 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4160959951 0 0) 0x7f8bc0133da0 con 0x7f8bc01353b0 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 10 monclient(hunting): my global_id is 225127 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bac003530 con 0x7f8bc01353b0 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 36877188 0 0) 0x7f8bc013ed50 con 0x7f8bc013bdf0 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.180+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.171:6790/0 conn(0x7f8bc0135870 legacy=0x7f8bc012d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.171:6789/0 conn(0x7f8bc01353b0 legacy=0x7f8bc0134a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 monclient: found mon.a 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bc0134360 con 0x7f8bc013bdf0 2024-04-26T00:11:01.173 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 5 monclient: authenticate success, global_id 274185 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 10 monclient: _renew_subs 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8bc013e3b0 con 0x7f8bc013bdf0 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 10 monclient: _renew_subs 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f8bc012dd80 con 0x7f8bc013bdf0 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8bb0001180 con 0x7f8bc013bdf0 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bb0005150 con 0x7f8bc013bdf0 2024-04-26T00:11:01.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc4adc640 4 set_mon_vals no callback set 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: dump: 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.175 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8ba00065d0 con 0x7f8ba0002870 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8bb000fef0 con 0x7f8bc013bdf0 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f8bb0045080 con 0x7f8bc013bdf0 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1774195037 0 0) 0x7f8ba00065d0 con 0x7f8ba0002870 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient(hunting): my global_id is 274225 2024-04-26T00:11:01.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bc013ed50 con 0x7f8ba0002870 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bc5ade640 10 monclient: get_auth_request con 0x7f8bac037710 auth_method 0 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2534190706 0 0) 0x7f8bc013ed50 con 0x7f8ba0002870 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ba00065d0 con 0x7f8ba0002870 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bb8001c40 con 0x7f8ba0002870 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: dump: 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.177 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3922971538 0 0) 0x7f8ba00065d0 con 0x7f8ba0002870 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8ba000a160 con 0x7f8ba0002870 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8bb80049d0 con 0x7f8ba0002870 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:01.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.106:6791/0 conn(0x7f8ba0002870 legacy=0x7f8ba0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.184+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.106:6791/0 conn(0x7f8ba0002870 legacy=0x7f8ba0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8ba0009e30 con 0x7f8ba00090f0 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3990768613 0 0) 0x7f8ba0009e30 con 0x7f8ba00090f0 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient(hunting): my global_id is 274234 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8ba00065d0 con 0x7f8ba00090f0 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 544184662 0 0) 0x7f8ba00065d0 con 0x7f8ba00090f0 2024-04-26T00:11:01.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8ba0009e30 con 0x7f8ba00090f0 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8bb8003f70 con 0x7f8ba00090f0 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient: dump: 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.181 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4065251486 0 0) 0x7f8ba0009e30 con 0x7f8ba00090f0 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8ba000c3a0 con 0x7f8ba00090f0 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7564 (unknown 0 0 835409297) 0x7f8bb8004b80 con 0x7f8ba00090f0 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.106:6791/0 conn(0x7f8ba00090f0 legacy=0x7f8ba0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bbeffd640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.106:6791/0 conn(0x7f8ba00090f0 legacy=0x7f8ba0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 9271, 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:01.183 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.184 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.185 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:01.186 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.187 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:01.188 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.189 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.190 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.191 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:01.192 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.193 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.194 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.195 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.196 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.197 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.198 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.199 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.200 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.201 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:01.201 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.171:6812/722422047 conn(0x7f8bac037710 legacy=0x7f8bac039bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 10 monclient: shutdown 2024-04-26T00:11:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 >> v1:172.21.15.106:6789/0 conn(0x7f8bc013bdf0 legacy=0x7f8bc01d44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc6ae0640 1 -- 172.21.15.106:0/2140026394 reap_dead start 2024-04-26T00:11:01.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc6ae0640 1 -- 172.21.15.106:0/2140026394 reap_dead start 2024-04-26T00:11:01.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 shutdown_connections 2024-04-26T00:11:01.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 >> 172.21.15.106:0/2140026394 conn(0x7f8bc00a64e0 msgr2=0x7f8bc0070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 shutdown_connections 2024-04-26T00:11:01.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.192+0000 7f8bc8543640 1 -- 172.21.15.106:0/2140026394 wait complete. 2024-04-26T00:11:01.203 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:01.203 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:11:01.204 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:11:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient: get_monmap_and_config 2024-04-26T00:11:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient: monmap: 2024-04-26T00:11:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:01.351571+0000 2024-04-26T00:11:01.323 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:01.351571+0000 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.324 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 1 Processor -- start 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 1 -- start start 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient: init 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient: _add_conns ranks=[4,5,2,3,8,0,1,7,6] 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient(hunting): picked mon.noname-c con 0x7f4254134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient(hunting): picked mon.noname-h con 0x7f42540a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient(hunting): picked mon.noname-b con 0x7f425413e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f425406dd40 con 0x7f425413e200 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540a2b10 con 0x7f4254134970 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540a2df0 con 0x7f42540a4820 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4259c8d640 10 monclient(hunting): authenticate will time out at 1916.879455s 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4253fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f425413e200 0x7f42541405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44300/0 (socket says 172.21.15.106:44300) 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f42537fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f4254134970 0x7f4254134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45918/0 (socket says 172.21.15.106:45918) 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f42537fe640 1 -- 172.21.15.106:0/658596435 learned_addr learned my addr 172.21.15.106:0/658596435 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110614161 0 0) 0x7f425406dd40 con 0x7f425413e200 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): my global_id is 254450 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4240003530 con 0x7f425413e200 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675163774 0 0) 0x7f42540a2b10 con 0x7f4254134970 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 10 monclient(hunting): my global_id is 274243 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.348+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f425406dd40 con 0x7f4254134970 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2361490860 0 0) 0x7f4240003530 con 0x7f425413e200 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 >> v1:172.21.15.171:6791/0 conn(0x7f42540a4820 legacy=0x7f425413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 >> v1:172.21.15.106:6791/0 conn(0x7f4254134970 legacy=0x7f4254134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 monclient: found mon.noname-b 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42540a30d0 con 0x7f425413e200 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f424c001b40 con 0x7f425413e200 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 5 monclient: authenticate success, global_id 254450 2024-04-26T00:11:01.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: dump: 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.335 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f424c001da0 con 0x7f425413e200 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 1 -- 172.21.15.106:0/658596435 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f424c004eb0 con 0x7f425413e200 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 4 set_mon_vals no callback set 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4252ffd640 10 monclient: dump: 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.337 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: shutdown 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/658596435 >> v1:172.21.15.106:6790/0 conn(0x7f425413e200 legacy=0x7f42541405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/658596435 shutdown_connections 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/658596435 >> 172.21.15.106:0/658596435 conn(0x7f42540a9e20 msgr2=0x7f42540aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/658596435 shutdown_connections 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/658596435 wait complete. 2024-04-26T00:11:01.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: monmap: 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.339 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 Processor -- start 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- start start 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: init 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: _add_conns ranks=[2,1,7,3,0,5,6,8,4] 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient(hunting): picked mon.noname-b con 0x7f42540a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient(hunting): picked mon.noname-f con 0x7f4254134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient(hunting): picked mon.noname-i con 0x7f425413e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540a1e00 con 0x7f4254134970 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42540a1a40 con 0x7f42540a4820 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42541391e0 con 0x7f425413e200 2024-04-26T00:11:01.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient(hunting): authenticate will time out at 1916.882392s 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f42537fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f42540a4820 0x7f425412a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44316/0 (socket says 172.21.15.106:44316) 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f42537fe640 1 -- 172.21.15.106:0/3675817789 learned_addr learned my addr 172.21.15.106:0/3675817789 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064884031 0 0) 0x7f42540a1a40 con 0x7f42540a4820 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): my global_id is 254459 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4234003530 con 0x7f42540a4820 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3263241752 0 0) 0x7f4234003530 con 0x7f42540a4820 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42540a1a40 con 0x7f42540a4820 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f42440014a0 con 0x7f42540a4820 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:01.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): dump: 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.342 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3421146422 0 0) 0x7f42540a1a40 con 0x7f42540a4820 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.171:6792/0 conn(0x7f425413e200 legacy=0x7f42541d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.171:6789/0 conn(0x7f4254134970 legacy=0x7f42541d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 monclient: found mon.b 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42541394c0 con 0x7f42540a4820 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 5 monclient: authenticate success, global_id 254459 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: _renew_subs 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42541388b0 con 0x7f42540a4820 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: _renew_subs 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f42541366d0 con 0x7f42540a4820 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4244004aa0 con 0x7f42540a4820 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4244004f90 con 0x7f42540a4820 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f42527fc640 4 set_mon_vals no callback set 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4250ff9640 10 monclient: dump: 2024-04-26T00:11:01.344 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.345 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.352+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f42380065d0 con 0x7f4238002870 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f424400fd30 con 0x7f42540a4820 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f4244045200 con 0x7f42540a4820 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 367470034 0 0) 0x7f42380065d0 con 0x7f4238002870 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient(hunting): my global_id is 254445 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42540a1a40 con 0x7f4238002870 2024-04-26T00:11:01.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4253fff640 10 monclient: get_auth_request con 0x7f42340378b0 auth_method 0 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1076720620 0 0) 0x7f42540a1a40 con 0x7f4238002870 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42380065d0 con 0x7f4238002870 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f423c0017f0 con 0x7f4238002870 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient: dump: 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.347 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1658352755 0 0) 0x7f42380065d0 con 0x7f4238002870 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f423800a160 con 0x7f4238002870 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f423c001d00 con 0x7f4238002870 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.106:6792/0 conn(0x7f4238002870 legacy=0x7f4238004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.356+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.106:6792/0 conn(0x7f4238002870 legacy=0x7f4238004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4259c8d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:01.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4238009e50 con 0x7f4238009110 2024-04-26T00:11:01.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 756122133 0 0) 0x7f4238009e50 con 0x7f4238009110 2024-04-26T00:11:01.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 10 monclient(hunting): my global_id is 254454 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42380065d0 con 0x7f4238009110 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4109082470 0 0) 0x7f42380065d0 con 0x7f4238009110 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4238009e50 con 0x7f4238009110 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f423c003bd0 con 0x7f4238009110 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 10 monclient: dump: 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.351 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 682794572 0 0) 0x7f4238009e50 con 0x7f4238009110 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.360+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f423800c3e0 con 0x7f4238009110 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 3322109606) 0x7f423c003f00 con 0x7f4238009110 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4250ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4250ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.106:6792/0 conn(0x7f4238009110 legacy=0x7f42380095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.352 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4250ff9640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.106:6792/0 conn(0x7f4238009110 legacy=0x7f42380095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 131425, 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:01.353 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.354 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.355 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:01.356 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.357 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.358 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.359 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.360 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.361 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.362 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.363 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.364 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.365 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.366 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.367 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.368 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.369 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.370 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:11:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.371 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:01.371 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:01.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.171:6812/722422047 conn(0x7f42340378b0 legacy=0x7f4234039d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 10 monclient: shutdown 2024-04-26T00:11:01.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 >> v1:172.21.15.106:6790/0 conn(0x7f42540a4820 legacy=0x7f425412a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4253fff640 1 -- 172.21.15.106:0/3675817789 reap_dead start 2024-04-26T00:11:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4253fff640 1 -- 172.21.15.106:0/3675817789 reap_dead start 2024-04-26T00:11:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 shutdown_connections 2024-04-26T00:11:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 >> 172.21.15.106:0/3675817789 conn(0x7f42540a9e20 msgr2=0x7f4254130c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 shutdown_connections 2024-04-26T00:11:01.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.364+0000 7f4259c8d640 1 -- 172.21.15.106:0/3675817789 wait complete. 2024-04-26T00:11:01.373 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:01.373 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:11:01.373 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:11:01.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.512+0000 7fd4cba24640 10 monclient: get_monmap_and_config 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.512+0000 7fd4cba24640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.512+0000 7fd4cba24640 10 monclient: monmap: 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:01.518094+0000 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:01.518094+0000 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.499 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 Processor -- start 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- start start 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: init 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: _add_conns ranks=[6,1,8,7,3,2,0,4,5] 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient(hunting): picked mon.noname-d con 0x7fd4c4135870 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:01.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient(hunting): picked mon.noname-f con 0x7fd4c41353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient(hunting): picked mon.noname-e con 0x7fd4c413bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c406f2d0 con 0x7fd4c41353b0 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c4072330 con 0x7fd4c4135870 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c4072610 con 0x7fd4c413bdf0 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient(hunting): authenticate will time out at 1917.045257s 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4c97c0640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fd4c4135870 0x7fd4c4135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41870/0 (socket says 172.21.15.106:41870) 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4c97c0640 1 -- 172.21.15.106:0/1284371496 learned_addr learned my addr 172.21.15.106:0/1284371496 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4c9fc1640 1 --1- 172.21.15.106:0/1284371496 >> v1:172.21.15.106:6793/0 conn(0x7fd4c413bdf0 0x7fd4c413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33458/0 (socket says 172.21.15.106:33458) 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686608051 0 0) 0x7fd4c4072610 con 0x7fd4c413bdf0 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): my global_id is 225044 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4b0003530 con 0x7fd4c413bdf0 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2759253687 0 0) 0x7fd4c4072330 con 0x7fd4c4135870 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient(hunting): my global_id is 254463 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c4072610 con 0x7fd4c4135870 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2021482034 0 0) 0x7fd4b0003530 con 0x7fd4c413bdf0 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 >> v1:172.21.15.106:6792/0 conn(0x7fd4c4135870 legacy=0x7fd4c4135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 >> v1:172.21.15.171:6789/0 conn(0x7fd4c41353b0 legacy=0x7fd4c413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 monclient: found mon.noname-e 2024-04-26T00:11:01.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c40a3260 con 0x7fd4c413bdf0 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 5 monclient: authenticate success, global_id 225044 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4bc001b80 con 0x7fd4c413bdf0 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: dump: 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.503 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:01.504 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4bc001e50 con 0x7fd4c413bdf0 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 4 set_mon_vals no callback set 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 1 -- 172.21.15.106:0/1284371496 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4bc004eb0 con 0x7fd4c413bdf0 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4bbfff640 10 monclient: dump: 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.505 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: shutdown 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- 172.21.15.106:0/1284371496 >> v1:172.21.15.106:6793/0 conn(0x7fd4c413bdf0 legacy=0x7fd4c413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- 172.21.15.106:0/1284371496 shutdown_connections 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- 172.21.15.106:0/1284371496 >> 172.21.15.106:0/1284371496 conn(0x7fd4c40a64e0 msgr2=0x7fd4c40a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- 172.21.15.106:0/1284371496 shutdown_connections 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- 172.21.15.106:0/1284371496 wait complete. 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: monmap: 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.507 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 Processor -- start 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 1 -- start start 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.516+0000 7fd4cba24640 10 monclient: init 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient: _add_conns ranks=[4,0,2,5,6,1,8,7,3] 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient(hunting): picked mon.noname-c con 0x7fd4c41353b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient(hunting): picked mon.noname-a con 0x7fd4c4135870 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient(hunting): picked mon.noname-b con 0x7fd4c413bdf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c413e6d0 con 0x7fd4c4135870 2024-04-26T00:11:01.508 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c409f930 con 0x7fd4c413bdf0 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c4137450 con 0x7fd4c41353b0 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient(hunting): authenticate will time out at 1917.048173s 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4c97c0640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fd4c41353b0 0x7fd4c41ccbf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45926/0 (socket says 172.21.15.106:45926) 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4c97c0640 1 -- 172.21.15.106:0/3870509912 learned_addr learned my addr 172.21.15.106:0/3870509912 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4c8fbf640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd4c4135870 0x7fd4c41d1bd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38136/0 (socket says 172.21.15.106:38136) 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1059334107 0 0) 0x7fd4c4137450 con 0x7fd4c41353b0 2024-04-26T00:11:01.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): my global_id is 274252 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4a8003530 con 0x7fd4c41353b0 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3897715243 0 0) 0x7fd4c40a3260 con 0x7fd4c413bdf0 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): my global_id is 254468 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c4137450 con 0x7fd4c413bdf0 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103193186 0 0) 0x7fd4c413e6d0 con 0x7fd4c4135870 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): my global_id is 274194 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c40a3260 con 0x7fd4c4135870 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 571077008 0 0) 0x7fd4a8003530 con 0x7fd4c41353b0 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4c413e6d0 con 0x7fd4c41353b0 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4b4001aa0 con 0x7fd4c41353b0 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): dump: 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.511 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2725942950 0 0) 0x7fd4c4137450 con 0x7fd4c413bdf0 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4a8003530 con 0x7fd4c413bdf0 2024-04-26T00:11:01.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4bc001b40 con 0x7fd4c413bdf0 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): dump: 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.513 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 476642215 0 0) 0x7fd4c40a3260 con 0x7fd4c4135870 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4c4137450 con 0x7fd4c4135870 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4c0001950 con 0x7fd4c4135870 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.514 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): dump: 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.515 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2119824314 0 0) 0x7fd4c413e6d0 con 0x7fd4c41353b0 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.106:6790/0 conn(0x7fd4c413bdf0 legacy=0x7fd4c41d5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.106:6789/0 conn(0x7fd4c4135870 legacy=0x7fd4c41d1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 monclient: found mon.c 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c409f470 con 0x7fd4c41353b0 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.516 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 5 monclient: authenticate success, global_id 274252 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient: _renew_subs 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c4070c10 con 0x7fd4c41353b0 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient: _renew_subs 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd4c4135c50 con 0x7fd4c41353b0 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd4b4004aa0 con 0x7fd4c41353b0 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd4c4075890 con 0x7fd4c4070500 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4b4004f90 con 0x7fd4c41353b0 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:01.517 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4bb7fe640 4 set_mon_vals no callback set 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: dump: 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.518 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd4b40051f0 con 0x7fd4c41353b0 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fd4b4045380 con 0x7fd4c41353b0 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320911031 0 0) 0x7fd4c4075890 con 0x7fd4c4070500 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient(hunting): my global_id is 225053 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c413e6d0 con 0x7fd4c4070500 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4c9fc1640 10 monclient: get_auth_request con 0x7fd4a80381a0 auth_method 0 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2929947346 0 0) 0x7fd4c413e6d0 con 0x7fd4c4070500 2024-04-26T00:11:01.519 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4c4075890 con 0x7fd4c4070500 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4c0003940 con 0x7fd4c4070500 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: dump: 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.520 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 267314044 0 0) 0x7fd4c4075890 con 0x7fd4c4070500 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4c40708e0 con 0x7fd4c4070500 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd4c00057d0 con 0x7fd4c4070500 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.106:6793/0 conn(0x7fd4c4070500 legacy=0x7fd4c413cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.521 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.520+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.106:6793/0 conn(0x7fd4c4070500 legacy=0x7fd4c413cfb0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd4c4062e50 con 0x7fd4c41cd300 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3181029095 0 0) 0x7fd4c4062e50 con 0x7fd4c41cd300 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient(hunting): my global_id is 225062 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4c4075890 con 0x7fd4c41cd300 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2816948728 0 0) 0x7fd4c4075890 con 0x7fd4c41cd300 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4c4062e50 con 0x7fd4c41cd300 2024-04-26T00:11:01.523 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4c0004250 con 0x7fd4c41cd300 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient: dump: 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.524 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1192585178 0 0) 0x7fd4c4062e50 con 0x7fd4c41cd300 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd4c4136cd0 con 0x7fd4c41cd300 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 1116233383) 0x7fd4c00079c0 con 0x7fd4c41cd300 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.106:6793/0 conn(0x7fd4c41cd300 legacy=0x7fd4c413d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4b9ffb640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.106:6793/0 conn(0x7fd4c41cd300 legacy=0x7fd4c413d6c0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 374760, 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:01.526 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.527 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.528 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:01.529 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.530 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.531 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.532 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.533 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.534 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.535 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.536 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.537 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.538 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.539 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.540 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.541 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.542 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.543 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.544 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.545 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:01.545 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.171:6812/722422047 conn(0x7fd4a80381a0 legacy=0x7fd4a803a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 10 monclient: shutdown 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 >> v1:172.21.15.106:6791/0 conn(0x7fd4c41353b0 legacy=0x7fd4c41ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4c9fc1640 1 -- 172.21.15.106:0/3870509912 reap_dead start 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4c9fc1640 1 -- 172.21.15.106:0/3870509912 reap_dead start 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 shutdown_connections 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 >> 172.21.15.106:0/3870509912 conn(0x7fd4c40a64e0 msgr2=0x7fd4c413c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 shutdown_connections 2024-04-26T00:11:01.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.528+0000 7fd4cba24640 1 -- 172.21.15.106:0/3870509912 wait complete. 2024-04-26T00:11:01.547 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:01.547 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:11:01.547 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:11:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: get_monmap_and_config 2024-04-26T00:11:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: monmap: 2024-04-26T00:11:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.662 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:01.690680+0000 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:01.690680+0000 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.663 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 Processor -- start 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- start start 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: init 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: _add_conns ranks=[2,5,8,1,6,0,7,3,4] 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient(hunting): picked mon.noname-b con 0x7fb460134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient(hunting): picked mon.noname-h con 0x7fb4600a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient(hunting): picked mon.noname-e con 0x7fb46013e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:01.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb46006dd40 con 0x7fb460134970 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4600a2b10 con 0x7fb4600a4820 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4600a2df0 con 0x7fb46013e200 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient(hunting): authenticate will time out at 1917.217850s 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45effd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fb460134970 0x7fb460134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44324/0 (socket says 172.21.15.106:44324) 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45effd640 1 -- 172.21.15.106:0/2711221014 learned_addr learned my addr 172.21.15.106:0/2711221014 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3679890089 0 0) 0x7fb46006dd40 con 0x7fb460134970 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): my global_id is 254477 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb44c003530 con 0x7fb460134970 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4225428888 0 0) 0x7fb4600a2df0 con 0x7fb46013e200 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient(hunting): my global_id is 225071 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb46006dd40 con 0x7fb46013e200 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 587510448 0 0) 0x7fb46006dd40 con 0x7fb46013e200 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 >> v1:172.21.15.171:6791/0 conn(0x7fb4600a4820 legacy=0x7fb46013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 >> v1:172.21.15.106:6790/0 conn(0x7fb460134970 legacy=0x7fb460134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 monclient: found mon.noname-e 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4600a30d0 con 0x7fb46013e200 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb458001b40 con 0x7fb46013e200 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: dump: 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.674 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 5 monclient: authenticate success, global_id 225071 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb458001d30 con 0x7fb46013e200 2024-04-26T00:11:01.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 1 -- 172.21.15.106:0/2711221014 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb4580039a0 con 0x7fb46013e200 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 4 set_mon_vals no callback set 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb45e7fc640 10 monclient: dump: 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.676 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 10 monclient: shutdown 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- 172.21.15.106:0/2711221014 >> v1:172.21.15.106:6793/0 conn(0x7fb46013e200 legacy=0x7fb4601405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- 172.21.15.106:0/2711221014 shutdown_connections 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- 172.21.15.106:0/2711221014 >> 172.21.15.106:0/2711221014 conn(0x7fb4600a9e20 msgr2=0x7fb4600aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- 172.21.15.106:0/2711221014 shutdown_connections 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.688+0000 7fb4658bd640 1 -- 172.21.15.106:0/2711221014 wait complete. 2024-04-26T00:11:01.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: monmap: 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.678 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 Processor -- start 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 -- start start 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: init 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: _add_conns ranks=[8,6,0,5,1,3,7,2,4] 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient(hunting): picked mon.noname-e con 0x7fb4600a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient(hunting): picked mon.noname-d con 0x7fb460134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient(hunting): picked mon.noname-a con 0x7fb46013e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4600a1e00 con 0x7fb46013e200 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4601392c0 con 0x7fb460134970 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4601373e0 con 0x7fb4600a4820 2024-04-26T00:11:01.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient(hunting): authenticate will time out at 1917.221032s 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45effd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fb4600a4820 0x7fb46012a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:33506/0 (socket says 172.21.15.106:33506) 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45effd640 1 -- 172.21.15.106:0/1103282937 learned_addr learned my addr 172.21.15.106:0/1103282937 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2185196044 0 0) 0x7fb4601392c0 con 0x7fb460134970 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): my global_id is 254472 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb440003530 con 0x7fb460134970 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838548678 0 0) 0x7fb4600a30d0 con 0x7fb46013e200 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): my global_id is 274203 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4601392c0 con 0x7fb46013e200 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1728985598 0 0) 0x7fb4601373e0 con 0x7fb4600a4820 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): my global_id is 225080 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4600a30d0 con 0x7fb4600a4820 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3677735866 0 0) 0x7fb440003530 con 0x7fb460134970 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4601373e0 con 0x7fb460134970 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb450001a20 con 0x7fb460134970 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): dump: 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.681 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1517882534 0 0) 0x7fb4601392c0 con 0x7fb46013e200 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb440003530 con 0x7fb46013e200 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb458001a40 con 0x7fb46013e200 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): dump: 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.683 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3391309512 0 0) 0x7fb4600a30d0 con 0x7fb4600a4820 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4601392c0 con 0x7fb4600a4820 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1527903663 0 0) 0x7fb4601373e0 con 0x7fb460134970 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.106:6793/0 conn(0x7fb4600a4820 legacy=0x7fb46012a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.106:6789/0 conn(0x7fb46013e200 legacy=0x7fb4601d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 monclient: found mon.d 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb460138fe0 con 0x7fb460134970 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 5 monclient: authenticate success, global_id 254472 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: _renew_subs 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb460137aa0 con 0x7fb460134970 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: _renew_subs 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb4601366d0 con 0x7fb460134970 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb450003950 con 0x7fb460134970 2024-04-26T00:11:01.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb450003e40 con 0x7fb460134970 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45dffb640 4 set_mon_vals no callback set 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient: dump: 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.686 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb4440065d0 con 0x7fb444002870 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb450004060 con 0x7fb460134970 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fb4500440b0 con 0x7fb460134970 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45f7fe640 10 monclient: get_auth_request con 0x7fb440038030 auth_method 0 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1439834951 0 0) 0x7fb4440065d0 con 0x7fb444002870 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 10 monclient(hunting): my global_id is 225154 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.692+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4601373e0 con 0x7fb444002870 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 615568359 0 0) 0x7fb4601373e0 con 0x7fb444002870 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4440065d0 con 0x7fb444002870 2024-04-26T00:11:01.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb448004b30 con 0x7fb444002870 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 10 monclient: dump: 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.691 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.692 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.692 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2798305560 0 0) 0x7fb4440065d0 con 0x7fb444002870 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb44400a160 con 0x7fb444002870 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb448005fd0 con 0x7fb444002870 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.171:6789/0 conn(0x7fb444002870 legacy=0x7fb444004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.693 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.696+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.171:6789/0 conn(0x7fb444002870 legacy=0x7fb444004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.700+0000 7fb4658bd640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.700+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb444009e50 con 0x7fb444009110 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.700+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459881539 0 0) 0x7fb444009e50 con 0x7fb444009110 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient(hunting): my global_id is 225163 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4440065d0 con 0x7fb444009110 2024-04-26T00:11:01.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1338895092 0 0) 0x7fb4440065d0 con 0x7fb444009110 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb444009e50 con 0x7fb444009110 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb448006830 con 0x7fb444009110 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient: dump: 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.696 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1942642504 0 0) 0x7fb444009e50 con 0x7fb444009110 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb44400c3e0 con 0x7fb444009110 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 2620031341) 0x7fb448006a90 con 0x7fb444009110 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:01.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:01.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.171:6789/0 conn(0x7fb444009110 legacy=0x7fb4440095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45cff9640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.171:6789/0 conn(0x7fb444009110 legacy=0x7fb4440095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 374936, 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:01.699 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.700 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.701 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:01.702 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.703 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:01.704 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.705 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:01.706 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.707 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.708 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.709 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.710 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:01.711 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.712 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.713 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.714 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.714 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.714 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.714 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.714 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.714 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:01.714 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.715 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.716 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.717 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.718 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:01.719 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.171:6812/722422047 conn(0x7fb440038030 legacy=0x7fb44003a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 10 monclient: shutdown 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 >> v1:172.21.15.106:6792/0 conn(0x7fb460134970 legacy=0x7fb4601d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45f7fe640 1 -- 172.21.15.106:0/1103282937 reap_dead start 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb45f7fe640 1 -- 172.21.15.106:0/1103282937 reap_dead start 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 shutdown_connections 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 >> 172.21.15.106:0/1103282937 conn(0x7fb4600a9e20 msgr2=0x7fb460130c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 shutdown_connections 2024-04-26T00:11:01.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.704+0000 7fb4658bd640 1 -- 172.21.15.106:0/1103282937 wait complete. 2024-04-26T00:11:01.722 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:01.722 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:11:01.722 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: get_monmap_and_config 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: monmap: 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:01.866530+0000 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:01.866530+0000 2024-04-26T00:11:01.838 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.839 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 Processor -- start 2024-04-26T00:11:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- start start 2024-04-26T00:11:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: init 2024-04-26T00:11:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: _add_conns ranks=[5,7,6,2,0,1,3,4,8] 2024-04-26T00:11:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient(hunting): picked mon.noname-h con 0x7f58b00a1b20 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:01.846 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient(hunting): picked mon.noname-i con 0x7f58b006be40 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient(hunting): picked mon.noname-d con 0x7f58b009fd70 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b00a3400 con 0x7f58b00a1b20 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b006b9b0 con 0x7f58b009fd70 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b009eaa0 con 0x7f58b006be40 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient(hunting): authenticate will time out at 1917.393661s 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58affff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f58b009fd70 0x7f58b0140390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41896/0 (socket says 172.21.15.106:41896) 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58affff640 1 -- 172.21.15.106:0/758745767 learned_addr learned my addr 172.21.15.106:0/758745767 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1375159074 0 0) 0x7f58b006b9b0 con 0x7f58b009fd70 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient(hunting): my global_id is 254481 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589c003530 con 0x7f58b009fd70 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1391959469 0 0) 0x7f589c003530 con 0x7f58b009fd70 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 >> v1:172.21.15.171:6792/0 conn(0x7f58b006be40 legacy=0x7f58b013cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 >> v1:172.21.15.171:6791/0 conn(0x7f58b00a1b20 legacy=0x7f58b00a1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 monclient: found mon.noname-d 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:11:01.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b006b470 con 0x7f58b009fd70 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58a00017c0 con 0x7f58b009fd70 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: dump: 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.849 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 5 monclient: authenticate success, global_id 254481 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:01.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58a0001b20 con 0x7f58b009fd70 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 1 -- 172.21.15.106:0/758745767 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58a0001d50 con 0x7f58b009fd70 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 4 set_mon_vals no callback set 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58ae7fc640 10 monclient: dump: 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.851 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: shutdown 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- 172.21.15.106:0/758745767 >> v1:172.21.15.106:6792/0 conn(0x7f58b009fd70 legacy=0x7f58b0140390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- 172.21.15.106:0/758745767 shutdown_connections 2024-04-26T00:11:01.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- 172.21.15.106:0/758745767 >> 172.21.15.106:0/758745767 conn(0x7f58b00a6fe0 msgr2=0x7f58b00a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- 172.21.15.106:0/758745767 shutdown_connections 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 1 -- 172.21.15.106:0/758745767 wait complete. 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: build_initial_monmap 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.864+0000 7f58b5b14640 10 monclient: monmap: 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.853 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 Processor -- start 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 -- start start 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient: init 2024-04-26T00:11:01.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient: _add_conns ranks=[4,0,1,6,7,8,3,2,5] 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient(hunting): picked mon.noname-c con 0x7f58b006be40 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient(hunting): picked mon.noname-a con 0x7f58b009fd70 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient(hunting): picked mon.noname-f con 0x7f58b00a1b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b013da80 con 0x7f58b009fd70 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b013fd70 con 0x7f58b00a1b20 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58b013ccf0 con 0x7f58b006be40 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient(hunting): authenticate will time out at 1917.396661s 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58aeffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f58b009fd70 0x7f58b013c5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:38152/0 (socket says 172.21.15.106:38152) 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58aeffd640 1 -- 172.21.15.106:0/2634837817 learned_addr learned my addr 172.21.15.106:0/2634837817 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984116881 0 0) 0x7f58b013ccf0 con 0x7f58b006be40 2024-04-26T00:11:01.855 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): my global_id is 274261 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5890003530 con 0x7f58b006be40 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924931157 0 0) 0x7f58b013da80 con 0x7f58b009fd70 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): my global_id is 274212 2024-04-26T00:11:01.856 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b013ccf0 con 0x7f58b009fd70 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4136934139 0 0) 0x7f5890003530 con 0x7f58b006be40 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58b013da80 con 0x7f58b006be40 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58a8001c70 con 0x7f58b006be40 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): dump: 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.857 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2430779361 0 0) 0x7f58b013ccf0 con 0x7f58b009fd70 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5890003530 con 0x7f58b009fd70 2024-04-26T00:11:01.858 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512169448 0 0) 0x7f58b013fd70 con 0x7f58b00a1b20 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): my global_id is 225172 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b013ccf0 con 0x7f58b00a1b20 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5898001a20 con 0x7f58b009fd70 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): dump: 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.859 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.860 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2549812869 0 0) 0x7f58b013da80 con 0x7f58b006be40 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.171:6789/0 conn(0x7f58b00a1b20 legacy=0x7f58b01d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.106:6789/0 conn(0x7f58b009fd70 legacy=0x7f58b013c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: _finish_hunting 0 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 monclient: found mon.c 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58b009e150 con 0x7f58b006be40 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: _finish_auth 0 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: _check_auth_tickets 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 5 monclient: authenticate success, global_id 274261 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient: _renew_subs 2024-04-26T00:11:01.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f58b0072600 con 0x7f58b006be40 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient: _renew_subs 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f58b013e2f0 con 0x7f58b006be40 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f58a8001ff0 con 0x7f58b006be40 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58a8003f90 con 0x7f58b006be40 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58adffb640 4 set_mon_vals no callback set 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: dump: 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.862 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58940065d0 con 0x7f5894002870 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f58a8004130 con 0x7f58b006be40 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f58a80441d0 con 0x7f58b006be40 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58affff640 10 monclient: get_auth_request con 0x7f5890038020 auth_method 0 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673460395 0 0) 0x7f58940065d0 con 0x7f5894002870 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient(hunting): my global_id is 215238 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58b013da80 con 0x7f5894002870 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1842164958 0 0) 0x7f58b013da80 con 0x7f5894002870 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58940065d0 con 0x7f5894002870 2024-04-26T00:11:01.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5898003b90 con 0x7f5894002870 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 10 monclient: dump: 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.865 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.866 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1852065726 0 0) 0x7f58940065d0 con 0x7f5894002870 2024-04-26T00:11:01.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.868+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f589400a160 con 0x7f5894002870 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.872+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f58980057d0 con 0x7f5894002870 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.872+0000 7f58a7fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.872+0000 7f58a7fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.872+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.171:6790/0 conn(0x7f5894002870 legacy=0x7f5894004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.872+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.171:6790/0 conn(0x7f5894002870 legacy=0x7f5894004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58b5b14640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5894009e30 con 0x7f58940090f0 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540774956 0 0) 0x7f5894009e30 con 0x7f58940090f0 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58a7fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58a7fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58a7fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58a7fff640 10 monclient(hunting): my global_id is 215247 2024-04-26T00:11:01.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.876+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58940065d0 con 0x7f58940090f0 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 627001654 0 0) 0x7f58940065d0 con 0x7f58940090f0 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5894009e30 con 0x7f58940090f0 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5898004360 con 0x7f58940090f0 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 10 monclient: dump: 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:01.869 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1918761934 0 0) 0x7f5894009e30 con 0x7f58940090f0 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f589400c3a0 con 0x7f58940090f0 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7906 (unknown 0 0 2549569734) 0x7f58980059e0 con 0x7f58940090f0 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:01.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.171:6790/0 conn(0x7f58940090f0 legacy=0x7f5894009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58a7fff640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.171:6790/0 conn(0x7f58940090f0 legacy=0x7f5894009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 492299, 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:01.871 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.872 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.873 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:01.874 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:01.875 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.876 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.877 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.878 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:01.878 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.878 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.878 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.878 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.878 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.878 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:01.879 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:01.879 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.879 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.880 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.881 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:01.882 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.883 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:01.884 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.885 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.886 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.887 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.888 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:01.889 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.890 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:01.891 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:01.893 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:01.894 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:01.894 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:01.894 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:01.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.171:6812/722422047 conn(0x7f5890038020 legacy=0x7f589003a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 10 monclient: shutdown 2024-04-26T00:11:01.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:01.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 >> v1:172.21.15.106:6791/0 conn(0x7f58b006be40 legacy=0x7f58b013bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:01.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58affff640 1 -- 172.21.15.106:0/2634837817 reap_dead start 2024-04-26T00:11:01.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58affff640 1 -- 172.21.15.106:0/2634837817 reap_dead start 2024-04-26T00:11:01.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 shutdown_connections 2024-04-26T00:11:01.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 >> 172.21.15.106:0/2634837817 conn(0x7f58b00a6fe0 msgr2=0x7f58b00a5370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:01.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 shutdown_connections 2024-04-26T00:11:01.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:01.880+0000 7f58b5b14640 1 -- 172.21.15.106:0/2634837817 wait complete. 2024-04-26T00:11:01.896 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:01.896 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:11:01.897 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:11:02.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient: get_monmap_and_config 2024-04-26T00:11:02.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient: build_initial_monmap 2024-04-26T00:11:02.039 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient: monmap: 2024-04-26T00:11:02.039 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:02.039 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.039 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:02.067485+0000 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:02.067485+0000 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:02.040 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.041 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 1 Processor -- start 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 1 -- start start 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient: init 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient: _add_conns ranks=[7,8,6,2,0,3,5,1,4] 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient(hunting): picked mon.noname-i con 0x7f22d00a1290 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient(hunting): picked mon.noname-e con 0x7f22d009f770 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient(hunting): picked mon.noname-d con 0x7f22d009fb70 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d00727a0 con 0x7f22d009fb70 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d00724c0 con 0x7f22d00a1290 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d0072a80 con 0x7f22d009f770 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22d5674640 10 monclient(hunting): authenticate will time out at 1917.595524s 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22cf7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f22d009fb70 0x7f22d013de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41902/0 (socket says 172.21.15.106:41902) 2024-04-26T00:11:02.042 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.064+0000 7f22cf7fe640 1 -- 172.21.15.106:0/738831591 learned_addr learned my addr 172.21.15.106:0/738831591 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:02.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521855441 0 0) 0x7f22c80014a0 con 0x7f22d009fb70 2024-04-26T00:11:02.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): my global_id is 254490 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22b8003530 con 0x7f22d009fb70 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 416988934 0 0) 0x7f22d0072a80 con 0x7f22d009f770 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient(hunting): my global_id is 225089 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22c80014a0 con 0x7f22d009f770 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3139670950 0 0) 0x7f22c80014a0 con 0x7f22d009f770 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 >> v1:172.21.15.171:6792/0 conn(0x7f22d00a1290 legacy=0x7f22d00a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 >> v1:172.21.15.106:6792/0 conn(0x7f22d009fb70 legacy=0x7f22d013de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: _finish_hunting 0 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 monclient: found mon.noname-e 2024-04-26T00:11:02.045 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d006bfc0 con 0x7f22d009f770 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: _finish_auth 0 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: _check_auth_tickets 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f22c40017c0 con 0x7f22d009f770 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: dump: 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.046 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 5 monclient: authenticate success, global_id 225089 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22c4001a20 con 0x7f22d009f770 2024-04-26T00:11:02.047 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 1 -- 172.21.15.106:0/738831591 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f22c4001c90 con 0x7f22d009f770 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22cdffb640 10 monclient: dump: 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.048 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 4 set_mon_vals no callback set 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 10 monclient: shutdown 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 1 -- 172.21.15.106:0/738831591 >> v1:172.21.15.106:6793/0 conn(0x7f22d009f770 legacy=0x7f22d013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 1 -- 172.21.15.106:0/738831591 shutdown_connections 2024-04-26T00:11:02.049 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.068+0000 7f22d5674640 1 -- 172.21.15.106:0/738831591 >> 172.21.15.106:0/738831591 conn(0x7f22d006b210 msgr2=0x7f22d006b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 1 -- 172.21.15.106:0/738831591 shutdown_connections 2024-04-26T00:11:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 1 -- 172.21.15.106:0/738831591 wait complete. 2024-04-26T00:11:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient: build_initial_monmap 2024-04-26T00:11:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient: monmap: 2024-04-26T00:11:02.053 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:02.054 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 1 Processor -- start 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 1 -- start start 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient: init 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient: _add_conns ranks=[6,3,7,0,4,5,1,8,2] 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient(hunting): picked mon.noname-d con 0x7f22d009fb70 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient(hunting): picked mon.noname-g con 0x7f22d013e1f0 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient(hunting): picked mon.noname-i con 0x7f22d01d2e90 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d013f1b0 con 0x7f22d013e1f0 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d0134970 con 0x7f22d009fb70 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22ceffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f22d009fb70 0x7f22d0134260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:41910/0 (socket says 172.21.15.106:41910) 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22ceffd640 1 -- 172.21.15.106:0/1309575677 learned_addr learned my addr 172.21.15.106:0/1309575677 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:02.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d0071860 con 0x7f22d01d2e90 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22d5674640 10 monclient(hunting): authenticate will time out at 1917.602925s 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159602969 0 0) 0x7f22d0134970 con 0x7f22d009fb70 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): my global_id is 254499 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22bc003530 con 0x7f22d009fb70 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744457101 0 0) 0x7f22c80013b0 con 0x7f22d01d2e90 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): my global_id is 146572 2024-04-26T00:11:02.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d0134970 con 0x7f22d01d2e90 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 659207269 0 0) 0x7f22d0134970 con 0x7f22d01d2e90 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22c80013b0 con 0x7f22d01d2e90 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2977221527 0 0) 0x7f22bc003530 con 0x7f22d009fb70 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22d0134970 con 0x7f22d009fb70 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f22c8001e90 con 0x7f22d01d2e90 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): dump: 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.057 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f22c0001960 con 0x7f22d009fb70 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): dump: 2024-04-26T00:11:02.058 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.059 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 273332804 0 0) 0x7f22d013f1b0 con 0x7f22d013e1f0 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient(hunting): my global_id is 215256 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22bc003530 con 0x7f22d013e1f0 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3535667592 0 0) 0x7f22c80013b0 con 0x7f22d01d2e90 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.106:6792/0 conn(0x7f22d009fb70 legacy=0x7f22d0134260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.171:6790/0 conn(0x7f22d013e1f0 legacy=0x7f22d01d1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 monclient: found mon.i 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:11:02.060 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d00a1f00 con 0x7f22d01d2e90 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient: _finish_auth 0 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.072+0000 7f22b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22d5674640 5 monclient: authenticate success, global_id 146572 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22d5674640 10 monclient: _renew_subs 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22d5674640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22d5674640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22d011ebf0 con 0x7f22d01d2e90 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22d5674640 10 monclient: _renew_subs 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22d5674640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22d5674640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f22d006d330 con 0x7f22d01d2e90 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22c8004e20 con 0x7f22d01d2e90 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22cd7fa640 4 set_mon_vals no callback set 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f22c8005310 con 0x7f22d01d2e90 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.061 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 10 monclient: dump: 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.062 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.063 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.063 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.063 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f22c80100b0 con 0x7f22d01d2e90 2024-04-26T00:11:02.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f22c80454e0 con 0x7f22d01d2e90 2024-04-26T00:11:02.063 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.076+0000 7f22ceffd640 10 monclient: get_auth_request con 0x7f22bc038020 auth_method 0 2024-04-26T00:11:02.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b57fa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:02.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f22d013e5f0 con 0x7f22d00623f0 2024-04-26T00:11:02.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3532311104 0 0) 0x7f22d013e5f0 con 0x7f22d00623f0 2024-04-26T00:11:02.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient(hunting): my global_id is 254453 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22c80013b0 con 0x7f22d00623f0 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2190902625 0 0) 0x7f22c80013b0 con 0x7f22d00623f0 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22d013e5f0 con 0x7f22d00623f0 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f22c4001d20 con 0x7f22d00623f0 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient: dump: 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.065 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1495345391 0 0) 0x7f22d013e5f0 con 0x7f22d00623f0 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22d0067160 con 0x7f22d00623f0 2024-04-26T00:11:02.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f22c40014f0 con 0x7f22d00623f0 2024-04-26T00:11:02.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:02.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:02.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.171:6791/0 conn(0x7f22d00623f0 legacy=0x7f22d01d89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.080+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.171:6791/0 conn(0x7f22d00623f0 legacy=0x7f22d01d89b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:02.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.092+0000 7f22b57fa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:02.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.092+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f22d0062bb0 con 0x7f22d00627d0 2024-04-26T00:11:02.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 862345229 0 0) 0x7f22d0062bb0 con 0x7f22d00627d0 2024-04-26T00:11:02.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient(hunting): my global_id is 254462 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d013e5f0 con 0x7f22d00627d0 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 866675883 0 0) 0x7f22d013e5f0 con 0x7f22d00627d0 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22d0062bb0 con 0x7f22d00627d0 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f22c4003d20 con 0x7f22d00627d0 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient: dump: 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.071 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1741531683 0 0) 0x7f22d0062bb0 con 0x7f22d00627d0 2024-04-26T00:11:02.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22d0062e50 con 0x7f22d00627d0 2024-04-26T00:11:02.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 2237533498) 0x7f22c4008da0 con 0x7f22d00627d0 2024-04-26T00:11:02.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:02.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:02.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.171:6791/0 conn(0x7f22d00627d0 legacy=0x7f22d01dc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b77fe640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.171:6791/0 conn(0x7f22d00627d0 legacy=0x7f22d01dc0e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:02.073 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:02.073 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 132148, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:02.074 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:02.075 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:02.076 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:02.077 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:02.078 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.079 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:02.080 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.081 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:02.082 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.083 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:02.084 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.085 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:02.086 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:02.087 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.088 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.089 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:02.090 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.091 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:02.092 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.171:6812/722422047 conn(0x7f22bc038020 legacy=0x7f22bc03a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 10 monclient: shutdown 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 >> v1:172.21.15.171:6792/0 conn(0x7f22d01d2e90 legacy=0x7f22d01d5280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22cf7fe640 1 -- 172.21.15.106:0/1309575677 reap_dead start 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22cf7fe640 1 -- 172.21.15.106:0/1309575677 reap_dead start 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 shutdown_connections 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 >> 172.21.15.106:0/1309575677 conn(0x7f22d006b210 msgr2=0x7f22d00a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:02.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 shutdown_connections 2024-04-26T00:11:02.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.096+0000 7f22b57fa640 1 -- 172.21.15.106:0/1309575677 wait complete. 2024-04-26T00:11:02.094 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:02.094 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:11:02.094 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:11:02.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: get_monmap_and_config 2024-04-26T00:11:02.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: build_initial_monmap 2024-04-26T00:11:02.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: monmap: 2024-04-26T00:11:02.206 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:02.206 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:02.234621+0000 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:02.234621+0000 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:02.207 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 Processor -- start 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- start start 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: init 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: _add_conns ranks=[5,2,4,0,1,6,7,3,8] 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient(hunting): picked mon.noname-h con 0x7f2e00137730 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient(hunting): picked mon.noname-b con 0x7f2e000a0b20 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient(hunting): picked mon.noname-c con 0x7f2e00138220 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:02.218 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e000a2750 con 0x7f2e000a0b20 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e000a2a30 con 0x7f2e00138220 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e000a2d10 con 0x7f2e00137730 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient(hunting): authenticate will time out at 1917.761645s 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e0669b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f2e00138220 0x7f2e00140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45936/0 (socket says 172.21.15.106:45936) 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e0669b640 1 -- 172.21.15.106:0/3575740914 learned_addr learned my addr 172.21.15.106:0/3575740914 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e05699640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f2e000a0b20 0x7f2e0013ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:44328/0 (socket says 172.21.15.106:44328) 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3601323592 0 0) 0x7f2e000a2a30 con 0x7f2e00138220 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): my global_id is 274270 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2dec003530 con 0x7f2e00138220 2024-04-26T00:11:02.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 830700702 0 0) 0x7f2e000a2750 con 0x7f2e000a0b20 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient(hunting): my global_id is 254486 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e000a2a30 con 0x7f2e000a0b20 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 503879667 0 0) 0x7f2e000a2a30 con 0x7f2e000a0b20 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 >> v1:172.21.15.171:6791/0 conn(0x7f2e00137730 legacy=0x7f2e00137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 >> v1:172.21.15.106:6791/0 conn(0x7f2e00138220 legacy=0x7f2e00140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: _finish_hunting 0 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 monclient: found mon.noname-b 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e000a4680 con 0x7f2e000a0b20 2024-04-26T00:11:02.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: _finish_auth 0 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: _check_auth_tickets 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df00016f0 con 0x7f2e000a0b20 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 5 monclient: authenticate success, global_id 254486 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: dump: 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.221 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2df00018e0 con 0x7f2e000a0b20 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 1 -- 172.21.15.106:0/3575740914 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df00047f0 con 0x7f2e000a0b20 2024-04-26T00:11:02.222 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 4 set_mon_vals no callback set 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e04e98640 10 monclient: dump: 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.223 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: shutdown 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:02.224 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- 172.21.15.106:0/3575740914 >> v1:172.21.15.106:6790/0 conn(0x7f2e000a0b20 legacy=0x7f2e0013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- 172.21.15.106:0/3575740914 shutdown_connections 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- 172.21.15.106:0/3575740914 >> 172.21.15.106:0/3575740914 conn(0x7f2e000a6b80 msgr2=0x7f2e000a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- 172.21.15.106:0/3575740914 shutdown_connections 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 1 -- 172.21.15.106:0/3575740914 wait complete. 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: build_initial_monmap 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.232+0000 7f2e080fe640 10 monclient: monmap: 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:02.225 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 Processor -- start 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 -- start start 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient: init 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient: _add_conns ranks=[4,5,0,1,3,2,8,6,7] 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient(hunting): picked mon.noname-c con 0x7f2e000a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient(hunting): picked mon.noname-h con 0x7f2e00137730 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient(hunting): picked mon.noname-a con 0x7f2e00138220 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0009aa30 con 0x7f2e00138220 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e0009d1b0 con 0x7f2e000a0b20 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e000a06f0 con 0x7f2e00137730 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:02.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient(hunting): authenticate will time out at 1917.764844s 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e05e9a640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f2e000a0b20 0x7f2e00133de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:45952/0 (socket says 172.21.15.106:45952) 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e05e9a640 1 -- 172.21.15.106:0/2833062324 learned_addr learned my addr 172.21.15.106:0/2833062324 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3697418984 0 0) 0x7f2e0009d1b0 con 0x7f2e000a0b20 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): my global_id is 274279 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2de4003530 con 0x7f2e000a0b20 2024-04-26T00:11:02.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2722524225 0 0) 0x7f2e0009aa30 con 0x7f2e00138220 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): my global_id is 274221 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0009d1b0 con 0x7f2e00138220 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 220249352 0 0) 0x7f2de4003530 con 0x7f2e000a0b20 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e0009aa30 con 0x7f2e000a0b20 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2dfc001ae0 con 0x7f2e000a0b20 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:11:02.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): dump: 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.230 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4214936459 0 0) 0x7f2e0009d1b0 con 0x7f2e00138220 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2de4003530 con 0x7f2e00138220 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df8001c00 con 0x7f2e00138220 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): dump: 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.231 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820715407 0 0) 0x7f2e000a06f0 con 0x7f2e00137730 2024-04-26T00:11:02.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): my global_id is 254471 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0009d1b0 con 0x7f2e00137730 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 567327172 0 0) 0x7f2e0009aa30 con 0x7f2e000a0b20 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.171:6791/0 conn(0x7f2e00137730 legacy=0x7f2e001344f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.106:6789/0 conn(0x7f2e00138220 legacy=0x7f2e00134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 monclient: found mon.c 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e001d8aa0 con 0x7f2e000a0b20 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:02.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 5 monclient: authenticate success, global_id 274279 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient: _renew_subs 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e001d5a70 con 0x7f2e000a0b20 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient: _renew_subs 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e001d5f30 con 0x7f2e000a0b20 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2dfc003950 con 0x7f2e000a0b20 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2dfc003ec0 con 0x7f2e000a0b20 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df7fff640 4 set_mon_vals no callback set 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:02.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: dump: 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.235 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2de80065d0 con 0x7f2de8002870 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2dfc0040e0 con 0x7f2e000a0b20 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f2dfc045260 con 0x7f2e000a0b20 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449592000 0 0) 0x7f2de80065d0 con 0x7f2de8002870 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient(hunting): my global_id is 146581 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e0009aa30 con 0x7f2de8002870 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2e0669b640 10 monclient: get_auth_request con 0x7f2de4037de0 auth_method 0 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1719795637 0 0) 0x7f2e0009aa30 con 0x7f2de8002870 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2de80065d0 con 0x7f2de8002870 2024-04-26T00:11:02.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df00016b0 con 0x7f2de8002870 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.236+0000 7f2df67fc640 10 monclient: dump: 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.240+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4051711770 0 0) 0x7f2de80065d0 con 0x7f2de8002870 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.240+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2de800a160 con 0x7f2de8002870 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.240+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2df0001b20 con 0x7f2de8002870 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.240+0000 7f2df67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.240+0000 7f2df67fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.240+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.171:6792/0 conn(0x7f2de8002870 legacy=0x7f2de8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.240+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.171:6792/0 conn(0x7f2de8002870 legacy=0x7f2de8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:02.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2e080fe640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2de8009e30 con 0x7f2de80090f0 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2208229725 0 0) 0x7f2de8009e30 con 0x7f2de80090f0 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2df67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2df67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2df67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2df67fc640 10 monclient(hunting): my global_id is 146590 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.244+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2de80065d0 con 0x7f2de80090f0 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1457064776 0 0) 0x7f2de80065d0 con 0x7f2de80090f0 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2de8009e30 con 0x7f2de80090f0 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2df0004f00 con 0x7f2de80090f0 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 10 monclient: dump: 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:02.240 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:02.241 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2012355801 0 0) 0x7f2de8009e30 con 0x7f2de80090f0 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2de800c3a0 con 0x7f2de80090f0 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 2320330927) 0x7f2df00071f0 con 0x7f2de80090f0 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.171:6792/0 conn(0x7f2de80090f0 legacy=0x7f2de8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2df67fc640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.171:6792/0 conn(0x7f2de80090f0 legacy=0x7f2de8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:02.242 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 100, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 725777, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.243 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:02.244 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.245 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:02.246 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:02.247 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.248 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.249 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.250 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.251 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.252 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.253 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.254 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.255 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:02.256 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:02.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:02.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:02.261 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.171:6812/722422047 conn(0x7f2de4037de0 legacy=0x7f2de403a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 10 monclient: shutdown 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 >> v1:172.21.15.106:6791/0 conn(0x7f2e000a0b20 legacy=0x7f2e00133de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e0669b640 1 -- 172.21.15.106:0/2833062324 reap_dead start 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e0669b640 1 -- 172.21.15.106:0/2833062324 reap_dead start 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 shutdown_connections 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 >> 172.21.15.106:0/2833062324 conn(0x7f2e000a6b80 msgr2=0x7f2e000a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 shutdown_connections 2024-04-26T00:11:02.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:02.248+0000 7f2e080fe640 1 -- 172.21.15.106:0/2833062324 wait complete. 2024-04-26T00:11:02.264 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:11:02.264 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['g'] 2024-04-26T00:11:02.264 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['a', 'h'] 2024-04-26T00:11:02.264 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-04-26T00:11:02.264 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-04-26T00:11:02.264 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-04-26T00:11:02.264 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:11:02.300 INFO:tasks.ceph.mon.g:Stopped 2024-04-26T00:11:02.300 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-04-26T00:11:02.300 INFO:tasks.ceph.mon.a:Sent signal 19 2024-04-26T00:11:02.301 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-04-26T00:11:02.301 INFO:tasks.ceph.mon.h:Sent signal 19 2024-04-26T00:11:02.301 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T00:11:17.302 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-04-26T00:11:17.303 INFO:tasks.ceph.mon.a:Sent signal 18 2024-04-26T00:11:17.303 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-04-26T00:11:17.303 INFO:tasks.ceph.mon.h:Sent signal 18 2024-04-26T00:11:17.303 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-04-26T00:11:17.304 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:11:17.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient: get_monmap_and_config 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient: build_initial_monmap 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient: monmap: 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:17.460065+0000 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:17.460065+0000 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:17.432 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:17.433 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:17.433 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:17.433 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:17.433 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:17.433 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:17.433 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:17.433 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:17.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 1 Processor -- start 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 1 -- start start 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient: init 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient: _add_conns ranks=[7,3,5,8,2,0,1,4,6] 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient(hunting): picked mon.noname-i con 0x7f7e54135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient(hunting): picked mon.noname-g con 0x7f7e541353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient(hunting): picked mon.noname-h con 0x7f7e5413bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5406f2d0 con 0x7f7e541353b0 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e54072330 con 0x7f7e5413bdf0 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e54072610 con 0x7f7e54135870 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e58af0640 10 monclient(hunting): authenticate will time out at 1932.987200s 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e4bfff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f7e541353b0 legacy=0x7f7e5413a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:17.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e52d9d640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f7e5413bdf0 0x7f7e5413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:47042/0 (socket says 172.21.15.106:47042) 2024-04-26T00:11:17.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e5259c640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f7e54135870 0x7f7e54135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:48034/0 (socket says 172.21.15.106:48034) 2024-04-26T00:11:17.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.456+0000 7f7e52d9d640 1 -- 172.21.15.106:0/1416545221 learned_addr learned my addr 172.21.15.106:0/1416545221 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:17.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:17.660+0000 7f7e4bfff640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.171:6790/0 conn(0x7f7e541353b0 legacy=0x7f7e5413a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:18.038 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:18.064+0000 7f7e4bfff640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.171:6790/0 conn(0x7f7e541353b0 legacy=0x7f7e5413a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:18.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:18.868+0000 7f7e4bfff640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.171:6790/0 conn(0x7f7e541353b0 legacy=0x7f7e5413a6d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:20.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient(hunting): tick 2024-04-26T00:11:20.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:11:20.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 1 monclient(hunting): continuing hunt 2024-04-26T00:11:20.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:11:20.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.171:6792/0 conn(0x7f7e54135870 legacy=0x7f7e54135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.171:6791/0 conn(0x7f7e5413bdf0 legacy=0x7f7e5413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.171:6790/0 conn(0x7f7e541353b0 legacy=0x7f7e5413a6d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient: _add_conns ranks=[2,4,1,8,0,6] 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient(hunting): picked mon.noname-b con 0x7f7e340037d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient(hunting): picked mon.noname-c con 0x7f7e340073c0 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient(hunting): picked mon.noname-f con 0x7f7e3400b150 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 1 -- 172.21.15.106:0/1416545221 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e540a3260 con 0x7f7e3400b150 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 1 -- 172.21.15.106:0/1416545221 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5406f2d0 con 0x7f7e340037d0 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 1 -- 172.21.15.106:0/1416545221 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e34011000 con 0x7f7e340073c0 2024-04-26T00:11:20.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:20.460+0000 7f7e50d99640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:22.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.352+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729281477 0 0) 0x7f7e540a3260 con 0x7f7e3400b150 2024-04-26T00:11:22.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.352+0000 7f7e51d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.352+0000 7f7e51d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.352+0000 7f7e51d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.352+0000 7f7e51d9b640 10 monclient(hunting): my global_id is 225181 2024-04-26T00:11:22.330 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.352+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e40003530 con 0x7f7e3400b150 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2730962105 0 0) 0x7f7e40003530 con 0x7f7e3400b150 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.106:6791/0 conn(0x7f7e340073c0 legacy=0x7f7e34009880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.106:6790/0 conn(0x7f7e340037d0 legacy=0x7f7e34005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 monclient: found mon.noname-f 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e52d9d640 1 -- 172.21.15.106:0/1416545221 reap_dead start 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e34012290 con 0x7f7e3400b150 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: _finish_auth 0 2024-04-26T00:11:22.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e4c001ac0 con 0x7f7e3400b150 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 5 monclient: authenticate success, global_id 225181 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: dump: 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.332 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e4c001da0 con 0x7f7e3400b150 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 1 -- 172.21.15.106:0/1416545221 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e4c001fd0 con 0x7f7e3400b150 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:22.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 4 set_mon_vals no callback set 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e51d9b640 10 monclient: dump: 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.334 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.335 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.335 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.335 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.335 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 10 monclient: shutdown 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 1 -- 172.21.15.106:0/1416545221 >> v1:172.21.15.171:6789/0 conn(0x7f7e3400b150 legacy=0x7f7e3400d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 1 -- 172.21.15.106:0/1416545221 shutdown_connections 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 1 -- 172.21.15.106:0/1416545221 >> 172.21.15.106:0/1416545221 conn(0x7f7e540a64e0 msgr2=0x7f7e540a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 1 -- 172.21.15.106:0/1416545221 shutdown_connections 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.356+0000 7f7e58af0640 1 -- 172.21.15.106:0/1416545221 wait complete. 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: build_initial_monmap 2024-04-26T00:11:22.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: monmap: 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:22.340 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 1 Processor -- start 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 1 -- start start 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: init 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: _add_conns ranks=[0,6,2,4,3,1,5,8,7] 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient(hunting): picked mon.noname-a con 0x7f7e3400b150 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient(hunting): picked mon.noname-d con 0x7f7e541ca1f0 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient(hunting): picked mon.noname-b con 0x7f7e541d0c50 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:22.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5411fe30 con 0x7f7e3400b150 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5411e6a0 con 0x7f7e541d0c50 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e5409f930 con 0x7f7e541ca1f0 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient(hunting): authenticate will time out at 1937.890251s 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e5259c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f7e3400b150 0x7f7e54134490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46524/0 (socket says 172.21.15.106:46524) 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e5259c640 1 -- 172.21.15.106:0/2924731481 learned_addr learned my addr 172.21.15.106:0/2924731481 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4bfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f7e541ca1f0 0x7f7e541cf530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49034/0 (socket says 172.21.15.106:49034) 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4224015563 0 0) 0x7f7e5411fe30 con 0x7f7e3400b150 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): my global_id is 274230 2024-04-26T00:11:22.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e34010650 con 0x7f7e3400b150 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2210383856 0 0) 0x7f7e34010650 con 0x7f7e3400b150 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e5411fe30 con 0x7f7e3400b150 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e440018f0 con 0x7f7e3400b150 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): dump: 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.343 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.344 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4132317377 0 0) 0x7f7e5411fe30 con 0x7f7e3400b150 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 >> v1:172.21.15.106:6792/0 conn(0x7f7e541ca1f0 legacy=0x7f7e541cf530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 >> v1:172.21.15.106:6790/0 conn(0x7f7e541d0c50 legacy=0x7f7e541d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 monclient: found mon.a 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e5411eab0 con 0x7f7e3400b150 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: _finish_auth 0 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 5 monclient: authenticate success, global_id 274230 2024-04-26T00:11:22.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: _renew_subs 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7e5411fb50 con 0x7f7e3400b150 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: _renew_subs 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7e54134ba0 con 0x7f7e3400b150 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e44001cf0 con 0x7f7e3400b150 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e44004de0 con 0x7f7e3400b150 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e5159a640 4 set_mon_vals no callback set 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.360+0000 7f7e4affd640 10 monclient: dump: 2024-04-26T00:11:22.346 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.347 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.364+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7e44005000 con 0x7f7e3400b150 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.364+0000 7f7e58af0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.364+0000 7f7e58af0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.364+0000 7f7e58af0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.364+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e38005090 con 0x7f7e3400b150 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.364+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f7e440450e0 con 0x7f7e3400b150 2024-04-26T00:11:22.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.364+0000 7f7e4bfff640 10 monclient: get_auth_request con 0x7f7e34038d40 auth_method 0 2024-04-26T00:11:22.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.368+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7e440156b0 con 0x7f7e3400b150 2024-04-26T00:11:22.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.368+0000 7f7e4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:22.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.368+0000 7f7e4affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:22.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.596+0000 7f7e58af0640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:11:22.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.596+0000 7f7e58af0640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:11:22.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.596+0000 7f7e58af0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:11:22.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.596+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f7e38005380 con 0x7f7e3400b150 2024-04-26T00:11:22.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.596+0000 7f7e4affd640 1 -- 172.21.15.106:0/2924731481 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2739 (unknown 254746657 0 1555326685) 0x7f7e44014fb0 con 0x7f7e3400b150 2024-04-26T00:11:22.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.596+0000 7f7e4affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:11:22.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.596+0000 7f7e4affd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:22.573 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":106,"quorum":[0,1,2,4,5,6,7,8],"quorum_names":["a","f","b","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 >> v1:172.21.15.171:6812/722422047 conn(0x7f7e34038d40 legacy=0x7f7e3403b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 10 monclient: shutdown 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 >> v1:172.21.15.106:6789/0 conn(0x7f7e3400b150 legacy=0x7f7e54134490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 shutdown_connections 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 >> 172.21.15.106:0/2924731481 conn(0x7f7e540a64e0 msgr2=0x7f7e5413b570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 shutdown_connections 2024-04-26T00:11:22.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.600+0000 7f7e58af0640 1 -- 172.21.15.106:0/2924731481 wait complete. 2024-04-26T00:11:22.591 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-04-26T00:11:22.591 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-04-26T00:11:22.591 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:11:22.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.736+0000 7faddda10640 10 monclient: get_monmap_and_config 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.736+0000 7faddda10640 10 monclient: build_initial_monmap 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.736+0000 7faddda10640 10 monclient: monmap: 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:22.742290+0000 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:22.742290+0000 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:22.714 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:22.715 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:22.715 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:22.715 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:22.715 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:22.715 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 Processor -- start 2024-04-26T00:11:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- start start 2024-04-26T00:11:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient: init 2024-04-26T00:11:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient: _add_conns ranks=[7,0,2,3,1,8,5,6,4] 2024-04-26T00:11:22.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient(hunting): picked mon.noname-i con 0x7fadd806e3e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient(hunting): picked mon.noname-a con 0x7fadd806fba0 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient(hunting): picked mon.noname-b con 0x7fadd806eed0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8070f80 con 0x7fadd806fba0 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8071e00 con 0x7fadd806eed0 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd80709c0 con 0x7fadd806e3e0 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient(hunting): authenticate will time out at 1938.269397s 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd77fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fadd806eed0 0x7fadd813c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42734/0 (socket says 172.21.15.106:42734) 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd77fe640 1 -- 172.21.15.106:0/2407155158 learned_addr learned my addr 172.21.15.106:0/2407155158 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2181476500 0 0) 0x7fadd8071e00 con 0x7fadd806eed0 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): my global_id is 254495 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc0003530 con 0x7fadd806eed0 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 505944692 0 0) 0x7fadcc001120 con 0x7fadd806fba0 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient(hunting): my global_id is 274239 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd8071e00 con 0x7fadd806fba0 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 244804196 0 0) 0x7fadc0003530 con 0x7fadd806eed0 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 >> v1:172.21.15.171:6792/0 conn(0x7fadd806e3e0 legacy=0x7fadd806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 >> v1:172.21.15.106:6789/0 conn(0x7fadd806fba0 legacy=0x7fadd81391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 monclient: found mon.noname-b 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:22.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd8070ca0 con 0x7fadd806eed0 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: _finish_auth 0 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadd0001b40 con 0x7fadd806eed0 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: dump: 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.725 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 5 monclient: authenticate success, global_id 254495 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadd0001db0 con 0x7fadd806eed0 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:22.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 1 -- 172.21.15.106:0/2407155158 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadd0004f70 con 0x7fadd806eed0 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 4 set_mon_vals no callback set 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7fadd5ffb640 10 monclient: dump: 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.727 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient: shutdown 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- 172.21.15.106:0/2407155158 >> v1:172.21.15.106:6790/0 conn(0x7fadd806eed0 legacy=0x7fadd813c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- 172.21.15.106:0/2407155158 shutdown_connections 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- 172.21.15.106:0/2407155158 >> 172.21.15.106:0/2407155158 conn(0x7fadd80a64e0 msgr2=0x7fadd80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- 172.21.15.106:0/2407155158 shutdown_connections 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 -- 172.21.15.106:0/2407155158 wait complete. 2024-04-26T00:11:22.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient: build_initial_monmap 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 10 monclient: monmap: 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:22.729 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.740+0000 7faddda10640 1 Processor -- start 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 1 -- start start 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient: init 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient: _add_conns ranks=[1,2,5,4,6,0,3,7,8] 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient(hunting): picked mon.noname-f con 0x7fadd806e3e0 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient(hunting): picked mon.noname-b con 0x7fadd806eed0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient(hunting): picked mon.noname-h con 0x7fadd806fba0 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8139340 con 0x7fadd806e3e0 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8070000 con 0x7fadd806eed0 2024-04-26T00:11:22.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd8138910 con 0x7fadd806fba0 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient(hunting): authenticate will time out at 1938.272498s 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadd67fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fadd806eed0 0x7fadd809d630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42750/0 (socket says 172.21.15.106:42750) 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadd67fc640 1 -- 172.21.15.106:0/478492593 learned_addr learned my addr 172.21.15.106:0/478492593 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3711967903 0 0) 0x7fadd8070000 con 0x7fadd806eed0 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): my global_id is 254504 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc4003530 con 0x7fadd806eed0 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1953771712 0 0) 0x7fadc4003530 con 0x7fadd806eed0 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadd8070000 con 0x7fadd806eed0 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadcc001bb0 con 0x7fadd806eed0 2024-04-26T00:11:22.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): dump: 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.732 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4091652685 0 0) 0x7fadd8070000 con 0x7fadd806eed0 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.171:6791/0 conn(0x7fadd806fba0 legacy=0x7fadd81d25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.171:6789/0 conn(0x7fadd806e3e0 legacy=0x7fadd809cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: _finish_hunting 0 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 monclient: found mon.b 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd809eaf0 con 0x7fadd806eed0 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: _finish_auth 0 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: _check_auth_tickets 2024-04-26T00:11:22.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 5 monclient: authenticate success, global_id 254504 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient: _renew_subs 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fadd809dd40 con 0x7fadd806eed0 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient: _renew_subs 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fadd8138450 con 0x7fadd806eed0 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadcc0038b0 con 0x7fadd806eed0 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadcc003e20 con 0x7fadd806eed0 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadd57fa640 4 set_mon_vals no callback set 2024-04-26T00:11:22.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: dump: 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.735 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fadb80065d0 con 0x7fadb8002870 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fadcc003fc0 con 0x7fadd806eed0 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fadcc0450d0 con 0x7fadd806eed0 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3902050977 0 0) 0x7fadb80065d0 con 0x7fadb8002870 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient(hunting): my global_id is 274248 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd8070000 con 0x7fadb8002870 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 856819429 0 0) 0x7fadd8070000 con 0x7fadb8002870 2024-04-26T00:11:22.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadb80065d0 con 0x7fadb8002870 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadc80018c0 con 0x7fadb8002870 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: dump: 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.737 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadd77fe640 10 monclient: get_auth_request con 0x7fadc40377e0 auth_method 0 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2954433616 0 0) 0x7fadb80065d0 con 0x7fadb8002870 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fadb800a160 con 0x7fadb8002870 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fadc8004650 con 0x7fadb8002870 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.106:6789/0 conn(0x7fadb8002870 legacy=0x7fadb8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.744+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.106:6789/0 conn(0x7fadb8002870 legacy=0x7fadb8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fadb8009e30 con 0x7fadb80090f0 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 497912757 0 0) 0x7fadb8009e30 con 0x7fadb80090f0 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient(hunting): my global_id is 274257 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadb80065d0 con 0x7fadb80090f0 2024-04-26T00:11:22.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2750747553 0 0) 0x7fadb80065d0 con 0x7fadb80090f0 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadb8009e30 con 0x7fadb80090f0 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadc8003bf0 con 0x7fadb80090f0 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient: dump: 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.741 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2247832529 0 0) 0x7fadb8009e30 con 0x7fadb80090f0 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fadb800c3a0 con 0x7fadb80090f0 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7726 (unknown 0 0 1545521442) 0x7fadc8003e60 con 0x7fadb80090f0 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.106:6789/0 conn(0x7fadb80090f0 legacy=0x7fadb8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadbffff640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.106:6789/0 conn(0x7fadb80090f0 legacy=0x7fadb8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 30823, 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:22.743 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:22.744 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:22.745 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:22.746 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:22.747 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:22.748 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.749 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.750 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.751 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:22.752 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.753 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.754 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:22.755 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.756 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:22.757 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:22.759 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.761 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:22.762 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:22.763 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.171:6812/722422047 conn(0x7fadc40377e0 legacy=0x7fadc4039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 10 monclient: shutdown 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 >> v1:172.21.15.106:6790/0 conn(0x7fadd806eed0 legacy=0x7fadd809d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadd77fe640 1 -- 172.21.15.106:0/478492593 reap_dead start 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7fadd77fe640 1 -- 172.21.15.106:0/478492593 reap_dead start 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 shutdown_connections 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 >> 172.21.15.106:0/478492593 conn(0x7fadd80a64e0 msgr2=0x7fadd81369a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 shutdown_connections 2024-04-26T00:11:22.764 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.752+0000 7faddda10640 1 -- 172.21.15.106:0/478492593 wait complete. 2024-04-26T00:11:22.764 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:22.765 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-04-26T00:11:22.765 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:11:22.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient: get_monmap_and_config 2024-04-26T00:11:22.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient: build_initial_monmap 2024-04-26T00:11:22.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient: monmap: 2024-04-26T00:11:22.888 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:22.888 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.888 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:22.907161+0000 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:22.907161+0000 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 1 Processor -- start 2024-04-26T00:11:22.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 1 -- start start 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient: init 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient: _add_conns ranks=[1,3,7,2,6,4,0,8,5] 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient(hunting): picked mon.noname-f con 0x7f60840a5070 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient(hunting): picked mon.noname-g con 0x7f6084072710 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient(hunting): picked mon.noname-i con 0x7f6084072b70 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6084137d60 con 0x7f60840a5070 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608406cf90 con 0x7f6084072710 2024-04-26T00:11:22.890 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608406e240 con 0x7f6084072b70 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient(hunting): authenticate will time out at 1938.434299s 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f60892ba640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f6084072710 legacy=0x7f608413c970 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6089abb640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f60840a5070 0x7f6084137650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:40464/0 (socket says 172.21.15.106:40464) 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6089abb640 1 -- 172.21.15.106:0/613785642 learned_addr learned my addr 172.21.15.106:0/613785642 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 61861240 0 0) 0x7f6084137d60 con 0x7f60840a5070 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): my global_id is 225199 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6070003530 con 0x7f60840a5070 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234841592 0 0) 0x7f608406e240 con 0x7f6084072b70 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.891 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient(hunting): my global_id is 146608 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6084137d60 con 0x7f6084072b70 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1329666943 0 0) 0x7f6070003530 con 0x7f60840a5070 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 >> v1:172.21.15.171:6792/0 conn(0x7f6084072b70 legacy=0x7f60841400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 >> v1:172.21.15.171:6790/0 conn(0x7f6084072710 legacy=0x7f608413c970 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: _finish_hunting 0 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 monclient: found mon.noname-f 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6084070560 con 0x7f60840a5070 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: _finish_auth 0 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: _check_auth_tickets 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f60740017c0 con 0x7f60840a5070 2024-04-26T00:11:22.892 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 5 monclient: authenticate success, global_id 225199 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: dump: 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.893 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6074001a70 con 0x7f60840a5070 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f608bd1f640 4 set_mon_vals no callback set 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 1 -- 172.21.15.106:0/613785642 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6074004bf0 con 0x7f60840a5070 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.904+0000 7f6088ab9640 10 monclient: dump: 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.894 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.895 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: shutdown 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/613785642 >> v1:172.21.15.171:6789/0 conn(0x7f60840a5070 legacy=0x7f6084137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/613785642 shutdown_connections 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/613785642 >> 172.21.15.106:0/613785642 conn(0x7f60840a83a0 msgr2=0x7f60840a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/613785642 shutdown_connections 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/613785642 wait complete. 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: build_initial_monmap 2024-04-26T00:11:22.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: monmap: 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:22.897 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 Processor -- start 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- start start 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: init 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: _add_conns ranks=[1,4,2,0,6,5,3,8,7] 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient(hunting): picked mon.noname-f con 0x7f6084072710 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient(hunting): picked mon.noname-c con 0x7f6084072b70 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient(hunting): picked mon.noname-b con 0x7f60840a5070 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:22.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f608406d4c0 con 0x7f6084072710 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6084132960 con 0x7f60840a5070 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6084135080 con 0x7f6084072b70 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient(hunting): authenticate will time out at 1938.437823s 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f60892ba640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f6084072b70 0x7f6084132250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47940/0 (socket says 172.21.15.106:47940) 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f60892ba640 1 -- 172.21.15.106:0/2681054715 learned_addr learned my addr 172.21.15.106:0/2681054715 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289598046 0 0) 0x7f6084135080 con 0x7f6084072b70 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): my global_id is 274288 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6068003530 con 0x7f6084072b70 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418306790 0 0) 0x7f6084132960 con 0x7f60840a5070 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): my global_id is 254513 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6084135080 con 0x7f60840a5070 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576345191 0 0) 0x7f608406d4c0 con 0x7f6084072710 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): my global_id is 225208 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6084132960 con 0x7f6084072710 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1949825962 0 0) 0x7f6084135080 con 0x7f60840a5070 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f608406d4c0 con 0x7f60840a5070 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1303824096 0 0) 0x7f6068003530 con 0x7f6084072b70 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6084135080 con 0x7f6084072b70 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f607c001de0 con 0x7f60840a5070 2024-04-26T00:11:22.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): dump: 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.901 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f60800041e0 con 0x7f6084072b70 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): dump: 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.902 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 492901117 0 0) 0x7f608406d4c0 con 0x7f60840a5070 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.106:6791/0 conn(0x7f6084072b70 legacy=0x7f6084132250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.171:6789/0 conn(0x7f6084072710 legacy=0x7f6084131b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 monclient: found mon.b 2024-04-26T00:11:22.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6084135360 con 0x7f60840a5070 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 5 monclient: authenticate success, global_id 254513 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: _renew_subs 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f60841386e0 con 0x7f60840a5070 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: _renew_subs 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6084134190 con 0x7f60840a5070 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f607c002080 con 0x7f60840a5070 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:22.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f607c003f90 con 0x7f60840a5070 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607b7fe640 4 set_mon_vals no callback set 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient: dump: 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.905 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f606c0065d0 con 0x7f606c002870 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791595634 0 0) 0x7f606c0065d0 con 0x7f606c002870 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 10 monclient(hunting): my global_id is 254522 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.908+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f608406d4c0 con 0x7f606c002870 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3363133137 0 0) 0x7f608406d4c0 con 0x7f606c002870 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f606c0065d0 con 0x7f606c002870 2024-04-26T00:11:22.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6074001780 con 0x7f606c002870 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 10 monclient: dump: 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.907 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 460281677 0 0) 0x7f606c0065d0 con 0x7f606c002870 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f606c00a160 con 0x7f606c002870 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f607c0041b0 con 0x7f60840a5070 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f607c0441f0 con 0x7f60840a5070 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f60740047f0 con 0x7f606c002870 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.106:6790/0 conn(0x7f606c002870 legacy=0x7f606c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.106:6790/0 conn(0x7f606c002870 legacy=0x7f606c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:22.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.912+0000 7f60892ba640 10 monclient: get_auth_request con 0x7f60680382e0 auth_method 0 2024-04-26T00:11:22.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f608bd1f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:22.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f606c009e80 con 0x7f606c009140 2024-04-26T00:11:22.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 908126562 0 0) 0x7f606c009e80 con 0x7f606c009140 2024-04-26T00:11:22.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:22.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:22.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:22.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient(hunting): my global_id is 254531 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f606c0065d0 con 0x7f606c009140 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1305882233 0 0) 0x7f606c0065d0 con 0x7f606c009140 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f606c009e80 con 0x7f606c009140 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6074004fd0 con 0x7f606c009140 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient: dump: 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:22.911 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3799068418 0 0) 0x7f606c009e80 con 0x7f606c009140 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f606c00c400 con 0x7f606c009140 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7555 (unknown 0 0 3537854775) 0x7f60740073a0 con 0x7f606c009140 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.106:6790/0 conn(0x7f606c009140 legacy=0x7f606c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.916+0000 7f607a7fc640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.106:6790/0 conn(0x7f606c009140 legacy=0x7f606c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 152973, 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:22.913 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:22.914 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:22.915 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:22.916 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:22.917 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.918 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:22.919 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.920 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.921 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:22.922 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.923 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.924 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.925 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:22.926 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:22.928 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:22.929 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:22.930 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:11:22.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:22.930 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:22.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:22.930 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:22.930 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.171:6812/722422047 conn(0x7f60680382e0 legacy=0x7f606803a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 10 monclient: shutdown 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 >> v1:172.21.15.106:6790/0 conn(0x7f60840a5070 legacy=0x7f60841d4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608a2bc640 1 -- 172.21.15.106:0/2681054715 reap_dead start 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608a2bc640 1 -- 172.21.15.106:0/2681054715 reap_dead start 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 shutdown_connections 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 >> 172.21.15.106:0/2681054715 conn(0x7f60840a83a0 msgr2=0x7f60840a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 shutdown_connections 2024-04-26T00:11:22.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:22.920+0000 7f608bd1f640 1 -- 172.21.15.106:0/2681054715 wait complete. 2024-04-26T00:11:22.933 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:22.933 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-04-26T00:11:22.933 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:11:23.054 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: get_monmap_and_config 2024-04-26T00:11:23.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: monmap: 2024-04-26T00:11:23.295 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.295 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.295 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:23.082820+0000 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:23.082820+0000 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.296 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 Processor -- start 2024-04-26T00:11:23.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- start start 2024-04-26T00:11:23.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: init 2024-04-26T00:11:23.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: _add_conns ranks=[7,1,2,5,6,8,3,0,4] 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient(hunting): picked mon.noname-i con 0x7fbb200716e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient(hunting): picked mon.noname-f con 0x7fbb20135e50 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient(hunting): picked mon.noname-b con 0x7fbb2013bdd0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb201362a0 con 0x7fbb20135e50 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb200723f0 con 0x7fbb2013bdd0 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2006bcc0 con 0x7fbb200716e0 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient(hunting): authenticate will time out at 1938.609644s 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1ed9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fbb2013bdd0 0x7fbb2013e1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42788/0 (socket says 172.21.15.106:42788) 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1ed9d640 1 -- 172.21.15.106:0/3299647652 learned_addr learned my addr 172.21.15.106:0/3299647652 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888840861 0 0) 0x7fbb200723f0 con 0x7fbb2013bdd0 2024-04-26T00:11:23.306 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): my global_id is 254540 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb08003530 con 0x7fbb2013bdd0 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3711319154 0 0) 0x7fbb14001120 con 0x7fbb20135e50 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient(hunting): my global_id is 225217 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb200723f0 con 0x7fbb20135e50 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3348199382 0 0) 0x7fbb08003530 con 0x7fbb2013bdd0 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 >> v1:172.21.15.171:6792/0 conn(0x7fbb200716e0 legacy=0x7fbb20135740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 >> v1:172.21.15.171:6789/0 conn(0x7fbb20135e50 legacy=0x7fbb2013a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.307 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 monclient: found mon.noname-b 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb20135390 con 0x7fbb2013bdd0 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbb18001b40 con 0x7fbb2013bdd0 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 5 monclient: authenticate success, global_id 254540 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: dump: 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.308 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.309 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb18001da0 con 0x7fbb2013bdd0 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 1 -- 172.21.15.106:0/3299647652 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbb18004f70 con 0x7fbb2013bdd0 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 4 set_mon_vals no callback set 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb1d59a640 10 monclient: dump: 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.310 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: shutdown 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- 172.21.15.106:0/3299647652 >> v1:172.21.15.106:6790/0 conn(0x7fbb2013bdd0 legacy=0x7fbb2013e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.311 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- 172.21.15.106:0/3299647652 shutdown_connections 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- 172.21.15.106:0/3299647652 >> 172.21.15.106:0/3299647652 conn(0x7fbb200a7240 msgr2=0x7fbb200a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- 172.21.15.106:0/3299647652 shutdown_connections 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 1 -- 172.21.15.106:0/3299647652 wait complete. 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.080+0000 7fbb24f16640 10 monclient: monmap: 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.312 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 Processor -- start 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 -- start start 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient: init 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient: _add_conns ranks=[6,4,5,0,7,2,3,8,1] 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient(hunting): picked mon.noname-d con 0x7fbb200716e0 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient(hunting): picked mon.noname-c con 0x7fbb20135e50 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient(hunting): picked mon.noname-h con 0x7fbb2013bdd0 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:23.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2009d580 con 0x7fbb20135e50 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb200a03f0 con 0x7fbb2013bdd0 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb2009e750 con 0x7fbb200716e0 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient(hunting): authenticate will time out at 1938.612846s 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb1dd9b640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fbb20135e50 0x7fbb201ce7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47950/0 (socket says 172.21.15.106:47950) 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb1dd9b640 1 -- 172.21.15.106:0/327020983 learned_addr learned my addr 172.21.15.106:0/327020983 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb1e59c640 1 --1- 172.21.15.106:0/327020983 >> v1:172.21.15.106:6792/0 conn(0x7fbb200716e0 0x7fbb2009f130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49044/0 (socket says 172.21.15.106:49044) 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 7854841 0 0) 0x7fbb2009e750 con 0x7fbb200716e0 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): my global_id is 254508 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb00003560 con 0x7fbb200716e0 2024-04-26T00:11:23.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329536599 0 0) 0x7fbb2009d580 con 0x7fbb20135e50 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): my global_id is 274297 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb2009e750 con 0x7fbb20135e50 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2251654093 0 0) 0x7fbb00003560 con 0x7fbb200716e0 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb2009d580 con 0x7fbb200716e0 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1436737220 0 0) 0x7fbb2009e750 con 0x7fbb20135e50 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb00003560 con 0x7fbb20135e50 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 520192452 0 0) 0x7fbb200a03f0 con 0x7fbb2013bdd0 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.315 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): my global_id is 254489 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb2009e750 con 0x7fbb2013bdd0 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbb100019c0 con 0x7fbb200716e0 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): dump: 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.316 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbb14001b50 con 0x7fbb20135e50 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): dump: 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.317 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2680690679 0 0) 0x7fbb2009d580 con 0x7fbb200716e0 2024-04-26T00:11:23.318 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.171:6791/0 conn(0x7fbb2013bdd0 legacy=0x7fbb201d1f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.106:6791/0 conn(0x7fbb20135e50 legacy=0x7fbb201ce7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 monclient: found mon.d 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb2009ea30 con 0x7fbb200716e0 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 5 monclient: authenticate success, global_id 254508 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient: _renew_subs 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbb2009d1e0 con 0x7fbb200716e0 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient: _renew_subs 2024-04-26T00:11:23.319 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbb201d3810 con 0x7fbb200716e0 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbb100038d0 con 0x7fbb200716e0 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbb10001bf0 con 0x7fbb200716e0 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb1cd99640 4 set_mon_vals no callback set 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: dump: 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.320 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbb040065d0 con 0x7fbb04002870 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbb10003e40 con 0x7fbb200716e0 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fbb10045060 con 0x7fbb200716e0 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2704620551 0 0) 0x7fbb040065d0 con 0x7fbb04002870 2024-04-26T00:11:23.321 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient(hunting): my global_id is 274306 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb2009d580 con 0x7fbb04002870 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 421812027 0 0) 0x7fbb2009d580 con 0x7fbb04002870 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb040065d0 con 0x7fbb04002870 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb1ed9d640 10 monclient: get_auth_request con 0x7fbb00037fe0 auth_method 0 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbb14003b70 con 0x7fbb04002870 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: dump: 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.322 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2660280715 0 0) 0x7fbb040065d0 con 0x7fbb04002870 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbb0400a160 con 0x7fbb04002870 2024-04-26T00:11:23.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbb14003e10 con 0x7fbb04002870 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.106:6791/0 conn(0x7fbb04002870 legacy=0x7fbb04004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.084+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.106:6791/0 conn(0x7fbb04002870 legacy=0x7fbb04004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbb04009e10 con 0x7fbb040090d0 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 140547320 0 0) 0x7fbb04009e10 con 0x7fbb040090d0 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient(hunting): my global_id is 274315 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbb040065d0 con 0x7fbb040090d0 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 988825605 0 0) 0x7fbb040065d0 con 0x7fbb040090d0 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbb04009e10 con 0x7fbb040090d0 2024-04-26T00:11:23.324 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbb140057d0 con 0x7fbb040090d0 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient: dump: 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.325 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4219943775 0 0) 0x7fbb04009e10 con 0x7fbb040090d0 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbb0400c390 con 0x7fbb040090d0 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7554 (unknown 0 0 1996076940) 0x7fbb14005970 con 0x7fbb040090d0 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.106:6791/0 conn(0x7fbb040090d0 legacy=0x7fbb04009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb0effd640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.106:6791/0 conn(0x7fbb040090d0 legacy=0x7fbb04009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 31171, 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:23.327 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.328 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.329 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:23.330 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.331 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:23.332 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.333 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.334 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.335 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.336 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:23.337 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.338 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.339 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.340 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.341 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:23.342 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.343 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:23.344 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.345 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:23.345 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:23.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.171:6812/722422047 conn(0x7fbb00037fe0 legacy=0x7fbb0003a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 10 monclient: shutdown 2024-04-26T00:11:23.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 >> v1:172.21.15.106:6792/0 conn(0x7fbb200716e0 legacy=0x7fbb2009f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb1ed9d640 1 -- 172.21.15.106:0/327020983 reap_dead start 2024-04-26T00:11:23.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb1ed9d640 1 -- 172.21.15.106:0/327020983 reap_dead start 2024-04-26T00:11:23.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 shutdown_connections 2024-04-26T00:11:23.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 >> 172.21.15.106:0/327020983 conn(0x7fbb200a7240 msgr2=0x7fbb200a39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 shutdown_connections 2024-04-26T00:11:23.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.092+0000 7fbb24f16640 1 -- 172.21.15.106:0/327020983 wait complete. 2024-04-26T00:11:23.347 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:23.347 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-04-26T00:11:23.348 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:11:23.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.504+0000 7fc887c9d640 10 monclient: get_monmap_and_config 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.504+0000 7fc887c9d640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: monmap: 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:23.510354+0000 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:23.510354+0000 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.482 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.483 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.483 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 Processor -- start 2024-04-26T00:11:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- start start 2024-04-26T00:11:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: init 2024-04-26T00:11:23.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: _add_conns ranks=[7,1,3,2,6,8,4,0,5] 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient(hunting): picked mon.noname-i con 0x7fc880135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient(hunting): picked mon.noname-f con 0x7fc8801353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient(hunting): picked mon.noname-g con 0x7fc88013bdf0 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88006f2d0 con 0x7fc8801353b0 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc880072330 con 0x7fc88013bdf0 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc880072610 con 0x7fc880135870 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient(hunting): authenticate will time out at 1939.037440s 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc88623a640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fc88013bdf0 legacy=0x7fc88013e1e0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc885a39640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fc880135870 0x7fc880135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:48074/0 (socket says 172.21.15.106:48074) 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc885a39640 1 -- 172.21.15.106:0/1000084057 learned_addr learned my addr 172.21.15.106:0/1000084057 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 223924898 0 0) 0x7fc88006f2d0 con 0x7fc8801353b0 2024-04-26T00:11:23.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): my global_id is 225226 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc86c003530 con 0x7fc8801353b0 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3106088612 0 0) 0x7fc880072610 con 0x7fc880135870 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient(hunting): my global_id is 146626 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88006f2d0 con 0x7fc880135870 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2140627838 0 0) 0x7fc86c003530 con 0x7fc8801353b0 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 >> v1:172.21.15.171:6792/0 conn(0x7fc880135870 legacy=0x7fc880135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 >> v1:172.21.15.171:6790/0 conn(0x7fc88013bdf0 legacy=0x7fc88013e1e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:11:23.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 monclient: found mon.noname-f 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8800a3260 con 0x7fc8801353b0 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc8700017c0 con 0x7fc8801353b0 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: dump: 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.493 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 5 monclient: authenticate success, global_id 225226 2024-04-26T00:11:23.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc870001ae0 con 0x7fc8801353b0 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 4 set_mon_vals no callback set 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 1 -- 172.21.15.106:0/1000084057 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc870003960 con 0x7fc8801353b0 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc884a37640 10 monclient: dump: 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.495 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: shutdown 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- 172.21.15.106:0/1000084057 >> v1:172.21.15.171:6789/0 conn(0x7fc8801353b0 legacy=0x7fc88013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- 172.21.15.106:0/1000084057 shutdown_connections 2024-04-26T00:11:23.496 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- 172.21.15.106:0/1000084057 >> 172.21.15.106:0/1000084057 conn(0x7fc8800a64e0 msgr2=0x7fc8800a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- 172.21.15.106:0/1000084057 shutdown_connections 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 1 -- 172.21.15.106:0/1000084057 wait complete. 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.508+0000 7fc887c9d640 10 monclient: monmap: 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.497 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 Processor -- start 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 -- start start 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient: init 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient: _add_conns ranks=[5,8,1,6,7,3,2,0,4] 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient(hunting): picked mon.noname-h con 0x7fc8801353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient(hunting): picked mon.noname-e con 0x7fc880135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient(hunting): picked mon.noname-f con 0x7fc88013bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88009f930 con 0x7fc88013bdf0 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88011e2d0 con 0x7fc8801353b0 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc88011c560 con 0x7fc880135870 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient(hunting): authenticate will time out at 1939.040862s 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc885238640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc880135870 0x7fc8801c8b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35340/0 (socket says 172.21.15.106:35340) 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc885238640 1 -- 172.21.15.106:0/1766012646 learned_addr learned my addr 172.21.15.106:0/1766012646 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2177849338 0 0) 0x7fc88011c560 con 0x7fc880135870 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): my global_id is 225098 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc864003530 con 0x7fc880135870 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2495127094 0 0) 0x7fc864003530 con 0x7fc880135870 2024-04-26T00:11:23.499 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc88011c560 con 0x7fc880135870 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc870001780 con 0x7fc880135870 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): dump: 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.500 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 14581318 0 0) 0x7fc878003d50 con 0x7fc88013bdf0 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): my global_id is 225235 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc864003530 con 0x7fc88013bdf0 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 462749472 0 0) 0x7fc88011e2d0 con 0x7fc8801353b0 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.501 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): my global_id is 254498 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc878003d50 con 0x7fc8801353b0 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1396750792 0 0) 0x7fc88011c560 con 0x7fc880135870 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.171:6791/0 conn(0x7fc8801353b0 legacy=0x7fc880134950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.171:6789/0 conn(0x7fc88013bdf0 legacy=0x7fc8801d43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 monclient: found mon.e 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88011da30 con 0x7fc880135870 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.502 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 5 monclient: authenticate success, global_id 225098 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient: _renew_subs 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc88011dd10 con 0x7fc880135870 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient: _renew_subs 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fc8801c9240 con 0x7fc880135870 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc8700011c0 con 0x7fc880135870 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc8700042e0 con 0x7fc880135870 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc877fff640 4 set_mon_vals no callback set 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: dump: 2024-04-26T00:11:23.503 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.504 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc8680065d0 con 0x7fc868002870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc870004480 con 0x7fc880135870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fc870045250 con 0x7fc880135870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1192412477 0 0) 0x7fc8680065d0 con 0x7fc868002870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient(hunting): my global_id is 254517 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc88011c560 con 0x7fc868002870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2249323261 0 0) 0x7fc88011c560 con 0x7fc868002870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc8680065d0 con 0x7fc868002870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc87c0019c0 con 0x7fc868002870 2024-04-26T00:11:23.505 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: dump: 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.506 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc88623a640 10 monclient: get_auth_request con 0x7fc864037a10 auth_method 0 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3963028123 0 0) 0x7fc8680065d0 con 0x7fc868002870 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc86800a160 con 0x7fc868002870 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc87c001d00 con 0x7fc868002870 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.106:6792/0 conn(0x7fc868002870 legacy=0x7fc868004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.507 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.512+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.106:6792/0 conn(0x7fc868002870 legacy=0x7fc868004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc868009e50 con 0x7fc868009110 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2931328131 0 0) 0x7fc868009e50 con 0x7fc868009110 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient(hunting): my global_id is 254526 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8680065d0 con 0x7fc868009110 2024-04-26T00:11:23.509 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1048351012 0 0) 0x7fc8680065d0 con 0x7fc868009110 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc868009e50 con 0x7fc868009110 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc87c004da0 con 0x7fc868009110 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient: dump: 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.510 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1943491193 0 0) 0x7fc868009e50 con 0x7fc868009110 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc86800c3e0 con 0x7fc868009110 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7555 (unknown 0 0 399122359) 0x7fc87c0070d0 con 0x7fc868009110 2024-04-26T00:11:23.511 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.106:6792/0 conn(0x7fc868009110 legacy=0x7fc8680095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc8767fc640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.106:6792/0 conn(0x7fc868009110 legacy=0x7fc8680095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 153581, 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:23.512 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.513 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.514 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:23.515 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:23.516 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.517 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.518 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.519 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.520 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:23.521 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.522 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.523 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.524 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.525 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:23.526 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.527 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.528 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.529 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.530 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.530 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:11:23.530 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.530 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.530 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.530 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:23.530 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:23.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.171:6812/722422047 conn(0x7fc864037a10 legacy=0x7fc864039ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 10 monclient: shutdown 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 >> v1:172.21.15.106:6793/0 conn(0x7fc880135870 legacy=0x7fc8801c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc88623a640 1 -- 172.21.15.106:0/1766012646 reap_dead start 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc88623a640 1 -- 172.21.15.106:0/1766012646 reap_dead start 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 shutdown_connections 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 >> 172.21.15.106:0/1766012646 conn(0x7fc8800a64e0 msgr2=0x7fc88013a750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 shutdown_connections 2024-04-26T00:11:23.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.520+0000 7fc887c9d640 1 -- 172.21.15.106:0/1766012646 wait complete. 2024-04-26T00:11:23.532 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:23.532 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-04-26T00:11:23.533 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:11:23.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.676+0000 7fd3fe93c640 10 monclient: get_monmap_and_config 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.676+0000 7fd3fe93c640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.676+0000 7fd3fe93c640 10 monclient: monmap: 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:23.682208+0000 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:23.682208+0000 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.654 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.655 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.655 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.655 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 Processor -- start 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- start start 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient: init 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient: _add_conns ranks=[5,7,3,2,1,4,0,8,6] 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient(hunting): picked mon.noname-h con 0x7fd3f8134820 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient(hunting): picked mon.noname-i con 0x7fd3f80725d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient(hunting): picked mon.noname-g con 0x7fd3f813ace0 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:23.658 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f8071270 con 0x7fd3f813ace0 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f80714e0 con 0x7fd3f8134820 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f80729f0 con 0x7fd3f80725d0 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient(hunting): authenticate will time out at 1939.209352s 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fced9640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fd3f813ace0 legacy=0x7fd3f813d0d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f77fe640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fd3f80725d0 0x7fd3f81395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:48076/0 (socket says 172.21.15.106:48076) 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f77fe640 1 -- 172.21.15.106:0/1259309435 learned_addr learned my addr 172.21.15.106:0/1259309435 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1290189041 0 0) 0x7fd3f80729f0 con 0x7fd3f80725d0 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): my global_id is 146635 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e0003530 con 0x7fd3f80725d0 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2141226592 0 0) 0x7fd3e8001120 con 0x7fd3f8134820 2024-04-26T00:11:23.659 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient(hunting): my global_id is 254507 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f80729f0 con 0x7fd3f8134820 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2790457637 0 0) 0x7fd3e0003530 con 0x7fd3f80725d0 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 >> v1:172.21.15.171:6791/0 conn(0x7fd3f8134820 legacy=0x7fd3f8134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 >> v1:172.21.15.171:6790/0 conn(0x7fd3f813ace0 legacy=0x7fd3f813d0d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 monclient: found mon.noname-i 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f80717c0 con 0x7fd3f80725d0 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.660 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 5 monclient: authenticate success, global_id 146635 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3ec001820 con 0x7fd3f80725d0 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: dump: 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.661 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd3ec001af0 con 0x7fd3f80725d0 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 4 set_mon_vals no callback set 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 1 -- 172.21.15.106:0/1259309435 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3ec001d20 con 0x7fd3f80725d0 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:11:23.662 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3f6ffd640 10 monclient: dump: 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.663 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 10 monclient: shutdown 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- 172.21.15.106:0/1259309435 >> v1:172.21.15.171:6792/0 conn(0x7fd3f80725d0 legacy=0x7fd3f81395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- 172.21.15.106:0/1259309435 shutdown_connections 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- 172.21.15.106:0/1259309435 >> 172.21.15.106:0/1259309435 conn(0x7fd3f80a64e0 msgr2=0x7fd3f80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- 172.21.15.106:0/1259309435 shutdown_connections 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.680+0000 7fd3fe93c640 1 -- 172.21.15.106:0/1259309435 wait complete. 2024-04-26T00:11:23.664 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: monmap: 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.665 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.666 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.666 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 Processor -- start 2024-04-26T00:11:23.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 -- start start 2024-04-26T00:11:23.666 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: init 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: _add_conns ranks=[6,4,1,2,5,7,8,0,3] 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient(hunting): picked mon.noname-d con 0x7fd3f80725d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient(hunting): picked mon.noname-c con 0x7fd3f8134820 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient(hunting): picked mon.noname-f con 0x7fd3f813ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f8137240 con 0x7fd3f813ace0 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f81386f0 con 0x7fd3f8134820 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3f8138130 con 0x7fd3f80725d0 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient(hunting): authenticate will time out at 1939.213036s 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f7fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fd3f80725d0 0x7fd3f8139f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49086/0 (socket says 172.21.15.106:49086) 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f7fff640 1 -- 172.21.15.106:0/3336225518 learned_addr learned my addr 172.21.15.106:0/3336225518 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.671 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1156038653 0 0) 0x7fd3f8138130 con 0x7fd3f80725d0 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): my global_id is 254535 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e4003530 con 0x7fd3f80725d0 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2440795626 0 0) 0x7fd3f81386f0 con 0x7fd3f8134820 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): my global_id is 274324 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f8138130 con 0x7fd3f8134820 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 581281749 0 0) 0x7fd3f8138130 con 0x7fd3f8134820 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd3f81386f0 con 0x7fd3f8134820 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3ec0017e0 con 0x7fd3f8134820 2024-04-26T00:11:23.672 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): dump: 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.673 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 47006378 0 0) 0x7fd3e4003530 con 0x7fd3f80725d0 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd3f8138130 con 0x7fd3f80725d0 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3e8001bb0 con 0x7fd3f80725d0 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:23.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): dump: 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.675 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1264006805 0 0) 0x7fd3f8137240 con 0x7fd3f813ace0 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): my global_id is 225244 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3e4003530 con 0x7fd3f813ace0 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 128819363 0 0) 0x7fd3f81386f0 con 0x7fd3f8134820 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.106:6792/0 conn(0x7fd3f80725d0 legacy=0x7fd3f8139f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.171:6789/0 conn(0x7fd3f813ace0 legacy=0x7fd3f81d4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 monclient: found mon.c 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.676 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3f8136760 con 0x7fd3f8134820 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 5 monclient: authenticate success, global_id 274324 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: _renew_subs 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd3f813a610 con 0x7fd3f8134820 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: _renew_subs 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd3f81cc4e0 con 0x7fd3f8134820 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd3f8072c40 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd3ec0011b0 con 0x7fd3f8134820 2024-04-26T00:11:23.677 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3ec005010 con 0x7fd3f8134820 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: dump: 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.678 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f67fc640 4 set_mon_vals no callback set 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd3ec00fdb0 con 0x7fd3f8134820 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fd3ec045090 con 0x7fd3f8134820 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311003914 0 0) 0x7fd3f8072c40 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient(hunting): my global_id is 225107 2024-04-26T00:11:23.679 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f81386f0 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3fced9640 10 monclient: get_auth_request con 0x7fd3e4037f00 auth_method 0 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 946816662 0 0) 0x7fd3f81386f0 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd3f8072c40 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3e8003b90 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 10 monclient: dump: 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.680 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2489348718 0 0) 0x7fd3f8072c40 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.684+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd3f8075890 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.688+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd3e8003e80 con 0x7fd3f81cc7d0 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.688+0000 7fd3f4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.688+0000 7fd3f4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.688+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.106:6793/0 conn(0x7fd3f81cc7d0 legacy=0x7fd3f8130ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.688+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.106:6793/0 conn(0x7fd3f81cc7d0 legacy=0x7fd3f8130ae0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.681 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd3f8062e50 con 0x7fd3f802d010 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2095813796 0 0) 0x7fd3f8062e50 con 0x7fd3f802d010 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient(hunting): my global_id is 225116 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd3f8072c40 con 0x7fd3f802d010 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3395042865 0 0) 0x7fd3f8072c40 con 0x7fd3f802d010 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd3f8062e50 con 0x7fd3f802d010 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd3e80057d0 con 0x7fd3f802d010 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:23.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient: dump: 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.683 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2805188126 0 0) 0x7fd3f8062e50 con 0x7fd3f802d010 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd3f806c310 con 0x7fd3f802d010 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7895 (unknown 0 0 2739923600) 0x7fd3e8007a90 con 0x7fd3f802d010 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.106:6793/0 conn(0x7fd3f802d010 legacy=0x7fd3f81311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3f4ff9640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.106:6793/0 conn(0x7fd3f802d010 legacy=0x7fd3f81311f0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:23.684 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 396924, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.685 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.686 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.687 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:23.688 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.689 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.690 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.691 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.692 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.693 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.694 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.695 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.696 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:23.697 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.698 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.699 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.700 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.701 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:11:23.702 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:23.703 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.171:6812/722422047 conn(0x7fd3e4037f00 legacy=0x7fd3e403a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 10 monclient: shutdown 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 >> v1:172.21.15.106:6791/0 conn(0x7fd3f8134820 legacy=0x7fd3f81d15a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fced9640 1 -- 172.21.15.106:0/3336225518 reap_dead start 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fced9640 1 -- 172.21.15.106:0/3336225518 reap_dead start 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 shutdown_connections 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 >> 172.21.15.106:0/3336225518 conn(0x7fd3f80a64e0 msgr2=0x7fd3f80a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 shutdown_connections 2024-04-26T00:11:23.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.692+0000 7fd3fe93c640 1 -- 172.21.15.106:0/3336225518 wait complete. 2024-04-26T00:11:23.706 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:23.706 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-04-26T00:11:23.706 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:11:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.844+0000 7f36cd598640 10 monclient: get_monmap_and_config 2024-04-26T00:11:23.821 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.844+0000 7f36cd598640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.844+0000 7f36cd598640 10 monclient: monmap: 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:23.850056+0000 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:23.850056+0000 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.822 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.823 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.823 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 Processor -- start 2024-04-26T00:11:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- start start 2024-04-26T00:11:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: init 2024-04-26T00:11:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.829 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: _add_conns ranks=[0,8,1,2,3,7,4,5,6] 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient(hunting): picked mon.noname-a con 0x7f36c8134820 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient(hunting): picked mon.noname-e con 0x7f36c80725d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient(hunting): picked mon.noname-f con 0x7f36c813ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c8071270 con 0x7f36c8134820 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c80714e0 con 0x7f36c813ace0 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c80729f0 con 0x7f36c80725d0 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient(hunting): authenticate will time out at 1939.377171s 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c67fc640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f36c80725d0 0x7f36c81395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35380/0 (socket says 172.21.15.106:35380) 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c6ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f36c8134820 0x7f36c8134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46560/0 (socket says 172.21.15.106:46560) 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c67fc640 1 -- 172.21.15.106:0/4071309610 learned_addr learned my addr 172.21.15.106:0/4071309610 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3319874774 0 0) 0x7f36c80729f0 con 0x7f36c80725d0 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.830 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): my global_id is 225125 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36b0003530 con 0x7f36c80725d0 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2533717158 0 0) 0x7f36c8071270 con 0x7f36c8134820 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient(hunting): my global_id is 274266 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c80729f0 con 0x7f36c8134820 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1849392596 0 0) 0x7f36c80729f0 con 0x7f36c8134820 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 >> v1:172.21.15.106:6793/0 conn(0x7f36c80725d0 legacy=0x7f36c81395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 >> v1:172.21.15.171:6789/0 conn(0x7f36c813ace0 legacy=0x7f36c813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 monclient: found mon.noname-a 2024-04-26T00:11:23.831 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c80717c0 con 0x7f36c8134820 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f36b80017a0 con 0x7f36c8134820 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 5 monclient: authenticate success, global_id 274266 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: dump: 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.832 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.833 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.834 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.834 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.834 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.834 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36b8001b00 con 0x7f36c8134820 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 1 -- 172.21.15.106:0/4071309610 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f36b8004b30 con 0x7f36c8134820 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 4 set_mon_vals no callback set 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36c5ffb640 10 monclient: dump: 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.835 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: shutdown 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- 172.21.15.106:0/4071309610 >> v1:172.21.15.106:6789/0 conn(0x7f36c8134820 legacy=0x7f36c8134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- 172.21.15.106:0/4071309610 shutdown_connections 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- 172.21.15.106:0/4071309610 >> 172.21.15.106:0/4071309610 conn(0x7f36c80a64e0 msgr2=0x7f36c80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- 172.21.15.106:0/4071309610 shutdown_connections 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- 172.21.15.106:0/4071309610 wait complete. 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: monmap: 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.837 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 Processor -- start 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 1 -- start start 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.848+0000 7f36cd598640 10 monclient: init 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient: _add_conns ranks=[3,0,5,1,7,2,4,6,8] 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient(hunting): picked mon.noname-g con 0x7f36c80725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:23.838 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient(hunting): picked mon.noname-a con 0x7f36c8134820 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient(hunting): picked mon.noname-h con 0x7f36c813ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c8137560 con 0x7f36c8134820 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c806f200 con 0x7f36c80725d0 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36c81363e0 con 0x7f36c813ace0 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient(hunting): authenticate will time out at 1939.380354s 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c67fc640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f36c8134820 legacy=0x7f36c806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c67fc640 1 -- >> v1:172.21.15.106:6789/0 conn(0x7f36c8134820 legacy=0x7f36c806eaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c67fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f36c8134820 0x7f36c806eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify read banner and identify addresses failed 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c67fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f36c8134820 0x7f36c806eaf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6789/0 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c6ffd640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f36c80725d0 legacy=0x7f36c806e3e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c77fe640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f36c813ace0 0x7f36c81d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:47080/0 (socket says 172.21.15.106:47080) 2024-04-26T00:11:23.839 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c77fe640 1 -- 172.21.15.106:0/2857329688 learned_addr learned my addr 172.21.15.106:0/2857329688 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 780885365 0 0) 0x7f36c81363e0 con 0x7f36c813ace0 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): my global_id is 254516 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36b4003530 con 0x7f36c813ace0 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 108184447 0 0) 0x7f36b4003530 con 0x7f36c813ace0 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36c81363e0 con 0x7f36c813ace0 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f36c0001d20 con 0x7f36c813ace0 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): dump: 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.840 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:23.841 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 382862222 0 0) 0x7f36c81363e0 con 0x7f36c813ace0 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.171:6790/0 conn(0x7f36c80725d0 legacy=0x7f36c806e3e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.106:6789/0 conn(0x7f36c8134820 legacy=0x7f36c806eaf0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 monclient: found mon.h 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36c8134de0 con 0x7f36c813ace0 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 5 monclient: authenticate success, global_id 254516 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient: _renew_subs 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:11:23.842 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f36c8072c60 con 0x7f36c813ace0 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient: _renew_subs 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f36c8135e00 con 0x7f36c813ace0 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f36c00020b0 con 0x7f36c813ace0 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36c57fa640 4 set_mon_vals no callback set 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f36c0003f90 con 0x7f36c813ace0 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient: dump: 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.843 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f36a80065d0 con 0x7f36a8002870 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f36c00041b0 con 0x7f36c813ace0 2024-04-26T00:11:23.844 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f36c00454d0 con 0x7f36c813ace0 2024-04-26T00:11:23.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3090745643 0 0) 0x7f36a80065d0 con 0x7f36a8002870 2024-04-26T00:11:23.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 10 monclient(hunting): my global_id is 225262 2024-04-26T00:11:23.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.852+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36c81363e0 con 0x7f36a8002870 2024-04-26T00:11:23.845 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36c67fc640 10 monclient: get_auth_request con 0x7f36b40377e0 auth_method 0 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1036253794 0 0) 0x7f36c81363e0 con 0x7f36a8002870 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36a80065d0 con 0x7f36a8002870 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f36b8004b30 con 0x7f36a8002870 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 10 monclient: dump: 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.847 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4247134876 0 0) 0x7f36a80065d0 con 0x7f36a8002870 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f36a800a160 con 0x7f36a8002870 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f36b8004ba0 con 0x7f36a8002870 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:23.848 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.171:6789/0 conn(0x7f36a8002870 legacy=0x7f36a8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.856+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.171:6789/0 conn(0x7f36a8002870 legacy=0x7f36a8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.860+0000 7f36cd598640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.860+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f36a8009e30 con 0x7f36a80090f0 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3578747685 0 0) 0x7f36a8009e30 con 0x7f36a80090f0 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient(hunting): my global_id is 225271 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36a80065d0 con 0x7f36a80090f0 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 15524155 0 0) 0x7f36a80065d0 con 0x7f36a80090f0 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f36a8009e30 con 0x7f36a80090f0 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f36b8001820 con 0x7f36a80090f0 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.849 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient: dump: 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.850 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2017553905 0 0) 0x7f36a8009e30 con 0x7f36a80090f0 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f36a800c3a0 con 0x7f36a80090f0 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7725 (unknown 0 0 885881996) 0x7f36b8007490 con 0x7f36a80090f0 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.171:6789/0 conn(0x7f36a80090f0 legacy=0x7f36a8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36af7fe640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.171:6789/0 conn(0x7f36a80090f0 legacy=0x7f36a8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:23.851 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 397096, 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:23.852 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.853 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.854 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.854 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.854 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.854 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.854 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.854 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.855 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:23.856 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:23.857 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.858 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:23.859 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.860 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:23.861 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.862 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.863 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.864 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.865 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:23.866 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.867 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.868 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:23.869 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.870 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:23.871 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.171:6812/722422047 conn(0x7f36b40377e0 legacy=0x7f36b4039ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 10 monclient: shutdown 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 >> v1:172.21.15.171:6791/0 conn(0x7f36c813ace0 legacy=0x7f36c81d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36c77fe640 1 -- 172.21.15.106:0/2857329688 reap_dead start 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36c77fe640 1 -- 172.21.15.106:0/2857329688 reap_dead start 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 shutdown_connections 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 >> 172.21.15.106:0/2857329688 conn(0x7f36c80a64e0 msgr2=0x7f36c80a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:23.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 shutdown_connections 2024-04-26T00:11:23.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:23.864+0000 7f36cd598640 1 -- 172.21.15.106:0/2857329688 wait complete. 2024-04-26T00:11:23.874 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:23.874 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-04-26T00:11:23.874 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:11:23.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient: get_monmap_and_config 2024-04-26T00:11:23.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient: build_initial_monmap 2024-04-26T00:11:23.986 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient: monmap: 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:24.014937+0000 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:24.014937+0000 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:23.987 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:23.988 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:23.988 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:23.988 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 1 Processor -- start 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 1 -- start start 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient: init 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient: _add_conns ranks=[7,8,3,1,0,4,2,6,5] 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient(hunting): picked mon.noname-i con 0x7f18180a1290 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient(hunting): picked mon.noname-e con 0x7f181809f770 addr v1:172.21.15.106:6793/0 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient(hunting): picked mon.noname-g con 0x7f181809fb70 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:23.994 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18180727a0 con 0x7f181809fb70 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18180724c0 con 0x7f18180a1290 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1818072a80 con 0x7f181809f770 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient(hunting): authenticate will time out at 1939.542882s 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181d67e640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f181809f770 0x7f181813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:35394/0 (socket says 172.21.15.106:35394) 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181d67e640 1 -- 172.21.15.106:0/1788263118 learned_addr learned my addr 172.21.15.106:0/1788263118 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181e680640 1 -- 172.21.15.106:0/1788263118 >> v1:172.21.15.171:6790/0 conn(0x7f181809fb70 legacy=0x7f181813de00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073347524 0 0) 0x7f1818072a80 con 0x7f181809f770 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient(hunting): _negotiate 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:23.995 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient(hunting): my global_id is 225134 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1804003530 con 0x7f181809f770 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2507536505 0 0) 0x7f1804003530 con 0x7f181809f770 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 >> v1:172.21.15.171:6792/0 conn(0x7f18180a1290 legacy=0x7f18180a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 >> v1:172.21.15.171:6790/0 conn(0x7f181809fb70 legacy=0x7f181813de00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: _finish_hunting 0 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 monclient: found mon.noname-e 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181806bfc0 con 0x7f181809f770 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: _finish_auth 0 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: _check_auth_tickets 2024-04-26T00:11:23.996 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f18080017c0 con 0x7f181809f770 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: dump: 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:23.997 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 5 monclient: authenticate success, global_id 225134 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1808001b20 con 0x7f181809f770 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:23.998 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 1 -- 172.21.15.106:0/1788263118 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1808004bf0 con 0x7f181809f770 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f18200e3640 4 set_mon_vals no callback set 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.012+0000 7f181ce7d640 10 monclient: dump: 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:23.999 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: shutdown 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/1788263118 >> v1:172.21.15.106:6793/0 conn(0x7f181809f770 legacy=0x7f181813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.000 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/1788263118 shutdown_connections 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/1788263118 >> 172.21.15.106:0/1788263118 conn(0x7f181806b210 msgr2=0x7f181806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/1788263118 shutdown_connections 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/1788263118 wait complete. 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: build_initial_monmap 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: monmap: 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:24.001 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 Processor -- start 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- start start 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: init 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:24.002 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: _add_conns ranks=[2,3,1,7,6,8,4,5,0] 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient(hunting): picked mon.noname-b con 0x7f181809f770 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient(hunting): picked mon.noname-g con 0x7f181809fb70 addr v1:172.21.15.171:6790/0 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient(hunting): picked mon.noname-f con 0x7f18180a1290 addr v1:172.21.15.171:6789/0 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181806d140 con 0x7f18180a1290 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18180a1f00 con 0x7f181809f770 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f181806dd50 con 0x7f181809fb70 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient(hunting): authenticate will time out at 1939.545822s 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f181de7f640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f181809f770 0x7f181806c320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42790/0 (socket says 172.21.15.106:42790) 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f181d67e640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f181809fb70 legacy=0x7f181806ca30 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f181de7f640 1 -- 172.21.15.106:0/4154680949 learned_addr learned my addr 172.21.15.106:0/4154680949 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:24.003 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1522049930 0 0) 0x7f18180a1f00 con 0x7f181809f770 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): my global_id is 254549 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc003530 con 0x7f181809f770 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3220306733 0 0) 0x7f17fc003530 con 0x7f181809f770 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18180a1f00 con 0x7f181809f770 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1814001a40 con 0x7f181809f770 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): dump: 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.004 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.005 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 170029282 0 0) 0x7f181806d140 con 0x7f18180a1290 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient(hunting): my global_id is 225280 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17fc003530 con 0x7f18180a1290 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 987420350 0 0) 0x7f18180a1f00 con 0x7f181809f770 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.171:6790/0 conn(0x7f181809fb70 legacy=0x7f181806ca30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.171:6789/0 conn(0x7f18180a1290 legacy=0x7f18181d4930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:24.006 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 monclient: found mon.b 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f181809ce00 con 0x7f181809f770 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 5 monclient: authenticate success, global_id 254549 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: _renew_subs 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f181813eed0 con 0x7f181809f770 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: _renew_subs 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:24.007 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f181813e520 con 0x7f181809f770 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1814003950 con 0x7f181809f770 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1814003e40 con 0x7f181809f770 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180ffff640 4 set_mon_vals no callback set 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 10 monclient: dump: 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.008 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1814004060 con 0x7f181809f770 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:24.009 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f18000065d0 con 0x7f1800002870 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.016+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f1814045340 con 0x7f181809f770 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f181e680640 10 monclient: get_auth_request con 0x7f17fc0376c0 auth_method 0 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631552992 0 0) 0x7f18000065d0 con 0x7f1800002870 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient(hunting): my global_id is 254525 2024-04-26T00:11:24.010 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18180a1f00 con 0x7f1800002870 2024-04-26T00:11:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1356598805 0 0) 0x7f18180a1f00 con 0x7f1800002870 2024-04-26T00:11:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f18000065d0 con 0x7f1800002870 2024-04-26T00:11:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1808001220 con 0x7f1800002870 2024-04-26T00:11:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.014 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient: dump: 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.015 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4142904725 0 0) 0x7f18000065d0 con 0x7f1800002870 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f180000a160 con 0x7f1800002870 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f18080011e0 con 0x7f1800002870 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.171:6791/0 conn(0x7f1800002870 legacy=0x7f1800004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.020+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.171:6791/0 conn(0x7f1800002870 legacy=0x7f1800004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:24.016 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f1800009e30 con 0x7f18000090f0 2024-04-26T00:11:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 502414535 0 0) 0x7f1800009e30 con 0x7f18000090f0 2024-04-26T00:11:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient(hunting): my global_id is 254534 2024-04-26T00:11:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18000065d0 con 0x7f18000090f0 2024-04-26T00:11:24.017 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1893635629 0 0) 0x7f18000065d0 con 0x7f18000090f0 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1800009e30 con 0x7f18000090f0 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1808005000 con 0x7f18000090f0 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient: dump: 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.018 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1180316759 0 0) 0x7f1800009e30 con 0x7f18000090f0 2024-04-26T00:11:24.019 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f180000c3a0 con 0x7f18000090f0 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7555 (unknown 0 0 215347547) 0x7f1808007340 con 0x7f18000090f0 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.171:6791/0 conn(0x7f18000090f0 legacy=0x7f1800009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f180e7fc640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.171:6791/0 conn(0x7f18000090f0 legacy=0x7f1800009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:24.020 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 154084, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:24.021 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:24.022 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:24.023 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:24.024 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:24.025 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:24.026 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:24.027 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.028 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.029 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.030 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.031 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.032 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.033 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.034 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.035 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.036 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.037 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:24.038 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:24.039 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:24.040 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.041 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.042 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.042 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:24.042 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:24.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.171:6812/722422047 conn(0x7f17fc0376c0 legacy=0x7f17fc039b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.043 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 10 monclient: shutdown 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 >> v1:172.21.15.106:6790/0 conn(0x7f181809f770 legacy=0x7f181806c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f181e680640 1 -- 172.21.15.106:0/4154680949 reap_dead start 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f181e680640 1 -- 172.21.15.106:0/4154680949 reap_dead start 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 shutdown_connections 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 >> 172.21.15.106:0/4154680949 conn(0x7f181806b210 msgr2=0x7f18180a69f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 shutdown_connections 2024-04-26T00:11:24.044 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.028+0000 7f18200e3640 1 -- 172.21.15.106:0/4154680949 wait complete. 2024-04-26T00:11:24.044 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:24.045 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-04-26T00:11:24.045 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: get_monmap_and_config 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: build_initial_monmap 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: monmap: 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:11:24.198511+0000 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:11:24.198511+0000 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:24.170 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:24.171 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 Processor -- start 2024-04-26T00:11:24.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- start start 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: init 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: _add_conns ranks=[6,4,2,0,1,5,7,3,8] 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient(hunting): picked mon.noname-d con 0x7f9310071bc0 addr v1:172.21.15.106:6792/0 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient(hunting): picked mon.noname-c con 0x7f931009e6f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient(hunting): picked mon.noname-b con 0x7f931006f5d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931009fba0 con 0x7f931006f5d0 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931009fe80 con 0x7f931009e6f0 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93100a0c20 con 0x7f9310071bc0 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient(hunting): authenticate will time out at 1939.725674s 2024-04-26T00:11:24.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930effd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f931009e6f0 0x7f93101396c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:47986/0 (socket says 172.21.15.106:47986) 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930effd640 1 -- 172.21.15.106:0/1844637236 learned_addr learned my addr 172.21.15.106:0/1844637236 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930f7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9310071bc0 0x7f9310071fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:49094/0 (socket says 172.21.15.106:49094) 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3209874048 0 0) 0x7f931009fba0 con 0x7f931006f5d0 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): my global_id is 254558 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92fc003530 con 0x7f931006f5d0 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4054439090 0 0) 0x7f931009fe80 con 0x7f931009e6f0 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): my global_id is 274333 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f931009fba0 con 0x7f931009e6f0 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014998418 0 0) 0x7f93100a0c20 con 0x7f9310071bc0 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient(hunting): my global_id is 254544 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f931009fe80 con 0x7f9310071bc0 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2061629592 0 0) 0x7f92fc003530 con 0x7f931006f5d0 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 >> v1:172.21.15.106:6792/0 conn(0x7f9310071bc0 legacy=0x7f9310071fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 >> v1:172.21.15.106:6791/0 conn(0x7f931009e6f0 legacy=0x7f93101396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:11:24.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 monclient: found mon.noname-b 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93100a0f70 con 0x7f931006f5d0 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93000016f0 con 0x7f931006f5d0 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 5 monclient: authenticate success, global_id 254558 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:24.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: dump: 2024-04-26T00:11:24.185 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.185 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.185 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.185 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.186 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.187 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.187 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.187 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.187 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.187 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:11:24.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9300001a10 con 0x7f931006f5d0 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: get_monmap_and_config success 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 4 set_mon_vals no callback set 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 1 -- 172.21.15.106:0/1844637236 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9300003960 con 0x7f931006f5d0 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f930e7fc640 10 monclient: dump: 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.188 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: shutdown 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- 172.21.15.106:0/1844637236 >> v1:172.21.15.106:6790/0 conn(0x7f931006f5d0 legacy=0x7f931013cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- 172.21.15.106:0/1844637236 shutdown_connections 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- 172.21.15.106:0/1844637236 >> 172.21.15.106:0/1844637236 conn(0x7f93100a6fe0 msgr2=0x7f93100a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- 172.21.15.106:0/1844637236 shutdown_connections 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 1 -- 172.21.15.106:0/1844637236 wait complete. 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: build_initial_monmap 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.196+0000 7f9315fe7640 10 monclient: monmap: 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:11:24.190 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 Processor -- start 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 -- start start 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient: init 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient: _reopen_session rank -1 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient: _add_conns ranks=[7,0,2,4,6,1,8,3,5] 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient(hunting): picked mon.noname-i con 0x7f931006f5d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient(hunting): picked mon.noname-a con 0x7f9310071bc0 addr v1:172.21.15.106:6789/0 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient(hunting): picked mon.noname-b con 0x7f931009e6f0 addr v1:172.21.15.106:6790/0 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9310127db0 con 0x7f9310071bc0 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9310127990 con 0x7f931009e6f0 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f931009ef40 con 0x7f931006f5d0 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient(hunting): _renew_subs 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient(hunting): authenticate will time out at 1939.728930s 2024-04-26T00:11:24.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f930effd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9310071bc0 0x7f93101d16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:46584/0 (socket says 172.21.15.106:46584) 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f930effd640 1 -- 172.21.15.106:0/2705466612 learned_addr learned my addr 172.21.15.106:0/2705466612 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f930ffff640 1 --1- 172.21.15.106:0/2705466612 >> v1:172.21.15.106:6790/0 conn(0x7f931009e6f0 0x7f93101d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42806/0 (socket says 172.21.15.106:42806) 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678380518 0 0) 0x7f92f80011e0 con 0x7f9310071bc0 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): my global_id is 274275 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f0003530 con 0x7f9310071bc0 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612841065 0 0) 0x7f9310127990 con 0x7f931009e6f0 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): my global_id is 254567 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f80011e0 con 0x7f931009e6f0 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 709315987 0 0) 0x7f92f80011e0 con 0x7f931009e6f0 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9310127990 con 0x7f931009e6f0 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93000016b0 con 0x7f931009e6f0 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): dump: 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.194 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.195 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2686100955 0 0) 0x7f92f0003530 con 0x7f9310071bc0 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92f80011e0 con 0x7f9310071bc0 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f92f8001b90 con 0x7f9310071bc0 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): dump: 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.196 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2394137813 0 0) 0x7f9310127990 con 0x7f931009e6f0 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.171:6792/0 conn(0x7f931006f5d0 legacy=0x7f93101cc510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.106:6789/0 conn(0x7f9310071bc0 legacy=0x7f93101d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: _finish_hunting 0 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 monclient: found mon.b 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93101256a0 con 0x7f931009e6f0 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: _finish_auth 0 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: _check_auth_tickets 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 5 monclient: authenticate success, global_id 254567 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient: _renew_subs 2024-04-26T00:11:24.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f93101276b0 con 0x7f931009e6f0 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient: _renew_subs 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9310124a60 con 0x7f931009e6f0 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9300001a10 con 0x7f931009e6f0 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9300004000 con 0x7f931009e6f0 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f930dffb640 4 set_mon_vals no callback set 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient: dump: 2024-04-26T00:11:24.199 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.200 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f93000041a0 con 0x7f931009e6f0 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f93000450a0 con 0x7f931009e6f0 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f930effd640 10 monclient: get_auth_request con 0x7f92f0037e30 auth_method 0 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1368773970 0 0) 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 10 monclient(hunting): my global_id is 146662 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.200+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9310127990 con 0x7f92f4002870 2024-04-26T00:11:24.201 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3647948091 0 0) 0x7f9310127990 con 0x7f92f4002870 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9308001c30 con 0x7f92f4002870 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 10 monclient: dump: 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.202 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3342526258 0 0) 0x7f92f40065d0 con 0x7f92f4002870 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f92f400a160 con 0x7f92f4002870 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9308002020 con 0x7f92f4002870 2024-04-26T00:11:24.203 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:11:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:11:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.171:6792/0 conn(0x7f92f4002870 legacy=0x7f92f4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.204 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.204+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.171:6792/0 conn(0x7f92f4002870 legacy=0x7f92f4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.208+0000 7f9315fe7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.208+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 928711857 0 0) 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient(hunting): _negotiate 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient(hunting): my global_id is 146671 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f92f40065d0 con 0x7f92f40090f0 2024-04-26T00:11:24.205 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 594126550 0 0) 0x7f92f40065d0 con 0x7f92f40090f0 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93080050a0 con 0x7f92f40090f0 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient: dump: 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:11:24.206 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1141481191 0 0) 0x7f92f4009e30 con 0x7f92f40090f0 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f92f400c3a0 con 0x7f92f40090f0 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7555 (unknown 0 0 2336532605) 0x7f9308007380 con 0x7f92f40090f0 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:11:24.207 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.171:6792/0 conn(0x7f92f40090f0 legacy=0x7f92f4009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9307fff640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.171:6792/0 conn(0x7f92f40090f0 legacy=0x7f92f4009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 106, 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 747741, 2024-04-26T00:11:24.208 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:24.209 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:24.210 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:24.211 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:11:24.212 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:11:24.213 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.214 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.216 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:11:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:11:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:11:24.217 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:11:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:11:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.218 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.221 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.222 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.223 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.224 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.225 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:11:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:11:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:11:24.226 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:11:24.227 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.228 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.229 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:11:24.230 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:11:24.231 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:11:24.232 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:11:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:11:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:11:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:11:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:11:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:11:24.233 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:11:24.233 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:11:24.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.171:6812/722422047 conn(0x7f92f0037e30 legacy=0x7f92f003a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 10 monclient: shutdown 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 >> v1:172.21.15.106:6790/0 conn(0x7f931009e6f0 legacy=0x7f93101d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f930ffff640 1 -- 172.21.15.106:0/2705466612 reap_dead start 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f930ffff640 1 -- 172.21.15.106:0/2705466612 reap_dead start 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 shutdown_connections 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 >> 172.21.15.106:0/2705466612 conn(0x7f93100a6fe0 msgr2=0x7f93101348d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 shutdown_connections 2024-04-26T00:11:24.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:11:24.212+0000 7f9315fe7640 1 -- 172.21.15.106:0/2705466612 wait complete. 2024-04-26T00:11:24.236 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-04-26T00:11:24.236 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-26T00:12:54.236 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-04-26T00:12:54.237 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-04-26T00:12:54.237 INFO:tasks.ceph.mon.g:Restarting daemon 2024-04-26T00:12:54.237 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-04-26T00:12:54.241 INFO:tasks.ceph.mon.g:Started 2024-04-26T00:12:54.241 INFO:tasks.mon_thrash:Sending STOP to mon a 2024-04-26T00:12:54.241 INFO:tasks.ceph.mon.a:Sent signal 19 2024-04-26T00:12:54.241 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-04-26T00:12:54.242 INFO:tasks.ceph.mon.h:Sent signal 19 2024-04-26T00:12:54.242 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T00:13:09.243 INFO:tasks.mon_thrash:Sending CONT to mon a 2024-04-26T00:13:09.243 INFO:tasks.ceph.mon.a:Sent signal 18 2024-04-26T00:13:09.243 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-04-26T00:13:09.244 INFO:tasks.ceph.mon.h:Sent signal 18 2024-04-26T00:13:09.244 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:13:09.244 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:13:09.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient: get_monmap_and_config 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient: build_initial_monmap 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient: monmap: 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:09.407439+0000 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:09.407439+0000 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:09.378 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:09.379 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:09.379 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:09.379 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:09.379 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:09.379 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:09.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 1 Processor -- start 2024-04-26T00:13:09.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 1 -- start start 2024-04-26T00:13:09.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient: init 2024-04-26T00:13:09.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:09.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient: _add_conns ranks=[5,6,7,1,4,3,8,0,2] 2024-04-26T00:13:09.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient(hunting): picked mon.noname-h con 0x7fa4dc137c40 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient(hunting): picked mon.noname-d con 0x7fa4dc09fca0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient(hunting): picked mon.noname-i con 0x7fa4dc137570 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc06ee10 con 0x7fa4dc137c40 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc0a2220 con 0x7fa4dc09fca0 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc06f0f0 con 0x7fa4dc137570 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4e26d5640 10 monclient(hunting): authenticate will time out at 2044.934857s 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4d3fff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fa4dc09fca0 0x7fa4dc0a1b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:44090/0 (socket says 172.21.15.106:44090) 2024-04-26T00:13:09.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:09.403+0000 7fa4d3fff640 1 -- 172.21.15.106:0/2752508224 learned_addr learned my addr 172.21.15.106:0/2752508224 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:12.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient(hunting): tick 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 1 monclient(hunting): continuing hunt 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 1 -- 172.21.15.106:0/2752508224 >> v1:172.21.15.171:6792/0 conn(0x7fa4dc137570 legacy=0x7fa4dc1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 1 -- 172.21.15.106:0/2752508224 >> v1:172.21.15.106:6792/0 conn(0x7fa4dc09fca0 legacy=0x7fa4dc0a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 1 -- 172.21.15.106:0/2752508224 >> v1:172.21.15.171:6791/0 conn(0x7fa4dc137c40 legacy=0x7fa4dc0a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient: _add_conns ranks=[8,4,2,0,3,1] 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient(hunting): picked mon.noname-e con 0x7fa4bc0037f0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient(hunting): picked mon.noname-c con 0x7fa4bc007440 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient(hunting): picked mon.noname-b con 0x7fa4bc00b1d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 1 -- 172.21.15.106:0/2752508224 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc06f3d0 con 0x7fa4bc00b1d0 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 1 -- 172.21.15.106:0/2752508224 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4bc010000 con 0x7fa4bc007440 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 1 -- 172.21.15.106:0/2752508224 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4bc011290 con 0x7fa4bc0037f0 2024-04-26T00:13:12.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:12.402+0000 7fa4da7fc640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:14.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957485489 0 0) 0x7fa4dc06f3d0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:14.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:14.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:14.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): my global_id is 254576 2024-04-26T00:13:14.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4c8003530 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3973749525 0 0) 0x7fa4bc011290 con 0x7fa4bc0037f0 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient(hunting): my global_id is 225143 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4dc06f3d0 con 0x7fa4bc0037f0 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1802590880 0 0) 0x7fa4c8003530 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 >> v1:172.21.15.106:6793/0 conn(0x7fa4bc0037f0 legacy=0x7fa4bc005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 >> v1:172.21.15.106:6791/0 conn(0x7fa4bc007440 legacy=0x7fa4bc009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 monclient: found mon.noname-b 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4bc0125e0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: _finish_auth 0 2024-04-26T00:13:14.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4d4001b00 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: dump: 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:14.288 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e0c72640 1 -- 172.21.15.106:0/2752508224 reap_dead start 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 5 monclient: authenticate success, global_id 254576 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4d4001d90 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 1 -- 172.21.15.106:0/2752508224 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4d4003ce0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:14.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 4 set_mon_vals no callback set 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4db7fe640 10 monclient: dump: 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:14.290 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:14.291 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:14.291 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:14.291 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:14.291 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:14.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 10 monclient: shutdown 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2752508224 >> v1:172.21.15.106:6790/0 conn(0x7fa4bc00b1d0 legacy=0x7fa4bc00d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2752508224 shutdown_connections 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2752508224 >> 172.21.15.106:0/2752508224 conn(0x7fa4dc0a64e0 msgr2=0x7fa4dc0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2752508224 shutdown_connections 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2752508224 wait complete. 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.310+0000 7fa4e26d5640 10 monclient: build_initial_monmap 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: monmap: 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:14.295 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 1 Processor -- start 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 1 -- start start 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: init 2024-04-26T00:13:14.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: _add_conns ranks=[8,1,0,5,2,6,7,4,3] 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient(hunting): picked mon.noname-e con 0x7fa4bc00b1d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient(hunting): picked mon.noname-f con 0x7fa4dc12f7c0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient(hunting): picked mon.noname-a con 0x7fa4dc136cc0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc11e860 con 0x7fa4dc136cc0 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc11d0d0 con 0x7fa4dc12f7c0 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa4dc1bfa30 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient(hunting): authenticate will time out at 2049.845435s 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4dbfff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fa4bc00b1d0 0x7fa4dc12f0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:46592/0 (socket says 172.21.15.106:46592) 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4dbfff640 1 -- 172.21.15.106:0/2374942671 learned_addr learned my addr 172.21.15.106:0/2374942671 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370923714 0 0) 0x7fa4dc1bfa30 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:14.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): my global_id is 225152 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4bc0101d0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1025892238 0 0) 0x7fa4bc0101d0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa4dc1bfa30 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4cc001b20 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): dump: 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:14.298 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 450510932 0 0) 0x7fa4dc11d0d0 con 0x7fa4dc12f7c0 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient(hunting): my global_id is 225289 2024-04-26T00:13:14.299 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4bc0101d0 con 0x7fa4dc12f7c0 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1289992591 0 0) 0x7fa4dc1bfa30 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 >> v1:172.21.15.171:6789/0 conn(0x7fa4dc12f7c0 legacy=0x7fa4dc1d1720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 >> v1:172.21.15.106:6789/0 conn(0x7fa4dc136cc0 legacy=0x7fa4dc1d4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 monclient: found mon.e 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4dc11e580 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient: _finish_auth 0 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4d97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 5 monclient: authenticate success, global_id 225152 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: _renew_subs 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:14.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa4dc11cdc0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: _renew_subs 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.314+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fa4dc1d6740 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4e26d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4e26d5640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4e26d5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4dc075890 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa4cc003930 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fa4cc003ea0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 10 monclient: dump: 2024-04-26T00:13:14.301 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:14.302 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fa4cc004040 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4daffd640 4 set_mon_vals no callback set 2024-04-26T00:13:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fa4cc0452a0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.318+0000 7fa4d3fff640 10 monclient: get_auth_request con 0x7fa4bc038ea0 auth_method 0 2024-04-26T00:13:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.322+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fa4dc06ee10 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.322+0000 7fa4d97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:14.303 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.322+0000 7fa4d97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:14.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.550+0000 7fa4e26d5640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:13:14.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.550+0000 7fa4e26d5640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:14.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.550+0000 7fa4e26d5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:14.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.550+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa4dc062e50 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.550+0000 7fa4d97fa640 1 -- 172.21.15.106:0/2374942671 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2739 (unknown 254746657 0 217035059) 0x7fa4cc0158f0 con 0x7fa4bc00b1d0 2024-04-26T00:13:14.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.550+0000 7fa4d97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:14.526 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.550+0000 7fa4d97fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:14.527 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":110,"quorum":[0,1,2,3,4,6,7,8],"quorum_names":["a","f","b","g","c","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:13:14.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 >> v1:172.21.15.171:6812/722422047 conn(0x7fa4bc038ea0 legacy=0x7fa4bc03b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:14.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 10 monclient: shutdown 2024-04-26T00:13:14.528 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:14.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 >> v1:172.21.15.106:6793/0 conn(0x7fa4bc00b1d0 legacy=0x7fa4dc12f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:14.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 shutdown_connections 2024-04-26T00:13:14.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 >> 172.21.15.106:0/2374942671 conn(0x7fa4dc0a64e0 msgr2=0x7fa4dc133790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:14.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 shutdown_connections 2024-04-26T00:13:14.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:14.554+0000 7fa4e26d5640 1 -- 172.21.15.106:0/2374942671 wait complete. 2024-04-26T00:13:17.545 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:13:17.673 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient: get_monmap_and_config 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient: build_initial_monmap 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient: monmap: 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:17.703486+0000 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:17.703486+0000 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:17.674 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:17.675 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:17.675 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:17.675 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:17.675 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:17.675 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 1 Processor -- start 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 1 -- start start 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient: init 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient: _add_conns ranks=[7,2,3,1,4,5,6,8,0] 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient(hunting): picked mon.noname-i con 0x7f620806e3e0 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient(hunting): picked mon.noname-b con 0x7f620806fba0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient(hunting): picked mon.noname-g con 0x7f620806eed0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6208070f80 con 0x7f620806fba0 2024-04-26T00:13:17.682 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6208071e00 con 0x7f620806eed0 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62080709c0 con 0x7f620806e3e0 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient(hunting): authenticate will time out at 2053.230777s 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f62077fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f620806fba0 0x7f62081391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52776/0 (socket says 172.21.15.106:52776) 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f62077fe640 1 -- 172.21.15.106:0/3453248764 learned_addr learned my addr 172.21.15.106:0/3453248764 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1245306685 0 0) 0x7f61fc001120 con 0x7f620806fba0 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient(hunting): my global_id is 254585 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f0003450 con 0x7f620806fba0 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 668948303 0 0) 0x7f61f0003450 con 0x7f620806fba0 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 >> v1:172.21.15.171:6792/0 conn(0x7f620806e3e0 legacy=0x7f620806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:17.683 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 >> v1:172.21.15.171:6790/0 conn(0x7f620806eed0 legacy=0x7f620813c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 monclient: found mon.noname-b 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6208070ca0 con 0x7f620806fba0 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61fc001990 con 0x7f620806fba0 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 5 monclient: authenticate success, global_id 254585 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: dump: 2024-04-26T00:13:17.684 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:17.685 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61fc001c80 con 0x7f620806fba0 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 1 -- 172.21.15.106:0/3453248764 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61fc004bf0 con 0x7f620806fba0 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f6206ffd640 10 monclient: dump: 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:17.686 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.698+0000 7f620e597640 4 set_mon_vals no callback set 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: shutdown 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3453248764 >> v1:172.21.15.106:6790/0 conn(0x7f620806fba0 legacy=0x7f62081391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3453248764 shutdown_connections 2024-04-26T00:13:17.687 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3453248764 >> 172.21.15.106:0/3453248764 conn(0x7f62080a64e0 msgr2=0x7f62080a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3453248764 shutdown_connections 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3453248764 wait complete. 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: build_initial_monmap 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: monmap: 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:17.688 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 Processor -- start 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- start start 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: init 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _add_conns ranks=[4,7,0,8,1,2,5,6,3] 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient(hunting): picked mon.noname-c con 0x7f620806e3e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient(hunting): picked mon.noname-i con 0x7f620806eed0 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient(hunting): picked mon.noname-a con 0x7f620806fba0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:17.689 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62081c9c60 con 0x7f620806fba0 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f620809ee30 con 0x7f620806e3e0 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62081a6fb0 con 0x7f620806eed0 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient(hunting): authenticate will time out at 2053.233791s 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6207fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f620806e3e0 0x7f62081c9550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50600/0 (socket says 172.21.15.106:50600) 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6207fff640 1 -- 172.21.15.106:0/3024061407 learned_addr learned my addr 172.21.15.106:0/3024061407 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2938121727 0 0) 0x7f62081c9c60 con 0x7f620806fba0 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): my global_id is 274284 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61f4003530 con 0x7f620806fba0 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059206433 0 0) 0x7f620809ee30 con 0x7f620806e3e0 2024-04-26T00:13:17.690 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): my global_id is 274342 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62081c9c60 con 0x7f620806e3e0 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545685188 0 0) 0x7f62081a6fb0 con 0x7f620806eed0 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): my global_id is 146689 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f620809ee30 con 0x7f620806eed0 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3092482599 0 0) 0x7f61f4003530 con 0x7f620806fba0 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62081a6fb0 con 0x7f620806fba0 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3159990739 0 0) 0x7f62081c9c60 con 0x7f620806e3e0 2024-04-26T00:13:17.691 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61f4003530 con 0x7f620806e3e0 2024-04-26T00:13:17.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6200001ca0 con 0x7f620806fba0 2024-04-26T00:13:17.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:17.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:17.692 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:17.692 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:17.692 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:17.693 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61f8001980 con 0x7f620806e3e0 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:17.694 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:17.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1225103956 0 0) 0x7f62081a6fb0 con 0x7f620806fba0 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 >> v1:172.21.15.171:6792/0 conn(0x7f620806eed0 legacy=0x7f62081d1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 >> v1:172.21.15.106:6791/0 conn(0x7f620806e3e0 legacy=0x7f62081c9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 monclient: found mon.a 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62081a6710 con 0x7f620806fba0 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: _finish_auth 0 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 5 monclient: authenticate success, global_id 274284 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _renew_subs 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:17.696 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f62081b5bd0 con 0x7f620806fba0 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _renew_subs 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f62081a5b60 con 0x7f620806fba0 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6200002020 con 0x7f620806fba0 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6200003f90 con 0x7f620806fba0 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f62067fc640 4 set_mon_vals no callback set 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 10 monclient: dump: 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.697 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:17.698 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:17.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61e8005090 con 0x7f620806fba0 2024-04-26T00:13:17.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.702+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6200004130 con 0x7f620806fba0 2024-04-26T00:13:17.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.706+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f6200044250 con 0x7f620806fba0 2024-04-26T00:13:17.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.706+0000 7f6207fff640 10 monclient: get_auth_request con 0x7f61f4037e70 auth_method 0 2024-04-26T00:13:17.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.710+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6200014840 con 0x7f620806fba0 2024-04-26T00:13:17.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.710+0000 7f6204ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:17.699 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.710+0000 7f6204ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:13:17.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:17.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:17.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f61e8005380 con 0x7f620806fba0 2024-04-26T00:13:17.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f6204ff9640 1 -- 172.21.15.106:0/3024061407 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2739 (unknown 254746657 0 1414602499) 0x7f62000184f0 con 0x7f620806fba0 2024-04-26T00:13:17.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f6204ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:17.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f6204ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:17.907 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":110,"quorum":[0,1,2,3,4,6,7,8],"quorum_names":["a","f","b","g","c","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:13:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 >> v1:172.21.15.171:6812/722422047 conn(0x7f61f4037e70 legacy=0x7f61f403a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 10 monclient: shutdown 2024-04-26T00:13:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 >> v1:172.21.15.106:6789/0 conn(0x7f620806fba0 legacy=0x7f62081d4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:17.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 shutdown_connections 2024-04-26T00:13:17.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 >> 172.21.15.106:0/3024061407 conn(0x7f62080a64e0 msgr2=0x7f620806f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:17.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.930+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 shutdown_connections 2024-04-26T00:13:17.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:17.934+0000 7f620e597640 1 -- 172.21.15.106:0/3024061407 wait complete. 2024-04-26T00:13:20.925 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:13:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.078+0000 7fefbd6e8640 10 monclient: get_monmap_and_config 2024-04-26T00:13:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.078+0000 7fefbd6e8640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.078+0000 7fefbd6e8640 10 monclient: monmap: 2024-04-26T00:13:21.055 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:21.085122+0000 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:21.085122+0000 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.056 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.057 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.078+0000 7fefbd6e8640 1 Processor -- start 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.078+0000 7fefbd6e8640 1 -- start start 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.078+0000 7fefbd6e8640 10 monclient: init 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: _add_conns ranks=[1,3,0,4,6,5,7,2,8] 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): picked mon.noname-f con 0x7fefb8137c40 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): picked mon.noname-g con 0x7fefb809fca0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): picked mon.noname-a con 0x7fefb8137570 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb806ee10 con 0x7fefb8137570 2024-04-26T00:13:21.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb80a2220 con 0x7fefb8137c40 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb806f0f0 con 0x7fefb809fca0 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): authenticate will time out at 2056.612344s 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb77fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fefb8137570 0x7fefb81408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44142/0 (socket says 172.21.15.106:44142) 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb77fe640 1 -- 172.21.15.106:0/3712635877 learned_addr learned my addr 172.21.15.106:0/3712635877 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760355082 0 0) 0x7fefb0001120 con 0x7fefb8137570 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient(hunting): my global_id is 274293 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa0003530 con 0x7fefb8137570 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 645442291 0 0) 0x7fefa0003530 con 0x7fefb8137570 2024-04-26T00:13:21.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 >> v1:172.21.15.171:6790/0 conn(0x7fefb809fca0 legacy=0x7fefb80a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 >> v1:172.21.15.171:6789/0 conn(0x7fefb8137c40 legacy=0x7fefb80a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 monclient: found mon.noname-a 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb806f3d0 con 0x7fefb8137570 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fefb0001990 con 0x7fefb8137570 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:21.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: dump: 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.067 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 5 monclient: authenticate success, global_id 274293 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefb0001c80 con 0x7fefb8137570 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 4 set_mon_vals no callback set 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 1 -- 172.21.15.106:0/3712635877 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fefb0004bf0 con 0x7fefb8137570 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb5ffb640 10 monclient: dump: 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.068 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.069 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: shutdown 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3712635877 >> v1:172.21.15.106:6789/0 conn(0x7fefb8137570 legacy=0x7fefb81408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3712635877 shutdown_connections 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3712635877 >> 172.21.15.106:0/3712635877 conn(0x7fefb80a64e0 msgr2=0x7fefb80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3712635877 shutdown_connections 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3712635877 wait complete. 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: monmap: 2024-04-26T00:13:21.070 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.071 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 Processor -- start 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- start start 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: init 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient: _add_conns ranks=[8,2,6,5,1,0,3,4,7] 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): picked mon.noname-e con 0x7fefb809fca0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): picked mon.noname-b con 0x7fefb8137570 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): picked mon.noname-d con 0x7fefb8137c40 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb8072970 con 0x7fefb8137570 2024-04-26T00:13:21.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb811e860 con 0x7fefb8137c40 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fefb80724d0 con 0x7fefb809fca0 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefbd6e8640 10 monclient(hunting): authenticate will time out at 2056.615347s 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb6ffd640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fefb809fca0 0x7fefb812f160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45360/0 (socket says 172.21.15.106:45360) 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fefb6ffd640 1 -- 172.21.15.106:0/3172631205 learned_addr learned my addr 172.21.15.106:0/3172631205 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 981137461 0 0) 0x7fefb80724d0 con 0x7fefb809fca0 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): my global_id is 225161 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefa4003530 con 0x7fefb809fca0 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 515876682 0 0) 0x7fefb806f0f0 con 0x7fefb8137570 2024-04-26T00:13:21.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): my global_id is 254594 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefb80724d0 con 0x7fefb8137570 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1721995234 0 0) 0x7fefb811e860 con 0x7fefb8137c40 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 10 monclient(hunting): my global_id is 254553 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.082+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fefb806f0f0 con 0x7fefb8137c40 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 63741334 0 0) 0x7fefa4003530 con 0x7fefb809fca0 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefb811e860 con 0x7fefb809fca0 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fefa8001d40 con 0x7fefb809fca0 2024-04-26T00:13:21.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.075 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 349652815 0 0) 0x7fefb80724d0 con 0x7fefb8137570 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefa4003530 con 0x7fefb8137570 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1505494901 0 0) 0x7fefb806f0f0 con 0x7fefb8137c40 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fefb80724d0 con 0x7fefb8137c40 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fefac0019e0 con 0x7fefb8137570 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.076 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.077 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fefb0001950 con 0x7fefb8137c40 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.078 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 263043244 0 0) 0x7fefb811e860 con 0x7fefb809fca0 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 >> v1:172.21.15.106:6792/0 conn(0x7fefb8137c40 legacy=0x7fefb81d51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 >> v1:172.21.15.106:6790/0 conn(0x7fefb8137570 legacy=0x7fefb81d1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 monclient: found mon.e 2024-04-26T00:13:21.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb8136d70 con 0x7fefb809fca0 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 5 monclient: authenticate success, global_id 225161 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 10 monclient: _renew_subs 2024-04-26T00:13:21.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fefb811d3b0 con 0x7fefb809fca0 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 10 monclient: _renew_subs 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fefb81ccc20 con 0x7fefb809fca0 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fefa8003c50 con 0x7fefb809fca0 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fefa80041c0 con 0x7fefb809fca0 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 10 monclient: dump: 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.081 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefb57fa640 4 set_mon_vals no callback set 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fefa80043e0 con 0x7fefb809fca0 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef98005090 con 0x7fefb809fca0 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fefa80454c0 con 0x7fefb809fca0 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.086+0000 7fefb67fc640 10 monclient: get_auth_request con 0x7fefa4038100 auth_method 0 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.090+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fefa8015b50 con 0x7fefb809fca0 2024-04-26T00:13:21.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.090+0000 7fef9f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.090+0000 7fef9f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:21.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.310+0000 7fefbd6e8640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:13:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.310+0000 7fefbd6e8640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.310+0000 7fefbd6e8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.310+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fef98005380 con 0x7fefb809fca0 2024-04-26T00:13:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.310+0000 7fef9f7fe640 1 -- 172.21.15.106:0/3172631205 <== mon.8 v1:172.21.15.106:6793/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1277138171) 0x7fefa8015450 con 0x7fefb809fca0 2024-04-26T00:13:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.310+0000 7fef9f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:21.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.310+0000 7fef9f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:21.288 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":114,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":1,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:13:21.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 >> v1:172.21.15.171:6812/722422047 conn(0x7fefa4038100 legacy=0x7fefa403a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 10 monclient: shutdown 2024-04-26T00:13:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 >> v1:172.21.15.106:6793/0 conn(0x7fefb809fca0 legacy=0x7fefb812f160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 shutdown_connections 2024-04-26T00:13:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 >> 172.21.15.106:0/3172631205 conn(0x7fefb80a64e0 msgr2=0x7fefb81337e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 shutdown_connections 2024-04-26T00:13:21.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.314+0000 7fefbd6e8640 1 -- 172.21.15.106:0/3172631205 wait complete. 2024-04-26T00:13:21.306 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:13:21.306 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:13:21.306 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:13:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.446+0000 7fe10c5c2640 10 monclient: get_monmap_and_config 2024-04-26T00:13:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.446+0000 7fe10c5c2640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.446+0000 7fe10c5c2640 10 monclient: monmap: 2024-04-26T00:13:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.424 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:21.454164+0000 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:21.454164+0000 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.425 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 Processor -- start 2024-04-26T00:13:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- start start 2024-04-26T00:13:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: init 2024-04-26T00:13:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: _add_conns ranks=[2,1,6,7,5,0,3,8,4] 2024-04-26T00:13:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient(hunting): picked mon.noname-b con 0x7fe10406fba0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:21.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient(hunting): picked mon.noname-f con 0x7fe1041372e0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient(hunting): picked mon.noname-d con 0x7fe10413adf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1040a1b10 con 0x7fe1041372e0 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe104070f80 con 0x7fe10406fba0 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe104071e00 con 0x7fe10413adf0 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient(hunting): authenticate will time out at 2056.981373s 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10a35e640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fe10406fba0 0x7fe1040a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52792/0 (socket says 172.21.15.106:52792) 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10a35e640 1 -- 172.21.15.106:0/4045544459 learned_addr learned my addr 172.21.15.106:0/4045544459 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2562642024 0 0) 0x7fe104071e00 con 0x7fe10413adf0 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): my global_id is 254562 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0f0003530 con 0x7fe10413adf0 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1217735386 0 0) 0x7fe100001120 con 0x7fe10406fba0 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient(hunting): my global_id is 254603 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe104071e00 con 0x7fe10406fba0 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2760513973 0 0) 0x7fe0f0003530 con 0x7fe10413adf0 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 >> v1:172.21.15.106:6790/0 conn(0x7fe10406fba0 legacy=0x7fe1040a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 >> v1:172.21.15.171:6789/0 conn(0x7fe1041372e0 legacy=0x7fe1041396d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 monclient: found mon.noname-d 2024-04-26T00:13:21.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1040709c0 con 0x7fe10413adf0 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 5 monclient: authenticate success, global_id 254562 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0fc001b40 con 0x7fe10413adf0 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: dump: 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.436 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0fc001db0 con 0x7fe10413adf0 2024-04-26T00:13:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 1 -- 172.21.15.106:0/4045544459 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0fc003ce0 con 0x7fe10413adf0 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 4 set_mon_vals no callback set 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10935c640 10 monclient: dump: 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: shutdown 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- 172.21.15.106:0/4045544459 >> v1:172.21.15.106:6792/0 conn(0x7fe10413adf0 legacy=0x7fe10413d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- 172.21.15.106:0/4045544459 shutdown_connections 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- 172.21.15.106:0/4045544459 >> 172.21.15.106:0/4045544459 conn(0x7fe1040a64e0 msgr2=0x7fe1040a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- 172.21.15.106:0/4045544459 shutdown_connections 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- 172.21.15.106:0/4045544459 wait complete. 2024-04-26T00:13:21.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: monmap: 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.440 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 Processor -- start 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 1 -- start start 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.450+0000 7fe10c5c2640 10 monclient: init 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient: _add_conns ranks=[6,2,0,8,3,1,4,5,7] 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient(hunting): picked mon.noname-d con 0x7fe10406fba0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient(hunting): picked mon.noname-b con 0x7fe1041372e0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient(hunting): picked mon.noname-a con 0x7fe10413adf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe104122a80 con 0x7fe10413adf0 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe104070000 con 0x7fe1041372e0 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1041392f0 con 0x7fe10406fba0 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient(hunting): authenticate will time out at 2056.984353s 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe109b5d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fe1041372e0 0x7fe104134390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52804/0 (socket says 172.21.15.106:52804) 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10a35e640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe10406fba0 0x7fe1041cc4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46398/0 (socket says 172.21.15.106:46398) 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe109b5d640 1 -- 172.21.15.106:0/2427108407 learned_addr learned my addr 172.21.15.106:0/2427108407 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4181967681 0 0) 0x7fe104070000 con 0x7fe1041372e0 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): my global_id is 254612 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0e8003530 con 0x7fe1041372e0 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171500489 0 0) 0x7fe104122a80 con 0x7fe10413adf0 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): my global_id is 274302 2024-04-26T00:13:21.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe104070000 con 0x7fe10413adf0 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3478927564 0 0) 0x7fe1041392f0 con 0x7fe10406fba0 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): my global_id is 254571 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe104122a80 con 0x7fe10406fba0 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1182209199 0 0) 0x7fe104070000 con 0x7fe10413adf0 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe1041392f0 con 0x7fe10413adf0 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0fc003cc0 con 0x7fe10413adf0 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.443 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:21.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 145297070 0 0) 0x7fe0e8003530 con 0x7fe1041372e0 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe104070000 con 0x7fe1041372e0 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0f8001a20 con 0x7fe1041372e0 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.445 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3680010358 0 0) 0x7fe104122a80 con 0x7fe10406fba0 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0e8003530 con 0x7fe10406fba0 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe1000015c0 con 0x7fe10406fba0 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): dump: 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.446 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.447 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1933548778 0 0) 0x7fe1041392f0 con 0x7fe10413adf0 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.106:6792/0 conn(0x7fe10406fba0 legacy=0x7fe1041cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.106:6790/0 conn(0x7fe1041372e0 legacy=0x7fe104134390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 monclient: found mon.a 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1041224c0 con 0x7fe10413adf0 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 5 monclient: authenticate success, global_id 274302 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient: _renew_subs 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:21.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe1041215d0 con 0x7fe10413adf0 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient: _renew_subs 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe104134c70 con 0x7fe10413adf0 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe0fc001db0 con 0x7fe10413adf0 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe0fc001410 con 0x7fe10413adf0 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe108b5b640 4 set_mon_vals no callback set 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: dump: 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.449 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe0fc00eed0 con 0x7fe10413adf0 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe0ec0065d0 con 0x7fe0ec002870 2024-04-26T00:13:21.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fe0fc0442b0 con 0x7fe10413adf0 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356871397 0 0) 0x7fe0ec0065d0 con 0x7fe0ec002870 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient(hunting): my global_id is 274311 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1041392f0 con 0x7fe0ec002870 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 765381898 0 0) 0x7fe1041392f0 con 0x7fe0ec002870 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0ec0065d0 con 0x7fe0ec002870 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe100004b30 con 0x7fe0ec002870 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: dump: 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.451 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe109b5d640 10 monclient: get_auth_request con 0x7fe0e8038220 auth_method 0 2024-04-26T00:13:21.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2224557932 0 0) 0x7fe0ec0065d0 con 0x7fe0ec002870 2024-04-26T00:13:21.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe0ec00a160 con 0x7fe0ec002870 2024-04-26T00:13:21.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe100004eb0 con 0x7fe0ec002870 2024-04-26T00:13:21.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:21.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.106:6789/0 conn(0x7fe0ec002870 legacy=0x7fe0ec004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.454+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.106:6789/0 conn(0x7fe0ec002870 legacy=0x7fe0ec004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe0ec009e30 con 0x7fe0ec0090f0 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1323305850 0 0) 0x7fe0ec009e30 con 0x7fe0ec0090f0 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient(hunting): my global_id is 274320 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe0ec0065d0 con 0x7fe0ec0090f0 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3183103126 0 0) 0x7fe0ec0065d0 con 0x7fe0ec0090f0 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe0ec009e30 con 0x7fe0ec0090f0 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe1000057f0 con 0x7fe0ec0090f0 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:21.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient: dump: 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 137622680 0 0) 0x7fe0ec009e30 con 0x7fe0ec0090f0 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe0ec00c3a0 con 0x7fe0ec0090f0 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7738 (unknown 0 0 4253151613) 0x7fe100005a20 con 0x7fe0ec0090f0 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.106:6789/0 conn(0x7fe0ec0090f0 legacy=0x7fe0ec009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe0f6ffd640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.106:6789/0 conn(0x7fe0ec0090f0 legacy=0x7fe0ec009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:21.457 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 149533, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:21.458 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.459 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.460 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:21.461 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.462 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.464 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.465 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.467 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.469 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.470 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:21.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.475 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:21.476 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.171:6812/722422047 conn(0x7fe0e8038220 legacy=0x7fe0e803a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 10 monclient: shutdown 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 >> v1:172.21.15.106:6789/0 conn(0x7fe10413adf0 legacy=0x7fe1041d4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10ab5f640 1 -- 172.21.15.106:0/2427108407 reap_dead start 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10ab5f640 1 -- 172.21.15.106:0/2427108407 reap_dead start 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 shutdown_connections 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 >> 172.21.15.106:0/2427108407 conn(0x7fe1040a64e0 msgr2=0x7fe104135b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 shutdown_connections 2024-04-26T00:13:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.462+0000 7fe10c5c2640 1 -- 172.21.15.106:0/2427108407 wait complete. 2024-04-26T00:13:21.479 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:21.479 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:13:21.479 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:13:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.614+0000 7fc46a884640 10 monclient: get_monmap_and_config 2024-04-26T00:13:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.614+0000 7fc46a884640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.614+0000 7fc46a884640 10 monclient: monmap: 2024-04-26T00:13:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:21.622178+0000 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:21.622178+0000 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.593 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 Processor -- start 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- start start 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: init 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: _add_conns ranks=[2,1,6,0,4,7,8,3,5] 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient(hunting): picked mon.noname-b con 0x7fc464135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient(hunting): picked mon.noname-f con 0x7fc4641353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient(hunting): picked mon.noname-d con 0x7fc46413bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46406f2d0 con 0x7fc4641353b0 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc464072330 con 0x7fc464135870 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc464072610 con 0x7fc46413bdf0 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient(hunting): authenticate will time out at 2057.149289s 2024-04-26T00:13:21.600 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc468e21640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc46413bdf0 0x7fc46413e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46404/0 (socket says 172.21.15.106:46404) 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc468e21640 1 -- 172.21.15.106:0/3208622880 learned_addr learned my addr 172.21.15.106:0/3208622880 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc463fff640 1 --1- 172.21.15.106:0/3208622880 >> v1:172.21.15.106:6790/0 conn(0x7fc464135870 0x7fc464135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52816/0 (socket says 172.21.15.106:52816) 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3298608731 0 0) 0x7fc464072610 con 0x7fc46413bdf0 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): my global_id is 254580 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc44c003530 con 0x7fc46413bdf0 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 57450483 0 0) 0x7fc464072330 con 0x7fc464135870 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient(hunting): my global_id is 254621 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc464072610 con 0x7fc464135870 2024-04-26T00:13:21.601 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 624291481 0 0) 0x7fc44c003530 con 0x7fc46413bdf0 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 >> v1:172.21.15.106:6790/0 conn(0x7fc464135870 legacy=0x7fc464135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 >> v1:172.21.15.171:6789/0 conn(0x7fc4641353b0 legacy=0x7fc46413a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 monclient: found mon.noname-d 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4640a3260 con 0x7fc46413bdf0 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc45c001b80 con 0x7fc46413bdf0 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 5 monclient: authenticate success, global_id 254580 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:21.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: dump: 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.603 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc45c001e50 con 0x7fc46413bdf0 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 4 set_mon_vals no callback set 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 1 -- 172.21.15.106:0/3208622880 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc45c004f70 con 0x7fc46413bdf0 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc462ffd640 10 monclient: dump: 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.604 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: shutdown 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- 172.21.15.106:0/3208622880 >> v1:172.21.15.106:6792/0 conn(0x7fc46413bdf0 legacy=0x7fc46413e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- 172.21.15.106:0/3208622880 shutdown_connections 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- 172.21.15.106:0/3208622880 >> 172.21.15.106:0/3208622880 conn(0x7fc4640a64e0 msgr2=0x7fc4640a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- 172.21.15.106:0/3208622880 shutdown_connections 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- 172.21.15.106:0/3208622880 wait complete. 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: monmap: 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.606 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 Processor -- start 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 1 -- start start 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.618+0000 7fc46a884640 10 monclient: init 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient: _add_conns ranks=[8,3,1,5,6,7,0,4,2] 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient(hunting): picked mon.noname-e con 0x7fc4641353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:21.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient(hunting): picked mon.noname-g con 0x7fc464135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient(hunting): picked mon.noname-f con 0x7fc46413bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc464135fd0 con 0x7fc46413bdf0 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46409f930 con 0x7fc464135870 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46409f470 con 0x7fc4641353b0 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient(hunting): authenticate will time out at 2057.152335s 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc463fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc4641353b0 0x7fc4641317b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45366/0 (socket says 172.21.15.106:45366) 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc463fff640 1 -- 172.21.15.106:0/1749422958 learned_addr learned my addr 172.21.15.106:0/1749422958 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1193502118 0 0) 0x7fc46409f470 con 0x7fc4641353b0 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): my global_id is 225170 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc450003530 con 0x7fc4641353b0 2024-04-26T00:13:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1352526330 0 0) 0x7fc450003530 con 0x7fc4641353b0 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc46409f470 con 0x7fc4641353b0 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc454001a60 con 0x7fc4641353b0 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.609 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3536117455 0 0) 0x7fc46409f470 con 0x7fc4641353b0 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.171:6790/0 conn(0x7fc464135870 legacy=0x7fc464131ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.171:6789/0 conn(0x7fc46413bdf0 legacy=0x7fc4641325d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 monclient: found mon.e 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc464135160 con 0x7fc4641353b0 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 5 monclient: authenticate success, global_id 225170 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient: _renew_subs 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc464135cf0 con 0x7fc4641353b0 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient: _renew_subs 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fc46413ba90 con 0x7fc4641353b0 2024-04-26T00:13:21.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc454004aa0 con 0x7fc4641353b0 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc454005010 con 0x7fc4641353b0 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc4627fc640 4 set_mon_vals no callback set 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: dump: 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.612 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc4440065d0 con 0x7fc444002870 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc45400fe30 con 0x7fc4641353b0 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fc454045160 con 0x7fc4641353b0 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3884199004 0 0) 0x7fc4440065d0 con 0x7fc444002870 2024-04-26T00:13:21.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient(hunting): my global_id is 254630 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46409f470 con 0x7fc444002870 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 433123042 0 0) 0x7fc46409f470 con 0x7fc444002870 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc4440065d0 con 0x7fc444002870 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc4580017b0 con 0x7fc444002870 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: dump: 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.614 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc468e21640 10 monclient: get_auth_request con 0x7fc450037780 auth_method 0 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3030649935 0 0) 0x7fc4440065d0 con 0x7fc444002870 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc44400a160 con 0x7fc444002870 2024-04-26T00:13:21.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fc458001d40 con 0x7fc444002870 2024-04-26T00:13:21.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:21.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.106:6790/0 conn(0x7fc444002870 legacy=0x7fc444004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.622+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.106:6790/0 conn(0x7fc444002870 legacy=0x7fc444004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fc444009e30 con 0x7fc4440090f0 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3244794075 0 0) 0x7fc444009e30 con 0x7fc4440090f0 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient(hunting): my global_id is 254639 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc4440065d0 con 0x7fc4440090f0 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3078508322 0 0) 0x7fc4440065d0 con 0x7fc4440090f0 2024-04-26T00:13:21.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc444009e30 con 0x7fc4440090f0 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc458001aa0 con 0x7fc4440090f0 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient: dump: 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.618 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 174836709 0 0) 0x7fc444009e30 con 0x7fc4440090f0 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fc44400c3a0 con 0x7fc4440090f0 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 4033666580) 0x7fc458003e00 con 0x7fc4440090f0 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.106:6790/0 conn(0x7fc4440090f0 legacy=0x7fc444009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc460ff9640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.106:6790/0 conn(0x7fc4440090f0 legacy=0x7fc444009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 271687, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:21.620 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.621 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.622 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:21.623 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.624 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:21.625 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.626 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.627 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.628 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.629 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:21.631 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.633 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.634 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:21.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.636 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.637 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.638 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:21.638 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:21.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.171:6812/722422047 conn(0x7fc450037780 legacy=0x7fc450039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 10 monclient: shutdown 2024-04-26T00:13:21.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 >> v1:172.21.15.106:6793/0 conn(0x7fc4641353b0 legacy=0x7fc4641317b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc468e21640 1 -- 172.21.15.106:0/1749422958 reap_dead start 2024-04-26T00:13:21.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc468e21640 1 -- 172.21.15.106:0/1749422958 reap_dead start 2024-04-26T00:13:21.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 shutdown_connections 2024-04-26T00:13:21.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 >> 172.21.15.106:0/1749422958 conn(0x7fc4640a64e0 msgr2=0x7fc4640a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 shutdown_connections 2024-04-26T00:13:21.640 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.630+0000 7fc46a884640 1 -- 172.21.15.106:0/1749422958 wait complete. 2024-04-26T00:13:21.640 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:21.640 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:13:21.640 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:13:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: get_monmap_and_config 2024-04-26T00:13:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: monmap: 2024-04-26T00:13:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:21.787199+0000 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:21.787199+0000 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.758 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 Processor -- start 2024-04-26T00:13:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 -- start start 2024-04-26T00:13:21.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: init 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: _add_conns ranks=[4,3,5,8,1,2,6,7,0] 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient(hunting): picked mon.noname-c con 0x7fd138134820 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient(hunting): picked mon.noname-g con 0x7fd1380725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient(hunting): picked mon.noname-h con 0x7fd13813ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd138071270 con 0x7fd1380725d0 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1380714e0 con 0x7fd138134820 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1380729f0 con 0x7fd13813ace0 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient(hunting): authenticate will time out at 2057.314490s 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13e467640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fd138134820 0x7fd138134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50606/0 (socket says 172.21.15.106:50606) 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13e467640 1 -- 172.21.15.106:0/296543080 learned_addr learned my addr 172.21.15.106:0/296543080 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 408673601 0 0) 0x7fd128001120 con 0x7fd138134820 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient(hunting): my global_id is 274351 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd120003530 con 0x7fd138134820 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2261382452 0 0) 0x7fd120003530 con 0x7fd138134820 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 >> v1:172.21.15.171:6791/0 conn(0x7fd13813ace0 legacy=0x7fd13813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 >> v1:172.21.15.171:6790/0 conn(0x7fd1380725d0 legacy=0x7fd1381395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 monclient: found mon.noname-c 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1380717c0 con 0x7fd138134820 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd128001990 con 0x7fd138134820 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 5 monclient: authenticate success, global_id 274351 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: dump: 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.769 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.770 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd128001bf0 con 0x7fd138134820 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 1 -- 172.21.15.106:0/296543080 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd128004bf0 con 0x7fd138134820 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd13d465640 10 monclient: dump: 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.771 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 4 set_mon_vals no callback set 2024-04-26T00:13:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 10 monclient: shutdown 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 -- 172.21.15.106:0/296543080 >> v1:172.21.15.106:6791/0 conn(0x7fd138134820 legacy=0x7fd138134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 -- 172.21.15.106:0/296543080 shutdown_connections 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.782+0000 7fd1406cb640 1 -- 172.21.15.106:0/296543080 >> 172.21.15.106:0/296543080 conn(0x7fd1380a64e0 msgr2=0x7fd1380a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- 172.21.15.106:0/296543080 shutdown_connections 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- 172.21.15.106:0/296543080 wait complete. 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: monmap: 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 Processor -- start 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- start start 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: init 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: _add_conns ranks=[0,2,5,6,3,8,7,1,4] 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient(hunting): picked mon.noname-a con 0x7fd1380725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient(hunting): picked mon.noname-b con 0x7fd138134820 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient(hunting): picked mon.noname-h con 0x7fd13813ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd1380706a0 con 0x7fd1380725d0 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13809cb80 con 0x7fd138134820 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd13809ce60 con 0x7fd13813ace0 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient(hunting): authenticate will time out at 2057.317452s 2024-04-26T00:13:21.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd13e467640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fd1380725d0 0x7fd13812a3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44188/0 (socket says 172.21.15.106:44188) 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd13e467640 1 -- 172.21.15.106:0/3954504606 learned_addr learned my addr 172.21.15.106:0/3954504606 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2373566302 0 0) 0x7fd13809cb80 con 0x7fd138134820 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): my global_id is 254648 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd124003530 con 0x7fd138134820 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 632310892 0 0) 0x7fd1380717c0 con 0x7fd1380725d0 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): my global_id is 274329 2024-04-26T00:13:21.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd13809cb80 con 0x7fd1380725d0 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4215732103 0 0) 0x7fd13809cb80 con 0x7fd1380725d0 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1380717c0 con 0x7fd1380725d0 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 55485491 0 0) 0x7fd124003530 con 0x7fd138134820 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd13809cb80 con 0x7fd138134820 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd128001950 con 0x7fd1380725d0 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): dump: 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.778 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd12c001960 con 0x7fd138134820 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): dump: 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2790052548 0 0) 0x7fd13809ce60 con 0x7fd13813ace0 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): my global_id is 254552 2024-04-26T00:13:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd124003530 con 0x7fd13813ace0 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1518432053 0 0) 0x7fd1380717c0 con 0x7fd1380725d0 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.171:6791/0 conn(0x7fd13813ace0 legacy=0x7fd1381d3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.106:6790/0 conn(0x7fd138134820 legacy=0x7fd1381cfb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 monclient: found mon.a 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd13809b290 con 0x7fd1380725d0 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 5 monclient: authenticate success, global_id 274329 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: _renew_subs 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd13809d560 con 0x7fd1380725d0 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: _renew_subs 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd138133d00 con 0x7fd1380725d0 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd128001bf0 con 0x7fd1380725d0 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd128004c50 con 0x7fd1380725d0 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient: dump: 2024-04-26T00:13:21.783 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.784 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd13cc64640 4 set_mon_vals no callback set 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd1180065d0 con 0x7fd118002870 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd12800fe40 con 0x7fd1380725d0 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fd1280451a0 con 0x7fd1380725d0 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876953227 0 0) 0x7fd1180065d0 con 0x7fd118002870 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 10 monclient(hunting): my global_id is 274360 2024-04-26T00:13:21.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.786+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1380717c0 con 0x7fd118002870 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd13ec68640 10 monclient: get_auth_request con 0x7fd124037d90 auth_method 0 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 516918943 0 0) 0x7fd1380717c0 con 0x7fd118002870 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd1180065d0 con 0x7fd118002870 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd12c003940 con 0x7fd118002870 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 10 monclient: dump: 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.786 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2635255303 0 0) 0x7fd1180065d0 con 0x7fd118002870 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd11800a160 con 0x7fd118002870 2024-04-26T00:13:21.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd12c005bc0 con 0x7fd118002870 2024-04-26T00:13:21.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:21.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.106:6791/0 conn(0x7fd118002870 legacy=0x7fd118004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.790+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.106:6791/0 conn(0x7fd118002870 legacy=0x7fd118004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:21.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd118009e10 con 0x7fd1180090f0 2024-04-26T00:13:21.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 388840848 0 0) 0x7fd118009e10 con 0x7fd1180090f0 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient(hunting): my global_id is 274369 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1180065d0 con 0x7fd1180090f0 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3350274130 0 0) 0x7fd1180065d0 con 0x7fd1180090f0 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd118009e10 con 0x7fd1180090f0 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd12c005490 con 0x7fd1180090f0 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient: dump: 2024-04-26T00:13:21.790 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.791 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 995487486 0 0) 0x7fd118009e10 con 0x7fd1180090f0 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd11800c390 con 0x7fd1180090f0 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 2832568174) 0x7fd12c005750 con 0x7fd1180090f0 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.106:6791/0 conn(0x7fd1180090f0 legacy=0x7fd118009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd136ffd640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.106:6791/0 conn(0x7fd1180090f0 legacy=0x7fd118009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 149873, 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:21.793 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.794 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:21.795 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.796 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:21.797 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.798 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.799 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.800 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.801 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:21.802 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.803 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.804 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.805 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.806 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.807 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.808 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.809 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:21.810 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.811 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:21.812 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:21.813 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.171:6812/722422047 conn(0x7fd124037d90 legacy=0x7fd12403a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 10 monclient: shutdown 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 >> v1:172.21.15.106:6789/0 conn(0x7fd1380725d0 legacy=0x7fd13812a3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd13ec68640 1 -- 172.21.15.106:0/3954504606 reap_dead start 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd13ec68640 1 -- 172.21.15.106:0/3954504606 reap_dead start 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 shutdown_connections 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 >> 172.21.15.106:0/3954504606 conn(0x7fd1380a64e0 msgr2=0x7fd13806e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.794+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 shutdown_connections 2024-04-26T00:13:21.815 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.798+0000 7fd1406cb640 1 -- 172.21.15.106:0/3954504606 wait complete. 2024-04-26T00:13:21.816 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:21.816 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:13:21.816 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.954+0000 7fdb7070c640 10 monclient: get_monmap_and_config 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.954+0000 7fdb7070c640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.954+0000 7fdb7070c640 10 monclient: monmap: 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:21.961972+0000 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:21.961972+0000 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.932 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.933 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 Processor -- start 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- start start 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient: init 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient: _add_conns ranks=[1,3,5,7,6,2,0,8,4] 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient(hunting): picked mon.noname-f con 0x7fdb68134860 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient(hunting): picked mon.noname-g con 0x7fdb680a3e80 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient(hunting): picked mon.noname-h con 0x7fdb6813e090 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb680a6410 con 0x7fdb68134860 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb680a4610 con 0x7fdb680a3e80 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb680a0ca0 con 0x7fdb6813e090 2024-04-26T00:13:21.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient(hunting): authenticate will time out at 2057.489282s 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6e4a8640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fdb68134860 0x7fdb68134c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:36396/0 (socket says 172.21.15.106:36396) 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6e4a8640 1 -- 172.21.15.106:0/3837178853 learned_addr learned my addr 172.21.15.106:0/3837178853 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6eca9640 1 --1- 172.21.15.106:0/3837178853 >> v1:172.21.15.171:6791/0 conn(0x7fdb6813e090 0x7fdb68140480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:41902/0 (socket says 172.21.15.106:41902) 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4231223674 0 0) 0x7fdb680a6410 con 0x7fdb68134860 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): my global_id is 225334 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb54003530 con 0x7fdb68134860 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206636074 0 0) 0x7fdb680a4610 con 0x7fdb680a3e80 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): my global_id is 284142 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb680a6410 con 0x7fdb680a3e80 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3162535833 0 0) 0x7fdb680a0ca0 con 0x7fdb6813e090 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient(hunting): my global_id is 254561 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb680a4610 con 0x7fdb6813e090 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 589699066 0 0) 0x7fdb54003530 con 0x7fdb68134860 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 >> v1:172.21.15.171:6791/0 conn(0x7fdb6813e090 legacy=0x7fdb68140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 >> v1:172.21.15.171:6790/0 conn(0x7fdb680a3e80 legacy=0x7fdb6813c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 monclient: found mon.noname-f 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:13:21.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb680a15e0 con 0x7fdb68134860 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 5 monclient: authenticate success, global_id 225334 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb640017c0 con 0x7fdb68134860 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: dump: 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.945 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb64001a60 con 0x7fdb68134860 2024-04-26T00:13:21.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 1 -- 172.21.15.106:0/3837178853 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb64004bf0 con 0x7fdb68134860 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 4 set_mon_vals no callback set 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb6d4a6640 10 monclient: dump: 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.947 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 10 monclient: shutdown 2024-04-26T00:13:21.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- 172.21.15.106:0/3837178853 >> v1:172.21.15.171:6789/0 conn(0x7fdb68134860 legacy=0x7fdb68134c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- 172.21.15.106:0/3837178853 shutdown_connections 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- 172.21.15.106:0/3837178853 >> 172.21.15.106:0/3837178853 conn(0x7fdb680a68e0 msgr2=0x7fdb680a6cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- 172.21.15.106:0/3837178853 shutdown_connections 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.958+0000 7fdb7070c640 1 -- 172.21.15.106:0/3837178853 wait complete. 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: build_initial_monmap 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: monmap: 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:21.949 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 Processor -- start 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 -- start start 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: init 2024-04-26T00:13:21.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: _add_conns ranks=[1,0,4,6,7,5,2,3,8] 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient(hunting): picked mon.noname-f con 0x7fdb680a3e80 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient(hunting): picked mon.noname-a con 0x7fdb68134860 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient(hunting): picked mon.noname-c con 0x7fdb6813e090 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb680a0870 con 0x7fdb68134860 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb681314e0 con 0x7fdb680a3e80 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb680a0a60 con 0x7fdb6813e090 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient(hunting): authenticate will time out at 2057.493248s 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb6dca7640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fdb68134860 0x7fdb681d1500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44202/0 (socket says 172.21.15.106:44202) 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb6eca9640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fdb6813e090 0x7fdb681d4c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50636/0 (socket says 172.21.15.106:50636) 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb6dca7640 1 -- 172.21.15.106:0/492577984 learned_addr learned my addr 172.21.15.106:0/492577984 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3168643005 0 0) 0x7fdb680a0a60 con 0x7fdb6813e090 2024-04-26T00:13:21.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): my global_id is 274378 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb4c003530 con 0x7fdb6813e090 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363689207 0 0) 0x7fdb680a0870 con 0x7fdb68134860 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): my global_id is 274338 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb680a0a60 con 0x7fdb68134860 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402112658 0 0) 0x7fdb681314e0 con 0x7fdb680a3e80 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.952 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): my global_id is 225343 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb680a0870 con 0x7fdb680a3e80 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3356297966 0 0) 0x7fdb4c003530 con 0x7fdb6813e090 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb681314e0 con 0x7fdb6813e090 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb60001cc0 con 0x7fdb6813e090 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): dump: 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.953 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3608128675 0 0) 0x7fdb680a0a60 con 0x7fdb68134860 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb4c003530 con 0x7fdb68134860 2024-04-26T00:13:21.954 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb58001520 con 0x7fdb68134860 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): dump: 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.955 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2460897713 0 0) 0x7fdb681314e0 con 0x7fdb6813e090 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.171:6789/0 conn(0x7fdb680a3e80 legacy=0x7fdb680a0160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.106:6789/0 conn(0x7fdb68134860 legacy=0x7fdb681d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 monclient: found mon.c 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb68132040 con 0x7fdb6813e090 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: _finish_auth 0 2024-04-26T00:13:21.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 5 monclient: authenticate success, global_id 274378 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: _renew_subs 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb681cc470 con 0x7fdb6813e090 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: _renew_subs 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb68132550 con 0x7fdb6813e090 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb60002010 con 0x7fdb6813e090 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb60005160 con 0x7fdb6813e090 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb6cca5640 4 set_mon_vals no callback set 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:21.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: dump: 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.958 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdb500065d0 con 0x7fdb50002870 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdb60005300 con 0x7fdb6813e090 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fdb600453f0 con 0x7fdb6813e090 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 496769482 0 0) 0x7fdb500065d0 con 0x7fdb50002870 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient(hunting): my global_id is 254589 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb681314e0 con 0x7fdb50002870 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb6dca7640 10 monclient: get_auth_request con 0x7fdb4c037f80 auth_method 0 2024-04-26T00:13:21.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2360198709 0 0) 0x7fdb681314e0 con 0x7fdb50002870 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb500065d0 con 0x7fdb50002870 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb64004b30 con 0x7fdb50002870 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 10 monclient: dump: 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.960 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 657506294 0 0) 0x7fdb500065d0 con 0x7fdb50002870 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.962+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdb5000a160 con 0x7fdb50002870 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.966+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdb64001240 con 0x7fdb50002870 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.966+0000 7fdb5effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.966+0000 7fdb5effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.966+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.106:6792/0 conn(0x7fdb50002870 legacy=0x7fdb50004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.966+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.106:6792/0 conn(0x7fdb50002870 legacy=0x7fdb50004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.963 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdb50009e50 con 0x7fdb50009110 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010313752 0 0) 0x7fdb50009e50 con 0x7fdb50009110 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient(hunting): my global_id is 254598 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb500065d0 con 0x7fdb50009110 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3125616342 0 0) 0x7fdb500065d0 con 0x7fdb50009110 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb50009e50 con 0x7fdb50009110 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdb64005000 con 0x7fdb50009110 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient: dump: 2024-04-26T00:13:21.964 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:21.965 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 745551902 0 0) 0x7fdb50009e50 con 0x7fdb50009110 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdb5000c3e0 con 0x7fdb50009110 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 4129658391) 0x7fdb640073b0 con 0x7fdb50009110 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.106:6792/0 conn(0x7fdb50009110 legacy=0x7fdb500095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb5effd640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.106:6792/0 conn(0x7fdb50009110 legacy=0x7fdb500095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:21.966 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 272031, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:21.967 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.968 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.969 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:21.970 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:21.971 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.972 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:21.973 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.974 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.975 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.976 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.977 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.978 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.979 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:21.981 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.981 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.981 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.981 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.982 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:21.982 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:21.982 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.982 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.982 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.982 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.983 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.984 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.985 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.986 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:21.987 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.171:6812/722422047 conn(0x7fdb4c037f80 legacy=0x7fdb4c03a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 10 monclient: shutdown 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 >> v1:172.21.15.106:6791/0 conn(0x7fdb6813e090 legacy=0x7fdb681d4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb6eca9640 1 -- 172.21.15.106:0/492577984 reap_dead start 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb6eca9640 1 -- 172.21.15.106:0/492577984 reap_dead start 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 shutdown_connections 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 >> 172.21.15.106:0/492577984 conn(0x7fdb680a68e0 msgr2=0x7fdb680a8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 shutdown_connections 2024-04-26T00:13:21.989 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:21.970+0000 7fdb7070c640 1 -- 172.21.15.106:0/492577984 wait complete. 2024-04-26T00:13:21.990 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:21.990 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:13:21.990 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:13:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: get_monmap_and_config 2024-04-26T00:13:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: monmap: 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:22.134600+0000 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:22.134600+0000 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 Processor -- start 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- start start 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: init 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: _add_conns ranks=[0,5,4,8,2,3,6,7,1] 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient(hunting): picked mon.noname-a con 0x7f35e4134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient(hunting): picked mon.noname-h con 0x7f35e40a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient(hunting): picked mon.noname-c con 0x7f35e413e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e406dd40 con 0x7f35e4134970 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e40a2b10 con 0x7f35e413e200 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e40a2df0 con 0x7f35e40a4820 2024-04-26T00:13:22.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient(hunting): authenticate will time out at 2057.661944s 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e3fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f35e413e200 0x7f35e41405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50652/0 (socket says 172.21.15.106:50652) 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e3fff640 1 -- 172.21.15.106:0/3949443336 learned_addr learned my addr 172.21.15.106:0/3949443336 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2255987064 0 0) 0x7f35e40a2b10 con 0x7f35e413e200 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): my global_id is 274387 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35d0003530 con 0x7f35e413e200 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3231500594 0 0) 0x7f35e406dd40 con 0x7f35e4134970 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient(hunting): my global_id is 274347 2024-04-26T00:13:22.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e40a2b10 con 0x7f35e4134970 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3507547967 0 0) 0x7f35d0003530 con 0x7f35e413e200 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 >> v1:172.21.15.171:6791/0 conn(0x7f35e40a4820 legacy=0x7f35e413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 >> v1:172.21.15.106:6789/0 conn(0x7f35e4134970 legacy=0x7f35e4134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 monclient: found mon.noname-c 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e40a30d0 con 0x7f35e413e200 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35dc0017c0 con 0x7f35e413e200 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 5 monclient: authenticate success, global_id 274387 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: dump: 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.118 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35dc0019b0 con 0x7f35e413e200 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 1 -- 172.21.15.106:0/3949443336 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35dc004bf0 con 0x7f35e413e200 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 4 set_mon_vals no callback set 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e27fc640 10 monclient: dump: 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.119 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: shutdown 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- 172.21.15.106:0/3949443336 >> v1:172.21.15.106:6791/0 conn(0x7f35e413e200 legacy=0x7f35e41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- 172.21.15.106:0/3949443336 shutdown_connections 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- 172.21.15.106:0/3949443336 >> 172.21.15.106:0/3949443336 conn(0x7f35e40a9e20 msgr2=0x7f35e40aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- 172.21.15.106:0/3949443336 shutdown_connections 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 1 -- 172.21.15.106:0/3949443336 wait complete. 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.130+0000 7f35e9dca640 10 monclient: monmap: 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.121 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 Processor -- start 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 -- start start 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient: init 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient: _add_conns ranks=[5,1,4,8,2,0,3,6,7] 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient(hunting): picked mon.noname-h con 0x7f35e40a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient(hunting): picked mon.noname-f con 0x7f35e4134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient(hunting): picked mon.noname-c con 0x7f35e413e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:22.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e4138e70 con 0x7f35e4134970 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e413d700 con 0x7f35e413e200 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35e41371e0 con 0x7f35e40a4820 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient(hunting): authenticate will time out at 2057.665008s 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e3fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f35e413e200 0x7f35e41d4cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50660/0 (socket says 172.21.15.106:50660) 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e3fff640 1 -- 172.21.15.106:0/2410530865 learned_addr learned my addr 172.21.15.106:0/2410530865 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389100635 0 0) 0x7f35e413d700 con 0x7f35e413e200 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): my global_id is 274396 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c4003530 con 0x7f35e413e200 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2899908056 0 0) 0x7f35c4003530 con 0x7f35e413e200 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35e413d700 con 0x7f35e413e200 2024-04-26T00:13:22.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35dc001780 con 0x7f35e413e200 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): dump: 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.124 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446354836 0 0) 0x7f35e4138e70 con 0x7f35e4134970 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): my global_id is 225352 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c4003530 con 0x7f35e4134970 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2854710753 0 0) 0x7f35e41371e0 con 0x7f35e40a4820 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): my global_id is 254579 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e4138e70 con 0x7f35e40a4820 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3458024996 0 0) 0x7f35e413d700 con 0x7f35e413e200 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.171:6791/0 conn(0x7f35e40a4820 legacy=0x7f35e412a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.171:6789/0 conn(0x7f35e4134970 legacy=0x7f35e41d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 monclient: found mon.c 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35e4138b90 con 0x7f35e413e200 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 5 monclient: authenticate success, global_id 274396 2024-04-26T00:13:22.126 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient: _renew_subs 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f35e41378a0 con 0x7f35e413e200 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient: _renew_subs 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f35e41366d0 con 0x7f35e413e200 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35dc0019b0 con 0x7f35e413e200 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35dc004cb0 con 0x7f35e413e200 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e1ffb640 4 set_mon_vals no callback set 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: dump: 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.127 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f35c80065d0 con 0x7f35c8002870 2024-04-26T00:13:22.128 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f35dc00fde0 con 0x7f35e413e200 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f35dc045220 con 0x7f35e413e200 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1399459313 0 0) 0x7f35c80065d0 con 0x7f35c8002870 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient(hunting): my global_id is 225179 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35e413d700 con 0x7f35c8002870 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3103901409 0 0) 0x7f35e413d700 con 0x7f35c8002870 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35c80065d0 con 0x7f35c8002870 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35d40016a0 con 0x7f35c8002870 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: dump: 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.129 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.130 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35e2ffd640 10 monclient: get_auth_request con 0x7f35c40379f0 auth_method 0 2024-04-26T00:13:22.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 552464547 0 0) 0x7f35c80065d0 con 0x7f35c8002870 2024-04-26T00:13:22.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35c800a160 con 0x7f35c8002870 2024-04-26T00:13:22.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f35d4001a10 con 0x7f35c8002870 2024-04-26T00:13:22.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:22.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.106:6793/0 conn(0x7f35c8002870 legacy=0x7f35c8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.131 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.134+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.106:6793/0 conn(0x7f35c8002870 legacy=0x7f35c8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.132 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f35c8009e50 con 0x7f35c8009110 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443162250 0 0) 0x7f35c8009e50 con 0x7f35c8009110 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient(hunting): my global_id is 225188 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35c80065d0 con 0x7f35c8009110 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3869824024 0 0) 0x7f35c80065d0 con 0x7f35c8009110 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f35c8009e50 con 0x7f35c8009110 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f35d4003eb0 con 0x7f35c8009110 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient: dump: 2024-04-26T00:13:22.133 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.134 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 378629756 0 0) 0x7f35c8009e50 con 0x7f35c8009110 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f35c800c3e0 con 0x7f35c8009110 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 3033530244) 0x7f35d4005460 con 0x7f35c8009110 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.106:6793/0 conn(0x7f35c8009110 legacy=0x7f35c80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35dbfff640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.106:6793/0 conn(0x7f35c8009110 legacy=0x7f35c80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:22.135 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 515374, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-26T00:13:22.136 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.137 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.138 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:22.139 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.140 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.141 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.142 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:22.143 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.144 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.145 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.146 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.147 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.148 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.149 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.150 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.151 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.152 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:22.153 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.171:6812/722422047 conn(0x7f35c40379f0 legacy=0x7f35c4039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 10 monclient: shutdown 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 >> v1:172.21.15.106:6791/0 conn(0x7f35e413e200 legacy=0x7f35e41d4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e3fff640 1 -- 172.21.15.106:0/2410530865 reap_dead start 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e3fff640 1 -- 172.21.15.106:0/2410530865 reap_dead start 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 shutdown_connections 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 >> 172.21.15.106:0/2410530865 conn(0x7f35e40a9e20 msgr2=0x7f35e4130cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 shutdown_connections 2024-04-26T00:13:22.155 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.142+0000 7f35e9dca640 1 -- 172.21.15.106:0/2410530865 wait complete. 2024-04-26T00:13:22.156 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:22.156 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:13:22.156 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.290+0000 7f8a79cee640 10 monclient: get_monmap_and_config 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.290+0000 7f8a79cee640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.290+0000 7f8a79cee640 10 monclient: monmap: 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:22.297853+0000 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:22.297853+0000 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.268 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.269 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 Processor -- start 2024-04-26T00:13:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- start start 2024-04-26T00:13:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: init 2024-04-26T00:13:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: _add_conns ranks=[0,1,2,3,7,8,5,6,4] 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient(hunting): picked mon.noname-a con 0x7f8a74134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient(hunting): picked mon.noname-f con 0x7f8a740a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient(hunting): picked mon.noname-b con 0x7f8a7413e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a7406dd40 con 0x7f8a74134970 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a740a2b10 con 0x7f8a740a4820 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a740a2df0 con 0x7f8a7413e200 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient(hunting): authenticate will time out at 2057.825437s 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a73fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f8a7413e200 0x7f8a741405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52862/0 (socket says 172.21.15.106:52862) 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a737fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f8a74134970 0x7f8a74134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44226/0 (socket says 172.21.15.106:44226) 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a73fff640 1 -- 172.21.15.106:0/4094007338 learned_addr learned my addr 172.21.15.106:0/4094007338 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 699924804 0 0) 0x7f8a740a2df0 con 0x7f8a7413e200 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): my global_id is 254657 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a5c003530 con 0x7f8a7413e200 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 481627938 0 0) 0x7f8a7406dd40 con 0x7f8a74134970 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient(hunting): my global_id is 274356 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a740a2df0 con 0x7f8a74134970 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 354482532 0 0) 0x7f8a5c003530 con 0x7f8a7413e200 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 >> v1:172.21.15.171:6789/0 conn(0x7f8a740a4820 legacy=0x7f8a7413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 >> v1:172.21.15.106:6789/0 conn(0x7f8a74134970 legacy=0x7f8a74134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 monclient: found mon.noname-b 2024-04-26T00:13:22.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a740a30d0 con 0x7f8a7413e200 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a6c001a70 con 0x7f8a7413e200 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: dump: 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.280 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 5 monclient: authenticate success, global_id 254657 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a6c001ce0 con 0x7f8a7413e200 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 1 -- 172.21.15.106:0/4094007338 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a6c004f70 con 0x7f8a7413e200 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a727fc640 10 monclient: dump: 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.282 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 4 set_mon_vals no callback set 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: shutdown 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- 172.21.15.106:0/4094007338 >> v1:172.21.15.106:6790/0 conn(0x7f8a7413e200 legacy=0x7f8a741405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- 172.21.15.106:0/4094007338 shutdown_connections 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- 172.21.15.106:0/4094007338 >> 172.21.15.106:0/4094007338 conn(0x7f8a740a9e20 msgr2=0x7f8a740aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- 172.21.15.106:0/4094007338 shutdown_connections 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- 172.21.15.106:0/4094007338 wait complete. 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: monmap: 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.284 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.285 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 Processor -- start 2024-04-26T00:13:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 1 -- start start 2024-04-26T00:13:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.294+0000 7f8a79cee640 10 monclient: init 2024-04-26T00:13:22.285 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient: _add_conns ranks=[6,8,4,0,3,7,5,2,1] 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient(hunting): picked mon.noname-d con 0x7f8a740a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient(hunting): picked mon.noname-e con 0x7f8a74134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient(hunting): picked mon.noname-c con 0x7f8a7413e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a740a1e00 con 0x7f8a7413e200 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a740a1a40 con 0x7f8a740a4820 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a74138e60 con 0x7f8a74134970 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient(hunting): authenticate will time out at 2057.828290s 2024-04-26T00:13:22.286 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a737fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f8a740a4820 0x7f8a741cc770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46428/0 (socket says 172.21.15.106:46428) 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a737fe640 1 -- 172.21.15.106:0/2929684099 learned_addr learned my addr 172.21.15.106:0/2929684099 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 344217916 0 0) 0x7f8a74138e60 con 0x7f8a74134970 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): my global_id is 225197 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a60003530 con 0x7f8a74134970 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2576496817 0 0) 0x7f8a740a1a40 con 0x7f8a740a4820 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): my global_id is 254607 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a74138e60 con 0x7f8a740a4820 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675374666 0 0) 0x7f8a740a1e00 con 0x7f8a7413e200 2024-04-26T00:13:22.287 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): my global_id is 274405 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a740a1a40 con 0x7f8a7413e200 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2480892762 0 0) 0x7f8a60003530 con 0x7f8a74134970 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a740a1e00 con 0x7f8a74134970 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a68001960 con 0x7f8a74134970 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): dump: 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.288 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 543612753 0 0) 0x7f8a740a1a40 con 0x7f8a7413e200 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a60003530 con 0x7f8a7413e200 2024-04-26T00:13:22.289 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a6c001a30 con 0x7f8a7413e200 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): dump: 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.290 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1287192492 0 0) 0x7f8a74138e60 con 0x7f8a740a4820 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a740a1a40 con 0x7f8a740a4820 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a640014a0 con 0x7f8a740a4820 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): dump: 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.291 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.292 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3069268131 0 0) 0x7f8a740a1e00 con 0x7f8a74134970 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.106:6792/0 conn(0x7f8a740a4820 legacy=0x7f8a741cc770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.106:6791/0 conn(0x7f8a7413e200 legacy=0x7f8a741d4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 monclient: found mon.e 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a74137e00 con 0x7f8a74134970 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 5 monclient: authenticate success, global_id 225197 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient: _renew_subs 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:22.293 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f8a74138570 con 0x7f8a74134970 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient: _renew_subs 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f8a7413d530 con 0x7f8a74134970 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8a68001c60 con 0x7f8a74134970 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a68003c10 con 0x7f8a74134970 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a71ffb640 4 set_mon_vals no callback set 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: dump: 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.294 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.295 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8a540065d0 con 0x7f8a54002870 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8a68003db0 con 0x7f8a74134970 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f8a68043f50 con 0x7f8a74134970 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a73fff640 10 monclient: get_auth_request con 0x7f8a60038290 auth_method 0 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3616971860 0 0) 0x7f8a540065d0 con 0x7f8a54002870 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient(hunting): my global_id is 225370 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a740a1e00 con 0x7f8a54002870 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3886212114 0 0) 0x7f8a740a1e00 con 0x7f8a54002870 2024-04-26T00:13:22.296 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a540065d0 con 0x7f8a54002870 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a64004b30 con 0x7f8a54002870 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 10 monclient: dump: 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.297 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 70482463 0 0) 0x7f8a540065d0 con 0x7f8a54002870 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.298+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8a5400a160 con 0x7f8a54002870 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.302+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8a64004f40 con 0x7f8a54002870 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.302+0000 7f8a5bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.302+0000 7f8a5bfff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.302+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.171:6789/0 conn(0x7f8a54002870 legacy=0x7f8a54004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.298 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.302+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.171:6789/0 conn(0x7f8a54002870 legacy=0x7f8a54004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a79cee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8a54009e50 con 0x7f8a54009110 2024-04-26T00:13:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2631360545 0 0) 0x7f8a54009e50 con 0x7f8a54009110 2024-04-26T00:13:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.300 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 10 monclient(hunting): my global_id is 225379 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a540065d0 con 0x7f8a54009110 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3770723109 0 0) 0x7f8a540065d0 con 0x7f8a54009110 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8a54009e50 con 0x7f8a54009110 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8a640057b0 con 0x7f8a54009110 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 10 monclient: dump: 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.301 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2796279924 0 0) 0x7f8a54009e50 con 0x7f8a54009110 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.306+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f8a5400c3e0 con 0x7f8a54009110 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 3192617002) 0x7f8a64006bd0 con 0x7f8a54009110 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a5bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a5bfff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.171:6789/0 conn(0x7f8a54009110 legacy=0x7f8a540095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.302 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a5bfff640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.171:6789/0 conn(0x7f8a54009110 legacy=0x7f8a540095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 515542, 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:22.303 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 2, 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.304 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.305 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:22.306 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.307 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.308 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.309 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.310 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.311 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:22.312 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.313 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:22.314 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.315 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.316 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.317 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.318 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:22.319 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.320 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.321 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:22.321 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.171:6812/722422047 conn(0x7f8a60038290 legacy=0x7f8a6003a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 10 monclient: shutdown 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 >> v1:172.21.15.106:6793/0 conn(0x7f8a74134970 legacy=0x7f8a7413cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a73fff640 1 -- 172.21.15.106:0/2929684099 reap_dead start 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a73fff640 1 -- 172.21.15.106:0/2929684099 reap_dead start 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 shutdown_connections 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 >> 172.21.15.106:0/2929684099 conn(0x7f8a740a9e20 msgr2=0x7f8a74130d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 shutdown_connections 2024-04-26T00:13:22.323 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.310+0000 7f8a79cee640 1 -- 172.21.15.106:0/2929684099 wait complete. 2024-04-26T00:13:22.324 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:22.324 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:13:22.324 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:13:22.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: get_monmap_and_config 2024-04-26T00:13:22.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: monmap: 2024-04-26T00:13:22.441 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:22.470595+0000 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:22.470595+0000 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.442 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.443 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.443 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.443 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 Processor -- start 2024-04-26T00:13:22.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- start start 2024-04-26T00:13:22.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: init 2024-04-26T00:13:22.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: _add_conns ranks=[6,7,2,1,8,3,0,4,5] 2024-04-26T00:13:22.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient(hunting): picked mon.noname-d con 0x7fbd20134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:22.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient(hunting): picked mon.noname-i con 0x7fbd200a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:22.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient(hunting): picked mon.noname-b con 0x7fbd2013e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:22.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2006dd40 con 0x7fbd2013e200 2024-04-26T00:13:22.450 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200a2b10 con 0x7fbd20134970 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200a2df0 con 0x7fbd200a4820 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient(hunting): authenticate will time out at 2057.997717s 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd257fb640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fbd20134970 0x7fbd20134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46432/0 (socket says 172.21.15.106:46432) 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd257fb640 1 -- 172.21.15.106:0/3437790952 learned_addr learned my addr 172.21.15.106:0/3437790952 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd25ffc640 1 --1- 172.21.15.106:0/3437790952 >> v1:172.21.15.106:6790/0 conn(0x7fbd2013e200 0x7fbd201405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52866/0 (socket says 172.21.15.106:52866) 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4049410458 0 0) 0x7fbd200a2b10 con 0x7fbd20134970 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): my global_id is 254616 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd0c003530 con 0x7fbd20134970 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2721244310 0 0) 0x7fbd2006dd40 con 0x7fbd2013e200 2024-04-26T00:13:22.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient(hunting): my global_id is 254666 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd200a2b10 con 0x7fbd2013e200 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1372685952 0 0) 0x7fbd0c003530 con 0x7fbd20134970 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 >> v1:172.21.15.171:6792/0 conn(0x7fbd200a4820 legacy=0x7fbd2013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 >> v1:172.21.15.106:6790/0 conn(0x7fbd2013e200 legacy=0x7fbd201405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 monclient: found mon.noname-d 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd200a30d0 con 0x7fbd20134970 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd1c0017c0 con 0x7fbd20134970 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: dump: 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.453 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 5 monclient: authenticate success, global_id 254616 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd1c001a30 con 0x7fbd20134970 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 1 -- 172.21.15.106:0/3437790952 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd1c004bf0 con 0x7fbd20134970 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd17fff640 10 monclient: dump: 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.454 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 4 set_mon_vals no callback set 2024-04-26T00:13:22.455 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: shutdown 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- 172.21.15.106:0/3437790952 >> v1:172.21.15.106:6792/0 conn(0x7fbd20134970 legacy=0x7fbd20134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- 172.21.15.106:0/3437790952 shutdown_connections 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- 172.21.15.106:0/3437790952 >> 172.21.15.106:0/3437790952 conn(0x7fbd200a9e20 msgr2=0x7fbd200aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- 172.21.15.106:0/3437790952 shutdown_connections 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 1 -- 172.21.15.106:0/3437790952 wait complete. 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.466+0000 7fbd27a5f640 10 monclient: monmap: 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.456 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 Processor -- start 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 -- start start 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient: init 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient: _add_conns ranks=[3,8,7,2,4,0,6,1,5] 2024-04-26T00:13:22.457 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient(hunting): picked mon.noname-g con 0x7fbd200a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient(hunting): picked mon.noname-e con 0x7fbd20134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient(hunting): picked mon.noname-i con 0x7fbd2013e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200a1e00 con 0x7fbd200a4820 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd200a1a40 con 0x7fbd2013e200 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2009c9f0 con 0x7fbd20134970 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient(hunting): authenticate will time out at 2058.000742s 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd24ffa640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fbd20134970 0x7fbd201d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45412/0 (socket says 172.21.15.106:45412) 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd24ffa640 1 -- 172.21.15.106:0/2988219363 learned_addr learned my addr 172.21.15.106:0/2988219363 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1316164568 0 0) 0x7fbd2009c9f0 con 0x7fbd20134970 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): my global_id is 225206 2024-04-26T00:13:22.458 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd04003530 con 0x7fbd20134970 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2157514621 0 0) 0x7fbd04003530 con 0x7fbd20134970 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd2009c9f0 con 0x7fbd20134970 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd10001ae0 con 0x7fbd20134970 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): dump: 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.459 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3045076485 0 0) 0x7fbd200a1a40 con 0x7fbd2013e200 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): my global_id is 146707 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd04003530 con 0x7fbd2013e200 2024-04-26T00:13:22.460 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 102562335 0 0) 0x7fbd2009c9f0 con 0x7fbd20134970 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.171:6792/0 conn(0x7fbd2013e200 legacy=0x7fbd201d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.171:6790/0 conn(0x7fbd200a4820 legacy=0x7fbd2009fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 monclient: found mon.e 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2009ce70 con 0x7fbd20134970 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 5 monclient: authenticate success, global_id 225206 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient: _renew_subs 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2009d100 con 0x7fbd20134970 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient: _renew_subs 2024-04-26T00:13:22.461 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fbd201cc820 con 0x7fbd20134970 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd10003950 con 0x7fbd20134970 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd10003ec0 con 0x7fbd20134970 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd177fe640 4 set_mon_vals no callback set 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: dump: 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.462 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd000065d0 con 0x7fbd00002870 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fbd10004060 con 0x7fbd20134970 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fbd10045230 con 0x7fbd20134970 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd25ffc640 10 monclient: get_auth_request con 0x7fbd040378e0 auth_method 0 2024-04-26T00:13:22.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942900623 0 0) 0x7fbd000065d0 con 0x7fbd00002870 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient(hunting): my global_id is 284160 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd2009c9f0 con 0x7fbd00002870 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2937859579 0 0) 0x7fbd2009c9f0 con 0x7fbd00002870 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd000065d0 con 0x7fbd00002870 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd1c001440 con 0x7fbd00002870 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 10 monclient: dump: 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.464 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3662781761 0 0) 0x7fbd000065d0 con 0x7fbd00002870 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.470+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd0000a160 con 0x7fbd00002870 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.474+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbd1c0017c0 con 0x7fbd00002870 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.474+0000 7fbd15ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.465 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.474+0000 7fbd15ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.474+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.171:6790/0 conn(0x7fbd00002870 legacy=0x7fbd00004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.466 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.474+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.171:6790/0 conn(0x7fbd00002870 legacy=0x7fbd00004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd27a5f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd00009e50 con 0x7fbd00009110 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3469765876 0 0) 0x7fbd00009e50 con 0x7fbd00009110 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 10 monclient(hunting): my global_id is 284169 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd000065d0 con 0x7fbd00009110 2024-04-26T00:13:22.467 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2108382840 0 0) 0x7fbd000065d0 con 0x7fbd00009110 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd00009e50 con 0x7fbd00009110 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fbd1c005000 con 0x7fbd00009110 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.478+0000 7fbd15ffb640 10 monclient: dump: 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.468 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3413698866 0 0) 0x7fbd00009e50 con 0x7fbd00009110 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd0000c3e0 con 0x7fbd00009110 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 1339927410) 0x7fbd1c007240 con 0x7fbd00009110 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd15ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd15ffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.171:6790/0 conn(0x7fbd00009110 legacy=0x7fbd000095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.469 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd15ffb640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.171:6790/0 conn(0x7fbd00009110 legacy=0x7fbd000095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 28135, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:22.470 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.471 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.472 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:22.473 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.474 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.476 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.478 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.480 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:22.481 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.482 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.483 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.484 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.485 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.486 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.487 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.488 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:22.488 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.171:6812/722422047 conn(0x7fbd040378e0 legacy=0x7fbd04039da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 10 monclient: shutdown 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 >> v1:172.21.15.106:6793/0 conn(0x7fbd20134970 legacy=0x7fbd201d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd25ffc640 1 -- 172.21.15.106:0/2988219363 reap_dead start 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd25ffc640 1 -- 172.21.15.106:0/2988219363 reap_dead start 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 shutdown_connections 2024-04-26T00:13:22.489 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 >> 172.21.15.106:0/2988219363 conn(0x7fbd200a9e20 msgr2=0x7fbd20130ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 shutdown_connections 2024-04-26T00:13:22.490 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.482+0000 7fbd27a5f640 1 -- 172.21.15.106:0/2988219363 wait complete. 2024-04-26T00:13:22.490 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:22.490 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:13:22.490 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:13:22.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: get_monmap_and_config 2024-04-26T00:13:22.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: monmap: 2024-04-26T00:13:22.605 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.605 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.605 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:22.634860+0000 2024-04-26T00:13:22.605 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:22.634860+0000 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.606 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.607 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 Processor -- start 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- start start 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: init 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: _add_conns ranks=[6,0,1,5,3,7,2,8,4] 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient(hunting): picked mon.noname-d con 0x7ffac4134760 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient(hunting): picked mon.noname-a con 0x7ffac40a0d70 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient(hunting): picked mon.noname-f con 0x7ffac413df70 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac406b910 con 0x7ffac40a0d70 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac409fac0 con 0x7ffac413df70 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac40a0080 con 0x7ffac4134760 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient(hunting): authenticate will time out at 2058.161957s 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac9cfa640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffac40a0d70 0x7ffac413c850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44234/0 (socket says 172.21.15.106:44234) 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac9cfa640 1 -- 172.21.15.106:0/3782412176 learned_addr learned my addr 172.21.15.106:0/3782412176 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffaca4fb640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7ffac4134760 0x7ffac4134b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46440/0 (socket says 172.21.15.106:46440) 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3942990970 0 0) 0x7ffac406b910 con 0x7ffac40a0d70 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): my global_id is 274365 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffab0003530 con 0x7ffac40a0d70 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1968815819 0 0) 0x7ffac40a0080 con 0x7ffac4134760 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient(hunting): my global_id is 254625 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffac406b910 con 0x7ffac4134760 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2300969234 0 0) 0x7ffab0003530 con 0x7ffac40a0d70 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 >> v1:172.21.15.106:6792/0 conn(0x7ffac4134760 legacy=0x7ffac4134b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 >> v1:172.21.15.171:6789/0 conn(0x7ffac413df70 legacy=0x7ffac4140360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 monclient: found mon.noname-a 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac409f280 con 0x7ffac40a0d70 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ffab40017c0 con 0x7ffac40a0d70 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 5 monclient: authenticate success, global_id 274365 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: dump: 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.617 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffab4001a20 con 0x7ffac40a0d70 2024-04-26T00:13:22.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 1 -- 172.21.15.106:0/3782412176 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ffab4004bf0 con 0x7ffac40a0d70 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 4 set_mon_vals no callback set 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffac94f9640 10 monclient: dump: 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.619 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: shutdown 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- 172.21.15.106:0/3782412176 >> v1:172.21.15.106:6789/0 conn(0x7ffac40a0d70 legacy=0x7ffac413c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- 172.21.15.106:0/3782412176 shutdown_connections 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- 172.21.15.106:0/3782412176 >> 172.21.15.106:0/3782412176 conn(0x7ffac40a7240 msgr2=0x7ffac40a35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- 172.21.15.106:0/3782412176 shutdown_connections 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 1 -- 172.21.15.106:0/3782412176 wait complete. 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.630+0000 7ffacc75f640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: monmap: 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.621 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 Processor -- start 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 -- start start 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: init 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: _add_conns ranks=[1,7,0,3,5,2,8,6,4] 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient(hunting): picked mon.noname-f con 0x7ffac40a0d70 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient(hunting): picked mon.noname-i con 0x7ffac4134760 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:22.622 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient(hunting): picked mon.noname-a con 0x7ffac413df70 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac4072500 con 0x7ffac413df70 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac4070fc0 con 0x7ffac40a0d70 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac412ceb0 con 0x7ffac4134760 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient(hunting): authenticate will time out at 2058.164967s 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacacfc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ffac413df70 0x7ffac41d4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44240/0 (socket says 172.21.15.106:44240) 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacacfc640 1 -- 172.21.15.106:0/1881311971 learned_addr learned my addr 172.21.15.106:0/1881311971 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3223887704 0 0) 0x7ffac4072500 con 0x7ffac413df70 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): my global_id is 274374 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaa8003530 con 0x7ffac413df70 2024-04-26T00:13:22.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3862249202 0 0) 0x7ffaa8003530 con 0x7ffac413df70 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffac4072500 con 0x7ffac413df70 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ffac0001d70 con 0x7ffac413df70 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): dump: 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.624 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1887201615 0 0) 0x7ffac4072500 con 0x7ffac413df70 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.171:6792/0 conn(0x7ffac4134760 legacy=0x7ffac41d1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.171:6789/0 conn(0x7ffac40a0d70 legacy=0x7ffac41319d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 monclient: found mon.a 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.625 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac41320e0 con 0x7ffac413df70 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 5 monclient: authenticate success, global_id 274374 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: _renew_subs 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ffac4072170 con 0x7ffac413df70 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: _renew_subs 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7ffac412c890 con 0x7ffac413df70 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ffac0003c50 con 0x7ffac413df70 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.626 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ffac0004140 con 0x7ffac413df70 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffac8cf8640 4 set_mon_vals no callback set 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: dump: 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.627 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffaac0065d0 con 0x7ffaac002870 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ffac0004360 con 0x7ffac413df70 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7ffac0045540 con 0x7ffac413df70 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffac9cfa640 10 monclient: get_auth_request con 0x7ffaa8037860 auth_method 0 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1936680896 0 0) 0x7ffaac0065d0 con 0x7ffaac002870 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient(hunting): my global_id is 254588 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffac4072500 con 0x7ffaac002870 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 181968393 0 0) 0x7ffac4072500 con 0x7ffaac002870 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffaac0065d0 con 0x7ffaac002870 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ffabc001560 con 0x7ffaac002870 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.634+0000 7ffabaffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 10 monclient: dump: 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.629 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2393813538 0 0) 0x7ffaac0065d0 con 0x7ffaac002870 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffaac00a160 con 0x7ffaac002870 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ffabc001c30 con 0x7ffaac002870 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:22.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.171:6791/0 conn(0x7ffaac002870 legacy=0x7ffaac004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.631 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.638+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.171:6791/0 conn(0x7ffaac002870 legacy=0x7ffaac004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.642+0000 7ffacc75f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.642+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ffaac009e50 con 0x7ffaac009110 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 24729527 0 0) 0x7ffaac009e50 con 0x7ffaac009110 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient(hunting): my global_id is 254597 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffaac0065d0 con 0x7ffaac009110 2024-04-26T00:13:22.632 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3751910810 0 0) 0x7ffaac0065d0 con 0x7ffaac009110 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ffaac009e50 con 0x7ffaac009110 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ffabc004d20 con 0x7ffaac009110 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient: dump: 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.633 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 210822016 0 0) 0x7ffaac009e50 con 0x7ffaac009110 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ffaac00c3e0 con 0x7ffaac009110 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 2074225706) 0x7ffabc007090 con 0x7ffaac009110 2024-04-26T00:13:22.634 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.171:6791/0 conn(0x7ffaac009110 legacy=0x7ffaac0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffabaffd640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.171:6791/0 conn(0x7ffaac009110 legacy=0x7ffaac0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 272698, 2024-04-26T00:13:22.635 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.636 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.637 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.638 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:22.639 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.640 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.641 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.642 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:22.643 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.644 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.645 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.646 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.647 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:22.648 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.649 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.650 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.651 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.652 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:22.653 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:22.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.171:6812/722422047 conn(0x7ffaa8037860 legacy=0x7ffaa8039d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 10 monclient: shutdown 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 >> v1:172.21.15.106:6789/0 conn(0x7ffac413df70 legacy=0x7ffac41d4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacacfc640 1 -- 172.21.15.106:0/1881311971 reap_dead start 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacacfc640 1 -- 172.21.15.106:0/1881311971 reap_dead start 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 shutdown_connections 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 >> 172.21.15.106:0/1881311971 conn(0x7ffac40a7240 msgr2=0x7ffac40a48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 shutdown_connections 2024-04-26T00:13:22.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.646+0000 7ffacc75f640 1 -- 172.21.15.106:0/1881311971 wait complete. 2024-04-26T00:13:22.655 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:22.656 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:13:22.656 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: get_monmap_and_config 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: monmap: 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:22.799085+0000 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:22.799085+0000 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.769 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.770 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 Processor -- start 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- start start 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: init 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: _add_conns ranks=[4,0,1,6,8,2,3,7,5] 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient(hunting): picked mon.noname-c con 0x7f2fec135870 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient(hunting): picked mon.noname-a con 0x7f2fec1353b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient(hunting): picked mon.noname-f con 0x7f2fec13bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec06f2d0 con 0x7f2fec1353b0 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec072330 con 0x7f2fec13bdf0 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec072610 con 0x7f2fec135870 2024-04-26T00:13:22.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient(hunting): authenticate will time out at 2058.326241s 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff16fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f2fec1353b0 0x7f2fec13a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44254/0 (socket says 172.21.15.106:44254) 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff16fc640 1 -- 172.21.15.106:0/1044967059 learned_addr learned my addr 172.21.15.106:0/1044967059 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005695615 0 0) 0x7f2fec072610 con 0x7f2fec135870 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): my global_id is 274414 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd4003530 con 0x7f2fec135870 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453009748 0 0) 0x7f2fec06f2d0 con 0x7f2fec1353b0 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.779 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient(hunting): my global_id is 274383 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fec072610 con 0x7f2fec1353b0 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2187453753 0 0) 0x7f2fd4003530 con 0x7f2fec135870 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 >> v1:172.21.15.171:6789/0 conn(0x7f2fec13bdf0 legacy=0x7f2fec13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 >> v1:172.21.15.106:6789/0 conn(0x7f2fec1353b0 legacy=0x7f2fec13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 monclient: found mon.noname-c 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec0a3260 con 0x7f2fec135870 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2fe4001b80 con 0x7f2fec135870 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: dump: 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.781 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 5 monclient: authenticate success, global_id 274414 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fe4001e10 con 0x7f2fec135870 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 4 set_mon_vals no callback set 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 1 -- 172.21.15.106:0/1044967059 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2fe4003ce0 con 0x7f2fec135870 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff0efb640 10 monclient: dump: 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.782 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 10 monclient: shutdown 2024-04-26T00:13:22.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- 172.21.15.106:0/1044967059 >> v1:172.21.15.106:6791/0 conn(0x7f2fec135870 legacy=0x7f2fec135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- 172.21.15.106:0/1044967059 shutdown_connections 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- 172.21.15.106:0/1044967059 >> 172.21.15.106:0/1044967059 conn(0x7f2fec0a64e0 msgr2=0x7f2fec0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- 172.21.15.106:0/1044967059 shutdown_connections 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.794+0000 7f2ff4161640 1 -- 172.21.15.106:0/1044967059 wait complete. 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: monmap: 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.784 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 Processor -- start 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 -- start start 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: init 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: _add_conns ranks=[8,4,1,2,0,3,7,6,5] 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient(hunting): picked mon.noname-e con 0x7f2fec1353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:22.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient(hunting): picked mon.noname-c con 0x7f2fec135870 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient(hunting): picked mon.noname-f con 0x7f2fec13bdf0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec1321e0 con 0x7f2fec13bdf0 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec09f470 con 0x7f2fec135870 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fec132fd0 con 0x7f2fec1353b0 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient(hunting): authenticate will time out at 2058.329234s 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff16fc640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f2fec135870 0x7f2fec1cf3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50686/0 (socket says 172.21.15.106:50686) 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff16fc640 1 -- 172.21.15.106:0/1895104648 learned_addr learned my addr 172.21.15.106:0/1895104648 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 755085951 0 0) 0x7f2fec09f470 con 0x7f2fec135870 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): my global_id is 274423 2024-04-26T00:13:22.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd8003530 con 0x7f2fec135870 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984999810 0 0) 0x7f2fec132fd0 con 0x7f2fec1353b0 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): my global_id is 225215 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fec09f470 con 0x7f2fec1353b0 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2261333072 0 0) 0x7f2fd8003530 con 0x7f2fec135870 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fec132fd0 con 0x7f2fec135870 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2fe0001a00 con 0x7f2fec135870 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): dump: 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.787 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2287438983 0 0) 0x7f2fec1321e0 con 0x7f2fec13bdf0 2024-04-26T00:13:22.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): my global_id is 225415 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fd8003530 con 0x7f2fec13bdf0 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2298081080 0 0) 0x7f2fec09f470 con 0x7f2fec1353b0 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fec1321e0 con 0x7f2fec1353b0 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2fe4001b40 con 0x7f2fec1353b0 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): dump: 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.789 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3712836572 0 0) 0x7f2fec132fd0 con 0x7f2fec135870 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.106:6793/0 conn(0x7f2fec1353b0 legacy=0x7f2fec1c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.171:6789/0 conn(0x7f2fec13bdf0 legacy=0x7f2fec1d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 monclient: found mon.c 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fec1c6bb0 con 0x7f2fec135870 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 5 monclient: authenticate success, global_id 274423 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: _renew_subs 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2fec1c7820 con 0x7f2fec135870 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: _renew_subs 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2fec135080 con 0x7f2fec135870 2024-04-26T00:13:22.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2fe0001c60 con 0x7f2fec135870 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2fe0004de0 con 0x7f2fec135870 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2febfff640 4 set_mon_vals no callback set 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient: dump: 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.792 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fcc0065d0 con 0x7f2fcc002870 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2fe0005000 con 0x7f2fec135870 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f2fe00450c0 con 0x7f2fec135870 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2ff26fe640 10 monclient: get_auth_request con 0x7f2fd8038030 auth_method 0 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426066749 0 0) 0x7f2fcc0065d0 con 0x7f2fcc002870 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 10 monclient(hunting): my global_id is 146725 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.798+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fec132fd0 con 0x7f2fcc002870 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3051440399 0 0) 0x7f2fec132fd0 con 0x7f2fcc002870 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fcc0065d0 con 0x7f2fcc002870 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2fe4004030 con 0x7f2fcc002870 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 10 monclient: dump: 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.794 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.798 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3502878373 0 0) 0x7f2fcc0065d0 con 0x7f2fcc002870 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2fcc00a160 con 0x7f2fcc002870 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2fe40041f0 con 0x7f2fcc002870 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.171:6792/0 conn(0x7f2fcc002870 legacy=0x7f2fcc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.802+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.171:6792/0 conn(0x7f2fcc002870 legacy=0x7f2fcc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.806+0000 7f2ff4161640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.806+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2fcc009e30 con 0x7f2fcc0090f0 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 906579890 0 0) 0x7f2fcc009e30 con 0x7f2fcc0090f0 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient(hunting): my global_id is 146734 2024-04-26T00:13:22.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fcc0065d0 con 0x7f2fcc0090f0 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2956752654 0 0) 0x7f2fcc0065d0 con 0x7f2fcc0090f0 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2fcc009e30 con 0x7f2fcc0090f0 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2fe4004a20 con 0x7f2fcc0090f0 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient: dump: 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.802 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1094686234 0 0) 0x7f2fcc009e30 con 0x7f2fcc0090f0 2024-04-26T00:13:22.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2fcc00c3a0 con 0x7f2fcc0090f0 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 281827017) 0x7f2fe40076a0 con 0x7f2fcc0090f0 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.171:6792/0 conn(0x7f2fcc0090f0 legacy=0x7f2fcc009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2fea7fc640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.171:6792/0 conn(0x7f2fcc0090f0 legacy=0x7f2fcc009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:22.804 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:22.805 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:22.805 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:22.806 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 866338, 2024-04-26T00:13:22.806 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:22.806 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:22.806 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:22.806 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:22.806 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:22.806 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 3, 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.807 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:22.808 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:22.808 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.808 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.808 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.808 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.808 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.808 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.809 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:22.810 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.811 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:22.812 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:22.813 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:22.813 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:22.813 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:22.813 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:22.813 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:22.814 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:22.814 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:22.814 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:22.814 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:22.814 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:22.815 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:22.815 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:22.815 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:22.815 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:22.815 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.815 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:22.816 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.816 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:22.816 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.816 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:22.816 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:22.817 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.817 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.817 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.817 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:22.817 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.818 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:22.819 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.820 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.821 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.822 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.823 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:22.824 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.825 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.826 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:22.827 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.828 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.829 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:22.830 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.831 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.832 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:22.833 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:22.834 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.171:6812/722422047 conn(0x7f2fd8038030 legacy=0x7f2fd803a4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 10 monclient: shutdown 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 >> v1:172.21.15.106:6791/0 conn(0x7f2fec135870 legacy=0x7f2fec1cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff26fe640 1 -- 172.21.15.106:0/1895104648 reap_dead start 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff26fe640 1 -- 172.21.15.106:0/1895104648 reap_dead start 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 shutdown_connections 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 >> 172.21.15.106:0/1895104648 conn(0x7f2fec0a64e0 msgr2=0x7f2fec13f1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 shutdown_connections 2024-04-26T00:13:22.836 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.810+0000 7f2ff4161640 1 -- 172.21.15.106:0/1895104648 wait complete. 2024-04-26T00:13:22.836 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:22.837 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:13:22.837 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:13:22.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: get_monmap_and_config 2024-04-26T00:13:22.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: monmap: 2024-04-26T00:13:22.949 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.949 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:22.979016+0000 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:22.979016+0000 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.950 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.951 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.951 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.951 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.951 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.951 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 Processor -- start 2024-04-26T00:13:22.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- start start 2024-04-26T00:13:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: init 2024-04-26T00:13:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: _add_conns ranks=[0,6,8,7,4,1,2,3,5] 2024-04-26T00:13:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient(hunting): picked mon.noname-a con 0x7fc070134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:22.958 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient(hunting): picked mon.noname-d con 0x7fc0700a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient(hunting): picked mon.noname-e con 0x7fc07013e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc07006dd40 con 0x7fc070134970 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0700a2b10 con 0x7fc0700a4820 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc0700a2df0 con 0x7fc07013e200 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient(hunting): authenticate will time out at 2058.506126s 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06f7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc0700a4820 0x7fc07013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46456/0 (socket says 172.21.15.106:46456) 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06f7fe640 1 -- 172.21.15.106:0/1912355520 learned_addr learned my addr 172.21.15.106:0/1912355520 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc074a7c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc07013e200 0x7fc0701405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45432/0 (socket says 172.21.15.106:45432) 2024-04-26T00:13:22.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735560574 0 0) 0x7fc0700a2b10 con 0x7fc0700a4820 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): my global_id is 254634 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc058003530 con 0x7fc0700a4820 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2997880891 0 0) 0x7fc07006dd40 con 0x7fc070134970 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): my global_id is 274392 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc0700a2b10 con 0x7fc070134970 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 947631313 0 0) 0x7fc0700a2df0 con 0x7fc07013e200 2024-04-26T00:13:22.960 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient(hunting): my global_id is 225224 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc07006dd40 con 0x7fc07013e200 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2910013725 0 0) 0x7fc058003530 con 0x7fc0700a4820 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 >> v1:172.21.15.106:6793/0 conn(0x7fc07013e200 legacy=0x7fc0701405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 >> v1:172.21.15.106:6789/0 conn(0x7fc070134970 legacy=0x7fc070134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 monclient: found mon.noname-d 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0700a30d0 con 0x7fc0700a4820 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0600017c0 con 0x7fc0700a4820 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 5 monclient: authenticate success, global_id 254634 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:22.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: dump: 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.963 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc0600019f0 con 0x7fc0700a4820 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 4 set_mon_vals no callback set 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 1 -- 172.21.15.106:0/1912355520 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc060004bf0 con 0x7fc0700a4820 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:22.964 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc06effd640 10 monclient: dump: 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.965 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 10 monclient: shutdown 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- 172.21.15.106:0/1912355520 >> v1:172.21.15.106:6792/0 conn(0x7fc0700a4820 legacy=0x7fc07013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- 172.21.15.106:0/1912355520 shutdown_connections 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- 172.21.15.106:0/1912355520 >> 172.21.15.106:0/1912355520 conn(0x7fc0700a9e20 msgr2=0x7fc0700aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- 172.21.15.106:0/1912355520 shutdown_connections 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.974+0000 7fc0764df640 1 -- 172.21.15.106:0/1912355520 wait complete. 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: build_initial_monmap 2024-04-26T00:13:22.966 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: monmap: 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:22.967 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 Processor -- start 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 -- start start 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: init 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _add_conns ranks=[3,8,4,6,5,7,1,0,2] 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient(hunting): picked mon.noname-g con 0x7fc0700a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient(hunting): picked mon.noname-e con 0x7fc070134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:22.968 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient(hunting): picked mon.noname-c con 0x7fc07013e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc070135d20 con 0x7fc0700a4820 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc070136000 con 0x7fc07013e200 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc070134d50 con 0x7fc070134970 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06f7fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc070134970 0x7fc0701d1710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45434/0 (socket says 172.21.15.106:45434) 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06f7fe640 1 -- 172.21.15.106:0/1233158869 learned_addr learned my addr 172.21.15.106:0/1233158869 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient(hunting): authenticate will time out at 2058.509212s 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207032087 0 0) 0x7fc070134d50 con 0x7fc070134970 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.969 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): my global_id is 225233 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc05c003530 con 0x7fc070134970 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 885818985 0 0) 0x7fc070136000 con 0x7fc07013e200 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): my global_id is 274432 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc070134d50 con 0x7fc07013e200 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2614442453 0 0) 0x7fc070134d50 con 0x7fc07013e200 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc070136000 con 0x7fc07013e200 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc068001cc0 con 0x7fc07013e200 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): dump: 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.971 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 966621336 0 0) 0x7fc05c003530 con 0x7fc070134970 2024-04-26T00:13:22.972 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc070134d50 con 0x7fc070134970 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0600017e0 con 0x7fc070134970 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): dump: 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.973 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2876738196 0 0) 0x7fc070135d20 con 0x7fc0700a4820 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:22.974 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient(hunting): my global_id is 284178 2024-04-26T00:13:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc05c003530 con 0x7fc0700a4820 2024-04-26T00:13:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 615949193 0 0) 0x7fc070136000 con 0x7fc07013e200 2024-04-26T00:13:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 >> v1:172.21.15.106:6793/0 conn(0x7fc070134970 legacy=0x7fc0701d1710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 >> v1:172.21.15.171:6790/0 conn(0x7fc0700a4820 legacy=0x7fc0701cc720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:22.975 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 monclient: found mon.c 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc070134f20 con 0x7fc07013e200 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: _finish_auth 0 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 5 monclient: authenticate success, global_id 274432 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _renew_subs 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc07009f6b0 con 0x7fc07013e200 2024-04-26T00:13:22.976 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _renew_subs 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc07009ed60 con 0x7fc07013e200 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc068001fd0 con 0x7fc07013e200 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc0680051e0 con 0x7fc07013e200 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06e7fc640 4 set_mon_vals no callback set 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 10 monclient: dump: 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.977 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:22.978 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc068005380 con 0x7fc07013e200 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fc0680453c0 con 0x7fc07013e200 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc050005090 con 0x7fc07013e200 2024-04-26T00:13:22.979 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.978+0000 7fc06ffff640 10 monclient: get_auth_request con 0x7fc05c037e50 auth_method 0 2024-04-26T00:13:22.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.982+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fc068015990 con 0x7fc07013e200 2024-04-26T00:13:22.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.982+0000 7fc06cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:22.980 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:22.982+0000 7fc06cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:23.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.190+0000 7fc0764df640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:13:23.166 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.190+0000 7fc0764df640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:13:23.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.190+0000 7fc0764df640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:23.167 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.190+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fc050005b90 con 0x7fc07013e200 2024-04-26T00:13:23.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.194+0000 7fc06cff9640 1 -- 172.21.15.106:0/1233158869 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fc068015290 con 0x7fc07013e200 2024-04-26T00:13:23.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.194+0000 7fc06cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:13:23.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.194+0000 7fc06cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:23.172 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.172 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=2094888147,config=692619927,health=4010110682,kv=1996692365,logm=2480795193}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=26,config=2,health=11,kv=12,logm=49} crc {auth=508960170,config=692619927,health=2785014837,kv=1996692365,logm=3932134399}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=27,config=2,health=12,kv=10,logm=49} crc {auth=903940596,config=2435484489,health=4010110682,kv=1795633974,logm=398046369}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=27,config=1,health=11,kv=11,logm=50} crc {auth=2246630613,config=3678701417,health=2803675564,kv=1342168570,logm=1404581887}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.173 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=27,config=1,health=11,kv=11,logm=50} crc {auth=411719167,config=1228700967,health=2800274429,kv=4113770424,logm=2596055673}) 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=25,config=2,health=10,kv=12,logm=51} crc {auth=1997735682,config=692619927,health=774453484,kv=1996692365,logm=2345102178}) 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=25,config=2,health=12,kv=12,logm=49} crc {auth=3836517725,config=692619927,health=4010110682,kv=1996692365,logm=98329635}) 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=27,config=2,health=12,kv=12,logm=47} crc {auth=903940596,config=692619927,health=4010110682,kv=959611114,logm=600748519}) 2024-04-26T00:13:23.174 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=27,config=2,health=11,kv=11,logm=49} crc {auth=903940596,config=692619927,health=2785014837,kv=2486284834,logm=3200319462}) 2024-04-26T00:13:23.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 >> v1:172.21.15.171:6812/722422047 conn(0x7fc05c037e50 legacy=0x7fc05c03a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:23.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 10 monclient: shutdown 2024-04-26T00:13:23.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:23.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 >> v1:172.21.15.106:6791/0 conn(0x7fc07013e200 legacy=0x7fc0701d4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:23.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 shutdown_connections 2024-04-26T00:13:23.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 >> 172.21.15.106:0/1233158869 conn(0x7fc0700a9e20 msgr2=0x7fc07009aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:23.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 shutdown_connections 2024-04-26T00:13:23.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:23.198+0000 7fc0764df640 1 -- 172.21.15.106:0/1233158869 wait complete. 2024-04-26T00:13:23.178 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.178 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.178 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4139668361}) 2024-04-26T00:13:23.178 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.178 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.178 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=839132797}) 2024-04-26T00:13:23.178 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2042565949}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3007178462}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1450491064}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3486675365}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2114281719}) 2024-04-26T00:13:23.179 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3277528574}) 2024-04-26T00:13:23.180 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2438819987}) 2024-04-26T00:13:23.181 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.181 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1012426480}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3475960220}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4057714871}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2463114714}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.182 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=229175955}) 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2244420348}) 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4010048901}) 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=197455360}) 2024-04-26T00:13:23.183 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1056720989}) 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2031030168}) 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=557404206}) 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3028251281}) 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.186 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3946083131}) 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1973107855}) 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2310630780}) 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.187 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.188 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1053559601}) 2024-04-26T00:13:23.188 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.188 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2541182439}) 2024-04-26T00:13:23.188 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1016051539}) 2024-04-26T00:13:23.192 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1419520856}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=517167139}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3979515100}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=974231389}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.193 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2230496668}) 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3423290451}) 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3365433852}) 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1151945222}) 2024-04-26T00:13:23.194 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1545226284}) 2024-04-26T00:13:23.195 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:13:23.223 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=12502184}) 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1144125186}) 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1822948685}) 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.224 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1378360723}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=645087960}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2116609425}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=753494500}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1268188995}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=80795326}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.225 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3750858158}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2448804981}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2376910515}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=682301569}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1144971339}) 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.226 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=24430717}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4072608930}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3833135860}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1140393520}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3701240686}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.227 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1658279933}) 2024-04-26T00:13:23.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=201834223}) 2024-04-26T00:13:23.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.228 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=63445562}) 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3790101443}) 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1080751049}) 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2146759664}) 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.229 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507383585}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4011721169}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2129588187}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2109455701}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3189034542}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3519604094}) 2024-04-26T00:13:23.230 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=845080775}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3170606545}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2377501627}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=683100201}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1198202785}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.231 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3374753222}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4116991132}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1401924543}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1880745011}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=182744229}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.232 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1022643771}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2391700049}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504636080}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1723352018}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=408098610}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4124066631}) 2024-04-26T00:13:23.233 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3596947928}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=214517065}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=767583412}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3590720608}) 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.234 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3779434455}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3138184048}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4191884334}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2561775912}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2978338821}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.235 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1805520565}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2910082849}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=324927561}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3366610254}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3504723636}) 2024-04-26T00:13:23.236 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4102659102}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1912825149}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=748817805}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1446186877}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3284997151}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=734810213}) 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.237 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1644706882}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=657469337}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3700680648}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807416388}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3813033926}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=795009756}) 2024-04-26T00:13:23.238 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=24874392}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4018231964}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1520353584}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3179372258}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.239 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2218221}) 2024-04-26T00:13:23.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1533967235}) 2024-04-26T00:13:23.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2167904312}) 2024-04-26T00:13:23.240 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3168638827}) 2024-04-26T00:13:23.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=401381368}) 2024-04-26T00:13:23.267 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3013229864}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3665094794}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1400472607}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=163115649}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.268 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=798050567}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3762446202}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3548955111}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2656017263}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2087202871}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1511822719}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.269 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1800732784}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2212252895}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4156361236}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1314217907}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3903513040}) 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.270 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1803593881}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2742444911}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3718140777}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=848932246}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1933727495}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4116640981}) 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1640125246}) 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4293500447}) 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=473019067}) 2024-04-26T00:13:23.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3160015849}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2827811910}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4209394651}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1799577326}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=868283922}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=567518447}) 2024-04-26T00:13:23.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1250113306}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4241260382}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1502417088}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2978608080}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1493427777}) 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4031236792}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1852742134}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=62896353}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3487633299}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3928935681}) 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=803392172}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=85927307}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4126554177}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3097906550}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1483519397}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4228909657}) 2024-04-26T00:13:23.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3942279568}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2990689346}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1769822096}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3100137823}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1979139942}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3145784567}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=385685406}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1514881340}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2527668681}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4106478584}) 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3375887}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1022500976}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3233245078}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1890115627}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4290608657}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2029477567}) 2024-04-26T00:13:23.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1779615603}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3783172258}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3638623360}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3088387517}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3719769955}) 2024-04-26T00:13:23.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2136099230}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2811428227}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282820920}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1602925135}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1101493406}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1834534693}) 2024-04-26T00:13:23.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=672781768}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3627935186}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1738019979}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=903014718}) 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4079760615}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4217248063}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4176109377}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2668795153}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1180170422}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3330282611}) 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3742099917}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2362172570}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4006394488}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2973118052}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1664563792}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3262356683}) 2024-04-26T00:13:23.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1733565408}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=772019531}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1360602339}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2449423955}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=905641730}) 2024-04-26T00:13:23.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2716167801}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3630254425}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=91014177}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=493760614}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2967857146}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4276223901}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=854202019}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3000612647}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2268761892}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=226770682}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3851019801}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697062342}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1837064460}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1081222614}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=397913940}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1390755260}) 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=826437234}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=477859207}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4186470415}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3556145976}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2633532974}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2306250678}) 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3081888867}) 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=844950639}) 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1419461431}) 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1188923787}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1306402689}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=792527562}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3467090260}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3518824221}) 2024-04-26T00:13:23.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2141584911}) 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3986343406}) 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=549369880}) 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1654057934}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2966644654}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3787206502}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2578426055}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1790006797}) 2024-04-26T00:13:23.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3631008690}) 2024-04-26T00:13:23.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2465137363}) 2024-04-26T00:13:23.420 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=199754764}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1556660258}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1239101564}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3613889805}) 2024-04-26T00:13:23.421 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3053780508}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=610920527}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=107991363}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1665521640}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1422578575}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1423030981}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1091916643}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1067252565}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3591910335}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3101642510}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3367093392}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1952023260}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=619860481}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2185897656}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2359562401}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1303183998}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3969027973}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=760668661}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1549453022}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4018969172}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=47335332}) 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=932435707}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2532037928}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2012475868}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1244544035}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4024595622}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3709685057}) 2024-04-26T00:13:23.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2176953255}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4075831743}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3562677243}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3402111581}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2112986956}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=491517482}) 2024-04-26T00:13:23.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2914864229}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=697940834}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1555191796}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2304763636}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2128749943}) 2024-04-26T00:13:23.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1113622675}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1638547173}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2950555684}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3340595743}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1563800482}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=355133905}) 2024-04-26T00:13:23.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=888131271}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1096079039}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3366519668}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=974123096}) 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1679007665}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2623995055}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3746803198}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2818590979}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=211446874}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=307157636}) 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2950205847}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1536900397}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=858126440}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=229193183}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1289184846}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2425629599}) 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=218097004}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3009465550}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3317041614}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1309816865}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3198207506}) 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=958517634}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1705660371}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1721289727}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4208163167}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=176731063}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2429923618}) 2024-04-26T00:13:23.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4095695668}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=494579449}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=668679605}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3263011613}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249129399}) 2024-04-26T00:13:23.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3374704152}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=19495951}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2050356962}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2289799839}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=529012465}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4016011207}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2517880225}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3901431656}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185873515}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1783674708}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=825427470}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2831797144}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4147038181}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2059638760}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1110071075}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2149148658}) 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=146823013}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2374496401}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1693347485}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2952901357}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3068855552}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1222758782}) 2024-04-26T00:13:23.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1663661397}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=72368420}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=747807182}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4233116606}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=963722449}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1296080495}) 2024-04-26T00:13:23.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1983392205}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4139275433}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=655369655}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2072221408}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1183333663}) 2024-04-26T00:13:23.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=319869896}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2773949600}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1636685432}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2532930094}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2946132317}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3448373216}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4021360793}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2393174665}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3693280586}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=223815425}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1541304374}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2697050286}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=337459712}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3221895423}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=710045208}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3008037831}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2455134998}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3101905463}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2072573589}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2415384461}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3147692908}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1058553536}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=701910448}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3501438727}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1708530122}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3086749666}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2042384209}) 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=379443473}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2597683313}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=624276186}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=955945739}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1035218718}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3776498115}) 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4206977248}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2342691276}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=866244139}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=889356346}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3333813379}) 2024-04-26T00:13:23.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320099278}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1851478480}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3327595473}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1783452970}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1016060167}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4204323954}) 2024-04-26T00:13:23.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3369581049}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1245953435}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=184276629}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845041410}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4125284909}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1933247290}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3509362081}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2134231298}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2982341946}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3362037535}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3535357640}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2689984816}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3404577205}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2776960567}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4004600767}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3655141156}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=800295268}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2468122547}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3537120562}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3437515042}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3210427871}) 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3687066631}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3630406482}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=312891895}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1979333032}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2607531472}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2868070759}) 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.334+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4076272719}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2413266424}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1562310901}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3179825680}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1269373649}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1450642846}) 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.455 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2488133635}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1813755674}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1042032776}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3243728154}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1468670586}) 2024-04-26T00:13:23.456 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2149217798}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=477979905}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2018929986}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2472239401}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3399640418}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3589642494}) 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.457 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3776101119}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1706104489}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=620969638}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3979754055}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1677068330}) 2024-04-26T00:13:23.458 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.338+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=501117755}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2437318391}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2924844587}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1141980661}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2138954757}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.459 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2901626198}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2773542477}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2081595912}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1707154720}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=878652671}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3441193711}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.460 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1912814837}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3406493758}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=175431331}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1760515886}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2768710037}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.461 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2746029655}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3845088209}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.342+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2630139982}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3003334669}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3642248576}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1847007617}) 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.462 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3850610724}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1806703207}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3799488226}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2572184313}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1801318296}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1711948130}) 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.463 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=41322207}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=844956282}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1661475868}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2952849898}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3282201325}) 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.464 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1836526201}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=371314740}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=131980688}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3620760166}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2974245018}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3254535652}) 2024-04-26T00:13:23.465 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=18061510}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1173722586}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4062093905}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1846573627}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2395516179}) 2024-04-26T00:13:23.466 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2997591128}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2948328595}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2161641138}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3158870501}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2448104518}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.467 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2988744998}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4218190310}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4270687517}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2811935190}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2635391296}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.350+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4220144891}) 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.468 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2506406065}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3037033603}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2063844974}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2676456475}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=108600971}) 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.469 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=528859092}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1844911934}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4249417688}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2718417589}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1891080818}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1879326126}) 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.470 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3857708301}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=757580492}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3483391300}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4183097508}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=983930851}) 2024-04-26T00:13:23.471 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1003027881}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.354+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2882053465}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3238376068}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1206103006}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2469864732}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1652385667}) 2024-04-26T00:13:23.472 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2327413292}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2276102897}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1513807311}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3743789933}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1228035794}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.473 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=678004787}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=141012715}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=161904902}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=144817845}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3710602064}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.474 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1084316628}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=827822486}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2243343174}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.358+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=156210739}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=20259985}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=745289380}) 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.475 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3556273406}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=350339741}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2168805338}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2058930941}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=807574930}) 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.476 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3233042162}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1596485511}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2860418683}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1180579856}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1280955186}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=364678554}) 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.477 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2399898224}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3871916863}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3495841943}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1577421170}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.362+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2159528870}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3958304416}) 2024-04-26T00:13:23.478 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2449076515}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4250418380}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3572268710}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4174434503}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.479 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1314569806}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1800467953}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1040509645}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3208005604}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3328712726}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4124390509}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.480 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1543704179}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1784707935}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4229549836}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2724508599}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=389463908}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4008391260}) 2024-04-26T00:13:23.481 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.366+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=803014403}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=825103790}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3199814790}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2730821564}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3817494993}) 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.482 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2244297206}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=349359361}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3663301195}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1876002738}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3404979740}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3063945358}) 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.483 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3419433689}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3503646727}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=86785955}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2596843556}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=970978273}) 2024-04-26T00:13:23.484 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1028498065}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1319123958}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.370+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3873069384}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3645453938}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2102456630}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1081897626}) 2024-04-26T00:13:23.485 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3416520416}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3450791327}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3508992939}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1780486727}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3756476140}) 2024-04-26T00:13:23.486 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=811700391}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1381203175}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3947287092}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1777748116}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3295315832}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.487 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=654876810}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2930279764}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1858107098}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=959522524}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.374+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3646327114}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1751130293}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.488 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3062150692}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3178422436}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1831948494}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=469874387}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1729140736}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.489 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=190233926}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1717439462}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2314027333}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3162282946}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2325738403}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2519724953}) 2024-04-26T00:13:23.490 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1976113197}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3112936537}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3233888194}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1061205325}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1430574732}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.378+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2162829493}) 2024-04-26T00:13:23.491 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2272046740}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2005351307}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=258216662}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=590519332}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3735106771}) 2024-04-26T00:13:23.492 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2720213394}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1681681676}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881056413}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2464199427}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=70168027}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2496559717}) 2024-04-26T00:13:23.493 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2301706033}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2065879132}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4109195352}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=453784517}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.494 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1290085754}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4183599549}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.382+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=703074416}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3233323518}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=353569969}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=414279729}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.495 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=925152333}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3754002398}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=936594269}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1536996461}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2289246905}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1944752483}) 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.496 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=785535346}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3877627024}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4122983783}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=403404899}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2948887895}) 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.497 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=6009149}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2869393868}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1265590343}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2835366325}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3306518956}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3497017711}) 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.498 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=866573894}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4035894781}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4053875921}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1430949774}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.386+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1388303091}) 2024-04-26T00:13:23.499 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434538276}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1370174576}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2730165641}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=492176477}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4125236574}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1377912579}) 2024-04-26T00:13:23.500 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1961551564}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=727979003}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1448801241}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3235197024}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3110302394}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2995218561}) 2024-04-26T00:13:23.501 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4238710406}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3658212123}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4142668975}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3076704083}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.502 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=235911091}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=367487275}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1467797202}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.390+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3905395986}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3879049322}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3121679809}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.503 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2738044450}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3990107016}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2264002223}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3046747410}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1269348658}) 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.504 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1309544227}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2209658188}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2322344139}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2824117276}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1797332221}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2961522018}) 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.505 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.394+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1203307322}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1686966787}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3134241539}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3205025371}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2363956115}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=507894403}) 2024-04-26T00:13:23.506 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2927255411}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1219120579}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1740918868}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2147362945}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=225745256}) 2024-04-26T00:13:23.507 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2752356370}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3712099180}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.398+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=411144317}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2945142220}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1576172523}) 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.508 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4149531144}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3185959921}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=235092308}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1277613283}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.509 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=689299733}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2785428456}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1197136742}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2313601835}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2590521536}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=144808610}) 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.510 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2898899569}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2467994817}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2979615942}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2932748065}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3315251844}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.402+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2680978565}) 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.511 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3876499078}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2356903572}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1338492397}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2752617202}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=290508288}) 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.512 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2010079944}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=742427076}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132238289}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.406+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=791206371}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3586469571}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4286782914}) 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.513 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1218574800}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1740420110}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3199057140}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3573453304}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=769444275}) 2024-04-26T00:13:23.514 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2429207205}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1703662532}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2727988688}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2743087512}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=419412608}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.515 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2655721637}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1508802897}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3968059206}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2300314050}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=110303344}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.410+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1021993292}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.516 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=274199751}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1226437780}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3198373829}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3158729177}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2920593236}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.517 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3721781096}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3662602388}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899441496}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2548845819}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3654111077}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1760490719}) 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.518 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2844536325}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2392784079}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1806736741}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4165650543}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2052108484}) 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.519 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1800104059}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.414+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2499677561}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1873954923}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=970252366}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3683694394}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4075740950}) 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.520 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=197605936}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=942904853}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3710539874}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2960593719}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3342738397}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2881893679}) 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.521 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2858471483}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=632057119}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1486000587}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3288246974}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2417643770}) 2024-04-26T00:13:23.522 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1304507273}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578903405}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.418+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=466980865}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1986014806}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3798757970}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.523 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3112923926}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=506558384}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4160797715}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1288960021}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4210230580}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=24510231}) 2024-04-26T00:13:23.524 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.430+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=491209323}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=982731444}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2925539303}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=205765418}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2240613344}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.525 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=465446718}) 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2318399099}) 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4239285469}) 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3252547638}) 2024-04-26T00:13:23.526 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.438+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=952847494}) 2024-04-26T00:13:23.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3361562006}) 2024-04-26T00:13:23.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.646 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2116190648}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2508204784}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=977303322}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1585542093}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3464562271}) 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.647 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1523405630}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3585186694}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3078842810}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3414678840}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1925382895}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=887698454}) 2024-04-26T00:13:23.648 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2872592075}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=365139406}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3637894022}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=916845420}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3613085950}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.502+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1020260123}) 2024-04-26T00:13:23.649 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1538515747}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2146529490}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2310171339}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4231237225}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.650 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3949404603}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3844412799}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3046609122}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=372249028}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2909286148}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3933238714}) 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.651 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3787003577}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2690485713}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3777685998}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2777491731}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3335401951}) 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.652 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2135526045}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2608504219}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2301922155}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3449475938}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2553430553}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1491756480}) 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.653 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3612832894}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2035926317}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1980334218}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2427428048}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1185237278}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.506+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1967242937}) 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.654 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2478417717}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3598049507}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=347267116}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3216463444}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3659111830}) 2024-04-26T00:13:23.655 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2503973163}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3543886730}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1504604294}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2246805365}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=400784457}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=66176393}) 2024-04-26T00:13:23.656 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3796102032}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3035094055}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3294377162}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3045715937}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.657 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3382840361}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2685640998}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.510+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=581056848}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1610728941}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3475489403}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2344519921}) 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.658 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1008907580}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2678913173}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3731016939}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1189854594}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=921750417}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2652156353}) 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.659 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1138879727}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=429852233}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2499337686}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1196419744}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=946894783}) 2024-04-26T00:13:23.660 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=877175222}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3362155649}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=371177062}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1140263160}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2011767720}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3532444997}) 2024-04-26T00:13:23.661 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=167664624}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3047791035}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=806224120}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3803336435}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.662 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4262000685}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=899607092}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.514+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2959849192}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=94188616}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3314921798}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1597785120}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.663 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=640682111}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3509852857}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1546634976}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3807709780}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=552333293}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4142834602}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.664 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=661725098}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3696811252}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1308228287}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=989052848}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=361250555}) 2024-04-26T00:13:23.665 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1114502309}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3502807389}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=507041146}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=927053405}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2532309875}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.666 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3969028147}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=765398808}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=112350608}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2952888283}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.518+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1185880120}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.667 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3319646310}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3015067127}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=752442943}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2277924324}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3712851575}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4215599039}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.668 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3819213897}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2903389899}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=819260923}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=199892603}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1711414454}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2975100063}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.669 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=474339317}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2639081650}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1802084974}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3746567912}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=685617474}) 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.670 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2134961054}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4163350175}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3939754922}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.522+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2226734916}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2402435939}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2975680588}) 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.671 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3795792414}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1117425341}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2607485313}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=389377824}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4189131223}) 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.672 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3447472676}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3781771610}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2004168885}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2887583425}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1596518069}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=559125541}) 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.673 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2937755583}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1407819781}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2761417121}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1823561068}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.526+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1765143434}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=632960349}) 2024-04-26T00:13:23.674 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2682223309}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1310660908}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2644593775}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=824639474}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.675 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2537164957}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2122163107}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2211250494}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1329615909}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=697565709}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=740723569}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.676 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3397834194}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2996129672}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3703132714}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4238485909}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3696358695}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=75135113}) 2024-04-26T00:13:23.677 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1628794272}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2917576864}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=469541934}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2487588642}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3800499791}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.678 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3178196804}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=946324268}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2245841689}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3420557737}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.530+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=194600635}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=268366741}) 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.679 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3843125388}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1532323583}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1755344295}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3300656953}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4270926568}) 2024-04-26T00:13:23.680 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2142468101}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=151874553}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=977107084}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=372438137}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=187530657}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=34310288}) 2024-04-26T00:13:23.681 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3559921546}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4225407543}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1708170375}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=387265848}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3440477757}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.534+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3247114579}) 2024-04-26T00:13:23.682 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4112539229}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=712390287}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3080674082}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3920630146}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.683 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3516819320}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1656493928}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3615727550}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2956808130}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2952995139}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3397395832}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.684 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=569523023}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3520281745}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=275837621}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3403969231}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1920979890}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.685 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2519459083}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2046120506}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.538+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3846153236}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1783390902}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=432174523}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=152544968}) 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.686 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1002006776}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=734047078}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=950294561}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2528607374}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=85581092}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3175240502}) 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.687 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2400551092}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1248421760}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3209629158}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3567790529}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2217993318}) 2024-04-26T00:13:23.688 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3284237630}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4143664476}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1943355520}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1075901464}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=324818347}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1276839260}) 2024-04-26T00:13:23.689 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1885833671}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2527379441}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1345310370}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2572442487}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.690 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1839852267}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.542+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=41565472}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=375093885}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1573111731}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4244980808}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2186697740}) 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.691 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=882739706}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=143341181}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3989745327}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=598691506}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1781456532}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1444427830}) 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.692 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2583539955}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1280817626}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2866708558}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3839302722}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=691991342}) 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.693 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2398981397}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1736273168}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=28699494}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.546+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3093734655}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=922196322}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=671477275}) 2024-04-26T00:13:23.694 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2243676322}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=381267992}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3745351178}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2618869915}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2508439143}) 2024-04-26T00:13:23.695 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3395364336}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2146469036}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1336434140}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2763663819}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1256497004}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2723733680}) 2024-04-26T00:13:23.696 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=383072411}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1993606297}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=716960724}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=942198884}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.550+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3472238873}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.697 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1908055374}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=408568452}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3340017101}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2731175974}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3723647406}) 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.698 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1375392220}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4178927080}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1311611009}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4164547317}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4213013007}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4183035246}) 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.699 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=74876968}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3144425672}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=679479441}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=45799252}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1774614099}) 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.700 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1627062738}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=233149727}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3366519154}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3515807623}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=824921681}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=331416257}) 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.701 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=735756787}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=705090136}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2337482848}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=366750578}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.554+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4208841498}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3332497965}) 2024-04-26T00:13:23.702 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1834225386}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1617685105}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=549199251}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=514011847}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=271119309}) 2024-04-26T00:13:23.703 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3314318111}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=816871003}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3792509920}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1534155508}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1601958819}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.704 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=977318144}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3076628222}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1948452547}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2659672950}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=116456062}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=810385509}) 2024-04-26T00:13:23.705 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.558+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1283330773}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=684172685}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3642076249}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=795191580}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1901364378}) 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.706 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=577655766}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1979939385}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2344087260}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1875959953}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=158386012}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=179774399}) 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.707 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1658064981}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2819511395}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4109302392}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2767157604}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=510497035}) 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.708 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1072684271}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2764083177}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.562+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2766699585}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2993155339}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=220349649}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3457553025}) 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.709 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1252590993}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=245256293}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2846902888}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=907069445}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=233922883}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4239205417}) 2024-04-26T00:13:23.710 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1703548499}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3968032420}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1573663521}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2688695229}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2199648654}) 2024-04-26T00:13:23.711 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3583288164}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3923741850}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1470344720}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.566+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=209121421}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1707996423}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3216221560}) 2024-04-26T00:13:23.712 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2918103836}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1657604804}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1871115417}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3686532638}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=99387443}) 2024-04-26T00:13:23.713 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810594079}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1485071752}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3091497716}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3910424640}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=62541598}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.714 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2758586004}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2163634838}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1784391530}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=362259729}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3371163457}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3676646950}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.715 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2877879544}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1644159274}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=633240687}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=614536183}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1266995775}) 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.716 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1204546085}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3501866777}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3738222524}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.570+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=785318608}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=577352031}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1587082169}) 2024-04-26T00:13:23.717 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2700771970}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3651055029}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2627985584}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3283444994}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.718 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3684961191}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1714832713}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2720519314}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1289894960}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4291183957}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2816519788}) 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.719 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3697994705}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=547165426}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3298960892}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4157671758}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1351209522}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2634095329}) 2024-04-26T00:13:23.720 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4131304472}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=573525063}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3716512736}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=475532537}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.721 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=703823768}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1069953030}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2316640384}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3392616516}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3902652478}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.574+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=427906921}) 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.722 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2255173086}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1117935338}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2870806461}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4220933880}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1909874678}) 2024-04-26T00:13:23.723 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=686489807}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2821652981}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4083443653}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2458265082}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=805158393}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.724 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4111200261}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=515118146}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2935800385}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2137998594}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=363818474}) 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.725 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1881781408}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3416312416}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=46050348}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2137722700}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1721031473}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2705016007}) 2024-04-26T00:13:23.726 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3306921500}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3614175438}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1058515061}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4030053169}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1115454126}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.727 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2085549631}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1750136330}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1021071683}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.578+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4220349994}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1280398408}) 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.728 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=408121472}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3293313566}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=451499828}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=101010662}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3756446677}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=940575180}) 2024-04-26T00:13:23.729 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=756612217}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1794159860}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=441947934}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2050265740}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2124028814}) 2024-04-26T00:13:23.730 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3809566035}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=800590540}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2232340086}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2725409622}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1141601507}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.731 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1464203362}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4029349773}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=718704859}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1093149197}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1191539402}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3026274582}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.732 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2182170165}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1073922961}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3511673908}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4179364632}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4250460810}) 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.733 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1030161054}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1380021261}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3519650871}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.582+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3050268418}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3416848475}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2289291040}) 2024-04-26T00:13:23.734 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2440922650}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1834127257}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=729383767}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1582220626}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2926268057}) 2024-04-26T00:13:23.735 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1822115793}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3074912862}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=249223984}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4027537839}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1532523759}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4087078892}) 2024-04-26T00:13:23.736 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3330633008}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=753806127}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=345228856}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3137952904}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3039461953}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4118417424}) 2024-04-26T00:13:23.737 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3304568341}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4228088222}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2481577018}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1847196934}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.738 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=457025617}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=940543178}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=792628501}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.586+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=461665470}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2569873094}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1449074418}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.739 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1434129692}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3628739453}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1300973265}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1774675445}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1102903306}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3144172866}) 2024-04-26T00:13:23.740 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4008781778}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2086444854}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4140246312}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1501205146}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3147171838}) 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.741 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2516665315}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=126634845}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3219969059}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1927849967}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.590+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4113126370}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=987104568}) 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.742 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1903387881}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2492288222}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2458764040}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3615619177}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1543433901}) 2024-04-26T00:13:23.743 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2321770798}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1339738967}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2665606600}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=496281243}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1255758310}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2192890548}) 2024-04-26T00:13:23.744 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=593085162}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=763614235}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1126957540}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2254176910}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3382357919}) 2024-04-26T00:13:23.745 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2196741446}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=65,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=14,mon_config_key=9} crc {logm=1960585406,mdsmap=2840952586,mgr=1156056737,mgr_metadata=177654402,mgrstat=983253145,mon_config_key=1813897464}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=70,mdsmap=3,mgr=7,mgr_command_descs=1,mgrstat=13,mon_config_key=6} crc {logm=1498587020,mdsmap=2840952586,mgr=119571008,mgr_command_descs=3057339438,mgrstat=4075615187,mon_config_key=969904023}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=64,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=14,mon_config_key=9} crc {logm=4215052617,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=983253145,mon_config_key=1813897464}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=68,mdsmap=3,mgr=7,mgr_metadata=1,mgrstat=12,mon_config_key=9} crc {logm=1260335669,mdsmap=2840952586,mgr=119571008,mgr_metadata=177654402,mgrstat=3605920139,mon_config_key=3040045454}) 2024-04-26T00:13:23.746 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=69,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=5} crc {logm=1232854006,mdsmap=2840952586,mgr=3822201789,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=37749762,mon_config_key=590447541}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=67,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=8} crc {logm=1631700578,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3403472064,mon_config_key=1869952910}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=64,mdsmap=3,mgr=8,mgr_command_descs=1,mgrstat=13,mon_config_key=11} crc {logm=750815824,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgrstat=2018159867,mon_config_key=809949667}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=62,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=11,monmap=2} crc {logm=1144882558,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=3432692215,mon_config_key=809949667,monmap=375078350}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.594+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=67,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=7} crc {logm=1343959844,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339439,mgr_metadata=177654402,mgrstat=1796188648,mon_config_key=3728314589}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=56} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=330302025}) 2024-04-26T00:13:23.747 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {monmap=1,osd_metadata=6,osdmap=59} crc {monmap=1228700967,osd_metadata=857068958,osdmap=4220734489}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=5,osd_pg_creating=1,osdmap=57} crc {osd_metadata=1249858579,osd_pg_creating=3530713735,osdmap=3516172283}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {monmap=1,osd_metadata=6,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osdmap=1831850145}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=59} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=3768846554}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.748 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=58} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=2824496872}) 2024-04-26T00:13:23.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=60} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=3485965698}) 2024-04-26T00:13:23.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:13:23.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=57} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=1729865213}) 2024-04-26T00:13:23.749 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:13:23.606+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {monmap=1,osd_metadata=6,osd_pg_creating=1,osdmap=61} crc {monmap=1228700967,osd_metadata=857068958,osd_pg_creating=3530713735,osdmap=2643447618}) 2024-04-26T00:13:24.195 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:13:24.196 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:13:24.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: get_monmap_and_config 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: build_initial_monmap 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: monmap: 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:24.358613+0000 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:24.358613+0000 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:24.329 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:24.330 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:24.330 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:24.330 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:24.330 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 Processor -- start 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- start start 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: init 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: _add_conns ranks=[3,4,2,6,5,0,8,7,1] 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient(hunting): picked mon.noname-g con 0x7f9658134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient(hunting): picked mon.noname-c con 0x7f96580a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient(hunting): picked mon.noname-b con 0x7f965813e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f965806dd40 con 0x7f965813e200 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96580a2b10 con 0x7f9658134970 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96580a2df0 con 0x7f96580a4820 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient(hunting): authenticate will time out at 2059.885466s 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f96577fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f96580a4820 0x7f965813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50696/0 (socket says 172.21.15.106:50696) 2024-04-26T00:13:24.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f96577fe640 1 -- 172.21.15.106:0/484399739 learned_addr learned my addr 172.21.15.106:0/484399739 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1540411453 0 0) 0x7f965806dd40 con 0x7f965813e200 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): my global_id is 254675 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9644003530 con 0x7f965813e200 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2275537652 0 0) 0x7f96580a2df0 con 0x7f96580a4820 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient(hunting): my global_id is 274441 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f965806dd40 con 0x7f96580a4820 2024-04-26T00:13:24.338 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 812223044 0 0) 0x7f9644003530 con 0x7f965813e200 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 >> v1:172.21.15.106:6791/0 conn(0x7f96580a4820 legacy=0x7f965813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 >> v1:172.21.15.171:6790/0 conn(0x7f9658134970 legacy=0x7f9658134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 monclient: found mon.noname-b 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96580a30d0 con 0x7f965813e200 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9648001b40 con 0x7f965813e200 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: dump: 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.340 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 5 monclient: authenticate success, global_id 254675 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9648001db0 con 0x7f965813e200 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 4 set_mon_vals no callback set 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 1 -- 172.21.15.106:0/484399739 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9648003ce0 con 0x7f965813e200 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f9656ffd640 10 monclient: dump: 2024-04-26T00:13:24.341 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.342 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: shutdown 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- 172.21.15.106:0/484399739 >> v1:172.21.15.106:6790/0 conn(0x7f965813e200 legacy=0x7f96581405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- 172.21.15.106:0/484399739 shutdown_connections 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- 172.21.15.106:0/484399739 >> 172.21.15.106:0/484399739 conn(0x7f96580a9e20 msgr2=0x7f96580aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- 172.21.15.106:0/484399739 shutdown_connections 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- 172.21.15.106:0/484399739 wait complete. 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: build_initial_monmap 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: monmap: 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:24.343 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 Processor -- start 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 1 -- start start 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.354+0000 7f965e29c640 10 monclient: init 2024-04-26T00:13:24.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _add_conns ranks=[4,8,7,6,3,5,1,0,2] 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient(hunting): picked mon.noname-c con 0x7f96580a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient(hunting): picked mon.noname-e con 0x7f9658134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient(hunting): picked mon.noname-i con 0x7f965813e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96580a1e00 con 0x7f96580a4820 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96581392c0 con 0x7f965813e200 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f96581373e0 con 0x7f9658134970 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient(hunting): authenticate will time out at 2059.888351s 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9657fff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f96580a4820 0x7f965812a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50702/0 (socket says 172.21.15.106:50702) 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9657fff640 1 -- 172.21.15.106:0/1770024144 learned_addr learned my addr 172.21.15.106:0/1770024144 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1161396344 0 0) 0x7f96580a2b10 con 0x7f96580a4820 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): my global_id is 274450 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9638003530 con 0x7f96580a4820 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2538896727 0 0) 0x7f96581373e0 con 0x7f9658134970 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): my global_id is 225242 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96580a2b10 con 0x7f9658134970 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3777283251 0 0) 0x7f9638003530 con 0x7f96580a4820 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f96581373e0 con 0x7f96580a4820 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9650001aa0 con 0x7f96580a4820 2024-04-26T00:13:24.346 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.347 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1348711982 0 0) 0x7f96580a2b10 con 0x7f9658134970 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9638003530 con 0x7f9658134970 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3425458668 0 0) 0x7f96581392c0 con 0x7f965813e200 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): my global_id is 146743 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f96580a2b10 con 0x7f965813e200 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9640001440 con 0x7f9658134970 2024-04-26T00:13:24.348 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.349 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 756505862 0 0) 0x7f96581373e0 con 0x7f96580a4820 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 >> v1:172.21.15.106:6793/0 conn(0x7f9658134970 legacy=0x7f96581d17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 >> v1:172.21.15.171:6792/0 conn(0x7f965813e200 legacy=0x7f96581d4f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 monclient: found mon.c 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9658138fe0 con 0x7f96580a4820 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: _finish_auth 0 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:24.350 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 5 monclient: authenticate success, global_id 274450 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _renew_subs 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9658137aa0 con 0x7f96580a4820 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _renew_subs 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f96581366d0 con 0x7f96580a4820 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f96500038d0 con 0x7f96580a4820 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9650003e40 con 0x7f96580a4820 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f96567fc640 4 set_mon_vals no callback set 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:24.351 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 10 monclient: dump: 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.352 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9650004060 con 0x7f96580a4820 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f963c005090 con 0x7f96580a4820 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f9650045220 con 0x7f96580a4820 2024-04-26T00:13:24.353 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.358+0000 7f96577fe640 10 monclient: get_auth_request con 0x7f9638037fd0 auth_method 0 2024-04-26T00:13:24.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.362+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f96580a1e00 con 0x7f96580a4820 2024-04-26T00:13:24.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.362+0000 7f9654ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:24.354 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.362+0000 7f9654ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:24.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.614+0000 7f965e29c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:13:24.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.614+0000 7f965e29c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:24.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.614+0000 7f965e29c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:24.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.614+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f963c005380 con 0x7f96580a4820 2024-04-26T00:13:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.614+0000 7f9654ff9640 1 -- 172.21.15.106:0/1770024144 <== mon.4 v1:172.21.15.106:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1861079316) 0x7f96500158b0 con 0x7f96580a4820 2024-04-26T00:13:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.614+0000 7f9654ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:24.592 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.614+0000 7f9654ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:24.592 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":114,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:13:24.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 >> v1:172.21.15.171:6812/722422047 conn(0x7f9638037fd0 legacy=0x7f963803a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 10 monclient: shutdown 2024-04-26T00:13:24.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:24.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 >> v1:172.21.15.106:6791/0 conn(0x7f96580a4820 legacy=0x7f965812a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 shutdown_connections 2024-04-26T00:13:24.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 >> 172.21.15.106:0/1770024144 conn(0x7f96580a9e20 msgr2=0x7f9658130c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:24.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 shutdown_connections 2024-04-26T00:13:24.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.618+0000 7f965e29c640 1 -- 172.21.15.106:0/1770024144 wait complete. 2024-04-26T00:13:24.608 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:13:24.608 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-04-26T00:13:24.608 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:13:24.608 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:13:24.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: get_monmap_and_config 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: build_initial_monmap 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: monmap: 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:24.754658+0000 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:24.754658+0000 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:24.725 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:24.726 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:24.726 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:24.726 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:24.726 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:24.726 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 Processor -- start 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- start start 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: init 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: _add_conns ranks=[2,3,7,6,8,0,5,4,1] 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient(hunting): picked mon.noname-b con 0x7f5888134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient(hunting): picked mon.noname-g con 0x7f58880a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient(hunting): picked mon.noname-i con 0x7f588813e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:24.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588806dd40 con 0x7f5888134970 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58880a2b10 con 0x7f58880a4820 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58880a2df0 con 0x7f588813e200 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient(hunting): authenticate will time out at 2060.281689s 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5886ffd640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f5888134970 0x7f5888134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52880/0 (socket says 172.21.15.106:52880) 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5886ffd640 1 -- 172.21.15.106:0/2070206156 learned_addr learned my addr 172.21.15.106:0/2070206156 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4025561409 0 0) 0x7f588806dd40 con 0x7f5888134970 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient(hunting): my global_id is 254684 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5870003530 con 0x7f5888134970 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1389972634 0 0) 0x7f5870003530 con 0x7f5888134970 2024-04-26T00:13:24.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 >> v1:172.21.15.171:6792/0 conn(0x7f588813e200 legacy=0x7f58881405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 >> v1:172.21.15.171:6790/0 conn(0x7f58880a4820 legacy=0x7f588813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 monclient: found mon.noname-b 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58880a30d0 con 0x7f5888134970 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: _finish_auth 0 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f58780017c0 con 0x7f5888134970 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 5 monclient: authenticate success, global_id 254684 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:24.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: dump: 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.736 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5878001ab0 con 0x7f5888134970 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 1 -- 172.21.15.106:0/2070206156 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5878004bf0 con 0x7f5888134970 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 4 set_mon_vals no callback set 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f5885ffb640 10 monclient: dump: 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.738 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: shutdown 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- 172.21.15.106:0/2070206156 >> v1:172.21.15.106:6790/0 conn(0x7f5888134970 legacy=0x7f5888134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- 172.21.15.106:0/2070206156 shutdown_connections 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- 172.21.15.106:0/2070206156 >> 172.21.15.106:0/2070206156 conn(0x7f58880a9e20 msgr2=0x7f58880aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- 172.21.15.106:0/2070206156 shutdown_connections 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 1 -- 172.21.15.106:0/2070206156 wait complete. 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: build_initial_monmap 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.750+0000 7f588d37c640 10 monclient: monmap: 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:24.739 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 Processor -- start 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 -- start start 2024-04-26T00:13:24.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient: init 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient: _add_conns ranks=[0,7,4,1,3,5,8,6,2] 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient(hunting): picked mon.noname-a con 0x7f58880a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient(hunting): picked mon.noname-i con 0x7f5888134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient(hunting): picked mon.noname-c con 0x7f588813e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588809dda0 con 0x7f58880a4820 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58880a1e00 con 0x7f588813e200 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f588809c320 con 0x7f5888134970 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient(hunting): authenticate will time out at 2060.285008s 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f5886ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f58880a4820 0x7f58881cc3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44284/0 (socket says 172.21.15.106:44284) 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f5886ffd640 1 -- 172.21.15.106:0/2163556540 learned_addr learned my addr 172.21.15.106:0/2163556540 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3908800502 0 0) 0x7f588809dda0 con 0x7f58880a4820 2024-04-26T00:13:24.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): my global_id is 274401 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5874003530 con 0x7f58880a4820 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1326245837 0 0) 0x7f58880a1e00 con 0x7f588813e200 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): my global_id is 274459 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f588809dda0 con 0x7f588813e200 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 947154775 0 0) 0x7f5874003530 con 0x7f58880a4820 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58880a1e00 con 0x7f58880a4820 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5878001780 con 0x7f58880a4820 2024-04-26T00:13:24.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2889076564 0 0) 0x7f588809dda0 con 0x7f588813e200 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5874003530 con 0x7f588813e200 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5880001c80 con 0x7f588813e200 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.744 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768442373 0 0) 0x7f588809c320 con 0x7f5888134970 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): my global_id is 146761 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f588809dda0 con 0x7f5888134970 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2791257149 0 0) 0x7f58880a1e00 con 0x7f58880a4820 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.171:6792/0 conn(0x7f5888134970 legacy=0x7f588809fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.106:6791/0 conn(0x7f588813e200 legacy=0x7f58881d4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 monclient: found mon.a 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f588809e330 con 0x7f58880a4820 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:13:24.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 5 monclient: authenticate success, global_id 274401 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient: _renew_subs 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f588809ca00 con 0x7f58880a4820 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient: _renew_subs 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f58880a0420 con 0x7f58880a4820 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5878001ab0 con 0x7f58880a4820 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5878001ce0 con 0x7f58880a4820 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f58857fa640 4 set_mon_vals no callback set 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: dump: 2024-04-26T00:13:24.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.748 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58680065d0 con 0x7f5868002870 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f58780100f0 con 0x7f58880a4820 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5878045310 con 0x7f58880a4820 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2363091131 0 0) 0x7f58680065d0 con 0x7f5868002870 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient(hunting): my global_id is 274410 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58880a1e00 con 0x7f5868002870 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f58877fe640 10 monclient: get_auth_request con 0x7f5874037e90 auth_method 0 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 408235224 0 0) 0x7f58880a1e00 con 0x7f5868002870 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58680065d0 con 0x7f5868002870 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f587c0017f0 con 0x7f5868002870 2024-04-26T00:13:24.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 10 monclient: dump: 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.750 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2715712345 0 0) 0x7f58680065d0 con 0x7f5868002870 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.754+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f586800a160 con 0x7f5868002870 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.758+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f587c001cb0 con 0x7f5868002870 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.758+0000 7f586f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.758+0000 7f586f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.758+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.106:6789/0 conn(0x7f5868002870 legacy=0x7f5868004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.758+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.106:6789/0 conn(0x7f5868002870 legacy=0x7f5868004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5868009e30 con 0x7f58680090f0 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3931295239 0 0) 0x7f5868009e30 con 0x7f58680090f0 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient(hunting): my global_id is 274419 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58680065d0 con 0x7f58680090f0 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2446085798 0 0) 0x7f58680065d0 con 0x7f58680090f0 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5868009e30 con 0x7f58680090f0 2024-04-26T00:13:24.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f587c003bb0 con 0x7f58680090f0 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient: dump: 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.754 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3205797606 0 0) 0x7f5868009e30 con 0x7f58680090f0 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f586800c3a0 con 0x7f58680090f0 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7738 (unknown 0 0 514649741) 0x7f587c003e50 con 0x7f58680090f0 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.106:6789/0 conn(0x7f58680090f0 legacy=0x7f5868009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.755 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f586f7fe640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.106:6789/0 conn(0x7f58680090f0 legacy=0x7f5868009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 152833, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:24.756 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:24.757 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:24.758 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:24.759 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:24.760 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:24.761 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:24.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.765 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:24.766 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.767 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:24.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:24.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:24.773 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:24.774 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.171:6812/722422047 conn(0x7f5874037e90 legacy=0x7f587403a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 10 monclient: shutdown 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 >> v1:172.21.15.106:6789/0 conn(0x7f58880a4820 legacy=0x7f58881cc3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f58877fe640 1 -- 172.21.15.106:0/2163556540 reap_dead start 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f58877fe640 1 -- 172.21.15.106:0/2163556540 reap_dead start 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 shutdown_connections 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 >> 172.21.15.106:0/2163556540 conn(0x7f58880a9e20 msgr2=0x7f5888130bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 shutdown_connections 2024-04-26T00:13:24.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.762+0000 7f588d37c640 1 -- 172.21.15.106:0/2163556540 wait complete. 2024-04-26T00:13:24.777 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:24.777 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:13:24.777 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.906+0000 7fd8bd058640 10 monclient: get_monmap_and_config 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.906+0000 7fd8bd058640 10 monclient: build_initial_monmap 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.906+0000 7fd8bd058640 10 monclient: monmap: 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:24.913959+0000 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:24.913959+0000 2024-04-26T00:13:24.884 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:24.885 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 Processor -- start 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- start start 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: init 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: _add_conns ranks=[2,8,6,7,1,4,5,0,3] 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient(hunting): picked mon.noname-b con 0x7fd8b8134970 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient(hunting): picked mon.noname-e con 0x7fd8b80a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient(hunting): picked mon.noname-d con 0x7fd8b813e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:24.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b806dd40 con 0x7fd8b8134970 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b80a2b10 con 0x7fd8b813e200 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b80a2df0 con 0x7fd8b80a4820 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient(hunting): authenticate will time out at 2060.441464s 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b659c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fd8b80a4820 0x7fd8b813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45450/0 (socket says 172.21.15.106:45450) 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b659c640 1 -- 172.21.15.106:0/3375800162 learned_addr learned my addr 172.21.15.106:0/3375800162 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3906357483 0 0) 0x7fd8b806dd40 con 0x7fd8b8134970 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): my global_id is 254693 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8a0003530 con 0x7fd8b8134970 2024-04-26T00:13:24.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822564273 0 0) 0x7fd8b80a2df0 con 0x7fd8b80a4820 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): my global_id is 225251 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b806dd40 con 0x7fd8b80a4820 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4289091466 0 0) 0x7fd8b80a2b10 con 0x7fd8b813e200 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient(hunting): my global_id is 254643 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b80a2df0 con 0x7fd8b813e200 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1598966664 0 0) 0x7fd8a0003530 con 0x7fd8b8134970 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 >> v1:172.21.15.106:6793/0 conn(0x7fd8b80a4820 legacy=0x7fd8b813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 >> v1:172.21.15.106:6792/0 conn(0x7fd8b813e200 legacy=0x7fd8b81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 monclient: found mon.noname-b 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b80a30d0 con 0x7fd8b8134970 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: _finish_auth 0 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8a80017c0 con 0x7fd8b8134970 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: dump: 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.900 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 5 monclient: authenticate success, global_id 254693 2024-04-26T00:13:24.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8a80019f0 con 0x7fd8b8134970 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 1 -- 172.21.15.106:0/3375800162 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8a8003960 con 0x7fd8b8134970 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 4 set_mon_vals no callback set 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8b5d9b640 10 monclient: dump: 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.902 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: shutdown 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- 172.21.15.106:0/3375800162 >> v1:172.21.15.106:6790/0 conn(0x7fd8b8134970 legacy=0x7fd8b8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- 172.21.15.106:0/3375800162 shutdown_connections 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- 172.21.15.106:0/3375800162 >> 172.21.15.106:0/3375800162 conn(0x7fd8b80a9e20 msgr2=0x7fd8b80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- 172.21.15.106:0/3375800162 shutdown_connections 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- 172.21.15.106:0/3375800162 wait complete. 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: build_initial_monmap 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: monmap: 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:24.904 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 Processor -- start 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 1 -- start start 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.910+0000 7fd8bd058640 10 monclient: init 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient: _add_conns ranks=[3,5,7,8,4,2,1,0,6] 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient(hunting): picked mon.noname-g con 0x7fd8b80a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient(hunting): picked mon.noname-h con 0x7fd8b8134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient(hunting): picked mon.noname-i con 0x7fd8b813e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b813c230 con 0x7fd8b80a4820 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b80a1e00 con 0x7fd8b8134970 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8b80a1a40 con 0x7fd8b813e200 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:24.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient(hunting): authenticate will time out at 2060.444378s 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8b6d9d640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd8b80a4820 0x7fd8b812d540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:36754/0 (socket says 172.21.15.106:36754) 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8b6d9d640 1 -- 172.21.15.106:0/2948032825 learned_addr learned my addr 172.21.15.106:0/2948032825 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2612321552 0 0) 0x7fd8b80a1e00 con 0x7fd8b8134970 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): my global_id is 254606 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8a4003530 con 0x7fd8b8134970 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1289046600 0 0) 0x7fd8b80a1a40 con 0x7fd8b813e200 2024-04-26T00:13:24.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): my global_id is 146770 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b80a1e00 con 0x7fd8b813e200 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 145852750 0 0) 0x7fd8b813c230 con 0x7fd8b80a4820 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): my global_id is 284205 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b80a1a40 con 0x7fd8b80a4820 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 322513127 0 0) 0x7fd8a4003530 con 0x7fd8b8134970 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8b813c230 con 0x7fd8b8134970 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8ac001460 con 0x7fd8b8134970 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:24.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.909 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 867204727 0 0) 0x7fd8b80a1e00 con 0x7fd8b813e200 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8a4003530 con 0x7fd8b813e200 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8b0001b70 con 0x7fd8b813e200 2024-04-26T00:13:24.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.911 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1159003823 0 0) 0x7fd8b80a1a40 con 0x7fd8b80a4820 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8b80a1e00 con 0x7fd8b80a4820 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8a80016c0 con 0x7fd8b80a4820 2024-04-26T00:13:24.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:13:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): dump: 2024-04-26T00:13:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.913 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1783285193 0 0) 0x7fd8b813c230 con 0x7fd8b8134970 2024-04-26T00:13:24.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.171:6792/0 conn(0x7fd8b813e200 legacy=0x7fd8b81d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.171:6790/0 conn(0x7fd8b80a4820 legacy=0x7fd8b812d540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 monclient: found mon.h 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8b813a1b0 con 0x7fd8b8134970 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 5 monclient: authenticate success, global_id 254606 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient: _renew_subs 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8b813c510 con 0x7fd8b8134970 2024-04-26T00:13:24.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient: _renew_subs 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd8b81398c0 con 0x7fd8b8134970 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8ac001710 con 0x7fd8b8134970 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8ac004de0 con 0x7fd8b8134970 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8b559a640 4 set_mon_vals no callback set 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: dump: 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.916 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd8980065d0 con 0x7fd898002870 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018096557 0 0) 0x7fd8980065d0 con 0x7fd898002870 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient(hunting): my global_id is 254702 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8b813c230 con 0x7fd898002870 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2717437865 0 0) 0x7fd8b813c230 con 0x7fd898002870 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8980065d0 con 0x7fd898002870 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8a8003fb0 con 0x7fd898002870 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: dump: 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.918 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1379067300 0 0) 0x7fd8980065d0 con 0x7fd898002870 2024-04-26T00:13:24.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd89800a160 con 0x7fd898002870 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd8ac00fb80 con 0x7fd8b8134970 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fd8ac044fb0 con 0x7fd8b8134970 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd8a80041e0 con 0x7fd898002870 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.106:6790/0 conn(0x7fd898002870 legacy=0x7fd898004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.914+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.106:6790/0 conn(0x7fd898002870 legacy=0x7fd898004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:24.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.918+0000 7fd8b759e640 10 monclient: get_auth_request con 0x7fd8a4038260 auth_method 0 2024-04-26T00:13:24.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd898009e60 con 0x7fd898009120 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1986532764 0 0) 0x7fd898009e60 con 0x7fd898009120 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient(hunting): my global_id is 254711 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8980065d0 con 0x7fd898009120 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 351472710 0 0) 0x7fd8980065d0 con 0x7fd898009120 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd898009e60 con 0x7fd898009120 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd8a80049c0 con 0x7fd898009120 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient: dump: 2024-04-26T00:13:24.922 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:24.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1663241468 0 0) 0x7fd898009e60 con 0x7fd898009120 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd89800c3e0 con 0x7fd898009120 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 48388136) 0x7fd8a8007da0 con 0x7fd898009120 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.106:6790/0 conn(0x7fd898009120 legacy=0x7fd8980095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd89f7fe640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.106:6790/0 conn(0x7fd898009120 legacy=0x7fd8980095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:24.924 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 274979, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:24.925 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.926 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:24.928 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:24.929 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.930 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.932 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:24.934 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.935 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.938 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.939 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.941 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:24.942 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:24.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.171:6812/722422047 conn(0x7fd8a4038260 legacy=0x7fd8a403a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 10 monclient: shutdown 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 >> v1:172.21.15.171:6791/0 conn(0x7fd8b8134970 legacy=0x7fd8b812dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8b759e640 1 -- 172.21.15.106:0/2948032825 reap_dead start 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8b759e640 1 -- 172.21.15.106:0/2948032825 reap_dead start 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 shutdown_connections 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 >> 172.21.15.106:0/2948032825 conn(0x7fd8b80a9e20 msgr2=0x7fd8b8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 shutdown_connections 2024-04-26T00:13:24.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:24.922+0000 7fd8bd058640 1 -- 172.21.15.106:0/2948032825 wait complete. 2024-04-26T00:13:24.944 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:24.944 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:13:24.945 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:13:25.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.078+0000 7fcdacbaa640 10 monclient: get_monmap_and_config 2024-04-26T00:13:25.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.078+0000 7fcdacbaa640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.078+0000 7fcdacbaa640 10 monclient: monmap: 2024-04-26T00:13:25.056 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.056 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.056 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:25.085274+0000 2024-04-26T00:13:25.056 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:25.085274+0000 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.078+0000 7fcdacbaa640 1 Processor -- start 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.078+0000 7fcdacbaa640 1 -- start start 2024-04-26T00:13:25.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.078+0000 7fcdacbaa640 10 monclient: init 2024-04-26T00:13:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: _add_conns ranks=[4,2,8,5,7,0,6,1,3] 2024-04-26T00:13:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): picked mon.noname-c con 0x7fcda806e3e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): picked mon.noname-b con 0x7fcda806fba0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): picked mon.noname-e con 0x7fcda806eed0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:25.064 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda8070f80 con 0x7fcda806fba0 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda8071e00 con 0x7fcda806e3e0 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda80709c0 con 0x7fcda806eed0 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): authenticate will time out at 2060.612403s 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda659c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fcda806e3e0 0x7fcda806e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50714/0 (socket says 172.21.15.106:50714) 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda5d9b640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fcda806fba0 0x7fcda81391f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52918/0 (socket says 172.21.15.106:52918) 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda659c640 1 -- 172.21.15.106:0/2114773131 learned_addr learned my addr 172.21.15.106:0/2114773131 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda6d9d640 1 --1- 172.21.15.106:0/2114773131 >> v1:172.21.15.106:6793/0 conn(0x7fcda806eed0 0x7fcda813c920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45462/0 (socket says 172.21.15.106:45462) 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2933899321 0 0) 0x7fcda8071e00 con 0x7fcda806e3e0 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): my global_id is 274468 2024-04-26T00:13:25.065 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd88003530 con 0x7fcda806e3e0 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1337024771 0 0) 0x7fcda80709c0 con 0x7fcda806eed0 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): my global_id is 225260 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcda8071e00 con 0x7fcda806eed0 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 49273084 0 0) 0x7fcda00014a0 con 0x7fcda806fba0 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient(hunting): my global_id is 254720 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcda80709c0 con 0x7fcda806fba0 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1958495173 0 0) 0x7fcd88003530 con 0x7fcda806e3e0 2024-04-26T00:13:25.066 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 >> v1:172.21.15.106:6793/0 conn(0x7fcda806eed0 legacy=0x7fcda813c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 >> v1:172.21.15.106:6790/0 conn(0x7fcda806fba0 legacy=0x7fcda81391f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 monclient: found mon.noname-c 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda8070ca0 con 0x7fcda806e3e0 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd980017c0 con 0x7fcda806e3e0 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 5 monclient: authenticate success, global_id 274468 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: dump: 2024-04-26T00:13:25.067 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.068 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd980019f0 con 0x7fcda806e3e0 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 1 -- 172.21.15.106:0/2114773131 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd98001c60 con 0x7fcda806e3e0 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 4 set_mon_vals no callback set 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda559a640 10 monclient: dump: 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.069 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: shutdown 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- 172.21.15.106:0/2114773131 >> v1:172.21.15.106:6791/0 conn(0x7fcda806e3e0 legacy=0x7fcda806e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- 172.21.15.106:0/2114773131 shutdown_connections 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- 172.21.15.106:0/2114773131 >> 172.21.15.106:0/2114773131 conn(0x7fcda80a64e0 msgr2=0x7fcda80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- 172.21.15.106:0/2114773131 shutdown_connections 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- 172.21.15.106:0/2114773131 wait complete. 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: monmap: 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.071 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 Processor -- start 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- start start 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: init 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient: _add_conns ranks=[4,1,7,0,3,6,8,5,2] 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): picked mon.noname-c con 0x7fcda806e3e0 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): picked mon.noname-f con 0x7fcda806eed0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): picked mon.noname-i con 0x7fcda806fba0 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:25.072 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda813d7d0 con 0x7fcda806eed0 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda813b750 con 0x7fcda806e3e0 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcda813c2b0 con 0x7fcda806fba0 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcdacbaa640 10 monclient(hunting): authenticate will time out at 2060.615526s 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda659c640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fcda806e3e0 0x7fcda8132400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:50726/0 (socket says 172.21.15.106:50726) 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcda659c640 1 -- 172.21.15.106:0/4071443950 learned_addr learned my addr 172.21.15.106:0/4071443950 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 979332210 0 0) 0x7fcda813b750 con 0x7fcda806e3e0 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcd9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcd9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcd9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcd9effd640 10 monclient(hunting): my global_id is 274477 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.082+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd8c003530 con 0x7fcda806e3e0 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1550787537 0 0) 0x7fcd8c003530 con 0x7fcda806e3e0 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcda813b750 con 0x7fcda806e3e0 2024-04-26T00:13:25.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd98001780 con 0x7fcda806e3e0 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): dump: 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.074 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 772915638 0 0) 0x7fcda813b750 con 0x7fcda806e3e0 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.171:6792/0 conn(0x7fcda806fba0 legacy=0x7fcda81d2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.171:6789/0 conn(0x7fcda806eed0 legacy=0x7fcda81cf3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 monclient: found mon.c 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcda813d4f0 con 0x7fcda806e3e0 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 5 monclient: authenticate success, global_id 274477 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 10 monclient: _renew_subs 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcda813dab0 con 0x7fcda806e3e0 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 10 monclient: _renew_subs 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fcda813aca0 con 0x7fcda806e3e0 2024-04-26T00:13:25.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcd980019f0 con 0x7fcda806e3e0 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcd98005280 con 0x7fcda806e3e0 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcda4d99640 4 set_mon_vals no callback set 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: dump: 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.077 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcd800065d0 con 0x7fcd80002870 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fcd98010020 con 0x7fcda806e3e0 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fcd98045390 con 0x7fcda806e3e0 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2714373612 0 0) 0x7fcd800065d0 con 0x7fcd80002870 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient(hunting): my global_id is 274486 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcda813b750 con 0x7fcd80002870 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3698360522 0 0) 0x7fcda813b750 con 0x7fcd80002870 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd800065d0 con 0x7fcd80002870 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcda0001970 con 0x7fcd80002870 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: dump: 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.079 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcda6d9d640 10 monclient: get_auth_request con 0x7fcd8c037780 auth_method 0 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 242084671 0 0) 0x7fcd800065d0 con 0x7fcd80002870 2024-04-26T00:13:25.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd8000a160 con 0x7fcd80002870 2024-04-26T00:13:25.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcda0001e20 con 0x7fcd80002870 2024-04-26T00:13:25.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:25.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.106:6791/0 conn(0x7fcd80002870 legacy=0x7fcd80004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.086+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.106:6791/0 conn(0x7fcd80002870 legacy=0x7fcd80004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcd80009e30 con 0x7fcd800090f0 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3573534762 0 0) 0x7fcd80009e30 con 0x7fcd800090f0 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient(hunting): my global_id is 274495 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcd800065d0 con 0x7fcd800090f0 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1891211693 0 0) 0x7fcd800065d0 con 0x7fcd800090f0 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcd80009e30 con 0x7fcd800090f0 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fcda0004f30 con 0x7fcd800090f0 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient: dump: 2024-04-26T00:13:25.083 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.084 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 364035777 0 0) 0x7fcd80009e30 con 0x7fcd800090f0 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcd8000c3a0 con 0x7fcd800090f0 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 805487730) 0x7fcda0007260 con 0x7fcd800090f0 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.106:6791/0 conn(0x7fcd800090f0 legacy=0x7fcd80009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcd9effd640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.106:6791/0 conn(0x7fcd800090f0 legacy=0x7fcd80009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:25.085 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 153173, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:25.086 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.087 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.088 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:25.089 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.090 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:25.091 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.092 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:25.093 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.094 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.095 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.096 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.097 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:25.098 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.099 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.101 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.102 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:25.103 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.171:6812/722422047 conn(0x7fcd8c037780 legacy=0x7fcd8c039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 10 monclient: shutdown 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 >> v1:172.21.15.106:6791/0 conn(0x7fcda806e3e0 legacy=0x7fcda8132400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcda6d9d640 1 -- 172.21.15.106:0/4071443950 reap_dead start 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcda6d9d640 1 -- 172.21.15.106:0/4071443950 reap_dead start 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 shutdown_connections 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 >> 172.21.15.106:0/4071443950 conn(0x7fcda80a64e0 msgr2=0x7fcda80a4f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 shutdown_connections 2024-04-26T00:13:25.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.094+0000 7fcdacbaa640 1 -- 172.21.15.106:0/4071443950 wait complete. 2024-04-26T00:13:25.106 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:25.106 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:13:25.106 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: get_monmap_and_config 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: monmap: 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:25.246994+0000 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:25.246994+0000 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.217 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.218 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 Processor -- start 2024-04-26T00:13:25.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- start start 2024-04-26T00:13:25.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: init 2024-04-26T00:13:25.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: _add_conns ranks=[8,5,7,2,6,4,3,0,1] 2024-04-26T00:13:25.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient(hunting): picked mon.noname-e con 0x7f40a00a1c30 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient(hunting): picked mon.noname-h con 0x7f40a00a2010 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient(hunting): picked mon.noname-i con 0x7f40a013dc40 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a009c5b0 con 0x7f40a00a2010 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a009c2d0 con 0x7f40a013dc40 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a00a3a70 con 0x7f40a00a1c30 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient(hunting): authenticate will time out at 2060.774187s 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409ffff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f40a00a1c30 0x7f40a009aef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45464/0 (socket says 172.21.15.106:45464) 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409ffff640 1 -- 172.21.15.106:0/2325674536 learned_addr learned my addr 172.21.15.106:0/2325674536 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2069228842 0 0) 0x7f40a00a3a70 con 0x7f40a00a1c30 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.226 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient(hunting): my global_id is 225269 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f408c003530 con 0x7f40a00a1c30 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 50810384 0 0) 0x7f408c003530 con 0x7f40a00a1c30 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 >> v1:172.21.15.171:6792/0 conn(0x7f40a013dc40 legacy=0x7f40a0140030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 >> v1:172.21.15.171:6791/0 conn(0x7f40a00a2010 legacy=0x7f40a00a23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 monclient: found mon.noname-e 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a0144780 con 0x7f40a00a1c30 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f40900017c0 con 0x7f40a00a1c30 2024-04-26T00:13:25.227 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: dump: 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.228 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 5 monclient: authenticate success, global_id 225269 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4090001b20 con 0x7f40a00a1c30 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 1 -- 172.21.15.106:0/2325674536 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4090004bf0 con 0x7f40a00a1c30 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 4 set_mon_vals no callback set 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f409effd640 10 monclient: dump: 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.229 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.230 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 10 monclient: shutdown 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- 172.21.15.106:0/2325674536 >> v1:172.21.15.106:6793/0 conn(0x7f40a00a1c30 legacy=0x7f40a009aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- 172.21.15.106:0/2325674536 shutdown_connections 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- 172.21.15.106:0/2325674536 >> 172.21.15.106:0/2325674536 conn(0x7f40a00a2d20 msgr2=0x7f40a00a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- 172.21.15.106:0/2325674536 shutdown_connections 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.242+0000 7f40a6580640 1 -- 172.21.15.106:0/2325674536 wait complete. 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: monmap: 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.231 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 Processor -- start 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 -- start start 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: init 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: _add_conns ranks=[0,4,8,2,7,3,6,5,1] 2024-04-26T00:13:25.232 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient(hunting): picked mon.noname-a con 0x7f40a00a1c30 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient(hunting): picked mon.noname-c con 0x7f40a00a2010 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient(hunting): picked mon.noname-e con 0x7f40a013dc40 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a013ff60 con 0x7f40a00a1c30 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a011cef0 con 0x7f40a00a2010 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40a011d1b0 con 0x7f40a013dc40 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient(hunting): authenticate will time out at 2060.777099s 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a4b1d640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f40a013dc40 0x7f40a01d48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:45476/0 (socket says 172.21.15.106:45476) 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409ffff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f40a00a1c30 0x7f40a011e9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:44298/0 (socket says 172.21.15.106:44298) 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a4b1d640 1 -- 172.21.15.106:0/3829834931 learned_addr learned my addr 172.21.15.106:0/3829834931 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1991710615 0 0) 0x7f40a013ff60 con 0x7f40a00a1c30 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.233 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): my global_id is 274428 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4080003530 con 0x7f40a00a1c30 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725049692 0 0) 0x7f40a011cef0 con 0x7f40a00a2010 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): my global_id is 274504 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a013ff60 con 0x7f40a00a2010 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1035835257 0 0) 0x7f40a011d1b0 con 0x7f40a013dc40 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): my global_id is 225278 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a011cef0 con 0x7f40a013dc40 2024-04-26T00:13:25.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1949747759 0 0) 0x7f4080003530 con 0x7f40a00a1c30 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40a011d1b0 con 0x7f40a00a1c30 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4090001780 con 0x7f40a00a1c30 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): dump: 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.235 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2121307853 0 0) 0x7f40a013ff60 con 0x7f40a00a2010 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4080003530 con 0x7f40a00a2010 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3099084189 0 0) 0x7f40a011cef0 con 0x7f40a013dc40 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40a013ff60 con 0x7f40a013dc40 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4098001ce0 con 0x7f40a00a2010 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): dump: 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.237 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4088001840 con 0x7f40a013dc40 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): dump: 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.238 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2509042653 0 0) 0x7f40a011d1b0 con 0x7f40a00a1c30 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.106:6793/0 conn(0x7f40a013dc40 legacy=0x7f40a01d48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.106:6791/0 conn(0x7f40a00a2010 legacy=0x7f40a011f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 monclient: found mon.a 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40a011d490 con 0x7f40a00a1c30 2024-04-26T00:13:25.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 5 monclient: authenticate success, global_id 274428 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: _renew_subs 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f40a011e460 con 0x7f40a00a1c30 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: _renew_subs 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f40a013f420 con 0x7f40a00a1c30 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4090001b20 con 0x7f40a00a1c30 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4090004c10 con 0x7f40a00a1c30 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409e7fc640 4 set_mon_vals no callback set 2024-04-26T00:13:25.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: dump: 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.241 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f40840065d0 con 0x7f4084002870 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f409000fdb0 con 0x7f40a00a1c30 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f4090045140 con 0x7f40a00a1c30 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4221278861 0 0) 0x7f40840065d0 con 0x7f4084002870 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient(hunting): my global_id is 254652 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40a011d1b0 con 0x7f4084002870 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f40a4b1d640 10 monclient: get_auth_request con 0x7f4080038210 auth_method 0 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2913270015 0 0) 0x7f40a011d1b0 con 0x7f4084002870 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f40840065d0 con 0x7f4084002870 2024-04-26T00:13:25.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4098003cc0 con 0x7f4084002870 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 10 monclient: dump: 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.243 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2276955850 0 0) 0x7f40840065d0 con 0x7f4084002870 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.246+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f408400a160 con 0x7f4084002870 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.250+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f40980049d0 con 0x7f4084002870 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.250+0000 7f409cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.250+0000 7f409cff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.250+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.106:6792/0 conn(0x7f4084002870 legacy=0x7f4084004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.250+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.106:6792/0 conn(0x7f4084002870 legacy=0x7f4084004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:25.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4084009e30 con 0x7f40840090f0 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976693960 0 0) 0x7f4084009e30 con 0x7f40840090f0 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient(hunting): my global_id is 254661 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f40840065d0 con 0x7f40840090f0 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3565810376 0 0) 0x7f40840065d0 con 0x7f40840090f0 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4084009e30 con 0x7f40840090f0 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f4098004580 con 0x7f40840090f0 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient: dump: 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.246 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2963434115 0 0) 0x7f4084009e30 con 0x7f40840090f0 2024-04-26T00:13:25.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f408400c3a0 con 0x7f40840090f0 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 2336650441) 0x7f4098004b80 con 0x7f40840090f0 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.106:6792/0 conn(0x7f40840090f0 legacy=0x7f4084009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f409cff9640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.106:6792/0 conn(0x7f40840090f0 legacy=0x7f4084009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:25.248 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 275315, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 5, 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:25.249 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.250 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.253 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.254 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:25.255 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.256 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.257 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.258 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:25.259 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.260 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.261 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.263 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.266 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.267 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.268 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:25.269 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:25.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.171:6812/722422047 conn(0x7f4080038210 legacy=0x7f408003a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 10 monclient: shutdown 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 >> v1:172.21.15.106:6789/0 conn(0x7f40a00a1c30 legacy=0x7f40a011e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a4b1d640 1 -- 172.21.15.106:0/3829834931 reap_dead start 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a4b1d640 1 -- 172.21.15.106:0/3829834931 reap_dead start 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 shutdown_connections 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 >> 172.21.15.106:0/3829834931 conn(0x7f40a00a2d20 msgr2=0x7f40a00a49b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 shutdown_connections 2024-04-26T00:13:25.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.254+0000 7f40a6580640 1 -- 172.21.15.106:0/3829834931 wait complete. 2024-04-26T00:13:25.271 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:25.272 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:13:25.272 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:13:25.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: get_monmap_and_config 2024-04-26T00:13:25.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: monmap: 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:25.418404+0000 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:25.418404+0000 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.389 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.390 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 Processor -- start 2024-04-26T00:13:25.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- start start 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: init 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: _add_conns ranks=[7,6,8,1,2,3,5,0,4] 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient(hunting): picked mon.noname-i con 0x7f2588135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient(hunting): picked mon.noname-d con 0x7f25881353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient(hunting): picked mon.noname-e con 0x7f258813bdf0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258806f2d0 con 0x7f25881353b0 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2588072330 con 0x7f2588135870 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2588072610 con 0x7f258813bdf0 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient(hunting): authenticate will time out at 2060.945562s 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258d01e640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f25881353b0 0x7f258813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46490/0 (socket says 172.21.15.106:46490) 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258d01e640 1 -- 172.21.15.106:0/1829560528 learned_addr learned my addr 172.21.15.106:0/1829560528 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3450264917 0 0) 0x7f258806f2d0 con 0x7f25881353b0 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): my global_id is 254670 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2574003530 con 0x7f25881353b0 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2686828148 0 0) 0x7f2588072610 con 0x7f258813bdf0 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient(hunting): my global_id is 225287 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258806f2d0 con 0x7f258813bdf0 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2146054792 0 0) 0x7f2574003530 con 0x7f25881353b0 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 >> v1:172.21.15.106:6793/0 conn(0x7f258813bdf0 legacy=0x7f258813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 >> v1:172.21.15.171:6792/0 conn(0x7f2588135870 legacy=0x7f2588135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 monclient: found mon.noname-d 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25880a3260 con 0x7f25881353b0 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f25780017c0 con 0x7f25881353b0 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: dump: 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.399 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 5 monclient: authenticate success, global_id 254670 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:25.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2578001ae0 con 0x7f25881353b0 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 1 -- 172.21.15.106:0/1829560528 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2578004bf0 con 0x7f25881353b0 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258c81d640 10 monclient: dump: 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.401 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 4 set_mon_vals no callback set 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: shutdown 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- 172.21.15.106:0/1829560528 >> v1:172.21.15.106:6792/0 conn(0x7f25881353b0 legacy=0x7f258813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- 172.21.15.106:0/1829560528 shutdown_connections 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- 172.21.15.106:0/1829560528 >> 172.21.15.106:0/1829560528 conn(0x7f25880a64e0 msgr2=0x7f25880a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- 172.21.15.106:0/1829560528 shutdown_connections 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 1 -- 172.21.15.106:0/1829560528 wait complete. 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.414+0000 7f258fa83640 10 monclient: monmap: 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.403 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 Processor -- start 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 -- start start 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient: init 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient: _add_conns ranks=[2,1,4,3,6,7,8,0,5] 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient(hunting): picked mon.noname-b con 0x7f25881353b0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient(hunting): picked mon.noname-f con 0x7f2588135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient(hunting): picked mon.noname-c con 0x7f258813bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2588134f80 con 0x7f2588135870 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258809f930 con 0x7f25881353b0 2024-04-26T00:13:25.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258809f470 con 0x7f258813bdf0 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient(hunting): authenticate will time out at 2060.948974s 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258d81f640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f25881353b0 0x7f258813b080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:52922/0 (socket says 172.21.15.106:52922) 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258d81f640 1 -- 172.21.15.106:0/4129818434 learned_addr learned my addr 172.21.15.106:0/4129818434 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3582688263 0 0) 0x7f258809f470 con 0x7f258813bdf0 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): my global_id is 274513 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f256c003530 con 0x7f258813bdf0 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773322167 0 0) 0x7f258809f930 con 0x7f25881353b0 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): my global_id is 254729 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258809f470 con 0x7f25881353b0 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3548606630 0 0) 0x7f258809f470 con 0x7f25881353b0 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f258809f930 con 0x7f25881353b0 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2584001a40 con 0x7f25881353b0 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): dump: 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.406 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1995726145 0 0) 0x7f256c003530 con 0x7f258813bdf0 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f258809f470 con 0x7f258813bdf0 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2580001d40 con 0x7f258813bdf0 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): dump: 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.408 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3537969895 0 0) 0x7f2588134f80 con 0x7f2588135870 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): my global_id is 225433 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f256c003530 con 0x7f2588135870 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 993437110 0 0) 0x7f258809f930 con 0x7f25881353b0 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.106:6791/0 conn(0x7f258813bdf0 legacy=0x7f25881d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.171:6789/0 conn(0x7f2588135870 legacy=0x7f25881cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 monclient: found mon.b 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2588134ca0 con 0x7f25881353b0 2024-04-26T00:13:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 5 monclient: authenticate success, global_id 254729 2024-04-26T00:13:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient: _renew_subs 2024-04-26T00:13:25.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2588133820 con 0x7f25881353b0 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient: _renew_subs 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f258813b960 con 0x7f25881353b0 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2584003950 con 0x7f25881353b0 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2584003ec0 con 0x7f25881353b0 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257ffff640 4 set_mon_vals no callback set 2024-04-26T00:13:25.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: dump: 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.412 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f25700065d0 con 0x7f2570002870 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2584004060 con 0x7f25881353b0 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f25840451e0 con 0x7f25881353b0 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2600444630 0 0) 0x7f25700065d0 con 0x7f2570002870 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient(hunting): my global_id is 225296 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258809f930 con 0x7f2570002870 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2099093243 0 0) 0x7f258809f930 con 0x7f2570002870 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f25700065d0 con 0x7f2570002870 2024-04-26T00:13:25.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2578001440 con 0x7f2570002870 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: dump: 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f258e020640 10 monclient: get_auth_request con 0x7f256c037f50 auth_method 0 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 604102363 0 0) 0x7f25700065d0 con 0x7f2570002870 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f257000a160 con 0x7f2570002870 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2578001770 con 0x7f2570002870 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.106:6793/0 conn(0x7f2570002870 legacy=0x7f2570004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.415 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.418+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.106:6793/0 conn(0x7f2570002870 legacy=0x7f2570004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2570009e50 con 0x7f2570009110 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4073444260 0 0) 0x7f2570009e50 con 0x7f2570009110 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient(hunting): my global_id is 225305 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25700065d0 con 0x7f2570009110 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3542018924 0 0) 0x7f25700065d0 con 0x7f2570009110 2024-04-26T00:13:25.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2570009e50 con 0x7f2570009110 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2578005000 con 0x7f2570009110 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient: dump: 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.418 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 111141135 0 0) 0x7f2570009e50 con 0x7f2570009110 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f257000c3e0 con 0x7f2570009110 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 1281410458) 0x7f2578007240 con 0x7f2570009110 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.106:6793/0 conn(0x7f2570009110 legacy=0x7f25700095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f257e7fc640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.106:6793/0 conn(0x7f2570009110 legacy=0x7f25700095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 518658, 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:25.420 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.421 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.422 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:25.423 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.424 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:25.425 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.426 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.428 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.429 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.430 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:25.432 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.435 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.437 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.438 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.439 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:25.439 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.171:6812/722422047 conn(0x7f256c037f50 legacy=0x7f256c03a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 10 monclient: shutdown 2024-04-26T00:13:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 >> v1:172.21.15.106:6790/0 conn(0x7f25881353b0 legacy=0x7f258813b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258e020640 1 -- 172.21.15.106:0/4129818434 reap_dead start 2024-04-26T00:13:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258e020640 1 -- 172.21.15.106:0/4129818434 reap_dead start 2024-04-26T00:13:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 shutdown_connections 2024-04-26T00:13:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 >> 172.21.15.106:0/4129818434 conn(0x7f25880a64e0 msgr2=0x7f25880a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 shutdown_connections 2024-04-26T00:13:25.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.426+0000 7f258fa83640 1 -- 172.21.15.106:0/4129818434 wait complete. 2024-04-26T00:13:25.441 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:25.441 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:13:25.441 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:13:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: get_monmap_and_config 2024-04-26T00:13:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: monmap: 2024-04-26T00:13:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:25.586953+0000 2024-04-26T00:13:25.557 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:25.586953+0000 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.558 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 Processor -- start 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- start start 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: init 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: _add_conns ranks=[8,4,2,0,3,1,6,5,7] 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient(hunting): picked mon.noname-e con 0x7f2f2c134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient(hunting): picked mon.noname-c con 0x7f2f2c0725d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient(hunting): picked mon.noname-b con 0x7f2f2c13ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c071270 con 0x7f2f2c13ace0 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c0714e0 con 0x7f2f2c0725d0 2024-04-26T00:13:25.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c0729f0 con 0x7f2f2c134820 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient(hunting): authenticate will time out at 2061.114152s 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f2a7fc640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f2f2c0725d0 0x7f2f2c1395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:52522/0 (socket says 172.21.15.106:52522) 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f2a7fc640 1 -- 172.21.15.106:0/1980147593 learned_addr learned my addr 172.21.15.106:0/1980147593 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 158760471 0 0) 0x7f2f2c0729f0 con 0x7f2f2c134820 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): my global_id is 225314 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f18003530 con 0x7f2f2c134820 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354775487 0 0) 0x7f2f14001050 con 0x7f2f2c0725d0 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): my global_id is 274522 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f2c0729f0 con 0x7f2f2c0725d0 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3793477006 0 0) 0x7f2f2c071270 con 0x7f2f2c13ace0 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient(hunting): my global_id is 254738 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f14001050 con 0x7f2f2c13ace0 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1298854462 0 0) 0x7f2f18003530 con 0x7f2f2c134820 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 >> v1:172.21.15.106:6791/0 conn(0x7f2f2c0725d0 legacy=0x7f2f2c1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 >> v1:172.21.15.106:6790/0 conn(0x7f2f2c13ace0 legacy=0x7f2f2c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 monclient: found mon.noname-e 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c0717c0 con 0x7f2f2c134820 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f24001ad0 con 0x7f2f2c134820 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: dump: 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.573 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.574 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 5 monclient: authenticate success, global_id 225314 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f24001da0 con 0x7f2f2c134820 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 1 -- 172.21.15.106:0/1980147593 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f24003ce0 con 0x7f2f2c134820 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f29ffb640 10 monclient: dump: 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.575 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:25.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 4 set_mon_vals no callback set 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 10 monclient: shutdown 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- 172.21.15.106:0/1980147593 >> v1:172.21.15.106:6793/0 conn(0x7f2f2c134820 legacy=0x7f2f2c134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- 172.21.15.106:0/1980147593 shutdown_connections 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- 172.21.15.106:0/1980147593 >> 172.21.15.106:0/1980147593 conn(0x7f2f2c0a64e0 msgr2=0x7f2f2c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- 172.21.15.106:0/1980147593 shutdown_connections 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.582+0000 7f2f318bb640 1 -- 172.21.15.106:0/1980147593 wait complete. 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: monmap: 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.577 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 Processor -- start 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 -- start start 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: init 2024-04-26T00:13:25.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: _add_conns ranks=[6,2,4,8,1,3,5,7,0] 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient(hunting): picked mon.noname-d con 0x7f2f2c0725d0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient(hunting): picked mon.noname-b con 0x7f2f2c134820 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient(hunting): picked mon.noname-c con 0x7f2f2c13ace0 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c135500 con 0x7f2f2c134820 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c09e8c0 con 0x7f2f2c13ace0 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f2c135220 con 0x7f2f2c0725d0 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient(hunting): authenticate will time out at 2061.117269s 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f2a7fc640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f2f2c134820 0x7f2f2c1cd3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55986/0 (socket says 172.21.15.106:55986) 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f2a7fc640 1 -- 172.21.15.106:0/1435388149 learned_addr learned my addr 172.21.15.106:0/1435388149 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126623881 0 0) 0x7f2f2c135500 con 0x7f2f2c134820 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): my global_id is 254747 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f0c003530 con 0x7f2f2c134820 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2283252185 0 0) 0x7f2f2c135220 con 0x7f2f2c0725d0 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): my global_id is 254679 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f2c135500 con 0x7f2f2c0725d0 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1344437351 0 0) 0x7f2f2c09e8c0 con 0x7f2f2c13ace0 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): my global_id is 274531 2024-04-26T00:13:25.580 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f2c135220 con 0x7f2f2c13ace0 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 465836828 0 0) 0x7f2f0c003530 con 0x7f2f2c134820 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f2c09e8c0 con 0x7f2f2c134820 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f14001580 con 0x7f2f2c134820 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): dump: 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.581 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 171532183 0 0) 0x7f2f2c135500 con 0x7f2f2c0725d0 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f0c003530 con 0x7f2f2c0725d0 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 763665837 0 0) 0x7f2f2c135220 con 0x7f2f2c13ace0 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f2c135500 con 0x7f2f2c13ace0 2024-04-26T00:13:25.582 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f1c001770 con 0x7f2f2c13ace0 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): dump: 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.583 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f24001ad0 con 0x7f2f2c0725d0 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient(hunting): dump: 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.584 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4243558602 0 0) 0x7f2f2c09e8c0 con 0x7f2f2c134820 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.106:6792/0 conn(0x7f2f2c0725d0 legacy=0x7f2f2c12c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.585 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.106:6791/0 conn(0x7f2f2c13ace0 legacy=0x7f2f2c1d0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 monclient: found mon.b 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c09e640 con 0x7f2f2c134820 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 5 monclient: authenticate success, global_id 254747 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: _renew_subs 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c135ee0 con 0x7f2f2c134820 2024-04-26T00:13:25.586 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: _renew_subs 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f2c09d270 con 0x7f2f2c134820 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f14004aa0 con 0x7f2f2c134820 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f14004f90 con 0x7f2f2c134820 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f297fa640 4 set_mon_vals no callback set 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 10 monclient: dump: 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.587 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.588 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f100065d0 con 0x7f2f10002870 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2f1400fd30 con 0x7f2f2c134820 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f2f14045280 con 0x7f2f2c134820 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.586+0000 7f2f2b7fe640 10 monclient: get_auth_request con 0x7f2f0c0382f0 auth_method 0 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2348511522 0 0) 0x7f2f100065d0 con 0x7f2f10002870 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient(hunting): my global_id is 225442 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f2c09e8c0 con 0x7f2f10002870 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 941695031 0 0) 0x7f2f2c09e8c0 con 0x7f2f10002870 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f100065d0 con 0x7f2f10002870 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f24002040 con 0x7f2f10002870 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.589 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient: dump: 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.590 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3856387186 0 0) 0x7f2f100065d0 con 0x7f2f10002870 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2f1000a160 con 0x7f2f10002870 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2f240060b0 con 0x7f2f10002870 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.171:6789/0 conn(0x7f2f10002870 legacy=0x7f2f10004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.591 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.590+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.171:6789/0 conn(0x7f2f10002870 legacy=0x7f2f10004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.594+0000 7f2f318bb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.594+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2f10009e50 con 0x7f2f10009110 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3215159449 0 0) 0x7f2f10009e50 con 0x7f2f10009110 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient(hunting): my global_id is 225451 2024-04-26T00:13:25.593 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f100065d0 con 0x7f2f10009110 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 119926824 0 0) 0x7f2f100065d0 con 0x7f2f10009110 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f10009e50 con 0x7f2f10009110 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2f240046a0 con 0x7f2f10009110 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient: dump: 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.594 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 359751893 0 0) 0x7f2f10009e50 con 0x7f2f10009110 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2f1000c3e0 con 0x7f2f10009110 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 846037397) 0x7f2f24009170 con 0x7f2f10009110 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.171:6789/0 conn(0x7f2f10009110 legacy=0x7f2f100095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.595 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f23fff640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.171:6789/0 conn(0x7f2f10009110 legacy=0x7f2f100095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 518830, 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:25.596 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.597 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.598 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:25.599 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.600 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:25.601 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.602 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.603 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.604 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.605 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.606 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.607 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.608 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.609 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.610 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.611 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.612 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.613 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.614 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.615 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:25.616 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.171:6812/722422047 conn(0x7f2f0c0382f0 legacy=0x7f2f0c03a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 10 monclient: shutdown 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 >> v1:172.21.15.106:6790/0 conn(0x7f2f2c134820 legacy=0x7f2f2c1cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f2b7fe640 1 -- 172.21.15.106:0/1435388149 reap_dead start 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f2b7fe640 1 -- 172.21.15.106:0/1435388149 reap_dead start 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 shutdown_connections 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 >> 172.21.15.106:0/1435388149 conn(0x7f2f2c0a64e0 msgr2=0x7f2f2c0a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 shutdown_connections 2024-04-26T00:13:25.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.598+0000 7f2f318bb640 1 -- 172.21.15.106:0/1435388149 wait complete. 2024-04-26T00:13:25.619 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:25.619 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:13:25.619 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:13:25.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: get_monmap_and_config 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: monmap: 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:25.759736+0000 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:25.759736+0000 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.730 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.731 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.731 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.731 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.731 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.731 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.731 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 1 Processor -- start 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 1 -- start start 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: init 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: _add_conns ranks=[5,1,4,3,2,8,7,0,6] 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient(hunting): picked mon.noname-h con 0x7f89b4134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient(hunting): picked mon.noname-f con 0x7f89b40a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient(hunting): picked mon.noname-c con 0x7f89b413e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b406dd40 con 0x7f89b40a4820 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b40a2b10 con 0x7f89b413e200 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b40a2df0 con 0x7f89b4134970 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient(hunting): authenticate will time out at 2061.286624s 2024-04-26T00:13:25.739 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b8879640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f89b413e200 0x7f89b41405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:52530/0 (socket says 172.21.15.106:52530) 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b8879640 1 -- 172.21.15.106:0/2518074256 learned_addr learned my addr 172.21.15.106:0/2518074256 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1835606836 0 0) 0x7f89b40a2b10 con 0x7f89b413e200 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient(hunting): my global_id is 274540 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f899c003530 con 0x7f89b413e200 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2849343921 0 0) 0x7f899c003530 con 0x7f89b413e200 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 >> v1:172.21.15.171:6791/0 conn(0x7f89b4134970 legacy=0x7f89b4134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 >> v1:172.21.15.171:6789/0 conn(0x7f89b40a4820 legacy=0x7f89b413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 monclient: found mon.noname-c 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:13:25.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b40a30d0 con 0x7f89b413e200 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 5 monclient: authenticate success, global_id 274540 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89ac001b40 con 0x7f89b413e200 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: dump: 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.741 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89ac001e30 con 0x7f89b413e200 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:25.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 4 set_mon_vals no callback set 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 1 -- 172.21.15.106:0/2518074256 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89ac004f70 con 0x7f89b413e200 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89b2ffd640 10 monclient: dump: 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 10 monclient: shutdown 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.754+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2518074256 >> v1:172.21.15.106:6791/0 conn(0x7f89b413e200 legacy=0x7f89b41405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2518074256 shutdown_connections 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2518074256 >> 172.21.15.106:0/2518074256 conn(0x7f89b40a9e20 msgr2=0x7f89b40aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2518074256 shutdown_connections 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2518074256 wait complete. 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: monmap: 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.744 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 Processor -- start 2024-04-26T00:13:25.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- start start 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: init 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: _add_conns ranks=[1,6,0,2,3,5,8,4,7] 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient(hunting): picked mon.noname-f con 0x7f89b40a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient(hunting): picked mon.noname-d con 0x7f89b4134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient(hunting): picked mon.noname-a con 0x7f89b413e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b4138cc0 con 0x7f89b413e200 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b4138fa0 con 0x7f89b40a4820 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89b4133a90 con 0x7f89b4134970 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient(hunting): authenticate will time out at 2061.289649s 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b8879640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f89b413e200 0x7f89b41d4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51928/0 (socket says 172.21.15.106:51928) 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b8879640 1 -- 172.21.15.106:0/2096620112 learned_addr learned my addr 172.21.15.106:0/2096620112 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b37fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f89b4134970 0x7f89b41d16a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46950/0 (socket says 172.21.15.106:46950) 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546628944 0 0) 0x7f89b4138cc0 con 0x7f89b413e200 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): my global_id is 274437 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89a0003530 con 0x7f89b413e200 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653681852 0 0) 0x7f89b4133a90 con 0x7f89b4134970 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): my global_id is 254688 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b4138cc0 con 0x7f89b4134970 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 910155498 0 0) 0x7f89b4138fa0 con 0x7f89b40a4820 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): my global_id is 225469 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b4133a90 con 0x7f89b40a4820 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 234641074 0 0) 0x7f89b4138cc0 con 0x7f89b4134970 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89b4138fa0 con 0x7f89b4134970 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3790999251 0 0) 0x7f89a0003530 con 0x7f89b413e200 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89b4138cc0 con 0x7f89b413e200 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89a80019e0 con 0x7f89b4134970 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.748 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89ac001b00 con 0x7f89b413e200 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.750 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1276430960 0 0) 0x7f89b4138fa0 con 0x7f89b4134970 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.171:6789/0 conn(0x7f89b40a4820 legacy=0x7f89b412a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.106:6789/0 conn(0x7f89b413e200 legacy=0x7f89b41d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 monclient: found mon.d 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89b40a1e00 con 0x7f89b4134970 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 5 monclient: authenticate success, global_id 254688 2024-04-26T00:13:25.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: _renew_subs 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f89b41382a0 con 0x7f89b4134970 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: _renew_subs 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f89b4139c60 con 0x7f89b4134970 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f89a80038d0 con 0x7f89b4134970 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89a8003e40 con 0x7f89b4134970 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b27fc640 4 set_mon_vals no callback set 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 10 monclient: dump: 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.752 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f89940065d0 con 0x7f8994002870 2024-04-26T00:13:25.753 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f89a8003fe0 con 0x7f89b4134970 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.758+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f89a8045030 con 0x7f89b4134970 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b8879640 10 monclient: get_auth_request con 0x7f89a0037f50 auth_method 0 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 779864625 0 0) 0x7f89940065d0 con 0x7f8994002870 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient(hunting): my global_id is 284214 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89b4138fa0 con 0x7f8994002870 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1781618276 0 0) 0x7f89b4138fa0 con 0x7f8994002870 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f89940065d0 con 0x7f8994002870 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89a4001930 con 0x7f8994002870 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient: dump: 2024-04-26T00:13:25.754 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.755 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1475935868 0 0) 0x7f89940065d0 con 0x7f8994002870 2024-04-26T00:13:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f899400a160 con 0x7f8994002870 2024-04-26T00:13:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f89a4001cd0 con 0x7f8994002870 2024-04-26T00:13:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.171:6790/0 conn(0x7f8994002870 legacy=0x7f8994004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.756 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.762+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.171:6790/0 conn(0x7f8994002870 legacy=0x7f8994004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.766+0000 7f89ba2dc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:25.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.766+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8994009e30 con 0x7f89940090f0 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20976067 0 0) 0x7f8994009e30 con 0x7f89940090f0 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient(hunting): my global_id is 284223 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89940065d0 con 0x7f89940090f0 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4224779746 0 0) 0x7f89940065d0 con 0x7f89940090f0 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8994009e30 con 0x7f89940090f0 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f89a4003bb0 con 0x7f89940090f0 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient: dump: 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.758 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.759 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 811201099 0 0) 0x7f8994009e30 con 0x7f89940090f0 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f899400c3a0 con 0x7f89940090f0 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2304605886) 0x7f89a4003e40 con 0x7f89940090f0 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.171:6790/0 conn(0x7f89940090f0 legacy=0x7f8994009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b0ff9640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.171:6790/0 conn(0x7f89940090f0 legacy=0x7f8994009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:25.760 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 31423, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-26T00:13:25.761 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.762 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.763 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:25.764 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.765 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:25.767 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.769 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.770 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:25.771 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.772 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.773 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.774 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.775 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.776 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.777 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:25.778 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.171:6812/722422047 conn(0x7f89a0037f50 legacy=0x7f89a003a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 10 monclient: shutdown 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 >> v1:172.21.15.106:6792/0 conn(0x7f89b4134970 legacy=0x7f89b41d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b8879640 1 -- 172.21.15.106:0/2096620112 reap_dead start 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89b8879640 1 -- 172.21.15.106:0/2096620112 reap_dead start 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 shutdown_connections 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 >> 172.21.15.106:0/2096620112 conn(0x7f89b40a9e20 msgr2=0x7f89b41354f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 shutdown_connections 2024-04-26T00:13:25.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.770+0000 7f89ba2dc640 1 -- 172.21.15.106:0/2096620112 wait complete. 2024-04-26T00:13:25.781 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:25.781 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:13:25.781 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:13:25.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.918+0000 7f6a2f90c640 10 monclient: get_monmap_and_config 2024-04-26T00:13:25.896 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.918+0000 7f6a2f90c640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.918+0000 7f6a2f90c640 10 monclient: monmap: 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:25.926271+0000 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:25.926271+0000 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.897 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.898 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.898 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.898 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.898 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 Processor -- start 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- start start 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient: init 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient: _add_conns ranks=[3,7,0,2,6,4,1,5,8] 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient(hunting): picked mon.noname-g con 0x7f6a280a5070 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient(hunting): picked mon.noname-i con 0x7f6a28072710 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient(hunting): picked mon.noname-a con 0x7f6a28072b70 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a28137d60 con 0x7f6a28072b70 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2806cf90 con 0x7f6a280a5070 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2806e240 con 0x7f6a28072710 2024-04-26T00:13:25.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient(hunting): authenticate will time out at 2061.453541s 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2dea9640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f6a28072b70 0x7f6a281400a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:51936/0 (socket says 172.21.15.106:51936) 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2dea9640 1 -- 172.21.15.106:0/3111634967 learned_addr learned my addr 172.21.15.106:0/3111634967 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196856323 0 0) 0x7f6a28137d60 con 0x7f6a28072b70 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): my global_id is 274446 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a14003530 con 0x7f6a28072b70 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 183038507 0 0) 0x7f6a2806cf90 con 0x7f6a280a5070 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.908 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient(hunting): my global_id is 284232 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a28137d60 con 0x7f6a280a5070 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 223086321 0 0) 0x7f6a14003530 con 0x7f6a28072b70 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 >> v1:172.21.15.171:6792/0 conn(0x7f6a28072710 legacy=0x7f6a2813c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 >> v1:172.21.15.171:6790/0 conn(0x7f6a280a5070 legacy=0x7f6a28137650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 monclient: found mon.noname-a 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a28070560 con 0x7f6a28072b70 2024-04-26T00:13:25.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 5 monclient: authenticate success, global_id 274446 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a20001b40 con 0x7f6a28072b70 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: dump: 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.910 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.911 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a20001df0 con 0x7f6a28072b70 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 4 set_mon_vals no callback set 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 1 -- 172.21.15.106:0/3111634967 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a20004f70 con 0x7f6a28072b70 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a1ffff640 10 monclient: dump: 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.912 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.913 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient: shutdown 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- 172.21.15.106:0/3111634967 >> v1:172.21.15.106:6789/0 conn(0x7f6a28072b70 legacy=0x7f6a281400a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- 172.21.15.106:0/3111634967 shutdown_connections 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- 172.21.15.106:0/3111634967 >> 172.21.15.106:0/3111634967 conn(0x7f6a280a83a0 msgr2=0x7f6a280a45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- 172.21.15.106:0/3111634967 shutdown_connections 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 1 -- 172.21.15.106:0/3111634967 wait complete. 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient: build_initial_monmap 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.922+0000 7f6a2f90c640 10 monclient: monmap: 2024-04-26T00:13:25.914 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:25.915 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 Processor -- start 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 -- start start 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient: init 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient: _add_conns ranks=[2,7,5,4,6,3,1,0,8] 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient(hunting): picked mon.noname-b con 0x7f6a28072710 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient(hunting): picked mon.noname-i con 0x7f6a28072b70 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient(hunting): picked mon.noname-h con 0x7f6a280a5070 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a28130770 con 0x7f6a28072710 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2806d9f0 con 0x7f6a280a5070 2024-04-26T00:13:25.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a2806d4c0 con 0x7f6a28072b70 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient(hunting): authenticate will time out at 2061.456614s 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2d6a8640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f6a28072710 0x7f6a2812f950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55992/0 (socket says 172.21.15.106:55992) 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2d6a8640 1 -- 172.21.15.106:0/1034460150 learned_addr learned my addr 172.21.15.106:0/1034460150 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2719479015 0 0) 0x7f6a28130770 con 0x7f6a28072710 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): my global_id is 254756 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a0c003530 con 0x7f6a28072710 2024-04-26T00:13:25.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2268530115 0 0) 0x7f6a0c003530 con 0x7f6a28072710 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a28130770 con 0x7f6a28072710 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a24001a60 con 0x7f6a28072710 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): dump: 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.918 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442736703 0 0) 0x7f6a2806d4c0 con 0x7f6a28072b70 2024-04-26T00:13:25.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): my global_id is 146815 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a0c003530 con 0x7f6a28072b70 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3624582218 0 0) 0x7f6a2806d9f0 con 0x7f6a280a5070 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): my global_id is 254633 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a2806d4c0 con 0x7f6a280a5070 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1683971987 0 0) 0x7f6a28130770 con 0x7f6a28072710 2024-04-26T00:13:25.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.171:6792/0 conn(0x7f6a28072b70 legacy=0x7f6a28130060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.171:6791/0 conn(0x7f6a280a5070 legacy=0x7f6a281d4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 monclient: found mon.b 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a281315a0 con 0x7f6a28072710 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: _finish_auth 0 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:25.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 5 monclient: authenticate success, global_id 254756 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient: _renew_subs 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6a28133890 con 0x7f6a28072710 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient: _renew_subs 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f6a28135220 con 0x7f6a28072710 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6a24003950 con 0x7f6a28072710 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a24003ec0 con 0x7f6a28072710 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1f7fe640 4 set_mon_vals no callback set 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: dump: 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.923 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6a080065d0 con 0x7f6a08002870 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6a240040e0 con 0x7f6a28072710 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f6a24045240 con 0x7f6a28072710 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a2dea9640 10 monclient: get_auth_request con 0x7f6a0c0379c0 auth_method 0 2024-04-26T00:13:25.924 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 45939548 0 0) 0x7f6a080065d0 con 0x7f6a08002870 2024-04-26T00:13:25.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient(hunting): my global_id is 254642 2024-04-26T00:13:25.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a28130770 con 0x7f6a08002870 2024-04-26T00:13:25.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3937619423 0 0) 0x7f6a28130770 con 0x7f6a08002870 2024-04-26T00:13:25.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a080065d0 con 0x7f6a08002870 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a180019c0 con 0x7f6a08002870 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 10 monclient: dump: 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.926 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1298359057 0 0) 0x7f6a080065d0 con 0x7f6a08002870 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.926+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6a0800a160 con 0x7f6a08002870 2024-04-26T00:13:25.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.930+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6a18003600 con 0x7f6a08002870 2024-04-26T00:13:25.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.930+0000 7f6a1dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:25.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.930+0000 7f6a1dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:25.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.930+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.171:6791/0 conn(0x7f6a08002870 legacy=0x7f6a08004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.930+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.171:6791/0 conn(0x7f6a08002870 legacy=0x7f6a08004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a2f90c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6a08009e30 con 0x7f6a080090f0 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 923786594 0 0) 0x7f6a08009e30 con 0x7f6a080090f0 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 10 monclient(hunting): my global_id is 254651 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6a080065d0 con 0x7f6a080090f0 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2904617679 0 0) 0x7f6a080065d0 con 0x7f6a080090f0 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6a08009e30 con 0x7f6a080090f0 2024-04-26T00:13:25.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6a18003ce0 con 0x7f6a080090f0 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 10 monclient: dump: 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:25.931 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2854980400 0 0) 0x7f6a08009e30 con 0x7f6a080090f0 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.934+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6a0800c3a0 con 0x7f6a080090f0 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 324235592) 0x7f6a18005110 con 0x7f6a080090f0 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a1dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a1dffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:25.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.171:6791/0 conn(0x7f6a080090f0 legacy=0x7f6a08009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a1dffb640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.171:6791/0 conn(0x7f6a080090f0 legacy=0x7f6a08009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:25.933 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:25.933 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:25.933 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:25.933 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:25.933 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:25.933 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 275990, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.934 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.935 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.936 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:25.937 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:25.938 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.939 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.940 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.941 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.942 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.943 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.944 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.945 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.946 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:25.947 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.948 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.949 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.950 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.951 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:25.952 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:25.953 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:25.954 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:25.955 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:25.955 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:25.955 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:25.955 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:25.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.171:6812/722422047 conn(0x7f6a0c0379c0 legacy=0x7f6a0c039e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 10 monclient: shutdown 2024-04-26T00:13:25.956 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 >> v1:172.21.15.106:6790/0 conn(0x7f6a28072710 legacy=0x7f6a2812f950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2dea9640 1 -- 172.21.15.106:0/1034460150 reap_dead start 2024-04-26T00:13:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2dea9640 1 -- 172.21.15.106:0/1034460150 reap_dead start 2024-04-26T00:13:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 shutdown_connections 2024-04-26T00:13:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 >> 172.21.15.106:0/1034460150 conn(0x7f6a280a83a0 msgr2=0x7f6a280a3380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 shutdown_connections 2024-04-26T00:13:25.957 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:25.938+0000 7f6a2f90c640 1 -- 172.21.15.106:0/1034460150 wait complete. 2024-04-26T00:13:25.957 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:25.957 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:13:25.958 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:13:26.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient: get_monmap_and_config 2024-04-26T00:13:26.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient: build_initial_monmap 2024-04-26T00:13:26.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient: monmap: 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:26.102976+0000 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:26.102976+0000 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:26.074 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:26.075 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:26.075 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 1 Processor -- start 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 1 -- start start 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient: init 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient: _add_conns ranks=[1,7,2,6,5,4,0,3,8] 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient(hunting): picked mon.noname-f con 0x7efe8c134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient(hunting): picked mon.noname-i con 0x7efe8c0a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient(hunting): picked mon.noname-b con 0x7efe8c13e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8c06dd40 con 0x7efe8c134970 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8c0a2b10 con 0x7efe8c13e200 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8c0a2df0 con 0x7efe8c0a4820 2024-04-26T00:13:26.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient(hunting): authenticate will time out at 2061.630430s 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe92aa8640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7efe8c13e200 0x7efe8c1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:55996/0 (socket says 172.21.15.106:55996) 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe92aa8640 1 -- 172.21.15.106:0/3097420592 learned_addr learned my addr 172.21.15.106:0/3097420592 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 751112449 0 0) 0x7efe8c0a2b10 con 0x7efe8c13e200 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): my global_id is 254765 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe78003530 con 0x7efe8c13e200 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2282581223 0 0) 0x7efe8c0a2df0 con 0x7efe8c0a4820 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): my global_id is 146824 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe8c0a2b10 con 0x7efe8c0a4820 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026166514 0 0) 0x7efe8c06dd40 con 0x7efe8c134970 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient(hunting): my global_id is 225478 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe8c0a2df0 con 0x7efe8c134970 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1052981740 0 0) 0x7efe78003530 con 0x7efe8c13e200 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 >> v1:172.21.15.171:6792/0 conn(0x7efe8c0a4820 legacy=0x7efe8c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 >> v1:172.21.15.171:6789/0 conn(0x7efe8c134970 legacy=0x7efe8c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: _finish_hunting 0 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 monclient: found mon.noname-b 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:26.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c0a30d0 con 0x7efe8c13e200 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: _finish_auth 0 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: _check_auth_tickets 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 5 monclient: authenticate success, global_id 254765 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe84001ac0 con 0x7efe8c13e200 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: dump: 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.085 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe84001d20 con 0x7efe8c13e200 2024-04-26T00:13:26.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 1 -- 172.21.15.106:0/3097420592 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe84004c30 con 0x7efe8c13e200 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe9450b640 4 set_mon_vals no callback set 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.098+0000 7efe912a5640 10 monclient: dump: 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.087 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: shutdown 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/3097420592 >> v1:172.21.15.106:6790/0 conn(0x7efe8c13e200 legacy=0x7efe8c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/3097420592 shutdown_connections 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/3097420592 >> 172.21.15.106:0/3097420592 conn(0x7efe8c0a9e20 msgr2=0x7efe8c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:26.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/3097420592 shutdown_connections 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/3097420592 wait complete. 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: build_initial_monmap 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: monmap: 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:26.089 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 Processor -- start 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- start start 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: init 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: _add_conns ranks=[8,1,3,6,7,2,5,0,4] 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient(hunting): picked mon.noname-e con 0x7efe8c0a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient(hunting): picked mon.noname-f con 0x7efe8c134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient(hunting): picked mon.noname-g con 0x7efe8c13e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:26.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8c0a1e00 con 0x7efe8c134970 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8c138c30 con 0x7efe8c13e200 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe8c138f10 con 0x7efe8c0a4820 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient(hunting): authenticate will time out at 2061.633600s 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe922a7640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7efe8c0a4820 0x7efe8c12abf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:43256/0 (socket says 172.21.15.106:43256) 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe922a7640 1 -- 172.21.15.106:0/4038299866 learned_addr learned my addr 172.21.15.106:0/4038299866 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3346489953 0 0) 0x7efe8c138f10 con 0x7efe8c0a4820 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): my global_id is 225323 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe70003530 con 0x7efe8c0a4820 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2681521721 0 0) 0x7efe70003530 con 0x7efe8c0a4820 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe8c138f10 con 0x7efe8c0a4820 2024-04-26T00:13:26.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe88001a60 con 0x7efe8c0a4820 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): dump: 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.092 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2926595016 0 0) 0x7efe8c138c30 con 0x7efe8c13e200 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): my global_id is 284241 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe70003530 con 0x7efe8c13e200 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2131653478 0 0) 0x7efe8c0a2b10 con 0x7efe8c134970 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): my global_id is 225487 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe8c138c30 con 0x7efe8c134970 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1723727882 0 0) 0x7efe8c138f10 con 0x7efe8c0a4820 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.171:6790/0 conn(0x7efe8c13e200 legacy=0x7efe8c1d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.171:6789/0 conn(0x7efe8c134970 legacy=0x7efe8c1d16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 monclient: found mon.e 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe8c0a1a40 con 0x7efe8c0a4820 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:26.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 5 monclient: authenticate success, global_id 225323 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: _renew_subs 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe8c136c10 con 0x7efe8c0a4820 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: _renew_subs 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7efe8c137060 con 0x7efe8c0a4820 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe88003950 con 0x7efe8c0a4820 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe88003e40 con 0x7efe8c0a4820 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe90aa4640 4 set_mon_vals no callback set 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:13:26.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient: dump: 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.096 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efe740065d0 con 0x7efe74002870 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7efe88003fe0 con 0x7efe8c0a4820 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7efe88045190 con 0x7efe8c0a4820 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe92aa8640 10 monclient: get_auth_request con 0x7efe700379f0 auth_method 0 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3932888976 0 0) 0x7efe740065d0 con 0x7efe74002870 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 10 monclient(hunting): my global_id is 146833 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.102+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe8c138f10 con 0x7efe74002870 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2452211822 0 0) 0x7efe8c138f10 con 0x7efe74002870 2024-04-26T00:13:26.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe740065d0 con 0x7efe74002870 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe7c001930 con 0x7efe74002870 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 10 monclient: dump: 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.098 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2560989756 0 0) 0x7efe740065d0 con 0x7efe74002870 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efe7400a160 con 0x7efe74002870 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efe7c003600 con 0x7efe74002870 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.171:6792/0 conn(0x7efe74002870 legacy=0x7efe74004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.106+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.171:6792/0 conn(0x7efe74002870 legacy=0x7efe74004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.110+0000 7efe9450b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.110+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efe74009e50 con 0x7efe74009110 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1834993296 0 0) 0x7efe74009e50 con 0x7efe74009110 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient(hunting): my global_id is 146842 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe740065d0 con 0x7efe74009110 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2585915550 0 0) 0x7efe740065d0 con 0x7efe74009110 2024-04-26T00:13:26.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe74009e50 con 0x7efe74009110 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7efe7c003b70 con 0x7efe74009110 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient: dump: 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.102 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 361223497 0 0) 0x7efe74009e50 con 0x7efe74009110 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efe7400c3e0 con 0x7efe74009110 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 346459589) 0x7efe7c005e40 con 0x7efe74009110 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.171:6792/0 conn(0x7efe74009110 legacy=0x7efe740095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe82ffd640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.171:6792/0 conn(0x7efe74009110 legacy=0x7efe740095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 114, 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 869642, 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:13:26.104 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 6, 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:26.105 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:26.106 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:26.107 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:26.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:26.109 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:26.111 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.112 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.113 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:26.114 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.115 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.116 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:26.117 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:26.118 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.119 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:26.120 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:26.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:26.122 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:26.123 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.171:6812/722422047 conn(0x7efe700379f0 legacy=0x7efe70039eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 10 monclient: shutdown 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 >> v1:172.21.15.106:6793/0 conn(0x7efe8c0a4820 legacy=0x7efe8c12abf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe92aa8640 1 -- 172.21.15.106:0/4038299866 reap_dead start 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe92aa8640 1 -- 172.21.15.106:0/4038299866 reap_dead start 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 shutdown_connections 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 >> 172.21.15.106:0/4038299866 conn(0x7efe8c0a9e20 msgr2=0x7efe8c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:26.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 shutdown_connections 2024-04-26T00:13:26.125 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.114+0000 7efe9450b640 1 -- 172.21.15.106:0/4038299866 wait complete. 2024-04-26T00:13:26.125 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:13:26.125 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['b', 'f', 'g', 'e'] 2024-04-26T00:13:26.125 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['d', 'h', 'i'] 2024-04-26T00:13:26.125 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-04-26T00:13:26.125 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b store 2024-04-26T00:13:26.125 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b sync_force --yes-i-really-mean-it 2024-04-26T00:13:26.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient: get_monmap_and_config 2024-04-26T00:13:26.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient: build_initial_monmap 2024-04-26T00:13:26.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient: monmap: 2024-04-26T00:13:26.242 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:26.242 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.242 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:26.272111+0000 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:26.272111+0000 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:26.243 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 1 Processor -- start 2024-04-26T00:13:26.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 1 -- start start 2024-04-26T00:13:26.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient: init 2024-04-26T00:13:26.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient: _add_conns ranks=[1,7,6,5,3,8,2,0,4] 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient(hunting): picked mon.noname-f con 0x7f9edc135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient(hunting): picked mon.noname-i con 0x7f9edc1353b0 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient(hunting): picked mon.noname-d con 0x7f9edc13bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc06f2d0 con 0x7f9edc135870 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc072330 con 0x7f9edc13bdf0 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc072610 con 0x7f9edc1353b0 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ee1962640 10 monclient(hunting): authenticate will time out at 2061.799232s 2024-04-26T00:13:26.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9edb7fe640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9edc13bdf0 0x7f9edc13e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:46956/0 (socket says 172.21.15.106:46956) 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9edb7fe640 1 -- 172.21.15.106:0/1463863277 learned_addr learned my addr 172.21.15.106:0/1463863277 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 92005028 0 0) 0x7f9edc072330 con 0x7f9edc13bdf0 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ed9ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ed9ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ed9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ed9ffb640 10 monclient(hunting): my global_id is 254697 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec4003530 con 0x7f9edc13bdf0 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.266+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3949190502 0 0) 0x7f9ec4003530 con 0x7f9edc13bdf0 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 >> v1:172.21.15.171:6792/0 conn(0x7f9edc1353b0 legacy=0x7f9edc13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 >> v1:172.21.15.171:6789/0 conn(0x7f9edc135870 legacy=0x7f9edc135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 1 monclient: found mon.noname-d 2024-04-26T00:13:26.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc0a3260 con 0x7f9edc13bdf0 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: _finish_auth 0 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9ed4001b40 con 0x7f9edc13bdf0 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: dump: 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.253 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 5 monclient: authenticate success, global_id 254697 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ed4001e30 con 0x7f9edc13bdf0 2024-04-26T00:13:26.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 1 -- 172.21.15.106:0/1463863277 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9ed4004f70 con 0x7f9edc13bdf0 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 4 set_mon_vals no callback set 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed9ffb640 10 monclient: dump: 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.255 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: shutdown 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/1463863277 >> v1:172.21.15.106:6792/0 conn(0x7f9edc13bdf0 legacy=0x7f9edc13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/1463863277 shutdown_connections 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/1463863277 >> 172.21.15.106:0/1463863277 conn(0x7f9edc0a64e0 msgr2=0x7f9edc0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/1463863277 shutdown_connections 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/1463863277 wait complete. 2024-04-26T00:13:26.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: build_initial_monmap 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: monmap: 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:26.257 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 Processor -- start 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- start start 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: init 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: _add_conns ranks=[3,4,5,8,1,2,6,7,0] 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient(hunting): picked mon.noname-g con 0x7f9edc1353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient(hunting): picked mon.noname-c con 0x7f9edc135870 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient(hunting): picked mon.noname-h con 0x7f9edc13bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc1322c0 con 0x7f9edc1353b0 2024-04-26T00:13:26.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc1312d0 con 0x7f9edc135870 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9edc09f470 con 0x7f9edc13bdf0 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient(hunting): authenticate will time out at 2061.802340s 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9eda7fc640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f9edc135870 0x7f9edc12fde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:52540/0 (socket says 172.21.15.106:52540) 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9eda7fc640 1 -- 172.21.15.106:0/3811090483 learned_addr learned my addr 172.21.15.106:0/3811090483 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1584146427 0 0) 0x7f9edc1312d0 con 0x7f9edc135870 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): my global_id is 274549 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec8003530 con 0x7f9edc135870 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2548224570 0 0) 0x7f9ec8003530 con 0x7f9edc135870 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9edc1312d0 con 0x7f9edc135870 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9ecc001b20 con 0x7f9edc135870 2024-04-26T00:13:26.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): dump: 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.260 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3257209848 0 0) 0x7f9edc1322c0 con 0x7f9edc1353b0 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): my global_id is 284250 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ec8003530 con 0x7f9edc1353b0 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3945203865 0 0) 0x7f9edc09f470 con 0x7f9edc13bdf0 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient(hunting): my global_id is 254660 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9edc1322c0 con 0x7f9edc13bdf0 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 725111550 0 0) 0x7f9edc1312d0 con 0x7f9edc135870 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.171:6791/0 conn(0x7f9edc13bdf0 legacy=0x7f9edc1d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.171:6790/0 conn(0x7f9edc1353b0 legacy=0x7f9edc12f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 monclient: found mon.c 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9edc131840 con 0x7f9edc135870 2024-04-26T00:13:26.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: _finish_auth 0 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 5 monclient: authenticate success, global_id 274549 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: _renew_subs 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9edc131fe0 con 0x7f9edc135870 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: _renew_subs 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f9edc134f60 con 0x7f9edc135870 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9ecc003950 con 0x7f9edc135870 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9ecc003e40 con 0x7f9edc135870 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ed97fa640 4 set_mon_vals no callback set 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ec3fff640 10 monclient: dump: 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.264 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.270+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9ebc0065d0 con 0x7f9ebc002870 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9ecc003fe0 con 0x7f9edc135870 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f9ecc045210 con 0x7f9edc135870 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499114202 0 0) 0x7f9ebc0065d0 con 0x7f9ebc002870 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient(hunting): my global_id is 254774 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9edc1312d0 con 0x7f9ebc002870 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9edb7fe640 10 monclient: get_auth_request con 0x7f9ec8037990 auth_method 0 2024-04-26T00:13:26.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1158438806 0 0) 0x7f9edc1312d0 con 0x7f9ebc002870 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ebc0065d0 con 0x7f9ebc002870 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9ed00017f0 con 0x7f9ebc002870 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient: dump: 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.266 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 668121684 0 0) 0x7f9ebc0065d0 con 0x7f9ebc002870 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9ebc00a160 con 0x7f9ebc002870 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9ed0001d40 con 0x7f9ebc002870 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.106:6790/0 conn(0x7f9ebc002870 legacy=0x7f9ebc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.274+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.106:6790/0 conn(0x7f9ebc002870 legacy=0x7f9ebc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 10 start_mon_command cmd=[{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9ebc009e40 con 0x7f9ebc009100 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284190959 0 0) 0x7f9ebc009e40 con 0x7f9ebc009100 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient(hunting): my global_id is 254783 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9ebc0065d0 con 0x7f9ebc009100 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 636190611 0 0) 0x7f9ebc0065d0 con 0x7f9ebc009100 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9ebc009e40 con 0x7f9ebc009100 2024-04-26T00:13:26.269 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9ed0003b30 con 0x7f9ebc009100 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient: dump: 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:26.270 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1339021664 0 0) 0x7f9ebc009e40 con 0x7f9ebc009100 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "sync_force", "yes_i_really_mean_it": true}) -- 0x7f9ebc00c3e0 con 0x7f9ebc009100 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+83 (unknown 0 0 2946029456) 0x7f9ed0004060 con 0x7f9ebc009100 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient: handle_command_reply 2 [{"prefix": "sync_force", "yes_i_really_mean_it": true}] 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.106:6790/0 conn(0x7f9ebc009100 legacy=0x7f9ebc009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ec3fff640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.106:6790/0 conn(0x7f9ebc009100 legacy=0x7f9ebc009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:26.272 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: "ret": 0, 2024-04-26T00:13:26.272 INFO:teuthology.orchestra.run.smithi106.stdout: "msg": "forcing store sync the next time the monitor starts" 2024-04-26T00:13:26.272 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:26.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.171:6812/722422047 conn(0x7f9ec8037990 legacy=0x7f9ec8039e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 10 monclient: shutdown 2024-04-26T00:13:26.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:26.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 >> v1:172.21.15.106:6791/0 conn(0x7f9edc135870 legacy=0x7f9edc12fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:26.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9edb7fe640 1 -- 172.21.15.106:0/3811090483 reap_dead start 2024-04-26T00:13:26.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9edb7fe640 1 -- 172.21.15.106:0/3811090483 reap_dead start 2024-04-26T00:13:26.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 shutdown_connections 2024-04-26T00:13:26.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 >> 172.21.15.106:0/3811090483 conn(0x7f9edc0a64e0 msgr2=0x7f9edc0a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:26.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 shutdown_connections 2024-04-26T00:13:26.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:26.282+0000 7f9ee1962640 1 -- 172.21.15.106:0/3811090483 wait complete. 2024-04-26T00:13:26.274 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T00:13:26.274 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T00:13:26.274 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:13:26.288 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T00:13:26.288 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-04-26T00:13:26.288 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-26T00:13:26.288 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-04-26T00:13:26.288 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:13:26.317 INFO:tasks.ceph.mon.f:Stopped 2024-04-26T00:13:26.317 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-04-26T00:13:26.317 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-04-26T00:13:26.317 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-04-26T00:13:26.317 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:13:26.376 INFO:tasks.ceph.mon.g:Stopped 2024-04-26T00:13:26.377 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.e 2024-04-26T00:13:26.377 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-26T00:13:26.377 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-04-26T00:13:26.377 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:13:26.393 INFO:tasks.ceph.mon.e:Stopped 2024-04-26T00:13:26.393 INFO:tasks.mon_thrash:Sending STOP to mon d 2024-04-26T00:13:26.393 INFO:tasks.ceph.mon.d:Sent signal 19 2024-04-26T00:13:26.393 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-04-26T00:13:26.394 INFO:tasks.ceph.mon.h:Sent signal 19 2024-04-26T00:13:26.394 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-04-26T00:13:26.394 INFO:tasks.ceph.mon.i:Sent signal 19 2024-04-26T00:13:26.394 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T00:13:41.395 INFO:tasks.mon_thrash:Sending CONT to mon d 2024-04-26T00:13:41.396 INFO:tasks.ceph.mon.d:Sent signal 18 2024-04-26T00:13:41.396 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-04-26T00:13:41.396 INFO:tasks.ceph.mon.h:Sent signal 18 2024-04-26T00:13:41.396 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-04-26T00:13:41.396 INFO:tasks.ceph.mon.i:Sent signal 18 2024-04-26T00:13:41.396 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-04-26T00:13:41.397 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:13:41.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.553+0000 7f3d5e5c4640 10 monclient: get_monmap_and_config 2024-04-26T00:13:41.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.553+0000 7f3d5e5c4640 10 monclient: build_initial_monmap 2024-04-26T00:13:41.527 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.553+0000 7f3d5e5c4640 10 monclient: monmap: 2024-04-26T00:13:41.528 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:41.528 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:41.528 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:41.557007+0000 2024-04-26T00:13:41.528 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:41.557007+0000 2024-04-26T00:13:41.528 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:41.528 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:41.528 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:41.529 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:41.529 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:41.529 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:41.529 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:41.529 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:41.529 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:41.529 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:41.530 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:41.530 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:41.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.553+0000 7f3d5e5c4640 1 Processor -- start 2024-04-26T00:13:41.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.553+0000 7f3d5e5c4640 1 -- start start 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.553+0000 7f3d5e5c4640 10 monclient: init 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 10 monclient: _add_conns ranks=[3,1,0,4,6,8,7,2,5] 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 10 monclient(hunting): picked mon.noname-g con 0x7f3d58134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 10 monclient(hunting): picked mon.noname-f con 0x7f3d580a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 10 monclient(hunting): picked mon.noname-a con 0x7f3d5813e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5806dd40 con 0x7f3d5813e200 2024-04-26T00:13:41.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d580a2b10 con 0x7f3d580a4820 2024-04-26T00:13:41.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d580a2df0 con 0x7f3d58134970 2024-04-26T00:13:41.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:41.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5e5c4640 10 monclient(hunting): authenticate will time out at 2077.084344s 2024-04-26T00:13:41.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5cb61640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3d5813e200 0x7f3d581405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40748/0 (socket says 172.21.15.106:40748) 2024-04-26T00:13:41.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d5cb61640 1 -- 172.21.15.106:0/165239998 learned_addr learned my addr 172.21.15.106:0/165239998 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:41.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d577fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f3d580a4820 legacy=0x7f3d5813cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:41.534 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.557+0000 7f3d57fff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f3d58134970 legacy=0x7f3d58134d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:41.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.761+0000 7f3d577fe640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6789/0 conn(0x7f3d580a4820 legacy=0x7f3d5813cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:41.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:41.761+0000 7f3d57fff640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6790/0 conn(0x7f3d58134970 legacy=0x7f3d58134d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:42.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:42.165+0000 7f3d57fff640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6790/0 conn(0x7f3d58134970 legacy=0x7f3d58134d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:42.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:42.165+0000 7f3d577fe640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6789/0 conn(0x7f3d580a4820 legacy=0x7f3d5813cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:42.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:42.969+0000 7f3d57fff640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6790/0 conn(0x7f3d58134970 legacy=0x7f3d58134d50 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:42.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:42.969+0000 7f3d577fe640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6789/0 conn(0x7f3d580a4820 legacy=0x7f3d5813cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:44.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient(hunting): tick 2024-04-26T00:13:44.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:13:44.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 1 monclient(hunting): continuing hunt 2024-04-26T00:13:44.529 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6790/0 conn(0x7f3d58134970 legacy=0x7f3d58134d50 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6789/0 conn(0x7f3d580a4820 legacy=0x7f3d5813cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6789/0 conn(0x7f3d5813e200 legacy=0x7f3d581405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient: _add_conns ranks=[6,5,7,2,4,8] 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient(hunting): picked mon.noname-d con 0x7f3d380037b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient(hunting): picked mon.noname-h con 0x7f3d38007440 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient(hunting): picked mon.noname-i con 0x7f3d3800b1d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d580a30d0 con 0x7f3d38007440 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d580a2b10 con 0x7f3d380037b0 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d580a2df0 con 0x7f3d3800b1d0 2024-04-26T00:13:44.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:44.557+0000 7f3d55ffb640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:45.910 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=110 2024-04-26T00:13:45.910 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 110 -ne 110 ]] 2024-04-26T00:13:45.911 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:13:45.911 INFO:tasks.workunit.client.0.smithi171.stderr:+ export CEPH_ARGS= 2024-04-26T00:13:45.911 INFO:tasks.workunit.client.0.smithi171.stderr:+ CEPH_ARGS= 2024-04-26T00:13:45.911 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph auth del client.bar 2024-04-26T00:13:46.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient: get_monmap_and_config 2024-04-26T00:13:46.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient: build_initial_monmap 2024-04-26T00:13:46.023 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient: monmap: 2024-04-26T00:13:46.023 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:13:46.023 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:46.023 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:13:46.050846+0000 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:13:46.050846+0000 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:46.024 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 1 Processor -- start 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 1 -- start start 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient: init 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient: _add_conns ranks=[6,0,1,7,4,5,8,2,3] 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient(hunting): picked mon.noname-d con 0x7f5bfc0a3100 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient(hunting): picked mon.noname-a con 0x7f5bfc072940 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient(hunting): picked mon.noname-f con 0x7f5bfc072da0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc0a1c00 con 0x7f5bfc072940 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc0a1ee0 con 0x7f5bfc072da0 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc0a21c0 con 0x7f5bfc0a3100 2024-04-26T00:13:46.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:46.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5c00ecd640 10 monclient(hunting): authenticate will time out at 2076.757950s 2024-04-26T00:13:46.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5bfad9d640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f5bfc072da0 legacy=0x7f5bfc13df10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:46.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5bfa59c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5bfc0a3100 0x7f5bfc1354c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:34066/0 (socket says 172.21.15.171:34066) 2024-04-26T00:13:46.027 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.046+0000 7f5bfa59c640 1 -- 172.21.15.171:0/3073821499 learned_addr learned my addr 172.21.15.171:0/3073821499 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:13:46.227 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.250+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6789/0 conn(0x7f5bfc072da0 legacy=0x7f5bfc13df10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:46.628 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:46.654+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6789/0 conn(0x7f5bfc072da0 legacy=0x7f5bfc13df10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:47.435 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:47.458+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6789/0 conn(0x7f5bfc072da0 legacy=0x7f5bfc13df10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:47.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient(hunting): tick 2024-04-26T00:13:47.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:13:47.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 1 monclient(hunting): continuing hunt 2024-04-26T00:13:47.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:13:47.530 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6792/0 conn(0x7f3d3800b1d0 legacy=0x7f3d3800d690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:47.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6792/0 conn(0x7f3d380037b0 legacy=0x7f3d38005c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:47.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.171:6791/0 conn(0x7f3d38007440 legacy=0x7f3d38009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:47.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient: _add_conns ranks=[2,8,4] 2024-04-26T00:13:47.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient(hunting): picked mon.noname-b con 0x7f3d38011180 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:47.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d5cb61640 1 -- 172.21.15.106:0/165239998 reap_dead start 2024-04-26T00:13:47.531 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient(hunting): picked mon.noname-e con 0x7f3d380133e0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:47.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient(hunting): picked mon.noname-c con 0x7f3d38016fe0 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:47.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d380120a0 con 0x7f3d38011180 2024-04-26T00:13:47.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3800a0d0 con 0x7f3d38016fe0 2024-04-26T00:13:47.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3800a2e0 con 0x7f3d380133e0 2024-04-26T00:13:47.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d55ffb640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:47.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d577fe640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6793/0 conn(0x7f3d380133e0 legacy=0x7f3d380157d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:47.533 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.557+0000 7f3d57fff640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6790/0 conn(0x7f3d38011180 legacy=0x7f3d380115c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.761+0000 7f3d57fff640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6790/0 conn(0x7f3d38011180 legacy=0x7f3d380115c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:47.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:47.761+0000 7f3d577fe640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6793/0 conn(0x7f3d380133e0 legacy=0x7f3d380157d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:48.136 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:48.165+0000 7f3d57fff640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6790/0 conn(0x7f3d38011180 legacy=0x7f3d380115c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:48.137 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:48.165+0000 7f3d577fe640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6793/0 conn(0x7f3d380133e0 legacy=0x7f3d380157d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:48.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:48.969+0000 7f3d57fff640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6790/0 conn(0x7f3d38011180 legacy=0x7f3d380115c0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:48.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:48.969+0000 7f3d577fe640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6793/0 conn(0x7f3d380133e0 legacy=0x7f3d380157d0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:49.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient(hunting): tick 2024-04-26T00:13:49.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:13:49.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 1 monclient(hunting): continuing hunt 2024-04-26T00:13:49.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:13:49.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.106:6792/0 conn(0x7f5bfc0a3100 legacy=0x7f5bfc1354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:49.025 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6789/0 conn(0x7f5bfc072da0 legacy=0x7f5bfc13df10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.106:6789/0 conn(0x7f5bfc072940 legacy=0x7f5bfc13a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient: _add_conns ranks=[4,5,3,2,7,8] 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient(hunting): picked mon.noname-c con 0x7f5bdc003800 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient(hunting): picked mon.noname-h con 0x7f5bdc0073f0 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient(hunting): picked mon.noname-g con 0x7f5bdc00b180 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 1 -- 172.21.15.171:0/3073821499 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc136340 con 0x7f5bdc00b180 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 1 -- 172.21.15.171:0/3073821499 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc0a1ee0 con 0x7f5bdc003800 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 1 -- 172.21.15.171:0/3073821499 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bdc010ff0 con 0x7f5bdc0073f0 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bf3fff640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:49.026 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.050+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6790/0 conn(0x7f5bdc00b180 legacy=0x7f5bdc00d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:49.231 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.254+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6790/0 conn(0x7f5bdc00b180 legacy=0x7f5bdc00d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:49.631 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:49.658+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6790/0 conn(0x7f5bdc00b180 legacy=0x7f5bdc00d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:50.439 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.466+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6790/0 conn(0x7f5bdc00b180 legacy=0x7f5bdc00d640 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 580342093 0 0) 0x7f3d3800a0d0 con 0x7f3d38016fe0 2024-04-26T00:13:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient(hunting): my global_id is 274558 2024-04-26T00:13:50.525 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d44003530 con 0x7f3d38016fe0 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3158259772 0 0) 0x7f5bfc0a1ee0 con 0x7f5bdc003800 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient(hunting): my global_id is 274567 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5be8003530 con 0x7f5bdc003800 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2047203780 0 0) 0x7f5be8003530 con 0x7f5bdc003800 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6791/0 conn(0x7f5bdc0073f0 legacy=0x7f5bdc0098b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.171:6790/0 conn(0x7f5bdc00b180 legacy=0x7f5bdc00d640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: _finish_hunting 0 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 monclient: found mon.noname-c 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bfad9d640 1 -- 172.21.15.171:0/3073821499 reap_dead start 2024-04-26T00:13:50.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bdc0122e0 con 0x7f5bdc003800 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: _finish_auth 0 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: _check_auth_tickets 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5c00ecd640 5 monclient: authenticate success, global_id 274567 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5c00ecd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5bec001670 con 0x7f5bdc003800 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: dump: 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.531 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5c00ecd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bec001940 con 0x7f5bdc003800 2024-04-26T00:13:50.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5c00ecd640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5c00ecd640 4 set_mon_vals no callback set 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 1 -- 172.21.15.171:0/3073821499 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5bec0048b0 con 0x7f5bdc003800 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.550+0000 7f5bf959a640 10 monclient: dump: 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.533 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient: shutdown 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- 172.21.15.171:0/3073821499 >> v1:172.21.15.106:6791/0 conn(0x7f5bdc003800 legacy=0x7f5bdc005c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- 172.21.15.171:0/3073821499 shutdown_connections 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- 172.21.15.171:0/3073821499 >> 172.21.15.171:0/3073821499 conn(0x7f5bfc0a6860 msgr2=0x7f5bfc0a29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- 172.21.15.171:0/3073821499 shutdown_connections 2024-04-26T00:13:50.534 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- 172.21.15.171:0/3073821499 wait complete. 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient: build_initial_monmap 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient: monmap: 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:50.535 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:50.536 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:50.536 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:50.536 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3811708172 0 0) 0x7f3d44003530 con 0x7f3d38016fe0 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6793/0 conn(0x7f3d380133e0 legacy=0x7f3d380157d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6790/0 conn(0x7f3d38011180 legacy=0x7f3d380115c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 monclient: found mon.noname-c 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3800a4b0 con 0x7f3d38016fe0 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:50.537 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3d50001640 con 0x7f3d38016fe0 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: dump: 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.538 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 5 monclient: authenticate success, global_id 274558 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d500018d0 con 0x7f3d38016fe0 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 1 -- 172.21.15.106:0/165239998 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3d500048b0 con 0x7f3d38016fe0 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d56ffd640 10 monclient: dump: 2024-04-26T00:13:50.539 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 4 set_mon_vals no callback set 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 10 monclient: shutdown 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/165239998 >> v1:172.21.15.106:6791/0 conn(0x7f3d38016fe0 legacy=0x7f3d38019400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/165239998 shutdown_connections 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/165239998 >> 172.21.15.106:0/165239998 conn(0x7f3d580a9e20 msgr2=0x7f3d580aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/165239998 shutdown_connections 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/165239998 wait complete. 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 10 monclient: build_initial_monmap 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.553+0000 7f3d5e5c4640 10 monclient: monmap: 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:50.541 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 1 Processor -- start 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 1 -- start start 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient: init 2024-04-26T00:13:50.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient: _add_conns ranks=[8,3,0,4,2,1,7,6,5] 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient(hunting): picked mon.noname-e con 0x7f3d38011180 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient(hunting): picked mon.noname-g con 0x7f3d380133e0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient(hunting): picked mon.noname-a con 0x7f3d38016fe0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5813c9c0 con 0x7f3d38016fe0 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d581cd380 con 0x7f3d380133e0 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5813b510 con 0x7f3d38011180 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5e5c4640 10 monclient(hunting): authenticate will time out at 2086.085106s 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d57fff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f3d38011180 legacy=0x7f3d581cc560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d577fe640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f3d380133e0 legacy=0x7f3d581ccc70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5cb61640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f3d38016fe0 0x7f3d581d4ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53146/0 (socket says 172.21.15.106:53146) 2024-04-26T00:13:50.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.557+0000 7f3d5cb61640 1 -- 172.21.15.106:0/322702449 learned_addr learned my addr 172.21.15.106:0/322702449 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 Processor -- start 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- start start 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient: init 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient: _add_conns ranks=[0,2,3,6,1,8,4,7,5] 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient(hunting): picked mon.noname-a con 0x7f5bdc003800 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient(hunting): picked mon.noname-b con 0x7f5bfc09e400 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient(hunting): picked mon.noname-g con 0x7f5bfc1ccad0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc12c6b0 con 0x7f5bdc003800 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc12fcb0 con 0x7f5bfc09e400 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bfc11d5c0 con 0x7f5bfc1ccad0 2024-04-26T00:13:50.545 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:50.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5bfad9d640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f5bfc1ccad0 legacy=0x7f5bfc1d4d50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:50.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5c00ecd640 10 monclient(hunting): authenticate will time out at 2081.265346s 2024-04-26T00:13:50.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5bf9d9b640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f5bfc09e400 legacy=0x7f5bfc1d1620 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:50.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5bfa59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5bdc003800 0x7f5bfc1cc3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.171:54318/0 (socket says 172.21.15.171:54318) 2024-04-26T00:13:50.546 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.554+0000 7f5bfa59c640 1 -- 172.21.15.171:0/706209274 learned_addr learned my addr 172.21.15.171:0/706209274 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:13:50.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.573+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 742673598 0 0) 0x7f3d5813c9c0 con 0x7f3d38016fe0 2024-04-26T00:13:50.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.573+0000 7f3d54ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.573+0000 7f3d54ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.573+0000 7f3d54ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.573+0000 7f3d54ff9640 10 monclient(hunting): my global_id is 274455 2024-04-26T00:13:50.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.573+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d38012000 con 0x7f3d38016fe0 2024-04-26T00:13:50.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.570+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2322136772 0 0) 0x7f5bdc0122e0 con 0x7f5bdc003800 2024-04-26T00:13:50.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.570+0000 7f5bf2ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.570+0000 7f5bf2ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.570+0000 7f5bf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.570+0000 7f5bf2ffd640 10 monclient(hunting): my global_id is 274464 2024-04-26T00:13:50.549 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.570+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5bdc010680 con 0x7f5bdc003800 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1583016611 0 0) 0x7f3d38012000 con 0x7f3d38016fe0 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d5813c9c0 con 0x7f3d38016fe0 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3d50001640 con 0x7f3d38016fe0 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient(hunting): dump: 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.551 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.552 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.553 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.553 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.553 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.553 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1237486958 0 0) 0x7f3d5813c9c0 con 0x7f3d38016fe0 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 >> v1:172.21.15.106:6793/0 conn(0x7f3d38011180 legacy=0x7f3d581cc560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 >> v1:172.21.15.171:6790/0 conn(0x7f3d380133e0 legacy=0x7f3d581ccc70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 monclient: found mon.a 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d580a1e00 con 0x7f3d38016fe0 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient: _finish_auth 0 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d54ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:50.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d5e5c4640 5 monclient: authenticate success, global_id 274455 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d5e5c4640 10 monclient: _renew_subs 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d5e5c4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5813c6e0 con 0x7f3d38016fe0 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d5e5c4640 10 monclient: _renew_subs 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d5e5c4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.577+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d5813dc70 con 0x7f3d38016fe0 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d500018d0 con 0x7f3d38016fe0 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f3d50004de0 con 0x7f3d38016fe0 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d567fc640 4 set_mon_vals no callback set 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 10 monclient: dump: 2024-04-26T00:13:50.558 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d5e5c4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d5e5c4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d5e5c4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d3c005090 con 0x7f3d38016fe0 2024-04-26T00:13:50.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f3d50004f80 con 0x7f3d38016fe0 2024-04-26T00:13:50.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f3d50044de0 con 0x7f3d38016fe0 2024-04-26T00:13:50.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.581+0000 7f3d57fff640 10 monclient: get_auth_request con 0x7f3d380397c0 auth_method 0 2024-04-26T00:13:50.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2994584509 0 0) 0x7f5bdc010680 con 0x7f5bdc003800 2024-04-26T00:13:50.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5bdc0122e0 con 0x7f5bdc003800 2024-04-26T00:13:50.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5bec001c80 con 0x7f5bdc003800 2024-04-26T00:13:50.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:50.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:50.560 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient(hunting): dump: 2024-04-26T00:13:50.560 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:13:50.561 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1718069519 0 0) 0x7f5bdc0122e0 con 0x7f5bdc003800 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 >> v1:172.21.15.171:6790/0 conn(0x7f5bfc1ccad0 legacy=0x7f5bfc1d4d50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 >> v1:172.21.15.106:6790/0 conn(0x7f5bfc09e400 legacy=0x7f5bfc1d1620 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 monclient: found mon.a 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bfc1ccf00 con 0x7f5bdc003800 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: _finish_auth 0 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 5 monclient: authenticate success, global_id 274464 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 10 monclient: _renew_subs 2024-04-26T00:13:50.562 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5bfc11e840 con 0x7f5bdc003800 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 10 monclient: _renew_subs 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5bfc1d6470 con 0x7f5bdc003800 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5bec0017f0 con 0x7f5bdc003800 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5bec005120 con 0x7f5bdc003800 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf8d99640 4 set_mon_vals no callback set 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 10 monclient: dump: 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.563 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.564 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5be0005090 con 0x7f5bdc003800 2024-04-26T00:13:50.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.574+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5bec00fec0 con 0x7f5bdc003800 2024-04-26T00:13:50.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.578+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5bec044fe0 con 0x7f5bdc003800 2024-04-26T00:13:50.565 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.578+0000 7f5bf9d9b640 10 monclient: get_auth_request con 0x7f5bdc038d50 auth_method 0 2024-04-26T00:13:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.585+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f3d500154d0 con 0x7f3d38016fe0 2024-04-26T00:13:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.585+0000 7f3d54ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.585+0000 7f3d54ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:50.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.594+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5bfc12c6b0 con 0x7f5bdc003800 2024-04-26T00:13:50.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.594+0000 7f5bf2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.568 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.594+0000 7f5bf2ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.809+0000 7f3d5e5c4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:13:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.809+0000 7f3d5e5c4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.809+0000 7f3d5e5c4640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.809+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f3d3c005380 con 0x7f3d38016fe0 2024-04-26T00:13:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.809+0000 7f3d54ff9640 1 -- 172.21.15.106:0/322702449 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2721 (unknown 254746657 0 3794134809) 0x7f3d50014dd0 con 0x7f3d38016fe0 2024-04-26T00:13:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.809+0000 7f3d54ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:13:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.809+0000 7f3d54ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:50.784 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":122,"quorum":[0,4,5,6,7],"quorum_names":["a","c","h","d","i"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 >> v1:172.21.15.171:6812/722422047 conn(0x7f3d380397c0 legacy=0x7f3d3803bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 10 monclient: shutdown 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 >> v1:172.21.15.106:6789/0 conn(0x7f3d38016fe0 legacy=0x7f3d581d4ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 shutdown_connections 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 >> 172.21.15.106:0/322702449 conn(0x7f3d580a9e20 msgr2=0x7f3d5809ae30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 shutdown_connections 2024-04-26T00:13:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.813+0000 7f3d5e5c4640 1 -- 172.21.15.106:0/322702449 wait complete. 2024-04-26T00:13:50.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.822+0000 7f5c00ecd640 10 start_mon_command cmd=[{"prefix": "auth del", "entity": "client.bar"}] 2024-04-26T00:13:50.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.822+0000 7f5c00ecd640 10 monclient: _send_command 2 [{"prefix": "auth del", "entity": "client.bar"}] 2024-04-26T00:13:50.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.822+0000 7f5c00ecd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.796 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.822+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "auth del", "entity": "client.bar"} v 0) -- 0x7f5be0005380 con 0x7f5bdc003800 2024-04-26T00:13:50.798 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.826+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bar"}]=0 v39) ==== 80+0+0 (unknown 1325025729 0 0) 0x7f5bec015670 con 0x7f5bdc003800 2024-04-26T00:13:50.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.826+0000 7f5bf2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "auth del", "entity": "client.bar"}] 2024-04-26T00:13:50.799 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.826+0000 7f5bf2ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:50.802 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-04-26T00:13:50.802 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-04-26T00:13:50.802 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: get_monmap_and_config 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: build_initial_monmap 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: monmap: 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:50.950507+0000 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:50.950507+0000 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:50.922 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 Processor -- start 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- start start 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: init 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: _add_conns ranks=[8,5,3,7,1,2,4,6,0] 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient(hunting): picked mon.noname-e con 0x7fb80c06b210 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient(hunting): picked mon.noname-h con 0x7fb80c06bd00 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient(hunting): picked mon.noname-g con 0x7fb80c09b5d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c09ba00 con 0x7fb80c09b5d0 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c0a3040 con 0x7fb80c06bd00 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c0a0620 con 0x7fb80c06b210 2024-04-26T00:13:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient(hunting): authenticate will time out at 2086.477647s 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80b7fe640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fb80c06b210 legacy=0x7fb80c06b5f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80bfff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7fb80c09b5d0 legacy=0x7fb80c13e080 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80affd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fb80c06bd00 0x7fb80c13a950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:56892/0 (socket says 172.21.15.106:56892) 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80affd640 1 -- 172.21.15.106:0/3019916517 learned_addr learned my addr 172.21.15.106:0/3019916517 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279365901 0 0) 0x7fb80c0a3040 con 0x7fb80c06bd00 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient(hunting): my global_id is 254669 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f4003530 con 0x7fb80c06bd00 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1323983503 0 0) 0x7fb7f4003530 con 0x7fb80c06bd00 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 >> v1:172.21.15.106:6793/0 conn(0x7fb80c06b210 legacy=0x7fb80c06b5f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 >> v1:172.21.15.171:6790/0 conn(0x7fb80c09b5d0 legacy=0x7fb80c13e080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 monclient: found mon.noname-h 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c072720 con 0x7fb80c06bd00 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb800001b40 con 0x7fb80c06bd00 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 5 monclient: authenticate success, global_id 254669 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: dump: 2024-04-26T00:13:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.933 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb800001ea0 con 0x7fb80c06bd00 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 4 set_mon_vals no callback set 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 1 -- 172.21.15.106:0/3019916517 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb8000020d0 con 0x7fb80c06bd00 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb80a7fc640 10 monclient: dump: 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 10 monclient: shutdown 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- 172.21.15.106:0/3019916517 >> v1:172.21.15.171:6791/0 conn(0x7fb80c06bd00 legacy=0x7fb80c13a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- 172.21.15.106:0/3019916517 shutdown_connections 2024-04-26T00:13:50.935 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- 172.21.15.106:0/3019916517 >> 172.21.15.106:0/3019916517 conn(0x7fb80c0a6fe0 msgr2=0x7fb80c0a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- 172.21.15.106:0/3019916517 shutdown_connections 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.949+0000 7fb811aa2640 1 -- 172.21.15.106:0/3019916517 wait complete. 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: build_initial_monmap 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: monmap: 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:50.936 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 Processor -- start 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 -- start start 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: init 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: _add_conns ranks=[1,6,2,7,5,0,8,3,4] 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient(hunting): picked mon.noname-f con 0x7fb80c06b210 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient(hunting): picked mon.noname-d con 0x7fb80c06bd00 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient(hunting): picked mon.noname-b con 0x7fb80c09b5d0 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:50.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c11e7a0 con 0x7fb80c06b210 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c11ea80 con 0x7fb80c09b5d0 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb80c137df0 con 0x7fb80c06bd00 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient(hunting): authenticate will time out at 2086.481250s 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb80bfff640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7fb80c09b5d0 legacy=0x7fb80c1d27b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb80b7fe640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7fb80c06b210 legacy=0x7fb80c1376e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb80affd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fb80c06bd00 0x7fb80c1cf080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39088/0 (socket says 172.21.15.106:39088) 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb80affd640 1 -- 172.21.15.106:0/2783687717 learned_addr learned my addr 172.21.15.106:0/2783687717 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 151417422 0 0) 0x7fb80c137df0 con 0x7fb80c06bd00 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): my global_id is 254706 2024-04-26T00:13:50.938 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7f8003530 con 0x7fb80c06bd00 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 612168441 0 0) 0x7fb7f8003530 con 0x7fb80c06bd00 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb80c137df0 con 0x7fb80c06bd00 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb800001b00 con 0x7fb80c06bd00 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): dump: 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.939 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2773651217 0 0) 0x7fb80c137df0 con 0x7fb80c06bd00 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.106:6790/0 conn(0x7fb80c09b5d0 legacy=0x7fb80c1d27b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.171:6789/0 conn(0x7fb80c06b210 legacy=0x7fb80c1376e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 monclient: found mon.d 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:50.940 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb80c11dcf0 con 0x7fb80c06bd00 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: _finish_auth 0 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 5 monclient: authenticate success, global_id 254706 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: _renew_subs 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb80c11dec0 con 0x7fb80c06bd00 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: _renew_subs 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fb80c11da80 con 0x7fb80c06bd00 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb800005380 con 0x7fb80c06bd00 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb800005870 con 0x7fb80c06bd00 2024-04-26T00:13:50.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb809ffb640 4 set_mon_vals no callback set 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: dump: 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.942 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb7ec0065d0 con 0x7fb7ec002870 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4281936748 0 0) 0x7fb7ec0065d0 con 0x7fb7ec002870 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient(hunting): my global_id is 274473 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb80c137df0 con 0x7fb7ec002870 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fb800005a10 con 0x7fb80c06bd00 2024-04-26T00:13:50.943 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fb800045710 con 0x7fb80c06bd00 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 632419562 0 0) 0x7fb80c137df0 con 0x7fb7ec002870 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7ec0065d0 con 0x7fb7ec002870 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb804003fd0 con 0x7fb7ec002870 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 10 monclient: dump: 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.944 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 236861519 0 0) 0x7fb7ec0065d0 con 0x7fb7ec002870 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb7ec00a160 con 0x7fb7ec002870 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.953+0000 7fb80bfff640 10 monclient: get_auth_request con 0x7fb7f8037720 auth_method 0 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.957+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb804006330 con 0x7fb7ec002870 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.957+0000 7fb7f3fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.957+0000 7fb7f3fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.957+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.106:6789/0 conn(0x7fb7ec002870 legacy=0x7fb7ec004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.957+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.106:6789/0 conn(0x7fb7ec002870 legacy=0x7fb7ec004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb7ec009e30 con 0x7fb7ec0090f0 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 85261072 0 0) 0x7fb7ec009e30 con 0x7fb7ec0090f0 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient(hunting): my global_id is 274482 2024-04-26T00:13:50.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb7ec0065d0 con 0x7fb7ec0090f0 2024-04-26T00:13:50.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2767686859 0 0) 0x7fb7ec0065d0 con 0x7fb7ec0090f0 2024-04-26T00:13:50.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb7ec009e30 con 0x7fb7ec0090f0 2024-04-26T00:13:50.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fb804004a90 con 0x7fb7ec0090f0 2024-04-26T00:13:50.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:50.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:50.948 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient: dump: 2024-04-26T00:13:50.949 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:50.949 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:50.949 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.949 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:50.949 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:50.949 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:50.949 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2258316588 0 0) 0x7fb7ec009e30 con 0x7fb7ec0090f0 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb7ec00c3a0 con 0x7fb7ec0090f0 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7694 (unknown 0 0 2615196406) 0x7fb804005f40 con 0x7fb7ec0090f0 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:50.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.106:6789/0 conn(0x7fb7ec0090f0 legacy=0x7fb7ec009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb7f3fff640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.106:6789/0 conn(0x7fb7ec0090f0 legacy=0x7fb7ec009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 122, 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 179032, 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:50.951 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:50.952 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:50.953 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:50.954 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:50.955 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.956 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:50.957 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.958 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.959 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.960 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:50.961 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.962 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.963 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.964 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:50.965 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:50.966 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:50.967 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:50.968 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:50.969 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:50.969 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:50.969 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:50.969 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:50.969 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.171:6812/722422047 conn(0x7fb7f8037720 legacy=0x7fb7f8039be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 10 monclient: shutdown 2024-04-26T00:13:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 >> v1:172.21.15.106:6792/0 conn(0x7fb80c06bd00 legacy=0x7fb80c1cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb80bfff640 1 -- 172.21.15.106:0/2783687717 reap_dead start 2024-04-26T00:13:50.970 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb80bfff640 1 -- 172.21.15.106:0/2783687717 reap_dead start 2024-04-26T00:13:50.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 shutdown_connections 2024-04-26T00:13:50.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 >> 172.21.15.106:0/2783687717 conn(0x7fb80c0a6fe0 msgr2=0x7fb80c0715e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:50.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 shutdown_connections 2024-04-26T00:13:50.971 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:50.961+0000 7fb811aa2640 1 -- 172.21.15.106:0/2783687717 wait complete. 2024-04-26T00:13:50.971 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:13:50.971 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon c 2024-04-26T00:13:50.971 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.974+0000 7f5c00ecd640 10 start_mon_command cmd=[{"prefix": "auth del", "entity": "client.bar"}] 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.974+0000 7f5c00ecd640 10 monclient: _send_command 3 [{"prefix": "auth del", "entity": "client.bar"}] 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.974+0000 7f5c00ecd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.974+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "auth del", "entity": "client.bar"} v 0) -- 0x7f5be0005770 con 0x7f5bdc003800 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.974+0000 7f5bf2ffd640 1 -- 172.21.15.171:0/706209274 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bar"}]=0 v39) ==== 80+0+0 (unknown 1325025729 0 0) 0x7f5bec014f70 con 0x7f5bdc003800 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.974+0000 7f5bf2ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "auth del", "entity": "client.bar"}] 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.974+0000 7f5bf2ffd640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 >> v1:172.21.15.171:6812/722422047 conn(0x7f5bdc038d50 legacy=0x7f5bdc03b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 10 monclient: shutdown 2024-04-26T00:13:50.973 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 >> v1:172.21.15.106:6789/0 conn(0x7f5bdc003800 legacy=0x7f5bfc1cc3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 shutdown_connections 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 >> 172.21.15.171:0/706209274 conn(0x7f5bfc0a6860 msgr2=0x7f5bfc067440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 shutdown_connections 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:13:50.978+0000 7f5c00ecd640 1 -- 172.21.15.171:0/706209274 wait complete. 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status' 13 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status' 2024-04-26T00:13:50.974 INFO:tasks.workunit.client.0.smithi171.stdout:ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status 2024-04-26T00:13:50.975 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=13 2024-04-26T00:13:50.975 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status 2024-04-26T00:13:50.975 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph -k /tmp/cephtest-mon-caps-madness.bar.keyring --user bar quorum_status 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.109+0000 7fe3af26e640 10 monclient: get_monmap_and_config 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.109+0000 7fe3af26e640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.109+0000 7fe3af26e640 10 monclient: monmap: 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:51.113971+0000 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:51.113971+0000 2024-04-26T00:13:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.085 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 Processor -- start 2024-04-26T00:13:51.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- start start 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: init 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: _add_conns ranks=[6,1,5,4,7,2,0,3,8] 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient(hunting): picked mon.noname-d con 0x7fe3a8137730 addr v1:172.21.15.106:6792/0 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient(hunting): picked mon.noname-f con 0x7fe3a80a0b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient(hunting): picked mon.noname-h con 0x7fe3a8138220 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80a2750 con 0x7fe3a80a0b20 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80a2a30 con 0x7fe3a8138220 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80a2d10 con 0x7fe3a8137730 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient(hunting): authenticate will time out at 2086.641389s 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3ad00a640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fe3a8137730 0x7fe3a8137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:39090/0 (socket says 172.21.15.106:39090) 2024-04-26T00:13:51.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3ad00a640 1 -- 172.21.15.106:0/426373673 learned_addr learned my addr 172.21.15.106:0/426373673 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3ac809640 1 -- 172.21.15.106:0/426373673 >> v1:172.21.15.171:6789/0 conn(0x7fe3a80a0b20 legacy=0x7fe3a813ccd0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1707209728 0 0) 0x7fe3a80a2d10 con 0x7fe3a8137730 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient(hunting): my global_id is 254724 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe394003530 con 0x7fe3a8137730 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2113433340 0 0) 0x7fe394003530 con 0x7fe3a8137730 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 >> v1:172.21.15.171:6791/0 conn(0x7fe3a8138220 legacy=0x7fe3a8140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 >> v1:172.21.15.171:6789/0 conn(0x7fe3a80a0b20 legacy=0x7fe3a813ccd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 monclient: found mon.noname-d 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a80a4680 con 0x7fe3a8137730 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: _finish_auth 0 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a4001b40 con 0x7fe3a8137730 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 5 monclient: authenticate success, global_id 254724 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:51.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: dump: 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.098 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3a4001ea0 con 0x7fe3a8137730 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 1 -- 172.21.15.106:0/426373673 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a4004f70 con 0x7fe3a8137730 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 4 set_mon_vals no callback set 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe39ffff640 10 monclient: dump: 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.099 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: shutdown 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:51.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- 172.21.15.106:0/426373673 >> v1:172.21.15.106:6792/0 conn(0x7fe3a8137730 legacy=0x7fe3a8137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- 172.21.15.106:0/426373673 shutdown_connections 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- 172.21.15.106:0/426373673 >> 172.21.15.106:0/426373673 conn(0x7fe3a80a6b80 msgr2=0x7fe3a80a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- 172.21.15.106:0/426373673 shutdown_connections 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- 172.21.15.106:0/426373673 wait complete. 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: monmap: 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.101 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 Processor -- start 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 1 -- start start 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: init 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient: _add_conns ranks=[2,8,5,6,3,4,7,1,0] 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.113+0000 7fe3af26e640 10 monclient(hunting): picked mon.noname-b con 0x7fe3a80a0b20 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient(hunting): picked mon.noname-e con 0x7fe3a8137730 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:51.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient(hunting): picked mon.noname-h con 0x7fe3a8138220 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a80a19d0 con 0x7fe3a80a0b20 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a81c9a70 con 0x7fe3a8138220 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3a809f320 con 0x7fe3a8137730 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient(hunting): authenticate will time out at 2086.644042s 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3ad00a640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7fe3a80a0b20 legacy=0x7fe3a81c8c50 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3ac809640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7fe3a8137730 legacy=0x7fe3a81c9360 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3ad80b640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fe3a8138220 0x7fe3a81d46e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:56914/0 (socket says 172.21.15.106:56914) 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3ad80b640 1 -- 172.21.15.106:0/3736139556 learned_addr learned my addr 172.21.15.106:0/3736139556 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1304100536 0 0) 0x7fe3a81c9a70 con 0x7fe3a8138220 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): my global_id is 254687 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe38c003530 con 0x7fe3a8138220 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 571518591 0 0) 0x7fe38c003530 con 0x7fe3a8138220 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3a81c9a70 con 0x7fe3a8138220 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a0001a00 con 0x7fe3a8138220 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): dump: 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.104 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4241964076 0 0) 0x7fe3a81c9a70 con 0x7fe3a8138220 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.106:6793/0 conn(0x7fe3a8137730 legacy=0x7fe3a81c9360 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.106:6790/0 conn(0x7fe3a80a0b20 legacy=0x7fe3a81c8c50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 monclient: found mon.h 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:51.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3a809f600 con 0x7fe3a8138220 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: _finish_auth 0 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 5 monclient: authenticate success, global_id 254687 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient: _renew_subs 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3a809d910 con 0x7fe3a8138220 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient: _renew_subs 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3a80a0540 con 0x7fe3a8138220 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3a00038d0 con 0x7fe3a8138220 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a0003e40 con 0x7fe3a8138220 2024-04-26T00:13:51.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39f7fe640 4 set_mon_vals no callback set 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: dump: 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.107 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe3880065d0 con 0x7fe388002870 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219817850 0 0) 0x7fe3880065d0 con 0x7fe388002870 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient(hunting): my global_id is 274576 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3a81c9a70 con 0x7fe388002870 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe3a0003fe0 con 0x7fe3a8138220 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fe3a00451b0 con 0x7fe3a8138220 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1222016243 0 0) 0x7fe3a81c9a70 con 0x7fe388002870 2024-04-26T00:13:51.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3880065d0 con 0x7fe388002870 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a40015a0 con 0x7fe388002870 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: dump: 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.109 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe3ac809640 10 monclient: get_auth_request con 0x7fe38c037800 auth_method 0 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 736768172 0 0) 0x7fe3880065d0 con 0x7fe388002870 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe38800a160 con 0x7fe388002870 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe3a4002020 con 0x7fe388002870 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.106:6791/0 conn(0x7fe388002870 legacy=0x7fe388004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.117+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.106:6791/0 conn(0x7fe388002870 legacy=0x7fe388004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe388009e30 con 0x7fe3880090f0 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 880156651 0 0) 0x7fe388009e30 con 0x7fe3880090f0 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient(hunting): my global_id is 274585 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3880065d0 con 0x7fe3880090f0 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3986211127 0 0) 0x7fe3880065d0 con 0x7fe3880090f0 2024-04-26T00:13:51.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe388009e30 con 0x7fe3880090f0 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3a40055c0 con 0x7fe3880090f0 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient: dump: 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.113 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1238717024 0 0) 0x7fe388009e30 con 0x7fe3880090f0 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe38800c3a0 con 0x7fe3880090f0 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7522 (unknown 0 0 1544212289) 0x7fe3a4001c00 con 0x7fe3880090f0 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.106:6791/0 conn(0x7fe3880090f0 legacy=0x7fe388009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe39dffb640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.106:6791/0 conn(0x7fe3880090f0 legacy=0x7fe388009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 122, 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 179204, 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:13:51.115 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.116 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.117 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:51.118 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.119 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.120 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.121 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.122 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.123 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.124 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:51.125 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:51.126 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.127 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:51.128 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.129 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:51.130 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.131 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:51.132 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:51.133 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:51.134 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.171:6812/722422047 conn(0x7fe38c037800 legacy=0x7fe38c039cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 10 monclient: shutdown 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 >> v1:172.21.15.171:6791/0 conn(0x7fe3a8138220 legacy=0x7fe3a81d46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3ad80b640 1 -- 172.21.15.106:0/3736139556 reap_dead start 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3ad80b640 1 -- 172.21.15.106:0/3736139556 reap_dead start 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 shutdown_connections 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 >> 172.21.15.106:0/3736139556 conn(0x7fe3a80a6b80 msgr2=0x7fe3a80a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 shutdown_connections 2024-04-26T00:13:51.135 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.125+0000 7fe3af26e640 1 -- 172.21.15.106:0/3736139556 wait complete. 2024-04-26T00:13:51.135 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:13:51.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon d 2024-04-26T00:13:51.136 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:13:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: get_monmap_and_config 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: monmap: 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:51.278558+0000 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:51.278558+0000 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.250 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 Processor -- start 2024-04-26T00:13:51.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- start start 2024-04-26T00:13:51.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: init 2024-04-26T00:13:51.257 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: _add_conns ranks=[8,0,5,7,1,2,6,3,4] 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient(hunting): picked mon.noname-e con 0x7f5d48071bc0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient(hunting): picked mon.noname-a con 0x7f5d4809e6f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient(hunting): picked mon.noname-h con 0x7f5d4806f5d0 addr v1:172.21.15.171:6791/0 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4809fba0 con 0x7f5d4809e6f0 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d4809fe80 con 0x7f5d4806f5d0 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d480a0c20 con 0x7f5d48071bc0 2024-04-26T00:13:51.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient(hunting): authenticate will time out at 2086.805537s 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4ddb3640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5d48071bc0 legacy=0x7f5d48071fa0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4d5b2640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 0x7f5d481396c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53166/0 (socket says 172.21.15.106:53166) 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4d5b2640 1 -- 172.21.15.106:0/4212875840 learned_addr learned my addr 172.21.15.106:0/4212875840 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2975087627 0 0) 0x7f5d4809fba0 con 0x7f5d4809e6f0 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient(hunting): my global_id is 274491 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d34005740 con 0x7f5d4809e6f0 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1830749419 0 0) 0x7f5d34005740 con 0x7f5d4809e6f0 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 >> v1:172.21.15.106:6793/0 conn(0x7f5d48071bc0 legacy=0x7f5d48071fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 >> v1:172.21.15.171:6791/0 conn(0x7f5d4806f5d0 legacy=0x7f5d4813cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: _finish_hunting 0 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 monclient: found mon.noname-a 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d480a0f70 con 0x7f5d4809e6f0 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: _finish_auth 0 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: _check_auth_tickets 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d380017c0 con 0x7f5d4809e6f0 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: dump: 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.260 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 5 monclient: authenticate success, global_id 274491 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:51.261 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d38001b20 con 0x7f5d4809e6f0 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 1 -- 172.21.15.106:0/4212875840 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d38001d50 con 0x7f5d4809e6f0 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 4 set_mon_vals no callback set 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d4cdb1640 10 monclient: dump: 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.262 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: shutdown 2024-04-26T00:13:51.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- 172.21.15.106:0/4212875840 >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 legacy=0x7f5d481396c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- 172.21.15.106:0/4212875840 shutdown_connections 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- 172.21.15.106:0/4212875840 >> 172.21.15.106:0/4212875840 conn(0x7f5d480a6fe0 msgr2=0x7f5d480a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- 172.21.15.106:0/4212875840 shutdown_connections 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- 172.21.15.106:0/4212875840 wait complete. 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: monmap: 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.264 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 Processor -- start 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 1 -- start start 2024-04-26T00:13:51.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.277+0000 7f5d50017640 10 monclient: init 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient: _add_conns ranks=[3,7,0,2,5,8,6,4,1] 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient(hunting): picked mon.noname-g con 0x7f5d4806f5d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient(hunting): picked mon.noname-i con 0x7f5d48071bc0 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient(hunting): picked mon.noname-a con 0x7f5d4809e6f0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d48134150 con 0x7f5d4809e6f0 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d48072a50 con 0x7f5d4806f5d0 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d48121130 con 0x7f5d48071bc0 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient(hunting): authenticate will time out at 2086.808502s 2024-04-26T00:13:51.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d4ddb3640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f5d4806f5d0 legacy=0x7f5d48133a40 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d4e5b4640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 0x7f5d481d04b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53174/0 (socket says 172.21.15.106:53174) 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d4e5b4640 1 -- 172.21.15.106:0/823790591 learned_addr learned my addr 172.21.15.106:0/823790591 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616171296 0 0) 0x7f5d48134150 con 0x7f5d4809e6f0 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): my global_id is 274500 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2c003560 con 0x7f5d4809e6f0 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 824825985 0 0) 0x7f5d2c003560 con 0x7f5d4809e6f0 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d48134150 con 0x7f5d4809e6f0 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d44001e20 con 0x7f5d4809e6f0 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): dump: 2024-04-26T00:13:51.267 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.268 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.269 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.269 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:51.270 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d4e5b4640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 legacy=0x7f5d481d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d4e5b4640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 legacy=0x7f5d481d04b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d4e5b4640 1 --1- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 0x7f5d481d04b0 :-1 s=OPENED pgs=1177 cs=1 l=1).handle_message read tag failed 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d4e5b4640 1 --1- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 0x7f5d481d04b0 :-1 s=OPENED pgs=1177 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6789/0 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267277507 0 0) 0x7f5d48121130 con 0x7f5d48071bc0 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.271 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): my global_id is 146860 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2c003560 con 0x7f5d48071bc0 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2937143870 0 0) 0x7f5d2c003560 con 0x7f5d48071bc0 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d48121130 con 0x7f5d48071bc0 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d38001780 con 0x7f5d48071bc0 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): dump: 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.272 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 10056393 0 0) 0x7f5d48121130 con 0x7f5d48071bc0 2024-04-26T00:13:51.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.171:6790/0 conn(0x7f5d4806f5d0 legacy=0x7f5d48133a40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6789/0 conn(0x7f5d4809e6f0 legacy=0x7f5d481d04b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 monclient: found mon.i 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d48121c90 con 0x7f5d48071bc0 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 5 monclient: authenticate success, global_id 146860 2024-04-26T00:13:51.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient: _renew_subs 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5d48123420 con 0x7f5d48071bc0 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient: _renew_subs 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5d481220a0 con 0x7f5d48071bc0 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d38001b20 con 0x7f5d48071bc0 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d38004f70 con 0x7f5d48071bc0 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3f7fe640 4 set_mon_vals no callback set 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: dump: 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.275 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.276 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d300065d0 con 0x7f5d30002870 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3378376387 0 0) 0x7f5d300065d0 con 0x7f5d30002870 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient(hunting): my global_id is 254733 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d48121130 con 0x7f5d30002870 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2575811343 0 0) 0x7f5d48121130 con 0x7f5d30002870 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d300065d0 con 0x7f5d30002870 2024-04-26T00:13:51.277 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d40004050 con 0x7f5d30002870 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: dump: 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.278 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1080034250 0 0) 0x7f5d300065d0 con 0x7f5d30002870 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d3000a160 con 0x7f5d30002870 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5d3800fd10 con 0x7f5d48071bc0 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5d38044e40 con 0x7f5d48071bc0 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5d40006440 con 0x7f5d30002870 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6792/0 conn(0x7f5d30002870 legacy=0x7f5d30004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.279 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.281+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6792/0 conn(0x7f5d30002870 legacy=0x7f5d30004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:51.280 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.285+0000 7f5d4e5b4640 10 monclient: get_auth_request con 0x7f5d2c038220 auth_method 0 2024-04-26T00:13:51.281 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d30009e90 con 0x7f5d30009150 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1261860990 0 0) 0x7f5d30009e90 con 0x7f5d30009150 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient(hunting): my global_id is 254742 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d300065d0 con 0x7f5d30009150 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1946639433 0 0) 0x7f5d300065d0 con 0x7f5d30009150 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d30009e90 con 0x7f5d30009150 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d40004cf0 con 0x7f5d30009150 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient: dump: 2024-04-26T00:13:51.282 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.283 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 126492982 0 0) 0x7f5d30009e90 con 0x7f5d30009150 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d3000c390 con 0x7f5d30009150 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7692 (unknown 0 0 4053485054) 0x7f5d400061c0 con 0x7f5d30009150 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6792/0 conn(0x7f5d30009150 legacy=0x7f5d300095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d3e7fc640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.106:6792/0 conn(0x7f5d30009150 legacy=0x7f5d300095e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:51.284 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 122, 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 301350, 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.285 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.286 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.287 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:51.288 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.289 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.290 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.291 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:51.292 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.293 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.294 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.295 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:51.296 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.297 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.298 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:51.299 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.300 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.301 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.302 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:51.303 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:51.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.171:6812/722422047 conn(0x7f5d2c038220 legacy=0x7f5d2c03a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.304 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 10 monclient: shutdown 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 >> v1:172.21.15.171:6792/0 conn(0x7f5d48071bc0 legacy=0x7f5d481ccd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d4e5b4640 1 -- 172.21.15.106:0/823790591 reap_dead start 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d4e5b4640 1 -- 172.21.15.106:0/823790591 reap_dead start 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 shutdown_connections 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 >> 172.21.15.106:0/823790591 conn(0x7f5d480a6fe0 msgr2=0x7f5d480a5420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 shutdown_connections 2024-04-26T00:13:51.305 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.289+0000 7f5d50017640 1 -- 172.21.15.106:0/823790591 wait complete. 2024-04-26T00:13:51.305 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:13:51.305 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-04-26T00:13:51.306 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:13:51.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.437+0000 7fadc3fee640 10 monclient: get_monmap_and_config 2024-04-26T00:13:51.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.437+0000 7fadc3fee640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.437+0000 7fadc3fee640 10 monclient: monmap: 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:51.441910+0000 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:51.441910+0000 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.413 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 Processor -- start 2024-04-26T00:13:51.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- start start 2024-04-26T00:13:51.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: init 2024-04-26T00:13:51.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: _add_conns ranks=[4,2,0,1,3,5,7,6,8] 2024-04-26T00:13:51.422 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): picked mon.noname-c con 0x7fadbc134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): picked mon.noname-b con 0x7fadbc0a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): picked mon.noname-a con 0x7fadbc13e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc06dd40 con 0x7fadbc13e200 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc0a2b10 con 0x7fadbc0a4820 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc0a2df0 con 0x7fadbc134970 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): authenticate will time out at 2086.968725s 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc1589640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7fadbc0a4820 legacy=0x7fadbc13cae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc258b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fadbc13e200 0x7fadbc1405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53182/0 (socket says 172.21.15.106:53182) 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc258b640 1 -- 172.21.15.106:0/1949627356 learned_addr learned my addr 172.21.15.106:0/1949627356 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2102028177 0 0) 0x7fadbc06dd40 con 0x7fadbc13e200 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): my global_id is 274509 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada8003530 con 0x7fadbc13e200 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1210610740 0 0) 0x7fadbc0a2df0 con 0x7fadbc134970 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient(hunting): my global_id is 274594 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadbc06dd40 con 0x7fadbc134970 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4013179704 0 0) 0x7fada8003530 con 0x7fadbc13e200 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 >> v1:172.21.15.106:6791/0 conn(0x7fadbc134970 legacy=0x7fadbc134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 >> v1:172.21.15.106:6790/0 conn(0x7fadbc0a4820 legacy=0x7fadbc13cae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:51.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: _finish_hunting 0 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 monclient: found mon.noname-a 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc0a30d0 con 0x7fadbc13e200 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: _finish_auth 0 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: _check_auth_tickets 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 5 monclient: authenticate success, global_id 274509 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadb4001b40 con 0x7fadbc13e200 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: dump: 2024-04-26T00:13:51.425 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.426 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadb4001df0 con 0x7fadbc13e200 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 1 -- 172.21.15.106:0/1949627356 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadb4004f70 con 0x7fadbc13e200 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 4 set_mon_vals no callback set 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:51.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc0d88640 10 monclient: dump: 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.428 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: shutdown 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- 172.21.15.106:0/1949627356 >> v1:172.21.15.106:6789/0 conn(0x7fadbc13e200 legacy=0x7fadbc1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- 172.21.15.106:0/1949627356 shutdown_connections 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- 172.21.15.106:0/1949627356 >> 172.21.15.106:0/1949627356 conn(0x7fadbc0a9e20 msgr2=0x7fadbc0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- 172.21.15.106:0/1949627356 shutdown_connections 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- 172.21.15.106:0/1949627356 wait complete. 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: monmap: 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:51.429 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 Processor -- start 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- start start 2024-04-26T00:13:51.430 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: init 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient: _add_conns ranks=[3,4,1,0,2,7,6,8,5] 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): picked mon.noname-g con 0x7fadbc0a4820 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): picked mon.noname-c con 0x7fadbc134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): picked mon.noname-f con 0x7fadbc13e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc13a6d0 con 0x7fadbc13e200 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc13bcb0 con 0x7fadbc0a4820 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadbc13bf90 con 0x7fadbc134970 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc3fee640 10 monclient(hunting): authenticate will time out at 2086.971472s 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc1589640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fadbc134970 0x7fadbc138fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:55230/0 (socket says 172.21.15.106:55230) 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc1589640 1 -- 172.21.15.106:0/1243118473 learned_addr learned my addr 172.21.15.106:0/1243118473 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc1d8a640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6790/0 conn(0x7fadbc0a4820 legacy=0x7fadbc1388b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadc258b640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6789/0 conn(0x7fadbc13e200 legacy=0x7fadbc1d47f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:51.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 405347346 0 0) 0x7fadbc13bf90 con 0x7fadbc134970 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): my global_id is 274603 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada0003530 con 0x7fadbc134970 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2044622586 0 0) 0x7fada0003530 con 0x7fadbc134970 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadbc13bf90 con 0x7fadbc134970 2024-04-26T00:13:51.432 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadac004300 con 0x7fadbc134970 2024-04-26T00:13:51.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:51.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:13:51.433 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): dump: 2024-04-26T00:13:51.433 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.433 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.433 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.441+0000 7fadb27fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:51.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1708988393 0 0) 0x7fadbc13bf90 con 0x7fadbc134970 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6790/0 conn(0x7fadbc0a4820 legacy=0x7fadbc1388b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6789/0 conn(0x7fadbc13e200 legacy=0x7fadbc1d47f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 monclient: found mon.c 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadbc1396d0 con 0x7fadbc134970 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: _finish_auth 0 2024-04-26T00:13:51.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:13:51.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:51.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 5 monclient: authenticate success, global_id 274603 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 10 monclient: _renew_subs 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fadbc0a1e00 con 0x7fadbc134970 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 10 monclient: _renew_subs 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fadbc13aae0 con 0x7fadbc134970 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadac004660 con 0x7fadbc134970 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadac004bd0 con 0x7fadbc134970 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb3fff640 4 set_mon_vals no callback set 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: dump: 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.437 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.438 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fada40065d0 con 0x7fada4002870 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fadac004df0 con 0x7fadbc134970 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fadac0452a0 con 0x7fadbc134970 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadc258b640 10 monclient: get_auth_request con 0x7fada0037780 auth_method 0 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3862593992 0 0) 0x7fada40065d0 con 0x7fada4002870 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient(hunting): my global_id is 254705 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadbc13bf90 con 0x7fada4002870 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2323774709 0 0) 0x7fadbc13bf90 con 0x7fada4002870 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fada40065d0 con 0x7fada4002870 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadb80018b0 con 0x7fada4002870 2024-04-26T00:13:51.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: dump: 2024-04-26T00:13:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.440 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.441 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.441 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.442 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.443 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.443 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.443 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.443 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.443 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1791687199 0 0) 0x7fada40065d0 con 0x7fada4002870 2024-04-26T00:13:51.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fada400a160 con 0x7fada4002870 2024-04-26T00:13:51.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fadb80057d0 con 0x7fada4002870 2024-04-26T00:13:51.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:51.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:51.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6791/0 conn(0x7fada4002870 legacy=0x7fada4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.444 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.445+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6791/0 conn(0x7fada4002870 legacy=0x7fada4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:51.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:51.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fada4009e50 con 0x7fada4009110 2024-04-26T00:13:51.447 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4066109458 0 0) 0x7fada4009e50 con 0x7fada4009110 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient(hunting): my global_id is 254714 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fada40065d0 con 0x7fada4009110 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4236968651 0 0) 0x7fada40065d0 con 0x7fada4009110 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fada4009e50 con 0x7fada4009110 2024-04-26T00:13:51.448 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fadb8003c10 con 0x7fada4009110 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient: dump: 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.449 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.450 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.450 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.450 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.450 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.450 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.450 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.450 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.451 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.451 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.451 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1321694719 0 0) 0x7fada4009e50 con 0x7fada4009110 2024-04-26T00:13:51.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fada400c3e0 con 0x7fada4009110 2024-04-26T00:13:51.451 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7692 (unknown 0 0 2424930044) 0x7fadb8005980 con 0x7fada4009110 2024-04-26T00:13:51.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:51.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:51.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6791/0 conn(0x7fada4009110 legacy=0x7fada40095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.452 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadb27fc640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6791/0 conn(0x7fada4009110 legacy=0x7fada40095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:51.453 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:51.453 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:51.453 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:51.453 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:51.453 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 122, 2024-04-26T00:13:51.453 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 301509, 2024-04-26T00:13:51.454 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:51.454 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:51.454 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:51.454 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:51.454 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:51.454 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:13:51.455 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.455 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:13:51.455 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:51.455 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:51.455 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:51.455 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:51.456 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:51.457 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:51.458 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.459 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.460 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.461 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.462 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.463 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.464 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.465 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.466 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:51.467 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:51.467 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.467 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.467 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.467 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.467 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:51.468 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.469 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.470 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:51.471 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.471 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.471 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.471 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.471 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:51.471 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.473 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.474 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:51.475 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.476 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.477 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.477 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:51.477 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.477 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.477 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:51.477 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:13:51.478 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:51.479 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:51.479 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:51.479 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:51.479 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.171:6812/722422047 conn(0x7fada0037780 legacy=0x7fada0039c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 10 monclient: shutdown 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 >> v1:172.21.15.106:6791/0 conn(0x7fadbc134970 legacy=0x7fadbc138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc258b640 1 -- 172.21.15.106:0/1243118473 reap_dead start 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc258b640 1 -- 172.21.15.106:0/1243118473 reap_dead start 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 shutdown_connections 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 >> 172.21.15.106:0/1243118473 conn(0x7fadbc0a9e20 msgr2=0x7fadbc1309a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 shutdown_connections 2024-04-26T00:13:51.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.453+0000 7fadc3fee640 1 -- 172.21.15.106:0/1243118473 wait complete. 2024-04-26T00:13:51.482 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:13:51.482 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon i 2024-04-26T00:13:51.482 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: get_monmap_and_config 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: monmap: 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:13:51.626858+0000 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:13:51.626858+0000 2024-04-26T00:13:51.597 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.598 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 Processor -- start 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- start start 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: init 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: _add_conns ranks=[3,0,7,8,4,6,1,2,5] 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient(hunting): picked mon.noname-g con 0x7f90b8134820 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient(hunting): picked mon.noname-a con 0x7f90b80725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:51.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient(hunting): picked mon.noname-i con 0x7f90b813ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b8071270 con 0x7f90b80725d0 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b80714e0 con 0x7f90b8134820 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b80729f0 con 0x7f90b813ace0 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient(hunting): authenticate will time out at 2087.153908s 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b7fff640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f90b80725d0 0x7f90b81395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53196/0 (socket says 172.21.15.106:53196) 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b7fff640 1 -- 172.21.15.106:0/2390256025 learned_addr learned my addr 172.21.15.106:0/2390256025 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90bc8f0640 1 -- 172.21.15.106:0/2390256025 >> v1:172.21.15.171:6790/0 conn(0x7f90b8134820 legacy=0x7f90b8134c00 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1784750712 0 0) 0x7f90b8071270 con 0x7f90b80725d0 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient(hunting): my global_id is 274518 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a0005740 con 0x7f90b80725d0 2024-04-26T00:13:51.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1261411507 0 0) 0x7f90a0005740 con 0x7f90b80725d0 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 >> v1:172.21.15.171:6792/0 conn(0x7f90b813ace0 legacy=0x7f90b813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 >> v1:172.21.15.171:6790/0 conn(0x7f90b8134820 legacy=0x7f90b8134c00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 monclient: found mon.noname-a 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b80717c0 con 0x7f90b80725d0 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: _finish_auth 0 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 5 monclient: authenticate success, global_id 274518 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f90ac0017c0 con 0x7f90b80725d0 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: dump: 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.605 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90ac001b20 con 0x7f90b80725d0 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 1 -- 172.21.15.106:0/2390256025 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f90ac001d50 con 0x7f90b80725d0 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90b77fe640 10 monclient: dump: 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.606 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: get_monmap_and_config success 2024-04-26T00:13:51.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 4 set_mon_vals no callback set 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: shutdown 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- 172.21.15.106:0/2390256025 >> v1:172.21.15.106:6789/0 conn(0x7f90b80725d0 legacy=0x7f90b81395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- 172.21.15.106:0/2390256025 shutdown_connections 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- 172.21.15.106:0/2390256025 >> 172.21.15.106:0/2390256025 conn(0x7f90b80a64e0 msgr2=0x7f90b80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- 172.21.15.106:0/2390256025 shutdown_connections 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 1 -- 172.21.15.106:0/2390256025 wait complete. 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: build_initial_monmap 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.625+0000 7f90beb54640 10 monclient: monmap: 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:13:51.608 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:13:51.609 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 1 Processor -- start 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 1 -- start start 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient: init 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient: _reopen_session rank -1 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient: _add_conns ranks=[8,2,1,5,4,6,7,0,3] 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient(hunting): picked mon.noname-e con 0x7f90b80725d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient(hunting): picked mon.noname-b con 0x7f90b8134820 addr v1:172.21.15.106:6790/0 2024-04-26T00:13:51.610 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient(hunting): picked mon.noname-f con 0x7f90b813ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b809e880 con 0x7f90b813ace0 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b809eb60 con 0x7f90b8134820 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b80706a0 con 0x7f90b80725d0 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90beb54640 10 monclient(hunting): authenticate will time out at 2087.156636s 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90bc8f0640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f90b80725d0 legacy=0x7f90b812b3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90b7fff640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f90b8134820 legacy=0x7f90b81cd2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:51.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.629+0000 7f90bd0f1640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f90b813ace0 legacy=0x7f90b81d09d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:51.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.833+0000 7f90b7fff640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f90b8134820 legacy=0x7f90b81cd2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:51.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.833+0000 7f90bc8f0640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f90b80725d0 legacy=0x7f90b812b3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:51.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:51.833+0000 7f90bd0f1640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f90b813ace0 legacy=0x7f90b81d09d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:52.208 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:52.237+0000 7f90b7fff640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f90b8134820 legacy=0x7f90b81cd2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:52.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:52.237+0000 7f90bc8f0640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f90b80725d0 legacy=0x7f90b812b3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:52.209 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:52.237+0000 7f90bd0f1640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f90b813ace0 legacy=0x7f90b81d09d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:53.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:53.041+0000 7f90b7fff640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f90b8134820 legacy=0x7f90b81cd2a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:13:53.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:53.041+0000 7f90bc8f0640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f90b80725d0 legacy=0x7f90b812b3f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:13:53.013 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:53.041+0000 7f90bd0f1640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f90b813ace0 legacy=0x7f90b81d09d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:13:54.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient(hunting): tick 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 1 monclient(hunting): continuing hunt 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f90b80725d0 legacy=0x7f90b812b3f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f90b8134820 legacy=0x7f90b81cd2a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f90b813ace0 legacy=0x7f90b81d09d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient: _add_conns ranks=[4,3,0,6,7,5] 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient(hunting): picked mon.noname-c con 0x7f9098003790 addr v1:172.21.15.106:6791/0 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient(hunting): picked mon.noname-g con 0x7f9098007420 addr v1:172.21.15.171:6790/0 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient(hunting): picked mon.noname-a con 0x7f909800b1b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b8072c60 con 0x7f909800b1b0 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b809e880 con 0x7f9098007420 2024-04-26T00:13:54.603 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b809eb60 con 0x7f9098003790 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f909ffff640 10 monclient(hunting): _renew_subs 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90bd0f1640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f909800b1b0 0x7f909800d670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:53224/0 (socket says 172.21.15.106:53224) 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90bd0f1640 1 -- 172.21.15.106:0/687774355 learned_addr learned my addr 172.21.15.106:0/687774355 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b7fff640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f9098007420 legacy=0x7f90980098e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895427797 0 0) 0x7f90b8072c60 con 0x7f909800b1b0 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): my global_id is 274527 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90a4003530 con 0x7f909800b1b0 2024-04-26T00:13:54.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3426589444 0 0) 0x7f90b809eb60 con 0x7f9098003790 2024-04-26T00:13:54.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:13:54.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:54.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:54.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): my global_id is 274612 2024-04-26T00:13:54.605 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90b8072c60 con 0x7f9098003790 2024-04-26T00:13:54.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 652534568 0 0) 0x7f90a4003530 con 0x7f909800b1b0 2024-04-26T00:13:54.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90b809eb60 con 0x7f909800b1b0 2024-04-26T00:13:54.608 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f90b0001dd0 con 0x7f909800b1b0 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): dump: 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:54.609 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:54.610 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:54.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:13:54.611 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3752974478 0 0) 0x7f90b8072c60 con 0x7f9098003790 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90a4003530 con 0x7f9098003790 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f90a8004280 con 0x7f9098003790 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient(hunting): dump: 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:54.612 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2414018746 0 0) 0x7f90b809eb60 con 0x7f909800b1b0 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.106:6791/0 conn(0x7f9098003790 legacy=0x7f9098005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.171:6790/0 conn(0x7f9098007420 legacy=0x7f90980098e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 monclient: found mon.a 2024-04-26T00:13:54.613 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b80706a0 con 0x7f909800b1b0 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: _finish_auth 0 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90beb54640 5 monclient: authenticate success, global_id 274527 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90bd0f1640 1 -- 172.21.15.106:0/687774355 reap_dead start 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90beb54640 10 monclient: _renew_subs 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90beb54640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f90b809f260 con 0x7f909800b1b0 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90beb54640 10 monclient: _renew_subs 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90beb54640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f90b812b3f0 con 0x7f909800b1b0 2024-04-26T00:13:54.614 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f90b00020b0 con 0x7f909800b1b0 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f90b0003ff0 con 0x7f909800b1b0 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b57fa640 10 monclient: dump: 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:54.615 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.629+0000 7f90b6ffd640 4 set_mon_vals no callback set 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90beb54640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f90b0004210 con 0x7f909800b1b0 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f90b0045360 con 0x7f909800b1b0 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f90900065d0 con 0x7f9090002870 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90bc8f0640 10 monclient: get_auth_request con 0x7f90a4037c20 auth_method 0 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 153754530 0 0) 0x7f90900065d0 con 0x7f9090002870 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:13:54.616 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 10 monclient(hunting): my global_id is 146887 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90b809eb60 con 0x7f9090002870 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1746718099 0 0) 0x7f90b809eb60 con 0x7f9090002870 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f90900065d0 con 0x7f9090002870 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f90ac0011e0 con 0x7f9090002870 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 10 monclient: dump: 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.617 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1231878975 0 0) 0x7f90900065d0 con 0x7f9090002870 2024-04-26T00:13:54.618 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.633+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f909000a160 con 0x7f9090002870 2024-04-26T00:13:54.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.637+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f90ac001590 con 0x7f9090002870 2024-04-26T00:13:54.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.637+0000 7f90b57fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:13:54.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.637+0000 7f90b57fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:13:54.620 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.637+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.171:6792/0 conn(0x7f9090002870 legacy=0x7f9090004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.637+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.171:6792/0 conn(0x7f9090002870 legacy=0x7f9090004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.641+0000 7f90beb54640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.641+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9090009e30 con 0x7f90900090f0 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3458361881 0 0) 0x7f9090009e30 con 0x7f90900090f0 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient(hunting): my global_id is 146896 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f90900065d0 con 0x7f90900090f0 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1776624950 0 0) 0x7f90900065d0 con 0x7f90900090f0 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9090009e30 con 0x7f90900090f0 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f90ac005340 con 0x7f90900090f0 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:13:54.621 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient: dump: 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:13:54.622 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1956344914 0 0) 0x7f9090009e30 con 0x7f90900090f0 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f909000c3a0 con 0x7f90900090f0 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7862 (unknown 0 0 4033379842) 0x7f90ac007660 con 0x7f90900090f0 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.171:6792/0 conn(0x7f90900090f0 legacy=0x7f9090009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90b57fa640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.171:6792/0 conn(0x7f90900090f0 legacy=0x7f9090009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:54.623 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 122, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 898174, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: 7 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 4, 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:13:54.624 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:13:54.625 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:13:54.626 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:13:54.627 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.628 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:13:54.629 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.630 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:13:54.631 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.632 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.633 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.634 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.635 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.636 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:13:54.637 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.638 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.639 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:54.640 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:54.641 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:13:54.642 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:13:54.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.171:6812/722422047 conn(0x7f90a4037c20 legacy=0x7f90a403a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:54.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 10 monclient: shutdown 2024-04-26T00:13:54.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:13:54.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 >> v1:172.21.15.106:6789/0 conn(0x7f909800b1b0 legacy=0x7f909800d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:13:54.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 shutdown_connections 2024-04-26T00:13:54.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 >> 172.21.15.106:0/687774355 conn(0x7f90b80a64e0 msgr2=0x7f90b80a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:13:54.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 shutdown_connections 2024-04-26T00:13:54.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:13:54.645+0000 7f90beb54640 1 -- 172.21.15.106:0/687774355 wait complete. 2024-04-26T00:13:54.644 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-04-26T00:13:54.644 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-04-26T00:14:36.087 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=13 2024-04-26T00:14:36.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 13 -ne 13 ]] 2024-04-26T00:14:36.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:14:36.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ rm /tmp/cephtest-mon-caps-madness.bazar.keyring /tmp/cephtest-mon-caps-madness.foo.keyring /tmp/cephtest-mon-caps-madness.bar.keyring 2024-04-26T00:14:36.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ cat 2024-04-26T00:14:36.088 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph auth import -i - 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.225+0000 7f5f3ca6f640 10 monclient: get_monmap_and_config 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.225+0000 7f5f3ca6f640 10 monclient: build_initial_monmap 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.225+0000 7f5f3ca6f640 10 monclient: monmap: 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:14:36.230216+0000 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:14:36.230216+0000 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:36.203 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:36.204 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 Processor -- start 2024-04-26T00:14:36.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- start start 2024-04-26T00:14:36.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient: init 2024-04-26T00:14:36.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:36.211 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient: _add_conns ranks=[2,8,4,3,0,6,5,1,7] 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient(hunting): picked mon.noname-b con 0x7f5f380a4b10 addr v1:172.21.15.106:6790/0 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient(hunting): picked mon.noname-e con 0x7f5f3809ce30 addr v1:172.21.15.106:6793/0 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient(hunting): picked mon.noname-c con 0x7f5f380a5f50 addr v1:172.21.15.106:6791/0 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3809be90 con 0x7f5f380a4b10 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f380a7aa0 con 0x7f5f380a5f50 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3809bbb0 con 0x7f5f3809ce30 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient(hunting): authenticate will time out at 2126.937409s 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f35d9b640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f5f3809ce30 legacy=0x7f5f3813cd20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3659c640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f5f380a4b10 legacy=0x7f5f380a4ef0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f36d9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f5f380a5f50 0x7f5f38140450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:36844/0 (socket says 172.21.15.171:36844) 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f36d9d640 1 -- 172.21.15.171:0/2932295361 learned_addr learned my addr 172.21.15.171:0/2932295361 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:36.212 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2712668550 0 0) 0x7f5f380a7aa0 con 0x7f5f380a5f50 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient(hunting): _negotiate 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient(hunting): my global_id is 274675 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f20003530 con 0x7f5f380a5f50 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4278037850 0 0) 0x7f5f20003530 con 0x7f5f380a5f50 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 >> v1:172.21.15.106:6793/0 conn(0x7f5f3809ce30 legacy=0x7f5f3813cd20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 >> v1:172.21.15.106:6790/0 conn(0x7f5f380a4b10 legacy=0x7f5f380a4ef0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: _finish_hunting 0 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 monclient: found mon.noname-c 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f3809c170 con 0x7f5f380a5f50 2024-04-26T00:14:36.213 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: _finish_auth 0 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: _check_auth_tickets 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f30001b40 con 0x7f5f380a5f50 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: dump: 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.214 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 5 monclient: authenticate success, global_id 274675 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f30001da0 con 0x7f5f380a5f50 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 1 -- 172.21.15.171:0/2932295361 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f30004f70 con 0x7f5f380a5f50 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:36.215 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3559a640 10 monclient: dump: 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.216 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient: get_monmap_and_config success 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 4 set_mon_vals no callback set 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 10 monclient: shutdown 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/2932295361 >> v1:172.21.15.106:6791/0 conn(0x7f5f380a5f50 legacy=0x7f5f38140450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/2932295361 shutdown_connections 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/2932295361 >> 172.21.15.171:0/2932295361 conn(0x7f5f380aa770 msgr2=0x7f5f380a6c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/2932295361 shutdown_connections 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.229+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/2932295361 wait complete. 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: build_initial_monmap 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: monmap: 2024-04-26T00:14:36.217 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:36.218 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 Processor -- start 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 -- start start 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: init 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _add_conns ranks=[5,0,2,6,4,1,7,3,8] 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient(hunting): picked mon.noname-h con 0x7f5f3809ce30 addr v1:172.21.15.171:6791/0 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient(hunting): picked mon.noname-a con 0x7f5f380a4b10 addr v1:172.21.15.106:6789/0 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient(hunting): picked mon.noname-b con 0x7f5f380a5f50 addr v1:172.21.15.106:6790/0 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f381ab690 con 0x7f5f380a4b10 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f3809d570 con 0x7f5f380a5f50 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f381ab3b0 con 0x7f5f3809ce30 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:36.219 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient(hunting): authenticate will time out at 2126.941610s 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f36d9d640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f5f380a5f50 legacy=0x7f5f381d4710 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3659c640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f5f3809ce30 0x7f5f381bbf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42648/0 (socket says 172.21.15.171:42648) 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3659c640 1 -- 172.21.15.171:0/339705582 learned_addr learned my addr 172.21.15.171:0/339705582 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2085562350 0 0) 0x7f5f381ab3b0 con 0x7f5f3809ce30 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): my global_id is 254768 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f18003530 con 0x7f5f3809ce30 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1000556107 0 0) 0x7f5f18003530 con 0x7f5f3809ce30 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f381ab3b0 con 0x7f5f3809ce30 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f28004330 con 0x7f5f3809ce30 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:14:36.220 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): dump: 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.221 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275060158 0 0) 0x7f5f381ab690 con 0x7f5f380a4b10 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient(hunting): my global_id is 274581 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f18003530 con 0x7f5f380a4b10 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2563685106 0 0) 0x7f5f381ab3b0 con 0x7f5f3809ce30 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 >> v1:172.21.15.106:6790/0 conn(0x7f5f380a5f50 legacy=0x7f5f381d4710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 >> v1:172.21.15.106:6789/0 conn(0x7f5f380a4b10 legacy=0x7f5f381d0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:14:36.222 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 monclient: found mon.h 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f381a9f30 con 0x7f5f3809ce30 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: _finish_auth 0 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 5 monclient: authenticate success, global_id 254768 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _renew_subs 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f381bc6a0 con 0x7f5f3809ce30 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _renew_subs 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f381cbee0 con 0x7f5f3809ce30 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f28004690 con 0x7f5f3809ce30 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:36.223 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5f28004c00 con 0x7f5f3809ce30 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f34d99640 4 set_mon_vals no callback set 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 10 monclient: dump: 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.224 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5f28004e20 con 0x7f5f3809ce30 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f1c005090 con 0x7f5f3809ce30 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5f28045210 con 0x7f5f3809ce30 2024-04-26T00:14:36.225 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.233+0000 7f5f35d9b640 10 monclient: get_auth_request con 0x7f5f180378c0 auth_method 0 2024-04-26T00:14:36.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.241+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5f28015980 con 0x7f5f3809ce30 2024-04-26T00:14:36.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.241+0000 7f5f26ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:36.226 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.241+0000 7f5f26ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:14:36.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.449+0000 7f5f3ca6f640 10 start_mon_command cmd=[{"prefix": "auth import"}] 2024-04-26T00:14:36.426 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.449+0000 7f5f3ca6f640 10 monclient: _send_command 2 [{"prefix": "auth import"}] 2024-04-26T00:14:36.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.449+0000 7f5f3ca6f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:14:36.427 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.449+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "auth import"} v 0) -- 0x7f5f1c005380 con 0x7f5f3809ce30 2024-04-26T00:14:36.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:14:36.452+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 auth entities have invalid capabilities (AUTH_BAD_CAPS) 2024-04-26T00:14:36.437 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.461+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 10 ==== mon_command_ack([{"prefix": "auth import"}]=0 v40) ==== 59+0+0 (unknown 150836410 0 0) 0x7f5f28015280 con 0x7f5f3809ce30 2024-04-26T00:14:36.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.461+0000 7f5f26ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "auth import"}] 2024-04-26T00:14:36.438 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.461+0000 7f5f26ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:14:36.589 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.613+0000 7f5f3ca6f640 10 start_mon_command cmd=[{"prefix": "auth import"}] 2024-04-26T00:14:36.589 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.613+0000 7f5f3ca6f640 10 monclient: _send_command 3 [{"prefix": "auth import"}] 2024-04-26T00:14:36.589 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.613+0000 7f5f3ca6f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:14:36.589 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.613+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 --> v1:172.21.15.171:6791/0 -- mon_command({"prefix": "auth import"} v 0) -- 0x7f5f1c0010a0 con 0x7f5f3809ce30 2024-04-26T00:14:36.600 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.625+0000 7f5f26ffd640 1 -- 172.21.15.171:0/339705582 <== mon.5 v1:172.21.15.171:6791/0 11 ==== mon_command_ack([{"prefix": "auth import"}]=0 v41) ==== 59+0+0 (unknown 1018960142 0 0) 0x7f5f2801de30 con 0x7f5f3809ce30 2024-04-26T00:14:36.601 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.625+0000 7f5f26ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "auth import"}] 2024-04-26T00:14:36.601 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.625+0000 7f5f26ffd640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 >> v1:172.21.15.171:6812/722422047 conn(0x7f5f180378c0 legacy=0x7f5f18039d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 10 monclient: shutdown 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 >> v1:172.21.15.171:6791/0 conn(0x7f5f3809ce30 legacy=0x7f5f381bbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 shutdown_connections 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 >> 172.21.15.171:0/339705582 conn(0x7f5f380aa770 msgr2=0x7f5f381bd6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 shutdown_connections 2024-04-26T00:14:36.603 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.629+0000 7f5f3ca6f640 1 -- 172.21.15.171:0/339705582 wait complete. 2024-04-26T00:14:36.618 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph health 2024-04-26T00:14:36.618 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep AUTH_BAD_CAP 2024-04-26T00:14:36.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient: get_monmap_and_config 2024-04-26T00:14:36.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient: build_initial_monmap 2024-04-26T00:14:36.720 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient: monmap: 2024-04-26T00:14:36.720 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:36.720 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.720 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:14:36.747947+0000 2024-04-26T00:14:36.720 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:14:36.747947+0000 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:36.721 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:36.722 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 1 Processor -- start 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 1 -- start start 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient: init 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient: _add_conns ranks=[5,0,3,1,6,4,2,7,8] 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient(hunting): picked mon.noname-h con 0x7f16800a3100 addr v1:172.21.15.171:6791/0 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient(hunting): picked mon.noname-a con 0x7f1680072940 addr v1:172.21.15.106:6789/0 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient(hunting): picked mon.noname-g con 0x7f1680072da0 addr v1:172.21.15.171:6790/0 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16800a1c00 con 0x7f1680072940 2024-04-26T00:14:36.728 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16800a1ee0 con 0x7f1680072da0 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16800a21c0 con 0x7f16800a3100 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient(hunting): authenticate will time out at 2127.454952s 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f168548b640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f1680072da0 legacy=0x7f168013df10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1684c8a640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7f16800a3100 0x7f16801354c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.171:42650/0 (socket says 172.21.15.171:42650) 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1684c8a640 1 -- 172.21.15.171:0/4262801094 learned_addr learned my addr 172.21.15.171:0/4262801094 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3506837650 0 0) 0x7f16800a21c0 con 0x7f16800a3100 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient(hunting): my global_id is 254777 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1670003530 con 0x7f16800a3100 2024-04-26T00:14:36.729 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3003042703 0 0) 0x7f1670003530 con 0x7f16800a3100 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 >> v1:172.21.15.171:6790/0 conn(0x7f1680072da0 legacy=0x7f168013df10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 >> v1:172.21.15.106:6789/0 conn(0x7f1680072940 legacy=0x7f168013a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 monclient: found mon.noname-h 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1680136340 con 0x7f16800a3100 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f166c0017c0 con 0x7f16800a3100 2024-04-26T00:14:36.730 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: dump: 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.731 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 5 monclient: authenticate success, global_id 254777 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f166c001ab0 con 0x7f16800a3100 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 10 monclient: get_monmap_and_config success 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 1 -- 172.21.15.171:0/4262801094 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f166c004bf0 con 0x7f16800a3100 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f1686eee640 4 set_mon_vals no callback set 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:14:36.732 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.745+0000 7f167f7fe640 10 monclient: dump: 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.733 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: shutdown 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/4262801094 >> v1:172.21.15.171:6791/0 conn(0x7f16800a3100 legacy=0x7f16801354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/4262801094 shutdown_connections 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/4262801094 >> 172.21.15.171:0/4262801094 conn(0x7f16800a6860 msgr2=0x7f16800a29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/4262801094 shutdown_connections 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/4262801094 wait complete. 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: build_initial_monmap 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: monmap: 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:14:36.734 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.735 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 Processor -- start 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- start start 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: init 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _add_conns ranks=[6,1,7,0,3,2,4,8,5] 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient(hunting): picked mon.noname-d con 0x7f1680072940 addr v1:172.21.15.106:6792/0 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient(hunting): picked mon.noname-f con 0x7f1680072da0 addr v1:172.21.15.171:6789/0 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient(hunting): picked mon.noname-i con 0x7f16800a3100 addr v1:172.21.15.171:6792/0 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1680132f00 con 0x7f1680072da0 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168006ef30 con 0x7f1680072940 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f168012fbb0 con 0x7f16800a3100 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient(hunting): authenticate will time out at 2127.457928s 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167ffff640 1 -- >> v1:172.21.15.171:6789/0 conn(0x7f1680072da0 legacy=0x7f1680131cd0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6789/0 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f168548b640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f16800a3100 0x7f16801d2570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:44132/0 (socket says 172.21.15.171:44132) 2024-04-26T00:14:36.736 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f168548b640 1 -- 172.21.15.171:0/2137873601 learned_addr learned my addr 172.21.15.171:0/2137873601 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2006418304 0 0) 0x7f168012fbb0 con 0x7f16800a3100 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): my global_id is 146950 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1664003530 con 0x7f16800a3100 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3638359602 0 0) 0x7f1664003530 con 0x7f16800a3100 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f168012fbb0 con 0x7f16800a3100 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1678004530 con 0x7f16800a3100 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): dump: 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.737 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.738 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2978689145 0 0) 0x7f168006ef30 con 0x7f1680072940 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient(hunting): my global_id is 254796 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1664003530 con 0x7f1680072940 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 274091182 0 0) 0x7f168012fbb0 con 0x7f16800a3100 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 >> v1:172.21.15.106:6792/0 conn(0x7f1680072940 legacy=0x7f16801315c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 >> v1:172.21.15.171:6789/0 conn(0x7f1680072da0 legacy=0x7f1680131cd0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 monclient: found mon.i 2024-04-26T00:14:36.739 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f168012c3c0 con 0x7f16800a3100 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 5 monclient: authenticate success, global_id 146950 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _renew_subs 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f16801323e0 con 0x7f16800a3100 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _renew_subs 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f16801d3c90 con 0x7f16800a3100 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:36.740 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1680074470 con 0x7f16800a3100 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1678004890 con 0x7f16800a3100 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1678004e00 con 0x7f16800a3100 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167effd640 4 set_mon_vals no callback set 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 10 monclient: dump: 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:36.741 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.749+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1678004fa0 con 0x7f16800a3100 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.753+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f1678045350 con 0x7f16800a3100 2024-04-26T00:14:36.742 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.753+0000 7f1684c8a640 10 monclient: get_auth_request con 0x7f1664037880 auth_method 0 2024-04-26T00:14:36.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.757+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f16780159e0 con 0x7f16800a3100 2024-04-26T00:14:36.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.757+0000 7f167d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:36.743 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.757+0000 7f167d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:14:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.937+0000 7f1686eee640 10 start_mon_command cmd=[{"prefix": "health"}] 2024-04-26T00:14:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.937+0000 7f1686eee640 10 monclient: _send_command 2 [{"prefix": "health"}] 2024-04-26T00:14:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.937+0000 7f1686eee640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.937+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "health"} v 0) -- 0x7f168006f100 con 0x7f16800a3100 2024-04-26T00:14:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.937+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "health"}]=0 v0) ==== 54+0+132 (unknown 2555570491 0 3224879470) 0x7f16780152e0 con 0x7f16800a3100 2024-04-26T00:14:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.937+0000 7f167d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health"}] 2024-04-26T00:14:36.914 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:36.937+0000 7f167d7fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:14:37.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.057+0000 7f1686eee640 10 start_mon_command cmd=[{"prefix": "health"}] 2024-04-26T00:14:37.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.057+0000 7f1686eee640 10 monclient: _send_command 3 [{"prefix": "health"}] 2024-04-26T00:14:37.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.057+0000 7f1686eee640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:37.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.057+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "health"} v 0) -- 0x7f16800008e0 con 0x7f16800a3100 2024-04-26T00:14:37.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.057+0000 7f167d7fa640 1 -- 172.21.15.171:0/2137873601 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "health"}]=0 v0) ==== 54+0+132 (unknown 2555570491 0 3224879470) 0x7f167801de90 con 0x7f16800a3100 2024-04-26T00:14:37.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.057+0000 7f167d7fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "health"}] 2024-04-26T00:14:37.033 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.057+0000 7f167d7fa640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:14:37.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 >> v1:172.21.15.171:6812/722422047 conn(0x7f1664037880 legacy=0x7f1664039d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 10 monclient: shutdown 2024-04-26T00:14:37.035 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:37.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 >> v1:172.21.15.171:6792/0 conn(0x7f16800a3100 legacy=0x7f16801d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 shutdown_connections 2024-04-26T00:14:37.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 >> 172.21.15.171:0/2137873601 conn(0x7f16800a6860 msgr2=0x7f1680133660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:37.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 shutdown_connections 2024-04-26T00:14:37.036 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.061+0000 7f1686eee640 1 -- 172.21.15.171:0/2137873601 wait complete. 2024-04-26T00:14:37.049 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph health detail 2024-04-26T00:14:37.050 INFO:tasks.workunit.client.0.smithi171.stderr:+ grep client.bad 2024-04-26T00:14:37.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.173+0000 7f6178caf640 10 monclient: get_monmap_and_config 2024-04-26T00:14:37.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.173+0000 7f6178caf640 10 monclient: build_initial_monmap 2024-04-26T00:14:37.150 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.173+0000 7f6178caf640 10 monclient: monmap: 2024-04-26T00:14:37.150 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:37.150 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.150 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:14:37.178146+0000 2024-04-26T00:14:37.150 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:14:37.178146+0000 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:37.151 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.158 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 Processor -- start 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- start start 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: init 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: _add_conns ranks=[4,7,8,0,3,5,2,6,1] 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): picked mon.noname-c con 0x7f61740a3100 addr v1:172.21.15.106:6791/0 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): picked mon.noname-i con 0x7f6174072940 addr v1:172.21.15.171:6792/0 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): picked mon.noname-e con 0x7f6174072da0 addr v1:172.21.15.106:6793/0 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61740a1c00 con 0x7f61740a3100 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61740a1ee0 con 0x7f6174072940 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61740a21c0 con 0x7f6174072da0 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): authenticate will time out at 2127.885329s 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6172d9d640 1 -- >> v1:172.21.15.106:6793/0 conn(0x7f6174072da0 legacy=0x7f617413df10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6793/0 2024-04-26T00:14:37.159 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6171d9b640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f6174072940 0x7f617413a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:44142/0 (socket says 172.21.15.171:44142) 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6171d9b640 1 -- 172.21.15.171:0/1514563170 learned_addr learned my addr 172.21.15.171:0/1514563170 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1793739595 0 0) 0x7f61740a1ee0 con 0x7f6174072940 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient(hunting): _negotiate 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient(hunting): my global_id is 146959 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f615c003530 con 0x7f6174072940 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1089195016 0 0) 0x7f615c003530 con 0x7f6174072940 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 >> v1:172.21.15.106:6793/0 conn(0x7f6174072da0 legacy=0x7f617413df10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 >> v1:172.21.15.106:6791/0 conn(0x7f61740a3100 legacy=0x7f61741354c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: _finish_hunting 0 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 monclient: found mon.noname-i 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:37.160 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.171:6792/0 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6174136340 con 0x7f6174072940 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: _finish_auth 0 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: _check_auth_tickets 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f61640017c0 con 0x7f6174072940 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 5 monclient: authenticate success, global_id 146959 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: dump: 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.161 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 <== mon.7 v1:172.21.15.171:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6164001ab0 con 0x7f6174072940 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:37.162 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: get_monmap_and_config success 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 4 set_mon_vals no callback set 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 1 -- 172.21.15.171:0/1514563170 <== mon.7 v1:172.21.15.171:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6164004bf0 con 0x7f6174072940 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f617159a640 10 monclient: dump: 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.163 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: shutdown 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- 172.21.15.171:0/1514563170 >> v1:172.21.15.171:6792/0 conn(0x7f6174072940 legacy=0x7f617413a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- 172.21.15.171:0/1514563170 shutdown_connections 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- 172.21.15.171:0/1514563170 >> 172.21.15.171:0/1514563170 conn(0x7f61740a6860 msgr2=0x7f61740a29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- 172.21.15.171:0/1514563170 shutdown_connections 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- 172.21.15.171:0/1514563170 wait complete. 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: build_initial_monmap 2024-04-26T00:14:37.164 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: monmap: 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:37.165 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 Processor -- start 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- start start 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: init 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient: _add_conns ranks=[6,3,0,8,7,4,5,1,2] 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): picked mon.noname-d con 0x7f6174072940 addr v1:172.21.15.106:6792/0 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): picked mon.noname-g con 0x7f6174072da0 addr v1:172.21.15.171:6790/0 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): picked mon.noname-a con 0x7f61740a3100 addr v1:172.21.15.106:6789/0 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61741ca970 con 0x7f61740a3100 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6174070450 con 0x7f6174072da0 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6171d9b640 1 -- >> v1:172.21.15.171:6790/0 conn(0x7f6174072da0 legacy=0x7f61741cf060 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.171:6790/0 2024-04-26T00:14:37.166 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6174071ea0 con 0x7f6174072940 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.177+0000 7f6178caf640 10 monclient(hunting): authenticate will time out at 2127.887964s 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f617259c640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f6174072940 0x7f617412bc40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.171:56012/0 (socket says 172.21.15.171:56012) 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f617259c640 1 -- 172.21.15.171:0/88355053 learned_addr learned my addr 172.21.15.171:0/88355053 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 215722225 0 0) 0x7f6174071ea0 con 0x7f6174072940 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): my global_id is 254805 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6154003560 con 0x7f6174072940 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446801877 0 0) 0x7f61741ca970 con 0x7f61740a3100 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:37.167 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): my global_id is 274599 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6174071ea0 con 0x7f61740a3100 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 222868710 0 0) 0x7f6174071ea0 con 0x7f61740a3100 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61741ca970 con 0x7f61740a3100 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f616c0055d0 con 0x7f61740a3100 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): dump: 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.168 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1218847027 0 0) 0x7f6154003560 con 0x7f6174072940 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6174071ea0 con 0x7f6174072940 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6168001ac0 con 0x7f6174072940 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:14:37.169 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient(hunting): dump: 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.170 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2864618812 0 0) 0x7f61741ca970 con 0x7f61740a3100 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 >> v1:172.21.15.106:6792/0 conn(0x7f6174072940 legacy=0x7f617412bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 >> v1:172.21.15.171:6790/0 conn(0x7f6174072da0 legacy=0x7f61741cf060 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 monclient: found mon.a 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6174072180 con 0x7f61740a3100 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: _finish_auth 0 2024-04-26T00:14:37.171 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 5 monclient: authenticate success, global_id 274599 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 10 monclient: _renew_subs 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6174072460 con 0x7f61740a3100 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 10 monclient: _renew_subs 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6174071310 con 0x7f61740a3100 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f616c004120 con 0x7f61740a3100 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f616c004690 con 0x7f61740a3100 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6170d99640 4 set_mon_vals no callback set 2024-04-26T00:14:37.172 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 10 monclient: dump: 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.173 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6158005090 con 0x7f61740a3100 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f616c0048b0 con 0x7f61740a3100 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f616c0452e0 con 0x7f61740a3100 2024-04-26T00:14:37.174 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.181+0000 7f617259c640 10 monclient: get_auth_request con 0x7f6154037e10 auth_method 0 2024-04-26T00:14:37.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.193+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f616c019500 con 0x7f61740a3100 2024-04-26T00:14:37.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.193+0000 7f6162ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:37.175 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.193+0000 7f6162ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:14:37.385 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.409+0000 7f6178caf640 10 start_mon_command cmd=[{"prefix": "health", "detail": "detail"}] 2024-04-26T00:14:37.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.409+0000 7f6178caf640 10 monclient: _send_command 2 [{"prefix": "health", "detail": "detail"}] 2024-04-26T00:14:37.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.409+0000 7f6178caf640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:14:37.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.409+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6158005380 con 0x7f61740a3100 2024-04-26T00:14:37.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.413+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1410 (unknown 501213350 0 1104487007) 0x7f616c01ddc0 con 0x7f61740a3100 2024-04-26T00:14:37.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.413+0000 7f6162ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "detail": "detail"}] 2024-04-26T00:14:37.386 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.413+0000 7f6162ffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:14:37.528 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.553+0000 7f6178caf640 10 start_mon_command cmd=[{"prefix": "health", "detail": "detail"}] 2024-04-26T00:14:37.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.553+0000 7f6178caf640 10 monclient: _send_command 3 [{"prefix": "health", "detail": "detail"}] 2024-04-26T00:14:37.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.553+0000 7f6178caf640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:14:37.529 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.553+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "health", "detail": "detail"} v 0) -- 0x7f6158005770 con 0x7f61740a3100 2024-04-26T00:14:37.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.553+0000 7f6162ffd640 1 -- 172.21.15.171:0/88355053 <== mon.0 v1:172.21.15.106:6789/0 11 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) ==== 74+0+1410 (unknown 501213350 0 1104487007) 0x7f616c040940 con 0x7f61740a3100 2024-04-26T00:14:37.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.553+0000 7f6162ffd640 10 monclient: handle_mon_command_ack 3 [{"prefix": "health", "detail": "detail"}] 2024-04-26T00:14:37.530 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.553+0000 7f6162ffd640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:14:37.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 >> v1:172.21.15.171:6812/722422047 conn(0x7f6154037e10 legacy=0x7f615403a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 10 monclient: shutdown 2024-04-26T00:14:37.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:37.531 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 >> v1:172.21.15.106:6789/0 conn(0x7f61740a3100 legacy=0x7f61741d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 shutdown_connections 2024-04-26T00:14:37.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 >> 172.21.15.171:0/88355053 conn(0x7f61740a6860 msgr2=0x7f6174067440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:37.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 shutdown_connections 2024-04-26T00:14:37.532 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.557+0000 7f6178caf640 1 -- 172.21.15.171:0/88355053 wait complete. 2024-04-26T00:14:37.545 INFO:tasks.workunit.client.0.smithi171.stdout: client.bad mds capability parse failed, stopped at 'also does not parse' of 'also does not parse' 2024-04-26T00:14:37.545 INFO:tasks.workunit.client.0.smithi171.stdout: client.bad mon capability parse failed, stopped at 'this is wrong' of 'this is wrong' 2024-04-26T00:14:37.545 INFO:tasks.workunit.client.0.smithi171.stdout: client.bad osd capability parse failed, stopped at 'does not parse' of 'does not parse' 2024-04-26T00:14:37.545 INFO:tasks.workunit.client.0.smithi171.stdout: client.bad mds capability parse failed, stopped at 'also does not parse' of 'also does not parse' 2024-04-26T00:14:37.545 INFO:tasks.workunit.client.0.smithi171.stdout: client.bad mon capability parse failed, stopped at 'this is wrong' of 'this is wrong' 2024-04-26T00:14:37.545 INFO:tasks.workunit.client.0.smithi171.stdout: client.bad osd capability parse failed, stopped at 'does not parse' of 'does not parse' 2024-04-26T00:14:37.545 INFO:tasks.workunit.client.0.smithi171.stderr:+ ceph auth rm client.bad 2024-04-26T00:14:37.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient: get_monmap_and_config 2024-04-26T00:14:37.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient: build_initial_monmap 2024-04-26T00:14:37.647 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient: monmap: 2024-04-26T00:14:37.647 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:37.647 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.647 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-26T00:14:37.675236+0000 2024-04-26T00:14:37.647 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-26T00:14:37.675236+0000 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:37.648 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.655 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 1 Processor -- start 2024-04-26T00:14:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 1 -- start start 2024-04-26T00:14:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient: init 2024-04-26T00:14:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient: _add_conns ranks=[4,2,6,0,5,3,8,7,1] 2024-04-26T00:14:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient(hunting): picked mon.noname-c con 0x7f59ec09d3f0 addr v1:172.21.15.106:6791/0 2024-04-26T00:14:37.656 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient(hunting): picked mon.noname-b con 0x7f59ec09dee0 addr v1:172.21.15.106:6790/0 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient(hunting): picked mon.noname-d con 0x7f59ec09fa10 addr v1:172.21.15.106:6792/0 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec0a1a00 con 0x7f59ec09dee0 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec072f30 con 0x7f59ec09d3f0 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec09f030 con 0x7f59ec09fa10 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient(hunting): authenticate will time out at 2128.382131s 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59ebfff640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f59ec09dee0 legacy=0x7f59ec139b10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f089a640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f59ec09d3f0 0x7f59ec09d7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.171:36862/0 (socket says 172.21.15.171:36862) 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f089a640 1 -- 172.21.15.171:0/836352338 learned_addr learned my addr 172.21.15.171:0/836352338 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 791708115 0 0) 0x7f59ec09f030 con 0x7f59ec09fa10 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:37.657 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): my global_id is 254814 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59d8003530 con 0x7f59ec09fa10 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462051985 0 0) 0x7f59ec072f30 con 0x7f59ec09d3f0 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient(hunting): my global_id is 274693 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59ec09f030 con 0x7f59ec09d3f0 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4221786444 0 0) 0x7f59d8003530 con 0x7f59ec09fa10 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 >> v1:172.21.15.106:6791/0 conn(0x7f59ec09d3f0 legacy=0x7f59ec09d7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 >> v1:172.21.15.106:6790/0 conn(0x7f59ec09dee0 legacy=0x7f59ec139b10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 monclient: found mon.noname-d 2024-04-26T00:14:37.658 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec09e790 con 0x7f59ec09fa10 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: _finish_auth 0 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59e40017c0 con 0x7f59ec09fa10 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 5 monclient: authenticate success, global_id 254814 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: dump: 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.659 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59e4001a70 con 0x7f59ec09fa10 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 10 monclient: get_monmap_and_config success 2024-04-26T00:14:37.660 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59f2afe640 4 set_mon_vals no callback set 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 1 -- 172.21.15.171:0/836352338 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59e4003960 con 0x7f59ec09fa10 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.673+0000 7f59eb7fe640 10 monclient: dump: 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.661 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: shutdown 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/836352338 >> v1:172.21.15.106:6792/0 conn(0x7f59ec09fa10 legacy=0x7f59ec13d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/836352338 shutdown_connections 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/836352338 >> 172.21.15.171:0/836352338 conn(0x7f59ec0a6860 msgr2=0x7f59ec0a29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:37.662 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/836352338 shutdown_connections 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/836352338 wait complete. 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: build_initial_monmap 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: monmap: 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 0 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 0.000000 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:created 0.000000 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 0 (unknown) 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:14:37.663 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 Processor -- start 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- start start 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: init 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _reopen_session rank -1 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _add_conns ranks=[7,6,2,4,3,8,0,5,1] 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient(hunting): picked mon.noname-i con 0x7f59ec09d3f0 addr v1:172.21.15.171:6792/0 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient(hunting): picked mon.noname-d con 0x7f59ec09dee0 addr v1:172.21.15.106:6792/0 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient(hunting): picked mon.noname-b con 0x7f59ec09fa10 addr v1:172.21.15.106:6790/0 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec1c66a0 con 0x7f59ec09fa10 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec1315c0 con 0x7f59ec09dee0 2024-04-26T00:14:37.664 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59ec130b20 con 0x7f59ec09d3f0 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient(hunting): _renew_subs 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient(hunting): authenticate will time out at 2128.385716s 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f109b640 1 -- >> v1:172.21.15.106:6790/0 conn(0x7f59ec09fa10 legacy=0x7f59ec1d44a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.106:6790/0 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f089a640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f59ec09d3f0 0x7f59ec1c5880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.171:44144/0 (socket says 172.21.15.171:44144) 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f089a640 1 -- 172.21.15.171:0/573391268 learned_addr learned my addr 172.21.15.171:0/573391268 (peer_addr_for_me v1:172.21.15.171:0/0) 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1795272000 0 0) 0x7f59ec130b20 con 0x7f59ec09d3f0 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): my global_id is 146968 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59cc003560 con 0x7f59ec09d3f0 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4018557457 0 0) 0x7f59cc003560 con 0x7f59ec09d3f0 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f59ec130b20 con 0x7f59ec09d3f0 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59dc001de0 con 0x7f59ec09d3f0 2024-04-26T00:14:37.665 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): dump: 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.666 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 454459968 0 0) 0x7f59ec1315c0 con 0x7f59ec09dee0 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): _negotiate 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:14:37.667 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient(hunting): my global_id is 254823 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59cc003560 con 0x7f59ec09dee0 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3333134596 0 0) 0x7f59ec130b20 con 0x7f59ec09d3f0 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 >> v1:172.21.15.106:6792/0 conn(0x7f59ec09dee0 legacy=0x7f59ec1c5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 >> v1:172.21.15.106:6790/0 conn(0x7f59ec09fa10 legacy=0x7f59ec1d44a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: _finish_hunting 0 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 monclient: found mon.i 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec131000 con 0x7f59ec09d3f0 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: _finish_auth 0 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: _check_auth_tickets 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 5 monclient: authenticate success, global_id 146968 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _renew_subs 2024-04-26T00:14:37.668 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec140920 con 0x7f59ec09d3f0 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _renew_subs 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f59ec132290 con 0x7f59ec09d3f0 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f59dc004ea0 con 0x7f59ec09d3f0 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f59dc005410 con 0x7f59ec09d3f0 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59eaffd640 4 set_mon_vals no callback set 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 10 monclient: dump: 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:epoch 1 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:14:37.669 INFO:tasks.workunit.client.0.smithi171.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:min_mon_release 19 (squid) 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:election_strategy: 1 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr: 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f59dc0055b0 con 0x7f59ec09d3f0 2024-04-26T00:14:37.670 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:37.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:37.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:37.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59d0005090 con 0x7f59ec09d3f0 2024-04-26T00:14:37.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f59dc045680 con 0x7f59ec09d3f0 2024-04-26T00:14:37.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.677+0000 7f59ebfff640 10 monclient: get_auth_request con 0x7f59cc037880 auth_method 0 2024-04-26T00:14:37.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.681+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f59dc015bf0 con 0x7f59ec09d3f0 2024-04-26T00:14:37.671 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.681+0000 7f59e97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:14:37.672 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.681+0000 7f59e97fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:14:37.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.885+0000 7f59f2afe640 10 start_mon_command cmd=[{"prefix": "auth rm", "entity": "client.bad"}] 2024-04-26T00:14:37.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.885+0000 7f59f2afe640 10 monclient: _send_command 2 [{"prefix": "auth rm", "entity": "client.bad"}] 2024-04-26T00:14:37.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.885+0000 7f59f2afe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:37.863 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.885+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "auth rm", "entity": "client.bad"} v 0) -- 0x7f59d0005380 con 0x7f59ec09d3f0 2024-04-26T00:14:37.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.897+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 10 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.bad"}]=0 v42) ==== 79+0+0 (unknown 2871006253 0 0) 0x7f59dc0198a0 con 0x7f59ec09d3f0 2024-04-26T00:14:37.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.897+0000 7f59e97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "auth rm", "entity": "client.bad"}] 2024-04-26T00:14:37.872 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:37.897+0000 7f59e97fa640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:14:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.037+0000 7f59f2afe640 10 start_mon_command cmd=[{"prefix": "auth rm", "entity": "client.bad"}] 2024-04-26T00:14:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.037+0000 7f59f2afe640 10 monclient: _send_command 3 [{"prefix": "auth rm", "entity": "client.bad"}] 2024-04-26T00:14:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.037+0000 7f59f2afe640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:14:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.037+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 --> v1:172.21.15.171:6792/0 -- mon_command({"prefix": "auth rm", "entity": "client.bad"} v 0) -- 0x7f59d0002220 con 0x7f59ec09d3f0 2024-04-26T00:14:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.037+0000 7f59e97fa640 1 -- 172.21.15.171:0/573391268 <== mon.7 v1:172.21.15.171:6792/0 11 ==== mon_command_ack([{"prefix": "auth rm", "entity": "client.bad"}]=0 v42) ==== 79+0+0 (unknown 2871006253 0 0) 0x7f59dc01e160 con 0x7f59ec09d3f0 2024-04-26T00:14:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.037+0000 7f59e97fa640 10 monclient: handle_mon_command_ack 3 [{"prefix": "auth rm", "entity": "client.bad"}] 2024-04-26T00:14:38.014 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.037+0000 7f59e97fa640 10 monclient: _finish_command 3 = system:0 2024-04-26T00:14:38.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 >> v1:172.21.15.171:6812/722422047 conn(0x7f59cc037880 legacy=0x7f59cc039d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:38.015 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 10 monclient: shutdown 2024-04-26T00:14:38.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:14:38.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 >> v1:172.21.15.171:6792/0 conn(0x7f59ec09d3f0 legacy=0x7f59ec1c5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:14:38.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 shutdown_connections 2024-04-26T00:14:38.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 >> 172.21.15.171:0/573391268 conn(0x7f59ec0a6860 msgr2=0x7f59ec0a3df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:14:38.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 shutdown_connections 2024-04-26T00:14:38.016 INFO:tasks.workunit.client.0.smithi171.stderr:2024-04-26T00:14:38.041+0000 7f59f2afe640 1 -- 172.21.15.171:0/573391268 wait complete. 2024-04-26T00:14:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:+ expect 'ceph auth health | grep AUTH_BAD_CAP' 1 2024-04-26T00:14:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:+ cmd='ceph auth health | grep AUTH_BAD_CAP' 2024-04-26T00:14:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:+ expected_ret=1 2024-04-26T00:14:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo ceph auth health '|' grep AUTH_BAD_CAP 2024-04-26T00:14:38.029 INFO:tasks.workunit.client.0.smithi171.stderr:+ eval ceph auth health '|' grep AUTH_BAD_CAP 2024-04-26T00:14:38.029 INFO:tasks.workunit.client.0.smithi171.stdout:ceph auth health | grep AUTH_BAD_CAP 2024-04-26T00:14:38.373 INFO:tasks.workunit.client.0.smithi171.stderr:+ ret=1 2024-04-26T00:14:38.374 INFO:tasks.workunit.client.0.smithi171.stderr:+ [[ 1 -ne 1 ]] 2024-04-26T00:14:38.374 INFO:tasks.workunit.client.0.smithi171.stderr:+ return 0 2024-04-26T00:14:38.374 INFO:tasks.workunit.client.0.smithi171.stdout:OK 2024-04-26T00:14:38.376 INFO:tasks.workunit.client.0.smithi171.stderr:+ echo OK 2024-04-26T00:14:38.376 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-26T00:14:38.377 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-26T00:14:38.389 INFO:tasks.workunit:Stopping ['mon/pool_ops.sh', 'mon/crush_ops.sh', 'mon/osd.sh', 'mon/caps.sh'] on client.0... 2024-04-26T00:14:38.389 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-26T00:14:38.742 DEBUG:teuthology.parallel:result is None 2024-04-26T00:14:38.743 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T00:14:38.755 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T00:14:38.755 DEBUG:teuthology.orchestra.run.smithi171:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-26T00:14:38.813 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-26T00:14:38.813 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-04-26T00:14:38.823 INFO:tasks.mon_thrash:joining mon_thrasher 2024-04-26T00:15:24.645 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-04-26T00:15:24.646 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-04-26T00:15:24.646 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-26T00:15:24.647 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-26T00:15:24.651 INFO:tasks.ceph.mon.b:Started 2024-04-26T00:15:24.651 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-04-26T00:15:24.651 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-04-26T00:15:24.651 INFO:tasks.ceph.mon.f:Restarting daemon 2024-04-26T00:15:24.651 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-04-26T00:15:24.654 INFO:tasks.ceph.mon.f:Started 2024-04-26T00:15:24.655 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-04-26T00:15:24.655 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-04-26T00:15:24.655 INFO:tasks.ceph.mon.g:Restarting daemon 2024-04-26T00:15:24.655 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-04-26T00:15:24.657 INFO:tasks.ceph.mon.g:Started 2024-04-26T00:15:24.657 INFO:tasks.mon_thrash.mon_thrasher:killing mon.e 2024-04-26T00:15:24.657 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.e 2024-04-26T00:15:24.658 INFO:tasks.ceph.mon.e:Restarting daemon 2024-04-26T00:15:24.658 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-04-26T00:15:24.660 INFO:tasks.ceph.mon.e:Started 2024-04-26T00:15:24.660 INFO:tasks.mon_thrash:Sending STOP to mon d 2024-04-26T00:15:24.661 INFO:tasks.ceph.mon.d:Sent signal 19 2024-04-26T00:15:24.661 INFO:tasks.mon_thrash:Sending STOP to mon h 2024-04-26T00:15:24.661 INFO:tasks.ceph.mon.h:Sent signal 19 2024-04-26T00:15:24.661 INFO:tasks.mon_thrash:Sending STOP to mon i 2024-04-26T00:15:24.661 INFO:tasks.ceph.mon.i:Sent signal 19 2024-04-26T00:15:24.662 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-04-26T00:15:24.768 INFO:tasks.ceph.mon.b.smithi106.stderr:2024-04-26T00:15:24.790+0000 7f67bf49ac80 -1 mon.b@-1(???).log v0 log_external_backlog rewinding external_log_to from 625 -> 0 (sync_force? mon rebuild?) 2024-04-26T00:15:39.662 INFO:tasks.mon_thrash:Sending CONT to mon d 2024-04-26T00:15:39.662 INFO:tasks.ceph.mon.d:Sent signal 18 2024-04-26T00:15:39.662 INFO:tasks.mon_thrash:Sending CONT to mon h 2024-04-26T00:15:39.663 INFO:tasks.ceph.mon.h:Sent signal 18 2024-04-26T00:15:39.663 INFO:tasks.mon_thrash:Sending CONT to mon i 2024-04-26T00:15:39.663 INFO:tasks.ceph.mon.i:Sent signal 18 2024-04-26T00:15:39.663 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:15:39.663 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:15:39.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient: get_monmap_and_config 2024-04-26T00:15:39.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient: build_initial_monmap 2024-04-26T00:15:39.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient: monmap: 2024-04-26T00:15:39.794 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:39.794 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:39.794 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:39.823825+0000 2024-04-26T00:15:39.794 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:39.823825+0000 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:39.795 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:39.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 1 Processor -- start 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 1 -- start start 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient: init 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient: _add_conns ranks=[3,8,2,4,0,5,7,1,6] 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient(hunting): picked mon.noname-g con 0x7fee04134820 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient(hunting): picked mon.noname-e con 0x7fee040725d0 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient(hunting): picked mon.noname-b con 0x7fee0413ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee04071270 con 0x7fee0413ace0 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee040714e0 con 0x7fee04134820 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee040729f0 con 0x7fee040725d0 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0c030640 10 monclient(hunting): authenticate will time out at 2195.351465s 2024-04-26T00:15:39.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee095cb640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fee040725d0 0x7fee041395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:44818/0 (socket says 172.21.15.106:44818) 2024-04-26T00:15:39.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee095cb640 1 -- 172.21.15.106:0/3024470392 learned_addr learned my addr 172.21.15.106:0/3024470392 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:39.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:39.818+0000 7fee0a5cd640 1 --1- 172.21.15.106:0/3024470392 >> v1:172.21.15.106:6790/0 conn(0x7fee0413ace0 0x7fee0413d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:42980/0 (socket says 172.21.15.106:42980) 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 10 monclient(hunting): tick 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 10 monclient(hunting): _check_auth_tickets 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 1 monclient(hunting): continuing hunt 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 10 monclient(hunting): _reopen_session rank -1 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 1 -- 172.21.15.106:0/3024470392 >> v1:172.21.15.106:6793/0 conn(0x7fee040725d0 legacy=0x7fee041395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 1 -- 172.21.15.106:0/3024470392 >> v1:172.21.15.171:6790/0 conn(0x7fee04134820 legacy=0x7fee04134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 1 -- 172.21.15.106:0/3024470392 >> v1:172.21.15.106:6790/0 conn(0x7fee0413ace0 legacy=0x7fee0413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 10 monclient: _add_conns ranks=[1,5,7,6,4,0] 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 10 monclient(hunting): picked mon.noname-f con 0x7fede8005a00 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 10 monclient(hunting): picked mon.noname-h con 0x7fede8009690 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:42.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.818+0000 7fedfb7fe640 10 monclient(hunting): picked mon.noname-i con 0x7fede800d3c0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:42.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.822+0000 7fedfb7fe640 1 -- 172.21.15.106:0/3024470392 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee040717c0 con 0x7fede8005a00 2024-04-26T00:15:42.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.822+0000 7fedfb7fe640 1 -- 172.21.15.106:0/3024470392 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede80121f0 con 0x7fede8009690 2024-04-26T00:15:42.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.822+0000 7fedfb7fe640 1 -- 172.21.15.106:0/3024470392 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede8013480 con 0x7fede800d3c0 2024-04-26T00:15:42.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:42.822+0000 7fedfb7fe640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:44.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.798+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3953395268 0 0) 0x7fede80121f0 con 0x7fede8009690 2024-04-26T00:15:44.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.798+0000 7fee08dca640 10 monclient(hunting): _negotiate 2024-04-26T00:15:44.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.798+0000 7fee08dca640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:44.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.798+0000 7fee08dca640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:44.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.798+0000 7fee08dca640 10 monclient(hunting): my global_id is 254795 2024-04-26T00:15:44.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.798+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedf0003530 con 0x7fede8009690 2024-04-26T00:15:44.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.802+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 47377905 0 0) 0x7fede8013480 con 0x7fede800d3c0 2024-04-26T00:15:44.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.802+0000 7fee08dca640 10 monclient(hunting): _negotiate 2024-04-26T00:15:44.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.802+0000 7fee08dca640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:44.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.802+0000 7fee08dca640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:44.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.802+0000 7fee08dca640 10 monclient(hunting): my global_id is 146995 2024-04-26T00:15:44.777 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.802+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede80121f0 con 0x7fede800d3c0 2024-04-26T00:15:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1477385455 0 0) 0x7fedf0003530 con 0x7fede8009690 2024-04-26T00:15:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 >> v1:172.21.15.171:6792/0 conn(0x7fede800d3c0 legacy=0x7fede800f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 >> v1:172.21.15.171:6789/0 conn(0x7fede8005a00 legacy=0x7fede8007e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: _finish_hunting 0 2024-04-26T00:15:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 monclient: found mon.noname-h 2024-04-26T00:15:44.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.171:6791/0 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede8014710 con 0x7fede8009690 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: _finish_auth 0 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: _check_auth_tickets 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedf4001880 con 0x7fede8009690 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0a5cd640 1 -- 172.21.15.106:0/3024470392 reap_dead start 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: dump: 2024-04-26T00:15:44.790 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:44.791 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:44.792 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 5 monclient: authenticate success, global_id 254795 2024-04-26T00:15:44.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 <== mon.5 v1:172.21.15.171:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedf4001ad0 con 0x7fede8009690 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 1 -- 172.21.15.106:0/3024470392 <== mon.5 v1:172.21.15.171:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedf4001d00 con 0x7fede8009690 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee08dca640 10 monclient: dump: 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.794 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 4 set_mon_vals no callback set 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 10 monclient: shutdown 2024-04-26T00:15:44.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 1 -- 172.21.15.106:0/3024470392 >> v1:172.21.15.171:6791/0 conn(0x7fede8009690 legacy=0x7fede800baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 1 -- 172.21.15.106:0/3024470392 shutdown_connections 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 1 -- 172.21.15.106:0/3024470392 >> 172.21.15.106:0/3024470392 conn(0x7fee040a64e0 msgr2=0x7fee040a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 1 -- 172.21.15.106:0/3024470392 shutdown_connections 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 1 -- 172.21.15.106:0/3024470392 wait complete. 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 10 monclient: build_initial_monmap 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.814+0000 7fee0c030640 10 monclient: monmap: 2024-04-26T00:15:44.796 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:44.797 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 1 Processor -- start 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 1 -- start start 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient: init 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient: _add_conns ranks=[1,2,0,3,7,4,5,6,8] 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient(hunting): picked mon.noname-f con 0x7fede8009690 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:44.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient(hunting): picked mon.noname-b con 0x7fee04133cf0 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient(hunting): picked mon.noname-a con 0x7fee041cc5c0 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee04120f20 con 0x7fee041cc5c0 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee041cca30 con 0x7fede8009690 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee04139880 con 0x7fee04133cf0 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient(hunting): authenticate will time out at 2200.349054s 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0a5cd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fee041cc5c0 0x7fee041d4df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58142/0 (socket says 172.21.15.106:58142) 2024-04-26T00:15:44.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0a5cd640 1 -- 172.21.15.106:0/1561781518 learned_addr learned my addr 172.21.15.106:0/1561781518 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:44.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3673258228 0 0) 0x7fee04139880 con 0x7fee04133cf0 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): my global_id is 294104 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede800b1f0 con 0x7fee04133cf0 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2629862008 0 0) 0x7fede800b1f0 con 0x7fee04133cf0 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fee04139880 con 0x7fee04133cf0 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedf4001c80 con 0x7fee04133cf0 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): dump: 2024-04-26T00:15:44.802 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:44.803 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1364237868 0 0) 0x7fee041cca30 con 0x7fede8009690 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient(hunting): my global_id is 294103 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fede800b1f0 con 0x7fede8009690 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2866129576 0 0) 0x7fee04139880 con 0x7fee04133cf0 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 >> v1:172.21.15.171:6789/0 conn(0x7fede8009690 legacy=0x7fee041335e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 >> v1:172.21.15.106:6789/0 conn(0x7fee041cc5c0 legacy=0x7fee041d4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 monclient: found mon.b 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:44.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee04121fb0 con 0x7fee04133cf0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fedfa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 5 monclient: authenticate success, global_id 294104 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient: _renew_subs 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fee04121710 con 0x7fee04133cf0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient: _renew_subs 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.818+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fee04120820 con 0x7fee04133cf0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedf4001a00 con 0x7fee04133cf0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedf4005120 con 0x7fee04133cf0 2024-04-26T00:15:44.805 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfbfff640 4 set_mon_vals no callback set 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 10 monclient: dump: 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:44.806 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fee0c030640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fedf400fec0 con 0x7fee04133cf0 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fee0c030640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fee0c030640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec005090 con 0x7fee04133cf0 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fedf40450e0 con 0x7fee04133cf0 2024-04-26T00:15:44.807 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.822+0000 7fee09dcc640 10 monclient: get_auth_request con 0x7fede8038e10 auth_method 0 2024-04-26T00:15:44.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.826+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fedf4015710 con 0x7fee04133cf0 2024-04-26T00:15:44.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.826+0000 7fedfa7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:44.808 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:44.826+0000 7fedfa7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:45.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.054+0000 7fee0c030640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:15:45.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.054+0000 7fee0c030640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:15:45.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.054+0000 7fee0c030640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.054+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fedec005380 con 0x7fee04133cf0 2024-04-26T00:15:45.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fedfa7fc640 1 -- 172.21.15.106:0/1561781518 <== mon.2 v1:172.21.15.106:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 1813179648) 0x7fedf401dbc0 con 0x7fee04133cf0 2024-04-26T00:15:45.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fedfa7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:15:45.033 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fedfa7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:45.033 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":132,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:15:45.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 >> v1:172.21.15.171:6812/722422047 conn(0x7fede8038e10 legacy=0x7fede803b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 10 monclient: shutdown 2024-04-26T00:15:45.035 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 >> v1:172.21.15.106:6790/0 conn(0x7fee04133cf0 legacy=0x7fee041d16c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 shutdown_connections 2024-04-26T00:15:45.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 >> 172.21.15.106:0/1561781518 conn(0x7fee040a64e0 msgr2=0x7fee040a1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 shutdown_connections 2024-04-26T00:15:45.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.058+0000 7fee0c030640 1 -- 172.21.15.106:0/1561781518 wait complete. 2024-04-26T00:15:45.052 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:15:45.052 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-04-26T00:15:45.052 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient: get_monmap_and_config 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient: monmap: 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:45.200537+0000 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:45.200537+0000 2024-04-26T00:15:45.174 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 1 Processor -- start 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 1 -- start start 2024-04-26T00:15:45.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient: init 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient: _add_conns ranks=[5,0,3,1,6,2,7,4,8] 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient(hunting): picked mon.noname-h con 0x7f43e0134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient(hunting): picked mon.noname-a con 0x7f43e00a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient(hunting): picked mon.noname-g con 0x7f43e013e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e006dd40 con 0x7f43e00a4820 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e00a2b10 con 0x7f43e013e200 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e00a2df0 con 0x7f43e0134970 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e81a0640 10 monclient(hunting): authenticate will time out at 2200.727678s 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e573b640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f43e00a4820 0x7f43e013cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:58150/0 (socket says 172.21.15.106:58150) 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.194+0000 7f43e573b640 1 -- 172.21.15.106:0/1160991350 learned_addr learned my addr 172.21.15.106:0/1160991350 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 803671236 0 0) 0x7f43e006dd40 con 0x7f43e00a4820 2024-04-26T00:15:45.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient(hunting): my global_id is 274608 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43cc003530 con 0x7f43e00a4820 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4181696081 0 0) 0x7f43cc003530 con 0x7f43e00a4820 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 >> v1:172.21.15.171:6791/0 conn(0x7f43e0134970 legacy=0x7f43e0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 >> v1:172.21.15.171:6790/0 conn(0x7f43e013e200 legacy=0x7f43e01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 monclient: found mon.noname-a 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00a30d0 con 0x7f43e00a4820 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f43d00017c0 con 0x7f43e00a4820 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: dump: 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.178 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 5 monclient: authenticate success, global_id 274608 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43d0001ab0 con 0x7f43e00a4820 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 1 -- 172.21.15.106:0/1160991350 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f43d0004bf0 con 0x7f43e00a4820 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e4f3a640 10 monclient: dump: 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.179 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 4 set_mon_vals no callback set 2024-04-26T00:15:45.180 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: shutdown 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- 172.21.15.106:0/1160991350 >> v1:172.21.15.106:6789/0 conn(0x7f43e00a4820 legacy=0x7f43e013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- 172.21.15.106:0/1160991350 shutdown_connections 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- 172.21.15.106:0/1160991350 >> 172.21.15.106:0/1160991350 conn(0x7f43e00a9e20 msgr2=0x7f43e00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- 172.21.15.106:0/1160991350 shutdown_connections 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- 172.21.15.106:0/1160991350 wait complete. 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: monmap: 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.181 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.182 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 Processor -- start 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- start start 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: init 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: _add_conns ranks=[5,1,4,7,8,6,3,0,2] 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient(hunting): picked mon.noname-h con 0x7f43e00a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient(hunting): picked mon.noname-f con 0x7f43e0134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:45.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient(hunting): picked mon.noname-c con 0x7f43e013e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e009e690 con 0x7f43e0134970 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e009c3c0 con 0x7f43e013e200 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e00a1e00 con 0x7f43e00a4820 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient(hunting): authenticate will time out at 2200.730656s 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e673d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f43e013e200 0x7f43e01d4fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:40754/0 (socket says 172.21.15.106:40754) 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e673d640 1 -- 172.21.15.106:0/3829862922 learned_addr learned my addr 172.21.15.106:0/3829862922 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1134637697 0 0) 0x7f43e009c3c0 con 0x7f43e013e200 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): my global_id is 274702 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43c4003530 con 0x7f43e013e200 2024-04-26T00:15:45.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2215861321 0 0) 0x7f43c4003530 con 0x7f43e013e200 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43e009c3c0 con 0x7f43e013e200 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f43d8001d20 con 0x7f43e013e200 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): dump: 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.190 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109003403 0 0) 0x7f43e00a1e00 con 0x7f43e00a4820 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): my global_id is 254813 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43c4003530 con 0x7f43e00a4820 2024-04-26T00:15:45.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4008999768 0 0) 0x7f43e009e690 con 0x7f43e0134970 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient(hunting): my global_id is 294112 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e00a1e00 con 0x7f43e0134970 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 214310157 0 0) 0x7f43e009c3c0 con 0x7f43e013e200 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.171:6791/0 conn(0x7f43e00a4820 legacy=0x7f43e012a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.171:6789/0 conn(0x7f43e0134970 legacy=0x7f43e01d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 monclient: found mon.c 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e00a1a40 con 0x7f43e013e200 2024-04-26T00:15:45.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 5 monclient: authenticate success, global_id 274702 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: _renew_subs 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f43e009ca80 con 0x7f43e013e200 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: _renew_subs 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f43e009f0c0 con 0x7f43e013e200 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43d8003cd0 con 0x7f43e013e200 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f43d8004240 con 0x7f43e013e200 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d7fff640 4 set_mon_vals no callback set 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.198+0000 7f43d67fc640 10 monclient: dump: 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.194 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43e81a0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43c80065d0 con 0x7f43c8002870 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f43d80043e0 con 0x7f43e013e200 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f43d8045320 con 0x7f43e013e200 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1283539744 0 0) 0x7f43c80065d0 con 0x7f43c8002870 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient(hunting): my global_id is 274617 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e009c3c0 con 0x7f43c8002870 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3048880445 0 0) 0x7f43e009c3c0 con 0x7f43c8002870 2024-04-26T00:15:45.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43c80065d0 con 0x7f43c8002870 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f43dc0017f0 con 0x7f43c8002870 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43e573b640 10 monclient: get_auth_request con 0x7f43c4037980 auth_method 0 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient: dump: 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.196 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2085715156 0 0) 0x7f43c80065d0 con 0x7f43c8002870 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43c800a160 con 0x7f43c8002870 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f43dc001d40 con 0x7f43c8002870 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:45.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.106:6789/0 conn(0x7f43c8002870 legacy=0x7f43c8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.202+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.106:6789/0 conn(0x7f43c8002870 legacy=0x7f43c8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.206+0000 7f43e81a0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.206+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43c8009e30 con 0x7f43c80090f0 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2634518288 0 0) 0x7f43c8009e30 con 0x7f43c80090f0 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient(hunting): my global_id is 274626 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43c80065d0 con 0x7f43c80090f0 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2777982974 0 0) 0x7f43c80065d0 con 0x7f43c80090f0 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43c8009e30 con 0x7f43c80090f0 2024-04-26T00:15:45.198 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f43dc003b30 con 0x7f43c80090f0 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient: dump: 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.199 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3839114170 0 0) 0x7f43c8009e30 con 0x7f43c80090f0 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 --> v1:172.21.15.106:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43c800c3a0 con 0x7f43c80090f0 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 <== mon.0 v1:172.21.15.106:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7738 (unknown 0 0 2138792281) 0x7f43dc003e90 con 0x7f43c80090f0 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.106:6789/0 conn(0x7f43c80090f0 legacy=0x7f43c8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.200 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43d67fc640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.106:6789/0 conn(0x7f43c80090f0 legacy=0x7f43c8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "leader", 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 293281, 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:45.201 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.202 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.203 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:45.204 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.205 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.206 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.207 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.208 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:45.209 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.210 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.211 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.212 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.213 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.214 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:45.215 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.216 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.217 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:45.218 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:45.219 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.171:6812/722422047 conn(0x7f43c4037980 legacy=0x7f43c4039e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 10 monclient: shutdown 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e673d640 1 -- 172.21.15.106:0/3829862922 reap_dead start 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 >> v1:172.21.15.106:6791/0 conn(0x7f43e013e200 legacy=0x7f43e01d4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 shutdown_connections 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 >> 172.21.15.106:0/3829862922 conn(0x7f43e00a9e20 msgr2=0x7f43e0130e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 shutdown_connections 2024-04-26T00:15:45.220 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.210+0000 7f43e81a0640 1 -- 172.21.15.106:0/3829862922 wait complete. 2024-04-26T00:15:45.220 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:45.220 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-04-26T00:15:45.221 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-04-26T00:15:45.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.366+0000 7faaee2dc640 10 monclient: get_monmap_and_config 2024-04-26T00:15:45.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.366+0000 7faaee2dc640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.366+0000 7faaee2dc640 10 monclient: monmap: 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:45.374243+0000 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:45.374243+0000 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.345 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.346 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.346 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.346 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.346 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 Processor -- start 2024-04-26T00:15:45.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- start start 2024-04-26T00:15:45.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient: init 2024-04-26T00:15:45.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient: _add_conns ranks=[8,1,6,4,0,7,5,3,2] 2024-04-26T00:15:45.356 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient(hunting): picked mon.noname-e con 0x7faae80a1290 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:45.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient(hunting): picked mon.noname-f con 0x7faae809f770 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:45.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient(hunting): picked mon.noname-d con 0x7faae809fb70 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:45.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae80727a0 con 0x7faae809f770 2024-04-26T00:15:45.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae80724c0 con 0x7faae809fb70 2024-04-26T00:15:45.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae8072a80 con 0x7faae80a1290 2024-04-26T00:15:45.357 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient(hunting): authenticate will time out at 2200.901539s 2024-04-26T00:15:45.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae7fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7faae80a1290 0x7faae80a1670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:44828/0 (socket says 172.21.15.106:44828) 2024-04-26T00:15:45.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae7fff640 1 -- 172.21.15.106:0/248881137 learned_addr learned my addr 172.21.15.106:0/248881137 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1258399746 0 0) 0x7faae8072a80 con 0x7faae80a1290 2024-04-26T00:15:45.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.358 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): my global_id is 294110 2024-04-26T00:15:45.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faad0003530 con 0x7faae80a1290 2024-04-26T00:15:45.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803718380 0 0) 0x7faae80724c0 con 0x7faae809fb70 2024-04-26T00:15:45.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.359 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient(hunting): my global_id is 254850 2024-04-26T00:15:45.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae8072a80 con 0x7faae809fb70 2024-04-26T00:15:45.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1926193738 0 0) 0x7faad0003530 con 0x7faae80a1290 2024-04-26T00:15:45.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 >> v1:172.21.15.106:6792/0 conn(0x7faae809fb70 legacy=0x7faae813de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 >> v1:172.21.15.171:6789/0 conn(0x7faae809f770 legacy=0x7faae813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.360 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 monclient: found mon.noname-e 2024-04-26T00:15:45.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:45.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae806bfc0 con 0x7faae80a1290 2024-04-26T00:15:45.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.361 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faad80017c0 con 0x7faae80a1290 2024-04-26T00:15:45.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 5 monclient: authenticate success, global_id 294110 2024-04-26T00:15:45.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.362 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:45.363 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: dump: 2024-04-26T00:15:45.363 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.363 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.363 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.363 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.363 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.363 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.364 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.364 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.364 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.364 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.364 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.364 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faad8001ae0 con 0x7faae80a1290 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.365 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:45.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 4 set_mon_vals no callback set 2024-04-26T00:15:45.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 1 -- 172.21.15.106:0/248881137 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faad8004bf0 con 0x7faae80a1290 2024-04-26T00:15:45.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:45.366 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faae6ffd640 10 monclient: dump: 2024-04-26T00:15:45.366 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.367 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.367 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.367 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.367 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.367 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.367 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.367 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.368 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.368 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.368 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.368 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.368 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.368 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.369 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.369 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient: shutdown 2024-04-26T00:15:45.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- 172.21.15.106:0/248881137 >> v1:172.21.15.106:6793/0 conn(0x7faae80a1290 legacy=0x7faae80a1670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.369 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- 172.21.15.106:0/248881137 shutdown_connections 2024-04-26T00:15:45.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- 172.21.15.106:0/248881137 >> 172.21.15.106:0/248881137 conn(0x7faae806b210 msgr2=0x7faae806b5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- 172.21.15.106:0/248881137 shutdown_connections 2024-04-26T00:15:45.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 -- 172.21.15.106:0/248881137 wait complete. 2024-04-26T00:15:45.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.370 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 10 monclient: monmap: 2024-04-26T00:15:45.371 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.371 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:45.371 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:45.371 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:45.371 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.371 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.372 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.372 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.372 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.372 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.372 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.372 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.372 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.373 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.373 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.373 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.370+0000 7faaee2dc640 1 Processor -- start 2024-04-26T00:15:45.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 1 -- start start 2024-04-26T00:15:45.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient: init 2024-04-26T00:15:45.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient: _add_conns ranks=[7,3,2,5,6,4,1,0,8] 2024-04-26T00:15:45.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient(hunting): picked mon.noname-i con 0x7faae809f770 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:45.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient(hunting): picked mon.noname-g con 0x7faae809fb70 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:45.374 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient(hunting): picked mon.noname-b con 0x7faae80a1290 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:45.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae80a1f00 con 0x7faae80a1290 2024-04-26T00:15:45.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae8071860 con 0x7faae809fb70 2024-04-26T00:15:45.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faae813b5f0 con 0x7faae809f770 2024-04-26T00:15:45.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient(hunting): authenticate will time out at 2200.904571s 2024-04-26T00:15:45.375 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaec879640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7faae80a1290 0x7faae81d2580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:43002/0 (socket says 172.21.15.106:43002) 2024-04-26T00:15:45.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaec879640 1 -- 172.21.15.106:0/2052019160 learned_addr learned my addr 172.21.15.106:0/2052019160 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2866166230 0 0) 0x7faae8072a80 con 0x7faae80a1290 2024-04-26T00:15:45.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.376 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): my global_id is 294113 2024-04-26T00:15:45.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faad4003530 con 0x7faae80a1290 2024-04-26T00:15:45.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1027866413 0 0) 0x7faad4003530 con 0x7faae80a1290 2024-04-26T00:15:45.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faae8072a80 con 0x7faae80a1290 2024-04-26T00:15:45.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faae0001e00 con 0x7faae80a1290 2024-04-26T00:15:45.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.377 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:45.378 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): dump: 2024-04-26T00:15:45.378 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.378 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.378 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.378 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.378 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.379 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.379 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.379 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.379 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.379 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.379 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.380 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.380 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.380 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.380 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.380 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.380 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:45.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3236246056 0 0) 0x7faae8071860 con 0x7faae809fb70 2024-04-26T00:15:45.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): my global_id is 294114 2024-04-26T00:15:45.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faad4003530 con 0x7faae809fb70 2024-04-26T00:15:45.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 953459107 0 0) 0x7faae813b5f0 con 0x7faae809f770 2024-04-26T00:15:45.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): my global_id is 147004 2024-04-26T00:15:45.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae8071860 con 0x7faae809f770 2024-04-26T00:15:45.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2160392320 0 0) 0x7faae8072a80 con 0x7faae80a1290 2024-04-26T00:15:45.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.171:6792/0 conn(0x7faae809f770 legacy=0x7faae813a7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.171:6790/0 conn(0x7faae809fb70 legacy=0x7faae813aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 monclient: found mon.b 2024-04-26T00:15:45.383 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faae813e4b0 con 0x7faae80a1290 2024-04-26T00:15:45.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.384 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 5 monclient: authenticate success, global_id 294113 2024-04-26T00:15:45.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient: _renew_subs 2024-04-26T00:15:45.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faae813e790 con 0x7faae80a1290 2024-04-26T00:15:45.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient: _renew_subs 2024-04-26T00:15:45.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7faae813f0e0 con 0x7faae80a1290 2024-04-26T00:15:45.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faae0003cd0 con 0x7faae80a1290 2024-04-26T00:15:45.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faae00041c0 con 0x7faae80a1290 2024-04-26T00:15:45.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:45.386 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: dump: 2024-04-26T00:15:45.387 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.387 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.387 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.387 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.387 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.387 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.387 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.388 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae67fc640 4 set_mon_vals no callback set 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faac80065d0 con 0x7faac8002870 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7faae00043e0 con 0x7faae80a1290 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7faae00455d0 con 0x7faae80a1290 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2517699764 0 0) 0x7faac80065d0 con 0x7faac8002870 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient(hunting): my global_id is 294122 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faae8072a80 con 0x7faac8002870 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae77fe640 10 monclient: get_auth_request con 0x7faad4037950 auth_method 0 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3024518331 0 0) 0x7faae8072a80 con 0x7faac8002870 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faac80065d0 con 0x7faac8002870 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faad8001440 con 0x7faac8002870 2024-04-26T00:15:45.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: dump: 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.391 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.392 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 330026993 0 0) 0x7faac80065d0 con 0x7faac8002870 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faac800a160 con 0x7faac8002870 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7faad80017b0 con 0x7faac8002870 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.106:6790/0 conn(0x7faac8002870 legacy=0x7faac8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.374+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.106:6790/0 conn(0x7faac8002870 legacy=0x7faac8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7faac8009e50 con 0x7faac8009110 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764788158 0 0) 0x7faac8009e50 con 0x7faac8009110 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient(hunting): my global_id is 294131 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faac80065d0 con 0x7faac8009110 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3178639031 0 0) 0x7faac80065d0 con 0x7faac8009110 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faac8009e50 con 0x7faac8009110 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7faad8004e60 con 0x7faac8009110 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient: dump: 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.396 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 467182404 0 0) 0x7faac8009e50 con 0x7faac8009110 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 --> v1:172.21.15.106:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7faac800c3e0 con 0x7faac8009110 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 <== mon.2 v1:172.21.15.106:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 3178632522) 0x7faad8006270 con 0x7faac8009110 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.106:6790/0 conn(0x7faac8009110 legacy=0x7faac80095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faae4ff9640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.106:6790/0 conn(0x7faac8009110 legacy=0x7faac80095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 20615, 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:45.398 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.399 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.400 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:45.401 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:45.402 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.403 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.404 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.405 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.406 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.407 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:45.408 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.409 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.410 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:45.411 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:45.412 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.412 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.412 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.412 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.412 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:45.412 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.413 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.413 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.413 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.413 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.413 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.413 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.414 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.414 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.414 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.414 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.414 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:45.415 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:45.415 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.415 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.415 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.415 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.415 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:45.416 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.416 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.416 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.416 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.416 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.416 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.417 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.417 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.417 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.417 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.417 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.417 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:45.418 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:45.418 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.418 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.418 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.418 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.419 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:45.419 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.419 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.419 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.419 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.419 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.420 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.420 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.420 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.420 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.420 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.420 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.421 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:45.421 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:45.421 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.421 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.421 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.422 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.422 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:45.422 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.422 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.422 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.423 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.423 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.423 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.423 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.423 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.424 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:45.424 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:45.424 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.424 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.425 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:45.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:45.427 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.171:6812/722422047 conn(0x7faad4037950 legacy=0x7faad4039e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 10 monclient: shutdown 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 >> v1:172.21.15.106:6790/0 conn(0x7faae80a1290 legacy=0x7faae81d2580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaec879640 1 -- 172.21.15.106:0/2052019160 reap_dead start 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaec879640 1 -- 172.21.15.106:0/2052019160 reap_dead start 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 shutdown_connections 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 >> 172.21.15.106:0/2052019160 conn(0x7faae806b210 msgr2=0x7faae80a34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 shutdown_connections 2024-04-26T00:15:45.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.382+0000 7faaee2dc640 1 -- 172.21.15.106:0/2052019160 wait complete. 2024-04-26T00:15:45.430 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:45.430 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-04-26T00:15:45.430 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-04-26T00:15:45.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.570+0000 7f25a0178640 10 monclient: get_monmap_and_config 2024-04-26T00:15:45.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.570+0000 7f25a0178640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.570+0000 7f25a0178640 10 monclient: monmap: 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:45.578146+0000 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:45.578146+0000 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.549 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.550 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.550 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 Processor -- start 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- start start 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: init 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: _add_conns ranks=[2,1,6,3,7,0,5,4,8] 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient(hunting): picked mon.noname-b con 0x7f2598135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient(hunting): picked mon.noname-f con 0x7f25981353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient(hunting): picked mon.noname-d con 0x7f259813bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f259806f2d0 con 0x7f25981353b0 2024-04-26T00:15:45.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2598072330 con 0x7f2598135870 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2598072610 con 0x7f259813bdf0 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient(hunting): authenticate will time out at 2201.105277s 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259e715640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f259813bdf0 0x7f259813e1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33782/0 (socket says 172.21.15.106:33782) 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259df14640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f2598135870 0x7f2598135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48132/0 (socket says 172.21.15.106:48132) 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259e715640 1 -- 172.21.15.106:0/600355425 learned_addr learned my addr 172.21.15.106:0/600355425 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2829024946 0 0) 0x7f2598072330 con 0x7f2598135870 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): my global_id is 294140 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2584003530 con 0x7f2598135870 2024-04-26T00:15:45.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2491531062 0 0) 0x7f2598072610 con 0x7f259813bdf0 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): my global_id is 254859 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2598072330 con 0x7f259813bdf0 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3784262074 0 0) 0x7f259806f2d0 con 0x7f25981353b0 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient(hunting): my global_id is 294130 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2598072610 con 0x7f25981353b0 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1008681747 0 0) 0x7f2598072330 con 0x7f259813bdf0 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 >> v1:172.21.15.106:6790/0 conn(0x7f2598135870 legacy=0x7f2598135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 >> v1:172.21.15.171:6789/0 conn(0x7f25981353b0 legacy=0x7f259813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 monclient: found mon.noname-d 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25980a3260 con 0x7f259813bdf0 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2590001ae0 con 0x7f259813bdf0 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 5 monclient: authenticate success, global_id 254859 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: dump: 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.560 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2590001d40 con 0x7f259813bdf0 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 1 -- 172.21.15.106:0/600355425 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2590004f70 con 0x7f259813bdf0 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 4 set_mon_vals no callback set 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f259cf12640 10 monclient: dump: 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.562 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: shutdown 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- 172.21.15.106:0/600355425 >> v1:172.21.15.106:6792/0 conn(0x7f259813bdf0 legacy=0x7f259813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- 172.21.15.106:0/600355425 shutdown_connections 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- 172.21.15.106:0/600355425 >> 172.21.15.106:0/600355425 conn(0x7f25980a64e0 msgr2=0x7f25980a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- 172.21.15.106:0/600355425 shutdown_connections 2024-04-26T00:15:45.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- 172.21.15.106:0/600355425 wait complete. 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: monmap: 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.564 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 Processor -- start 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 1 -- start start 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.574+0000 7f25a0178640 10 monclient: init 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient: _add_conns ranks=[5,8,4,7,1,6,2,3,0] 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient(hunting): picked mon.noname-h con 0x7f25981353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient(hunting): picked mon.noname-e con 0x7f2598135870 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient(hunting): picked mon.noname-c con 0x7f259813bdf0 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2598135020 con 0x7f259813bdf0 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2598133b70 con 0x7f25981353b0 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f259809f930 con 0x7f2598135870 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient(hunting): authenticate will time out at 2201.108561s 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f259d713640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f2598135870 0x7f25981cf190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49446/0 (socket says 172.21.15.106:49446) 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f259d713640 1 -- 172.21.15.106:0/3351437072 learned_addr learned my addr 172.21.15.106:0/3351437072 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362391369 0 0) 0x7f259809f930 con 0x7f2598135870 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): my global_id is 294119 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f257c003560 con 0x7f2598135870 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3338479694 0 0) 0x7f2598135020 con 0x7f259813bdf0 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): my global_id is 274711 2024-04-26T00:15:45.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f259809f930 con 0x7f259813bdf0 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 293823354 0 0) 0x7f257c003560 con 0x7f2598135870 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2598135020 con 0x7f2598135870 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2588001b40 con 0x7f2598135870 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): dump: 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.567 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3425514391 0 0) 0x7f259809f930 con 0x7f259813bdf0 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f257c003560 con 0x7f259813bdf0 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2442094394 0 0) 0x7f2598133b70 con 0x7f25981353b0 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): my global_id is 254822 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f259809f930 con 0x7f25981353b0 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f25900019e0 con 0x7f259813bdf0 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): dump: 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.569 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3352717152 0 0) 0x7f2598135020 con 0x7f2598135870 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.171:6791/0 conn(0x7f25981353b0 legacy=0x7f259813b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.106:6791/0 conn(0x7f259813bdf0 legacy=0x7f25981d28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 monclient: found mon.e 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:15:45.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2598134d40 con 0x7f2598135870 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 5 monclient: authenticate success, global_id 294119 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient: _renew_subs 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f25981338f0 con 0x7f2598135870 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient: _renew_subs 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f259813b9b0 con 0x7f2598135870 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25880038d0 con 0x7f2598135870 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2588003e40 con 0x7f2598135870 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258ffff640 4 set_mon_vals no callback set 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: dump: 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.572 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f25800065d0 con 0x7f2580002870 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f2588003fe0 con 0x7f2598135870 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f2588045220 con 0x7f2598135870 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174563969 0 0) 0x7f25800065d0 con 0x7f2580002870 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient(hunting): my global_id is 274720 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2598135020 con 0x7f2580002870 2024-04-26T00:15:45.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f259e715640 10 monclient: get_auth_request con 0x7f257c037f60 auth_method 0 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1687219830 0 0) 0x7f2598135020 con 0x7f2580002870 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f25800065d0 con 0x7f2580002870 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2594001910 con 0x7f2580002870 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: dump: 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.574 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2974311290 0 0) 0x7f25800065d0 con 0x7f2580002870 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f258000a160 con 0x7f2580002870 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2594005820 con 0x7f2580002870 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.106:6791/0 conn(0x7f2580002870 legacy=0x7f2580004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.578+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.106:6791/0 conn(0x7f2580002870 legacy=0x7f2580004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2580009e50 con 0x7f2580009110 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037798794 0 0) 0x7f2580009e50 con 0x7f2580009110 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient(hunting): my global_id is 274729 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f25800065d0 con 0x7f2580009110 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3448267027 0 0) 0x7f25800065d0 con 0x7f2580009110 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2580009e50 con 0x7f2580009110 2024-04-26T00:15:45.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2594004da0 con 0x7f2580009110 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient: dump: 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.578 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2489846591 0 0) 0x7f2580009e50 con 0x7f2580009110 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 --> v1:172.21.15.106:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f258000c3e0 con 0x7f2580009110 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 <== mon.4 v1:172.21.15.106:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7566 (unknown 0 0 2807357618) 0x7f25940059d0 con 0x7f2580009110 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.106:6791/0 conn(0x7f2580009110 legacy=0x7f25800095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.579 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f258e7fc640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.106:6791/0 conn(0x7f2580009110 legacy=0x7f25800095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 293665, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:45.580 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 0, 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.581 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.582 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:45.583 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.584 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.585 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:45.586 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.587 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.589 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:45.591 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:45.592 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.594 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.595 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.596 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:45.597 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:45.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.171:6812/722422047 conn(0x7f257c037f60 legacy=0x7f257c03a420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 10 monclient: shutdown 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 >> v1:172.21.15.106:6793/0 conn(0x7f2598135870 legacy=0x7f25981cf190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f259e715640 1 -- 172.21.15.106:0/3351437072 reap_dead start 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f259e715640 1 -- 172.21.15.106:0/3351437072 reap_dead start 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 shutdown_connections 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 >> 172.21.15.106:0/3351437072 conn(0x7f25980a64e0 msgr2=0x7f25980a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 shutdown_connections 2024-04-26T00:15:45.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.586+0000 7f25a0178640 1 -- 172.21.15.106:0/3351437072 wait complete. 2024-04-26T00:15:45.599 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:45.600 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-04-26T00:15:45.600 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: get_monmap_and_config 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: monmap: 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:45.746698+0000 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:45.746698+0000 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.717 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.718 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 Processor -- start 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- start start 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: init 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: _add_conns ranks=[6,8,2,5,0,3,4,7,1] 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient(hunting): picked mon.noname-d con 0x7f0f1c131160 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient(hunting): picked mon.noname-e con 0x7f0f1c09c710 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient(hunting): picked mon.noname-b con 0x7f0f1c09cb30 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:45.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c067c00 con 0x7f0f1c09cb30 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c131c50 con 0x7f0f1c131160 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c09ba50 con 0x7f0f1c09c710 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient(hunting): authenticate will time out at 2201.273965s 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f1a59c640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f0f1c09c710 0x7f0f1c13caa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49454/0 (socket says 172.21.15.106:49454) 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f1b59e640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f0f1c09cb30 0x7f0f1c1401d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48146/0 (socket says 172.21.15.106:48146) 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f1a59c640 1 -- 172.21.15.106:0/4139417351 learned_addr learned my addr 172.21.15.106:0/4139417351 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f1ad9d640 1 --1- 172.21.15.106:0/4139417351 >> v1:172.21.15.106:6792/0 conn(0x7f0f1c131160 0x7f0f1c131540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33792/0 (socket says 172.21.15.106:33792) 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2173885835 0 0) 0x7f0f1c067c00 con 0x7f0f1c09cb30 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): my global_id is 294149 2024-04-26T00:15:45.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f08003530 con 0x7f0f1c09cb30 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1472927283 0 0) 0x7f0f1c09ba50 con 0x7f0f1c09c710 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): my global_id is 294128 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1c067c00 con 0x7f0f1c09c710 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2861549708 0 0) 0x7f0f1c131c50 con 0x7f0f1c131160 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient(hunting): my global_id is 254868 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1c09ba50 con 0x7f0f1c131160 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3439389926 0 0) 0x7f0f08003530 con 0x7f0f1c09cb30 2024-04-26T00:15:45.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 >> v1:172.21.15.106:6793/0 conn(0x7f0f1c09c710 legacy=0x7f0f1c13caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 >> v1:172.21.15.106:6792/0 conn(0x7f0f1c131160 legacy=0x7f0f1c131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 monclient: found mon.noname-b 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c09bd30 con 0x7f0f1c09cb30 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f0c0017c0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 5 monclient: authenticate success, global_id 294149 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: dump: 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.730 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f0c001ae0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 1 -- 172.21.15.106:0/4139417351 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f0c004b30 con 0x7f0f1c09cb30 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 4 set_mon_vals no callback set 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f19d9b640 10 monclient: dump: 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.731 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 10 monclient: shutdown 2024-04-26T00:15:45.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- 172.21.15.106:0/4139417351 >> v1:172.21.15.106:6790/0 conn(0x7f0f1c09cb30 legacy=0x7f0f1c1401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- 172.21.15.106:0/4139417351 shutdown_connections 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- 172.21.15.106:0/4139417351 >> 172.21.15.106:0/4139417351 conn(0x7f0f1c0a2d20 msgr2=0x7f0f1c0a3100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- 172.21.15.106:0/4139417351 shutdown_connections 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.742+0000 7f0f2105e640 1 -- 172.21.15.106:0/4139417351 wait complete. 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: monmap: 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.733 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 Processor -- start 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 -- start start 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: init 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: _add_conns ranks=[8,2,4,6,7,5,1,0,3] 2024-04-26T00:15:45.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient(hunting): picked mon.noname-e con 0x7f0f1c09c710 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient(hunting): picked mon.noname-b con 0x7f0f1c09cb30 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient(hunting): picked mon.noname-c con 0x7f0f1c131160 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c067e30 con 0x7f0f1c09cb30 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c0717d0 con 0x7f0f1c131160 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f1c073220 con 0x7f0f1c09c710 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient(hunting): authenticate will time out at 2201.277191s 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f1a59c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f0f1c09cb30 0x7f0f1c140d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48150/0 (socket says 172.21.15.106:48150) 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f1a59c640 1 -- 172.21.15.106:0/2388819569 learned_addr learned my addr 172.21.15.106:0/2388819569 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2632229709 0 0) 0x7f0f1c067c00 con 0x7f0f1c09cb30 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.735 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): my global_id is 294158 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0efc003560 con 0x7f0f1c09cb30 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1501266870 0 0) 0x7f0f1c073220 con 0x7f0f1c09c710 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): my global_id is 294137 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1c067c00 con 0x7f0f1c09c710 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3375313260 0 0) 0x7f0f1c0717d0 con 0x7f0f1c131160 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): my global_id is 274738 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1c073220 con 0x7f0f1c131160 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2781297709 0 0) 0x7f0efc003560 con 0x7f0f1c09cb30 2024-04-26T00:15:45.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f1c0717d0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f04001a60 con 0x7f0f1c09cb30 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): dump: 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.737 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2152899562 0 0) 0x7f0f1c067c00 con 0x7f0f1c09c710 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0efc003560 con 0x7f0f1c09c710 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f14001c00 con 0x7f0f1c09c710 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): dump: 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.738 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.739 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4179181208 0 0) 0x7f0f1c073220 con 0x7f0f1c131160 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f1c067c00 con 0x7f0f1c131160 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f0c001780 con 0x7f0f1c131160 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): dump: 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.740 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 13210895 0 0) 0x7f0f1c0717d0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.106:6793/0 conn(0x7f0f1c09c710 legacy=0x7f0f1c140650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.106:6791/0 conn(0x7f0f1c131160 legacy=0x7f0f1c1d4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 monclient: found mon.b 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1c12c190 con 0x7f0f1c09cb30 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 5 monclient: authenticate success, global_id 294158 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: _renew_subs 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1c072ec0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0f04001ce0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f04004de0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: dump: 2024-04-26T00:15:45.742 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.743 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: _renew_subs 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0f1c070cb0 con 0x7f0f1c09cb30 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f1959a640 4 set_mon_vals no callback set 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f1c067160 con 0x7f0f1c132040 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0f0400fb80 con 0x7f0f1c09cb30 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f0f04045020 con 0x7f0f1c09cb30 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4127311802 0 0) 0x7f0f1c067160 con 0x7f0f1c132040 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient(hunting): my global_id is 254877 2024-04-26T00:15:45.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1c0717d0 con 0x7f0f1c132040 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1946744950 0 0) 0x7f0f1c0717d0 con 0x7f0f1c132040 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f1c067160 con 0x7f0f1c132040 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f14004eb0 con 0x7f0f1c132040 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 10 monclient: dump: 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.745 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f1b59e640 10 monclient: get_auth_request con 0x7f0efc038220 auth_method 0 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3687232106 0 0) 0x7f0f1c067160 con 0x7f0f1c132040 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.746+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f1c062e50 con 0x7f0f1c132040 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.750+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0f140063b0 con 0x7f0f1c132040 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.750+0000 7f0f137fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.750+0000 7f0f137fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:45.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.750+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.106:6792/0 conn(0x7f0f1c132040 legacy=0x7f0f1c132420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.750+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.106:6792/0 conn(0x7f0f1c132040 legacy=0x7f0f1c132420 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:45.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f1c06cbd0 con 0x7f0f1c02d010 2024-04-26T00:15:45.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 335625267 0 0) 0x7f0f1c06cbd0 con 0x7f0f1c02d010 2024-04-26T00:15:45.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient(hunting): my global_id is 254886 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f1c067160 con 0x7f0f1c02d010 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1489271611 0 0) 0x7f0f1c067160 con 0x7f0f1c02d010 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f1c06cbd0 con 0x7f0f1c02d010 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0f14005460 con 0x7f0f1c02d010 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient: dump: 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.749 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 784830352 0 0) 0x7f0f1c06cbd0 con 0x7f0f1c02d010 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 --> v1:172.21.15.106:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f1c1418f0 con 0x7f0f1c02d010 2024-04-26T00:15:45.750 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 <== mon.6 v1:172.21.15.106:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 2287849164) 0x7f0f140057d0 con 0x7f0f1c02d010 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.106:6792/0 conn(0x7f0f1c02d010 legacy=0x7f0f1c132b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f137fe640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.106:6792/0 conn(0x7f0f1c02d010 legacy=0x7f0f1c132b30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:45.751 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 415815, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.752 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:45.753 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.754 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:45.755 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.756 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.757 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:45.758 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.759 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.760 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.761 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.762 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.763 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.764 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.765 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.766 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.767 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.768 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 3 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.769 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.770 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.770 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:45.770 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:45.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.171:6812/722422047 conn(0x7f0efc038220 legacy=0x7f0efc03a6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 10 monclient: shutdown 2024-04-26T00:15:45.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 >> v1:172.21.15.106:6790/0 conn(0x7f0f1c09cb30 legacy=0x7f0f1c140d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f1b59e640 1 -- 172.21.15.106:0/2388819569 reap_dead start 2024-04-26T00:15:45.771 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f1b59e640 1 -- 172.21.15.106:0/2388819569 reap_dead start 2024-04-26T00:15:45.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 shutdown_connections 2024-04-26T00:15:45.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 >> 172.21.15.106:0/2388819569 conn(0x7f0f1c0a2d20 msgr2=0x7f0f1c09a9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 shutdown_connections 2024-04-26T00:15:45.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.754+0000 7f0f2105e640 1 -- 172.21.15.106:0/2388819569 wait complete. 2024-04-26T00:15:45.772 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:45.772 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-04-26T00:15:45.772 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-04-26T00:15:45.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.910+0000 7fdaade78640 10 monclient: get_monmap_and_config 2024-04-26T00:15:45.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.910+0000 7fdaade78640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.910+0000 7fdaade78640 10 monclient: monmap: 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:45.918237+0000 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:45.918237+0000 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.889 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.890 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.890 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.890 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.897 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 Processor -- start 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- start start 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient: init 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient: _add_conns ranks=[8,3,7,6,1,5,2,4,0] 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient(hunting): picked mon.noname-e con 0x7fdaa8134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient(hunting): picked mon.noname-g con 0x7fdaa80725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient(hunting): picked mon.noname-i con 0x7fdaa813ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa8071270 con 0x7fdaa80725d0 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa80714e0 con 0x7fdaa813ace0 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa80729f0 con 0x7fdaa8134820 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient(hunting): authenticate will time out at 2201.445225s 2024-04-26T00:15:45.898 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa77fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fdaa8134820 0x7fdaa8134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49478/0 (socket says 172.21.15.106:49478) 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa77fe640 1 -- 172.21.15.106:0/2909852538 learned_addr learned my addr 172.21.15.106:0/2909852538 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2399733160 0 0) 0x7fdaa80729f0 con 0x7fdaa8134820 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient(hunting): my global_id is 294146 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda90005740 con 0x7fdaa8134820 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1876793479 0 0) 0x7fda90005740 con 0x7fdaa8134820 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 >> v1:172.21.15.171:6792/0 conn(0x7fdaa813ace0 legacy=0x7fdaa813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 >> v1:172.21.15.171:6790/0 conn(0x7fdaa80725d0 legacy=0x7fdaa81395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 monclient: found mon.noname-e 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.899 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa80717c0 con 0x7fdaa8134820 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda98001820 con 0x7fdaa8134820 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: dump: 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.900 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 5 monclient: authenticate success, global_id 294146 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda98001b30 con 0x7fdaa8134820 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 1 -- 172.21.15.106:0/2909852538 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda98004bf0 con 0x7fdaa8134820 2024-04-26T00:15:45.901 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaa67fc640 10 monclient: dump: 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.902 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 4 set_mon_vals no callback set 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient: shutdown 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- 172.21.15.106:0/2909852538 >> v1:172.21.15.106:6793/0 conn(0x7fdaa8134820 legacy=0x7fdaa8134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- 172.21.15.106:0/2909852538 shutdown_connections 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- 172.21.15.106:0/2909852538 >> 172.21.15.106:0/2909852538 conn(0x7fdaa80a64e0 msgr2=0x7fdaa80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- 172.21.15.106:0/2909852538 shutdown_connections 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 1 -- 172.21.15.106:0/2909852538 wait complete. 2024-04-26T00:15:45.903 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient: build_initial_monmap 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.914+0000 7fdaade78640 10 monclient: monmap: 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:45.904 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 Processor -- start 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 -- start start 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient: init 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient: _add_conns ranks=[3,5,7,4,2,6,0,1,8] 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient(hunting): picked mon.noname-g con 0x7fdaa80725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient(hunting): picked mon.noname-h con 0x7fdaa8134820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient(hunting): picked mon.noname-i con 0x7fdaa813ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa8072c60 con 0x7fdaa80725d0 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa809f4e0 con 0x7fdaa8134820 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdaa8133d60 con 0x7fdaa813ace0 2024-04-26T00:15:45.905 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient(hunting): authenticate will time out at 2201.448836s 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaa7fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fdaa813ace0 0x7fdaa81d0370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:58940/0 (socket says 172.21.15.106:58940) 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaa6ffd640 1 --1- >> v1:172.21.15.171:6791/0 conn(0x7fdaa8134820 0x7fdaa81327e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6791/0 says I am v1:172.21.15.106:39512/0 (socket says 172.21.15.106:39512) 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaa7fff640 1 -- 172.21.15.106:0/962633814 learned_addr learned my addr 172.21.15.106:0/962633814 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3399109451 0 0) 0x7fdaa8133d60 con 0x7fdaa813ace0 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): my global_id is 147022 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda94003530 con 0x7fdaa813ace0 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2803305490 0 0) 0x7fdaa8072c60 con 0x7fdaa80725d0 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.906 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): my global_id is 294132 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa8133d60 con 0x7fdaa80725d0 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3837024476 0 0) 0x7fdaa809f4e0 con 0x7fdaa8134820 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): my global_id is 254831 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa8072c60 con 0x7fdaa8134820 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3218064897 0 0) 0x7fda94003530 con 0x7fdaa813ace0 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa809f4e0 con 0x7fdaa813ace0 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaa0001d80 con 0x7fdaa813ace0 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): dump: 2024-04-26T00:15:45.907 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.908 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2309040468 0 0) 0x7fdaa8133d60 con 0x7fdaa80725d0 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda94003530 con 0x7fdaa80725d0 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 654383793 0 0) 0x7fdaa8072c60 con 0x7fdaa8134820 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa8133d60 con 0x7fdaa8134820 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda980017e0 con 0x7fdaa80725d0 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): dump: 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.909 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda9c001950 con 0x7fdaa8134820 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): dump: 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.910 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.911 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1902161671 0 0) 0x7fdaa809f4e0 con 0x7fdaa813ace0 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.171:6791/0 conn(0x7fdaa8134820 legacy=0x7fdaa81327e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.171:6790/0 conn(0x7fdaa80725d0 legacy=0x7fdaa81320d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 monclient: found mon.i 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa809b6a0 con 0x7fdaa813ace0 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: _finish_auth 0 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 5 monclient: authenticate success, global_id 147022 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient: _renew_subs 2024-04-26T00:15:45.912 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa8132ef0 con 0x7fdaa813ace0 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient: _renew_subs 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.171:6792/0 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.171:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fdaa809bda0 con 0x7fdaa813ace0 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaa0003c50 con 0x7fdaa813ace0 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fdaa00041c0 con 0x7fdaa813ace0 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaa5ffb640 4 set_mon_vals no callback set 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient: dump: 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.913 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.914 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda880065d0 con 0x7fda88002870 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 161020984 0 0) 0x7fda880065d0 con 0x7fda88002870 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 10 monclient(hunting): my global_id is 294155 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.918+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa809f4e0 con 0x7fda88002870 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fdaa00043e0 con 0x7fdaa813ace0 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1425709278 0 0) 0x7fdaa809f4e0 con 0x7fda88002870 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda880065d0 con 0x7fda88002870 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.7 v1:172.21.15.171:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fdaa00454e0 con 0x7fdaa813ace0 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda98000ff0 con 0x7fda88002870 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.915 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 10 monclient: dump: 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.916 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3589238870 0 0) 0x7fda880065d0 con 0x7fda88002870 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fda8800a160 con 0x7fda88002870 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fdaa6ffd640 10 monclient: get_auth_request con 0x7fda94038120 auth_method 0 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fda98004b50 con 0x7fda88002870 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.106:6793/0 conn(0x7fda88002870 legacy=0x7fda88004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.922+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.106:6793/0 conn(0x7fda88002870 legacy=0x7fda88004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fdaade78640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fda88009e30 con 0x7fda880090f0 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1754956265 0 0) 0x7fda88009e30 con 0x7fda880090f0 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 10 monclient(hunting): my global_id is 294164 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda880065d0 con 0x7fda880090f0 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3991717099 0 0) 0x7fda880065d0 con 0x7fda880090f0 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda88009e30 con 0x7fda880090f0 2024-04-26T00:15:45.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fda98005870 con 0x7fda880090f0 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 10 monclient: dump: 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:45.920 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2574462778 0 0) 0x7fda88009e30 con 0x7fda880090f0 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.926+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 --> v1:172.21.15.106:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fda8800c3a0 con 0x7fda880090f0 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 <== mon.8 v1:172.21.15.106:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 2742866237) 0x7fda98007bd0 con 0x7fda880090f0 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fda8ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fda8ffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.106:6793/0 conn(0x7fda880090f0 legacy=0x7fda88009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fda8ffff640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.106:6793/0 conn(0x7fda880090f0 legacy=0x7fda88009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:45.921 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 21155, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:45.922 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.923 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.924 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:45.925 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:45.926 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.927 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.928 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.929 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.930 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.931 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.932 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.933 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.934 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.935 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.936 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:45.937 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:45.938 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:45.939 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:45.940 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.171:6812/722422047 conn(0x7fda94038120 legacy=0x7fda9403a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 10 monclient: shutdown 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 >> v1:172.21.15.171:6792/0 conn(0x7fdaa813ace0 legacy=0x7fdaa81d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaa7fff640 1 -- 172.21.15.106:0/962633814 reap_dead start 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaa7fff640 1 -- 172.21.15.106:0/962633814 reap_dead start 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 shutdown_connections 2024-04-26T00:15:45.941 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 >> 172.21.15.106:0/962633814 conn(0x7fdaa80a64e0 msgr2=0x7fdaa80a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:45.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 shutdown_connections 2024-04-26T00:15:45.942 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:45.930+0000 7fdaade78640 1 -- 172.21.15.106:0/962633814 wait complete. 2024-04-26T00:15:45.942 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:45.942 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-04-26T00:15:45.942 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-04-26T00:15:46.056 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.078+0000 7fd5197e5640 10 monclient: get_monmap_and_config 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.078+0000 7fd5197e5640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient: monmap: 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:46.086423+0000 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:46.086423+0000 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.057 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.058 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.058 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.058 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.058 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.058 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.058 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 Processor -- start 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- start start 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient: init 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient: _add_conns ranks=[3,7,1,8,6,5,4,0,2] 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient(hunting): picked mon.noname-g con 0x7fd514134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient(hunting): picked mon.noname-i con 0x7fd5140a4820 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient(hunting): picked mon.noname-f con 0x7fd51413e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51406dd40 con 0x7fd51413e200 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140a2b10 con 0x7fd514134970 2024-04-26T00:15:46.067 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140a2df0 con 0x7fd5140a4820 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient(hunting): authenticate will time out at 2201.613616s 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd512ffd640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fd514134970 0x7fd514134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:53660/0 (socket says 172.21.15.106:53660) 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd512ffd640 1 -- 172.21.15.106:0/1895528419 learned_addr learned my addr 172.21.15.106:0/1895528419 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506584761 0 0) 0x7fd5140a2b10 con 0x7fd514134970 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): my global_id is 294141 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd500003530 con 0x7fd514134970 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 966211028 0 0) 0x7fd51406dd40 con 0x7fd51413e200 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.068 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): my global_id is 294139 2024-04-26T00:15:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5140a2b10 con 0x7fd51413e200 2024-04-26T00:15:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 132204626 0 0) 0x7fd5140a2df0 con 0x7fd5140a4820 2024-04-26T00:15:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.069 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient(hunting): my global_id is 147031 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd51406dd40 con 0x7fd5140a4820 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3001456790 0 0) 0x7fd500003530 con 0x7fd514134970 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 >> v1:172.21.15.171:6792/0 conn(0x7fd5140a4820 legacy=0x7fd51413cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 >> v1:172.21.15.171:6789/0 conn(0x7fd51413e200 legacy=0x7fd5141405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 monclient: found mon.noname-g 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.171:6790/0 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5140a30d0 con 0x7fd514134970 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.070 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 5 monclient: authenticate success, global_id 294141 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5040017c0 con 0x7fd514134970 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: dump: 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.071 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.072 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 <== mon.3 v1:172.21.15.171:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd504001a20 con 0x7fd514134970 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 4 set_mon_vals no callback set 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 1 -- 172.21.15.106:0/1895528419 <== mon.3 v1:172.21.15.171:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd504004bf0 con 0x7fd514134970 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd511ffb640 10 monclient: dump: 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.073 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 10 monclient: shutdown 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.074 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- 172.21.15.106:0/1895528419 >> v1:172.21.15.171:6790/0 conn(0x7fd514134970 legacy=0x7fd514134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- 172.21.15.106:0/1895528419 shutdown_connections 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- 172.21.15.106:0/1895528419 >> 172.21.15.106:0/1895528419 conn(0x7fd5140a9e20 msgr2=0x7fd5140aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- 172.21.15.106:0/1895528419 shutdown_connections 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.082+0000 7fd5197e5640 1 -- 172.21.15.106:0/1895528419 wait complete. 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: monmap: 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.075 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 Processor -- start 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 -- start start 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: init 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: _add_conns ranks=[4,7,8,1,6,5,2,3,0] 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient(hunting): picked mon.noname-c con 0x7fd5140a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:46.076 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient(hunting): picked mon.noname-i con 0x7fd514134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient(hunting): picked mon.noname-e con 0x7fd51413e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140a1e00 con 0x7fd5140a4820 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5140a1a40 con 0x7fd514134970 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd51409deb0 con 0x7fd51413e200 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient(hunting): authenticate will time out at 2201.617438s 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd512ffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7fd5140a4820 0x7fd51412ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53712/0 (socket says 172.21.15.106:53712) 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd512ffd640 1 -- 172.21.15.106:0/1028858749 learned_addr learned my addr 172.21.15.106:0/1028858749 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1667330980 0 0) 0x7fd5140a1e00 con 0x7fd5140a4820 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): my global_id is 274747 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f4003530 con 0x7fd5140a4820 2024-04-26T00:15:46.077 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2049642616 0 0) 0x7fd51409deb0 con 0x7fd51413e200 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): my global_id is 294173 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5140a1e00 con 0x7fd51413e200 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3070414254 0 0) 0x7fd4f4003530 con 0x7fd5140a4820 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd51409deb0 con 0x7fd5140a4820 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257168324 0 0) 0x7fd5140a1a40 con 0x7fd514134970 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): my global_id is 147040 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f4003530 con 0x7fd514134970 2024-04-26T00:15:46.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd5040016c0 con 0x7fd5140a4820 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): dump: 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.079 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.080 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.080 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.080 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.080 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.080 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.080 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3643389510 0 0) 0x7fd5140a1e00 con 0x7fd51413e200 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5140a1a40 con 0x7fd51413e200 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd50c001900 con 0x7fd51413e200 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): dump: 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.081 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2820212544 0 0) 0x7fd51409deb0 con 0x7fd5140a4820 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.106:6793/0 conn(0x7fd51413e200 legacy=0x7fd5141d4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.171:6792/0 conn(0x7fd514134970 legacy=0x7fd5141d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 monclient: found mon.c 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.082 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd51409e190 con 0x7fd5140a4820 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 5 monclient: authenticate success, global_id 274747 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: _renew_subs 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd51409c7f0 con 0x7fd5140a4820 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: _renew_subs 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd51409eea0 con 0x7fd5140a4820 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd504001a20 con 0x7fd5140a4820 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd504005230 con 0x7fd5140a4820 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5117fa640 4 set_mon_vals no callback set 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient: dump: 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.084 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd4f80065d0 con 0x7fd4f8002870 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fd50400ffd0 con 0x7fd5140a4820 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fd504045110 con 0x7fd5140a4820 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4075996830 0 0) 0x7fd4f80065d0 con 0x7fd4f8002870 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 10 monclient(hunting): my global_id is 294148 2024-04-26T00:15:46.085 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd51409deb0 con 0x7fd4f8002870 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.086+0000 7fd5137fe640 10 monclient: get_auth_request con 0x7fd4f4037fd0 auth_method 0 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 637320204 0 0) 0x7fd51409deb0 con 0x7fd4f8002870 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4f80065d0 con 0x7fd4f8002870 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4fc001d00 con 0x7fd4f8002870 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 10 monclient: dump: 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.086 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3508900755 0 0) 0x7fd4f80065d0 con 0x7fd4f8002870 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd4f800a160 con 0x7fd4f8002870 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd4fc0049d0 con 0x7fd4f8002870 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.171:6789/0 conn(0x7fd4f8002870 legacy=0x7fd4f8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.090+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.171:6789/0 conn(0x7fd4f8002870 legacy=0x7fd4f8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.094+0000 7fd5197e5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:46.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.094+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd4f8009e30 con 0x7fd4f80090f0 2024-04-26T00:15:46.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 108668365 0 0) 0x7fd4f8009e30 con 0x7fd4f80090f0 2024-04-26T00:15:46.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient(hunting): my global_id is 294157 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4f80065d0 con 0x7fd4f80090f0 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2600445366 0 0) 0x7fd4f80065d0 con 0x7fd4f80090f0 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4f8009e30 con 0x7fd4f80090f0 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fd4fc003fd0 con 0x7fd4f80090f0 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient: dump: 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.090 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3486435931 0 0) 0x7fd4f8009e30 con 0x7fd4f80090f0 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 --> v1:172.21.15.171:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd4f800c3a0 con 0x7fd4f80090f0 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 <== mon.1 v1:172.21.15.171:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 777769257) 0x7fd4fc004b80 con 0x7fd4f80090f0 2024-04-26T00:15:46.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.171:6789/0 conn(0x7fd4f80090f0 legacy=0x7fd4f8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd50b7fe640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.171:6789/0 conn(0x7fd4f80090f0 legacy=0x7fd4f8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 21331, 2024-04-26T00:15:46.092 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:46.093 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:46.094 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:46.095 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.096 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.097 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.098 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.099 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.100 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:46.101 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.102 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.103 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.104 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.105 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:46.106 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.107 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.108 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.109 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:46.110 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:46.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.171:6812/722422047 conn(0x7fd4f4037fd0 legacy=0x7fd4f403a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 10 monclient: shutdown 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 >> v1:172.21.15.106:6791/0 conn(0x7fd5140a4820 legacy=0x7fd51412ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5137fe640 1 -- 172.21.15.106:0/1028858749 reap_dead start 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5137fe640 1 -- 172.21.15.106:0/1028858749 reap_dead start 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 shutdown_connections 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 >> 172.21.15.106:0/1028858749 conn(0x7fd5140a9e20 msgr2=0x7fd514067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 shutdown_connections 2024-04-26T00:15:46.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.098+0000 7fd5197e5640 1 -- 172.21.15.106:0/1028858749 wait complete. 2024-04-26T00:15:46.112 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:46.113 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-04-26T00:15:46.113 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-04-26T00:15:46.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: get_monmap_and_config 2024-04-26T00:15:46.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.225 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: monmap: 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:46.255240+0000 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:46.255240+0000 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.226 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.227 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.227 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.227 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 Processor -- start 2024-04-26T00:15:46.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- start start 2024-04-26T00:15:46.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: init 2024-04-26T00:15:46.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: _add_conns ranks=[7,8,3,5,2,0,1,4,6] 2024-04-26T00:15:46.234 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient(hunting): picked mon.noname-i con 0x7fedec137730 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient(hunting): picked mon.noname-e con 0x7fedec0a0b20 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient(hunting): picked mon.noname-g con 0x7fedec138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0a2750 con 0x7fedec138220 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0a2a30 con 0x7fedec137730 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0a2d10 con 0x7fedec0a0b20 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient(hunting): authenticate will time out at 2201.782299s 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fede3fff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fedec0a0b20 0x7fedec13ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49504/0 (socket says 172.21.15.106:49504) 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fede3fff640 1 -- 172.21.15.106:0/508854840 learned_addr learned my addr 172.21.15.106:0/508854840 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3106938351 0 0) 0x7fedec0a2d10 con 0x7fedec0a0b20 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient(hunting): my global_id is 294182 2024-04-26T00:15:46.235 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd8003530 con 0x7fedec0a0b20 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1243670708 0 0) 0x7fedd8003530 con 0x7fedec0a0b20 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 >> v1:172.21.15.171:6792/0 conn(0x7fedec137730 legacy=0x7fedec137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 >> v1:172.21.15.171:6790/0 conn(0x7fedec138220 legacy=0x7fedec140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 monclient: found mon.noname-e 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec0a4680 con 0x7fedec0a0b20 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedd40017c0 con 0x7fedec0a0b20 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:46.236 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: dump: 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.237 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 5 monclient: authenticate success, global_id 294182 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedd4001b20 con 0x7fedec0a0b20 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 1 -- 172.21.15.106:0/508854840 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedd4004bf0 con 0x7fedec0a0b20 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 4 set_mon_vals no callback set 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedea7fc640 10 monclient: dump: 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.238 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 10 monclient: shutdown 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- 172.21.15.106:0/508854840 >> v1:172.21.15.106:6793/0 conn(0x7fedec0a0b20 legacy=0x7fedec13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- 172.21.15.106:0/508854840 shutdown_connections 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- 172.21.15.106:0/508854840 >> 172.21.15.106:0/508854840 conn(0x7fedec0a6b80 msgr2=0x7fedec0a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- 172.21.15.106:0/508854840 shutdown_connections 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.250+0000 7fedf1283640 1 -- 172.21.15.106:0/508854840 wait complete. 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: monmap: 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.240 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 Processor -- start 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 -- start start 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: init 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: _add_conns ranks=[7,2,8,6,0,1,3,4,5] 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient(hunting): picked mon.noname-i con 0x7fedec0a0b20 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient(hunting): picked mon.noname-b con 0x7fedec137730 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient(hunting): picked mon.noname-e con 0x7fedec138220 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:46.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec0a0200 con 0x7fedec137730 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec070ff0 con 0x7fedec0a0b20 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedec070750 con 0x7fedec138220 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient(hunting): authenticate will time out at 2201.785385s 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede3fff640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fedec137730 0x7fedec1d5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48154/0 (socket says 172.21.15.106:48154) 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede3fff640 1 -- 172.21.15.106:0/3330050219 learned_addr learned my addr 172.21.15.106:0/3330050219 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 969359442 0 0) 0x7fedec0a0200 con 0x7fedec137730 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): my global_id is 294167 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedcc003530 con 0x7fedec137730 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3998101472 0 0) 0x7fedec070750 con 0x7fedec138220 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.242 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): my global_id is 294191 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec0a0200 con 0x7fedec138220 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1959107255 0 0) 0x7fedec070ff0 con 0x7fedec0a0b20 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): my global_id is 147058 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec070750 con 0x7fedec0a0b20 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 185893464 0 0) 0x7fedcc003530 con 0x7fedec137730 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedec070ff0 con 0x7fedec137730 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3082614443 0 0) 0x7fedec0a0200 con 0x7fedec138220 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedcc003530 con 0x7fedec138220 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedd4001780 con 0x7fedec137730 2024-04-26T00:15:46.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): dump: 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.244 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fede4001c00 con 0x7fedec138220 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): dump: 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.245 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3033217065 0 0) 0x7fedec070ff0 con 0x7fedec137730 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.106:6793/0 conn(0x7fedec138220 legacy=0x7fedec1d91b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.171:6792/0 conn(0x7fedec0a0b20 legacy=0x7fedec135dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 monclient: found mon.b 2024-04-26T00:15:46.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec06f540 con 0x7fedec137730 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 5 monclient: authenticate success, global_id 294167 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: _renew_subs 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fedec071410 con 0x7fedec137730 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: _renew_subs 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fedec06fcb0 con 0x7fedec137730 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fedd4001b20 con 0x7fedec137730 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede9ffb640 4 set_mon_vals no callback set 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fedd4004bf0 con 0x7fedec137730 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient: dump: 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.248 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fedd00065d0 con 0x7fedd0002870 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fedd400fdb0 con 0x7fedec137730 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fedd40451d0 con 0x7fedec137730 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3084626099 0 0) 0x7fedd00065d0 con 0x7fedd0002870 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 10 monclient(hunting): my global_id is 294159 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedec070ff0 con 0x7fedd0002870 2024-04-26T00:15:46.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.254+0000 7fedeb7fe640 10 monclient: get_auth_request con 0x7fedcc037e60 auth_method 0 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3866673682 0 0) 0x7fedec070ff0 con 0x7fedd0002870 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedd00065d0 con 0x7fedd0002870 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feddc001870 con 0x7fedd0002870 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 10 monclient: dump: 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.250 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 550888165 0 0) 0x7fedd00065d0 con 0x7fedd0002870 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fedd000a160 con 0x7fedd0002870 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7feddc004650 con 0x7fedd0002870 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.171:6790/0 conn(0x7fedd0002870 legacy=0x7fedd0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.258+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.171:6790/0 conn(0x7fedd0002870 legacy=0x7fedd0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.262+0000 7fedf1283640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.262+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fedd0009e30 con 0x7fedd00090f0 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2174992909 0 0) 0x7fedd0009e30 con 0x7fedd00090f0 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient(hunting): my global_id is 294168 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedd00065d0 con 0x7fedd00090f0 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1961997074 0 0) 0x7fedd00065d0 con 0x7fedd00090f0 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fedd0009e30 con 0x7fedd00090f0 2024-04-26T00:15:46.253 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7feddc003bf0 con 0x7fedd00090f0 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient: dump: 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.254 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2438287520 0 0) 0x7fedd0009e30 con 0x7fedd00090f0 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 --> v1:172.21.15.171:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fedd000c3a0 con 0x7fedd00090f0 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 <== mon.3 v1:172.21.15.171:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7565 (unknown 0 0 3221120530) 0x7feddc003e20 con 0x7fedd00090f0 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.171:6790/0 conn(0x7fedd00090f0 legacy=0x7fedd0009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fede37fe640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.171:6790/0 conn(0x7fedd00090f0 legacy=0x7fedd0009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.255 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 21495, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:46.256 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.257 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.258 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:46.259 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.260 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:46.261 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.262 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:46.263 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.264 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.265 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.266 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:46.267 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.268 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.269 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.270 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.271 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.272 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:46.273 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:46.274 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.171:6812/722422047 conn(0x7fedcc037e60 legacy=0x7fedcc03a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 10 monclient: shutdown 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 >> v1:172.21.15.106:6790/0 conn(0x7fedec137730 legacy=0x7fedec1d5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedeb7fe640 1 -- 172.21.15.106:0/3330050219 reap_dead start 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedeb7fe640 1 -- 172.21.15.106:0/3330050219 reap_dead start 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 shutdown_connections 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 >> 172.21.15.106:0/3330050219 conn(0x7fedec0a6b80 msgr2=0x7fedec12e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 shutdown_connections 2024-04-26T00:15:46.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.266+0000 7fedf1283640 1 -- 172.21.15.106:0/3330050219 wait complete. 2024-04-26T00:15:46.276 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:46.276 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-04-26T00:15:46.276 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: get_monmap_and_config 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: monmap: 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:46.414941+0000 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:46.414941+0000 2024-04-26T00:15:46.385 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.386 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 Processor -- start 2024-04-26T00:15:46.395 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- start start 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: init 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: _add_conns ranks=[7,4,0,3,1,8,5,2,6] 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient(hunting): picked mon.noname-i con 0x7f5d2c134820 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient(hunting): picked mon.noname-c con 0x7f5d2c0725d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient(hunting): picked mon.noname-a con 0x7f5d2c13ace0 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c071270 con 0x7f5d2c13ace0 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c0714e0 con 0x7f5d2c0725d0 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c0729f0 con 0x7f5d2c134820 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient(hunting): authenticate will time out at 2201.942069s 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d30f07640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5d2c13ace0 0x7f5d2c13d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40686/0 (socket says 172.21.15.106:40686) 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2b7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f5d2c0725d0 0x7f5d2c1395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53720/0 (socket says 172.21.15.106:53720) 2024-04-26T00:15:46.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d30f07640 1 -- 172.21.15.106:0/3603057529 learned_addr learned my addr 172.21.15.106:0/3603057529 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940034472 0 0) 0x7f5d2c071270 con 0x7f5d2c13ace0 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): my global_id is 274635 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d14003530 con 0x7f5d2c13ace0 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 826925199 0 0) 0x7f5d20001050 con 0x7f5d2c0725d0 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient(hunting): my global_id is 274756 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2c071270 con 0x7f5d2c0725d0 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1345074612 0 0) 0x7f5d14003530 con 0x7f5d2c13ace0 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 >> v1:172.21.15.171:6792/0 conn(0x7f5d2c134820 legacy=0x7f5d2c134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 >> v1:172.21.15.106:6791/0 conn(0x7f5d2c0725d0 legacy=0x7f5d2c1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 monclient: found mon.noname-a 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c0717c0 con 0x7f5d2c13ace0 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d1c0017c0 con 0x7f5d2c13ace0 2024-04-26T00:15:46.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: dump: 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.399 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 5 monclient: authenticate success, global_id 274635 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d1c001ae0 con 0x7f5d2c13ace0 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 1 -- 172.21.15.106:0/3603057529 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d1c001d50 con 0x7f5d2c13ace0 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 4 set_mon_vals no callback set 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d2affd640 10 monclient: dump: 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.400 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.401 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 10 monclient: shutdown 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- 172.21.15.106:0/3603057529 >> v1:172.21.15.106:6789/0 conn(0x7f5d2c13ace0 legacy=0x7f5d2c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- 172.21.15.106:0/3603057529 shutdown_connections 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- 172.21.15.106:0/3603057529 >> 172.21.15.106:0/3603057529 conn(0x7f5d2c0a64e0 msgr2=0x7f5d2c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- 172.21.15.106:0/3603057529 shutdown_connections 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.410+0000 7f5d3296a640 1 -- 172.21.15.106:0/3603057529 wait complete. 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: monmap: 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:46.402 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 Processor -- start 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 -- start start 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: init 2024-04-26T00:15:46.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: _add_conns ranks=[4,0,1,5,2,7,6,8,3] 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient(hunting): picked mon.noname-c con 0x7f5d2c0725d0 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient(hunting): picked mon.noname-a con 0x7f5d2c134820 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient(hunting): picked mon.noname-f con 0x7f5d2c13ace0 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c134c00 con 0x7f5d2c134820 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c09f1a0 con 0x7f5d2c13ace0 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5d2c13bee0 con 0x7f5d2c0725d0 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient(hunting): authenticate will time out at 2201.945200s 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d2bfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f5d2c0725d0 0x7f5d2c13b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53722/0 (socket says 172.21.15.106:53722) 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d2bfff640 1 -- 172.21.15.106:0/1222433467 learned_addr learned my addr 172.21.15.106:0/1222433467 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475648823 0 0) 0x7f5d2c134c00 con 0x7f5d2c134820 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): my global_id is 274644 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d18003530 con 0x7f5d2c134820 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857387145 0 0) 0x7f5d2c13bee0 con 0x7f5d2c0725d0 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): my global_id is 274765 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2c134c00 con 0x7f5d2c0725d0 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2413329541 0 0) 0x7f5d18003530 con 0x7f5d2c134820 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d2c13bee0 con 0x7f5d2c134820 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d200019e0 con 0x7f5d2c134820 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:46.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): dump: 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.406 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1552067176 0 0) 0x7f5d2c134c00 con 0x7f5d2c0725d0 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d18003530 con 0x7f5d2c0725d0 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d24001e40 con 0x7f5d2c0725d0 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): dump: 2024-04-26T00:15:46.407 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.408 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237995755 0 0) 0x7f5d2c09f1a0 con 0x7f5d2c13ace0 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): my global_id is 294166 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2c134c00 con 0x7f5d2c13ace0 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2386836621 0 0) 0x7f5d2c13bee0 con 0x7f5d2c134820 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.106:6791/0 conn(0x7f5d2c0725d0 legacy=0x7f5d2c13b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.171:6789/0 conn(0x7f5d2c13ace0 legacy=0x7f5d2c1d4c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 monclient: found mon.a 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d2c134ec0 con 0x7f5d2c134820 2024-04-26T00:15:46.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 5 monclient: authenticate success, global_id 274644 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: _renew_subs 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5d2c133c60 con 0x7f5d2c134820 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: _renew_subs 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5d2c13c350 con 0x7f5d2c134820 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5d20004aa0 con 0x7f5d2c134820 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d20004f90 con 0x7f5d2c134820 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.410 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d2a7fc640 4 set_mon_vals no callback set 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient: dump: 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.411 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d0c0065d0 con 0x7f5d0c002870 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5d2000fd30 con 0x7f5d2c134820 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5d20045120 con 0x7f5d2c134820 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d30f07640 10 monclient: get_auth_request con 0x7f5d18037e30 auth_method 0 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951954049 0 0) 0x7f5d0c0065d0 con 0x7f5d0c002870 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 10 monclient(hunting): my global_id is 254840 2024-04-26T00:15:46.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.414+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d2c13bee0 con 0x7f5d0c002870 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1310785923 0 0) 0x7f5d2c13bee0 con 0x7f5d0c002870 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d0c0065d0 con 0x7f5d0c002870 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d24003ed0 con 0x7f5d0c002870 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 10 monclient: dump: 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.413 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 36789348 0 0) 0x7f5d0c0065d0 con 0x7f5d0c002870 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5d0c00a160 con 0x7f5d0c002870 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5d24005b50 con 0x7f5d0c002870 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.171:6791/0 conn(0x7f5d0c002870 legacy=0x7f5d0c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.414 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.418+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.171:6791/0 conn(0x7f5d0c002870 legacy=0x7f5d0c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.422+0000 7f5d3296a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:46.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.422+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5d0c009e30 con 0x7f5d0c0090f0 2024-04-26T00:15:46.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2610005008 0 0) 0x7f5d0c009e30 con 0x7f5d0c0090f0 2024-04-26T00:15:46.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.416 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient(hunting): my global_id is 254849 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5d0c0065d0 con 0x7f5d0c0090f0 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 26875608 0 0) 0x7f5d0c0065d0 con 0x7f5d0c0090f0 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5d0c009e30 con 0x7f5d0c0090f0 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5d24004770 con 0x7f5d0c0090f0 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient: dump: 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.417 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4156430261 0 0) 0x7f5d0c009e30 con 0x7f5d0c0090f0 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 --> v1:172.21.15.171:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5d0c00c3a0 con 0x7f5d0c0090f0 2024-04-26T00:15:46.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 <== mon.5 v1:172.21.15.171:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7736 (unknown 0 0 3619870573) 0x7f5d24007e40 con 0x7f5d0c0090f0 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.171:6791/0 conn(0x7f5d0c0090f0 legacy=0x7f5d0c009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d28ff9640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.171:6791/0 conn(0x7f5d0c0090f0 legacy=0x7f5d0c009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 416484, 2024-04-26T00:15:46.419 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:46.420 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:46.421 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:46.422 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:46.423 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:46.424 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.425 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.426 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.427 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.428 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.429 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.430 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.431 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:46.432 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.433 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.434 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.435 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.436 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 2 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:46.437 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.171:6812/722422047 conn(0x7f5d18037e30 legacy=0x7f5d1803a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 10 monclient: shutdown 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 >> v1:172.21.15.106:6789/0 conn(0x7f5d2c134820 legacy=0x7f5d2c13b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d30f07640 1 -- 172.21.15.106:0/1222433467 reap_dead start 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d30f07640 1 -- 172.21.15.106:0/1222433467 reap_dead start 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 shutdown_connections 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 >> 172.21.15.106:0/1222433467 conn(0x7f5d2c0a64e0 msgr2=0x7f5d2c0a1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 shutdown_connections 2024-04-26T00:15:46.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.426+0000 7f5d3296a640 1 -- 172.21.15.106:0/1222433467 wait complete. 2024-04-26T00:15:46.440 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:46.440 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-04-26T00:15:46.440 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: get_monmap_and_config 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: monmap: 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:46.574883+0000 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:46.574883+0000 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.545 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.546 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 Processor -- start 2024-04-26T00:15:46.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- start start 2024-04-26T00:15:46.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: init 2024-04-26T00:15:46.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: _add_conns ranks=[0,1,7,3,8,4,6,5,2] 2024-04-26T00:15:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient(hunting): picked mon.noname-a con 0x7f5b9c137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient(hunting): picked mon.noname-f con 0x7f5b9c0a0b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient(hunting): picked mon.noname-i con 0x7f5b9c138220 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:46.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c0a2750 con 0x7f5b9c137730 2024-04-26T00:15:46.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c0a2a30 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c0a2d10 con 0x7f5b9c138220 2024-04-26T00:15:46.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient(hunting): authenticate will time out at 2202.102177s 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9a59c640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f5b9c137730 0x7f5b9c137b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40714/0 (socket says 172.21.15.106:40714) 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9a59c640 1 -- 172.21.15.106:0/456155341 learned_addr learned my addr 172.21.15.106:0/456155341 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1733868409 0 0) 0x7f5b9c0a2750 con 0x7f5b9c137730 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient(hunting): my global_id is 274653 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b84003530 con 0x7f5b9c137730 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 232710884 0 0) 0x7f5b84003530 con 0x7f5b9c137730 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 >> v1:172.21.15.171:6792/0 conn(0x7f5b9c138220 legacy=0x7f5b9c140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 >> v1:172.21.15.171:6789/0 conn(0x7f5b9c0a0b20 legacy=0x7f5b9c13ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 monclient: found mon.noname-a 2024-04-26T00:15:46.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c0a4680 con 0x7f5b9c137730 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b94001b40 con 0x7f5b9c137730 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: dump: 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.556 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 5 monclient: authenticate success, global_id 274653 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b94001e30 con 0x7f5b9c137730 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 1 -- 172.21.15.106:0/456155341 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b94004f70 con 0x7f5b9c137730 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 4 set_mon_vals no callback set 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5b9959a640 10 monclient: dump: 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.558 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 10 monclient: shutdown 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- 172.21.15.106:0/456155341 >> v1:172.21.15.106:6789/0 conn(0x7f5b9c137730 legacy=0x7f5b9c137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.559 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- 172.21.15.106:0/456155341 shutdown_connections 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- 172.21.15.106:0/456155341 >> 172.21.15.106:0/456155341 conn(0x7f5b9c0a6b80 msgr2=0x7f5b9c0a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- 172.21.15.106:0/456155341 shutdown_connections 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.570+0000 7f5ba0c77640 1 -- 172.21.15.106:0/456155341 wait complete. 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: monmap: 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.560 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 Processor -- start 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 -- start start 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: init 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.561 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: _add_conns ranks=[6,3,2,5,8,7,0,4,1] 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient(hunting): picked mon.noname-d con 0x7f5b9c0a0b20 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient(hunting): picked mon.noname-g con 0x7f5b9c137730 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient(hunting): picked mon.noname-b con 0x7f5b9c138220 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c1307d0 con 0x7f5b9c138220 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c136390 con 0x7f5b9c137730 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b9c132b10 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient(hunting): authenticate will time out at 2202.105159s 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b9ad9d640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f5b9c138220 0x7f5b9c1d4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48160/0 (socket says 172.21.15.106:48160) 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b9ad9d640 1 -- 172.21.15.106:0/2277343858 learned_addr learned my addr 172.21.15.106:0/2277343858 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b9a59c640 1 --1- 172.21.15.106:0/2277343858 >> v1:172.21.15.106:6792/0 conn(0x7f5b9c0a0b20 0x7f5b9c12f9b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33824/0 (socket says 172.21.15.106:33824) 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1935346683 0 0) 0x7f5b9c132b10 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.562 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): my global_id is 254895 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b7c003530 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3822474267 0 0) 0x7f5b9c1307d0 con 0x7f5b9c138220 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): my global_id is 294176 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b9c132b10 con 0x7f5b9c138220 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2955849700 0 0) 0x7f5b7c003530 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b9c1307d0 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b94001b00 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:46.563 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): dump: 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.564 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 304404425 0 0) 0x7f5b9c132b10 con 0x7f5b9c138220 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b7c003530 con 0x7f5b9c138220 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b8c0018c0 con 0x7f5b9c138220 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): dump: 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.565 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477189491 0 0) 0x7f5b9c136390 con 0x7f5b9c137730 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): my global_id is 294177 2024-04-26T00:15:46.566 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b9c132b10 con 0x7f5b9c137730 2024-04-26T00:15:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2536845535 0 0) 0x7f5b9c1307d0 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.171:6790/0 conn(0x7f5b9c137730 legacy=0x7f5b9c1300c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.106:6790/0 conn(0x7f5b9c138220 legacy=0x7f5b9c1d4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.567 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 monclient: found mon.d 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9c130ad0 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 5 monclient: authenticate success, global_id 254895 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: _renew_subs 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9c1315f0 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.568 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: _renew_subs 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5b9c133760 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5b94004fb0 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b94005530 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b98d99640 4 set_mon_vals no callback set 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: dump: 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.569 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5b800065d0 con 0x7f5b80002870 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5b940102d0 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.570 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5b94045590 con 0x7f5b9c0a0b20 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 773966744 0 0) 0x7f5b800065d0 con 0x7f5b80002870 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient(hunting): my global_id is 147085 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b9c1307d0 con 0x7f5b80002870 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b9ad9d640 10 monclient: get_auth_request con 0x7f5b7c037f30 auth_method 0 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2318678960 0 0) 0x7f5b9c1307d0 con 0x7f5b80002870 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b800065d0 con 0x7f5b80002870 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b90001940 con 0x7f5b80002870 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.574+0000 7f5b8affd640 10 monclient: dump: 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.571 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.572 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.578+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1221672605 0 0) 0x7f5b800065d0 con 0x7f5b80002870 2024-04-26T00:15:46.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.578+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b8000a160 con 0x7f5b80002870 2024-04-26T00:15:46.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.578+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5b90004650 con 0x7f5b80002870 2024-04-26T00:15:46.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.578+0000 7f5b8affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.578+0000 7f5b8affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:46.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.578+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.171:6792/0 conn(0x7f5b80002870 legacy=0x7f5b80004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.573 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.578+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.171:6792/0 conn(0x7f5b80002870 legacy=0x7f5b80004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5ba0c77640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-04-26T00:15:46.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5b80009e30 con 0x7f5b800090f0 2024-04-26T00:15:46.574 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835544791 0 0) 0x7f5b80009e30 con 0x7f5b800090f0 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 10 monclient(hunting): my global_id is 147094 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5b800065d0 con 0x7f5b800090f0 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4172614037 0 0) 0x7f5b800065d0 con 0x7f5b800090f0 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5b80009e30 con 0x7f5b800090f0 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5b90003bf0 con 0x7f5b800090f0 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.582+0000 7f5b8affd640 10 monclient: dump: 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.575 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 953169798 0 0) 0x7f5b80009e30 con 0x7f5b800090f0 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 --> v1:172.21.15.171:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5b8000c3a0 con 0x7f5b800090f0 2024-04-26T00:15:46.576 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 <== mon.7 v1:172.21.15.171:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7907 (unknown 0 0 4235038546) 0x7f5b90003e20 con 0x7f5b800090f0 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b8affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b8affd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.171:6792/0 conn(0x7f5b800090f0 legacy=0x7f5b80009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b8affd640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.171:6792/0 conn(0x7f5b800090f0 legacy=0x7f5b80009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "state": "peon", 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "election_epoch": 132, 2024-04-26T00:15:46.577 INFO:teuthology.orchestra.run.smithi106.stdout: "uptime": 1010116, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum": [ 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 0, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 1, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 2, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 3, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 4, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 5, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 6, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 7, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: 8 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_age": 1, 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.578 INFO:teuthology.orchestra.run.smithi106.stdout: "required_con": "2450521708007866372", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "required_mon": [ 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.579 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_con": "4540701547738038271", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "quorum_mon": [ 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.580 INFO:teuthology.orchestra.run.smithi106.stdout: "outside_quorum": [], 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "extra_probe_peers": [], 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "sync_provider": [], 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "monmap": { 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "epoch": 1, 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "fsid": "91a11040-4c8b-4137-ad71-c18376365faa", 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "modified": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "created": "2024-04-25T23:54:15.226551Z", 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release": 19, 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "min_mon_release_name": "squid", 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "election_strategy": 1, 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "disallowed_leaders: ": "", 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false, 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "tiebreaker_mon": "", 2024-04-26T00:15:46.581 INFO:teuthology.orchestra.run.smithi106.stdout: "removed_ranks: ": "", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "features": { 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "persistent": [ 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "kraken", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "luminous", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "mimic", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "osdmap-prune", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "nautilus", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "octopus", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "pacific", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "elector-pinging", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "quincy", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "reef", 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: "squid" 2024-04-26T00:15:46.582 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "optional": [] 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "mons": [ 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 0, 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "a", 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789", 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.583 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6789/0", 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 1, 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "f", 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.584 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789", 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6789/0", 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 2, 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "b", 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.585 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790", 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6790/0", 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.586 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 3, 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "g", 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790", 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6790/0", 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.587 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 4, 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "c", 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791", 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.588 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6791/0", 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 5, 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "h", 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791", 2024-04-26T00:15:46.589 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6791/0", 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 6, 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "d", 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.590 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792", 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6792/0", 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.591 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 7, 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "i", 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792", 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.171:6792/0", 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.592 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "rank": 8, 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "name": "e", 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addrs": { 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addrvec": [ 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "type": "v1", 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793", 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "nonce": 0 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.593 INFO:teuthology.orchestra.run.smithi106.stdout: "public_addr": "172.21.15.106:6793/0", 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "priority": 0, 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "weight": 0, 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "crush_location": "{}" 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "feature_map": { 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "mon": [ 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.594 INFO:teuthology.orchestra.run.smithi106.stdout: "osd": [ 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "client": [ 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: ], 2024-04-26T00:15:46.595 INFO:teuthology.orchestra.run.smithi106.stdout: "mgr": [ 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: { 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "features": "0x3f03cffffffdffff", 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "release": "luminous", 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "num": 1 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: } 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: ] 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: }, 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout: "stretch_mode": false 2024-04-26T00:15:46.596 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:46.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.171:6812/722422047 conn(0x7f5b7c037f30 legacy=0x7f5b7c03a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 10 monclient: shutdown 2024-04-26T00:15:46.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 >> v1:172.21.15.106:6792/0 conn(0x7f5b9c0a0b20 legacy=0x7f5b9c12f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b9ad9d640 1 -- 172.21.15.106:0/2277343858 reap_dead start 2024-04-26T00:15:46.598 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5b9ad9d640 1 -- 172.21.15.106:0/2277343858 reap_dead start 2024-04-26T00:15:46.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 shutdown_connections 2024-04-26T00:15:46.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 >> 172.21.15.106:0/2277343858 conn(0x7f5b9c0a6b80 msgr2=0x7f5b9c12e650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 shutdown_connections 2024-04-26T00:15:46.599 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.586+0000 7f5ba0c77640 1 -- 172.21.15.106:0/2277343858 wait complete. 2024-04-26T00:15:46.599 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-04-26T00:15:46.599 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-04-26T00:15:46.599 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-04-26T00:15:46.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 10 monclient: get_monmap_and_config 2024-04-26T00:15:46.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 10 monclient: monmap: 2024-04-26T00:15:46.726 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.726 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:46.744963+0000 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:46.744963+0000 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.727 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 1 Processor -- start 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 1 -- start start 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 10 monclient: init 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.738+0000 7fe3f3f53640 10 monclient: _add_conns ranks=[1,7,3,2,6,0,4,8,5] 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): picked mon.noname-f con 0x7fe3ec137c40 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): picked mon.noname-i con 0x7fe3ec09fca0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): picked mon.noname-g con 0x7fe3ec137570 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:46.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec06ee10 con 0x7fe3ec137c40 2024-04-26T00:15:46.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec0a2220 con 0x7fe3ec137570 2024-04-26T00:15:46.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec06f0f0 con 0x7fe3ec09fca0 2024-04-26T00:15:46.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): authenticate will time out at 2202.272085s 2024-04-26T00:15:46.729 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f1cef640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7fe3ec137c40 0x7fe3ec0a1400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:34022/0 (socket says 172.21.15.106:34022) 2024-04-26T00:15:46.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f24f0640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7fe3ec137570 0x7fe3ec1408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:53714/0 (socket says 172.21.15.106:53714) 2024-04-26T00:15:46.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f24f0640 1 -- 172.21.15.106:0/692087579 learned_addr learned my addr 172.21.15.106:0/692087579 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305010346 0 0) 0x7fe3e8001120 con 0x7fe3ec137c40 2024-04-26T00:15:46.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): my global_id is 294184 2024-04-26T00:15:46.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3d4003530 con 0x7fe3ec137c40 2024-04-26T00:15:46.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2585230443 0 0) 0x7fe3ec0a2220 con 0x7fe3ec137570 2024-04-26T00:15:46.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): my global_id is 294186 2024-04-26T00:15:46.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3e8001120 con 0x7fe3ec137570 2024-04-26T00:15:46.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3380334768 0 0) 0x7fe3ec06f0f0 con 0x7fe3ec09fca0 2024-04-26T00:15:46.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient(hunting): my global_id is 147103 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3ec0a2220 con 0x7fe3ec09fca0 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2164498240 0 0) 0x7fe3d4003530 con 0x7fe3ec137c40 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 >> v1:172.21.15.171:6792/0 conn(0x7fe3ec09fca0 legacy=0x7fe3ec0a1b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 >> v1:172.21.15.171:6790/0 conn(0x7fe3ec137570 legacy=0x7fe3ec1408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 monclient: found mon.noname-f 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec06f3d0 con 0x7fe3ec137c40 2024-04-26T00:15:46.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3e8001990 con 0x7fe3ec137c40 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 5 monclient: authenticate success, global_id 294184 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: dump: 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.734 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.735 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3e8001c40 con 0x7fe3ec137c40 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 4 set_mon_vals no callback set 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 1 -- 172.21.15.106:0/692087579 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3e8004b30 con 0x7fe3ec137c40 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.736 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f0ced640 10 monclient: dump: 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.737 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient: shutdown 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- 172.21.15.106:0/692087579 >> v1:172.21.15.171:6789/0 conn(0x7fe3ec137c40 legacy=0x7fe3ec0a1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- 172.21.15.106:0/692087579 shutdown_connections 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- 172.21.15.106:0/692087579 >> 172.21.15.106:0/692087579 conn(0x7fe3ec0a64e0 msgr2=0x7fe3ec0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- 172.21.15.106:0/692087579 shutdown_connections 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- 172.21.15.106:0/692087579 wait complete. 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient: build_initial_monmap 2024-04-26T00:15:46.738 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient: monmap: 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:46.739 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 Processor -- start 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- start start 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient: init 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient: _add_conns ranks=[3,4,0,2,7,5,1,8,6] 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): picked mon.noname-g con 0x7fe3ec09fca0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): picked mon.noname-c con 0x7fe3ec137570 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): picked mon.noname-a con 0x7fe3ec137c40 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec122b80 con 0x7fe3ec137c40 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec120d30 con 0x7fe3ec09fca0 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe3ec072970 con 0x7fe3ec137570 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.742+0000 7fe3f3f53640 10 monclient(hunting): authenticate will time out at 2202.275933s 2024-04-26T00:15:46.740 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f24f0640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7fe3ec137c40 0x7fe3ec1d4f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40720/0 (socket says 172.21.15.106:40720) 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f24f0640 1 -- 172.21.15.106:0/2876444618 learned_addr learned my addr 172.21.15.106:0/2876444618 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1829047161 0 0) 0x7fe3ec122b80 con 0x7fe3ec137c40 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): my global_id is 274662 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3d8003530 con 0x7fe3ec137c40 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2293937388 0 0) 0x7fe3ec072970 con 0x7fe3ec137570 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): my global_id is 274774 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3ec122b80 con 0x7fe3ec137570 2024-04-26T00:15:46.741 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2684331059 0 0) 0x7fe3ec120d30 con 0x7fe3ec09fca0 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): my global_id is 294195 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe3ec072970 con 0x7fe3ec09fca0 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2966318571 0 0) 0x7fe3d8003530 con 0x7fe3ec137c40 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3ec120d30 con 0x7fe3ec137c40 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3dc001990 con 0x7fe3ec137c40 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): dump: 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.742 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.743 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4150243039 0 0) 0x7fe3ec122b80 con 0x7fe3ec137570 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe3d8003530 con 0x7fe3ec137570 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3e4001d60 con 0x7fe3ec137570 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient(hunting): dump: 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.744 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.745 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3799977014 0 0) 0x7fe3ec120d30 con 0x7fe3ec137c40 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 >> v1:172.21.15.106:6791/0 conn(0x7fe3ec137570 legacy=0x7fe3ec1d1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 >> v1:172.21.15.171:6790/0 conn(0x7fe3ec09fca0 legacy=0x7fe3ec1313b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 monclient: found mon.a 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3ec0724d0 con 0x7fe3ec137c40 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 5 monclient: authenticate success, global_id 274662 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 10 monclient: _renew_subs 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe3ec1ccc00 con 0x7fe3ec137c40 2024-04-26T00:15:46.746 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 10 monclient: _renew_subs 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe3dc0047f0 con 0x7fe3ec137c40 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fe3ec1228a0 con 0x7fe3ec137c40 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe3dc004d60 con 0x7fe3ec137c40 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 10 monclient: dump: 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:46.747 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e3fff640 4 set_mon_vals no callback set 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe3dc004fc0 con 0x7fe3ec137c40 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fe3dc045190 con 0x7fe3ec137c40 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.748 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3ec075890 con 0x7fe3ec137c40 2024-04-26T00:15:46.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.746+0000 7fe3f1cef640 10 monclient: get_auth_request con 0x7fe3d8037fa0 auth_method 0 2024-04-26T00:15:46.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.750+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe3dc0157c0 con 0x7fe3ec137c40 2024-04-26T00:15:46.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.750+0000 7fe3e27fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:46.749 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.750+0000 7fe3e27fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:46.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.962+0000 7fe3f3f53640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-04-26T00:15:46.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.962+0000 7fe3f3f53640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-04-26T00:15:46.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.962+0000 7fe3f3f53640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:46.937 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.962+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fe3ec062e50 con 0x7fe3ec137c40 2024-04-26T00:15:46.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.962+0000 7fe3e27fc640 1 -- 172.21.15.106:0/2876444618 <== mon.0 v1:172.21.15.106:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fe3dc0150c0 con 0x7fe3ec137c40 2024-04-26T00:15:46.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.962+0000 7fe3e27fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-04-26T00:15:46.939 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.962+0000 7fe3e27fc640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=29,config=1,health=12,kv=12,logm=46} crc {auth=3207260152,config=3678701417,health=2578490905,kv=3741052589,logm=742846962}) 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=33,config=2,health=12,kv=10,logm=43} crc {auth=3498402226,config=692619927,health=2578490905,kv=2662106322,logm=3966365644}) 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=29,config=2,health=12,kv=11,logm=46} crc {auth=3233268196,config=692619927,health=48896099,kv=2534290764,logm=1637872037}) 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.942 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=33,config=2,health=11,kv=11,logm=43} crc {auth=3498402226,config=692619927,health=4195516130,kv=1342168570,logm=238531176}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=32,config=2,health=12,kv=12,logm=42} crc {auth=844141075,config=692619927,health=2578490905,kv=1996692365,logm=430825872}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=31,config=2,health=10,kv=11,logm=46} crc {auth=3854338931,config=692619927,health=3230208285,kv=1310016058,logm=3623824039}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=33,config=1,health=10,kv=12,logm=44} crc {auth=3498402226,config=3678701417,health=494519786,kv=1996692365,logm=2770055376}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=31,config=2,health=12,kv=12,logm=43} crc {auth=4137821220,config=692619927,health=2578490905,kv=1996692365,logm=56949012}) 2024-04-26T00:15:46.943 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.966+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=30,config=2,health=12,kv=12,logm=44} crc {auth=1572830304,config=692619927,health=2578490905,kv=1996692365,logm=3934644898}) 2024-04-26T00:15:46.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 >> v1:172.21.15.171:6812/722422047 conn(0x7fe3d8037fa0 legacy=0x7fe3d803a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 10 monclient: shutdown 2024-04-26T00:15:46.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:46.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 >> v1:172.21.15.106:6789/0 conn(0x7fe3ec137c40 legacy=0x7fe3ec1d4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:46.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 shutdown_connections 2024-04-26T00:15:46.944 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 >> 172.21.15.106:0/2876444618 conn(0x7fe3ec0a64e0 msgr2=0x7fe3ec0a40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:46.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 shutdown_connections 2024-04-26T00:15:46.945 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:46.966+0000 7fe3f3f53640 1 -- 172.21.15.106:0/2876444618 wait complete. 2024-04-26T00:15:46.947 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=681936116}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4178675107}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=916868007}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3141806167}) 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.948 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2267175788}) 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2405459135}) 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1497958171}) 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4208818173}) 2024-04-26T00:15:46.949 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.970+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1528057007}) 2024-04-26T00:15:46.952 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.952 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.952 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2268069681}) 2024-04-26T00:15:46.952 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.952 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4040430982}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1601174275}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=361531018}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1073806989}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3367075386}) 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.953 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.954 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1569593771}) 2024-04-26T00:15:46.954 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.954 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1150615980}) 2024-04-26T00:15:46.954 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.974+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1023820906}) 2024-04-26T00:15:46.957 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.957 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.957 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1980548024}) 2024-04-26T00:15:46.957 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.957 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.957 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1860261187}) 2024-04-26T00:15:46.957 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2327182004}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=947919933}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=779019855}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2858796415}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.958 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=158481528}) 2024-04-26T00:15:46.959 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.959 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2605225014}) 2024-04-26T00:15:46.959 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.978+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2780399176}) 2024-04-26T00:15:46.963 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.963 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.963 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1693237017}) 2024-04-26T00:15:46.963 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=321340273}) 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1607950452}) 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3217475864}) 2024-04-26T00:15:46.964 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2570960857}) 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2017355783}) 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1741054984}) 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1635385550}) 2024-04-26T00:15:46.965 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.986+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4095833593}) 2024-04-26T00:15:46.966 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3248865888}) 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1527362308}) 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.971 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3824524019}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2739971150}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3086062949}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3003010689}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3895266111}) 2024-04-26T00:15:46.972 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2472921933}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.990+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2454485721}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=239118798}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3790561840}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3731889834}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.973 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3232244499}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=333253424}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3475715835}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1544639536}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4248074458}) 2024-04-26T00:15:46.974 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.994+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1660751019}) 2024-04-26T00:15:46.979 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.979 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.979 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=162445025}) 2024-04-26T00:15:46.979 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2677969034}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1980623812}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1592924252}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2210812535}) 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.980 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2219367781}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3320896274}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3400798424}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:46.998+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=491655084}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=724201678}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=437466072}) 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.981 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1831967766}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3204251131}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2020406376}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2319186348}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.982 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2881354269}) 2024-04-26T00:15:46.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1761584766}) 2024-04-26T00:15:46.983 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4074346531}) 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.002+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1851065100}) 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=705302123}) 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.989 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=365301537}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2328686779}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1626834126}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3055438180}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.990 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=913587024}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3978739158}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3785666063}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3279120632}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=211279849}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=349988830}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.991 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2021163471}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4094195490}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2919452047}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2295005638}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=39882726}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.006+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3680075257}) 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.992 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1670825240}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2825028724}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=762053440}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=466213260}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=756100536}) 2024-04-26T00:15:46.993 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=687804125}) 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=106418799}) 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675626653}) 2024-04-26T00:15:46.994 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.010+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1493756387}) 2024-04-26T00:15:47.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3255268880}) 2024-04-26T00:15:47.001 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1140295381}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1962140826}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2527088037}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3896238221}) 2024-04-26T00:15:47.002 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1336238166}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1928004921}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1434691401}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.014+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1014727789}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3355082563}) 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.003 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2080481505}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2792610568}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2842613972}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3686416905}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1614527786}) 2024-04-26T00:15:47.004 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2838353722}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2023842268}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.018+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=942001917}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2267064341}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=366277079}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.005 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2460540183}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=176641168}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1738236935}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=66405711}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4127955025}) 2024-04-26T00:15:47.006 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2286156075}) 2024-04-26T00:15:47.007 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.022+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4174144486}) 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3523448968}) 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2477623081}) 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.016 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4284727269}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3351343445}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1548235970}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4000884165}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2286518172}) 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.017 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3421255511}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.026+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1155935186}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2905482484}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=576430091}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3803832993}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4090591306}) 2024-04-26T00:15:47.018 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1977698236}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=216073862}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3865251318}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=637679930}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.030+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=660693300}) 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.019 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1533133073}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=556671199}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1169010345}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2222530983}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2795824400}) 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.020 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=102134317}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2445330444}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2898214965}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.034+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2119244292}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=439215099}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3055806363}) 2024-04-26T00:15:47.021 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=977093012}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3546939056}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1483420265}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3575313732}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=163616864}) 2024-04-26T00:15:47.022 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2067514659}) 2024-04-26T00:15:47.023 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.038+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3439244286}) 2024-04-26T00:15:47.032 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3278767680}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=913136185}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2752026341}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2311505480}) 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.033 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=764851523}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2062134710}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3066558158}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2947389951}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.042+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2331914571}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=135836433}) 2024-04-26T00:15:47.034 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1542719605}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4046932658}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2697825020}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1654345845}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.035 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1424070355}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=507246224}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4258209096}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3775712650}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.046+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2085816244}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=947977077}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.036 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=83193271}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3272061626}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=359856554}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=111148758}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3413448134}) 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.037 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3675733601}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3328141593}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3551461967}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4032745077}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1059216875}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4150205859}) 2024-04-26T00:15:47.038 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2727439211}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2601029984}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3478607500}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=97443758}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.050+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4089684066}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.039 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3804595479}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3000331160}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2594238419}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1520143359}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=740460998}) 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.040 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.041 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=924064387}) 2024-04-26T00:15:47.041 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.041 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.041 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3827944399}) 2024-04-26T00:15:47.041 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.041 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1658886889}) 2024-04-26T00:15:47.041 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.054+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4131989346}) 2024-04-26T00:15:47.047 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2164505774}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3339565420}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3097604940}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1525236564}) 2024-04-26T00:15:47.048 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3066034273}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1688145298}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1447264356}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2245621832}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.058+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3900256471}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3210213288}) 2024-04-26T00:15:47.049 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2113629840}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=785066840}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3543163572}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1347392692}) 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.050 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2783441549}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1296508495}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=95623541}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.062+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4183063880}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2053902845}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1649030198}) 2024-04-26T00:15:47.051 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3110897138}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1400514709}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2650348443}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1263876712}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.052 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2857766816}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1451932409}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.066+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3786669715}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=459455981}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=247740343}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=175009910}) 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.053 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2194090913}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=5563005}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3733460622}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3450708195}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3025797460}) 2024-04-26T00:15:47.054 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1903872311}) 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.070+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4093335414}) 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1243065196}) 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3083415472}) 2024-04-26T00:15:47.064 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3828333931}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2360042082}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3725423022}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=788244096}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2653443320}) 2024-04-26T00:15:47.065 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3269103419}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3649754142}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1340579844}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=8020229}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1834673988}) 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.066 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2025419771}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4291906067}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1181754464}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2976709932}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.074+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1825552630}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3089719358}) 2024-04-26T00:15:47.067 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1943490922}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=585689468}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3696283079}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=238607413}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=123684598}) 2024-04-26T00:15:47.068 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3299256940}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3088415540}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.078+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1125195074}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1417509389}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1436919048}) 2024-04-26T00:15:47.069 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=517061359}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=602138213}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=161786708}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3144173491}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.070 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2174452073}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=182442936}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.082+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3293342555}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=980514480}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1421757486}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1580366174}) 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.071 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2260639185}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3954708160}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4250958129}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=991760022}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2606946588}) 2024-04-26T00:15:47.072 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.086+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3126053036}) 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2095993720}) 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2637412370}) 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.083 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2819792047}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3027015167}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3885760725}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2207994151}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1542393017}) 2024-04-26T00:15:47.084 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=341414328}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.090+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2602491961}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=99594287}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3494621329}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2957500174}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.085 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3657488629}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=173188705}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2615499588}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3388368689}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=706302770}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=542808155}) 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.086 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3844868391}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3717264783}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2596176811}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.094+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3702663254}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2851176723}) 2024-04-26T00:15:47.087 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1249813217}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1286377403}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=570671075}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3717669674}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=930188176}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.088 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3967492205}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1832460747}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=463805744}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3446527316}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=881616144}) 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.089 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3924440186}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4161169031}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.098+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1923818666}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1829015230}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1544639218}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.090 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2986094572}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3802786995}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=557155036}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2609968460}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1886319415}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=769513801}) 2024-04-26T00:15:47.091 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.102+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=980779845}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4048753501}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1034619715}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3451514286}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1891727180}) 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.092 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1724676225}) 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=53284676}) 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3228499341}) 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2059402336}) 2024-04-26T00:15:47.093 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.106+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2089592848}) 2024-04-26T00:15:47.115 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.115 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.115 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3410827363}) 2024-04-26T00:15:47.115 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.115 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.115 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4159424289}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2794444743}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1525036989}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3156309193}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3717062989}) 2024-04-26T00:15:47.116 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2536989747}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2904064802}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2363694830}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4098935822}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1597167676}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.117 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=631269670}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4067043154}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3489472178}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1407904544}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=617295247}) 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.118 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=153500281}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.110+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4103702563}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2138661400}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1860127036}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2494086373}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2034869964}) 2024-04-26T00:15:47.119 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=899525338}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2375370562}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4028063649}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=141634879}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1802160922}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.120 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=995303779}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1403632819}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=558990428}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2490953935}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3023935244}) 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.121 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=716444005}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745721941}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=976745250}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.114+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1872298875}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3788965361}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=857127065}) 2024-04-26T00:15:47.122 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=633431792}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3772589896}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2366495658}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=545487948}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.123 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=622295312}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2668364073}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.118+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1146402824}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=484525719}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=397438079}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2090338935}) 2024-04-26T00:15:47.124 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3861230043}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3775866512}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=833855868}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1112808373}) 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.125 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1169928108}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2498000488}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1592496932}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=564173824}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1151442078}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=794606501}) 2024-04-26T00:15:47.126 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2713465962}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2632142224}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3475818479}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1951640035}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.122+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4225308763}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.127 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2568240977}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3756684093}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4012964655}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3756553138}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2185225764}) 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.128 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2436622562}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3849944983}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3026481417}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3004035876}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1600067297}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3366533779}) 2024-04-26T00:15:47.129 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1045293588}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2971459129}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4234682882}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=876979888}) 2024-04-26T00:15:47.130 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.126+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2446570305}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=995251159}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2264270039}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3660804971}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1873287681}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.131 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4257548436}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1929323226}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4237201292}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2202500648}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1966101612}) 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.132 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=533211246}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.130+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1750386320}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=712520863}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=295064575}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2378794659}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.133 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4103547145}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1511307834}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1521412876}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=767639661}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3842986230}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1629102263}) 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.134 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2207982484}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=313963740}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1981355915}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3895908740}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.135 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2528602578}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3511379449}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4054246906}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2512272755}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.134+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2308836680}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2171369833}) 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.136 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2552728492}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3622015928}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4096747318}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3172219964}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.137 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3638315657}) 2024-04-26T00:15:47.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1610110030}) 2024-04-26T00:15:47.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1830464682}) 2024-04-26T00:15:47.138 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3357676016}) 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2394230063}) 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2075399085}) 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.138+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.271 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=109334686}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1056286061}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2272529311}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1950638455}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3738170880}) 2024-04-26T00:15:47.272 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2753522230}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2000589532}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3293448992}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3710972440}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2458319573}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.273 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=428562265}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3440313596}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=962651630}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3687048293}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=240837747}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.142+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1613098187}) 2024-04-26T00:15:47.274 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=289516332}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3297174999}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3926904703}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3143383083}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2597868366}) 2024-04-26T00:15:47.275 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=811542034}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1605052647}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=952734536}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=94352098}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1940568752}) 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.276 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3898932969}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=777413662}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2271158750}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=779958921}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2492143096}) 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.277 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1539375879}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=951364047}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.146+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3638944650}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2502999238}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2408565034}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=337495995}) 2024-04-26T00:15:47.278 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2143706747}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3818771390}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=127923602}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=895544798}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1053816639}) 2024-04-26T00:15:47.279 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.150+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1669986808}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2633938675}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1592633861}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4289580104}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3516795081}) 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.280 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=967715939}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1937710353}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=320158560}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=382815369}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.154+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3980639126}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3392869797}) 2024-04-26T00:15:47.281 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3965779940}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3114119729}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2365475620}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=962072932}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.282 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2091849103}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1410128021}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2811740975}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3585098431}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1106513928}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3671767342}) 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.283 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1945754804}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2288951761}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4167437493}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3283155488}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3893956223}) 2024-04-26T00:15:47.284 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2730304116}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.158+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2776021533}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2537871026}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3299100362}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1124382901}) 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.285 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2485437674}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2628653179}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1625868444}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1000114192}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=206985152}) 2024-04-26T00:15:47.286 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1031547905}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4155369343}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=270661238}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1793898520}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1591767930}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.287 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=256774648}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2239129315}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3465541649}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3470461406}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.162+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2726209077}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3025004855}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.288 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4218214965}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3620316403}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1688138962}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4090785967}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2040934237}) 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.289 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4102677793}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=20407052}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=580427648}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3933008270}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=472396121}) 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.290 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=661590919}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4139363038}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.166+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2456810523}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3973067462}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1700012159}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680885215}) 2024-04-26T00:15:47.291 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=260551895}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=317362539}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3784949729}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1401083765}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2828718352}) 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.292 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3787090070}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=25395165}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3445494585}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=903864068}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2835294538}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=782724520}) 2024-04-26T00:15:47.293 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3698422773}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2426920690}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2636010229}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.170+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4207839065}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.294 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=728733245}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2941764220}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1581523902}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=545916846}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1929735359}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3682181341}) 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.295 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1145080995}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2029219013}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=301335677}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1563738140}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3575636926}) 2024-04-26T00:15:47.296 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=562618884}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2180098936}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.174+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3876261007}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1702076096}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=176806594}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.297 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1665194285}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=976554209}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3374405167}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3310822942}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2511293665}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=749156137}) 2024-04-26T00:15:47.298 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1383382612}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=843520641}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1460447902}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2155928359}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.299 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3743362828}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3571792575}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2835883501}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3676769427}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.178+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3686069315}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4230586358}) 2024-04-26T00:15:47.300 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=279826438}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1435783108}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2599333945}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2241398543}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=60763373}) 2024-04-26T00:15:47.301 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1386467689}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=336735872}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3259736846}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=476304962}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1834274477}) 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.302 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1237106591}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3549208780}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4227351575}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1709500194}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=768628298}) 2024-04-26T00:15:47.303 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=323950678}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.182+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2376079963}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2032022995}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3017834197}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=654772751}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1500699576}) 2024-04-26T00:15:47.304 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3856874741}) 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3802746835}) 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3882508933}) 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=315061450}) 2024-04-26T00:15:47.305 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3519079799}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2498784091}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=201196771}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1209115045}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1835023615}) 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.306 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3890724885}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2960517428}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2638307274}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2872640160}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.186+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2750680784}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3781629659}) 2024-04-26T00:15:47.307 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1416073128}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1631187937}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3530938206}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2382468700}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.308 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=651963486}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=997884969}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2265599607}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.190+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1758179269}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1955112722}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3402719455}) 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.309 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=77735707}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=871336023}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2135297616}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3994664369}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.310 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1236630394}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3941803819}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1603284296}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=132376726}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4089735423}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2757745136}) 2024-04-26T00:15:47.311 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3655040347}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2812459332}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2794044597}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1351812912}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1680659862}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.194+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2668885595}) 2024-04-26T00:15:47.312 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1569757230}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3801036459}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3213412602}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1468614467}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.313 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=733064573}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3150910118}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2267840037}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4016041804}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4219498762}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2869950603}) 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.314 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3326451405}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2619816951}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3429054135}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2811549426}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3376477722}) 2024-04-26T00:15:47.315 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2358579265}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1340704279}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.198+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2259076503}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2952758666}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=473216308}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=987452020}) 2024-04-26T00:15:47.316 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1721875564}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4259045248}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=77973384}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1738466403}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=132702939}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2863340229}) 2024-04-26T00:15:47.317 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=886932545}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1474761133}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.202+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1586086381}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2251168176}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.318 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=990248884}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3821006973}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3907937113}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2483103653}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=201004178}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3813234346}) 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.319 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3854412797}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2051089714}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=36501260}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1158604182}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2937278877}) 2024-04-26T00:15:47.320 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1408916093}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2469849150}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.206+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=43023165}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=700545507}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3288180460}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.321 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=883341364}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2538227966}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=834473353}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1888330274}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4203091853}) 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.322 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=814187921}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=922386003}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4201387987}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3720579454}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=646473248}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2951600933}) 2024-04-26T00:15:47.323 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=62481224}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=575195410}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=337919626}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1578869147}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.210+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=96190689}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.324 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2453970173}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=987565661}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2564841368}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1601299235}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3869320402}) 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.325 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1483224191}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3787065466}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3861632662}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3875968433}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3840581119}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3517178320}) 2024-04-26T00:15:47.326 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3623767719}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=9765103}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1405502329}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4175667607}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=807483774}) 2024-04-26T00:15:47.327 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3801372287}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.214+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2069784513}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1031626998}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1996697764}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=225587533}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.328 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1990518898}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=854059547}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=66834215}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=472435618}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1809352160}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.218+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3581523263}) 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.329 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2041060650}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3942251403}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3105298196}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3685632015}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=712327600}) 2024-04-26T00:15:47.330 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1241799674}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3779272949}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=476429882}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2446281889}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3373462006}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1888455025}) 2024-04-26T00:15:47.331 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=252292794}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3465650344}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1972733970}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1593620554}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.332 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2430976244}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2939397863}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.222+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=689372594}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=543566376}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1777694498}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1786242994}) 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.333 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=568069429}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3541263782}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2398938968}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3911165564}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=338521935}) 2024-04-26T00:15:47.334 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=395620280}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2688480366}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=699482012}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3075712142}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3617644718}) 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.335 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3775610551}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2766147279}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3294303845}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1868219471}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.226+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4262567284}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3013234467}) 2024-04-26T00:15:47.336 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1158200931}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3625005563}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2566424604}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4076063571}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=298654550}) 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.337 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2945055171}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541231667}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=866253773}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=109188984}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2371065622}) 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.338 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1382641527}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3249054712}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3541805390}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1680868213}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=493929137}) 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.339 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=882051605}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.230+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3520801936}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=694658864}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3784801334}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3303177623}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3200957779}) 2024-04-26T00:15:47.340 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1539372382}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1063586682}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2431187255}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1227718552}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.234+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=573265239}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=840645725}) 2024-04-26T00:15:47.341 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2292570579}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1435418365}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1206950818}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1784804443}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.342 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1149241360}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3629238908}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=541862197}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1788930403}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2204931864}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1907457328}) 2024-04-26T00:15:47.343 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2281534193}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4176622281}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=82723574}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3647575908}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3540293410}) 2024-04-26T00:15:47.344 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2282855293}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.238+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3212801212}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4002817478}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2175831779}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=101933814}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.345 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=429207608}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=658744242}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1709070580}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4183561321}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2198412895}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1903192542}) 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.346 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2829136622}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=412258684}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1495068222}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2615931538}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4110963305}) 2024-04-26T00:15:47.347 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3062499705}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3132368972}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1991028413}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.242+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=594851161}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2643374377}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.348 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1444331616}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=748526729}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1089724080}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4168013559}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=995534854}) 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.349 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3528926397}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195952572}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1448480134}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=662248053}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4130433067}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2231711608}) 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.246+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.350 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3050390917}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1280534833}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1644848661}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=576319701}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1349350704}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2248424708}) 2024-04-26T00:15:47.351 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1337957436}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4169819100}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3434712555}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3035297469}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=605898887}) 2024-04-26T00:15:47.352 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4097036109}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1862895323}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3280551186}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.250+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3318020736}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=293439686}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.353 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=109692205}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3381500459}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3637433446}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3383848675}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2909221288}) 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.354 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1336373041}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3103155377}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3355744852}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1033929070}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3790695692}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2355527343}) 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.355 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3914477111}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3608645213}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.254+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3042665962}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2172188248}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3629314404}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3245253109}) 2024-04-26T00:15:47.356 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=390974255}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2870919519}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1520801807}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=791418451}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.357 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1419749551}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2675911211}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1927458917}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4003727325}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.258+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3190438588}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1493973894}) 2024-04-26T00:15:47.358 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1962960931}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3335806060}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2724733010}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2257019740}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.359 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=358958887}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=521950201}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4095884212}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2008658200}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2448517666}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1040377786}) 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.360 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4090402360}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2766092552}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1946332181}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3254532655}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1280690725}) 2024-04-26T00:15:47.361 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2563121688}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.262+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1782826889}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1703527559}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2784086387}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1512943027}) 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.362 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2265531726}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1601111011}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1637229662}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3948845738}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3379804410}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=682852187}) 2024-04-26T00:15:47.363 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2259771630}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2334952731}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3492885741}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3412345876}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.364 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2545370188}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=163226727}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1505812173}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2610481993}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.266+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2564475761}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1868423044}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.365 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2852713107}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4133817236}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=221896168}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3708028403}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1792435371}) 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.366 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=22022746}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1059403392}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2001122528}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1100688742}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2668748622}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.367 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1623329556}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1311534850}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2479271640}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1986480153}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3081878894}) 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.368 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2103662141}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.270+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3915706930}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2327296009}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1592173975}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2280386418}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3370486171}) 2024-04-26T00:15:47.369 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3282446058}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1463587591}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3423822559}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=124068855}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1020351275}) 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.370 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2937709117}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1101274308}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1960998376}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1565317559}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2168984387}) 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.371 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1731237541}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3752808332}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2055943431}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.274+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2391127395}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2671547598}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.372 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3244786054}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1600509923}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3401792233}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2432114330}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3793164218}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.373 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3991476430}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=877875391}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2424155426}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3868438043}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3517726383}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2003446083}) 2024-04-26T00:15:47.374 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1488836186}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3405630804}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=997109567}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1980649619}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4149310771}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.278+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1734996506}) 2024-04-26T00:15:47.375 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2196635034}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2149016798}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4021482429}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2347767846}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.376 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=86983296}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3700798516}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3495707173}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1810740538}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.282+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1702635254}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1665799850}) 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.377 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3363786056}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3495418115}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=249628910}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2415575664}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1233583182}) 2024-04-26T00:15:47.378 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=308449328}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1372309292}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1345928344}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1569493804}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4238848099}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.379 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3087832166}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=940403689}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3991846725}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3806025297}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=418142489}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4293944677}) 2024-04-26T00:15:47.380 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.286+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2957034603}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2478346441}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=793428560}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2918234751}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1143282452}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.381 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=132247688}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3481891832}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2654181458}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1498598235}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3464041185}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3394438610}) 2024-04-26T00:15:47.382 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2159924148}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2040665123}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=284985465}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=558414279}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=597229258}) 2024-04-26T00:15:47.383 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=232412412}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=614782629}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.290+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=925243216}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=923299582}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3095930028}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2348760134}) 2024-04-26T00:15:47.384 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=19836768}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2185225728}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2732641531}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=255186123}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1496876982}) 2024-04-26T00:15:47.385 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=745364954}) 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1104881724}) 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.294+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2920529031}) 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.422 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1299924910}) 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3686447768}) 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3727357554}) 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3808711503}) 2024-04-26T00:15:47.423 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=30405447}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2326217528}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2505520973}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2169814028}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2616994228}) 2024-04-26T00:15:47.424 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1353917379}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1148905421}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3062215116}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2585654526}) 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.425 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3292199959}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2175110382}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.298+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3259967656}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=505268805}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2686735790}) 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.426 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1565170067}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2167998861}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3826419280}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1876530949}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.427 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=482147901}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3512150071}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2059561945}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=368311675}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3989677531}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.302+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3420296700}) 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.428 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2398089811}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1793899744}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=929445096}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=990156483}) 2024-04-26T00:15:47.429 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4164169668}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=43375466}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3973161472}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=224879517}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=277345248}) 2024-04-26T00:15:47.430 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=280799102}) 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1788439445}) 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1690148320}) 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.431 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=467085975}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3862086907}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3992143647}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=998813449}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2470437148}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.432 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2941311546}) 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.306+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3320684726}) 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2878622403}) 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3543579649}) 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.433 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1537989135}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1479844142}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4003393949}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2960394460}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=42691132}) 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.434 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1755084253}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=682737668}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1884943086}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=345404583}) 2024-04-26T00:15:47.435 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3141127562}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4022919592}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.310+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1465727893}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=241072167}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=786239787}) 2024-04-26T00:15:47.436 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=512888054}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2004507214}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1135681182}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=531727452}) 2024-04-26T00:15:47.437 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=62690560}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=488623289}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3901362360}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=774521600}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3386357017}) 2024-04-26T00:15:47.438 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2464513224}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2394729936}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=181573681}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=189972687}) 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.439 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=560363472}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2360713719}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.314+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3953444228}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2322498213}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3071495907}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.440 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1084949805}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1459980487}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1647132848}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1166551056}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.441 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=254299992}) 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2320614581}) 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=402457239}) 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1921863851}) 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4248619795}) 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.442 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2627053385}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=670373283}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3290985713}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4076102440}) 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.443 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=859807182}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1166535217}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.318+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2022648770}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1945749524}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=133874697}) 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.444 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4062167772}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3751318608}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1818477020}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1453841732}) 2024-04-26T00:15:47.445 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=764280495}) 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=742431320}) 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.322+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3471708747}) 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2080420539}) 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.446 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2321486516}) 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1076880691}) 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3580250470}) 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3304384525}) 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.447 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1716044059}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=107987440}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3944277834}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1998605074}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=154692138}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.448 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=442175637}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2869758697}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4279630452}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2562306768}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.449 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3181568958}) 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2753630787}) 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1813796150}) 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.326+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1383403052}) 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=11,monmap=3,osd_metadata=2} crc {logm=42366289,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339439,mgr_metadata=177654402,mgrstat=2085298247,mon_config_key=809949667,monmap=828017138,osd_metadata=1078571208}) 2024-04-26T00:15:47.450 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=61,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=10,monmap=3,osd_metadata=2} crc {logm=388458337,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=129152054,mon_config_key=3430297671,monmap=828017138,osd_metadata=2505607664}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,osd_metadata=3} crc {logm=2950488583,mdsmap=2091496210,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2085298247,mon_config_key=914247793,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=59,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,osd_metadata=4} crc {logm=1924913341,mdsmap=1401145748,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2085298247,mon_config_key=1003196044,monmap=828017138,osd_metadata=3360692524}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=1862263324,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=694892327,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.451 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=58,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,osd_metadata=6} crc {logm=3424572676,mdsmap=3140514009,mgr=119571008,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2085298247,mon_config_key=3303550185,monmap=828017138,osd_metadata=857068958}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=60,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=9,monmap=3,osd_metadata=4} crc {logm=2646202411,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=1825629902,mon_config_key=882409540,monmap=828017138,osd_metadata=1472095946}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=59,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=11,monmap=3,osd_metadata=3} crc {logm=274320184,mdsmap=2840952586,mgr=1156056737,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=669495997,mon_config_key=809949667,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.330+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=60,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=10,monmap=3,osd_metadata=3} crc {logm=2967734051,mdsmap=2840952586,mgr=3261276571,mgr_command_descs=3057339438,mgr_metadata=177654402,mgrstat=2085298247,mon_config_key=2901941722,monmap=828017138,osd_metadata=4228544399}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=57} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=3776841153}) 2024-04-26T00:15:47.452 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=59} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=2160519650}) 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_metadata=2,osd_pg_creating=1,osdmap=58} crc {osd_metadata=1521144874,osd_pg_creating=3530713735,osdmap=2590546722}) 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=59} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=2760957821}) 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.453 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=58} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1116304967}) 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=57} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=892146148}) 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=57} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=2361893333}) 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=55} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=1463995081}) 2024-04-26T00:15:47.454 INFO:tasks.ceph.mon.a.smithi106.stderr:2024-04-26T00:15:47.346+0000 7ffa2ee32640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osd_metadata=3,osd_pg_creating=1,osdmap=58} crc {osd_metadata=1671697579,osd_pg_creating=3530713735,osdmap=3838476110}) 2024-04-26T00:15:47.967 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-04-26T00:15:47.968 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient: get_monmap_and_config 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient: build_initial_monmap 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient: monmap: 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:48.107550+0000 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:48.107550+0000 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:48.078 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:48.079 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 1 Processor -- start 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 1 -- start start 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient: init 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient: _add_conns ranks=[2,0,4,8,7,5,6,3,1] 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient(hunting): picked mon.noname-b con 0x7f02d4134820 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient(hunting): picked mon.noname-a con 0x7f02d40725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:48.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient(hunting): picked mon.noname-c con 0x7f02d413ace0 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d4071270 con 0x7f02d40725d0 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d40714e0 con 0x7f02d4134820 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d40729f0 con 0x7f02d413ace0 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dc5c9640 10 monclient(hunting): authenticate will time out at 2203.635185s 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dab66640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f02d413ace0 0x7f02d413d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53750/0 (socket says 172.21.15.106:53750) 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02da365640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f02d4134820 0x7f02d4134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48168/0 (socket says 172.21.15.106:48168) 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9b64640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f02d40725d0 0x7f02d41395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40744/0 (socket says 172.21.15.106:40744) 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02dab66640 1 -- 172.21.15.106:0/62591893 learned_addr learned my addr 172.21.15.106:0/62591893 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1121681845 0 0) 0x7f02d0001120 con 0x7f02d4134820 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.087 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): my global_id is 294185 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02c0003530 con 0x7f02d4134820 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3195907782 0 0) 0x7f02d4071270 con 0x7f02d40725d0 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): my global_id is 274671 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d0001120 con 0x7f02d40725d0 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701803632 0 0) 0x7f02d40729f0 con 0x7f02d413ace0 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 10 monclient(hunting): my global_id is 274783 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d4071270 con 0x7f02d413ace0 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2006990645 0 0) 0x7f02c0003530 con 0x7f02d4134820 2024-04-26T00:15:48.088 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 >> v1:172.21.15.106:6791/0 conn(0x7f02d413ace0 legacy=0x7f02d413d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.102+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 >> v1:172.21.15.106:6789/0 conn(0x7f02d40725d0 legacy=0x7f02d41395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: _finish_hunting 0 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 1 monclient: found mon.noname-b 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d40717c0 con 0x7f02d4134820 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: _finish_auth 0 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: _check_auth_tickets 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02d0001990 con 0x7f02d4134820 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: dump: 2024-04-26T00:15:48.089 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.090 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 5 monclient: authenticate success, global_id 294185 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02d0001c30 con 0x7f02d4134820 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 1 -- 172.21.15.106:0/62591893 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02d0004b30 con 0x7f02d4134820 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9363640 10 monclient: dump: 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.091 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 4 set_mon_vals no callback set 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient: shutdown 2024-04-26T00:15:48.092 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- 172.21.15.106:0/62591893 >> v1:172.21.15.106:6790/0 conn(0x7f02d4134820 legacy=0x7f02d4134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- 172.21.15.106:0/62591893 shutdown_connections 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- 172.21.15.106:0/62591893 >> 172.21.15.106:0/62591893 conn(0x7f02d40a64e0 msgr2=0x7f02d40a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- 172.21.15.106:0/62591893 shutdown_connections 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- 172.21.15.106:0/62591893 wait complete. 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient: build_initial_monmap 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient: monmap: 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.093 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 Processor -- start 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- start start 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient: init 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:48.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient: _add_conns ranks=[1,7,3,4,2,8,5,0,6] 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient(hunting): picked mon.noname-f con 0x7f02d40725d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient(hunting): picked mon.noname-i con 0x7f02d4134820 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient(hunting): picked mon.noname-g con 0x7f02d413ace0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d41278e0 con 0x7f02d40725d0 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d4072c60 con 0x7f02d413ace0 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f02d40706a0 con 0x7f02d4134820 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dc5c9640 10 monclient(hunting): authenticate will time out at 2203.638435s 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02da365640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f02d40725d0 0x7f02d41ca980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:34030/0 (socket says 172.21.15.106:34030) 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02dab66640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f02d413ace0 0x7f02d41d3060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:53730/0 (socket says 172.21.15.106:53730) 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02da365640 1 -- 172.21.15.106:0/3133751526 learned_addr learned my addr 172.21.15.106:0/3133751526 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02d9b64640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f02d4134820 0x7f02d41cf930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:59026/0 (socket says 172.21.15.106:59026) 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229041952 0 0) 0x7f02d4072c60 con 0x7f02d413ace0 2024-04-26T00:15:48.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): my global_id is 294204 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02b8003530 con 0x7f02d413ace0 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680346882 0 0) 0x7f02d41278e0 con 0x7f02d40725d0 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): my global_id is 294193 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d4072c60 con 0x7f02d40725d0 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1130214359 0 0) 0x7f02d40706a0 con 0x7f02d4134820 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): my global_id is 147112 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f02d41278e0 con 0x7f02d4134820 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4145296971 0 0) 0x7f02d4072c60 con 0x7f02d40725d0 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02d40706a0 con 0x7f02d40725d0 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3907125159 0 0) 0x7f02b8003530 con 0x7f02d413ace0 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02d4072c60 con 0x7f02d413ace0 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02d0001610 con 0x7f02d40725d0 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): dump: 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.097 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.098 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02cc001b30 con 0x7f02d413ace0 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): dump: 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.099 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2386015423 0 0) 0x7f02d41278e0 con 0x7f02d4134820 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f02b8003530 con 0x7f02d4134820 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02c4001520 con 0x7f02d4134820 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.106+0000 7f02caffd640 10 monclient(hunting): dump: 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.100 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.101 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3299853157 0 0) 0x7f02d40706a0 con 0x7f02d40725d0 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 >> v1:172.21.15.171:6792/0 conn(0x7f02d4134820 legacy=0x7f02d41cf930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 >> v1:172.21.15.171:6790/0 conn(0x7f02d413ace0 legacy=0x7f02d41d3060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: _finish_hunting 0 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 monclient: found mon.f 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02d4129450 con 0x7f02d40725d0 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: _finish_auth 0 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: _check_auth_tickets 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 5 monclient: authenticate success, global_id 294193 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 10 monclient: _renew_subs 2024-04-26T00:15:48.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f02d4129730 con 0x7f02d40725d0 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 10 monclient: _renew_subs 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f02d4129b50 con 0x7f02d40725d0 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f02d00019c0 con 0x7f02d40725d0 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f02d0001c30 con 0x7f02d40725d0 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02d8b62640 4 set_mon_vals no callback set 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 10 monclient: dump: 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.103 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:15:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02bc005090 con 0x7f02d40725d0 2024-04-26T00:15:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f02d000ffe0 con 0x7f02d40725d0 2024-04-26T00:15:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f02d00451b0 con 0x7f02d40725d0 2024-04-26T00:15:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.110+0000 7f02d9b64640 10 monclient: get_auth_request con 0x7f02b8038300 auth_method 0 2024-04-26T00:15:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.118+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f02d40714e0 con 0x7f02d40725d0 2024-04-26T00:15:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.118+0000 7f02caffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.118+0000 7f02caffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:48.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02dc5c9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-04-26T00:15:48.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02dc5c9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-04-26T00:15:48.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02dc5c9640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.171:6789/0 2024-04-26T00:15:48.313 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 --> v1:172.21.15.171:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f02bc005380 con 0x7f02d40725d0 2024-04-26T00:15:48.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02caffd640 1 -- 172.21.15.106:0/3133751526 <== mon.1 v1:172.21.15.171:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2745 (unknown 254746657 0 883704624) 0x7f02d0015840 con 0x7f02d40725d0 2024-04-26T00:15:48.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02caffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-04-26T00:15:48.314 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02caffd640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:48.315 INFO:teuthology.orchestra.run.smithi106.stdout:{"election_epoch":132,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540701547738038271","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","modified":"2024-04-25T23:54:15.226551Z","created":"2024-04-25T23:54:15.226551Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6789","nonce":0}]},"addr":"172.21.15.106:6789/0","public_addr":"172.21.15.106:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6789","nonce":0}]},"addr":"172.21.15.171:6789/0","public_addr":"172.21.15.171:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6790","nonce":0}]},"addr":"172.21.15.106:6790/0","public_addr":"172.21.15.106:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6790","nonce":0}]},"addr":"172.21.15.171:6790/0","public_addr":"172.21.15.171:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6791","nonce":0}]},"addr":"172.21.15.106:6791/0","public_addr":"172.21.15.106:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6791","nonce":0}]},"addr":"172.21.15.171:6791/0","public_addr":"172.21.15.171:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6792","nonce":0}]},"addr":"172.21.15.106:6792/0","public_addr":"172.21.15.106:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6792","nonce":0}]},"addr":"172.21.15.171:6792/0","public_addr":"172.21.15.171:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6793","nonce":0}]},"addr":"172.21.15.106:6793/0","public_addr":"172.21.15.106:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.338+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 >> v1:172.21.15.171:6812/722422047 conn(0x7f02b8038300 legacy=0x7f02b803a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.342+0000 7f02dc5c9640 10 monclient: shutdown 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.342+0000 7f02dc5c9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.342+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 >> v1:172.21.15.171:6789/0 conn(0x7f02d40725d0 legacy=0x7f02d41ca980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.342+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 shutdown_connections 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.342+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 >> 172.21.15.106:0/3133751526 conn(0x7f02d40a64e0 msgr2=0x7f02d4124360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.342+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 shutdown_connections 2024-04-26T00:15:48.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.342+0000 7f02dc5c9640 1 -- 172.21.15.106:0/3133751526 wait complete. 2024-04-26T00:15:48.332 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-04-26T00:15:48.333 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-26T00:15:48.341 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-26T00:15:48.342 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient: get_monmap_and_config 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient: build_initial_monmap 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient: monmap: 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:48.492774+0000 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:48.492774+0000 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:48.463 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:48.464 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 1 Processor -- start 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 1 -- start start 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient: init 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient: _add_conns ranks=[7,0,1,8,4,5,6,3,2] 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient(hunting): picked mon.noname-i con 0x7f5274137730 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient(hunting): picked mon.noname-a con 0x7f52740a0b20 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient(hunting): picked mon.noname-f con 0x7f5274138220 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52740a2750 con 0x7f52740a0b20 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52740a2a30 con 0x7f5274138220 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52740a2d10 con 0x7f5274137730 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.486+0000 7f527bb09640 10 monclient(hunting): authenticate will time out at 2204.019910s 2024-04-26T00:15:48.471 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52790a4640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f52740a0b20 0x7f527413ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40758/0 (socket says 172.21.15.106:40758) 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52790a4640 1 -- 172.21.15.106:0/2008193785 learned_addr learned my addr 172.21.15.106:0/2008193785 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2437667977 0 0) 0x7f52740a2750 con 0x7f52740a0b20 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient(hunting): my global_id is 274680 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5260003530 con 0x7f52740a0b20 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3791562712 0 0) 0x7f5260003530 con 0x7f52740a0b20 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 >> v1:172.21.15.171:6792/0 conn(0x7f5274137730 legacy=0x7f5274137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 >> v1:172.21.15.171:6789/0 conn(0x7f5274138220 legacy=0x7f5274140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: _finish_hunting 0 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 monclient: found mon.noname-a 2024-04-26T00:15:48.472 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52740a4680 con 0x7f52740a0b20 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: _finish_auth 0 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: _check_auth_tickets 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f52640017c0 con 0x7f52740a0b20 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 5 monclient: authenticate success, global_id 274680 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: dump: 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.473 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.474 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5264001ab0 con 0x7f52740a0b20 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 1 -- 172.21.15.106:0/2008193785 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5264004bf0 con 0x7f52740a0b20 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52788a3640 10 monclient: dump: 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.475 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 4 set_mon_vals no callback set 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient: shutdown 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- 172.21.15.106:0/2008193785 >> v1:172.21.15.106:6789/0 conn(0x7f52740a0b20 legacy=0x7f527413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- 172.21.15.106:0/2008193785 shutdown_connections 2024-04-26T00:15:48.476 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- 172.21.15.106:0/2008193785 >> 172.21.15.106:0/2008193785 conn(0x7f52740a6b80 msgr2=0x7f52740a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- 172.21.15.106:0/2008193785 shutdown_connections 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- 172.21.15.106:0/2008193785 wait complete. 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient: build_initial_monmap 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient: monmap: 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:48.477 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 Processor -- start 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- start start 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient: init 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient: _add_conns ranks=[1,4,0,3,7,2,5,8,6] 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient(hunting): picked mon.noname-f con 0x7f52740a0b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient(hunting): picked mon.noname-c con 0x7f5274137730 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:48.478 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient(hunting): picked mon.noname-a con 0x7f5274138220 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52741325c0 con 0x7f5274138220 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52740a19d0 con 0x7f52740a0b20 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5274131560 con 0x7f5274137730 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f527bb09640 10 monclient(hunting): authenticate will time out at 2204.023090s 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52790a4640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f5274137730 0x7f5274130030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53766/0 (socket says 172.21.15.106:53766) 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f52790a4640 1 -- 172.21.15.106:0/835231692 learned_addr learned my addr 172.21.15.106:0/835231692 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 859706810 0 0) 0x7f5274131560 con 0x7f5274137730 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): my global_id is 274792 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5258003530 con 0x7f5274137730 2024-04-26T00:15:48.479 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659144706 0 0) 0x7f52741325c0 con 0x7f5274138220 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): my global_id is 274689 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5274131560 con 0x7f5274138220 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3543507415 0 0) 0x7f5274131560 con 0x7f5274138220 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f52741325c0 con 0x7f5274138220 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5270001870 con 0x7f5274138220 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): dump: 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.480 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:48.481 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3307591413 0 0) 0x7f5258003530 con 0x7f5274137730 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5274131560 con 0x7f5274137730 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5264001780 con 0x7f5274137730 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): dump: 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.482 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739720147 0 0) 0x7f52740a19d0 con 0x7f52740a0b20 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient(hunting): my global_id is 294211 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5258003530 con 0x7f52740a0b20 2024-04-26T00:15:48.483 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1724103627 0 0) 0x7f52741325c0 con 0x7f5274138220 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 >> v1:172.21.15.106:6791/0 conn(0x7f5274137730 legacy=0x7f5274130030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 >> v1:172.21.15.171:6789/0 conn(0x7f52740a0b20 legacy=0x7f527412f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 monclient: found mon.a 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.490+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5274136380 con 0x7f5274138220 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 5 monclient: authenticate success, global_id 274689 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 10 monclient: _renew_subs 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:48.484 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5274131af0 con 0x7f5274138220 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 10 monclient: _renew_subs 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f5274130740 con 0x7f5274138220 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f52700036a0 con 0x7f5274138220 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5270003c10 con 0x7f5274138220 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526bfff640 4 set_mon_vals no callback set 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 10 monclient: dump: 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.485 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.486 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5270003e30 con 0x7f5274138220 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c005090 con 0x7f5274138220 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5270043e80 con 0x7f5274138220 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.494+0000 7f52798a5640 10 monclient: get_auth_request con 0x7f5258037f00 auth_method 0 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.498+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f5270014520 con 0x7f5274138220 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.498+0000 7f526a7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.487 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.498+0000 7f526a7fc640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:48.630 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.654+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f525c000ba0 con 0x7f5258037f00 2024-04-26T00:15:48.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f526a7fc640 1 -- 172.21.15.106:0/835231692 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+78088 (unknown 2965378022 0 461709312) 0x7f525c000ba0 con 0x7f5258037f00 2024-04-26T00:15:48.637 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T00:15:48.637 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T00:15:48.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 >> v1:172.21.15.171:6812/722422047 conn(0x7f5258037f00 legacy=0x7f525803a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 10 monclient: shutdown 2024-04-26T00:15:48.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:48.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 >> v1:172.21.15.106:6789/0 conn(0x7f5274138220 legacy=0x7f52741d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 shutdown_connections 2024-04-26T00:15:48.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 >> 172.21.15.106:0/835231692 conn(0x7f52740a6b80 msgr2=0x7f527412e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:48.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 shutdown_connections 2024-04-26T00:15:48.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.662+0000 7f527bb09640 1 -- 172.21.15.106:0/835231692 wait complete. 2024-04-26T00:15:48.654 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":877,"stamp":"2024-04-26T00:15:47.961818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":191328,"kb_used_data":7328,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566039712,"statfs":{"total":579820584960,"available":579624665088,"internally_reserved":0,"allocated":7503872,"data_stored":7980170,"data_compressed":1408224,"data_compressed_allocated":2154496,"data_compressed_original":4787688,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003666"},"pg_stats":[{"pgid":"10.4","version":"0'0","reported_seq":306,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798261+0000","last_change":"2024-04-26T00:00:28.738770+0000","last_active":"2024-04-26T00:12:06.798261+0000","last_peered":"2024-04-26T00:12:06.798261+0000","last_clean":"2024-04-26T00:12:06.798261+0000","last_became_active":"2024-04-26T00:00:28.737377+0000","last_became_peered":"2024-04-26T00:00:28.737377+0000","last_unstale":"2024-04-26T00:12:06.798261+0000","last_undegraded":"2024-04-26T00:12:06.798261+0000","last_fullsized":"2024-04-26T00:12:06.798261+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:25:28.008466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698667+0000","last_change":"2024-04-26T00:00:28.717284+0000","last_active":"2024-04-26T00:13:31.698667+0000","last_peered":"2024-04-26T00:13:31.698667+0000","last_clean":"2024-04-26T00:13:31.698667+0000","last_became_active":"2024-04-26T00:00:28.716880+0000","last_became_peered":"2024-04-26T00:00:28.716880+0000","last_unstale":"2024-04-26T00:13:31.698667+0000","last_undegraded":"2024-04-26T00:13:31.698667+0000","last_fullsized":"2024-04-26T00:13:31.698667+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:36.026604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":296,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:11.679238+0000","last_change":"2024-04-26T00:00:28.738509+0000","last_active":"2024-04-26T00:12:11.679238+0000","last_peered":"2024-04-26T00:12:11.679238+0000","last_clean":"2024-04-26T00:12:11.679238+0000","last_became_active":"2024-04-26T00:00:28.737571+0000","last_became_peered":"2024-04-26T00:00:28.737571+0000","last_unstale":"2024-04-26T00:12:11.679238+0000","last_undegraded":"2024-04-26T00:12:11.679238+0000","last_fullsized":"2024-04-26T00:12:11.679238+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:23.623839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698622+0000","last_change":"2024-04-26T00:00:28.725961+0000","last_active":"2024-04-26T00:13:31.698622+0000","last_peered":"2024-04-26T00:13:31.698622+0000","last_clean":"2024-04-26T00:13:31.698622+0000","last_became_active":"2024-04-26T00:00:28.725554+0000","last_became_peered":"2024-04-26T00:00:28.725554+0000","last_unstale":"2024-04-26T00:13:31.698622+0000","last_undegraded":"2024-04-26T00:13:31.698622+0000","last_fullsized":"2024-04-26T00:13:31.698622+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:38.175600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":230,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:36.690931+0000","last_change":"2024-04-26T00:00:29.724808+0000","last_active":"2024-04-26T00:12:36.690931+0000","last_peered":"2024-04-26T00:12:36.690931+0000","last_clean":"2024-04-26T00:12:36.690931+0000","last_became_active":"2024-04-26T00:00:29.723663+0000","last_became_peered":"2024-04-26T00:00:29.723663+0000","last_unstale":"2024-04-26T00:12:36.690931+0000","last_undegraded":"2024-04-26T00:12:36.690931+0000","last_fullsized":"2024-04-26T00:12:36.690931+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:20.010319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":294,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798300+0000","last_change":"2024-04-26T00:00:28.719610+0000","last_active":"2024-04-26T00:12:06.798300+0000","last_peered":"2024-04-26T00:12:06.798300+0000","last_clean":"2024-04-26T00:12:06.798300+0000","last_became_active":"2024-04-26T00:00:28.718609+0000","last_became_peered":"2024-04-26T00:00:28.718609+0000","last_unstale":"2024-04-26T00:12:06.798300+0000","last_undegraded":"2024-04-26T00:12:06.798300+0000","last_fullsized":"2024-04-26T00:12:06.798300+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:22.854004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":184,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808969+0000","last_change":"2024-04-26T00:00:28.732762+0000","last_active":"2024-04-26T00:13:31.808969+0000","last_peered":"2024-04-26T00:13:31.808969+0000","last_clean":"2024-04-26T00:13:31.808969+0000","last_became_active":"2024-04-26T00:00:28.732236+0000","last_became_peered":"2024-04-26T00:00:28.732236+0000","last_unstale":"2024-04-26T00:13:31.808969+0000","last_undegraded":"2024-04-26T00:13:31.808969+0000","last_fullsized":"2024-04-26T00:13:31.808969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:13.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809082+0000","last_change":"2024-04-26T00:00:28.723106+0000","last_active":"2024-04-26T00:13:01.809082+0000","last_peered":"2024-04-26T00:13:01.809082+0000","last_clean":"2024-04-26T00:13:01.809082+0000","last_became_active":"2024-04-26T00:00:28.722170+0000","last_became_peered":"2024-04-26T00:00:28.722170+0000","last_unstale":"2024-04-26T00:13:01.809082+0000","last_undegraded":"2024-04-26T00:13:01.809082+0000","last_fullsized":"2024-04-26T00:13:01.809082+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:48.693605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":213,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:11:56.685302+0000","last_change":"2024-04-26T00:00:28.729400+0000","last_active":"2024-04-26T00:11:56.685302+0000","last_peered":"2024-04-26T00:11:56.685302+0000","last_clean":"2024-04-26T00:11:56.685302+0000","last_became_active":"2024-04-26T00:00:28.728808+0000","last_became_peered":"2024-04-26T00:00:28.728808+0000","last_unstale":"2024-04-26T00:11:56.685302+0000","last_undegraded":"2024-04-26T00:11:56.685302+0000","last_fullsized":"2024-04-26T00:11:56.685302+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:18.593420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":218,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:16.798472+0000","last_change":"2024-04-26T00:00:28.726625+0000","last_active":"2024-04-26T00:12:16.798472+0000","last_peered":"2024-04-26T00:12:16.798472+0000","last_clean":"2024-04-26T00:12:16.798472+0000","last_became_active":"2024-04-26T00:00:28.726130+0000","last_became_peered":"2024-04-26T00:00:28.726130+0000","last_unstale":"2024-04-26T00:12:16.798472+0000","last_undegraded":"2024-04-26T00:12:16.798472+0000","last_fullsized":"2024-04-26T00:12:16.798472+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:57:08.131796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":247,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.682708+0000","last_change":"2024-04-26T00:00:28.731858+0000","last_active":"2024-04-26T00:12:06.682708+0000","last_peered":"2024-04-26T00:12:06.682708+0000","last_clean":"2024-04-26T00:12:06.682708+0000","last_became_active":"2024-04-26T00:00:28.731390+0000","last_became_peered":"2024-04-26T00:00:28.731390+0000","last_unstale":"2024-04-26T00:12:06.682708+0000","last_undegraded":"2024-04-26T00:12:06.682708+0000","last_fullsized":"2024-04-26T00:12:06.682708+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:40.241345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.808988+0000","last_change":"2024-04-26T00:00:28.724198+0000","last_active":"2024-04-26T00:13:01.808988+0000","last_peered":"2024-04-26T00:13:01.808988+0000","last_clean":"2024-04-26T00:13:01.808988+0000","last_became_active":"2024-04-26T00:00:28.723392+0000","last_became_peered":"2024-04-26T00:00:28.723392+0000","last_unstale":"2024-04-26T00:13:01.808988+0000","last_undegraded":"2024-04-26T00:13:01.808988+0000","last_fullsized":"2024-04-26T00:13:01.808988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:18.116692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809021+0000","last_change":"2024-04-26T00:00:28.734188+0000","last_active":"2024-04-26T00:13:01.809021+0000","last_peered":"2024-04-26T00:13:01.809021+0000","last_clean":"2024-04-26T00:13:01.809021+0000","last_became_active":"2024-04-26T00:00:28.732291+0000","last_became_peered":"2024-04-26T00:00:28.732291+0000","last_unstale":"2024-04-26T00:13:01.809021+0000","last_undegraded":"2024-04-26T00:13:01.809021+0000","last_fullsized":"2024-04-26T00:13:01.809021+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:21:55.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":307,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798200+0000","last_change":"2024-04-26T00:00:28.731923+0000","last_active":"2024-04-26T00:12:06.798200+0000","last_peered":"2024-04-26T00:12:06.798200+0000","last_clean":"2024-04-26T00:12:06.798200+0000","last_became_active":"2024-04-26T00:00:28.730684+0000","last_became_peered":"2024-04-26T00:00:28.730684+0000","last_unstale":"2024-04-26T00:12:06.798200+0000","last_undegraded":"2024-04-26T00:12:06.798200+0000","last_fullsized":"2024-04-26T00:12:06.798200+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:38.832871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":191,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.686048+0000","last_change":"2024-04-26T00:00:29.729411+0000","last_active":"2024-04-26T00:13:01.686048+0000","last_peered":"2024-04-26T00:13:01.686048+0000","last_clean":"2024-04-26T00:13:01.686048+0000","last_became_active":"2024-04-26T00:00:29.727993+0000","last_became_peered":"2024-04-26T00:00:29.727993+0000","last_unstale":"2024-04-26T00:13:01.686048+0000","last_undegraded":"2024-04-26T00:13:01.686048+0000","last_fullsized":"2024-04-26T00:13:01.686048+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:34.304761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:31.804931+0000","last_change":"2024-04-26T00:00:28.712427+0000","last_active":"2024-04-26T00:12:31.804931+0000","last_peered":"2024-04-26T00:12:31.804931+0000","last_clean":"2024-04-26T00:12:31.804931+0000","last_became_active":"2024-04-26T00:00:28.711533+0000","last_became_peered":"2024-04-26T00:00:28.711533+0000","last_unstale":"2024-04-26T00:12:31.804931+0000","last_undegraded":"2024-04-26T00:12:31.804931+0000","last_fullsized":"2024-04-26T00:12:31.804931+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:37.400546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":436,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804720+0000","last_change":"2024-04-26T00:00:28.731423+0000","last_active":"2024-04-26T00:13:01.804720+0000","last_peered":"2024-04-26T00:13:01.804720+0000","last_clean":"2024-04-26T00:13:01.804720+0000","last_became_active":"2024-04-26T00:00:28.731119+0000","last_became_peered":"2024-04-26T00:00:28.731119+0000","last_unstale":"2024-04-26T00:13:01.804720+0000","last_undegraded":"2024-04-26T00:13:01.804720+0000","last_fullsized":"2024-04-26T00:13:01.804720+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:37:56.959685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":430,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:01.686029+0000","last_change":"2024-04-26T00:00:29.725274+0000","last_active":"2024-04-26T00:12:01.686029+0000","last_peered":"2024-04-26T00:12:01.686029+0000","last_clean":"2024-04-26T00:12:01.686029+0000","last_became_active":"2024-04-26T00:00:29.724281+0000","last_became_peered":"2024-04-26T00:00:29.724281+0000","last_unstale":"2024-04-26T00:12:01.686029+0000","last_undegraded":"2024-04-26T00:12:01.686029+0000","last_fullsized":"2024-04-26T00:12:01.686029+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:08.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.690581+0000","last_change":"2024-04-26T00:00:28.719506+0000","last_active":"2024-04-26T00:13:01.690581+0000","last_peered":"2024-04-26T00:13:01.690581+0000","last_clean":"2024-04-26T00:13:01.690581+0000","last_became_active":"2024-04-26T00:00:28.719074+0000","last_became_peered":"2024-04-26T00:00:28.719074+0000","last_unstale":"2024-04-26T00:13:01.690581+0000","last_undegraded":"2024-04-26T00:13:01.690581+0000","last_fullsized":"2024-04-26T00:13:01.690581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:58.255889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809041+0000","last_change":"2024-04-26T00:00:28.721183+0000","last_active":"2024-04-26T00:13:01.809041+0000","last_peered":"2024-04-26T00:13:01.809041+0000","last_clean":"2024-04-26T00:13:01.809041+0000","last_became_active":"2024-04-26T00:00:28.717935+0000","last_became_peered":"2024-04-26T00:00:28.717935+0000","last_unstale":"2024-04-26T00:13:01.809041+0000","last_undegraded":"2024-04-26T00:13:01.809041+0000","last_fullsized":"2024-04-26T00:13:01.809041+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:40.158656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"253'161","reported_seq":713,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804682+0000","last_change":"2024-04-26T00:00:31.558943+0000","last_active":"2024-04-26T00:13:01.804682+0000","last_peered":"2024-04-26T00:13:01.804682+0000","last_clean":"2024-04-26T00:13:01.804682+0000","last_became_active":"2024-04-26T00:00:31.558409+0000","last_became_peered":"2024-04-26T00:00:31.558409+0000","last_unstale":"2024-04-26T00:13:01.804682+0000","last_undegraded":"2024-04-26T00:13:01.804682+0000","last_fullsized":"2024-04-26T00:13:01.804682+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:02.624876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809065+0000","last_change":"2024-04-26T00:00:28.723193+0000","last_active":"2024-04-26T00:13:01.809065+0000","last_peered":"2024-04-26T00:13:01.809065+0000","last_clean":"2024-04-26T00:13:01.809065+0000","last_became_active":"2024-04-26T00:00:28.722258+0000","last_became_peered":"2024-04-26T00:00:28.722258+0000","last_unstale":"2024-04-26T00:13:01.809065+0000","last_undegraded":"2024-04-26T00:13:01.809065+0000","last_fullsized":"2024-04-26T00:13:01.809065+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:30.411395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:06.691323+0000","last_change":"2024-04-26T00:00:28.720773+0000","last_active":"2024-04-26T00:13:06.691323+0000","last_peered":"2024-04-26T00:13:06.691323+0000","last_clean":"2024-04-26T00:13:06.691323+0000","last_became_active":"2024-04-26T00:00:28.720392+0000","last_became_peered":"2024-04-26T00:00:28.720392+0000","last_unstale":"2024-04-26T00:13:06.691323+0000","last_undegraded":"2024-04-26T00:13:06.691323+0000","last_fullsized":"2024-04-26T00:13:06.691323+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:35:47.483585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":183,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808936+0000","last_change":"2024-04-26T00:00:28.731510+0000","last_active":"2024-04-26T00:13:31.808936+0000","last_peered":"2024-04-26T00:13:31.808936+0000","last_clean":"2024-04-26T00:13:31.808936+0000","last_became_active":"2024-04-26T00:00:28.731039+0000","last_became_peered":"2024-04-26T00:00:28.731039+0000","last_unstale":"2024-04-26T00:13:31.808936+0000","last_undegraded":"2024-04-26T00:13:31.808936+0000","last_fullsized":"2024-04-26T00:13:31.808936+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:14.612054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":440,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:31.690193+0000","last_change":"2024-04-26T00:00:28.726321+0000","last_active":"2024-04-26T00:12:31.690193+0000","last_peered":"2024-04-26T00:12:31.690193+0000","last_clean":"2024-04-26T00:12:31.690193+0000","last_became_active":"2024-04-26T00:00:28.725623+0000","last_became_peered":"2024-04-26T00:00:28.725623+0000","last_unstale":"2024-04-26T00:12:31.690193+0000","last_undegraded":"2024-04-26T00:12:31.690193+0000","last_fullsized":"2024-04-26T00:12:31.690193+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:33:54.174589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":6},{"poolid":9,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1586784,"data_compressed":24239,"data_compressed_allocated":98304,"data_compressed_original":1551848,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640510,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640509,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640509,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239126,"data_compressed_allocated":380928,"data_compressed_original":1138688,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640508,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28404,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343436,"statfs":{"total":96636764160,"available":96607678464,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640509,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239646,"data_compressed_allocated":380928,"data_compressed_original":1142248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640509,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":10193,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":7283,"data_compressed_allocated":32768,"data_compressed_original":515560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6763,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:15:48.655 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.802+0000 7fe487247640 10 monclient: get_monmap_and_config 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.802+0000 7fe487247640 10 monclient: build_initial_monmap 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.802+0000 7fe487247640 10 monclient: monmap: 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:48.809227+0000 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:48.809227+0000 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:48.780 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.802+0000 7fe487247640 1 Processor -- start 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.802+0000 7fe487247640 1 -- start start 2024-04-26T00:15:48.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.802+0000 7fe487247640 10 monclient: init 2024-04-26T00:15:48.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient: _add_conns ranks=[5,1,7,4,3,8,2,6,0] 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient(hunting): picked mon.noname-h con 0x7fe480134820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient(hunting): picked mon.noname-f con 0x7fe4800725d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient(hunting): picked mon.noname-i con 0x7fe48013ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe480071270 con 0x7fe4800725d0 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4800714e0 con 0x7fe480134820 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4800729f0 con 0x7fe48013ace0 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient(hunting): authenticate will time out at 2204.336323s 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4857e4640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fe48013ace0 0x7fe48013d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:59048/0 (socket says 172.21.15.106:59048) 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4857e4640 1 -- 172.21.15.106:0/398944514 learned_addr learned my addr 172.21.15.106:0/398944514 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:48.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe477fff640 1 --1- 172.21.15.106:0/398944514 >> v1:172.21.15.171:6789/0 conn(0x7fe4800725d0 0x7fe4801395c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:34054/0 (socket says 172.21.15.106:34054) 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3922085734 0 0) 0x7fe480071270 con 0x7fe4800725d0 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): my global_id is 294220 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe468003530 con 0x7fe4800725d0 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2683734940 0 0) 0x7fe4800729f0 con 0x7fe48013ace0 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): my global_id is 147130 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe480071270 con 0x7fe48013ace0 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3458578511 0 0) 0x7fe47c001120 con 0x7fe480134820 2024-04-26T00:15:48.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient(hunting): my global_id is 254858 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4800729f0 con 0x7fe480134820 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1101962781 0 0) 0x7fe468003530 con 0x7fe4800725d0 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 >> v1:172.21.15.171:6792/0 conn(0x7fe48013ace0 legacy=0x7fe48013d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 >> v1:172.21.15.171:6791/0 conn(0x7fe480134820 legacy=0x7fe480134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 monclient: found mon.noname-f 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4800717c0 con 0x7fe4800725d0 2024-04-26T00:15:48.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe4700017c0 con 0x7fe4800725d0 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: dump: 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.791 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 5 monclient: authenticate success, global_id 294220 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe470001ae0 con 0x7fe4800725d0 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 4 set_mon_vals no callback set 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 1 -- 172.21.15.106:0/398944514 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe470004b30 con 0x7fe4800725d0 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:15:48.792 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe4777fe640 10 monclient: dump: 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.793 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient: shutdown 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- 172.21.15.106:0/398944514 >> v1:172.21.15.171:6789/0 conn(0x7fe4800725d0 legacy=0x7fe4801395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- 172.21.15.106:0/398944514 shutdown_connections 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- 172.21.15.106:0/398944514 >> 172.21.15.106:0/398944514 conn(0x7fe4800a64e0 msgr2=0x7fe4800a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- 172.21.15.106:0/398944514 shutdown_connections 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- 172.21.15.106:0/398944514 wait complete. 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient: build_initial_monmap 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient: monmap: 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:48.794 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 Processor -- start 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 1 -- start start 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.806+0000 7fe487247640 10 monclient: init 2024-04-26T00:15:48.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _add_conns ranks=[0,3,2,5,7,6,1,8,4] 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient(hunting): picked mon.noname-a con 0x7fe4800725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient(hunting): picked mon.noname-g con 0x7fe480134820 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient(hunting): picked mon.noname-b con 0x7fe48013ace0 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe480133dc0 con 0x7fe4800725d0 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe480132f50 con 0x7fe48013ace0 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe48009d500 con 0x7fe480134820 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient(hunting): authenticate will time out at 2204.340308s 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4857e4640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7fe48013ace0 0x7fe4801d0300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48184/0 (socket says 172.21.15.106:48184) 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4857e4640 1 -- 172.21.15.106:0/3232562075 learned_addr learned my addr 172.21.15.106:0/3232562075 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3460162843 0 0) 0x7fe480132f50 con 0x7fe48013ace0 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): my global_id is 294194 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe46c003530 con 0x7fe48013ace0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443930418 0 0) 0x7fe480133dc0 con 0x7fe4800725d0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): my global_id is 274698 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe480132f50 con 0x7fe4800725d0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3423802181 0 0) 0x7fe46c003530 con 0x7fe48013ace0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe480133dc0 con 0x7fe48013ace0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 617822167 0 0) 0x7fe480132f50 con 0x7fe4800725d0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe46c003530 con 0x7fe4800725d0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe478001d80 con 0x7fe48013ace0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): dump: 2024-04-26T00:15:48.797 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.798 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe47c001bb0 con 0x7fe4800725d0 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): dump: 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.799 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3064638135 0 0) 0x7fe48009d500 con 0x7fe480134820 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient(hunting): my global_id is 294213 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe480132f50 con 0x7fe480134820 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1612975083 0 0) 0x7fe480133dc0 con 0x7fe48013ace0 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 >> v1:172.21.15.171:6790/0 conn(0x7fe480134820 legacy=0x7fe480132840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 >> v1:172.21.15.106:6789/0 conn(0x7fe4800725d0 legacy=0x7fe480132130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: _finish_hunting 0 2024-04-26T00:15:48.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 monclient: found mon.b 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe48009cc60 con 0x7fe48013ace0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: _finish_auth 0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: _check_auth_tickets 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 5 monclient: authenticate success, global_id 294194 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _renew_subs 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe48009bd70 con 0x7fe48013ace0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _renew_subs 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fe4801d1a20 con 0x7fe48013ace0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe478004e20 con 0x7fe48013ace0 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:48.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fe478001f20 con 0x7fe48013ace0 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe476ffd640 4 set_mon_vals no callback set 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 10 monclient: dump: 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:48.802 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fe47800ff10 con 0x7fe48013ace0 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fe478045450 con 0x7fe48013ace0 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe460005090 con 0x7fe48013ace0 2024-04-26T00:15:48.803 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.810+0000 7fe484fe3640 10 monclient: get_auth_request con 0x7fe46c037d60 auth_method 0 2024-04-26T00:15:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.814+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7fe4780159c0 con 0x7fe48013ace0 2024-04-26T00:15:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.814+0000 7fe4757fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:48.804 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.814+0000 7fe4757fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:48.953 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.978+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe460000ba0 con 0x7fe46c037d60 2024-04-26T00:15:48.959 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe4757fa640 1 -- 172.21.15.106:0/3232562075 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+78088 (unknown 2965378022 0 461709312) 0x7fe460000ba0 con 0x7fe46c037d60 2024-04-26T00:15:48.960 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T00:15:48.960 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T00:15:48.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 >> v1:172.21.15.171:6812/722422047 conn(0x7fe46c037d60 legacy=0x7fe46c03a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 10 monclient: shutdown 2024-04-26T00:15:48.961 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:48.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 >> v1:172.21.15.106:6790/0 conn(0x7fe48013ace0 legacy=0x7fe4801d0300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:48.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 shutdown_connections 2024-04-26T00:15:48.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 >> 172.21.15.106:0/3232562075 conn(0x7fe4800a64e0 msgr2=0x7fe4800a4780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:48.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 shutdown_connections 2024-04-26T00:15:48.962 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:48.986+0000 7fe487247640 1 -- 172.21.15.106:0/3232562075 wait complete. 2024-04-26T00:15:48.977 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":877,"stamp":"2024-04-26T00:15:47.961818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":191328,"kb_used_data":7328,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566039712,"statfs":{"total":579820584960,"available":579624665088,"internally_reserved":0,"allocated":7503872,"data_stored":7980170,"data_compressed":1408224,"data_compressed_allocated":2154496,"data_compressed_original":4787688,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003666"},"pg_stats":[{"pgid":"10.4","version":"0'0","reported_seq":306,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798261+0000","last_change":"2024-04-26T00:00:28.738770+0000","last_active":"2024-04-26T00:12:06.798261+0000","last_peered":"2024-04-26T00:12:06.798261+0000","last_clean":"2024-04-26T00:12:06.798261+0000","last_became_active":"2024-04-26T00:00:28.737377+0000","last_became_peered":"2024-04-26T00:00:28.737377+0000","last_unstale":"2024-04-26T00:12:06.798261+0000","last_undegraded":"2024-04-26T00:12:06.798261+0000","last_fullsized":"2024-04-26T00:12:06.798261+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:25:28.008466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698667+0000","last_change":"2024-04-26T00:00:28.717284+0000","last_active":"2024-04-26T00:13:31.698667+0000","last_peered":"2024-04-26T00:13:31.698667+0000","last_clean":"2024-04-26T00:13:31.698667+0000","last_became_active":"2024-04-26T00:00:28.716880+0000","last_became_peered":"2024-04-26T00:00:28.716880+0000","last_unstale":"2024-04-26T00:13:31.698667+0000","last_undegraded":"2024-04-26T00:13:31.698667+0000","last_fullsized":"2024-04-26T00:13:31.698667+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:36.026604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":296,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:11.679238+0000","last_change":"2024-04-26T00:00:28.738509+0000","last_active":"2024-04-26T00:12:11.679238+0000","last_peered":"2024-04-26T00:12:11.679238+0000","last_clean":"2024-04-26T00:12:11.679238+0000","last_became_active":"2024-04-26T00:00:28.737571+0000","last_became_peered":"2024-04-26T00:00:28.737571+0000","last_unstale":"2024-04-26T00:12:11.679238+0000","last_undegraded":"2024-04-26T00:12:11.679238+0000","last_fullsized":"2024-04-26T00:12:11.679238+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:23.623839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698622+0000","last_change":"2024-04-26T00:00:28.725961+0000","last_active":"2024-04-26T00:13:31.698622+0000","last_peered":"2024-04-26T00:13:31.698622+0000","last_clean":"2024-04-26T00:13:31.698622+0000","last_became_active":"2024-04-26T00:00:28.725554+0000","last_became_peered":"2024-04-26T00:00:28.725554+0000","last_unstale":"2024-04-26T00:13:31.698622+0000","last_undegraded":"2024-04-26T00:13:31.698622+0000","last_fullsized":"2024-04-26T00:13:31.698622+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:38.175600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":230,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:36.690931+0000","last_change":"2024-04-26T00:00:29.724808+0000","last_active":"2024-04-26T00:12:36.690931+0000","last_peered":"2024-04-26T00:12:36.690931+0000","last_clean":"2024-04-26T00:12:36.690931+0000","last_became_active":"2024-04-26T00:00:29.723663+0000","last_became_peered":"2024-04-26T00:00:29.723663+0000","last_unstale":"2024-04-26T00:12:36.690931+0000","last_undegraded":"2024-04-26T00:12:36.690931+0000","last_fullsized":"2024-04-26T00:12:36.690931+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:20.010319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":294,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798300+0000","last_change":"2024-04-26T00:00:28.719610+0000","last_active":"2024-04-26T00:12:06.798300+0000","last_peered":"2024-04-26T00:12:06.798300+0000","last_clean":"2024-04-26T00:12:06.798300+0000","last_became_active":"2024-04-26T00:00:28.718609+0000","last_became_peered":"2024-04-26T00:00:28.718609+0000","last_unstale":"2024-04-26T00:12:06.798300+0000","last_undegraded":"2024-04-26T00:12:06.798300+0000","last_fullsized":"2024-04-26T00:12:06.798300+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:22.854004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":184,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808969+0000","last_change":"2024-04-26T00:00:28.732762+0000","last_active":"2024-04-26T00:13:31.808969+0000","last_peered":"2024-04-26T00:13:31.808969+0000","last_clean":"2024-04-26T00:13:31.808969+0000","last_became_active":"2024-04-26T00:00:28.732236+0000","last_became_peered":"2024-04-26T00:00:28.732236+0000","last_unstale":"2024-04-26T00:13:31.808969+0000","last_undegraded":"2024-04-26T00:13:31.808969+0000","last_fullsized":"2024-04-26T00:13:31.808969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:13.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809082+0000","last_change":"2024-04-26T00:00:28.723106+0000","last_active":"2024-04-26T00:13:01.809082+0000","last_peered":"2024-04-26T00:13:01.809082+0000","last_clean":"2024-04-26T00:13:01.809082+0000","last_became_active":"2024-04-26T00:00:28.722170+0000","last_became_peered":"2024-04-26T00:00:28.722170+0000","last_unstale":"2024-04-26T00:13:01.809082+0000","last_undegraded":"2024-04-26T00:13:01.809082+0000","last_fullsized":"2024-04-26T00:13:01.809082+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:48.693605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":213,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:11:56.685302+0000","last_change":"2024-04-26T00:00:28.729400+0000","last_active":"2024-04-26T00:11:56.685302+0000","last_peered":"2024-04-26T00:11:56.685302+0000","last_clean":"2024-04-26T00:11:56.685302+0000","last_became_active":"2024-04-26T00:00:28.728808+0000","last_became_peered":"2024-04-26T00:00:28.728808+0000","last_unstale":"2024-04-26T00:11:56.685302+0000","last_undegraded":"2024-04-26T00:11:56.685302+0000","last_fullsized":"2024-04-26T00:11:56.685302+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:18.593420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":218,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:16.798472+0000","last_change":"2024-04-26T00:00:28.726625+0000","last_active":"2024-04-26T00:12:16.798472+0000","last_peered":"2024-04-26T00:12:16.798472+0000","last_clean":"2024-04-26T00:12:16.798472+0000","last_became_active":"2024-04-26T00:00:28.726130+0000","last_became_peered":"2024-04-26T00:00:28.726130+0000","last_unstale":"2024-04-26T00:12:16.798472+0000","last_undegraded":"2024-04-26T00:12:16.798472+0000","last_fullsized":"2024-04-26T00:12:16.798472+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:57:08.131796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":247,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.682708+0000","last_change":"2024-04-26T00:00:28.731858+0000","last_active":"2024-04-26T00:12:06.682708+0000","last_peered":"2024-04-26T00:12:06.682708+0000","last_clean":"2024-04-26T00:12:06.682708+0000","last_became_active":"2024-04-26T00:00:28.731390+0000","last_became_peered":"2024-04-26T00:00:28.731390+0000","last_unstale":"2024-04-26T00:12:06.682708+0000","last_undegraded":"2024-04-26T00:12:06.682708+0000","last_fullsized":"2024-04-26T00:12:06.682708+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:40.241345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.808988+0000","last_change":"2024-04-26T00:00:28.724198+0000","last_active":"2024-04-26T00:13:01.808988+0000","last_peered":"2024-04-26T00:13:01.808988+0000","last_clean":"2024-04-26T00:13:01.808988+0000","last_became_active":"2024-04-26T00:00:28.723392+0000","last_became_peered":"2024-04-26T00:00:28.723392+0000","last_unstale":"2024-04-26T00:13:01.808988+0000","last_undegraded":"2024-04-26T00:13:01.808988+0000","last_fullsized":"2024-04-26T00:13:01.808988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:18.116692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809021+0000","last_change":"2024-04-26T00:00:28.734188+0000","last_active":"2024-04-26T00:13:01.809021+0000","last_peered":"2024-04-26T00:13:01.809021+0000","last_clean":"2024-04-26T00:13:01.809021+0000","last_became_active":"2024-04-26T00:00:28.732291+0000","last_became_peered":"2024-04-26T00:00:28.732291+0000","last_unstale":"2024-04-26T00:13:01.809021+0000","last_undegraded":"2024-04-26T00:13:01.809021+0000","last_fullsized":"2024-04-26T00:13:01.809021+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:21:55.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":307,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798200+0000","last_change":"2024-04-26T00:00:28.731923+0000","last_active":"2024-04-26T00:12:06.798200+0000","last_peered":"2024-04-26T00:12:06.798200+0000","last_clean":"2024-04-26T00:12:06.798200+0000","last_became_active":"2024-04-26T00:00:28.730684+0000","last_became_peered":"2024-04-26T00:00:28.730684+0000","last_unstale":"2024-04-26T00:12:06.798200+0000","last_undegraded":"2024-04-26T00:12:06.798200+0000","last_fullsized":"2024-04-26T00:12:06.798200+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:38.832871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":191,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.686048+0000","last_change":"2024-04-26T00:00:29.729411+0000","last_active":"2024-04-26T00:13:01.686048+0000","last_peered":"2024-04-26T00:13:01.686048+0000","last_clean":"2024-04-26T00:13:01.686048+0000","last_became_active":"2024-04-26T00:00:29.727993+0000","last_became_peered":"2024-04-26T00:00:29.727993+0000","last_unstale":"2024-04-26T00:13:01.686048+0000","last_undegraded":"2024-04-26T00:13:01.686048+0000","last_fullsized":"2024-04-26T00:13:01.686048+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:34.304761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:31.804931+0000","last_change":"2024-04-26T00:00:28.712427+0000","last_active":"2024-04-26T00:12:31.804931+0000","last_peered":"2024-04-26T00:12:31.804931+0000","last_clean":"2024-04-26T00:12:31.804931+0000","last_became_active":"2024-04-26T00:00:28.711533+0000","last_became_peered":"2024-04-26T00:00:28.711533+0000","last_unstale":"2024-04-26T00:12:31.804931+0000","last_undegraded":"2024-04-26T00:12:31.804931+0000","last_fullsized":"2024-04-26T00:12:31.804931+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:37.400546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":436,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804720+0000","last_change":"2024-04-26T00:00:28.731423+0000","last_active":"2024-04-26T00:13:01.804720+0000","last_peered":"2024-04-26T00:13:01.804720+0000","last_clean":"2024-04-26T00:13:01.804720+0000","last_became_active":"2024-04-26T00:00:28.731119+0000","last_became_peered":"2024-04-26T00:00:28.731119+0000","last_unstale":"2024-04-26T00:13:01.804720+0000","last_undegraded":"2024-04-26T00:13:01.804720+0000","last_fullsized":"2024-04-26T00:13:01.804720+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:37:56.959685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":430,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:01.686029+0000","last_change":"2024-04-26T00:00:29.725274+0000","last_active":"2024-04-26T00:12:01.686029+0000","last_peered":"2024-04-26T00:12:01.686029+0000","last_clean":"2024-04-26T00:12:01.686029+0000","last_became_active":"2024-04-26T00:00:29.724281+0000","last_became_peered":"2024-04-26T00:00:29.724281+0000","last_unstale":"2024-04-26T00:12:01.686029+0000","last_undegraded":"2024-04-26T00:12:01.686029+0000","last_fullsized":"2024-04-26T00:12:01.686029+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:08.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.690581+0000","last_change":"2024-04-26T00:00:28.719506+0000","last_active":"2024-04-26T00:13:01.690581+0000","last_peered":"2024-04-26T00:13:01.690581+0000","last_clean":"2024-04-26T00:13:01.690581+0000","last_became_active":"2024-04-26T00:00:28.719074+0000","last_became_peered":"2024-04-26T00:00:28.719074+0000","last_unstale":"2024-04-26T00:13:01.690581+0000","last_undegraded":"2024-04-26T00:13:01.690581+0000","last_fullsized":"2024-04-26T00:13:01.690581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:58.255889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809041+0000","last_change":"2024-04-26T00:00:28.721183+0000","last_active":"2024-04-26T00:13:01.809041+0000","last_peered":"2024-04-26T00:13:01.809041+0000","last_clean":"2024-04-26T00:13:01.809041+0000","last_became_active":"2024-04-26T00:00:28.717935+0000","last_became_peered":"2024-04-26T00:00:28.717935+0000","last_unstale":"2024-04-26T00:13:01.809041+0000","last_undegraded":"2024-04-26T00:13:01.809041+0000","last_fullsized":"2024-04-26T00:13:01.809041+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:40.158656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"253'161","reported_seq":713,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804682+0000","last_change":"2024-04-26T00:00:31.558943+0000","last_active":"2024-04-26T00:13:01.804682+0000","last_peered":"2024-04-26T00:13:01.804682+0000","last_clean":"2024-04-26T00:13:01.804682+0000","last_became_active":"2024-04-26T00:00:31.558409+0000","last_became_peered":"2024-04-26T00:00:31.558409+0000","last_unstale":"2024-04-26T00:13:01.804682+0000","last_undegraded":"2024-04-26T00:13:01.804682+0000","last_fullsized":"2024-04-26T00:13:01.804682+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:02.624876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809065+0000","last_change":"2024-04-26T00:00:28.723193+0000","last_active":"2024-04-26T00:13:01.809065+0000","last_peered":"2024-04-26T00:13:01.809065+0000","last_clean":"2024-04-26T00:13:01.809065+0000","last_became_active":"2024-04-26T00:00:28.722258+0000","last_became_peered":"2024-04-26T00:00:28.722258+0000","last_unstale":"2024-04-26T00:13:01.809065+0000","last_undegraded":"2024-04-26T00:13:01.809065+0000","last_fullsized":"2024-04-26T00:13:01.809065+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:30.411395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:06.691323+0000","last_change":"2024-04-26T00:00:28.720773+0000","last_active":"2024-04-26T00:13:06.691323+0000","last_peered":"2024-04-26T00:13:06.691323+0000","last_clean":"2024-04-26T00:13:06.691323+0000","last_became_active":"2024-04-26T00:00:28.720392+0000","last_became_peered":"2024-04-26T00:00:28.720392+0000","last_unstale":"2024-04-26T00:13:06.691323+0000","last_undegraded":"2024-04-26T00:13:06.691323+0000","last_fullsized":"2024-04-26T00:13:06.691323+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:35:47.483585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":183,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808936+0000","last_change":"2024-04-26T00:00:28.731510+0000","last_active":"2024-04-26T00:13:31.808936+0000","last_peered":"2024-04-26T00:13:31.808936+0000","last_clean":"2024-04-26T00:13:31.808936+0000","last_became_active":"2024-04-26T00:00:28.731039+0000","last_became_peered":"2024-04-26T00:00:28.731039+0000","last_unstale":"2024-04-26T00:13:31.808936+0000","last_undegraded":"2024-04-26T00:13:31.808936+0000","last_fullsized":"2024-04-26T00:13:31.808936+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:14.612054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":440,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:31.690193+0000","last_change":"2024-04-26T00:00:28.726321+0000","last_active":"2024-04-26T00:12:31.690193+0000","last_peered":"2024-04-26T00:12:31.690193+0000","last_clean":"2024-04-26T00:12:31.690193+0000","last_became_active":"2024-04-26T00:00:28.725623+0000","last_became_peered":"2024-04-26T00:00:28.725623+0000","last_unstale":"2024-04-26T00:12:31.690193+0000","last_undegraded":"2024-04-26T00:12:31.690193+0000","last_fullsized":"2024-04-26T00:12:31.690193+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:33:54.174589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":6},{"poolid":9,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1586784,"data_compressed":24239,"data_compressed_allocated":98304,"data_compressed_original":1551848,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640510,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640509,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640509,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239126,"data_compressed_allocated":380928,"data_compressed_original":1138688,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640508,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28404,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343436,"statfs":{"total":96636764160,"available":96607678464,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640509,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239646,"data_compressed_allocated":380928,"data_compressed_original":1142248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640509,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":10193,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":7283,"data_compressed_allocated":32768,"data_compressed_original":515560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6763,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:15:48.979 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-26T00:15:48.979 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.122+0000 7f807f10b640 10 monclient: get_monmap_and_config 2024-04-26T00:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.122+0000 7f807f10b640 10 monclient: build_initial_monmap 2024-04-26T00:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.122+0000 7f807f10b640 10 monclient: monmap: 2024-04-26T00:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.100 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:49.129849+0000 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:49.129849+0000 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:49.101 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 Processor -- start 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- start start 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: init 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: _add_conns ranks=[2,6,5,4,7,0,1,8,3] 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): picked mon.noname-b con 0x7f8078135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): picked mon.noname-d con 0x7f80781353b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): picked mon.noname-h con 0x7f807813bdf0 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f807806f2d0 con 0x7f8078135870 2024-04-26T00:15:49.108 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078072330 con 0x7f807813bdf0 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078072610 con 0x7f80781353b0 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): authenticate will time out at 2204.657036s 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806ffff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f80781353b0 0x7f807813a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33834/0 (socket says 172.21.15.106:33834) 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806ffff640 1 -- 172.21.15.106:0/3855220549 learned_addr learned my addr 172.21.15.106:0/3855220549 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247917816 0 0) 0x7f8078072610 con 0x7f80781353b0 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): my global_id is 254904 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8060003530 con 0x7f80781353b0 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3967712692 0 0) 0x7f807806f2d0 con 0x7f8078135870 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient(hunting): my global_id is 294203 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8078072610 con 0x7f8078135870 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 25486923 0 0) 0x7f8060003530 con 0x7f80781353b0 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 >> v1:172.21.15.171:6791/0 conn(0x7f807813bdf0 legacy=0x7f807813e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 >> v1:172.21.15.106:6790/0 conn(0x7f8078135870 legacy=0x7f8078135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 monclient: found mon.noname-d 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80780a3260 con 0x7f80781353b0 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:49.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 5 monclient: authenticate success, global_id 254904 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8074001800 con 0x7f80781353b0 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: dump: 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.111 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8074001a90 con 0x7f80781353b0 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 1 -- 172.21.15.106:0/3855220549 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8074004bf0 con 0x7f80781353b0 2024-04-26T00:15:49.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 4 set_mon_vals no callback set 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f806f7fe640 10 monclient: dump: 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.113 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: shutdown 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- 172.21.15.106:0/3855220549 >> v1:172.21.15.106:6792/0 conn(0x7f80781353b0 legacy=0x7f807813a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- 172.21.15.106:0/3855220549 shutdown_connections 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- 172.21.15.106:0/3855220549 >> 172.21.15.106:0/3855220549 conn(0x7f80780a64e0 msgr2=0x7f80780a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- 172.21.15.106:0/3855220549 shutdown_connections 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- 172.21.15.106:0/3855220549 wait complete. 2024-04-26T00:15:49.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: build_initial_monmap 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: monmap: 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:49.115 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 Processor -- start 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- start start 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: init 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient: _add_conns ranks=[3,7,0,5,6,1,8,2,4] 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): picked mon.noname-g con 0x7f80781353b0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): picked mon.noname-i con 0x7f8078135870 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 10 monclient(hunting): picked mon.noname-a con 0x7f807813bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.126+0000 7f807f10b640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078133e30 con 0x7f807813bdf0 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8078134860 con 0x7f80781353b0 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80781332d0 con 0x7f8078135870 2024-04-26T00:15:49.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient(hunting): authenticate will time out at 2204.660037s 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807d6a8640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f807813bdf0 0x7f80781d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40786/0 (socket says 172.21.15.106:40786) 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807d6a8640 1 -- 172.21.15.106:0/240839248 learned_addr learned my addr 172.21.15.106:0/240839248 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033946574 0 0) 0x7f8078133e30 con 0x7f807813bdf0 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): my global_id is 274707 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8064003560 con 0x7f807813bdf0 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2876491377 0 0) 0x7f8064003560 con 0x7f807813bdf0 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8078133e30 con 0x7f807813bdf0 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f8070001cc0 con 0x7f807813bdf0 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:49.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): dump: 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.118 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3480396740 0 0) 0x7f8078134860 con 0x7f80781353b0 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): my global_id is 294222 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8064003560 con 0x7f80781353b0 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2641632870 0 0) 0x7f80781332d0 con 0x7f8078135870 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.119 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient(hunting): my global_id is 147139 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8078134860 con 0x7f8078135870 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1023394566 0 0) 0x7f8078133e30 con 0x7f807813bdf0 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 >> v1:172.21.15.171:6792/0 conn(0x7f8078135870 legacy=0x7f80781cf460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 >> v1:172.21.15.171:6790/0 conn(0x7f80781353b0 legacy=0x7f807813b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 monclient: found mon.a 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8078135e60 con 0x7f807813bdf0 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 5 monclient: authenticate success, global_id 274707 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient: _renew_subs 2024-04-26T00:15:49.120 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f807813bae0 con 0x7f807813bdf0 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient: _renew_subs 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f80781ca120 con 0x7f807813bdf0 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8070003cd0 con 0x7f807813bdf0 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f80700020d0 con 0x7f807813bdf0 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806effd640 4 set_mon_vals no callback set 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 10 monclient: dump: 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.121 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.122 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f8070004240 con 0x7f807813bdf0 2024-04-26T00:15:49.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:49.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:49.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:49.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8058005090 con 0x7f807813bdf0 2024-04-26T00:15:49.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f80700454b0 con 0x7f807813bdf0 2024-04-26T00:15:49.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.130+0000 7f807cea7640 10 monclient: get_auth_request con 0x7f8064037a90 auth_method 0 2024-04-26T00:15:49.123 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.134+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f8070015ac0 con 0x7f807813bdf0 2024-04-26T00:15:49.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.134+0000 7f806d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:49.124 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.134+0000 7f806d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:49.267 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.290+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8058000ba0 con 0x7f8064037a90 2024-04-26T00:15:49.273 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f806d7fa640 1 -- 172.21.15.106:0/240839248 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+78088 (unknown 2965378022 0 461709312) 0x7f8058000ba0 con 0x7f8064037a90 2024-04-26T00:15:49.274 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T00:15:49.274 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T00:15:49.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 >> v1:172.21.15.171:6812/722422047 conn(0x7f8064037a90 legacy=0x7f8064039f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.275 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 10 monclient: shutdown 2024-04-26T00:15:49.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:49.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 >> v1:172.21.15.106:6789/0 conn(0x7f807813bdf0 legacy=0x7f80781d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 shutdown_connections 2024-04-26T00:15:49.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 >> 172.21.15.106:0/240839248 conn(0x7f80780a64e0 msgr2=0x7f80780a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:49.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 shutdown_connections 2024-04-26T00:15:49.276 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.302+0000 7f807f10b640 1 -- 172.21.15.106:0/240839248 wait complete. 2024-04-26T00:15:49.299 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":877,"stamp":"2024-04-26T00:15:47.961818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":191328,"kb_used_data":7328,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566039712,"statfs":{"total":579820584960,"available":579624665088,"internally_reserved":0,"allocated":7503872,"data_stored":7980170,"data_compressed":1408224,"data_compressed_allocated":2154496,"data_compressed_original":4787688,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003666"},"pg_stats":[{"pgid":"10.4","version":"0'0","reported_seq":306,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798261+0000","last_change":"2024-04-26T00:00:28.738770+0000","last_active":"2024-04-26T00:12:06.798261+0000","last_peered":"2024-04-26T00:12:06.798261+0000","last_clean":"2024-04-26T00:12:06.798261+0000","last_became_active":"2024-04-26T00:00:28.737377+0000","last_became_peered":"2024-04-26T00:00:28.737377+0000","last_unstale":"2024-04-26T00:12:06.798261+0000","last_undegraded":"2024-04-26T00:12:06.798261+0000","last_fullsized":"2024-04-26T00:12:06.798261+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:25:28.008466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698667+0000","last_change":"2024-04-26T00:00:28.717284+0000","last_active":"2024-04-26T00:13:31.698667+0000","last_peered":"2024-04-26T00:13:31.698667+0000","last_clean":"2024-04-26T00:13:31.698667+0000","last_became_active":"2024-04-26T00:00:28.716880+0000","last_became_peered":"2024-04-26T00:00:28.716880+0000","last_unstale":"2024-04-26T00:13:31.698667+0000","last_undegraded":"2024-04-26T00:13:31.698667+0000","last_fullsized":"2024-04-26T00:13:31.698667+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:36.026604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":296,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:11.679238+0000","last_change":"2024-04-26T00:00:28.738509+0000","last_active":"2024-04-26T00:12:11.679238+0000","last_peered":"2024-04-26T00:12:11.679238+0000","last_clean":"2024-04-26T00:12:11.679238+0000","last_became_active":"2024-04-26T00:00:28.737571+0000","last_became_peered":"2024-04-26T00:00:28.737571+0000","last_unstale":"2024-04-26T00:12:11.679238+0000","last_undegraded":"2024-04-26T00:12:11.679238+0000","last_fullsized":"2024-04-26T00:12:11.679238+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:23.623839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698622+0000","last_change":"2024-04-26T00:00:28.725961+0000","last_active":"2024-04-26T00:13:31.698622+0000","last_peered":"2024-04-26T00:13:31.698622+0000","last_clean":"2024-04-26T00:13:31.698622+0000","last_became_active":"2024-04-26T00:00:28.725554+0000","last_became_peered":"2024-04-26T00:00:28.725554+0000","last_unstale":"2024-04-26T00:13:31.698622+0000","last_undegraded":"2024-04-26T00:13:31.698622+0000","last_fullsized":"2024-04-26T00:13:31.698622+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:38.175600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":230,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:36.690931+0000","last_change":"2024-04-26T00:00:29.724808+0000","last_active":"2024-04-26T00:12:36.690931+0000","last_peered":"2024-04-26T00:12:36.690931+0000","last_clean":"2024-04-26T00:12:36.690931+0000","last_became_active":"2024-04-26T00:00:29.723663+0000","last_became_peered":"2024-04-26T00:00:29.723663+0000","last_unstale":"2024-04-26T00:12:36.690931+0000","last_undegraded":"2024-04-26T00:12:36.690931+0000","last_fullsized":"2024-04-26T00:12:36.690931+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:20.010319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":294,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798300+0000","last_change":"2024-04-26T00:00:28.719610+0000","last_active":"2024-04-26T00:12:06.798300+0000","last_peered":"2024-04-26T00:12:06.798300+0000","last_clean":"2024-04-26T00:12:06.798300+0000","last_became_active":"2024-04-26T00:00:28.718609+0000","last_became_peered":"2024-04-26T00:00:28.718609+0000","last_unstale":"2024-04-26T00:12:06.798300+0000","last_undegraded":"2024-04-26T00:12:06.798300+0000","last_fullsized":"2024-04-26T00:12:06.798300+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:40:22.854004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":184,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808969+0000","last_change":"2024-04-26T00:00:28.732762+0000","last_active":"2024-04-26T00:13:31.808969+0000","last_peered":"2024-04-26T00:13:31.808969+0000","last_clean":"2024-04-26T00:13:31.808969+0000","last_became_active":"2024-04-26T00:00:28.732236+0000","last_became_peered":"2024-04-26T00:00:28.732236+0000","last_unstale":"2024-04-26T00:13:31.808969+0000","last_undegraded":"2024-04-26T00:13:31.808969+0000","last_fullsized":"2024-04-26T00:13:31.808969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:13.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809082+0000","last_change":"2024-04-26T00:00:28.723106+0000","last_active":"2024-04-26T00:13:01.809082+0000","last_peered":"2024-04-26T00:13:01.809082+0000","last_clean":"2024-04-26T00:13:01.809082+0000","last_became_active":"2024-04-26T00:00:28.722170+0000","last_became_peered":"2024-04-26T00:00:28.722170+0000","last_unstale":"2024-04-26T00:13:01.809082+0000","last_undegraded":"2024-04-26T00:13:01.809082+0000","last_fullsized":"2024-04-26T00:13:01.809082+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:20:48.693605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":213,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:11:56.685302+0000","last_change":"2024-04-26T00:00:28.729400+0000","last_active":"2024-04-26T00:11:56.685302+0000","last_peered":"2024-04-26T00:11:56.685302+0000","last_clean":"2024-04-26T00:11:56.685302+0000","last_became_active":"2024-04-26T00:00:28.728808+0000","last_became_peered":"2024-04-26T00:00:28.728808+0000","last_unstale":"2024-04-26T00:11:56.685302+0000","last_undegraded":"2024-04-26T00:11:56.685302+0000","last_fullsized":"2024-04-26T00:11:56.685302+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:18.593420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":218,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:16.798472+0000","last_change":"2024-04-26T00:00:28.726625+0000","last_active":"2024-04-26T00:12:16.798472+0000","last_peered":"2024-04-26T00:12:16.798472+0000","last_clean":"2024-04-26T00:12:16.798472+0000","last_became_active":"2024-04-26T00:00:28.726130+0000","last_became_peered":"2024-04-26T00:00:28.726130+0000","last_unstale":"2024-04-26T00:12:16.798472+0000","last_undegraded":"2024-04-26T00:12:16.798472+0000","last_fullsized":"2024-04-26T00:12:16.798472+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:57:08.131796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":247,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.682708+0000","last_change":"2024-04-26T00:00:28.731858+0000","last_active":"2024-04-26T00:12:06.682708+0000","last_peered":"2024-04-26T00:12:06.682708+0000","last_clean":"2024-04-26T00:12:06.682708+0000","last_became_active":"2024-04-26T00:00:28.731390+0000","last_became_peered":"2024-04-26T00:00:28.731390+0000","last_unstale":"2024-04-26T00:12:06.682708+0000","last_undegraded":"2024-04-26T00:12:06.682708+0000","last_fullsized":"2024-04-26T00:12:06.682708+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:40.241345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.808988+0000","last_change":"2024-04-26T00:00:28.724198+0000","last_active":"2024-04-26T00:13:01.808988+0000","last_peered":"2024-04-26T00:13:01.808988+0000","last_clean":"2024-04-26T00:13:01.808988+0000","last_became_active":"2024-04-26T00:00:28.723392+0000","last_became_peered":"2024-04-26T00:00:28.723392+0000","last_unstale":"2024-04-26T00:13:01.808988+0000","last_undegraded":"2024-04-26T00:13:01.808988+0000","last_fullsized":"2024-04-26T00:13:01.808988+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:53:18.116692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809021+0000","last_change":"2024-04-26T00:00:28.734188+0000","last_active":"2024-04-26T00:13:01.809021+0000","last_peered":"2024-04-26T00:13:01.809021+0000","last_clean":"2024-04-26T00:13:01.809021+0000","last_became_active":"2024-04-26T00:00:28.732291+0000","last_became_peered":"2024-04-26T00:00:28.732291+0000","last_unstale":"2024-04-26T00:13:01.809021+0000","last_undegraded":"2024-04-26T00:13:01.809021+0000","last_fullsized":"2024-04-26T00:13:01.809021+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:21:55.026807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":307,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.798200+0000","last_change":"2024-04-26T00:00:28.731923+0000","last_active":"2024-04-26T00:12:06.798200+0000","last_peered":"2024-04-26T00:12:06.798200+0000","last_clean":"2024-04-26T00:12:06.798200+0000","last_became_active":"2024-04-26T00:00:28.730684+0000","last_became_peered":"2024-04-26T00:00:28.730684+0000","last_unstale":"2024-04-26T00:12:06.798200+0000","last_undegraded":"2024-04-26T00:12:06.798200+0000","last_fullsized":"2024-04-26T00:12:06.798200+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:35:38.832871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":191,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.686048+0000","last_change":"2024-04-26T00:00:29.729411+0000","last_active":"2024-04-26T00:13:01.686048+0000","last_peered":"2024-04-26T00:13:01.686048+0000","last_clean":"2024-04-26T00:13:01.686048+0000","last_became_active":"2024-04-26T00:00:29.727993+0000","last_became_peered":"2024-04-26T00:00:29.727993+0000","last_unstale":"2024-04-26T00:13:01.686048+0000","last_undegraded":"2024-04-26T00:13:01.686048+0000","last_fullsized":"2024-04-26T00:13:01.686048+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:34.304761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:31.804931+0000","last_change":"2024-04-26T00:00:28.712427+0000","last_active":"2024-04-26T00:12:31.804931+0000","last_peered":"2024-04-26T00:12:31.804931+0000","last_clean":"2024-04-26T00:12:31.804931+0000","last_became_active":"2024-04-26T00:00:28.711533+0000","last_became_peered":"2024-04-26T00:00:28.711533+0000","last_unstale":"2024-04-26T00:12:31.804931+0000","last_undegraded":"2024-04-26T00:12:31.804931+0000","last_fullsized":"2024-04-26T00:12:31.804931+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:04:37.400546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":436,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804720+0000","last_change":"2024-04-26T00:00:28.731423+0000","last_active":"2024-04-26T00:13:01.804720+0000","last_peered":"2024-04-26T00:13:01.804720+0000","last_clean":"2024-04-26T00:13:01.804720+0000","last_became_active":"2024-04-26T00:00:28.731119+0000","last_became_peered":"2024-04-26T00:00:28.731119+0000","last_unstale":"2024-04-26T00:13:01.804720+0000","last_undegraded":"2024-04-26T00:13:01.804720+0000","last_fullsized":"2024-04-26T00:13:01.804720+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:37:56.959685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":430,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:01.686029+0000","last_change":"2024-04-26T00:00:29.725274+0000","last_active":"2024-04-26T00:12:01.686029+0000","last_peered":"2024-04-26T00:12:01.686029+0000","last_clean":"2024-04-26T00:12:01.686029+0000","last_became_active":"2024-04-26T00:00:29.724281+0000","last_became_peered":"2024-04-26T00:00:29.724281+0000","last_unstale":"2024-04-26T00:12:01.686029+0000","last_undegraded":"2024-04-26T00:12:01.686029+0000","last_fullsized":"2024-04-26T00:12:01.686029+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:08.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.690581+0000","last_change":"2024-04-26T00:00:28.719506+0000","last_active":"2024-04-26T00:13:01.690581+0000","last_peered":"2024-04-26T00:13:01.690581+0000","last_clean":"2024-04-26T00:13:01.690581+0000","last_became_active":"2024-04-26T00:00:28.719074+0000","last_became_peered":"2024-04-26T00:00:28.719074+0000","last_unstale":"2024-04-26T00:13:01.690581+0000","last_undegraded":"2024-04-26T00:13:01.690581+0000","last_fullsized":"2024-04-26T00:13:01.690581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:58.255889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809041+0000","last_change":"2024-04-26T00:00:28.721183+0000","last_active":"2024-04-26T00:13:01.809041+0000","last_peered":"2024-04-26T00:13:01.809041+0000","last_clean":"2024-04-26T00:13:01.809041+0000","last_became_active":"2024-04-26T00:00:28.717935+0000","last_became_peered":"2024-04-26T00:00:28.717935+0000","last_unstale":"2024-04-26T00:13:01.809041+0000","last_undegraded":"2024-04-26T00:13:01.809041+0000","last_fullsized":"2024-04-26T00:13:01.809041+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:11:40.158656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"253'161","reported_seq":713,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804682+0000","last_change":"2024-04-26T00:00:31.558943+0000","last_active":"2024-04-26T00:13:01.804682+0000","last_peered":"2024-04-26T00:13:01.804682+0000","last_clean":"2024-04-26T00:13:01.804682+0000","last_became_active":"2024-04-26T00:00:31.558409+0000","last_became_peered":"2024-04-26T00:00:31.558409+0000","last_unstale":"2024-04-26T00:13:01.804682+0000","last_undegraded":"2024-04-26T00:13:01.804682+0000","last_fullsized":"2024-04-26T00:13:01.804682+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:02.624876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.809065+0000","last_change":"2024-04-26T00:00:28.723193+0000","last_active":"2024-04-26T00:13:01.809065+0000","last_peered":"2024-04-26T00:13:01.809065+0000","last_clean":"2024-04-26T00:13:01.809065+0000","last_became_active":"2024-04-26T00:00:28.722258+0000","last_became_peered":"2024-04-26T00:00:28.722258+0000","last_unstale":"2024-04-26T00:13:01.809065+0000","last_undegraded":"2024-04-26T00:13:01.809065+0000","last_fullsized":"2024-04-26T00:13:01.809065+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:16:30.411395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:06.691323+0000","last_change":"2024-04-26T00:00:28.720773+0000","last_active":"2024-04-26T00:13:06.691323+0000","last_peered":"2024-04-26T00:13:06.691323+0000","last_clean":"2024-04-26T00:13:06.691323+0000","last_became_active":"2024-04-26T00:00:28.720392+0000","last_became_peered":"2024-04-26T00:00:28.720392+0000","last_unstale":"2024-04-26T00:13:06.691323+0000","last_undegraded":"2024-04-26T00:13:06.691323+0000","last_fullsized":"2024-04-26T00:13:06.691323+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:35:47.483585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":183,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808936+0000","last_change":"2024-04-26T00:00:28.731510+0000","last_active":"2024-04-26T00:13:31.808936+0000","last_peered":"2024-04-26T00:13:31.808936+0000","last_clean":"2024-04-26T00:13:31.808936+0000","last_became_active":"2024-04-26T00:00:28.731039+0000","last_became_peered":"2024-04-26T00:00:28.731039+0000","last_unstale":"2024-04-26T00:13:31.808936+0000","last_undegraded":"2024-04-26T00:13:31.808936+0000","last_fullsized":"2024-04-26T00:13:31.808936+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:14.612054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":440,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:31.690193+0000","last_change":"2024-04-26T00:00:28.726321+0000","last_active":"2024-04-26T00:12:31.690193+0000","last_peered":"2024-04-26T00:12:31.690193+0000","last_clean":"2024-04-26T00:12:31.690193+0000","last_became_active":"2024-04-26T00:00:28.725623+0000","last_became_peered":"2024-04-26T00:00:28.725623+0000","last_unstale":"2024-04-26T00:12:31.690193+0000","last_undegraded":"2024-04-26T00:12:31.690193+0000","last_fullsized":"2024-04-26T00:12:31.690193+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:33:54.174589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":6},{"poolid":9,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1586784,"data_compressed":24239,"data_compressed_allocated":98304,"data_compressed_original":1551848,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640510,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640509,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640509,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239126,"data_compressed_allocated":380928,"data_compressed_original":1138688,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640508,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28404,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343436,"statfs":{"total":96636764160,"available":96607678464,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640509,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239646,"data_compressed_allocated":380928,"data_compressed_original":1142248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640509,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":10193,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":7283,"data_compressed_allocated":32768,"data_compressed_original":515560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6763,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:15:49.301 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-26T00:15:49.418 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient: get_monmap_and_config 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient: build_initial_monmap 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient: monmap: 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:49.448427+0000 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:49.448427+0000 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:49.419 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:49.420 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:49.420 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:49.420 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:49.420 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 1 Processor -- start 2024-04-26T00:15:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 1 -- start start 2024-04-26T00:15:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient: init 2024-04-26T00:15:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient: _add_conns ranks=[1,0,3,5,4,2,6,7,8] 2024-04-26T00:15:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient(hunting): picked mon.noname-f con 0x7f1e18134970 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:49.423 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient(hunting): picked mon.noname-a con 0x7f1e180a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient(hunting): picked mon.noname-g con 0x7f1e1813e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e16ffd640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f1e180a4820 0x7f1e1813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40798/0 (socket says 172.21.15.106:40798) 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e16ffd640 1 -- 172.21.15.106:0/1528934016 learned_addr learned my addr 172.21.15.106:0/1528934016 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1806dd40 con 0x7f1e180a4820 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e180a2b10 con 0x7f1e18134970 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e180a2df0 con 0x7f1e1813e200 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.442+0000 7f1e1e260640 10 monclient(hunting): authenticate will time out at 2204.975764s 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3487247387 0 0) 0x7f1e1806dd40 con 0x7f1e180a4820 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): my global_id is 274716 2024-04-26T00:15:49.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e00003530 con 0x7f1e180a4820 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 165154948 0 0) 0x7f1e180a2df0 con 0x7f1e1813e200 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient(hunting): my global_id is 294231 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e1806dd40 con 0x7f1e1813e200 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1084540526 0 0) 0x7f1e00003530 con 0x7f1e180a4820 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 >> v1:172.21.15.171:6790/0 conn(0x7f1e1813e200 legacy=0x7f1e181405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 >> v1:172.21.15.171:6789/0 conn(0x7f1e18134970 legacy=0x7f1e18134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 monclient: found mon.noname-a 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e180a30d0 con 0x7f1e180a4820 2024-04-26T00:15:49.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1e0c0017c0 con 0x7f1e180a4820 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: dump: 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.426 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 5 monclient: authenticate success, global_id 274716 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e0c001a20 con 0x7f1e180a4820 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 1 -- 172.21.15.106:0/1528934016 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1e0c004bf0 con 0x7f1e180a4820 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:49.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e167fc640 10 monclient: dump: 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.428 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 4 set_mon_vals no callback set 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient: shutdown 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 >> v1:172.21.15.106:6789/0 conn(0x7f1e180a4820 legacy=0x7f1e1813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 shutdown_connections 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 >> 172.21.15.106:0/1528934016 conn(0x7f1e180a9e20 msgr2=0x7f1e180aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 shutdown_connections 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 -- 172.21.15.106:0/1528934016 wait complete. 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient: build_initial_monmap 2024-04-26T00:15:49.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient: monmap: 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:49.430 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:49.431 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 Processor -- start 2024-04-26T00:15:49.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 -- start start 2024-04-26T00:15:49.431 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient: init 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient: _add_conns ranks=[2,7,6,3,0,1,8,5,4] 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient(hunting): picked mon.noname-b con 0x7f1e180a4820 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient(hunting): picked mon.noname-i con 0x7f1e18134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 10 monclient(hunting): picked mon.noname-d con 0x7f1e1813e200 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e177fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f1e180a4820 0x7f1e181cc640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48200/0 (socket says 172.21.15.106:48200) 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e177fe640 1 -- 172.21.15.106:0/2773500094 learned_addr learned my addr 172.21.15.106:0/2773500094 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.446+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1809deb0 con 0x7f1e180a4820 2024-04-26T00:15:49.434 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e1809e350 con 0x7f1e1813e200 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1e180a1a40 con 0x7f1e18134970 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1e1e260640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1e1e260640 10 monclient(hunting): authenticate will time out at 2204.980327s 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 424032757 0 0) 0x7f1e1809e350 con 0x7f1e1813e200 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): my global_id is 254913 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e04003560 con 0x7f1e1813e200 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1763069332 0 0) 0x7f1e1809deb0 con 0x7f1e180a4820 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.435 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 10 monclient(hunting): my global_id is 294212 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.450+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e1809e350 con 0x7f1e180a4820 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2967671733 0 0) 0x7f1e180a1a40 con 0x7f1e18134970 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): my global_id is 147148 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1e1809deb0 con 0x7f1e18134970 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 923811928 0 0) 0x7f1e04003560 con 0x7f1e1813e200 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e180a1a40 con 0x7f1e1813e200 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 682543300 0 0) 0x7f1e1809e350 con 0x7f1e180a4820 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1e04003560 con 0x7f1e180a4820 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1e10001cc0 con 0x7f1e1813e200 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:49.436 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): dump: 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.437 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1e08001a90 con 0x7f1e180a4820 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient(hunting): dump: 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.438 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3765725226 0 0) 0x7f1e180a1a40 con 0x7f1e1813e200 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 >> v1:172.21.15.171:6792/0 conn(0x7f1e18134970 legacy=0x7f1e181d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 >> v1:172.21.15.106:6790/0 conn(0x7f1e180a4820 legacy=0x7f1e181cc640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:49.439 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 monclient: found mon.d 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e180a1e00 con 0x7f1e1813e200 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: _finish_auth 0 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 5 monclient: authenticate success, global_id 254913 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1e10001fe0 con 0x7f1e1813e200 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 10 monclient: _renew_subs 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1e1809ff20 con 0x7f1e1813e200 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:49.440 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e15ffb640 4 set_mon_vals no callback set 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 10 monclient: _renew_subs 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f1e10003f90 con 0x7f1e1813e200 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1e180a05c0 con 0x7f1e1813e200 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 10 monclient: dump: 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:49.441 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f1e1000ed30 con 0x7f1e1813e200 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f1e10043fd0 con 0x7f1e1813e200 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e177fe640 10 monclient: get_auth_request con 0x7f1e04037ff0 auth_method 0 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:49.442 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:49.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:49.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.454+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e18067160 con 0x7f1e1813e200 2024-04-26T00:15:49.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.462+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f1e1809ff20 con 0x7f1e1813e200 2024-04-26T00:15:49.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.462+0000 7f1dfffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:49.443 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.462+0000 7f1dfffff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:49.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.626+0000 7f1e1e260640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-04-26T00:15:49.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.626+0000 7f1e1e260640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-26T00:15:49.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.626+0000 7f1e1e260640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:49.602 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.626+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1e18062e50 con 0x7f1e1813e200 2024-04-26T00:15:49.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.626+0000 7f1dfffff640 1 -- 172.21.15.106:0/2773500094 <== mon.6 v1:172.21.15.106:6792/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v256) ==== 74+0+20493 (unknown 1383757950 0 990180159) 0x7f1e10014700 con 0x7f1e1813e200 2024-04-26T00:15:49.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.626+0000 7f1dfffff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-04-26T00:15:49.604 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.626+0000 7f1dfffff640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:15:49.605 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T00:15:49.605 INFO:teuthology.orchestra.run.smithi106.stdout:{"epoch":256,"fsid":"91a11040-4c8b-4137-ad71-c18376365faa","created":"2024-04-25T23:54:46.746675+0000","modified":"2024-04-26T00:08:46.687425+0000","last_up_change":"2024-04-25T23:54:55.661326+0000","last_in_change":"2024-04-26T00:08:46.687425+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":181,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":12,"max_osd":15,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":"rbd","create_time":"2024-04-25T23:54:56.831664+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":".mgr","create_time":"2024-04-25T23:54:57.662371+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"fooset","create_time":"2024-04-25T23:59:33.156016+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"barset","create_time":"2024-04-25T23:59:34.147004+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"d8be68ed-f989-43cd-bb66-fdf514ef84a2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6808","nonce":1458966339}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6809","nonce":1458966339}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6811","nonce":1458966339}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6810","nonce":1458966339}]},"public_addr":"172.21.15.106:6808/1458966339","cluster_addr":"172.21.15.106:6809/1458966339","heartbeat_back_addr":"172.21.15.106:6811/1458966339","heartbeat_front_addr":"172.21.15.106:6810/1458966339","state":["exists","up"]},{"osd":1,"uuid":"0b4cb186-016f-4325-86fc-a32d67508e1e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6800","nonce":858572474}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6802","nonce":858572474}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6807","nonce":858572474}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6804","nonce":858572474}]},"public_addr":"172.21.15.106:6800/858572474","cluster_addr":"172.21.15.106:6802/858572474","heartbeat_back_addr":"172.21.15.106:6807/858572474","heartbeat_front_addr":"172.21.15.106:6804/858572474","state":["exists","up"]},{"osd":2,"uuid":"5305c964-9533-4f1d-a1a2-6ab03decd54a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6801","nonce":2648645857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6803","nonce":2648645857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6806","nonce":2648645857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.106:6805","nonce":2648645857}]},"public_addr":"172.21.15.106:6801/2648645857","cluster_addr":"172.21.15.106:6803/2648645857","heartbeat_back_addr":"172.21.15.106:6806/2648645857","heartbeat_front_addr":"172.21.15.106:6805/2648645857","state":["exists","up"]},{"osd":3,"uuid":"acff288b-4172-4f63-9d56-7556ce456b20","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":170,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6808","nonce":2707846597}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6809","nonce":2707846597}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6811","nonce":2707846597}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6810","nonce":2707846597}]},"public_addr":"172.21.15.171:6808/2707846597","cluster_addr":"172.21.15.171:6809/2707846597","heartbeat_back_addr":"172.21.15.171:6811/2707846597","heartbeat_front_addr":"172.21.15.171:6810/2707846597","state":["exists","up"]},{"osd":4,"uuid":"7eebb63b-821b-4ad5-9ec1-dc19e2b3602c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6804","nonce":3736794137}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6805","nonce":3736794137}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6807","nonce":3736794137}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6806","nonce":3736794137}]},"public_addr":"172.21.15.171:6804/3736794137","cluster_addr":"172.21.15.171:6805/3736794137","heartbeat_back_addr":"172.21.15.171:6807/3736794137","heartbeat_front_addr":"172.21.15.171:6806/3736794137","state":["exists","up"]},{"osd":5,"uuid":"b6eacb9b-5f8b-4eaa-812d-4c4a7190dec1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":168,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6800","nonce":721452434}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6801","nonce":721452434}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6803","nonce":721452434}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.171:6802","nonce":721452434}]},"public_addr":"172.21.15.171:6800/721452434","cluster_addr":"172.21.15.171:6801/721452434","heartbeat_back_addr":"172.21.15.171:6803/721452434","heartbeat_front_addr":"172.21.15.171:6802/721452434","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["autoout","exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["autoout","exists","new"]},{"osd":8,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["autoout","exists","new"]},{"osd":9,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["autoout","exists","new"]},{"osd":10,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":12,"uuid":"aa68e4d6-7b8f-4a5a-8b0b-22213bea2028","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":13,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.949301+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.787874+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.829667+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.994707+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:54.048968+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T23:54:53.982217+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":65536,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":65536,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":65536,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":65536,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":12,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":13,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"},"ec-foo-ssd":{"crush-device-class":"ssd","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 >> v1:172.21.15.171:6812/722422047 conn(0x7f1e04037ff0 legacy=0x7f1e0403a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 10 monclient: shutdown 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 >> v1:172.21.15.106:6792/0 conn(0x7f1e1813e200 legacy=0x7f1e181d4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 shutdown_connections 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 >> 172.21.15.106:0/2773500094 conn(0x7f1e180a9e20 msgr2=0x7f1e18130b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 shutdown_connections 2024-04-26T00:15:49.607 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:49.630+0000 7f1e1e260640 1 -- 172.21.15.106:0/2773500094 wait complete. 2024-04-26T00:15:50.623 INFO:tasks.ceph:Scrubbing osd.0 2024-04-26T00:15:50.623 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-26T00:15:50.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: get_monmap_and_config 2024-04-26T00:15:50.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: build_initial_monmap 2024-04-26T00:15:50.757 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: monmap: 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:50.787096+0000 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:50.787096+0000 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:50.758 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:50.759 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:50.759 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 Processor -- start 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- start start 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: init 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: _add_conns ranks=[8,1,7,6,0,4,2,5,3] 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient(hunting): picked mon.noname-e con 0x7ff3a8134820 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient(hunting): picked mon.noname-f con 0x7ff3a80725d0 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:50.766 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient(hunting): picked mon.noname-i con 0x7ff3a813ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a8071270 con 0x7ff3a80725d0 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a80714e0 con 0x7ff3a813ace0 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a80729f0 con 0x7ff3a8134820 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient(hunting): authenticate will time out at 2206.314380s 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a77fe640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7ff3a8134820 0x7ff3a8134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49538/0 (socket says 172.21.15.106:49538) 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a77fe640 1 -- 172.21.15.106:0/657823317 learned_addr learned my addr 172.21.15.106:0/657823317 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513921686 0 0) 0x7ff3a80729f0 con 0x7ff3a8134820 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient(hunting): my global_id is 294200 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff390003530 con 0x7ff3a8134820 2024-04-26T00:15:50.767 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1996871547 0 0) 0x7ff390003530 con 0x7ff3a8134820 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 >> v1:172.21.15.171:6792/0 conn(0x7ff3a813ace0 legacy=0x7ff3a813d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 >> v1:172.21.15.171:6789/0 conn(0x7ff3a80725d0 legacy=0x7ff3a81395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 monclient: found mon.noname-e 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a80717c0 con 0x7ff3a8134820 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff398001820 con 0x7ff3a8134820 2024-04-26T00:15:50.768 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 5 monclient: authenticate success, global_id 294200 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: dump: 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.769 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff398001b30 con 0x7ff3a8134820 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 4 set_mon_vals no callback set 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 1 -- 172.21.15.106:0/657823317 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff398004bf0 con 0x7ff3a8134820 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:50.770 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3a67fc640 10 monclient: dump: 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.771 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 10 monclient: shutdown 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/657823317 >> v1:172.21.15.106:6793/0 conn(0x7ff3a8134820 legacy=0x7ff3a8134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/657823317 shutdown_connections 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/657823317 >> 172.21.15.106:0/657823317 conn(0x7ff3a80a64e0 msgr2=0x7ff3a80a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/657823317 shutdown_connections 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.786+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/657823317 wait complete. 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: build_initial_monmap 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: monmap: 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:50.772 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.773 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 1 Processor -- start 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 1 -- start start 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: init 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: _add_conns ranks=[3,5,7,0,4,8,6,1,2] 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient(hunting): picked mon.noname-g con 0x7ff3a80725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient(hunting): picked mon.noname-h con 0x7ff3a8134820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient(hunting): picked mon.noname-i con 0x7ff3a813ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a813bee0 con 0x7ff3a80725d0 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a809edb0 con 0x7ff3a8134820 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3a80706a0 con 0x7ff3a813ace0 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient(hunting): authenticate will time out at 2206.317425s 2024-04-26T00:15:50.774 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3a77fe640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7ff3a80725d0 0x7ff3a813b0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:53752/0 (socket says 172.21.15.106:53752) 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3a7fff640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7ff3a813ace0 0x7ff3a81d4970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:59076/0 (socket says 172.21.15.106:59076) 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3a77fe640 1 -- 172.21.15.106:0/1740999290 learned_addr learned my addr 172.21.15.106:0/1740999290 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1413610597 0 0) 0x7ff3a809edb0 con 0x7ff3a8134820 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): my global_id is 254867 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff394003530 con 0x7ff3a8134820 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1348899461 0 0) 0x7ff3a80706a0 con 0x7ff3a813ace0 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): my global_id is 147166 2024-04-26T00:15:50.775 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3a809edb0 con 0x7ff3a813ace0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3040074895 0 0) 0x7ff3a813bee0 con 0x7ff3a80725d0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): my global_id is 294240 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff3a80706a0 con 0x7ff3a80725d0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 541218853 0 0) 0x7ff3a80706a0 con 0x7ff3a80725d0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3a813bee0 con 0x7ff3a80725d0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2072480207 0 0) 0x7ff3a809edb0 con 0x7ff3a813ace0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3a80706a0 con 0x7ff3a813ace0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff3a0001bb0 con 0x7ff3a813ace0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-04-26T00:15:50.776 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): dump: 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.777 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff3980017e0 con 0x7ff3a80725d0 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): dump: 2024-04-26T00:15:50.778 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.779 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1205586007 0 0) 0x7ff394003530 con 0x7ff3a8134820 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff3a809edb0 con 0x7ff3a8134820 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff39c0019e0 con 0x7ff3a8134820 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient(hunting): dump: 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.780 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2192468665 0 0) 0x7ff3a813bee0 con 0x7ff3a80725d0 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 >> v1:172.21.15.171:6792/0 conn(0x7ff3a813ace0 legacy=0x7ff3a81d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 >> v1:172.21.15.171:6791/0 conn(0x7ff3a8134820 legacy=0x7ff3a813b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 monclient: found mon.g 2024-04-26T00:15:50.781 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3a8072c60 con 0x7ff3a80725d0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: _finish_auth 0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 5 monclient: authenticate success, global_id 294240 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: _renew_subs 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff3a8135640 con 0x7ff3a80725d0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: _renew_subs 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff3a813aa00 con 0x7ff3a80725d0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff398004c10 con 0x7ff3a80725d0 2024-04-26T00:15:50.782 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff3a5ffb640 4 set_mon_vals no callback set 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff398005240 con 0x7ff3a80725d0 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.790+0000 7ff38ffff640 10 monclient: dump: 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.783 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff3ae0f1640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.171:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff388000f90 con 0x7ff3a80725d0 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff39800ffe0 con 0x7ff3a80725d0 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7ff398045050 con 0x7ff3a80725d0 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.106:6808/1458966339 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff394045c10 con 0x7ff394041f40 2024-04-26T00:15:50.784 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (unknown 3755836717 0 0) 0x7ff398045430 con 0x7ff3a80725d0 2024-04-26T00:15:50.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff38ffff640 10 monclient: handle_get_version_reply finishing 1 version 256 2024-04-26T00:15:50.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff3a7fff640 10 monclient: get_auth_request con 0x7ff394041f40 auth_method 0 2024-04-26T00:15:50.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff3a6ffd640 10 monclient: get_auth_request con 0x7ff3940380f0 auth_method 0 2024-04-26T00:15:50.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.794+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== osd.0 v1:172.21.15.106:6808/1458966339 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff394045c10 con 0x7ff394041f40 2024-04-26T00:15:50.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 --> v1:172.21.15.106:6808/1458966339 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff388002cc0 con 0x7ff394041f40 2024-04-26T00:15:50.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff38ffff640 1 -- 172.21.15.106:0/1740999290 <== osd.0 v1:172.21.15.106:6808/1458966339 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7ff388002cc0 con 0x7ff394041f40 2024-04-26T00:15:50.786 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:50.786 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T00:15:50.786 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 >> v1:172.21.15.106:6808/1458966339 conn(0x7ff394041f40 legacy=0x7ff3940443a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 >> v1:172.21.15.171:6812/722422047 conn(0x7ff3940380f0 legacy=0x7ff39403a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 10 monclient: shutdown 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 >> v1:172.21.15.171:6790/0 conn(0x7ff3a80725d0 legacy=0x7ff3a813b0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3a7fff640 1 -- 172.21.15.106:0/1740999290 reap_dead start 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 shutdown_connections 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 >> 172.21.15.106:0/1740999290 conn(0x7ff3a80a64e0 msgr2=0x7ff3a813d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:50.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 shutdown_connections 2024-04-26T00:15:50.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.810+0000 7ff3ae0f1640 1 -- 172.21.15.106:0/1740999290 wait complete. 2024-04-26T00:15:50.797 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: get_monmap_and_config 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: build_initial_monmap 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: monmap: 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:50.938891+0000 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:50.938891+0000 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:50.909 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:50.910 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.916 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 Processor -- start 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- start start 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: init 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: _add_conns ranks=[8,5,0,4,7,6,3,1,2] 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient(hunting): picked mon.noname-e con 0x7f04580a1bc0 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient(hunting): picked mon.noname-h con 0x7f04580a0400 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient(hunting): picked mon.noname-a con 0x7f04580a26b0 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04580a01d0 con 0x7f04580a26b0 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0458072f80 con 0x7f04580a0400 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f045809b0f0 con 0x7f04580a1bc0 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient(hunting): authenticate will time out at 2206.465864s 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045d585640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f04580a1bc0 0x7f04580a1fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49540/0 (socket says 172.21.15.106:49540) 2024-04-26T00:15:50.917 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045d585640 1 -- 172.21.15.106:0/572653437 learned_addr learned my addr 172.21.15.106:0/572653437 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4087638829 0 0) 0x7f045809b0f0 con 0x7f04580a1bc0 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): my global_id is 294209 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0444003530 con 0x7f04580a1bc0 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3295654599 0 0) 0x7f04500014a0 con 0x7f04580a26b0 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient(hunting): my global_id is 274725 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f045809b0f0 con 0x7f04580a26b0 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 848187527 0 0) 0x7f0444003530 con 0x7f04580a1bc0 2024-04-26T00:15:50.918 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 >> v1:172.21.15.171:6791/0 conn(0x7f04580a0400 legacy=0x7f045813a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 >> v1:172.21.15.106:6789/0 conn(0x7f04580a26b0 legacy=0x7f045813e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 monclient: found mon.noname-e 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f045809d110 con 0x7f04580a1bc0 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: _finish_auth 0 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f04540017c0 con 0x7f04580a1bc0 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 5 monclient: authenticate success, global_id 294209 2024-04-26T00:15:50.919 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: dump: 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.920 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0454001a20 con 0x7f04580a1bc0 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 1 -- 172.21.15.106:0/572653437 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0454001c90 con 0x7f04580a1bc0 2024-04-26T00:15:50.921 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f044ffff640 10 monclient: dump: 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.922 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 4 set_mon_vals no callback set 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 10 monclient: shutdown 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- 172.21.15.106:0/572653437 >> v1:172.21.15.106:6793/0 conn(0x7f04580a1bc0 legacy=0x7f04580a1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- 172.21.15.106:0/572653437 shutdown_connections 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- 172.21.15.106:0/572653437 >> 172.21.15.106:0/572653437 conn(0x7f045806b210 msgr2=0x7f045806b620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- 172.21.15.106:0/572653437 shutdown_connections 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.938+0000 7f045f7e9640 1 -- 172.21.15.106:0/572653437 wait complete. 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: build_initial_monmap 2024-04-26T00:15:50.923 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: monmap: 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:50.924 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 Processor -- start 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 -- start start 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: init 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _add_conns ranks=[0,2,5,3,4,6,1,8,7] 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient(hunting): picked mon.noname-a con 0x7f04580a0400 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient(hunting): picked mon.noname-b con 0x7f04580a1bc0 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient(hunting): picked mon.noname-h con 0x7f04580a26b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04581aa450 con 0x7f04580a0400 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04580731a0 con 0x7f04580a1bc0 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0458072c50 con 0x7f04580a26b0 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:50.925 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient(hunting): authenticate will time out at 2206.469157s 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045cd84640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f04580a1bc0 0x7f04581d1630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48210/0 (socket says 172.21.15.106:48210) 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045cd84640 1 -- 172.21.15.106:0/4211725473 learned_addr learned my addr 172.21.15.106:0/4211725473 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417539980 0 0) 0x7f04580731a0 con 0x7f04580a1bc0 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): my global_id is 294221 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f043c003530 con 0x7f04580a1bc0 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599222880 0 0) 0x7f04581aa450 con 0x7f04580a0400 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): my global_id is 274734 2024-04-26T00:15:50.926 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04580731a0 con 0x7f04580a0400 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1051501861 0 0) 0x7f043c003530 con 0x7f04580a1bc0 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f04581aa450 con 0x7f04580a1bc0 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0448001b20 con 0x7f04580a1bc0 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): dump: 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.927 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3574868284 0 0) 0x7f04580731a0 con 0x7f04580a0400 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f043c003530 con 0x7f04580a0400 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0454001780 con 0x7f04580a0400 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): dump: 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.928 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.929 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 722173973 0 0) 0x7f0458072c50 con 0x7f04580a26b0 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient(hunting): my global_id is 254876 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f04580731a0 con 0x7f04580a26b0 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3795082241 0 0) 0x7f04581aa450 con 0x7f04580a1bc0 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 >> v1:172.21.15.171:6791/0 conn(0x7f04580a26b0 legacy=0x7f04581d4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 >> v1:172.21.15.106:6789/0 conn(0x7f04580a0400 legacy=0x7f04581b8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 monclient: found mon.b 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04581a8160 con 0x7f04580a1bc0 2024-04-26T00:15:50.930 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: _finish_auth 0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 5 monclient: authenticate success, global_id 294221 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _renew_subs 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f04581aa170 con 0x7f04580a1bc0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _renew_subs 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f04581c9880 con 0x7f04580a1bc0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0448003910 con 0x7f04580a1bc0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f0448003e00 con 0x7f04580a1bc0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:50.931 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044f7fe640 4 set_mon_vals no callback set 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 10 monclient: dump: 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:50.932 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f0448004020 con 0x7f04580a1bc0 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0438005090 con 0x7f04580a1bc0 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f0448045140 con 0x7f04580a1bc0 2024-04-26T00:15:50.933 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.942+0000 7f045d585640 10 monclient: get_auth_request con 0x7f043c037e90 auth_method 0 2024-04-26T00:15:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.946+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f0448015870 con 0x7f04580a1bc0 2024-04-26T00:15:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.946+0000 7f044dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:50.934 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:50.946+0000 7f044dffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:51.083 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.110+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0438000ba0 con 0x7f043c037e90 2024-04-26T00:15:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.110+0000 7f044dffb640 1 -- 172.21.15.106:0/4211725473 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f0438000ba0 con 0x7f043c037e90 2024-04-26T00:15:51.084 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 0 to deep-scrub 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 >> v1:172.21.15.171:6812/722422047 conn(0x7f043c037e90 legacy=0x7f043c03a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 10 monclient: shutdown 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 >> v1:172.21.15.106:6790/0 conn(0x7f04580a1bc0 legacy=0x7f04581d1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 shutdown_connections 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 >> 172.21.15.106:0/4211725473 conn(0x7f045806b210 msgr2=0x7f04581bbdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 shutdown_connections 2024-04-26T00:15:51.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.114+0000 7f045f7e9640 1 -- 172.21.15.106:0/4211725473 wait complete. 2024-04-26T00:15:51.102 INFO:tasks.ceph:Scrubbing osd.1 2024-04-26T00:15:51.103 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-26T00:15:51.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient: get_monmap_and_config 2024-04-26T00:15:51.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.229 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient: monmap: 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:51.259063+0000 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:51.259063+0000 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.230 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.231 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 1 Processor -- start 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 1 -- start start 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient: init 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient: _add_conns ranks=[3,8,7,6,1,2,4,0,5] 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient(hunting): picked mon.noname-g con 0x7f5c4c135870 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient(hunting): picked mon.noname-e con 0x7f5c4c1353b0 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:51.237 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient(hunting): picked mon.noname-i con 0x7f5c4c13bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c06f2d0 con 0x7f5c4c135870 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c072330 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c072610 con 0x7f5c4c1353b0 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient(hunting): authenticate will time out at 2206.786770s 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c50cad640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f5c4c1353b0 0x7f5c4c13a6d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49548/0 (socket says 172.21.15.106:49548) 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c50cad640 1 -- 172.21.15.106:0/1014165745 learned_addr learned my addr 172.21.15.106:0/1014165745 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 162207411 0 0) 0x7f5c4c072610 con 0x7f5c4c1353b0 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient(hunting): my global_id is 294218 2024-04-26T00:15:51.238 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c38003530 con 0x7f5c4c1353b0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2512795392 0 0) 0x7f5c38003530 con 0x7f5c4c1353b0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 >> v1:172.21.15.171:6792/0 conn(0x7f5c4c13bdf0 legacy=0x7f5c4c13e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 >> v1:172.21.15.171:6790/0 conn(0x7f5c4c135870 legacy=0x7f5c4c135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 monclient: found mon.noname-e 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c0a3260 con 0x7f5c4c1353b0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c3c001800 con 0x7f5c4c1353b0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.239 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: dump: 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.240 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 5 monclient: authenticate success, global_id 294218 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c3c001aa0 con 0x7f5c4c1353b0 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c53712640 4 set_mon_vals no callback set 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 1 -- 172.21.15.106:0/1014165745 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c3c004bf0 con 0x7f5c4c1353b0 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.258+0000 7f5c43fff640 10 monclient: dump: 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.241 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.242 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: shutdown 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/1014165745 >> v1:172.21.15.106:6793/0 conn(0x7f5c4c1353b0 legacy=0x7f5c4c13a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/1014165745 shutdown_connections 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/1014165745 >> 172.21.15.106:0/1014165745 conn(0x7f5c4c0a64e0 msgr2=0x7f5c4c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/1014165745 shutdown_connections 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/1014165745 wait complete. 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: monmap: 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:51.243 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 Processor -- start 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- start start 2024-04-26T00:15:51.244 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: init 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: _add_conns ranks=[1,5,6,4,7,2,8,3,0] 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient(hunting): picked mon.noname-f con 0x7f5c4c1353b0 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient(hunting): picked mon.noname-h con 0x7f5c4c135870 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient(hunting): picked mon.noname-d con 0x7f5c4c13bdf0 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c133c40 con 0x7f5c4c1353b0 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c1caed0 con 0x7f5c4c135870 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c4c09f470 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient(hunting): authenticate will time out at 2206.789735s 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c51caf640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f5c4c13bdf0 0x7f5c4c1d23f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33842/0 (socket says 172.21.15.106:33842) 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c51caf640 1 -- 172.21.15.106:0/473850120 learned_addr learned my addr 172.21.15.106:0/473850120 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 683798451 0 0) 0x7f5c4c09f470 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.245 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): my global_id is 254922 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c30003530 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2085356751 0 0) 0x7f5c30003530 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5c4c09f470 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c44001d50 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): dump: 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.246 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674878127 0 0) 0x7f5c4c1caed0 con 0x7f5c4c135870 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.247 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): my global_id is 254885 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c30003530 con 0x7f5c4c135870 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 933961202 0 0) 0x7f5c4c06f2d0 con 0x7f5c4c1353b0 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient(hunting): my global_id is 294238 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c4c1caed0 con 0x7f5c4c1353b0 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2691517155 0 0) 0x7f5c4c09f470 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 >> v1:172.21.15.171:6791/0 conn(0x7f5c4c135870 legacy=0x7f5c4c1ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 >> v1:172.21.15.171:6789/0 conn(0x7f5c4c1353b0 legacy=0x7f5c4c1ca0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.248 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 monclient: found mon.d 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c4c09f930 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 5 monclient: authenticate success, global_id 254922 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: _renew_subs 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5c4c1321f0 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: _renew_subs 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f5c4c134eb0 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5c44003cd0 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f5c44004240 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c437fe640 4 set_mon_vals no callback set 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 10 monclient: dump: 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.250 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f5c2c000f90 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f5c44004460 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.262+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f5c44045580 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.266+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6800/858572474 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c30045540 con 0x7f5c30041870 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.266+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (unknown 3755836717 0 0) 0x7f5c44045910 con 0x7f5c4c13bdf0 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.266+0000 7f5c41ffb640 10 monclient: handle_get_version_reply finishing 1 version 256 2024-04-26T00:15:51.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.266+0000 7f5c514ae640 10 monclient: get_auth_request con 0x7f5c30037a20 auth_method 0 2024-04-26T00:15:51.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.266+0000 7f5c50cad640 10 monclient: get_auth_request con 0x7f5c30041870 auth_method 0 2024-04-26T00:15:51.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.266+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== osd.1 v1:172.21.15.106:6800/858572474 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f5c30045540 con 0x7f5c30041870 2024-04-26T00:15:51.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 --> v1:172.21.15.106:6800/858572474 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5c2c002cc0 con 0x7f5c30041870 2024-04-26T00:15:51.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c41ffb640 1 -- 172.21.15.106:0/473850120 <== osd.1 v1:172.21.15.106:6800/858572474 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f5c2c002cc0 con 0x7f5c30041870 2024-04-26T00:15:51.253 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:51.253 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T00:15:51.253 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 >> v1:172.21.15.106:6800/858572474 conn(0x7f5c30041870 legacy=0x7f5c30043cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 >> v1:172.21.15.171:6812/722422047 conn(0x7f5c30037a20 legacy=0x7f5c30039ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 10 monclient: shutdown 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 >> v1:172.21.15.106:6792/0 conn(0x7f5c4c13bdf0 legacy=0x7f5c4c1d23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c51caf640 1 -- 172.21.15.106:0/473850120 reap_dead start 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 shutdown_connections 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 >> 172.21.15.106:0/473850120 conn(0x7f5c4c0a64e0 msgr2=0x7f5c4c0a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 shutdown_connections 2024-04-26T00:15:51.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.278+0000 7f5c53712640 1 -- 172.21.15.106:0/473850120 wait complete. 2024-04-26T00:15:51.267 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: get_monmap_and_config 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: monmap: 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:51.410433+0000 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:51.410433+0000 2024-04-26T00:15:51.381 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 Processor -- start 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- start start 2024-04-26T00:15:51.382 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: init 2024-04-26T00:15:51.388 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: _add_conns ranks=[4,3,8,7,5,2,1,6,0] 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient(hunting): picked mon.noname-c con 0x7f24700a03b0 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient(hunting): picked mon.noname-g con 0x7f24700a0ea0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient(hunting): picked mon.noname-e con 0x7f247009fd70 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24700a01e0 con 0x7f24700a0ea0 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247009ed80 con 0x7f24700a03b0 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247006b9b0 con 0x7f247009fd70 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient(hunting): authenticate will time out at 2206.937536s 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246f7fe640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f24700a03b0 0x7f24700a0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53780/0 (socket says 172.21.15.106:53780) 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246f7fe640 1 -- 172.21.15.106:0/3503385679 learned_addr learned my addr 172.21.15.106:0/3503385679 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3395553238 0 0) 0x7f247006b9b0 con 0x7f247009fd70 2024-04-26T00:15:51.389 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): my global_id is 294227 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2458003530 con 0x7f247009fd70 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657303168 0 0) 0x7f24680014a0 con 0x7f24700a03b0 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient(hunting): my global_id is 274801 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f247006b9b0 con 0x7f24700a03b0 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4282686154 0 0) 0x7f2458003530 con 0x7f247009fd70 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 >> v1:172.21.15.106:6791/0 conn(0x7f24700a03b0 legacy=0x7f24700a0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 >> v1:172.21.15.171:6790/0 conn(0x7f24700a0ea0 legacy=0x7f247013ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.390 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 monclient: found mon.noname-e 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247009eaa0 con 0x7f247009fd70 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24600017c0 con 0x7f247009fd70 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 5 monclient: authenticate success, global_id 294227 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: dump: 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.391 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2460001a30 con 0x7f247009fd70 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.392 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 4 set_mon_vals no callback set 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 1 -- 172.21.15.106:0/3503385679 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2460003960 con 0x7f247009fd70 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f246e7fc640 10 monclient: dump: 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.393 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: shutdown 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- 172.21.15.106:0/3503385679 >> v1:172.21.15.106:6793/0 conn(0x7f247009fd70 legacy=0x7f2470140180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- 172.21.15.106:0/3503385679 shutdown_connections 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- 172.21.15.106:0/3503385679 >> 172.21.15.106:0/3503385679 conn(0x7f24700a6fe0 msgr2=0x7f24700a73f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- 172.21.15.106:0/3503385679 shutdown_connections 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 1 -- 172.21.15.106:0/3503385679 wait complete. 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.394 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.410+0000 7f24760e3640 10 monclient: monmap: 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.395 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 Processor -- start 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 -- start start 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: init 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _add_conns ranks=[2,6,4,0,8,1,5,3,7] 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient(hunting): picked mon.noname-b con 0x7f247009fd70 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient(hunting): picked mon.noname-d con 0x7f24700a03b0 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient(hunting): picked mon.noname-c con 0x7f24700a0ea0 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f247013ffa0 con 0x7f247009fd70 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24701cd5b0 con 0x7f24700a0ea0 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2470072600 con 0x7f24700a03b0 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient(hunting): authenticate will time out at 2206.940558s 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f246f7fe640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f247009fd70 0x7f24701cc790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:48222/0 (socket says 172.21.15.106:48222) 2024-04-26T00:15:51.396 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f246f7fe640 1 -- 172.21.15.106:0/1715148180 learned_addr learned my addr 172.21.15.106:0/1715148180 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f246ffff640 1 --1- 172.21.15.106:0/1715148180 >> v1:172.21.15.106:6791/0 conn(0x7f24700a0ea0 0x7f24701d49f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53788/0 (socket says 172.21.15.106:53788) 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 508241006 0 0) 0x7f24701cd5b0 con 0x7f24700a0ea0 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): my global_id is 274810 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f245c003530 con 0x7f24700a0ea0 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2819601647 0 0) 0x7f2470072600 con 0x7f24700a03b0 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): my global_id is 254931 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f24701cd5b0 con 0x7f24700a03b0 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1536318237 0 0) 0x7f247013ffa0 con 0x7f247009fd70 2024-04-26T00:15:51.397 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): my global_id is 294230 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2470072600 con 0x7f247009fd70 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 395107676 0 0) 0x7f245c003530 con 0x7f24700a0ea0 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f247013ffa0 con 0x7f24700a0ea0 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2606878340 0 0) 0x7f2470072600 con 0x7f247009fd70 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f245c003530 con 0x7f247009fd70 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2698961960 0 0) 0x7f24701cd5b0 con 0x7f24700a03b0 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2470072600 con 0x7f24700a03b0 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2460003940 con 0x7f24700a0ea0 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.398 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): dump: 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.399 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f24680019c0 con 0x7f247009fd70 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): dump: 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.400 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2464001900 con 0x7f24700a03b0 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient(hunting): dump: 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.401 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1362589170 0 0) 0x7f245c003530 con 0x7f247009fd70 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 >> v1:172.21.15.106:6792/0 conn(0x7f24700a03b0 legacy=0x7f24701ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 >> v1:172.21.15.106:6791/0 conn(0x7f24700a0ea0 legacy=0x7f24701d49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 monclient: found mon.b 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:51.402 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247009e150 con 0x7f247009fd70 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 5 monclient: authenticate success, global_id 294230 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _renew_subs 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f247013fcc0 con 0x7f247009fd70 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _renew_subs 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2468004e20 con 0x7f247009fd70 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f24701408f0 con 0x7f247009fd70 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f2468001ba0 con 0x7f247009fd70 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.403 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 10 monclient: dump: 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.404 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f246dffb640 4 set_mon_vals no callback set 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.106:6790/0 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.106:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2470140b80 con 0x7f247009fd70 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f246800ff10 con 0x7f247009fd70 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f2468045460 con 0x7f247009fd70 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.414+0000 7f246effd640 10 monclient: get_auth_request con 0x7f245c038130 auth_method 0 2024-04-26T00:15:51.405 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.418+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mon.2 v1:172.21.15.106:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f247009ed80 con 0x7f247009fd70 2024-04-26T00:15:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.418+0000 7f2457fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:51.406 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.418+0000 7f2457fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:51.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.578+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f247013dcb0 con 0x7f245c038130 2024-04-26T00:15:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.578+0000 7f2457fff640 1 -- 172.21.15.106:0/1715148180 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f247013dcb0 con 0x7f245c038130 2024-04-26T00:15:51.552 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 1 to deep-scrub 2024-04-26T00:15:51.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 >> v1:172.21.15.171:6812/722422047 conn(0x7f245c038130 legacy=0x7f245c03a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 10 monclient: shutdown 2024-04-26T00:15:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 >> v1:172.21.15.106:6790/0 conn(0x7f247009fd70 legacy=0x7f24701cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 shutdown_connections 2024-04-26T00:15:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 >> 172.21.15.106:0/1715148180 conn(0x7f24700a6fe0 msgr2=0x7f24700a5270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 shutdown_connections 2024-04-26T00:15:51.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.582+0000 7f24760e3640 1 -- 172.21.15.106:0/1715148180 wait complete. 2024-04-26T00:15:51.570 INFO:tasks.ceph:Scrubbing osd.2 2024-04-26T00:15:51.571 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-26T00:15:51.700 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: get_monmap_and_config 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: monmap: 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:51.730440+0000 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:51.730440+0000 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.701 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.702 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.702 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.702 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.702 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.702 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 Processor -- start 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- start start 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: init 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: _add_conns ranks=[5,6,8,4,3,7,1,0,2] 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient(hunting): picked mon.noname-h con 0x7fc2dc13c0e0 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient(hunting): picked mon.noname-d con 0x7fc2dc0a5830 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient(hunting): picked mon.noname-e con 0x7fc2dc142710 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc06dd40 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc13cbd0 con 0x7fc2dc0a5830 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc0a6600 con 0x7fc2dc142710 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.712 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient(hunting): authenticate will time out at 2207.257611s 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e0f20640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7fc2dc0a5830 0x7fc2dc140ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33854/0 (socket says 172.21.15.106:33854) 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e0f20640 1 -- 172.21.15.106:0/3522725768 learned_addr learned my addr 172.21.15.106:0/3522725768 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e1f22640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7fc2dc142710 0x7fc2dc144b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49562/0 (socket says 172.21.15.106:49562) 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 526999128 0 0) 0x7fc2dc13cbd0 con 0x7fc2dc0a5830 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): my global_id is 254940 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2c8003530 con 0x7fc2dc0a5830 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002170817 0 0) 0x7fc2dc0a6600 con 0x7fc2dc142710 2024-04-26T00:15:51.713 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient(hunting): my global_id is 294236 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2dc13cbd0 con 0x7fc2dc142710 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2505882916 0 0) 0x7fc2c8003530 con 0x7fc2dc0a5830 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 >> v1:172.21.15.106:6793/0 conn(0x7fc2dc142710 legacy=0x7fc2dc144b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 >> v1:172.21.15.171:6791/0 conn(0x7fc2dc13c0e0 legacy=0x7fc2dc13c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 monclient: found mon.noname-d 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc0a1550 con 0x7fc2dc0a5830 2024-04-26T00:15:51.714 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2d00017c0 con 0x7fc2dc0a5830 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 5 monclient: authenticate success, global_id 254940 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: dump: 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.715 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc2d0001aa0 con 0x7fc2dc0a5830 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 1 -- 172.21.15.106:0/3522725768 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2d0004bf0 con 0x7fc2dc0a5830 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 4 set_mon_vals no callback set 2024-04-26T00:15:51.716 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2cffff640 10 monclient: dump: 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.717 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: shutdown 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- 172.21.15.106:0/3522725768 >> v1:172.21.15.106:6792/0 conn(0x7fc2dc0a5830 legacy=0x7fc2dc140ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- 172.21.15.106:0/3522725768 shutdown_connections 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- 172.21.15.106:0/3522725768 >> 172.21.15.106:0/3522725768 conn(0x7fc2dc0a9e20 msgr2=0x7fc2dc0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- 172.21.15.106:0/3522725768 shutdown_connections 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 1 -- 172.21.15.106:0/3522725768 wait complete. 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.730+0000 7fc2e3985640 10 monclient: monmap: 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.718 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.719 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 Processor -- start 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 -- start start 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: init 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: _add_conns ranks=[7,5,3,0,8,2,4,1,6] 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient(hunting): picked mon.noname-i con 0x7fc2dc0a5830 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient(hunting): picked mon.noname-h con 0x7fc2dc13c0e0 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient(hunting): picked mon.noname-g con 0x7fc2dc142710 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc13f6f0 con 0x7fc2dc142710 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc13dbe0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2dc0a0a90 con 0x7fc2dc0a5830 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient(hunting): authenticate will time out at 2207.260648s 2024-04-26T00:15:51.720 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e1721640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7fc2dc0a5830 0x7fc2dc13cdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:59082/0 (socket says 172.21.15.106:59082) 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e1721640 1 -- 172.21.15.106:0/860612529 learned_addr learned my addr 172.21.15.106:0/860612529 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1013826514 0 0) 0x7fc2dc13f6f0 con 0x7fc2dc142710 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): my global_id is 294267 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2c0003530 con 0x7fc2dc142710 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674892103 0 0) 0x7fc2dc0a0a90 con 0x7fc2dc0a5830 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.721 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): my global_id is 147184 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2dc13f6f0 con 0x7fc2dc0a5830 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1286976423 0 0) 0x7fc2dc13dbe0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): my global_id is 254903 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2dc0a0a90 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1407763472 0 0) 0x7fc2dc0a0a90 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2dc13dbe0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2d0004b30 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.722 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): dump: 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.723 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3846339023 0 0) 0x7fc2c0003530 con 0x7fc2dc142710 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2dc0a0a90 con 0x7fc2dc142710 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.7 v1:172.21.15.171:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1590420067 0 0) 0x7fc2dc13f6f0 con 0x7fc2dc0a5830 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc2c0003530 con 0x7fc2dc0a5830 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2d4001800 con 0x7fc2dc142710 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): dump: 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.724 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.725 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.7 v1:172.21.15.171:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2d8001d60 con 0x7fc2dc0a5830 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient(hunting): dump: 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.726 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1455233936 0 0) 0x7fc2dc13dbe0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 >> v1:172.21.15.171:6792/0 conn(0x7fc2dc0a5830 legacy=0x7fc2dc13cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 >> v1:172.21.15.171:6790/0 conn(0x7fc2dc142710 legacy=0x7fc2dc1d8de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 monclient: found mon.h 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2dc0716b0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.727 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 5 monclient: authenticate success, global_id 254903 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: _renew_subs 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc2dc13eeb0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: _renew_subs 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc2dc070cb0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc2d0000ff0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cf7fe640 4 set_mon_vals no callback set 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7fc2d00051f0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-04-26T00:15:51.728 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2cdffb640 10 monclient: dump: 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.729 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.171:6791/0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.734+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.171:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc2bc000f90 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7fc2d000ff90 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7fc2d0045010 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.106:6801/2648645857 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc2c0045db0 con 0x7fc2c00420e0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== mon.5 v1:172.21.15.171:6791/0 9 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (unknown 3755836717 0 0) 0x7fc2d00453f0 con 0x7fc2dc13c0e0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2cdffb640 10 monclient: handle_get_version_reply finishing 1 version 256 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2e1721640 10 monclient: get_auth_request con 0x7fc2c0038290 auth_method 0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2e1f22640 10 monclient: get_auth_request con 0x7fc2c00420e0 auth_method 0 2024-04-26T00:15:51.730 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.738+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== osd.2 v1:172.21.15.106:6801/2648645857 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fc2c0045db0 con 0x7fc2c00420e0 2024-04-26T00:15:51.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 --> v1:172.21.15.106:6801/2648645857 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc2bc002cc0 con 0x7fc2c00420e0 2024-04-26T00:15:51.731 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2cdffb640 1 -- 172.21.15.106:0/860612529 <== osd.2 v1:172.21.15.106:6801/2648645857 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc2bc002cc0 con 0x7fc2c00420e0 2024-04-26T00:15:51.731 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:51.731 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T00:15:51.731 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:51.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 >> v1:172.21.15.106:6801/2648645857 conn(0x7fc2c00420e0 legacy=0x7fc2c0044540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 >> v1:172.21.15.171:6812/722422047 conn(0x7fc2c0038290 legacy=0x7fc2c003a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 10 monclient: shutdown 2024-04-26T00:15:51.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.732 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 >> v1:172.21.15.171:6791/0 conn(0x7fc2dc13c0e0 legacy=0x7fc2dc13d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e1f22640 1 -- 172.21.15.106:0/860612529 reap_dead start 2024-04-26T00:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 shutdown_connections 2024-04-26T00:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 >> 172.21.15.106:0/860612529 conn(0x7fc2dc0a9e20 msgr2=0x7fc2dc067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 shutdown_connections 2024-04-26T00:15:51.733 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.750+0000 7fc2e3985640 1 -- 172.21.15.106:0/860612529 wait complete. 2024-04-26T00:15:51.740 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.878+0000 7f0113547640 10 monclient: get_monmap_and_config 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.878+0000 7f0113547640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.878+0000 7f0113547640 10 monclient: monmap: 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:51.881007+0000 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:51.881007+0000 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.852 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.853 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.878+0000 7f0113547640 1 Processor -- start 2024-04-26T00:15:51.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.878+0000 7f0113547640 1 -- start start 2024-04-26T00:15:51.854 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.878+0000 7f0113547640 10 monclient: init 2024-04-26T00:15:51.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: _add_conns ranks=[5,8,3,6,7,4,0,1,2] 2024-04-26T00:15:51.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): picked mon.noname-h con 0x7f010c134970 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:51.861 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): picked mon.noname-e con 0x7f010c0a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): picked mon.noname-g con 0x7f010c13e200 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c06dd40 con 0x7f010c13e200 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c0a2b10 con 0x7f010c134970 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c0a2df0 con 0x7f010c0a4820 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): authenticate will time out at 2207.408257s 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0110ae2640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f010c0a4820 0x7f010c13cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49564/0 (socket says 172.21.15.106:49564) 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0110ae2640 1 -- 172.21.15.106:0/628000419 learned_addr learned my addr 172.21.15.106:0/628000419 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014582585 0 0) 0x7f010c0a2df0 con 0x7f010c0a4820 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.862 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient(hunting): my global_id is 294245 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00f8003530 con 0x7f010c0a4820 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1173945195 0 0) 0x7f00f8003530 con 0x7f010c0a4820 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 >> v1:172.21.15.171:6791/0 conn(0x7f010c134970 legacy=0x7f010c134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 >> v1:172.21.15.171:6790/0 conn(0x7f010c13e200 legacy=0x7f010c1405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 monclient: found mon.noname-e 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c0a30d0 con 0x7f010c0a4820 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00fc0017c0 con 0x7f010c0a4820 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 5 monclient: authenticate success, global_id 294245 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.863 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: dump: 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.864 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00fc001ab0 con 0x7f010c0a4820 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 1 -- 172.21.15.106:0/628000419 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00fc004bf0 con 0x7f010c0a4820 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0103fff640 10 monclient: dump: 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.865 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 4 set_mon_vals no callback set 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: shutdown 2024-04-26T00:15:51.866 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- 172.21.15.106:0/628000419 >> v1:172.21.15.106:6793/0 conn(0x7f010c0a4820 legacy=0x7f010c13cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- 172.21.15.106:0/628000419 shutdown_connections 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- 172.21.15.106:0/628000419 >> 172.21.15.106:0/628000419 conn(0x7f010c0a9e20 msgr2=0x7f010c0aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- 172.21.15.106:0/628000419 shutdown_connections 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- 172.21.15.106:0/628000419 wait complete. 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: build_initial_monmap 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: monmap: 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:51.867 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 Processor -- start 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- start start 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: init 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient: _add_conns ranks=[0,4,7,6,3,2,8,5,1] 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): picked mon.noname-a con 0x7f010c0a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:51.868 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): picked mon.noname-c con 0x7f010c134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): picked mon.noname-i con 0x7f010c13e200 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c09eea0 con 0x7f010c0a4820 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c09e490 con 0x7f010c134970 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f010c09e1b0 con 0x7f010c13e200 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0113547640 10 monclient(hunting): authenticate will time out at 2207.411238s 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0110ae2640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f010c134970 0x7f010c12a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53790/0 (socket says 172.21.15.106:53790) 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0110ae2640 1 -- 172.21.15.106:0/1294999285 learned_addr learned my addr 172.21.15.106:0/1294999285 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3730235037 0 0) 0x7f010c09e490 con 0x7f010c134970 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): my global_id is 274819 2024-04-26T00:15:51.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f00f0003530 con 0x7f010c134970 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1334318232 0 0) 0x7f010c09eea0 con 0x7f010c0a4820 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): my global_id is 274743 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f010c09e490 con 0x7f010c0a4820 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 500293643 0 0) 0x7f010c09e1b0 con 0x7f010c13e200 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): my global_id is 147193 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f010c09eea0 con 0x7f010c13e200 2024-04-26T00:15:51.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1041771171 0 0) 0x7f00f0003530 con 0x7f010c134970 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f010c09e1b0 con 0x7f010c134970 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00fc001780 con 0x7f010c134970 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): dump: 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.871 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 54909950 0 0) 0x7f010c09e490 con 0x7f010c0a4820 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f00f0003530 con 0x7f010c0a4820 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f01080019a0 con 0x7f010c0a4820 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.882+0000 7f0101ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient(hunting): dump: 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.872 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1948971556 0 0) 0x7f010c09e1b0 con 0x7f010c134970 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 >> v1:172.21.15.171:6792/0 conn(0x7f010c13e200 legacy=0x7f010c1d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 >> v1:172.21.15.106:6789/0 conn(0x7f010c0a4820 legacy=0x7f010c09c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 monclient: found mon.c 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f010c09d8f0 con 0x7f010c134970 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: _finish_auth 0 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 5 monclient: authenticate success, global_id 274819 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 10 monclient: _renew_subs 2024-04-26T00:15:51.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f010c09b9b0 con 0x7f010c134970 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 10 monclient: _renew_subs 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f010c12ae80 con 0x7f010c134970 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00fc004c30 con 0x7f010c134970 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f00fc001c60 con 0x7f010c134970 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f01037fe640 4 set_mon_vals no callback set 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 10 monclient: dump: 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:51.875 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f00fc0100f0 con 0x7f010c134970 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:51.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:51.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f010c067160 con 0x7f010c134970 2024-04-26T00:15:51.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f00fc045240 con 0x7f010c134970 2024-04-26T00:15:51.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.886+0000 7f01112e3640 10 monclient: get_auth_request con 0x7f00f0038010 auth_method 0 2024-04-26T00:15:51.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.890+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f00fc0158d0 con 0x7f010c134970 2024-04-26T00:15:51.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.890+0000 7f0101ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:51.877 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:51.890+0000 7f0101ffb640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:52.027 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.054+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f010c062e50 con 0x7f00f0038010 2024-04-26T00:15:52.028 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.054+0000 7f0101ffb640 1 -- 172.21.15.106:0/1294999285 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f010c062e50 con 0x7f00f0038010 2024-04-26T00:15:52.028 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 2 to deep-scrub 2024-04-26T00:15:52.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 >> v1:172.21.15.171:6812/722422047 conn(0x7f00f0038010 legacy=0x7f00f003a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 10 monclient: shutdown 2024-04-26T00:15:52.030 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 >> v1:172.21.15.106:6791/0 conn(0x7f010c134970 legacy=0x7f010c12a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 shutdown_connections 2024-04-26T00:15:52.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 >> 172.21.15.106:0/1294999285 conn(0x7f010c0a9e20 msgr2=0x7f010c067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 shutdown_connections 2024-04-26T00:15:52.031 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.058+0000 7f0113547640 1 -- 172.21.15.106:0/1294999285 wait complete. 2024-04-26T00:15:52.046 INFO:tasks.ceph:Scrubbing osd.3 2024-04-26T00:15:52.047 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-26T00:15:52.164 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: get_monmap_and_config 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: monmap: 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:52.194530+0000 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:52.194530+0000 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.165 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.166 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 Processor -- start 2024-04-26T00:15:52.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- start start 2024-04-26T00:15:52.169 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: init 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: _add_conns ranks=[6,5,0,4,3,1,2,8,7] 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient(hunting): picked mon.noname-d con 0x7f66e0134970 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient(hunting): picked mon.noname-h con 0x7f66e00a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient(hunting): picked mon.noname-a con 0x7f66e013e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e006dd40 con 0x7f66e013e200 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e00a2b10 con 0x7f66e00a4820 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e00a2df0 con 0x7f66e0134970 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient(hunting): authenticate will time out at 2207.721710s 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ded9d640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f66e0134970 0x7f66e0134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33860/0 (socket says 172.21.15.106:33860) 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ded9d640 1 -- 172.21.15.106:0/131175934 learned_addr learned my addr 172.21.15.106:0/131175934 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3254591559 0 0) 0x7f66e00a2df0 con 0x7f66e0134970 2024-04-26T00:15:52.170 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): my global_id is 254949 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66cc003530 con 0x7f66e0134970 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1124121106 0 0) 0x7f66e006dd40 con 0x7f66e013e200 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient(hunting): my global_id is 274752 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e00a2df0 con 0x7f66e013e200 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 231158323 0 0) 0x7f66cc003530 con 0x7f66e0134970 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 >> v1:172.21.15.171:6791/0 conn(0x7f66e00a4820 legacy=0x7f66e013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 >> v1:172.21.15.106:6789/0 conn(0x7f66e013e200 legacy=0x7f66e01405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.171 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 monclient: found mon.noname-d 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e00a30d0 con 0x7f66e0134970 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 5 monclient: authenticate success, global_id 254949 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66d80017c0 con 0x7f66e0134970 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: dump: 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.172 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.173 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66d8001a20 con 0x7f66e0134970 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:52.174 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 4 set_mon_vals no callback set 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 1 -- 172.21.15.106:0/131175934 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66d8004bf0 con 0x7f66e0134970 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66ddd9b640 10 monclient: dump: 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.175 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 10 monclient: shutdown 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- 172.21.15.106:0/131175934 >> v1:172.21.15.106:6792/0 conn(0x7f66e0134970 legacy=0x7f66e0134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- 172.21.15.106:0/131175934 shutdown_connections 2024-04-26T00:15:52.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- 172.21.15.106:0/131175934 >> 172.21.15.106:0/131175934 conn(0x7f66e00a9e20 msgr2=0x7f66e00aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- 172.21.15.106:0/131175934 shutdown_connections 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.194+0000 7f66e50ea640 1 -- 172.21.15.106:0/131175934 wait complete. 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: monmap: 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.177 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 Processor -- start 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 -- start start 2024-04-26T00:15:52.178 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: init 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: _add_conns ranks=[4,8,0,1,2,5,3,6,7] 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient(hunting): picked mon.noname-c con 0x7f66e00a4820 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient(hunting): picked mon.noname-e con 0x7f66e0134970 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient(hunting): picked mon.noname-a con 0x7f66e013e200 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e00a1e00 con 0x7f66e013e200 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e009ca30 con 0x7f66e00a4820 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66e009de10 con 0x7f66e0134970 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient(hunting): authenticate will time out at 2207.725989s 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66ded9d640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f66e00a4820 0x7f66e012a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53796/0 (socket says 172.21.15.106:53796) 2024-04-26T00:15:52.182 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66ded9d640 1 -- 172.21.15.106:0/2830922884 learned_addr learned my addr 172.21.15.106:0/2830922884 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361922400 0 0) 0x7f66e00a1e00 con 0x7f66e013e200 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): my global_id is 274761 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66c0003530 con 0x7f66e013e200 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2558095929 0 0) 0x7f66e009de10 con 0x7f66e0134970 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): my global_id is 294254 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e00a1e00 con 0x7f66e0134970 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506732561 0 0) 0x7f66e009ca30 con 0x7f66e00a4820 2024-04-26T00:15:52.183 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): my global_id is 274828 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66e009de10 con 0x7f66e00a4820 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2432187223 0 0) 0x7f66c0003530 con 0x7f66e013e200 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66e009ca30 con 0x7f66e013e200 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66d0001d00 con 0x7f66e013e200 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): dump: 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.184 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.185 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2556382482 0 0) 0x7f66e00a1e00 con 0x7f66e0134970 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66c0003530 con 0x7f66e0134970 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66c80019e0 con 0x7f66e0134970 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): dump: 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.186 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4145840354 0 0) 0x7f66e009de10 con 0x7f66e00a4820 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66e00a1e00 con 0x7f66e00a4820 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66d80016c0 con 0x7f66e00a4820 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient(hunting): dump: 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.188 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1523389060 0 0) 0x7f66e009ca30 con 0x7f66e013e200 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 >> v1:172.21.15.106:6793/0 conn(0x7f66e0134970 legacy=0x7f66e01d1920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 >> v1:172.21.15.106:6791/0 conn(0x7f66e00a4820 legacy=0x7f66e012a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 monclient: found mon.a 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66e009f090 con 0x7f66e013e200 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 5 monclient: authenticate success, global_id 274761 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: _renew_subs 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f66e009ceb0 con 0x7f66e013e200 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: _renew_subs 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f66e009bb80 con 0x7f66e013e200 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f66d0002030 con 0x7f66e013e200 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f66d0003f90 con 0x7f66e013e200 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66dd59a640 4 set_mon_vals no callback set 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66d77fe640 10 monclient: dump: 2024-04-26T00:15:52.190 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.198+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.106:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f66c4000f90 con 0x7f66e013e200 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f66d00041b0 con 0x7f66e013e200 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f66d0044190 con 0x7f66e013e200 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.171:6808/2707846597 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66c0045cb0 con 0x7f66c0041fe0 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (unknown 3755836717 0 0) 0x7f66d00445a0 con 0x7f66e013e200 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66d77fe640 10 monclient: handle_get_version_reply finishing 1 version 256 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66ded9d640 10 monclient: get_auth_request con 0x7f66c0038190 auth_method 0 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66de59c640 10 monclient: get_auth_request con 0x7f66c0041fe0 auth_method 0 2024-04-26T00:15:52.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.202+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== osd.3 v1:172.21.15.171:6808/2707846597 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f66c0045cb0 con 0x7f66c0041fe0 2024-04-26T00:15:52.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 --> v1:172.21.15.171:6808/2707846597 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66c4002cc0 con 0x7f66c0041fe0 2024-04-26T00:15:52.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66d77fe640 1 -- 172.21.15.106:0/2830922884 <== osd.3 v1:172.21.15.171:6808/2707846597 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f66c4002cc0 con 0x7f66c0041fe0 2024-04-26T00:15:52.193 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:52.193 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T00:15:52.193 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:52.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 >> v1:172.21.15.171:6808/2707846597 conn(0x7f66c0041fe0 legacy=0x7f66c0044440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 >> v1:172.21.15.171:6812/722422047 conn(0x7f66c0038190 legacy=0x7f66c003a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 10 monclient: shutdown 2024-04-26T00:15:52.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 >> v1:172.21.15.106:6789/0 conn(0x7f66e013e200 legacy=0x7f66e01d5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66df59e640 1 -- 172.21.15.106:0/2830922884 reap_dead start 2024-04-26T00:15:52.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 shutdown_connections 2024-04-26T00:15:52.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 >> 172.21.15.106:0/2830922884 conn(0x7f66e00a9e20 msgr2=0x7f66e0067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 shutdown_connections 2024-04-26T00:15:52.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.218+0000 7f66e50ea640 1 -- 172.21.15.106:0/2830922884 wait complete. 2024-04-26T00:15:52.205 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-26T00:15:52.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient: get_monmap_and_config 2024-04-26T00:15:52.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.317 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient: monmap: 2024-04-26T00:15:52.317 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.317 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.317 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:52.347025+0000 2024-04-26T00:15:52.317 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:52.347025+0000 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.318 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 1 Processor -- start 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 1 -- start start 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient: init 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient: _add_conns ranks=[7,5,1,4,6,0,2,8,3] 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient(hunting): picked mon.noname-i con 0x7f6f90134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient(hunting): picked mon.noname-h con 0x7f6f900a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:52.326 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient(hunting): picked mon.noname-f con 0x7f6f9013e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9006dd40 con 0x7f6f9013e200 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f900a2b10 con 0x7f6f900a4820 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f900a2df0 con 0x7f6f90134970 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f96c7d640 10 monclient(hunting): authenticate will time out at 2207.874652s 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f9521a640 1 --1- >> v1:172.21.15.171:6789/0 conn(0x7f6f9013e200 0x7f6f901405f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6789/0 says I am v1:172.21.15.106:34086/0 (socket says 172.21.15.106:34086) 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f94a19640 1 --1- >> v1:172.21.15.171:6792/0 conn(0x7f6f90134970 0x7f6f90134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.171:6792/0 says I am v1:172.21.15.106:59098/0 (socket says 172.21.15.106:59098) 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f9521a640 1 -- 172.21.15.106:0/1144937475 learned_addr learned my addr 172.21.15.106:0/1144937475 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3184963931 0 0) 0x7f6f900a2b10 con 0x7f6f900a4820 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): my global_id is 254930 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f80003530 con 0x7f6f900a4820 2024-04-26T00:15:52.327 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1077583079 0 0) 0x7f6f9006dd40 con 0x7f6f9013e200 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): my global_id is 294247 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f900a2b10 con 0x7f6f9013e200 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 120390753 0 0) 0x7f6f900a2df0 con 0x7f6f90134970 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 10 monclient(hunting): my global_id is 147202 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.346+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9006dd40 con 0x7f6f90134970 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 540720911 0 0) 0x7f6f900a2b10 con 0x7f6f9013e200 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 >> v1:172.21.15.171:6792/0 conn(0x7f6f90134970 legacy=0x7f6f90134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 >> v1:172.21.15.171:6791/0 conn(0x7f6f900a4820 legacy=0x7f6f9013cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.328 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 monclient: found mon.noname-f 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.171:6789/0 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 --> v1:172.21.15.171:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f900a30d0 con 0x7f6f9013e200 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 5 monclient: authenticate success, global_id 294247 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f88001b20 con 0x7f6f9013e200 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: dump: 2024-04-26T00:15:52.329 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.330 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.330 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.330 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.330 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.330 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.330 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 <== mon.1 v1:172.21.15.171:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f88001e10 con 0x7f6f9013e200 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 4 set_mon_vals no callback set 2024-04-26T00:15:52.331 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 1 -- 172.21.15.106:0/1144937475 <== mon.1 v1:172.21.15.171:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f88004f70 con 0x7f6f9013e200 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8f7fe640 10 monclient: dump: 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.332 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: shutdown 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- 172.21.15.106:0/1144937475 >> v1:172.21.15.171:6789/0 conn(0x7f6f9013e200 legacy=0x7f6f901405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- 172.21.15.106:0/1144937475 shutdown_connections 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- 172.21.15.106:0/1144937475 >> 172.21.15.106:0/1144937475 conn(0x7f6f900a9e20 msgr2=0x7f6f900aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- 172.21.15.106:0/1144937475 shutdown_connections 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- 172.21.15.106:0/1144937475 wait complete. 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.333 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: monmap: 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.334 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 Processor -- start 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- start start 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: init 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: _add_conns ranks=[1,4,8,6,7,2,0,5,3] 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient(hunting): picked mon.noname-f con 0x7f6f900a4820 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient(hunting): picked mon.noname-c con 0x7f6f90134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient(hunting): picked mon.noname-e con 0x7f6f9013e200 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f901396d0 con 0x7f6f900a4820 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f900a1a40 con 0x7f6f90134970 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f9013b810 con 0x7f6f9013e200 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.335 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient(hunting): authenticate will time out at 2207.878428s 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8ffff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f6f90134970 0x7f6f90138fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53808/0 (socket says 172.21.15.106:53808) 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8ffff640 1 -- 172.21.15.106:0/2912982051 learned_addr learned my addr 172.21.15.106:0/2912982051 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086254505 0 0) 0x7f6f900a1a40 con 0x7f6f90134970 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): my global_id is 274837 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f74003530 con 0x7f6f90134970 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2456828653 0 0) 0x7f6f9013b810 con 0x7f6f9013e200 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): my global_id is 294263 2024-04-26T00:15:52.336 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f900a1a40 con 0x7f6f9013e200 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192997258 0 0) 0x7f6f901396d0 con 0x7f6f900a4820 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): my global_id is 294256 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6f9013b810 con 0x7f6f900a4820 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4277881444 0 0) 0x7f6f74003530 con 0x7f6f90134970 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f901396d0 con 0x7f6f90134970 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f7c001a80 con 0x7f6f90134970 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): dump: 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.337 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.338 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2087049702 0 0) 0x7f6f900a1a40 con 0x7f6f9013e200 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6f74003530 con 0x7f6f9013e200 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f88001ae0 con 0x7f6f9013e200 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.339 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient(hunting): dump: 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.340 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 771128398 0 0) 0x7f6f901396d0 con 0x7f6f90134970 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 >> v1:172.21.15.106:6793/0 conn(0x7f6f9013e200 legacy=0x7f6f901d45e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.341 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 >> v1:172.21.15.171:6789/0 conn(0x7f6f900a4820 legacy=0x7f6f901388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 monclient: found mon.c 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f9013baf0 con 0x7f6f90134970 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 5 monclient: authenticate success, global_id 274837 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: _renew_subs 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6f9013a920 con 0x7f6f90134970 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: _renew_subs 2024-04-26T00:15:52.342 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6f90139d70 con 0x7f6f90134970 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6f7c0038d0 con 0x7f6f90134970 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f6f7c003e40 con 0x7f6f90134970 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8effd640 4 set_mon_vals no callback set 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.350+0000 7f6f8d7fa640 10 monclient: dump: 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.343 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.354+0000 7f6f96c7d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.354+0000 7f6f96c7d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.354+0000 7f6f96c7d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.354+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f6f7c0040e0 con 0x7f6f90134970 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.354+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f70005090 con 0x7f6f90134970 2024-04-26T00:15:52.344 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.354+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f6f7c045210 con 0x7f6f90134970 2024-04-26T00:15:52.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.354+0000 7f6f94a19640 10 monclient: get_auth_request con 0x7f6f74037e40 auth_method 0 2024-04-26T00:15:52.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.358+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f6f7c015780 con 0x7f6f90134970 2024-04-26T00:15:52.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.358+0000 7f6f8d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:52.345 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.358+0000 7f6f8d7fa640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:52.491 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.518+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f6f70000ba0 con 0x7f6f74037e40 2024-04-26T00:15:52.492 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.518+0000 7f6f8d7fa640 1 -- 172.21.15.106:0/2912982051 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f6f70000ba0 con 0x7f6f74037e40 2024-04-26T00:15:52.492 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 3 to deep-scrub 2024-04-26T00:15:52.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 >> v1:172.21.15.171:6812/722422047 conn(0x7f6f74037e40 legacy=0x7f6f7403a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 10 monclient: shutdown 2024-04-26T00:15:52.494 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 >> v1:172.21.15.106:6791/0 conn(0x7f6f90134970 legacy=0x7f6f90138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 shutdown_connections 2024-04-26T00:15:52.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 >> 172.21.15.106:0/2912982051 conn(0x7f6f900a9e20 msgr2=0x7f6f90134f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 shutdown_connections 2024-04-26T00:15:52.495 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.522+0000 7f6f96c7d640 1 -- 172.21.15.106:0/2912982051 wait complete. 2024-04-26T00:15:52.511 INFO:tasks.ceph:Scrubbing osd.4 2024-04-26T00:15:52.511 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.654+0000 7f20cefb4640 10 monclient: get_monmap_and_config 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.654+0000 7f20cefb4640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.654+0000 7f20cefb4640 10 monclient: monmap: 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:52.657817+0000 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:52.657817+0000 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.628 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.629 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 Processor -- start 2024-04-26T00:15:52.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- start start 2024-04-26T00:15:52.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: init 2024-04-26T00:15:52.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: _add_conns ranks=[0,8,2,6,7,4,5,3,1] 2024-04-26T00:15:52.636 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): picked mon.noname-a con 0x7f20c8134970 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): picked mon.noname-e con 0x7f20c80a4820 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): picked mon.noname-b con 0x7f20c813e200 addr v1:172.21.15.106:6790/0 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c806dd40 con 0x7f20c8134970 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c80a2b10 con 0x7f20c813e200 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c80a2df0 con 0x7f20c80a4820 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): authenticate will time out at 2208.184914s 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20ccd50640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f20c8134970 0x7f20c8134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40850/0 (socket says 172.21.15.106:40850) 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20ccd50640 1 -- 172.21.15.106:0/777065346 learned_addr learned my addr 172.21.15.106:0/777065346 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2291164224 0 0) 0x7f20c80a2df0 con 0x7f20c80a4820 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): my global_id is 294272 2024-04-26T00:15:52.637 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20b8003530 con 0x7f20c80a4820 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1817122350 0 0) 0x7f20c806dd40 con 0x7f20c8134970 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): my global_id is 274770 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20c80a2df0 con 0x7f20c8134970 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463618869 0 0) 0x7f20c80a2b10 con 0x7f20c813e200 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient(hunting): my global_id is 294239 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20c806dd40 con 0x7f20c813e200 2024-04-26T00:15:52.638 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1315176954 0 0) 0x7f20b8003530 con 0x7f20c80a4820 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 >> v1:172.21.15.106:6790/0 conn(0x7f20c813e200 legacy=0x7f20c81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 >> v1:172.21.15.106:6789/0 conn(0x7f20c8134970 legacy=0x7f20c8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 monclient: found mon.noname-e 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c80a30d0 con 0x7f20c80a4820 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b40017c0 con 0x7f20c80a4820 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: dump: 2024-04-26T00:15:52.639 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.640 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 5 monclient: authenticate success, global_id 294272 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20b4001a70 con 0x7f20c80a4820 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 1 -- 172.21.15.106:0/777065346 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b4003960 con 0x7f20c80a4820 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 4 set_mon_vals no callback set 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20c77fe640 10 monclient: dump: 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.641 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: shutdown 2024-04-26T00:15:52.642 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- 172.21.15.106:0/777065346 >> v1:172.21.15.106:6793/0 conn(0x7f20c80a4820 legacy=0x7f20c813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- 172.21.15.106:0/777065346 shutdown_connections 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- 172.21.15.106:0/777065346 >> 172.21.15.106:0/777065346 conn(0x7f20c80a9e20 msgr2=0x7f20c80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- 172.21.15.106:0/777065346 shutdown_connections 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- 172.21.15.106:0/777065346 wait complete. 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: monmap: 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.643 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 Processor -- start 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- start start 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: init 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.644 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient: _add_conns ranks=[5,3,1,6,4,0,8,7,2] 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): picked mon.noname-h con 0x7f20c80a4820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): picked mon.noname-g con 0x7f20c8134970 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): picked mon.noname-f con 0x7f20c813e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c81396d0 con 0x7f20c813e200 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c8139ef0 con 0x7f20c8134970 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20c80a1a40 con 0x7f20c80a4820 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.658+0000 7f20cefb4640 10 monclient(hunting): authenticate will time out at 2208.187830s 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c7fff640 1 --1- >> v1:172.21.15.171:6790/0 conn(0x7f20c8134970 0x7f20c8138fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.171:6790/0 says I am v1:172.21.15.106:53798/0 (socket says 172.21.15.106:53798) 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c7fff640 1 -- 172.21.15.106:0/3478310040 learned_addr learned my addr 172.21.15.106:0/3478310040 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2573552925 0 0) 0x7f20c8139ef0 con 0x7f20c8134970 2024-04-26T00:15:52.645 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): my global_id is 294285 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20ac003530 con 0x7f20c8134970 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3435967158 0 0) 0x7f20c80a1a40 con 0x7f20c80a4820 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): my global_id is 254939 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20c8139ef0 con 0x7f20c80a4820 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3382162351 0 0) 0x7f20c81396d0 con 0x7f20c813e200 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.646 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): my global_id is 294265 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20c80a1a40 con 0x7f20c813e200 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3706445918 0 0) 0x7f20ac003530 con 0x7f20c8134970 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20c81396d0 con 0x7f20c8134970 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.5 v1:172.21.15.171:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3368790156 0 0) 0x7f20c8139ef0 con 0x7f20c80a4820 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20ac003530 con 0x7f20c80a4820 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b4001780 con 0x7f20c8134970 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): dump: 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.647 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.5 v1:172.21.15.171:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20bc001460 con 0x7f20c80a4820 2024-04-26T00:15:52.648 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): dump: 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.649 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.1 v1:172.21.15.171:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 506231055 0 0) 0x7f20c80a1a40 con 0x7f20c813e200 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f20c8139ef0 con 0x7f20c813e200 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.1 v1:172.21.15.171:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20c0001d00 con 0x7f20c813e200 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient(hunting): dump: 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.650 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2961658755 0 0) 0x7f20c81396d0 con 0x7f20c8134970 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 >> v1:172.21.15.171:6791/0 conn(0x7f20c80a4820 legacy=0x7f20c81388b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 >> v1:172.21.15.171:6789/0 conn(0x7f20c813e200 legacy=0x7f20c81d47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.651 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 monclient: found mon.g 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c80a1e00 con 0x7f20c8134970 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 5 monclient: authenticate success, global_id 294285 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 10 monclient: _renew_subs 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f20c813b920 con 0x7f20c8134970 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 10 monclient: _renew_subs 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:52.652 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f20c813b610 con 0x7f20c8134970 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f20b4001a70 con 0x7f20c8134970 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f20b4004040 con 0x7f20c8134970 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c6ffd640 4 set_mon_vals no callback set 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: dump: 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.653 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.171:6790/0 2024-04-26T00:15:52.654 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f20a8000f90 con 0x7f20c8134970 2024-04-26T00:15:52.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f20b40041e0 con 0x7f20c8134970 2024-04-26T00:15:52.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f20b4045210 con 0x7f20c8134970 2024-04-26T00:15:52.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6804/3736794137 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f20ac045be0 con 0x7f20ac041f10 2024-04-26T00:15:52.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== mon.3 v1:172.21.15.171:6790/0 9 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (unknown 3755836717 0 0) 0x7f20b4045570 con 0x7f20c8134970 2024-04-26T00:15:52.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20c57fa640 10 monclient: handle_get_version_reply finishing 1 version 256 2024-04-26T00:15:52.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20ccd50640 10 monclient: get_auth_request con 0x7f20ac0380c0 auth_method 0 2024-04-26T00:15:52.655 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.662+0000 7f20cd551640 10 monclient: get_auth_request con 0x7f20ac041f10 auth_method 0 2024-04-26T00:15:52.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.666+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== osd.4 v1:172.21.15.171:6804/3736794137 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f20ac045be0 con 0x7f20ac041f10 2024-04-26T00:15:52.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 --> v1:172.21.15.171:6804/3736794137 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f20a8002cc0 con 0x7f20ac041f10 2024-04-26T00:15:52.656 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20c57fa640 1 -- 172.21.15.106:0/3478310040 <== osd.4 v1:172.21.15.171:6804/3736794137 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f20a8002cc0 con 0x7f20ac041f10 2024-04-26T00:15:52.656 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:52.656 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T00:15:52.656 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 >> v1:172.21.15.171:6804/3736794137 conn(0x7f20ac041f10 legacy=0x7f20ac044370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 >> v1:172.21.15.171:6812/722422047 conn(0x7f20ac0380c0 legacy=0x7f20ac03a580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 10 monclient: shutdown 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 >> v1:172.21.15.171:6790/0 conn(0x7f20c8134970 legacy=0x7f20c8138fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cd551640 1 -- 172.21.15.106:0/3478310040 reap_dead start 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 shutdown_connections 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 >> 172.21.15.106:0/3478310040 conn(0x7f20c80a9e20 msgr2=0x7f20c8067370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 shutdown_connections 2024-04-26T00:15:52.657 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.678+0000 7f20cefb4640 1 -- 172.21.15.106:0/3478310040 wait complete. 2024-04-26T00:15:52.666 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-26T00:15:52.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.798+0000 7ff09c5f6640 10 monclient: get_monmap_and_config 2024-04-26T00:15:52.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.798+0000 7ff09c5f6640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.772 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.798+0000 7ff09c5f6640 10 monclient: monmap: 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:52.802281+0000 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:52.802281+0000 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.773 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 Processor -- start 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- start start 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient: init 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient: _add_conns ranks=[3,1,8,6,7,0,4,2,5] 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient(hunting): picked mon.noname-g con 0x7ff094137730 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient(hunting): picked mon.noname-f con 0x7ff0940a0b20 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient(hunting): picked mon.noname-e con 0x7ff094138220 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0940a2750 con 0x7ff0940a0b20 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0940a2a30 con 0x7ff094137730 2024-04-26T00:15:52.785 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0940a2d10 con 0x7ff094138220 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient(hunting): authenticate will time out at 2208.329972s 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09ab93640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7ff094138220 0x7ff094140400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49618/0 (socket says 172.21.15.106:49618) 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09ab93640 1 -- 172.21.15.106:0/743290897 learned_addr learned my addr 172.21.15.106:0/743290897 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360180494 0 0) 0x7ff0940a2d10 con 0x7ff094138220 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient(hunting): my global_id is 294281 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff080003530 con 0x7ff094138220 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 186246194 0 0) 0x7ff080003530 con 0x7ff094138220 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 >> v1:172.21.15.171:6790/0 conn(0x7ff094137730 legacy=0x7ff094137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.786 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 >> v1:172.21.15.171:6789/0 conn(0x7ff0940a0b20 legacy=0x7ff09413ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 monclient: found mon.noname-e 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0940a4680 con 0x7ff094138220 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff08c001b40 con 0x7ff094138220 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: dump: 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.787 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 5 monclient: authenticate success, global_id 294281 2024-04-26T00:15:52.788 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff08c001e30 con 0x7ff094138220 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 1 -- 172.21.15.106:0/743290897 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff08c004f70 con 0x7ff094138220 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 4 set_mon_vals no callback set 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff099390640 10 monclient: dump: 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.789 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient: shutdown 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- 172.21.15.106:0/743290897 >> v1:172.21.15.106:6793/0 conn(0x7ff094138220 legacy=0x7ff094140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.790 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- 172.21.15.106:0/743290897 shutdown_connections 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- 172.21.15.106:0/743290897 >> 172.21.15.106:0/743290897 conn(0x7ff0940a6b80 msgr2=0x7ff0940a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- 172.21.15.106:0/743290897 shutdown_connections 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 1 -- 172.21.15.106:0/743290897 wait complete. 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient: build_initial_monmap 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.802+0000 7ff09c5f6640 10 monclient: monmap: 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.791 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:52.792 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 Processor -- start 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 -- start start 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: init 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _add_conns ranks=[8,0,3,1,7,4,5,2,6] 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient(hunting): picked mon.noname-e con 0x7ff0940a0b20 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient(hunting): picked mon.noname-a con 0x7ff094137730 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient(hunting): picked mon.noname-g con 0x7ff094138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0941cd830 con 0x7ff094137730 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0941329c0 con 0x7ff094138220 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0940a1e20 con 0x7ff0940a0b20 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient(hunting): authenticate will time out at 2208.332587s 2024-04-26T00:15:52.793 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff099b91640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7ff094137730 0x7ff0941cd120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40854/0 (socket says 172.21.15.106:40854) 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff099b91640 1 -- 172.21.15.106:0/2006380327 learned_addr learned my addr 172.21.15.106:0/2006380327 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09a392640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7ff0940a0b20 0x7ff0941cca10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49630/0 (socket says 172.21.15.106:49630) 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201514089 0 0) 0x7ff0940a1e20 con 0x7ff0940a0b20 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): my global_id is 294290 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff078003530 con 0x7ff0940a0b20 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1255772517 0 0) 0x7ff0941cd830 con 0x7ff094137730 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.794 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): my global_id is 274779 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0940a1e20 con 0x7ff094137730 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3593254166 0 0) 0x7ff078003530 con 0x7ff0940a0b20 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff0941cd830 con 0x7ff0940a0b20 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1580536968 0 0) 0x7ff0940a1e20 con 0x7ff094137730 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff078003530 con 0x7ff094137730 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff090001a10 con 0x7ff0940a0b20 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): dump: 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.795 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff084001a70 con 0x7ff094137730 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): dump: 2024-04-26T00:15:52.796 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.797 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.3 v1:172.21.15.171:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 283529070 0 0) 0x7ff0941329c0 con 0x7ff094138220 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient(hunting): my global_id is 294303 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.171:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff0940a1e20 con 0x7ff094138220 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3186785678 0 0) 0x7ff0941cd830 con 0x7ff0940a0b20 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 >> v1:172.21.15.171:6790/0 conn(0x7ff094138220 legacy=0x7ff0941d4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 >> v1:172.21.15.106:6789/0 conn(0x7ff094137730 legacy=0x7ff0941cd120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: _finish_hunting 0 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 monclient: found mon.e 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:15:52.798 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff094132400 con 0x7ff0940a0b20 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: _finish_auth 0 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: _check_auth_tickets 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 5 monclient: authenticate success, global_id 294290 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _renew_subs 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff0941326e0 con 0x7ff0940a0b20 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _renew_subs 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff0940a01b0 con 0x7ff0940a0b20 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff0900038d0 con 0x7ff0940a0b20 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7ff090001c00 con 0x7ff0940a0b20 2024-04-26T00:15:52.799 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff098b8f640 4 set_mon_vals no callback set 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 10 monclient: dump: 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:52.800 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.106:6793/0 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7ff090003e40 con 0x7ff0940a0b20 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.106:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff07c005090 con 0x7ff0940a0b20 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7ff090045060 con 0x7ff0940a0b20 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.806+0000 7ff099b91640 10 monclient: get_auth_request con 0x7ff078037ec0 auth_method 0 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.810+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mon.8 v1:172.21.15.106:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7ff090019280 con 0x7ff0940a0b20 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.810+0000 7ff08affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:52.801 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.810+0000 7ff08affd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:52.946 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.974+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7ff07c000ba0 con 0x7ff078037ec0 2024-04-26T00:15:52.947 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.974+0000 7ff08affd640 1 -- 172.21.15.106:0/2006380327 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7ff07c000ba0 con 0x7ff078037ec0 2024-04-26T00:15:52.947 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 4 to deep-scrub 2024-04-26T00:15:52.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 >> v1:172.21.15.171:6812/722422047 conn(0x7ff078037ec0 legacy=0x7ff07803a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 10 monclient: shutdown 2024-04-26T00:15:52.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:52.949 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 >> v1:172.21.15.106:6793/0 conn(0x7ff0940a0b20 legacy=0x7ff0941cca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:52.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 shutdown_connections 2024-04-26T00:15:52.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 >> 172.21.15.106:0/2006380327 conn(0x7ff0940a6b80 msgr2=0x7ff09412e6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:52.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 shutdown_connections 2024-04-26T00:15:52.950 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:52.978+0000 7ff09c5f6640 1 -- 172.21.15.106:0/2006380327 wait complete. 2024-04-26T00:15:52.964 INFO:tasks.ceph:Scrubbing osd.5 2024-04-26T00:15:52.964 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-26T00:15:53.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient: get_monmap_and_config 2024-04-26T00:15:53.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient: build_initial_monmap 2024-04-26T00:15:53.086 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient: monmap: 2024-04-26T00:15:53.086 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:53.086 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.086 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:53.115850+0000 2024-04-26T00:15:53.086 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:53.115850+0000 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:53.087 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 1 Processor -- start 2024-04-26T00:15:53.093 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 1 -- start start 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient: init 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient: _add_conns ranks=[4,3,7,0,2,6,8,5,1] 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient(hunting): picked mon.noname-c con 0x7f7e2c134820 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient(hunting): picked mon.noname-g con 0x7f7e2c0725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient(hunting): picked mon.noname-i con 0x7f7e2c13ace0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c071270 con 0x7f7e2c0725d0 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0714e0 con 0x7f7e2c134820 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0729f0 con 0x7f7e2c13ace0 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient(hunting): authenticate will time out at 2208.642997s 2024-04-26T00:15:53.094 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e30a01640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f7e2c134820 0x7f7e2c134c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53816/0 (socket says 172.21.15.106:53816) 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e30a01640 1 -- 172.21.15.106:0/2851423455 learned_addr learned my addr 172.21.15.106:0/2851423455 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2242920328 0 0) 0x7f7e24001120 con 0x7f7e2c134820 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient(hunting): my global_id is 274846 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e18003530 con 0x7f7e2c134820 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2513358984 0 0) 0x7f7e18003530 con 0x7f7e2c134820 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 >> v1:172.21.15.171:6792/0 conn(0x7f7e2c13ace0 legacy=0x7f7e2c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 >> v1:172.21.15.171:6790/0 conn(0x7f7e2c0725d0 legacy=0x7f7e2c1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 monclient: found mon.noname-c 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.095 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c0717c0 con 0x7f7e2c134820 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: _finish_auth 0 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e24001990 con 0x7f7e2c134820 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: dump: 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.096 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 5 monclient: authenticate success, global_id 274846 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:53.097 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 <== mon.4 v1:172.21.15.106:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e24001cf0 con 0x7f7e2c134820 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 1 -- 172.21.15.106:0/2851423455 <== mon.4 v1:172.21.15.106:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e24004c70 con 0x7f7e2c134820 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e32c65640 4 set_mon_vals no callback set 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.114+0000 7f7e2b7fe640 10 monclient: dump: 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.098 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: shutdown 2024-04-26T00:15:53.099 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/2851423455 >> v1:172.21.15.106:6791/0 conn(0x7f7e2c134820 legacy=0x7f7e2c134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/2851423455 shutdown_connections 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/2851423455 >> 172.21.15.106:0/2851423455 conn(0x7f7e2c0a64e0 msgr2=0x7f7e2c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/2851423455 shutdown_connections 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/2851423455 wait complete. 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: build_initial_monmap 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: monmap: 2024-04-26T00:15:53.100 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:53.101 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.102 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 Processor -- start 2024-04-26T00:15:53.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- start start 2024-04-26T00:15:53.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: init 2024-04-26T00:15:53.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:53.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: _add_conns ranks=[7,4,5,0,3,1,8,2,6] 2024-04-26T00:15:53.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient(hunting): picked mon.noname-i con 0x7f7e2c0725d0 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:53.103 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient(hunting): picked mon.noname-c con 0x7f7e2c134820 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:53.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient(hunting): picked mon.noname-h con 0x7f7e2c13ace0 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:53.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c1336a0 con 0x7f7e2c134820 2024-04-26T00:15:53.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c133c50 con 0x7f7e2c13ace0 2024-04-26T00:15:53.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e2c0706a0 con 0x7f7e2c0725d0 2024-04-26T00:15:53.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:53.104 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient(hunting): authenticate will time out at 2208.646050s 2024-04-26T00:15:53.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e2bfff640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f7e2c134820 0x7f7e2c132f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53826/0 (socket says 172.21.15.106:53826) 2024-04-26T00:15:53.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e2bfff640 1 -- 172.21.15.106:0/301748467 learned_addr learned my addr 172.21.15.106:0/301748467 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:53.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2492977879 0 0) 0x7f7e2c1336a0 con 0x7f7e2c134820 2024-04-26T00:15:53.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.105 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): my global_id is 274855 2024-04-26T00:15:53.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e0c003530 con 0x7f7e2c134820 2024-04-26T00:15:53.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3523596866 0 0) 0x7f7e0c003530 con 0x7f7e2c134820 2024-04-26T00:15:53.106 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7e2c1336a0 con 0x7f7e2c134820 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e14001e60 con 0x7f7e2c134820 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): dump: 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.107 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.108 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.108 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.108 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.108 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.108 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.108 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.109 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.109 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.109 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.109 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.109 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.109 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.109 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:53.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3964351617 0 0) 0x7f7e2c0706a0 con 0x7f7e2c0725d0 2024-04-26T00:15:53.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): my global_id is 147220 2024-04-26T00:15:53.110 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e0c003530 con 0x7f7e2c0725d0 2024-04-26T00:15:53.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1963517335 0 0) 0x7f7e2c133c50 con 0x7f7e2c13ace0 2024-04-26T00:15:53.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient(hunting): my global_id is 254948 2024-04-26T00:15:53.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e2c0706a0 con 0x7f7e2c13ace0 2024-04-26T00:15:53.111 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3898732236 0 0) 0x7f7e2c1336a0 con 0x7f7e2c134820 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 >> v1:172.21.15.171:6792/0 conn(0x7f7e2c0725d0 legacy=0x7f7e2c132880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 >> v1:172.21.15.171:6791/0 conn(0x7f7e2c13ace0 legacy=0x7f7e2c1d4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: _finish_hunting 0 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 monclient: found mon.c 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2c13bcf0 con 0x7f7e2c134820 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: _finish_auth 0 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: _check_auth_tickets 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 5 monclient: authenticate success, global_id 274855 2024-04-26T00:15:53.112 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: _renew_subs 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7e2c13b270 con 0x7f7e2c134820 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: _renew_subs 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f7e2c1d6090 con 0x7f7e2c134820 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7e14003cd0 con 0x7f7e2c134820 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7e14004240 con 0x7f7e2c134820 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e2affd640 4 set_mon_vals no callback set 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 10 monclient: dump: 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.113 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.114 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.106:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7e10000f90 con 0x7f7e2c134820 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.118+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7e140043e0 con 0x7f7e2c134820 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.122+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f7e140455d0 con 0x7f7e2c134820 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.122+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.171:6800/721452434 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7e0c0454c0 con 0x7f7e0c041890 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.122+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_get_version_reply(handle=1 version=256) ==== 24+0+0 (unknown 3755836717 0 0) 0x7f7e140459e0 con 0x7f7e2c134820 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.122+0000 7f7e297fa640 10 monclient: handle_get_version_reply finishing 1 version 256 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.122+0000 7f7e30a01640 10 monclient: get_auth_request con 0x7f7e0c037a40 auth_method 0 2024-04-26T00:15:53.115 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.122+0000 7f7e31202640 10 monclient: get_auth_request con 0x7f7e0c041890 auth_method 0 2024-04-26T00:15:53.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.122+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== osd.5 v1:172.21.15.171:6800/721452434 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f7e0c0454c0 con 0x7f7e0c041890 2024-04-26T00:15:53.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.134+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 --> v1:172.21.15.171:6800/721452434 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7e10002cc0 con 0x7f7e0c041890 2024-04-26T00:15:53.116 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e297fa640 1 -- 172.21.15.106:0/301748467 <== osd.5 v1:172.21.15.171:6800/721452434 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f7e10002cc0 con 0x7f7e0c041890 2024-04-26T00:15:53.116 INFO:teuthology.orchestra.run.smithi106.stdout:{ 2024-04-26T00:15:53.116 INFO:teuthology.orchestra.run.smithi106.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-26T00:15:53.116 INFO:teuthology.orchestra.run.smithi106.stdout:} 2024-04-26T00:15:53.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 >> v1:172.21.15.171:6800/721452434 conn(0x7f7e0c041890 legacy=0x7f7e0c043cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 >> v1:172.21.15.171:6812/722422047 conn(0x7f7e0c037a40 legacy=0x7f7e0c039f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 10 monclient: shutdown 2024-04-26T00:15:53.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:53.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 >> v1:172.21.15.106:6791/0 conn(0x7f7e2c134820 legacy=0x7f7e2c132f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.117 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e31202640 1 -- 172.21.15.106:0/301748467 reap_dead start 2024-04-26T00:15:53.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 shutdown_connections 2024-04-26T00:15:53.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 >> 172.21.15.106:0/301748467 conn(0x7f7e2c0a64e0 msgr2=0x7f7e2c06e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:53.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 shutdown_connections 2024-04-26T00:15:53.118 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.138+0000 7f7e32c65640 1 -- 172.21.15.106:0/301748467 wait complete. 2024-04-26T00:15:53.125 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-26T00:15:53.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.266+0000 7f7975893640 10 monclient: get_monmap_and_config 2024-04-26T00:15:53.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.266+0000 7f7975893640 10 monclient: build_initial_monmap 2024-04-26T00:15:53.240 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.266+0000 7f7975893640 10 monclient: monmap: 2024-04-26T00:15:53.240 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:53.240 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:53.270031+0000 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:53.270031+0000 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:53.241 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:53.242 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:53.242 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:53.242 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:53.242 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:53.242 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 Processor -- start 2024-04-26T00:15:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- start start 2024-04-26T00:15:53.249 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: init 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: _add_conns ranks=[1,6,3,0,2,8,4,5,7] 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient(hunting): picked mon.noname-f con 0x7f7970137730 addr v1:172.21.15.171:6789/0 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient(hunting): picked mon.noname-d con 0x7f79700a0b20 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient(hunting): picked mon.noname-g con 0x7f7970138220 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79700a2750 con 0x7f7970137730 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79700a2a30 con 0x7f7970138220 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79700a2d10 con 0x7f79700a0b20 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient(hunting): authenticate will time out at 2208.797486s 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796e7fc640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f79700a0b20 0x7f797013ccd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33874/0 (socket says 172.21.15.106:33874) 2024-04-26T00:15:53.250 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796e7fc640 1 -- 172.21.15.106:0/2430666222 learned_addr learned my addr 172.21.15.106:0/2430666222 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395115945 0 0) 0x7f79700a2d10 con 0x7f79700a0b20 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient(hunting): my global_id is 254958 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7958003530 con 0x7f79700a0b20 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1612770485 0 0) 0x7f7958003530 con 0x7f79700a0b20 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 >> v1:172.21.15.171:6790/0 conn(0x7f7970138220 legacy=0x7f7970140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 >> v1:172.21.15.171:6789/0 conn(0x7f7970137730 legacy=0x7f7970137b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: _finish_hunting 0 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 monclient: found mon.noname-d 2024-04-26T00:15:53.251 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.106:6792/0 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79700a4680 con 0x7f79700a0b20 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: _finish_auth 0 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: _check_auth_tickets 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f79600017c0 con 0x7f79700a0b20 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 5 monclient: authenticate success, global_id 254958 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: dump: 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.252 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.253 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 <== mon.6 v1:172.21.15.106:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7960001b20 con 0x7f79700a0b20 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 4 set_mon_vals no callback set 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 1 -- 172.21.15.106:0/2430666222 <== mon.6 v1:172.21.15.106:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7960004bf0 con 0x7f79700a0b20 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f796dffb640 10 monclient: dump: 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.254 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.255 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: shutdown 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- 172.21.15.106:0/2430666222 >> v1:172.21.15.106:6792/0 conn(0x7f79700a0b20 legacy=0x7f797013ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- 172.21.15.106:0/2430666222 shutdown_connections 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- 172.21.15.106:0/2430666222 >> 172.21.15.106:0/2430666222 conn(0x7f79700a6b80 msgr2=0x7f79700a6f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- 172.21.15.106:0/2430666222 shutdown_connections 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- 172.21.15.106:0/2430666222 wait complete. 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: build_initial_monmap 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: monmap: 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:53.256 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:53.257 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 Processor -- start 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 1 -- start start 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.270+0000 7f7975893640 10 monclient: init 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _add_conns ranks=[4,7,8,6,5,0,3,2,1] 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient(hunting): picked mon.noname-c con 0x7f79700a0b20 addr v1:172.21.15.106:6791/0 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient(hunting): picked mon.noname-i con 0x7f7970137730 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient(hunting): picked mon.noname-e con 0x7f7970138220 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797009cb40 con 0x7f79700a0b20 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f797009d100 con 0x7f7970137730 2024-04-26T00:15:53.258 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7970134af0 con 0x7f7970138220 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient(hunting): authenticate will time out at 2208.800444s 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796effd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f79700a0b20 0x7f797009a9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:53838/0 (socket says 172.21.15.106:53838) 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796effd640 1 -- 172.21.15.106:0/1097870137 learned_addr learned my addr 172.21.15.106:0/1097870137 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796f7fe640 1 -- 172.21.15.106:0/1097870137 >> v1:172.21.15.106:6793/0 conn(0x7f7970138220 legacy=0x7f79701d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796f7fe640 1 -- 172.21.15.106:0/1097870137 >> v1:172.21.15.106:6793/0 conn(0x7f7970138220 legacy=0x7f79701d4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796f7fe640 1 --1- 172.21.15.106:0/1097870137 >> v1:172.21.15.106:6793/0 conn(0x7f7970138220 0x7f79701d4a60 :-1 s=OPENED pgs=532 cs=1 l=1).handle_message read tag failed 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796f7fe640 1 --1- 172.21.15.106:0/1097870137 >> v1:172.21.15.106:6793/0 conn(0x7f7970138220 0x7f79701d4a60 :-1 s=OPENED pgs=532 cs=1 l=1).fault on lossy channel, failing 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.106:6793/0 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 510734343 0 0) 0x7f797009cb40 con 0x7f79700a0b20 2024-04-26T00:15:53.259 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): my global_id is 274864 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c003530 con 0x7f79700a0b20 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3180131400 0 0) 0x7f795c003530 con 0x7f79700a0b20 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f797009cb40 con 0x7f79700a0b20 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7964001a60 con 0x7f79700a0b20 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): dump: 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.260 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.261 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 568614341 0 0) 0x7f797009d100 con 0x7f7970137730 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient(hunting): my global_id is 147229 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f795c003530 con 0x7f7970137730 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2435592177 0 0) 0x7f797009cb40 con 0x7f79700a0b20 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 >> v1:172.21.15.106:6793/0 conn(0x7f7970138220 legacy=0x7f79701d4a60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 >> v1:172.21.15.171:6792/0 conn(0x7f7970137730 legacy=0x7f797009b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.262 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: _finish_hunting 0 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 monclient: found mon.c 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.106:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797009ce20 con 0x7f79700a0b20 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: _finish_auth 0 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: _check_auth_tickets 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 5 monclient: authenticate success, global_id 274864 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _renew_subs 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.106:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f79701342e0 con 0x7f79700a0b20 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _renew_subs 2024-04-26T00:15:53.263 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.106:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f797009bc80 con 0x7f79700a0b20 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7964003950 con 0x7f79700a0b20 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f7964003ec0 con 0x7f79700a0b20 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796d7fa640 4 set_mon_vals no callback set 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 10 monclient: dump: 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.264 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:53.265 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.106:6791/0 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.106:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7950005090 con 0x7f79700a0b20 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f7964004060 con 0x7f79700a0b20 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f79640451c0 con 0x7f79700a0b20 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.274+0000 7f796e7fc640 10 monclient: get_auth_request con 0x7f795c037730 auth_method 0 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.278+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mon.4 v1:172.21.15.106:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f7964015730 con 0x7f79700a0b20 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.278+0000 7f7957fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:53.266 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.278+0000 7f7957fff640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:53.408 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.434+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f7950000ba0 con 0x7f795c037730 2024-04-26T00:15:53.409 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7957fff640 1 -- 172.21.15.106:0/1097870137 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f7950000ba0 con 0x7f795c037730 2024-04-26T00:15:53.409 INFO:teuthology.orchestra.run.smithi106.stderr:instructed osd(s) 5 to deep-scrub 2024-04-26T00:15:53.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 >> v1:172.21.15.171:6812/722422047 conn(0x7f795c037730 legacy=0x7f795c039bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 10 monclient: shutdown 2024-04-26T00:15:53.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:53.411 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 >> v1:172.21.15.106:6791/0 conn(0x7f79700a0b20 legacy=0x7f797009a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 shutdown_connections 2024-04-26T00:15:53.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 >> 172.21.15.106:0/1097870137 conn(0x7f79700a6b80 msgr2=0x7f79700a7a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:53.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 shutdown_connections 2024-04-26T00:15:53.412 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.438+0000 7f7975893640 1 -- 172.21.15.106:0/1097870137 wait complete. 2024-04-26T00:15:53.426 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.558+0000 7f9c11dc7640 10 monclient: get_monmap_and_config 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.558+0000 7f9c11dc7640 10 monclient: build_initial_monmap 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.558+0000 7f9c11dc7640 10 monclient: monmap: 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:15:53.561599+0000 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:15:53.561599+0000 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:53.532 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:53.533 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 Processor -- start 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- start start 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: init 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: _add_conns ranks=[5,3,8,6,4,7,1,2,0] 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): picked mon.noname-h con 0x7f9c0c134820 addr v1:172.21.15.171:6791/0 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): picked mon.noname-g con 0x7f9c0c0725d0 addr v1:172.21.15.171:6790/0 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): picked mon.noname-e con 0x7f9c0c13ace0 addr v1:172.21.15.106:6793/0 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- --> v1:172.21.15.171:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c071270 con 0x7f9c0c0725d0 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c0714e0 con 0x7f9c0c134820 2024-04-26T00:15:53.540 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- --> v1:172.21.15.106:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c0729f0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): authenticate will time out at 2209.088873s 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0bfff640 1 --1- >> v1:172.21.15.106:6793/0 conn(0x7f9c0c13ace0 0x7f9c0c13d0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6793/0 says I am v1:172.21.15.106:49656/0 (socket says 172.21.15.106:49656) 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0bfff640 1 -- 172.21.15.106:0/2116491786 learned_addr learned my addr 172.21.15.106:0/2116491786 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 <== mon.8 v1:172.21.15.106:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 333639493 0 0) 0x7f9c0c0729f0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient(hunting): my global_id is 294308 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 --> v1:172.21.15.106:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bf8003530 con 0x7f9c0c13ace0 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 <== mon.8 v1:172.21.15.106:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532670154 0 0) 0x7f9bf8003530 con 0x7f9c0c13ace0 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 >> v1:172.21.15.171:6791/0 conn(0x7f9c0c134820 legacy=0x7f9c0c134c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 >> v1:172.21.15.171:6790/0 conn(0x7f9c0c0725d0 legacy=0x7f9c0c1395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.541 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: _finish_hunting 0 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 monclient: found mon.noname-e 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.106:6793/0 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 --> v1:172.21.15.106:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c0717c0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: _finish_auth 0 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: _check_auth_tickets 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 <== mon.8 v1:172.21.15.106:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c04001ba0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: dump: 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.542 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.543 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 5 monclient: authenticate success, global_id 294308 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 <== mon.8 v1:172.21.15.106:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9c04001eb0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: get_monmap_and_config success 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 4 set_mon_vals no callback set 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 1 -- 172.21.15.106:0/2116491786 <== mon.8 v1:172.21.15.106:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c04004f70 con 0x7f9c0c13ace0 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0affd640 10 monclient: dump: 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.544 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: shutdown 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- 172.21.15.106:0/2116491786 >> v1:172.21.15.106:6793/0 conn(0x7f9c0c13ace0 legacy=0x7f9c0c13d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.545 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- 172.21.15.106:0/2116491786 shutdown_connections 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- 172.21.15.106:0/2116491786 >> 172.21.15.106:0/2116491786 conn(0x7f9c0c0a64e0 msgr2=0x7f9c0c0a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- 172.21.15.106:0/2116491786 shutdown_connections 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- 172.21.15.106:0/2116491786 wait complete. 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: build_initial_monmap 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: monmap: 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:15:53.546 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 Processor -- start 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- start start 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: init 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: _reopen_session rank -1 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient: _add_conns ranks=[0,7,6,3,1,5,2,4,8] 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): picked mon.noname-a con 0x7f9c0c0725d0 addr v1:172.21.15.106:6789/0 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): picked mon.noname-i con 0x7f9c0c134820 addr v1:172.21.15.171:6792/0 2024-04-26T00:15:53.547 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): picked mon.noname-d con 0x7f9c0c13ace0 addr v1:172.21.15.106:6792/0 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c09f7f0 con 0x7f9c0c0725d0 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c133ca0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c0c09baf0 con 0x7f9c0c134820 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): _renew_subs 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c11dc7640 10 monclient(hunting): authenticate will time out at 2209.091842s 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0bfff640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f9c0c13ace0 0x7f9c0c1d07c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:33878/0 (socket says 172.21.15.106:33878) 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0b7fe640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f9c0c0725d0 0x7f9c0c1296f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:40868/0 (socket says 172.21.15.106:40868) 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.562+0000 7f9c0bfff640 1 -- 172.21.15.106:0/3424021085 learned_addr learned my addr 172.21.15.106:0/3424021085 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4044651829 0 0) 0x7f9c0c09f7f0 con 0x7f9c0c0725d0 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): my global_id is 274788 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9bec003530 con 0x7f9c0c0725d0 2024-04-26T00:15:53.548 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824714040 0 0) 0x7f9c0c133ca0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): my global_id is 254967 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c0c09f7f0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2932766520 0 0) 0x7f9bec003530 con 0x7f9c0c0725d0 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9c0c133ca0 con 0x7f9c0c0725d0 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bfc001990 con 0x7f9c0c0725d0 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): dump: 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.549 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.550 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2908508594 0 0) 0x7f9c0c09f7f0 con 0x7f9c0c13ace0 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9bec003530 con 0x7f9c0c13ace0 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493171297 0 0) 0x7f9c0c09baf0 con 0x7f9c0c134820 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _negotiate 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): my global_id is 147238 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c0c09f7f0 con 0x7f9c0c134820 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9c04001b60 con 0x7f9c0c13ace0 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient(hunting): dump: 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.551 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2988210681 0 0) 0x7f9c0c133ca0 con 0x7f9c0c0725d0 2024-04-26T00:15:53.552 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 >> v1:172.21.15.171:6792/0 conn(0x7f9c0c134820 legacy=0x7f9c0c1cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 >> v1:172.21.15.106:6792/0 conn(0x7f9c0c13ace0 legacy=0x7f9c0c1d07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: _finish_hunting 0 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 monclient: found mon.a 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c0c09dc60 con 0x7f9c0c0725d0 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: _finish_auth 0 2024-04-26T00:15:53.553 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: _check_auth_tickets 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 5 monclient: authenticate success, global_id 274788 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 10 monclient: _renew_subs 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9c0c129e00 con 0x7f9c0c0725d0 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 10 monclient: _renew_subs 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f9c0c1332b0 con 0x7f9c0c0725d0 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9bfc001d20 con 0x7f9c0c0725d0 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: handle_config config(0 keys) 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f9bfc003c10 con 0x7f9c0c0725d0 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:15:53.554 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c0a7fc640 4 set_mon_vals no callback set 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 10 monclient: dump: 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:15:53.555 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f9bfc003db0 con 0x7f9c0c0725d0 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bf0005090 con 0x7f9c0c0725d0 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f9bfc045110 con 0x7f9c0c0725d0 2024-04-26T00:15:53.556 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.566+0000 7f9c02ffd640 10 monclient: get_auth_request con 0x7f9bec037fd0 auth_method 0 2024-04-26T00:15:53.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.570+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f9c0c0714e0 con 0x7f9c0c0725d0 2024-04-26T00:15:53.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.570+0000 7f9c08ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:15:53.557 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.570+0000 7f9c08ff9640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:15:53.695 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.722+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9bf0000ba0 con 0x7f9bec037fd0 2024-04-26T00:15:53.701 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c08ff9640 1 -- 172.21.15.106:0/3424021085 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+77792 (unknown 2965378022 0 2827085755) 0x7f9bf0000ba0 con 0x7f9bec037fd0 2024-04-26T00:15:53.704 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T00:15:53.704 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T00:15:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 >> v1:172.21.15.171:6812/722422047 conn(0x7f9bec037fd0 legacy=0x7f9bec03a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 10 monclient: shutdown 2024-04-26T00:15:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:15:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 >> v1:172.21.15.106:6789/0 conn(0x7f9c0c0725d0 legacy=0x7f9c0c1296f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:15:53.705 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 shutdown_connections 2024-04-26T00:15:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 >> 172.21.15.106:0/3424021085 conn(0x7f9c0c0a64e0 msgr2=0x7f9c0c0a1280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:15:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 shutdown_connections 2024-04-26T00:15:53.706 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:15:53.730+0000 7f9c11dc7640 1 -- 172.21.15.106:0/3424021085 wait complete. 2024-04-26T00:15:53.719 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":879,"stamp":"2024-04-26T00:15:51.963309+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":191328,"kb_used_data":7328,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566039712,"statfs":{"total":579820584960,"available":579624665088,"internally_reserved":0,"allocated":7503872,"data_stored":7980170,"data_compressed":1408224,"data_compressed_allocated":2154496,"data_compressed_original":4787688,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003959"},"pg_stats":[{"pgid":"10.4","version":"0'0","reported_seq":307,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:14:11.814722+0000","last_change":"2024-04-26T00:00:28.738770+0000","last_active":"2024-04-26T00:14:11.814722+0000","last_peered":"2024-04-26T00:14:11.814722+0000","last_clean":"2024-04-26T00:14:11.814722+0000","last_became_active":"2024-04-26T00:00:28.737377+0000","last_became_peered":"2024-04-26T00:00:28.737377+0000","last_unstale":"2024-04-26T00:14:11.814722+0000","last_undegraded":"2024-04-26T00:14:11.814722+0000","last_fullsized":"2024-04-26T00:14:11.814722+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698667+0000","last_change":"2024-04-26T00:00:28.717284+0000","last_active":"2024-04-26T00:13:31.698667+0000","last_peered":"2024-04-26T00:13:31.698667+0000","last_clean":"2024-04-26T00:13:31.698667+0000","last_became_active":"2024-04-26T00:00:28.716880+0000","last_became_peered":"2024-04-26T00:00:28.716880+0000","last_unstale":"2024-04-26T00:13:31.698667+0000","last_undegraded":"2024-04-26T00:13:31.698667+0000","last_fullsized":"2024-04-26T00:13:31.698667+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:42:36.026604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":296,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:11.679238+0000","last_change":"2024-04-26T00:00:28.738509+0000","last_active":"2024-04-26T00:12:11.679238+0000","last_peered":"2024-04-26T00:12:11.679238+0000","last_clean":"2024-04-26T00:12:11.679238+0000","last_became_active":"2024-04-26T00:00:28.737571+0000","last_became_peered":"2024-04-26T00:00:28.737571+0000","last_unstale":"2024-04-26T00:12:11.679238+0000","last_undegraded":"2024-04-26T00:12:11.679238+0000","last_fullsized":"2024-04-26T00:12:11.679238+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:39:23.623839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":180,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.698622+0000","last_change":"2024-04-26T00:00:28.725961+0000","last_active":"2024-04-26T00:13:31.698622+0000","last_peered":"2024-04-26T00:13:31.698622+0000","last_clean":"2024-04-26T00:13:31.698622+0000","last_became_active":"2024-04-26T00:00:28.725554+0000","last_became_peered":"2024-04-26T00:00:28.725554+0000","last_unstale":"2024-04-26T00:13:31.698622+0000","last_undegraded":"2024-04-26T00:13:31.698622+0000","last_fullsized":"2024-04-26T00:13:31.698622+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:08:38.175600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":230,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:36.690931+0000","last_change":"2024-04-26T00:00:29.724808+0000","last_active":"2024-04-26T00:12:36.690931+0000","last_peered":"2024-04-26T00:12:36.690931+0000","last_clean":"2024-04-26T00:12:36.690931+0000","last_became_active":"2024-04-26T00:00:29.723663+0000","last_became_peered":"2024-04-26T00:00:29.723663+0000","last_unstale":"2024-04-26T00:12:36.690931+0000","last_undegraded":"2024-04-26T00:12:36.690931+0000","last_fullsized":"2024-04-26T00:12:36.690931+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:48:20.010319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":303,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:51.509213+0000","last_change":"2024-04-26T00:15:51.509258+0000","last_active":"2024-04-26T00:15:51.509213+0000","last_peered":"2024-04-26T00:15:51.509213+0000","last_clean":"2024-04-26T00:15:51.509213+0000","last_became_active":"2024-04-26T00:00:28.718609+0000","last_became_peered":"2024-04-26T00:00:28.718609+0000","last_unstale":"2024-04-26T00:15:51.509213+0000","last_undegraded":"2024-04-26T00:15:51.509213+0000","last_fullsized":"2024-04-26T00:15:51.509213+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:51.509102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:51.509102+0000","last_clean_scrub_stamp":"2024-04-26T00:15:51.509102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:20.825833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":184,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808969+0000","last_change":"2024-04-26T00:00:28.732762+0000","last_active":"2024-04-26T00:13:31.808969+0000","last_peered":"2024-04-26T00:13:31.808969+0000","last_clean":"2024-04-26T00:13:31.808969+0000","last_became_active":"2024-04-26T00:00:28.732236+0000","last_became_peered":"2024-04-26T00:00:28.732236+0000","last_unstale":"2024-04-26T00:13:31.808969+0000","last_undegraded":"2024-04-26T00:13:31.808969+0000","last_fullsized":"2024-04-26T00:13:31.808969+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:49:13.674019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:06.826318+0000","last_change":"2024-04-26T00:00:28.723106+0000","last_active":"2024-04-26T00:15:06.826318+0000","last_peered":"2024-04-26T00:15:06.826318+0000","last_clean":"2024-04-26T00:15:06.826318+0000","last_became_active":"2024-04-26T00:00:28.722170+0000","last_became_peered":"2024-04-26T00:00:28.722170+0000","last_unstale":"2024-04-26T00:15:06.826318+0000","last_undegraded":"2024-04-26T00:15:06.826318+0000","last_fullsized":"2024-04-26T00:15:06.826318+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":213,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:11:56.685302+0000","last_change":"2024-04-26T00:00:28.729400+0000","last_active":"2024-04-26T00:11:56.685302+0000","last_peered":"2024-04-26T00:11:56.685302+0000","last_clean":"2024-04-26T00:11:56.685302+0000","last_became_active":"2024-04-26T00:00:28.728808+0000","last_became_peered":"2024-04-26T00:00:28.728808+0000","last_unstale":"2024-04-26T00:11:56.685302+0000","last_undegraded":"2024-04-26T00:11:56.685302+0000","last_fullsized":"2024-04-26T00:11:56.685302+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:39:18.593420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":218,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:16.798472+0000","last_change":"2024-04-26T00:00:28.726625+0000","last_active":"2024-04-26T00:12:16.798472+0000","last_peered":"2024-04-26T00:12:16.798472+0000","last_clean":"2024-04-26T00:12:16.798472+0000","last_became_active":"2024-04-26T00:00:28.726130+0000","last_became_peered":"2024-04-26T00:00:28.726130+0000","last_unstale":"2024-04-26T00:12:16.798472+0000","last_undegraded":"2024-04-26T00:12:16.798472+0000","last_fullsized":"2024-04-26T00:12:16.798472+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:57:08.131796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":247,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:06.682708+0000","last_change":"2024-04-26T00:00:28.731858+0000","last_active":"2024-04-26T00:12:06.682708+0000","last_peered":"2024-04-26T00:12:06.682708+0000","last_clean":"2024-04-26T00:12:06.682708+0000","last_became_active":"2024-04-26T00:00:28.731390+0000","last_became_peered":"2024-04-26T00:00:28.731390+0000","last_unstale":"2024-04-26T00:12:06.682708+0000","last_undegraded":"2024-04-26T00:12:06.682708+0000","last_fullsized":"2024-04-26T00:12:06.682708+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:11:40.241345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:06.826218+0000","last_change":"2024-04-26T00:00:28.724198+0000","last_active":"2024-04-26T00:15:06.826218+0000","last_peered":"2024-04-26T00:15:06.826218+0000","last_clean":"2024-04-26T00:15:06.826218+0000","last_became_active":"2024-04-26T00:00:28.723392+0000","last_became_peered":"2024-04-26T00:00:28.723392+0000","last_unstale":"2024-04-26T00:15:06.826218+0000","last_undegraded":"2024-04-26T00:15:06.826218+0000","last_fullsized":"2024-04-26T00:15:06.826218+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":191,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:06.826254+0000","last_change":"2024-04-26T00:00:28.734188+0000","last_active":"2024-04-26T00:15:06.826254+0000","last_peered":"2024-04-26T00:15:06.826254+0000","last_clean":"2024-04-26T00:15:06.826254+0000","last_became_active":"2024-04-26T00:00:28.732291+0000","last_became_peered":"2024-04-26T00:00:28.732291+0000","last_unstale":"2024-04-26T00:15:06.826254+0000","last_undegraded":"2024-04-26T00:15:06.826254+0000","last_fullsized":"2024-04-26T00:15:06.826254+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":308,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:14:11.814684+0000","last_change":"2024-04-26T00:00:28.731923+0000","last_active":"2024-04-26T00:14:11.814684+0000","last_peered":"2024-04-26T00:14:11.814684+0000","last_clean":"2024-04-26T00:14:11.814684+0000","last_became_active":"2024-04-26T00:00:28.730684+0000","last_became_peered":"2024-04-26T00:00:28.730684+0000","last_unstale":"2024-04-26T00:14:11.814684+0000","last_undegraded":"2024-04-26T00:14:11.814684+0000","last_fullsized":"2024-04-26T00:14:11.814684+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":191,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.686048+0000","last_change":"2024-04-26T00:00:29.729411+0000","last_active":"2024-04-26T00:13:01.686048+0000","last_peered":"2024-04-26T00:13:01.686048+0000","last_clean":"2024-04-26T00:13:01.686048+0000","last_became_active":"2024-04-26T00:00:29.727993+0000","last_became_peered":"2024-04-26T00:00:29.727993+0000","last_unstale":"2024-04-26T00:13:01.686048+0000","last_undegraded":"2024-04-26T00:13:01.686048+0000","last_fullsized":"2024-04-26T00:13:01.686048+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:34.691572+0000","last_clean_scrub_stamp":"2024-04-25T23:59:34.691572+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:21:34.304761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:14:31.821296+0000","last_change":"2024-04-26T00:00:28.712427+0000","last_active":"2024-04-26T00:14:31.821296+0000","last_peered":"2024-04-26T00:14:31.821296+0000","last_clean":"2024-04-26T00:14:31.821296+0000","last_became_active":"2024-04-26T00:00:28.711533+0000","last_became_peered":"2024-04-26T00:00:28.711533+0000","last_unstale":"2024-04-26T00:14:31.821296+0000","last_undegraded":"2024-04-26T00:14:31.821296+0000","last_fullsized":"2024-04-26T00:14:31.821296+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:59:33.678581+0000","last_clean_scrub_stamp":"2024-04-25T23:59:33.678581+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":436,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804720+0000","last_change":"2024-04-26T00:00:28.731423+0000","last_active":"2024-04-26T00:13:01.804720+0000","last_peered":"2024-04-26T00:13:01.804720+0000","last_clean":"2024-04-26T00:13:01.804720+0000","last_became_active":"2024-04-26T00:00:28.731119+0000","last_became_peered":"2024-04-26T00:00:28.731119+0000","last_unstale":"2024-04-26T00:13:01.804720+0000","last_undegraded":"2024-04-26T00:13:01.804720+0000","last_fullsized":"2024-04-26T00:13:01.804720+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:37:56.959685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":430,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:01.686029+0000","last_change":"2024-04-26T00:00:29.725274+0000","last_active":"2024-04-26T00:12:01.686029+0000","last_peered":"2024-04-26T00:12:01.686029+0000","last_clean":"2024-04-26T00:12:01.686029+0000","last_became_active":"2024-04-26T00:00:29.724281+0000","last_became_peered":"2024-04-26T00:00:29.724281+0000","last_unstale":"2024-04-26T00:12:01.686029+0000","last_undegraded":"2024-04-26T00:12:01.686029+0000","last_fullsized":"2024-04-26T00:12:01.686029+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:21:08.908921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.690581+0000","last_change":"2024-04-26T00:00:28.719506+0000","last_active":"2024-04-26T00:13:01.690581+0000","last_peered":"2024-04-26T00:13:01.690581+0000","last_clean":"2024-04-26T00:13:01.690581+0000","last_became_active":"2024-04-26T00:00:28.719074+0000","last_became_peered":"2024-04-26T00:00:28.719074+0000","last_unstale":"2024-04-26T00:13:01.690581+0000","last_undegraded":"2024-04-26T00:13:01.690581+0000","last_fullsized":"2024-04-26T00:13:01.690581+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:45:58.255889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:06.826277+0000","last_change":"2024-04-26T00:00:28.721183+0000","last_active":"2024-04-26T00:15:06.826277+0000","last_peered":"2024-04-26T00:15:06.826277+0000","last_clean":"2024-04-26T00:15:06.826277+0000","last_became_active":"2024-04-26T00:00:28.717935+0000","last_became_peered":"2024-04-26T00:00:28.717935+0000","last_unstale":"2024-04-26T00:15:06.826277+0000","last_undegraded":"2024-04-26T00:15:06.826277+0000","last_fullsized":"2024-04-26T00:15:06.826277+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"253'161","reported_seq":713,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:01.804682+0000","last_change":"2024-04-26T00:00:31.558943+0000","last_active":"2024-04-26T00:13:01.804682+0000","last_peered":"2024-04-26T00:13:01.804682+0000","last_clean":"2024-04-26T00:13:01.804682+0000","last_became_active":"2024-04-26T00:00:31.558409+0000","last_became_peered":"2024-04-26T00:00:31.558409+0000","last_unstale":"2024-04-26T00:13:01.804682+0000","last_undegraded":"2024-04-26T00:13:01.804682+0000","last_fullsized":"2024-04-26T00:13:01.804682+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":161,"log_dups_size":0,"ondisk_log_size":161,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:20:02.624876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":190,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:06.826300+0000","last_change":"2024-04-26T00:00:28.723193+0000","last_active":"2024-04-26T00:15:06.826300+0000","last_peered":"2024-04-26T00:15:06.826300+0000","last_clean":"2024-04-26T00:15:06.826300+0000","last_became_active":"2024-04-26T00:00:28.722258+0000","last_became_peered":"2024-04-26T00:00:28.722258+0000","last_unstale":"2024-04-26T00:15:06.826300+0000","last_undegraded":"2024-04-26T00:15:06.826300+0000","last_fullsized":"2024-04-26T00:15:06.826300+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:06.691323+0000","last_change":"2024-04-26T00:00:28.720773+0000","last_active":"2024-04-26T00:13:06.691323+0000","last_peered":"2024-04-26T00:13:06.691323+0000","last_clean":"2024-04-26T00:13:06.691323+0000","last_became_active":"2024-04-26T00:00:28.720392+0000","last_became_peered":"2024-04-26T00:00:28.720392+0000","last_unstale":"2024-04-26T00:13:06.691323+0000","last_undegraded":"2024-04-26T00:13:06.691323+0000","last_fullsized":"2024-04-26T00:13:06.691323+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:35:47.483585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":183,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:13:31.808936+0000","last_change":"2024-04-26T00:00:28.731510+0000","last_active":"2024-04-26T00:13:31.808936+0000","last_peered":"2024-04-26T00:13:31.808936+0000","last_clean":"2024-04-26T00:13:31.808936+0000","last_became_active":"2024-04-26T00:00:28.731039+0000","last_became_peered":"2024-04-26T00:00:28.731039+0000","last_unstale":"2024-04-26T00:13:31.808936+0000","last_undegraded":"2024-04-26T00:13:31.808936+0000","last_fullsized":"2024-04-26T00:13:31.808936+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:50:14.612054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":440,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:12:31.690193+0000","last_change":"2024-04-26T00:00:28.726321+0000","last_active":"2024-04-26T00:12:31.690193+0000","last_peered":"2024-04-26T00:12:31.690193+0000","last_clean":"2024-04-26T00:12:31.690193+0000","last_became_active":"2024-04-26T00:00:28.725623+0000","last_became_peered":"2024-04-26T00:00:28.725623+0000","last_unstale":"2024-04-26T00:12:31.690193+0000","last_undegraded":"2024-04-26T00:12:31.690193+0000","last_fullsized":"2024-04-26T00:12:31.690193+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T23:54:57.697990+0000","last_clean_scrub_stamp":"2024-04-25T23:54:57.697990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:33:54.174589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":6},{"poolid":9,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1586784,"data_compressed":24239,"data_compressed_allocated":98304,"data_compressed_original":1551848,"omap_allocated":0,"internal_metadata":0},"log_size":161,"ondisk_log_size":161,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640511,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640510,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640510,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239126,"data_compressed_allocated":380928,"data_compressed_original":1138688,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640509,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28404,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343436,"statfs":{"total":96636764160,"available":96607678464,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640510,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239646,"data_compressed_allocated":380928,"data_compressed_original":1142248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640510,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32564,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339276,"statfs":{"total":96636764160,"available":96603418624,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":10193,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":7283,"data_compressed_allocated":32768,"data_compressed_original":515560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6763,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:15:53.724 INFO:tasks.ceph:pgid 10.4 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.724 INFO:tasks.ceph:pgid 9.7 last_scrub_stamp 2024-04-25T23:59:33.678581+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.724 INFO:tasks.ceph:pgid 10.5 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.724 INFO:tasks.ceph:pgid 9.6 last_scrub_stamp 2024-04-25T23:59:33.678581+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.724 INFO:tasks.ceph:pgid 10.6 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 10.7 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 9.4 last_scrub_stamp 2024-04-25T23:59:33.678581+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 10.0 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 9.3 last_scrub_stamp 2024-04-25T23:59:33.678581+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 10.1 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 9.2 last_scrub_stamp 2024-04-25T23:59:33.678581+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 10.2 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.725 INFO:tasks.ceph:pgid 9.1 last_scrub_stamp 2024-04-25T23:59:33.678581+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 10.3 last_scrub_stamp 2024-04-25T23:59:34.691572+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=34, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 9.0 last_scrub_stamp 2024-04-25T23:59:33.678581+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=59, tm_sec=33, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.726 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.727 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2024-04-25T23:54:57.697990+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=23, tm_min=54, tm_sec=57, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=26, tm_hour=0, tm_min=15, tm_sec=49, tm_wday=4, tm_yday=117, tm_isdst=0) 2024-04-26T00:15:53.727 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-26T00:16:13.728 DEBUG:teuthology.orchestra.run.smithi106:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient: get_monmap_and_config 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient: build_initial_monmap 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient: monmap: 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:16:13.888589+0000 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:16:13.888589+0000 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:16:13.859 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:16:13.860 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 1 Processor -- start 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 1 -- start start 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient: init 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient: _reopen_session rank -1 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient: _add_conns ranks=[2,5,7,3,4,6,1,8,0] 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient(hunting): picked mon.noname-b con 0x7f93e0135870 addr v1:172.21.15.106:6790/0 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient(hunting): picked mon.noname-h con 0x7f93e01353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:16:13.869 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient(hunting): picked mon.noname-i con 0x7f93e013bdf0 addr v1:172.21.15.171:6792/0 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 1 -- --> v1:172.21.15.106:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e006f2d0 con 0x7f93e0135870 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e0072330 con 0x7f93e01353b0 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e0072610 con 0x7f93e013bdf0 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient(hunting): _renew_subs 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.885+0000 7f93e4d13640 10 monclient(hunting): authenticate will time out at 2229.415865s 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93de59c640 1 --1- >> v1:172.21.15.106:6790/0 conn(0x7f93e0135870 0x7f93e0135c50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6790/0 says I am v1:172.21.15.106:53322/0 (socket says 172.21.15.106:53322) 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93de59c640 1 -- 172.21.15.106:0/2351995473 learned_addr learned my addr 172.21.15.106:0/2351995473 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 <== mon.2 v1:172.21.15.106:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3888103392 0 0) 0x7f93e006f2d0 con 0x7f93e0135870 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient(hunting): _negotiate 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:13.870 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient(hunting): my global_id is 294248 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 --> v1:172.21.15.106:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93cc003530 con 0x7f93e0135870 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 <== mon.2 v1:172.21.15.106:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2639585462 0 0) 0x7f93cc003530 con 0x7f93e0135870 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 >> v1:172.21.15.171:6792/0 conn(0x7f93e013bdf0 legacy=0x7f93e013e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 >> v1:172.21.15.171:6791/0 conn(0x7f93e01353b0 legacy=0x7f93e013a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: _finish_hunting 0 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 monclient: found mon.noname-b 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.106:6790/0 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 --> v1:172.21.15.106:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e00a3260 con 0x7f93e0135870 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: _finish_auth 0 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: _check_auth_tickets 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:16:13.871 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 <== mon.2 v1:172.21.15.106:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93d00017c0 con 0x7f93e0135870 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: dump: 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:13.872 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 5 monclient: authenticate success, global_id 294248 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 <== mon.2 v1:172.21.15.106:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f93d0001b20 con 0x7f93e0135870 2024-04-26T00:16:13.873 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: handle_config config(0 keys) 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: get_monmap_and_config success 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 1 -- 172.21.15.106:0/2351995473 <== mon.2 v1:172.21.15.106:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93d0001d50 con 0x7f93e0135870 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 4 set_mon_vals no callback set 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93dd59a640 10 monclient: dump: 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:13.874 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:13.875 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: shutdown 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- 172.21.15.106:0/2351995473 >> v1:172.21.15.106:6790/0 conn(0x7f93e0135870 legacy=0x7f93e0135c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- 172.21.15.106:0/2351995473 shutdown_connections 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- 172.21.15.106:0/2351995473 >> 172.21.15.106:0/2351995473 conn(0x7f93e00a64e0 msgr2=0x7f93e00a24f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- 172.21.15.106:0/2351995473 shutdown_connections 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- 172.21.15.106:0/2351995473 wait complete. 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: build_initial_monmap 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: monmap: 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:16:13.876 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:16:13.877 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 Processor -- start 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- start start 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: init 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: _reopen_session rank -1 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: _add_conns ranks=[5,1,0,4,3,6,2,8,7] 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient(hunting): picked mon.noname-h con 0x7f93e01353b0 addr v1:172.21.15.171:6791/0 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient(hunting): picked mon.noname-f con 0x7f93e0135870 addr v1:172.21.15.171:6789/0 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient(hunting): picked mon.noname-a con 0x7f93e013bdf0 addr v1:172.21.15.106:6789/0 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e0132bb0 con 0x7f93e013bdf0 2024-04-26T00:16:13.878 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e0133330 con 0x7f93e0135870 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- --> v1:172.21.15.171:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93e0135060 con 0x7f93e01353b0 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient(hunting): _renew_subs 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient(hunting): authenticate will time out at 2229.418901s 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93ded9d640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f93e013bdf0 0x7f93e01d2b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:35238/0 (socket says 172.21.15.106:35238) 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93ded9d640 1 -- 172.21.15.106:0/3922953512 learned_addr learned my addr 172.21.15.106:0/3922953512 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384101297 0 0) 0x7f93e0132bb0 con 0x7f93e013bdf0 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): my global_id is 274797 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93c0003530 con 0x7f93e013bdf0 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1582815323 0 0) 0x7f93c0003530 con 0x7f93e013bdf0 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.106:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f93e0132bb0 con 0x7f93e013bdf0 2024-04-26T00:16:13.879 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93d80019e0 con 0x7f93e013bdf0 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): dump: 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:13.880 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.1 v1:172.21.15.171:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 262600260 0 0) 0x7f93e0133330 con 0x7f93e0135870 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): my global_id is 294292 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.171:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93c0003530 con 0x7f93e0135870 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.5 v1:172.21.15.171:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3790593096 0 0) 0x7f93e0135060 con 0x7f93e01353b0 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _negotiate 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:13.881 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient(hunting): my global_id is 254975 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.171:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93e0133330 con 0x7f93e01353b0 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1072061117 0 0) 0x7f93e0132bb0 con 0x7f93e013bdf0 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 >> v1:172.21.15.171:6791/0 conn(0x7f93e01353b0 legacy=0x7f93e013b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 >> v1:172.21.15.171:6789/0 conn(0x7f93e0135870 legacy=0x7f93e01cf450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: _finish_hunting 0 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 monclient: found mon.a 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:16:13.882 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93e013bb20 con 0x7f93e013bdf0 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: _finish_auth 0 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: _check_auth_tickets 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 5 monclient: authenticate success, global_id 274797 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: _renew_subs 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.106:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f93e0133af0 con 0x7f93e013bdf0 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: _renew_subs 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.106:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f93e0134060 con 0x7f93e013bdf0 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f93d8003950 con 0x7f93e013bdf0 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: handle_config config(0 keys) 2024-04-26T00:16:13.883 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f93d8003ec0 con 0x7f93e013bdf0 2024-04-26T00:16:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:16:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:16:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.889+0000 7f93d6ffd640 10 monclient: dump: 2024-04-26T00:16:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.884 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:13.885 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93dcd99640 4 set_mon_vals no callback set 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93e4d13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93e4d13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93e4d13640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.106:6789/0 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f93d80040e0 con 0x7f93e013bdf0 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.106:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93c4005090 con 0x7f93e013bdf0 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f93d8045170 con 0x7f93e013bdf0 2024-04-26T00:16:13.886 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.893+0000 7f93de59c640 10 monclient: get_auth_request con 0x7f93c0037930 auth_method 0 2024-04-26T00:16:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.897+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mon.0 v1:172.21.15.106:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f93d80157a0 con 0x7f93e013bdf0 2024-04-26T00:16:13.887 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.897+0000 7f93d6ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:16:13.888 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:13.897+0000 7f93d6ffd640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:16:14.026 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.053+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 --> v1:172.21.15.171:6812/722422047 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f93c4000ba0 con 0x7f93c0037930 2024-04-26T00:16:14.032 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93d6ffd640 1 -- 172.21.15.106:0/3922953512 <== mgr.4118 v1:172.21.15.171:6812/722422047 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+78096 (unknown 2965378022 0 3613981086) 0x7f93c4000ba0 con 0x7f93c0037930 2024-04-26T00:16:14.034 INFO:teuthology.orchestra.run.smithi106.stdout: 2024-04-26T00:16:14.035 INFO:teuthology.orchestra.run.smithi106.stderr:dumped all 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 >> v1:172.21.15.171:6812/722422047 conn(0x7f93c0037930 legacy=0x7f93c0039df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 10 monclient: shutdown 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 >> v1:172.21.15.106:6789/0 conn(0x7f93e013bdf0 legacy=0x7f93e01d2b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 shutdown_connections 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 >> 172.21.15.106:0/3922953512 conn(0x7f93e00a64e0 msgr2=0x7f93e00a02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 shutdown_connections 2024-04-26T00:16:14.036 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.061+0000 7f93e4d13640 1 -- 172.21.15.106:0/3922953512 wait complete. 2024-04-26T00:16:14.051 INFO:teuthology.orchestra.run.smithi106.stdout:{"pg_ready":true,"pg_map":{"version":890,"stamp":"2024-04-26T00:16:13.970553+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":58,"acting":58,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":58,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":190224,"kb_used_data":7328,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566040816,"statfs":{"total":579820584960,"available":579625795584,"internally_reserved":0,"allocated":7503872,"data_stored":7980170,"data_compressed":1408224,"data_compressed_allocated":2154496,"data_compressed_original":4787688,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003814"},"pg_stats":[{"pgid":"10.4","version":"0'0","reported_seq":315,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:53.597770+0000","last_change":"2024-04-26T00:15:53.597789+0000","last_active":"2024-04-26T00:15:53.597770+0000","last_peered":"2024-04-26T00:15:53.597770+0000","last_clean":"2024-04-26T00:15:53.597770+0000","last_became_active":"2024-04-26T00:00:28.737377+0000","last_became_peered":"2024-04-26T00:00:28.737377+0000","last_unstale":"2024-04-26T00:15:53.597770+0000","last_undegraded":"2024-04-26T00:15:53.597770+0000","last_fullsized":"2024-04-26T00:15:53.597770+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:53.597696+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:53.597696+0000","last_clean_scrub_stamp":"2024-04-26T00:15:53.597696+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:09:08.114934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1],"acting":[0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:53.520928+0000","last_change":"2024-04-26T00:15:53.520983+0000","last_active":"2024-04-26T00:15:53.520928+0000","last_peered":"2024-04-26T00:15:53.520928+0000","last_clean":"2024-04-26T00:15:53.520928+0000","last_became_active":"2024-04-26T00:00:28.716880+0000","last_became_peered":"2024-04-26T00:00:28.716880+0000","last_unstale":"2024-04-26T00:15:53.520928+0000","last_undegraded":"2024-04-26T00:15:53.520928+0000","last_fullsized":"2024-04-26T00:15:53.520928+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:53.520727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:53.520727+0000","last_clean_scrub_stamp":"2024-04-26T00:15:53.520727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:04:46.784621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":305,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:52.197403+0000","last_change":"2024-04-26T00:15:52.197435+0000","last_active":"2024-04-26T00:15:52.197403+0000","last_peered":"2024-04-26T00:15:52.197403+0000","last_clean":"2024-04-26T00:15:52.197403+0000","last_became_active":"2024-04-26T00:00:28.737571+0000","last_became_peered":"2024-04-26T00:00:28.737571+0000","last_unstale":"2024-04-26T00:15:52.197403+0000","last_undegraded":"2024-04-26T00:15:52.197403+0000","last_fullsized":"2024-04-26T00:15:52.197403+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:52.197318+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:52.197318+0000","last_clean_scrub_stamp":"2024-04-26T00:15:52.197318+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T00:46:30.529291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1],"acting":[2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":189,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:54.536983+0000","last_change":"2024-04-26T00:15:54.537037+0000","last_active":"2024-04-26T00:15:54.536983+0000","last_peered":"2024-04-26T00:15:54.536983+0000","last_clean":"2024-04-26T00:15:54.536983+0000","last_became_active":"2024-04-26T00:00:28.725554+0000","last_became_peered":"2024-04-26T00:00:28.725554+0000","last_unstale":"2024-04-26T00:15:54.536983+0000","last_undegraded":"2024-04-26T00:15:54.536983+0000","last_fullsized":"2024-04-26T00:15:54.536983+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:54.536780+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:54.536780+0000","last_clean_scrub_stamp":"2024-04-26T00:15:54.536780+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:40:38.452786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":239,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:57.536294+0000","last_change":"2024-04-26T00:15:57.536351+0000","last_active":"2024-04-26T00:15:57.536294+0000","last_peered":"2024-04-26T00:15:57.536294+0000","last_clean":"2024-04-26T00:15:57.536294+0000","last_became_active":"2024-04-26T00:00:29.723663+0000","last_became_peered":"2024-04-26T00:00:29.723663+0000","last_unstale":"2024-04-26T00:15:57.536294+0000","last_undegraded":"2024-04-26T00:15:57.536294+0000","last_fullsized":"2024-04-26T00:15:57.536294+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:57.536110+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:57.536110+0000","last_clean_scrub_stamp":"2024-04-26T00:15:57.536110+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:05:06.405632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":303,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:51.509213+0000","last_change":"2024-04-26T00:15:51.509258+0000","last_active":"2024-04-26T00:15:51.509213+0000","last_peered":"2024-04-26T00:15:51.509213+0000","last_clean":"2024-04-26T00:15:51.509213+0000","last_became_active":"2024-04-26T00:00:28.718609+0000","last_became_peered":"2024-04-26T00:00:28.718609+0000","last_unstale":"2024-04-26T00:15:51.509213+0000","last_undegraded":"2024-04-26T00:15:51.509213+0000","last_fullsized":"2024-04-26T00:15:51.509213+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:51.509102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:51.509102+0000","last_clean_scrub_stamp":"2024-04-26T00:15:51.509102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:00:20.825833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":193,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:55.968102+0000","last_change":"2024-04-26T00:15:55.968168+0000","last_active":"2024-04-26T00:15:55.968102+0000","last_peered":"2024-04-26T00:15:55.968102+0000","last_clean":"2024-04-26T00:15:55.968102+0000","last_became_active":"2024-04-26T00:00:28.732236+0000","last_became_peered":"2024-04-26T00:00:28.732236+0000","last_unstale":"2024-04-26T00:15:55.968102+0000","last_undegraded":"2024-04-26T00:15:55.968102+0000","last_fullsized":"2024-04-26T00:15:55.968102+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:55.967888+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:55.967888+0000","last_clean_scrub_stamp":"2024-04-26T00:15:55.967888+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:47:43.305478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0],"acting":[3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":198,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:54.260592+0000","last_change":"2024-04-26T00:15:54.260650+0000","last_active":"2024-04-26T00:15:54.260592+0000","last_peered":"2024-04-26T00:15:54.260592+0000","last_clean":"2024-04-26T00:15:54.260592+0000","last_became_active":"2024-04-26T00:00:28.722170+0000","last_became_peered":"2024-04-26T00:00:28.722170+0000","last_unstale":"2024-04-26T00:15:54.260592+0000","last_undegraded":"2024-04-26T00:15:54.260592+0000","last_fullsized":"2024-04-26T00:15:54.260592+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:54.260385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:54.260385+0000","last_clean_scrub_stamp":"2024-04-26T00:15:54.260385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:29:14.962383+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":223,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:56.575732+0000","last_change":"2024-04-26T00:15:56.575732+0000","last_active":"2024-04-26T00:15:56.575732+0000","last_peered":"2024-04-26T00:15:56.575732+0000","last_clean":"2024-04-26T00:15:56.575732+0000","last_became_active":"2024-04-26T00:00:28.728808+0000","last_became_peered":"2024-04-26T00:00:28.728808+0000","last_unstale":"2024-04-26T00:15:56.575732+0000","last_undegraded":"2024-04-26T00:15:56.575732+0000","last_fullsized":"2024-04-26T00:15:56.575732+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:56.575459+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:56.575459+0000","last_clean_scrub_stamp":"2024-04-26T00:15:56.575459+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:58:50.587434+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,4],"acting":[5,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":227,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:52.993736+0000","last_change":"2024-04-26T00:15:52.993840+0000","last_active":"2024-04-26T00:15:52.993736+0000","last_peered":"2024-04-26T00:15:52.993736+0000","last_clean":"2024-04-26T00:15:52.993736+0000","last_became_active":"2024-04-26T00:00:28.726130+0000","last_became_peered":"2024-04-26T00:00:28.726130+0000","last_unstale":"2024-04-26T00:15:52.993736+0000","last_undegraded":"2024-04-26T00:15:52.993736+0000","last_fullsized":"2024-04-26T00:15:52.993736+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:52.993477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:52.993477+0000","last_clean_scrub_stamp":"2024-04-26T00:15:52.993477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:33:46.422021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":256,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:55.596901+0000","last_change":"2024-04-26T00:15:55.596959+0000","last_active":"2024-04-26T00:15:55.596901+0000","last_peered":"2024-04-26T00:15:55.596901+0000","last_clean":"2024-04-26T00:15:55.596901+0000","last_became_active":"2024-04-26T00:00:28.731390+0000","last_became_peered":"2024-04-26T00:00:28.731390+0000","last_unstale":"2024-04-26T00:15:55.596901+0000","last_undegraded":"2024-04-26T00:15:55.596901+0000","last_fullsized":"2024-04-26T00:15:55.596901+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:55.596709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:55.596709+0000","last_clean_scrub_stamp":"2024-04-26T00:15:55.596709+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:05:54.525126+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0],"acting":[4,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":198,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:56.252767+0000","last_change":"2024-04-26T00:15:56.252823+0000","last_active":"2024-04-26T00:15:56.252767+0000","last_peered":"2024-04-26T00:15:56.252767+0000","last_clean":"2024-04-26T00:15:56.252767+0000","last_became_active":"2024-04-26T00:00:28.723392+0000","last_became_peered":"2024-04-26T00:00:28.723392+0000","last_unstale":"2024-04-26T00:15:56.252767+0000","last_undegraded":"2024-04-26T00:15:56.252767+0000","last_fullsized":"2024-04-26T00:15:56.252767+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:56.252536+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:56.252536+0000","last_clean_scrub_stamp":"2024-04-26T00:15:56.252536+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T06:11:28.866268+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":199,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:57.205600+0000","last_change":"2024-04-26T00:15:57.205655+0000","last_active":"2024-04-26T00:15:57.205600+0000","last_peered":"2024-04-26T00:15:57.205600+0000","last_clean":"2024-04-26T00:15:57.205600+0000","last_became_active":"2024-04-26T00:00:28.732291+0000","last_became_peered":"2024-04-26T00:00:28.732291+0000","last_unstale":"2024-04-26T00:15:57.205600+0000","last_undegraded":"2024-04-26T00:15:57.205600+0000","last_fullsized":"2024-04-26T00:15:57.205600+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:57.205398+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:57.205398+0000","last_clean_scrub_stamp":"2024-04-26T00:15:57.205398+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:37:43.344849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,0],"acting":[1,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":316,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:52.554927+0000","last_change":"2024-04-26T00:15:52.554983+0000","last_active":"2024-04-26T00:15:52.554927+0000","last_peered":"2024-04-26T00:15:52.554927+0000","last_clean":"2024-04-26T00:15:52.554927+0000","last_became_active":"2024-04-26T00:00:28.730684+0000","last_became_peered":"2024-04-26T00:00:28.730684+0000","last_unstale":"2024-04-26T00:15:52.554927+0000","last_undegraded":"2024-04-26T00:15:52.554927+0000","last_fullsized":"2024-04-26T00:15:52.554927+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:52.554796+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:52.554796+0000","last_clean_scrub_stamp":"2024-04-26T00:15:52.554796+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:57:33.624751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":200,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:53.149127+0000","last_change":"2024-04-26T00:15:53.149150+0000","last_active":"2024-04-26T00:15:53.149127+0000","last_peered":"2024-04-26T00:15:53.149127+0000","last_clean":"2024-04-26T00:15:53.149127+0000","last_became_active":"2024-04-26T00:00:29.727993+0000","last_became_peered":"2024-04-26T00:00:29.727993+0000","last_unstale":"2024-04-26T00:15:53.149127+0000","last_undegraded":"2024-04-26T00:15:53.149127+0000","last_fullsized":"2024-04-26T00:15:53.149127+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:53.149041+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:53.149041+0000","last_clean_scrub_stamp":"2024-04-26T00:15:53.149041+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:42:32.654251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,1],"acting":[2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":198,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:52.239052+0000","last_change":"2024-04-26T00:15:52.239073+0000","last_active":"2024-04-26T00:15:52.239052+0000","last_peered":"2024-04-26T00:15:52.239052+0000","last_clean":"2024-04-26T00:15:52.239052+0000","last_became_active":"2024-04-26T00:00:28.711533+0000","last_became_peered":"2024-04-26T00:00:28.711533+0000","last_unstale":"2024-04-26T00:15:52.239052+0000","last_undegraded":"2024-04-26T00:15:52.239052+0000","last_fullsized":"2024-04-26T00:15:52.239052+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:52.238964+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:52.238964+0000","last_clean_scrub_stamp":"2024-04-26T00:15:52.238964+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T10:33:31.776995+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":445,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:54.002908+0000","last_change":"2024-04-26T00:15:54.003014+0000","last_active":"2024-04-26T00:15:54.002908+0000","last_peered":"2024-04-26T00:15:54.002908+0000","last_clean":"2024-04-26T00:15:54.002908+0000","last_became_active":"2024-04-26T00:00:28.731119+0000","last_became_peered":"2024-04-26T00:00:28.731119+0000","last_unstale":"2024-04-26T00:15:54.002908+0000","last_undegraded":"2024-04-26T00:15:54.002908+0000","last_fullsized":"2024-04-26T00:15:54.002908+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:54.002677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:54.002677+0000","last_clean_scrub_stamp":"2024-04-26T00:15:54.002677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T08:11:35.914946+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":440,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:58.515372+0000","last_change":"2024-04-26T00:15:58.515372+0000","last_active":"2024-04-26T00:15:58.515372+0000","last_peered":"2024-04-26T00:15:58.515372+0000","last_clean":"2024-04-26T00:15:58.515372+0000","last_became_active":"2024-04-26T00:00:29.724281+0000","last_became_peered":"2024-04-26T00:00:29.724281+0000","last_unstale":"2024-04-26T00:15:58.515372+0000","last_undegraded":"2024-04-26T00:15:58.515372+0000","last_fullsized":"2024-04-26T00:15:58.515372+0000","mapping_epoch":168,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":169,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:58.515005+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:58.515005+0000","last_clean_scrub_stamp":"2024-04-26T00:15:58.515005+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T04:43:58.632259+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":202,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:53.594949+0000","last_change":"2024-04-26T00:15:53.595001+0000","last_active":"2024-04-26T00:15:53.594949+0000","last_peered":"2024-04-26T00:15:53.594949+0000","last_clean":"2024-04-26T00:15:53.594949+0000","last_became_active":"2024-04-26T00:00:28.719074+0000","last_became_peered":"2024-04-26T00:00:28.719074+0000","last_unstale":"2024-04-26T00:15:53.594949+0000","last_undegraded":"2024-04-26T00:15:53.594949+0000","last_fullsized":"2024-04-26T00:15:53.594949+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:53.594777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:53.594777+0000","last_clean_scrub_stamp":"2024-04-26T00:15:53.594777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T02:18:41.344658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":198,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:53.286258+0000","last_change":"2024-04-26T00:15:53.286277+0000","last_active":"2024-04-26T00:15:53.286258+0000","last_peered":"2024-04-26T00:15:53.286258+0000","last_clean":"2024-04-26T00:15:53.286258+0000","last_became_active":"2024-04-26T00:00:28.717935+0000","last_became_peered":"2024-04-26T00:00:28.717935+0000","last_unstale":"2024-04-26T00:15:53.286258+0000","last_undegraded":"2024-04-26T00:15:53.286258+0000","last_fullsized":"2024-04-26T00:15:53.286258+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:53.286179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:53.286179+0000","last_clean_scrub_stamp":"2024-04-26T00:15:53.286179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T01:28:28.082797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.0","version":"256'163","reported_seq":724,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:56.974788+0000","last_change":"2024-04-26T00:15:56.974866+0000","last_active":"2024-04-26T00:15:56.974788+0000","last_peered":"2024-04-26T00:15:56.974788+0000","last_clean":"2024-04-26T00:15:56.974788+0000","last_became_active":"2024-04-26T00:00:31.558409+0000","last_became_peered":"2024-04-26T00:00:31.558409+0000","last_unstale":"2024-04-26T00:15:56.974788+0000","last_undegraded":"2024-04-26T00:15:56.974788+0000","last_fullsized":"2024-04-26T00:15:56.974788+0000","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"256'163","last_scrub_stamp":"2024-04-26T00:15:56.974615+0000","last_deep_scrub":"256'163","last_deep_scrub_stamp":"2024-04-26T00:15:56.974615+0000","last_clean_scrub_stamp":"2024-04-26T00:15:56.974615+0000","objects_scrubbed":2,"log_size":163,"log_dups_size":0,"ondisk_log_size":163,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T07:30:57.842409+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":198,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:55.276995+0000","last_change":"2024-04-26T00:15:55.277051+0000","last_active":"2024-04-26T00:15:55.276995+0000","last_peered":"2024-04-26T00:15:55.276995+0000","last_clean":"2024-04-26T00:15:55.276995+0000","last_became_active":"2024-04-26T00:00:28.722258+0000","last_became_peered":"2024-04-26T00:00:28.722258+0000","last_unstale":"2024-04-26T00:15:55.276995+0000","last_undegraded":"2024-04-26T00:15:55.276995+0000","last_fullsized":"2024-04-26T00:15:55.276995+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:55.276807+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:55.276807+0000","last_clean_scrub_stamp":"2024-04-26T00:15:55.276807+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T09:36:03.770570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":202,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:54.580227+0000","last_change":"2024-04-26T00:15:54.580284+0000","last_active":"2024-04-26T00:15:54.580227+0000","last_peered":"2024-04-26T00:15:54.580227+0000","last_clean":"2024-04-26T00:15:54.580227+0000","last_became_active":"2024-04-26T00:00:28.720392+0000","last_became_peered":"2024-04-26T00:00:28.720392+0000","last_unstale":"2024-04-26T00:15:54.580227+0000","last_undegraded":"2024-04-26T00:15:54.580227+0000","last_fullsized":"2024-04-26T00:15:54.580227+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:54.580039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:54.580039+0000","last_clean_scrub_stamp":"2024-04-26T00:15:54.580039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T05:27:37.902076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":192,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:55.013629+0000","last_change":"2024-04-26T00:15:55.013683+0000","last_active":"2024-04-26T00:15:55.013629+0000","last_peered":"2024-04-26T00:15:55.013629+0000","last_clean":"2024-04-26T00:15:55.013629+0000","last_became_active":"2024-04-26T00:00:28.731039+0000","last_became_peered":"2024-04-26T00:00:28.731039+0000","last_unstale":"2024-04-26T00:15:55.013629+0000","last_undegraded":"2024-04-26T00:15:55.013629+0000","last_fullsized":"2024-04-26T00:15:55.013629+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:55.013447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:55.013447+0000","last_clean_scrub_stamp":"2024-04-26T00:15:55.013447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T11:46:02.466702+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":449,"reported_epoch":256,"state":"active+clean","last_fresh":"2024-04-26T00:15:55.527306+0000","last_change":"2024-04-26T00:15:55.527364+0000","last_active":"2024-04-26T00:15:55.527306+0000","last_peered":"2024-04-26T00:15:55.527306+0000","last_clean":"2024-04-26T00:15:55.527306+0000","last_became_active":"2024-04-26T00:00:28.725623+0000","last_became_peered":"2024-04-26T00:00:28.725623+0000","last_unstale":"2024-04-26T00:15:55.527306+0000","last_undegraded":"2024-04-26T00:15:55.527306+0000","last_fullsized":"2024-04-26T00:15:55.527306+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-26T00:15:55.527119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-26T00:15:55.527119+0000","last_clean_scrub_stamp":"2024-04-26T00:15:55.527119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-27T03:05:26.259887+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":10,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":6},{"poolid":9,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":146,"num_read_kb":127,"num_write":209,"num_write_kb":3462,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1057856,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":147456,"data_stored":1586784,"data_compressed":24239,"data_compressed_allocated":98304,"data_compressed_original":1551848,"omap_allocated":0,"internal_metadata":0},"log_size":163,"ondisk_log_size":163,"up":2,"acting":2,"num_store_stats":3},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640515,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":11,"seq":47244640514,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":11,"seq":47244640514,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239126,"data_compressed_allocated":380928,"data_compressed_original":1138688,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640513,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28220,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343620,"statfs":{"total":96636764160,"available":96607866880,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1286144,"data_stored":1682647,"data_compressed":239646,"data_compressed_allocated":380928,"data_compressed_original":1142248,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":11,"seq":47244640514,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32380,"kb_used_data":1204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339460,"statfs":{"total":96636764160,"available":96603607040,"internally_reserved":0,"allocated":1232896,"data_stored":1153719,"data_compressed":232363,"data_compressed_allocated":348160,"data_compressed_original":626688,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":528928,"data_compressed":10193,"data_compressed_allocated":32768,"data_compressed_original":524288,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":7283,"data_compressed_allocated":32768,"data_compressed_original":515560,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6763,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-26T00:16:14.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-26T00:16:14.175 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.201+0000 7f21fd3dd640 10 monclient: get_monmap_and_config 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.201+0000 7f21fd3dd640 10 monclient: build_initial_monmap 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.201+0000 7f21fd3dd640 10 monclient: monmap: 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-26T00:16:14.205331+0000 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-26T00:16:14.205331+0000 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:16:14.176 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:16:14.177 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:16:14.177 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:16:14.177 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:16:14.177 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.201+0000 7f21fd3dd640 1 Processor -- start 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.201+0000 7f21fd3dd640 1 -- start start 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.201+0000 7f21fd3dd640 10 monclient: init 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: _reopen_session rank -1 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: _add_conns ranks=[4,0,1,2,7,3,5,8,6] 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): picked mon.noname-c con 0x7f21f8134970 addr v1:172.21.15.106:6791/0 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): picked mon.noname-a con 0x7f21f80a4820 addr v1:172.21.15.106:6789/0 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): picked mon.noname-f con 0x7f21f813e200 addr v1:172.21.15.171:6789/0 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- --> v1:172.21.15.106:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f806dd40 con 0x7f21f80a4820 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- --> v1:172.21.15.171:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f80a2b10 con 0x7f21f813e200 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f80a2df0 con 0x7f21f8134970 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): _renew_subs 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): authenticate will time out at 2229.732522s 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f6ffd640 1 --1- >> v1:172.21.15.106:6791/0 conn(0x7f21f8134970 0x7f21f8134d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6791/0 says I am v1:172.21.15.106:57212/0 (socket says 172.21.15.106:57212) 2024-04-26T00:16:14.184 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f6ffd640 1 -- 172.21.15.106:0/3390010962 learned_addr learned my addr 172.21.15.106:0/3390010962 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f67fc640 1 --1- >> v1:172.21.15.106:6789/0 conn(0x7f21f80a4820 0x7f21f813cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.106:6789/0 says I am v1:172.21.15.106:35240/0 (socket says 172.21.15.106:35240) 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 <== mon.0 v1:172.21.15.106:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646860370 0 0) 0x7f21f806dd40 con 0x7f21f80a4820 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): my global_id is 274806 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 --> v1:172.21.15.106:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21e4003530 con 0x7f21f80a4820 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1004955436 0 0) 0x7f21f80a2df0 con 0x7f21f8134970 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): _negotiate 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient(hunting): my global_id is 274873 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21f806dd40 con 0x7f21f8134970 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 <== mon.0 v1:172.21.15.106:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3602458460 0 0) 0x7f21e4003530 con 0x7f21f80a4820 2024-04-26T00:16:14.185 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 >> v1:172.21.15.106:6791/0 conn(0x7f21f8134970 legacy=0x7f21f8134d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 >> v1:172.21.15.171:6789/0 conn(0x7f21f813e200 legacy=0x7f21f81405f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: _finish_hunting 0 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 monclient: found mon.noname-a 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.106:6789/0 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 --> v1:172.21.15.106:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f80a30d0 con 0x7f21f80a4820 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: _finish_auth 0 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: _check_auth_tickets 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 <== mon.0 v1:172.21.15.106:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21e00017c0 con 0x7f21f80a4820 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 5 monclient: authenticate success, global_id 274806 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:16:14.186 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: dump: 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:14.187 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 <== mon.0 v1:172.21.15.106:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21e0001a70 con 0x7f21f80a4820 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: handle_config config(0 keys) 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: get_monmap_and_config success 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 1 -- 172.21.15.106:0/3390010962 <== mon.0 v1:172.21.15.106:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21e0004b30 con 0x7f21f80a4820 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 4 set_mon_vals no callback set 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f5ffb640 10 monclient: dump: 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.188 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: shutdown 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3390010962 >> v1:172.21.15.106:6789/0 conn(0x7f21f80a4820 legacy=0x7f21f813cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3390010962 shutdown_connections 2024-04-26T00:16:14.189 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3390010962 >> 172.21.15.106:0/3390010962 conn(0x7f21f80a9e20 msgr2=0x7f21f80aa200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3390010962 shutdown_connections 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3390010962 wait complete. 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: build_initial_monmap 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: monmap: 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 0 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 0.000000 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:created 0.000000 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 0 (unknown) 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.noname-a 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.noname-f 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.noname-b 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.noname-g 2024-04-26T00:16:14.190 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.noname-c 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.noname-h 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.noname-d 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.noname-i 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.noname-e 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 Processor -- start 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- start start 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: init 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: _reopen_session rank -1 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient: _add_conns ranks=[6,7,4,8,1,2,5,0,3] 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): picked mon.noname-d con 0x7f21f80a4820 addr v1:172.21.15.106:6792/0 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): picked mon.noname-i con 0x7f21f8134970 addr v1:172.21.15.171:6792/0 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): picked mon.noname-c con 0x7f21f813e200 addr v1:172.21.15.106:6791/0 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- --> v1:172.21.15.106:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f80a1a40 con 0x7f21f813e200 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- --> v1:172.21.15.106:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f809c0c0 con 0x7f21f80a4820 2024-04-26T00:16:14.191 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 1 -- --> v1:172.21.15.171:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f21f809db10 con 0x7f21f8134970 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): _renew_subs 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21fd3dd640 10 monclient(hunting): authenticate will time out at 2229.735749s 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f6ffd640 1 --1- >> v1:172.21.15.106:6792/0 conn(0x7f21f80a4820 0x7f21f812a7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.106:6792/0 says I am v1:172.21.15.106:38384/0 (socket says 172.21.15.106:38384) 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.205+0000 7f21f6ffd640 1 -- 172.21.15.106:0/3056746392 learned_addr learned my addr 172.21.15.106:0/3056746392 (peer_addr_for_me v1:172.21.15.106:0/0) 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 74504613 0 0) 0x7f21f809c0c0 con 0x7f21f80a4820 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): my global_id is 254976 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21d8003530 con 0x7f21f80a4820 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.4 v1:172.21.15.106:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 909338179 0 0) 0x7f21f80a1a40 con 0x7f21f813e200 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): my global_id is 274882 2024-04-26T00:16:14.192 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21f809c0c0 con 0x7f21f813e200 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3390167292 0 0) 0x7f21d8003530 con 0x7f21f80a4820 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21f80a1a40 con 0x7f21f80a4820 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21f00017e0 con 0x7f21f80a4820 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): dump: 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:14.193 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _finish_auth 0 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.4 v1:172.21.15.106:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3958410728 0 0) 0x7f21f809c0c0 con 0x7f21f813e200 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f21d8003530 con 0x7f21f813e200 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.4 v1:172.21.15.106:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21e8001870 con 0x7f21f813e200 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): dump: 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:14.194 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.7 v1:172.21.15.171:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3638144453 0 0) 0x7f21f809db10 con 0x7f21f8134970 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _negotiate 2024-04-26T00:16:14.195 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _init_auth method 2 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient(hunting): my global_id is 147256 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.171:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f21f809c0c0 con 0x7f21f8134970 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4073496633 0 0) 0x7f21f80a1a40 con 0x7f21f80a4820 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 >> v1:172.21.15.171:6792/0 conn(0x7f21f8134970 legacy=0x7f21f81d1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 >> v1:172.21.15.106:6791/0 conn(0x7f21f813e200 legacy=0x7f21f81d4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: _finish_hunting 0 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 monclient: found mon.d 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f809cc20 con 0x7f21f80a4820 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: _finish_auth 0 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: _check_auth_tickets 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-04-26T00:16:14.196 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 5 monclient: authenticate success, global_id 254976 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 10 monclient: _renew_subs 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f21f809ed90 con 0x7f21f80a4820 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 10 monclient: _renew_subs 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f21f809b9b0 con 0x7f21f80a4820 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f21f0004e20 con 0x7f21f80a4820 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: handle_config config(0 keys) 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 792288016 0 0) 0x7f21f0005310 con 0x7f21f80a4820 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21f57fa640 4 set_mon_vals no callback set 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 10 monclient: dump: 2024-04-26T00:16:14.197 INFO:teuthology.orchestra.run.smithi106.stderr:epoch 1 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:fsid 91a11040-4c8b-4137-ad71-c18376365faa 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:last_changed 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:created 2024-04-25T23:54:15.226551+0000 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:min_mon_release 19 (squid) 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:election_strategy: 1 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:0: v1:172.21.15.106:6789/0 mon.a 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:1: v1:172.21.15.171:6789/0 mon.f 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:2: v1:172.21.15.106:6790/0 mon.b 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:3: v1:172.21.15.171:6790/0 mon.g 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:4: v1:172.21.15.106:6791/0 mon.c 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:5: v1:172.21.15.171:6791/0 mon.h 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:6: v1:172.21.15.106:6792/0 mon.d 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:7: v1:172.21.15.171:6792/0 mon.i 2024-04-26T00:16:14.198 INFO:teuthology.orchestra.run.smithi106.stderr:8: v1:172.21.15.106:6793/0 mon.e 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 7 ==== mgrmap(e 5) ==== 44018+0+0 (unknown 4091425241 0 0) 0x7f21f00100b0 con 0x7f21f80a4820 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21dc005090 con 0x7f21f80a4820 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 8 ==== osd_map(256..256 src has 228..256) ==== 6817+0+0 (unknown 3485206779 0 0) 0x7f21f0045640 con 0x7f21f80a4820 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.209+0000 7f21f67fc640 10 monclient: get_auth_request con 0x7f21d8037e90 auth_method 0 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.213+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+177576 (unknown 1092875540 0 3292399231) 0x7f21f0015c10 con 0x7f21f80a4820 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.213+0000 7f21ef7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-04-26T00:16:14.199 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.213+0000 7f21ef7fe640 10 monclient: _finish_command 1 = system:0 2024-04-26T00:16:14.372 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.397+0000 7f21fd3dd640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-04-26T00:16:14.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.397+0000 7f21fd3dd640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-04-26T00:16:14.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.397+0000 7f21fd3dd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.106:6792/0 2024-04-26T00:16:14.373 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.397+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 --> v1:172.21.15.106:6792/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f21dc005380 con 0x7f21f80a4820 2024-04-26T00:16:14.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.449+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f21f00117c0 con 0x7f21f80a4820 2024-04-26T00:16:14.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.449+0000 7f21ef7fe640 10 monclient: handle_config config(1 keys) 2024-04-26T00:16:14.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.449+0000 7f21f57fa640 4 set_mon_vals no callback set 2024-04-26T00:16:14.424 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.449+0000 7f21f57fa640 10 set_mon_vals mon_health_to_clog = false 2024-04-26T00:16:14.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.449+0000 7f21ef7fe640 1 -- 172.21.15.106:0/3056746392 <== mon.6 v1:172.21.15.106:6792/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v4)=0 v4) ==== 123+0+0 (unknown 1766731237 0 0) 0x7f21f0015510 con 0x7f21f80a4820 2024-04-26T00:16:14.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.449+0000 7f21ef7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-04-26T00:16:14.425 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.449+0000 7f21ef7fe640 10 monclient: _finish_command 2 = system:0 2024-04-26T00:16:14.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 >> v1:172.21.15.171:6812/722422047 conn(0x7f21d8037e90 legacy=0x7f21d803a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.427 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 10 monclient: shutdown 2024-04-26T00:16:14.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 20 monclient: shutdown discarding 0 pending message(s) 2024-04-26T00:16:14.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 >> v1:172.21.15.106:6792/0 conn(0x7f21f80a4820 legacy=0x7f21f812a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-26T00:16:14.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 shutdown_connections 2024-04-26T00:16:14.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 >> 172.21.15.106:0/3056746392 conn(0x7f21f80a9e20 msgr2=0x7f21f8130c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-26T00:16:14.428 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 shutdown_connections 2024-04-26T00:16:14.429 INFO:teuthology.orchestra.run.smithi106.stderr:2024-04-26T00:16:14.453+0000 7f21fd3dd640 1 -- 172.21.15.106:0/3056746392 wait complete. 2024-04-26T00:16:14.443 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-26T00:16:14.443 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-26T00:16:14.443 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-26T00:16:14.444 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:14.529 INFO:tasks.ceph.osd.0:Stopped 2024-04-26T00:16:14.529 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-26T00:16:14.529 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:14.622 INFO:tasks.ceph.osd.1:Stopped 2024-04-26T00:16:14.622 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-26T00:16:14.622 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:14.716 INFO:tasks.ceph.osd.2:Stopped 2024-04-26T00:16:14.716 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-26T00:16:14.717 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:14.782 INFO:tasks.ceph.osd.3:Stopped 2024-04-26T00:16:14.782 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-26T00:16:14.782 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:14.871 INFO:tasks.ceph.osd.4:Stopped 2024-04-26T00:16:14.871 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-26T00:16:14.872 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:14.958 INFO:tasks.ceph.osd.5:Stopped 2024-04-26T00:16:14.958 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-26T00:16:14.958 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-26T00:16:14.958 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:14.995 INFO:tasks.ceph.mgr.x:Stopped 2024-04-26T00:16:14.995 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-26T00:16:14.995 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-26T00:16:14.996 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.029 INFO:tasks.ceph.mon.a:Stopped 2024-04-26T00:16:15.030 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-26T00:16:15.030 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.089 INFO:tasks.ceph.mon.b:Stopped 2024-04-26T00:16:15.089 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-26T00:16:15.090 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.156 INFO:tasks.ceph.mon.c:Stopped 2024-04-26T00:16:15.156 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-04-26T00:16:15.156 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.227 INFO:tasks.ceph.mon.d:Stopped 2024-04-26T00:16:15.228 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-04-26T00:16:15.228 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.283 INFO:tasks.ceph.mon.e:Stopped 2024-04-26T00:16:15.284 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-04-26T00:16:15.284 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.305 INFO:tasks.ceph.mon.f:Stopped 2024-04-26T00:16:15.305 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-04-26T00:16:15.305 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.372 INFO:tasks.ceph.mon.g:Stopped 2024-04-26T00:16:15.372 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-04-26T00:16:15.372 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.441 INFO:tasks.ceph.mon.h:Stopped 2024-04-26T00:16:15.441 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-04-26T00:16:15.441 INFO:teuthology.orchestra.run:waiting for 300 2024-04-26T00:16:15.523 INFO:tasks.ceph.mon.i:Stopped 2024-04-26T00:16:15.524 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-26T00:16:15.524 DEBUG:teuthology.orchestra.run.smithi106:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'but it is still running' | egrep -v 'overall HEALTH_' | egrep -v '\(PG_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(AUTH_BAD_CAPS\)' | head -n 1 2024-04-26T00:16:15.544 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T00:16:15.544 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-26T00:16:16.008 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T00:16:16.008 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-26T00:16:16.251 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T00:16:16.252 DEBUG:teuthology.orchestra.run.smithi106:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-26T00:16:16.547 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-26T00:16:16.547 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-26T00:16:16.871 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-26T00:16:16.871 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-26T00:16:17.094 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-04-26T00:16:17.094 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-26T00:16:17.260 INFO:tasks.ceph:Archiving mon data... 2024-04-26T00:16:17.262 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.a.tgz 2024-04-26T00:16:17.262 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-26T00:16:17.268 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.vFJr7FbYui 2024-04-26T00:16:17.268 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.vFJr7FbYui 2024-04-26T00:16:17.494 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.vFJr7FbYui 2024-04-26T00:16:17.558 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.vFJr7FbYui is 1MB 2024-04-26T00:16:17.631 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.vFJr7FbYui 2024-04-26T00:16:17.637 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.b.tgz 2024-04-26T00:16:17.637 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-26T00:16:17.685 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.3ucwMPgjNq 2024-04-26T00:16:17.686 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.3ucwMPgjNq 2024-04-26T00:16:17.913 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.3ucwMPgjNq 2024-04-26T00:16:17.981 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.3ucwMPgjNq is 1MB 2024-04-26T00:16:18.051 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.3ucwMPgjNq 2024-04-26T00:16:18.056 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.c.tgz 2024-04-26T00:16:18.057 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-26T00:16:18.104 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.RdILo2aqnX 2024-04-26T00:16:18.105 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RdILo2aqnX 2024-04-26T00:16:18.328 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.RdILo2aqnX 2024-04-26T00:16:18.393 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.RdILo2aqnX is 1MB 2024-04-26T00:16:18.463 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.RdILo2aqnX 2024-04-26T00:16:18.469 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-d to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.d.tgz 2024-04-26T00:16:18.469 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-26T00:16:18.517 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.q1jZjZFa61 2024-04-26T00:16:18.517 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.q1jZjZFa61 2024-04-26T00:16:18.732 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.q1jZjZFa61 2024-04-26T00:16:18.796 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.q1jZjZFa61 is 1MB 2024-04-26T00:16:18.867 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.q1jZjZFa61 2024-04-26T00:16:18.872 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/mon/ceph-e to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.e.tgz 2024-04-26T00:16:18.872 DEBUG:teuthology.orchestra.run.smithi106:> mktemp 2024-04-26T00:16:18.920 INFO:teuthology.orchestra.run.smithi106.stdout:/tmp/tmp.ZMBoD6Mrm1 2024-04-26T00:16:18.921 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.ZMBoD6Mrm1 2024-04-26T00:16:19.132 DEBUG:teuthology.orchestra.run.smithi106:> sudo chmod 0666 /tmp/tmp.ZMBoD6Mrm1 2024-04-26T00:16:19.194 DEBUG:teuthology.orchestra.remote:smithi106:/tmp/tmp.ZMBoD6Mrm1 is 1MB 2024-04-26T00:16:19.303 DEBUG:teuthology.orchestra.run.smithi106:> rm -fr /tmp/tmp.ZMBoD6Mrm1 2024-04-26T00:16:19.309 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-f to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.f.tgz 2024-04-26T00:16:19.309 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-26T00:16:19.315 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.bQvjx6FqQt 2024-04-26T00:16:19.315 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.bQvjx6FqQt 2024-04-26T00:16:19.545 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.bQvjx6FqQt 2024-04-26T00:16:19.610 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.bQvjx6FqQt is 1MB 2024-04-26T00:16:19.680 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.bQvjx6FqQt 2024-04-26T00:16:19.686 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-g to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.g.tgz 2024-04-26T00:16:19.686 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-26T00:16:19.734 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.awKKuUzJLb 2024-04-26T00:16:19.735 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.awKKuUzJLb 2024-04-26T00:16:19.965 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.awKKuUzJLb 2024-04-26T00:16:20.030 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.awKKuUzJLb is 1MB 2024-04-26T00:16:20.104 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.awKKuUzJLb 2024-04-26T00:16:20.110 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-h to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.h.tgz 2024-04-26T00:16:20.110 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-26T00:16:20.158 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.gI7d7bscDX 2024-04-26T00:16:20.159 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.gI7d7bscDX 2024-04-26T00:16:20.382 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.gI7d7bscDX 2024-04-26T00:16:20.450 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.gI7d7bscDX is 1MB 2024-04-26T00:16:20.520 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.gI7d7bscDX 2024-04-26T00:16:20.526 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-i to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/data/mon.i.tgz 2024-04-26T00:16:20.526 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-04-26T00:16:20.576 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.xH1qQnHacY 2024-04-26T00:16:20.576 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.xH1qQnHacY 2024-04-26T00:16:20.805 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.xH1qQnHacY 2024-04-26T00:16:20.866 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.xH1qQnHacY is 1MB 2024-04-26T00:16:20.940 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.xH1qQnHacY 2024-04-26T00:16:20.946 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-26T00:16:20.946 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T00:16:20.949 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-26T00:16:21.009 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T00:16:21.050 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-26T00:16:21.050 INFO:tasks.ceph:Archiving crash dumps... 2024-04-26T00:16:21.052 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/remote/smithi106/crash 2024-04-26T00:16:21.053 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T00:16:21.070 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/remote/smithi171/crash 2024-04-26T00:16:21.071 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-26T00:16:21.106 INFO:tasks.ceph:Compressing logs... 2024-04-26T00:16:21.107 DEBUG:teuthology.orchestra.run.smithi106:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T00:16:21.118 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-26T00:16:21.165 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27627.log 2024-04-26T00:16:21.166 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32099.log 2024-04-26T00:16:21.166 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28322.log 2024-04-26T00:16:21.166 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32099.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.27627.log.gz 2024-04-26T00:16:21.167 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29641.log 2024-04-26T00:16:21.167 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32099.log.gz 2024-04-26T00:16:21.167 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27705.log 2024-04-26T00:16:21.168 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28322.log: /var/log/ceph/ceph-client.admin.29641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32204.log 2024-04-26T00:16:21.168 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34123.log 2024-04-26T00:16:21.168 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29641.log.gz 2024-04-26T00:16:21.168 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28348.log 2024-04-26T00:16:21.168 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.27705.log.gz 2024-04-26T00:16:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34123.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32204.log.gz 2024-04-26T00:16:21.173 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29302.log 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28322.log.gz 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28348.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34123.log.gz 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27497.log 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30566.log 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28348.log.gz 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27497.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29302.log.gz 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32177.log 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35335.log 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27497.log.gz 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9%/var/log/ceph/ceph-client.admin.32177.log: -- replaced with /var/log/ceph/ceph-client.admin.30566.log.gz 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29693.log 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32794.log 2024-04-26T00:16:21.174 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32177.log.gz 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29693.log: gzip -5 --verbose -- 89.3% /var/log/ceph/ceph-client.admin.28017.log 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35335.log.gz 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.29693.log.gz 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28686.log 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28790.log 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32794.log.gz 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28686.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30808.log 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28017.log.gz 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28686.log.gz 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32742.log 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34496.log 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30808.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.28790.log.gz 2024-04-26T00:16:21.175 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31328.log 2024-04-26T00:16:21.325 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30808.log.gz 2024-04-26T00:16:21.325 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34496.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32742.log.gz 2024-04-26T00:16:21.325 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36234.log 2024-04-26T00:16:21.325 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32334.log 2024-04-26T00:16:21.325 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34496.log.gz 2024-04-26T00:16:21.325 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30722.log 2024-04-26T00:16:21.325 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31328.log.gz 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.36234.log.gz 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26832.log 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32151.log 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32334.log.gz 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31094.log 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30722.log.gz 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.26832.log.gz 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32151.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.31094.log: -- /var/log/ceph/ceph-client.admin.30227.log 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32151.log.gz 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27058.log 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31094.log.gz 2024-04-26T00:16:21.326 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30227.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29771.log 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27058.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30227.log.gz -5 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28296.log 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27058.log.gz 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30123.log 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36260.log 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29771.log.gz 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30123.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28296.log.gz 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31302.log 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35543.log 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30123.log.gz 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27783.log 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.36260.log.gz 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35543.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31302.log.gz 2024-04-26T00:16:21.327 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31380.log 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35017.log 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35543.log.gz 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34913.log 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27783.log.gz 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35017.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31380.log.gz 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36286.log 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29380.log 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34913.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35017.log.gz 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27913.log 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34913.log.gz 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36626.log 89.0% 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36286.log.gz 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27913.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29380.log.gz 2024-04-26T00:16:21.328 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28660.log 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36626.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27913.log.gz 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29224.log 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35179.log 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.36626.log.gz 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30860.log 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28660.log.gz 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29224.log.gz 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27419.log 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32716.log 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35179.log.gz 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27419.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30860.log.gz 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27679.log 2024-04-26T00:16:21.329 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32716.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27419.log.gz 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31859.log 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33237.log 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32716.log.gz 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31859.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30748.log 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27679.log.gz 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31859.log.gz 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32360.log 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35147.log 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33237.log.gz 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32360.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30748.log.gz 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34939.log 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33002.log 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32360.log.gz 2024-04-26T00:16:21.330 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30410.log 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.35147.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33002.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34939.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35309.log 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32612.log 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33002.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27393.log 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30410.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32612.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35309.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27809.log 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32950.log 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32612.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34522.log 86.8% 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.27393.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32950.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27809.log.gz 2024-04-26T00:16:21.331 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29927.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.32950.log.gz --verbose 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr: --/var/log/ceph/ceph-client.admin.34522.log: /var/log/ceph/ceph-client.admin.33837.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27237.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34522.log.gz 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33837.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29927.log.gz 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33549.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33653.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33837.log.gz 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28192.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27237.log.gz 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33653.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33549.log.gz 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26915.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5/var/log/ceph/ceph-client.admin.28192.log: --verbose -- /var/log/ceph/ceph-client.admin.30436.log 2024-04-26T00:16:21.332 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33653.log.gz 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35069.log 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28192.log.gz 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30436.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.26915.log.gz 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27731.log 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:gzip/var/log/ceph/ceph-client.admin.35069.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.35121.log 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30436.log.gz 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34201.log 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35069.log.gz 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35121.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27731.log.gz 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24252.log 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33315.log 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35121.log.gz 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.24252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28764.log 2024-04-26T00:16:21.333 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34201.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33315.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.24252.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33993.log 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27083.log 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33315.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33054.log 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.28764.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27083.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33993.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29406.log 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27083.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33054.log: /var/log/ceph/ceph-client.admin.29406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31677.log 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33054.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29406.log.gz 2024-04-26T00:16:21.334 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27247.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.31677.log: /var/log/ceph/ceph-client.admin.32073.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27335.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31677.log.gz 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32073.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27247.log.gz 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31042.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30990.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32073.log.gz 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31042.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.27335.log.gz --verbose 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr: -- /var/log/ceph/ceph-client.admin.26866.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31042.log.gz 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32534.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34227.log 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26866.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30990.log.gz 2024-04-26T00:16:21.335 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29719.log 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34227.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.26866.log.gz 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36442.log 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32534.log.gz 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34227.log.gz 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28374.log 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32586.log 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36442.log: /var/log/ceph/ceph-client.admin.28374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29432.log 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29719.log.gz 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32586.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36442.log.gz 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33627.log 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28374.log.gz 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29432.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32586.log.gz 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-26T00:16:21.336 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29588.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29432.log.gz 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32560.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33627.log.gz 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35907.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28504.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29588.log.gz 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36598.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32560.log.gz 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32125.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35907.log.gz 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35699.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28504.log.gz 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34730.log 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36598.log.gz 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34574.log 88.8% 2024-04-26T00:16:21.337 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32125.log.gz 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33497.log 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35699.log.gz 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34574.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36052.log 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.34730.log.gz 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33497.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34574.log.gz 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31969.log 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.33497.log.gz 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.e.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32872.log 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36052.log.gz 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36572.log 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30149.log 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31969.log.gz 2024-04-26T00:16:21.338 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35855.log 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32872.log.gz 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34652.log 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36572.log.gz 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27835.log 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35855.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.30149.log.gz/var/log/ceph/ceph-client.admin.34652.log: gzip 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.29536.log 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27835.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34652.log.gz 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35855.log.gz 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- 89.5% /var/log/ceph/ceph-client.admin.36652.log -- replaced with /var/log/ceph/ceph-client.admin.27835.log.gz 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35361.log 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33132.log 2024-04-26T00:16:21.339 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29536.log.gz 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36078.log 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30540.log 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35361.log.gz 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27601.log 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33132.log.gz 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36078.log: /var/log/ceph/ceph-client.admin.30540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36208.log 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36809.log 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30540.log.gz -- replaced with /var/log/ceph/ceph-client.admin.36078.log.gz 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36208.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36390.log 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27601.log.gz 2024-04-26T00:16:21.340 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36809.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.36208.log.gz 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31432.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33263.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36809.log.gz 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31432.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.36390.log.gz 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26910.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30912.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31432.log.gz 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33263.log: /var/log/ceph/ceph-client.admin.26910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30331.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33263.log.gz 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30912.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.26910.log.gz 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28244.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33863.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30912.log.gz/var/log/ceph/ceph-client.admin.30331.log: 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28244.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20263.log 2024-04-26T00:16:21.341 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2%/var/log/ceph/ceph-client.admin.33863.log: -- replaced with /var/log/ceph/ceph-client.admin.30331.log.gz 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31796.log 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.28244.log.gz 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.tmp-client.admin.20263.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33863.log.gz 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20263.log.gz 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33080.log 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26717.log 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31796.log.gz 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27549.log 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28959.log 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33080.log.gz 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31172.log 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.26717.log.gz 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30696.log 2024-04-26T00:16:21.342 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28959.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27549.log.gz 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29172.log 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29328.log 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31172.log.gz 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29172.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28959.log.gz 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30696.log.gz 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29276.log 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29172.log.gz 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31510.log 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29276.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35205.log 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29328.log.gz 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34253.log 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29276.log.gz 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35205.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33289.log 2024-04-26T00:16:21.343 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31510.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34253.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29562.log 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35205.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31458.log 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34253.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30514.log 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33289.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29562.log: /var/log/ceph/ceph-client.admin.31458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33811.log 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31458.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36833.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29562.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30514.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36756.log 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32021.log 2024-04-26T00:16:21.344 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36756.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33811.log.gz 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35647.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36782.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36756.log.gz 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34965.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.32021.log.gz 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31765.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35647.log.gz 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34965.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36782.log.gz 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28218.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32846.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31765.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34965.log.gz 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35725.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32846.log: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36678.log 2024-04-26T00:16:21.345 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31765.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28218.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35725.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32846.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35725.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32768.log 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36678.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31276.log 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32412.log 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36678.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31276.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32768.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27653.log 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32412.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31276.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36156.log 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32412.log.gz 2024-04-26T00:16:21.346 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29198.log 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27653.log.gz 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36494.log: /var/log/ceph/ceph-client.admin.36156.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32924.log 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.36156.log.gz 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28086.log 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32924.log: 89.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35095.log 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.29198.log.gz 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32924.log.gz 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30358.log 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35095.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28086.log.gz 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33159.log 2024-04-26T00:16:21.347 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28608.log: /var/log/ceph/ceph-client.admin.30358.log: gzip 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35095.log.gz -5 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31536.log 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33159.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose 88.7% -- /var/log/ceph/ceph-client.admin.35569.log -- replaced with /var/log/ceph/ceph-client.admin.30358.log.gz 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33159.log.gz 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34444.log 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35933.log 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31536.log.gz 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26911.log 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35569.log.gz 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34444.log.gz 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35933.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35933.log.gz 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31016.log 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29667.log 2024-04-26T00:16:21.348 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36730.log 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.26911.log.gz 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29667.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31016.log.gz 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34097.log 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29667.log.gz 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36730.log: /var/log/ceph/ceph-osd.1.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.36730.log.gz 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27080.log 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28270.log 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27293.log 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34097.log.gz 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28270.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27080.log.gz 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28270.log.gz 2024-04-26T00:16:21.349 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36520.log 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33733.log 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27293.log: gzip/var/log/ceph/ceph-client.admin.36520.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30670.log 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33733.log: 87.0% 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27293.log.gz 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36520.log.gz 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33733.log.gz 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35257.log 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30670.log: gzip/var/log/ceph/ceph-mon.d.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29068.log 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35257.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30670.log.gz 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30834.log 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.35257.log.gz 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29068.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29068.log.gz 2024-04-26T00:16:21.350 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26918.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28582.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30834.log: /var/log/ceph/ceph-client.admin.26918.log: 88.5% 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30834.log.gz 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.26918.log.gz 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27887.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27991.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28582.log: /var/log/ceph/ceph-client.admin.27887.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28582.log.gz 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27887.log.gz 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32820.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31891.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27991.log: /var/log/ceph/ceph-client.admin.32820.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27991.log.gz 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32820.log.gz 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30253.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29094.log 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31891.log: /var/log/ceph/ceph-client.admin.30253.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31891.log.gz 2024-04-26T00:16:21.351 INFO:teuthology.orchestra.run.smithi106.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30253.log.gz 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33028.log 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34313.log 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29094.log: /var/log/ceph/ceph-client.admin.33028.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29094.log.gz 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33028.log.gz 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34600.log 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36364.log 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34313.log: /var/log/ceph/ceph-client.admin.34600.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.34313.log.gz 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29146.log 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34600.log.gz 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36364.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36364.log.gz 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35621.log 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29993.log 2024-04-26T00:16:21.352 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29146.log: /var/log/ceph/ceph-client.admin.35621.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29146.log.gz 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35621.log.gz 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34886.log 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29993.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29993.log.gz 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31917.log 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30045.log 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34886.log: /var/log/ceph/ceph-client.admin.31917.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34886.log.gz 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31917.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34626.log 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30045.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30045.log.gz 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36182.log 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32256.log 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34626.log: /var/log/ceph/ceph-client.admin.36182.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34626.log.gz 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31703.log 2024-04-26T00:16:21.353 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36182.log.gz 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32256.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32256.log.gz 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35439.log 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31068.log 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31703.log: /var/log/ceph/ceph-client.admin.35439.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31703.log.gz 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32230.log 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35439.log.gz 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31068.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31068.log.gz 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31995.log 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32230.log: /var/log/ceph/ceph.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.32230.log.gz 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31354.log 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31995.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31995.log.gz 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30592.log 2024-04-26T00:16:21.354 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31354.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31354.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30938.log 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30592.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30592.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32664.log 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30938.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30938.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32047.log 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32664.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32664.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35465.log 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32047.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32047.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33785.log 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35465.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35465.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34991.log 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33785.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33785.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30305.log 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34991.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34991.log.gz 2024-04-26T00:16:21.355 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34834.log 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30305.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30305.log.gz 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36416.log 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34834.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34834.log.gz 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34860.log 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36416.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36416.log.gz 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26796.log 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34860.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34860.log.gz 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34071.log 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26796.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.26796.log.gz 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28556.log 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34071.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.34071.log.gz 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28400.log 2024-04-26T00:16:21.356 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28556.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.28556.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31120.log 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28400.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.28400.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29615.log 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31120.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31120.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32386.log 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29615.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29615.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28452.log 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32386.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32386.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28478.log 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28452.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28452.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27939.log 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28478.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28478.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28712.log 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27939.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27939.log.gz 2024-04-26T00:16:21.357 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31198.log 2024-04-26T00:16:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28712.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.28712.log.gz 2024-04-26T00:16:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-26T00:16:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31198.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31198.log.gz 2024-04-26T00:16:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31146.log 2024-04-26T00:16:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32308.log 2024-04-26T00:16:21.358 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31146.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31146.log.gz 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27757.log 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32308.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32308.log.gz 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30384.log 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27757.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27757.log.gz 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35231.log 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30384.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30384.log.gz 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34704.log 2024-04-26T00:16:21.362 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35231.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35231.log.gz 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.bar.34824.log 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30604.log 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bar.34824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27717.log 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29530.log 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.bar.34824.log.gz 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29841.log 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30604.log.gz 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34385.log 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27717.log.gz 2024-04-26T00:16:21.367 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29841.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29530.log.gz 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.foo.34538.log 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29650.log 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29841.log.gz 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.foo.34538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31305.log 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34385.log.gz 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.foo.34538.log.gz 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32314.log 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33133.log 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29650.log.gz 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31329.log 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31305.log.gz 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32314.log.gz 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33133.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33061.log 2024-04-26T00:16:21.368 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24071.log 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33133.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31329.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24119.log 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.24071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33374.log 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33061.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.24119.log: 88.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.24071.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.32218.log 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.24119.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31767.log 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32290.log 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33374.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31767.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32218.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31848.log 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31767.log.gz 2024-04-26T00:16:21.369 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32290.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27424.log 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31848.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32290.log.gz 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33013.log 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.foo.34582.log 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31848.log.gz 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33013.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27424.log.gz 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29889.log 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.foo.34582.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33013.log.gz 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30347.log 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32892.log 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28193.log 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29889.log.gz 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.foo.34582.log.gz 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32892.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30347.log.gz 2024-04-26T00:16:21.370 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29480.log 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24095.log 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32892.log.gz 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27566.log 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28193.log.gz 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29480.log.gz 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.24095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33569.log 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27566.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24095.log.gz 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29188.log 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.27566.log.gz 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34058.log 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34330.log 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33569.log.gz 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34058.log: gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29188.log.gz -5 2024-04-26T00:16:21.371 INFO:teuthology.orchestra.run.smithi171.stderr: --verbose -- /var/log/ceph/ceph-client.admin.28684.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34330.log: gzip -5 --verbose -- 87.7% /var/log/ceph/ceph-mon.f.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34058.log.gz 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32194.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34330.log.gz 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.f.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28684.log.gz 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.bar.34846.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32194.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27374.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bar.34846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31380.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32194.log.gz 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27374.log: 88.8% -- replaced with /var/log/ceph/ceph-client.bar.34846.log.gz 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29116.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30273.log 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29116.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27374.log.gz 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31380.log.gz 2024-04-26T00:16:21.372 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28660.log 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29116.log.gz 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32507.log 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30273.log: /var/log/ceph/ceph-client.admin.28660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32458.log 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32507.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28660.log.gz 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32167.log 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30273.log.gz 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32507.log.gz 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28996.log 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32458.log: /var/log/ceph/ceph-client.admin.32167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32041.log 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28996.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32458.log.gz 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32167.log.gz 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30923.log 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28996.log.gz 2024-04-26T00:16:21.373 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29959.log 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32041.log.gz 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30923.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28708.log 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32410.log 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29959.log.gz 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30923.log.gz 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28924.log 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28708.log.gz 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33866.log 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32410.log.gz 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29983.log 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28924.log: /var/log/ceph/ceph-client.admin.33866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28636.log 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29983.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28924.log.gz 2024-04-26T00:16:21.374 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33866.log.gz 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27632.log 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29983.log.gz 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29092.log 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28636.log: /var/log/ceph/ceph-client.admin.27632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31647.log 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29092.log: gzip 86.5% -- replaced with /var/log/ceph/ceph-client.admin.27632.log.gz -5 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr: --verbose -- /var/log/ceph/ceph-client.admin.34186.log 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28636.log.gz 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29092.log.gz 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28169.log 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31647.log.gz 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31503.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34186.log.gz 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32989.log 2024-04-26T00:16:21.375 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32724.log 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34420.log 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32724.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.28169.log.gz 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27510.log 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32989.log.gz 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32724.log.gz 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.34420.log: /var/log/ceph/ceph-client.admin.28878.log 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31551.log 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27510.log: /var/log/ceph/ceph-client.admin.28878.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34420.log.gz 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.foo.34516.log 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28878.log.gz -- replaced with /var/log/ceph/ceph-client.admin.27510.log.gz 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29212.log 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.foo.34516.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31551.log.gz 2024-04-26T00:16:21.376 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34034.log 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.foo.34516.log.gz 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:gzip/var/log/ceph/ceph-client.admin.29212.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.27947.log 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34034.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33545.log 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27947.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29212.log.gz 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34034.log.gz 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33472.log 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27947.log.gz 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28341.log 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32140.log 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33472.log: /var/log/ceph/ceph-client.admin.28341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29935.log 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33545.log.gz 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33472.log.gz 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.28341.log.gz 2024-04-26T00:16:21.377 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27211.log 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32917.log 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32140.log.gz 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27211.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29935.log.gz 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30103.log 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27211.log.gz 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29262.log 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29672.log 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29262.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32917.log.gz 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27696.log 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30103.log.gz 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29262.log.gz 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31430.log 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29672.log.gz 2024-04-26T00:16:21.378 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31671.log 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27696.log: /var/log/ceph/ceph-client.admin.31430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32941.log 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31671.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31430.log.gz 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.27696.log.gz 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31138.log 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31671.log.gz 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31719.log 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32941.log: /var/log/ceph/ceph-client.admin.31138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27257.log 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30993.log 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31719.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31138.log.gz 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29504.log 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr: 88.2%/var/log/ceph/ceph-client.admin.30993.log: -- replaced with /var/log/ceph/ceph-client.admin.31719.log.gz 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27257.log.gz 2024-04-26T00:16:21.379 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30779.log 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30993.log.gz 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34162.log 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28611.log 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34162.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29504.log.gz 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30249.log 87.5% 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.admin.30779.log.gz 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34162.log.gz 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28241.log 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29340.log 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30249.log: /var/log/ceph/ceph-client.admin.28241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33181.log 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28611.log.gz 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30249.log.gz 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29340.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28241.log.gz 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31063.log 2024-04-26T00:16:21.380 INFO:teuthology.orchestra.run.smithi171.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29340.log.gz 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32338.log 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33181.log: /var/log/ceph/ceph-client.admin.31063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30079.log 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31063.log.gz 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31187.log 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33181.log.gz 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28367.log/var/log/ceph/ceph-client.admin.30079.log: 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31187.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32338.log.gz 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.bar.35049.log 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30079.log.gz 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31187.log.gz 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28972.log 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28121.log 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bar.35049.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28367.log.gz 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31575.log 2024-04-26T00:16:21.381 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28121.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28972.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28948.log 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28121.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33746.log 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31575.log: /var/log/ceph/ceph-client.admin.28948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33521.log 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.bar.35049.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33746.log: gzip -5 --verbose 89.0% -- /var/log/ceph/ceph-client.admin.28439.log -- replaced with /var/log/ceph/ceph-client.admin.28948.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31575.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35062.log 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33746.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28439.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28001.log 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33521.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28439.log.gz 2024-04-26T00:16:21.382 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.35062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.bar.34912.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30851.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35062.log.gz 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bar.34912.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28001.log.gz 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26979.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30851.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35025.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27741.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30851.log.gz 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.bar.34912.log.gz 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.35025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31695.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.26979.log.gz 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27741.log: gzip 88.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.35025.log.gz 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr: --verbose -- /var/log/ceph/ceph-client.admin.27454.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27741.log.gz 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33842.log 2024-04-26T00:16:21.383 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31695.log: /var/log/ceph/ceph-client.admin.27454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29436.log 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33842.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31695.log.gz 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27454.log.gz 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31454.log 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33842.log.gz 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35086.log 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29436.log.gz 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28760.log 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.35086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30727.log 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31454.log.gz 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28760.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.35086.log.gz 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33157.log 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29578.log 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30727.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28760.log.gz 2024-04-26T00:16:21.384 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32556.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30727.log.gz 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33157.log.gz 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30031.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31404.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30031.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29578.log.gz 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32556.log.gz 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33794.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31404.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30031.log.gz 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34306.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31404.log.gz 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33794.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28145.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34306.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33794.log.gz 2024-04-26T00:16:21.385 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34306.log.gz 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27099.log 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28217.log 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: 87.5%/var/log/ceph/ceph-client.admin.27099.log: -- replaced with /var/log/ceph/ceph-client.admin.28145.log.gz 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29020.log 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27099.log.gz 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28488.log 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29020.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29604.log 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28217.log.gz 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29020.log.gz 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30177.log 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27899.log 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28488.log.gz 2024-04-26T00:16:21.386 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30177.log: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.29604.log.gz -5 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30628.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27899.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30177.log.gz 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33770.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33277.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30628.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27899.log.gz 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33448.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33770.log.gz 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30628.log.gz 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.bazar.34409.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33277.log: /var/log/ceph/ceph-client.admin.33448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32700.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bazar.34409.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29236.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.33448.log.gz 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33277.log.gz 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.bazar.34409.log.gz 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.foo.34492.log 2024-04-26T00:16:21.387 INFO:teuthology.orchestra.run.smithi171.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32700.log.gz 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29236.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.foo.34560.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34444.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.foo.34492.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29236.log.gz 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.foo.34560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28316.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.foo.34492.log.gz 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34444.log: 87.6% -- replaced with /var/log/ceph/ceph-client.foo.34560.log.gz 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.foo.34763.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34444.log.gz 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28025.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27654.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.foo.34763.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28316.log.gz 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31017.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27654.log: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27235.log 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28025.log.gz 2024-04-26T00:16:21.388 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28832.log 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27654.log.gz 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27235.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31017.log.gzgzip 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr: -5 --verbose -- /var/log/ceph/ceph-client.bar.34890.log 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33617.log 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27235.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33962.log 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr: 93.1% 87.3% -- replaced with /var/log/ceph/ceph-client.foo.34763.log.gz 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.admin.28832.log.gz 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bar.34890.log: /var/log/ceph/ceph-client.admin.33617.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33617.log.gz 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.bar.34890.log.gz 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32965.log 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28097.log 2024-04-26T00:16:21.389 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29068.log 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33962.log.gz 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31527.log 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28097.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32965.log.gz 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27765.log 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28097.log.gz 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28512.log 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29068.log.gz 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27281.log 2024-04-26T00:16:21.390 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31527.log.gz 2024-04-26T00:16:21.394 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27765.log.gz 2024-04-26T00:16:21.394 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28512.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27875.log 2024-04-26T00:16:21.394 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35111.log 2024-04-26T00:16:21.394 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27281.log: /var/log/ceph/ceph-client.admin.27875.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28512.log.gz 2024-04-26T00:16:21.394 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32820.log 2024-04-26T00:16:21.394 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27281.log.gz 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.35111.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.27875.log.gzgzip 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr: -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32266.log 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35111.log.gz 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32820.log.gz 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30443.log 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.i.log: /var/log/ceph/ceph-client.admin.32266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29694.log 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30443.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32266.log.gz 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31599.log 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.g.log 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29694.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30443.log.gz/var/log/ceph/ceph-client.admin.31599.log: 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27398.log 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29694.log.gz 2024-04-26T00:16:21.395 INFO:teuthology.orchestra.run.smithi171.stderr: 87.8%/var/log/ceph/ceph-mon.g.log: -- replaced with /var/log/ceph/ceph-client.admin.31599.log.gz 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31355.log 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27398.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34354.log 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32242.log 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27398.log.gz 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34354.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31355.log.gz 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34354.log.gz 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26955.log 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29865.log 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29314.log 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32242.log.gz 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6%/var/log/ceph/ceph-client.admin.29865.log: -- replaced with /var/log/ceph/ceph-client.admin.26955.log.gz 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29865.log.gz 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27977.log 2024-04-26T00:16:21.396 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28561.log 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29314.log.gz 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28561.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27977.log.gz 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28561.log.gz 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31279.log 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33326.log 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28734.log 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31279.log.gz 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33326.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33326.log.gz 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30369.log 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30556.log 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30369.log: gzip 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28734.log.gz -5 2024-04-26T00:16:21.397 INFO:teuthology.orchestra.run.smithi171.stderr: --verbose -- /var/log/ceph/ceph-client.admin.29386.log 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30556.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30369.log.gz 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30556.log.gz 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31087.log 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31987.log 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29386.log.gz 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31087.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31087.log.gz 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30803.log 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30655.log 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30803.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31987.log.gz 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30803.log.gz 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31960.log 2024-04-26T00:16:21.398 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30151.log 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30655.log: /var/log/ceph/ceph-client.admin.31960.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30655.log.gz 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31960.log.gz 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32628.log 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30151.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32628.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30151.log.gz 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32628.log.gz 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30705.log 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30007.log 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.30705.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30705.log.gz 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33986.log 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30007.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30007.log.gz 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31113.log 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33986.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33986.log.gz 2024-04-26T00:16:21.399 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30395.log 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31113.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31113.log.gz 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29044.log 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30395.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30395.log.gz 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34282.log 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29044.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29044.log.gz 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29164.log 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34282.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34282.log.gz 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27189.log 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29164.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29164.log.gz 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27326.log 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27189.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.27189.log.gz 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33914.log 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27326.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.27326.log.gz 2024-04-26T00:16:21.400 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29742.log 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33914.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33914.log.gz 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32482.log 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29742.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29742.log.gz 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31821.log 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32482.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32482.log.gz 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31936.log 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31821.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31821.log.gz 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34010.log 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31936.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.31936.log.gz 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34234.log 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34010.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34010.log.gz 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33818.log 2024-04-26T00:16:21.401 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34234.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34234.log.gz 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32604.log 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33818.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33818.log.gz 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32772.log 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32604.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32604.log.gz 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27143.log 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32772.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32772.log.gz 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27143.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27143.log.gz 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29817.log 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33205.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29817.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29817.log.gz 2024-04-26T00:16:21.402 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32362.log 2024-04-26T00:16:21.403 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.h.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30127.log 2024-04-26T00:16:21.403 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32362.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32362.log.gz 2024-04-26T00:16:21.403 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.foo.34468.log 2024-04-26T00:16:21.403 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30127.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30127.log.gz 2024-04-26T00:16:21.403 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32386.log 2024-04-26T00:16:21.403 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.foo.34468.log: 87.9% -- replaced with /var/log/ceph/ceph-client.foo.34468.log.gz 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32386.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32386.log.gz 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29140.log 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33649.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gz 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29913.log 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29140.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29140.log.gz 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31794.log 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29913.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29913.log.gz 2024-04-26T00:16:21.407 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33915.log 2024-04-26T00:16:21.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34704.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34704.log.gz 2024-04-26T00:16:21.408 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28043.log 2024-04-26T00:16:21.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33915.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33915.log.gz 2024-04-26T00:16:21.408 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.23945.log 2024-04-26T00:16:21.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28043.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28043.log.gz 2024-04-26T00:16:21.408 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32282.log 2024-04-26T00:16:21.408 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.23945.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.23945.log.gz 2024-04-26T00:16:21.417 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30969.log 2024-04-26T00:16:21.418 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31794.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31794.log.gz 2024-04-26T00:16:21.424 INFO:teuthology.orchestra.run.smithi171.stderr: 90.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T00:16:21.425 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31041.log 2024-04-26T00:16:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35413.log 2024-04-26T00:16:21.426 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32282.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32282.log.gz 2024-04-26T00:16:21.427 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30969.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30969.log.gz 2024-04-26T00:16:21.427 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32434.log 2024-04-26T00:16:21.427 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31041.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31041.log.gz 2024-04-26T00:16:21.427 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29767.log 2024-04-26T00:16:21.428 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32434.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32434.log.gz 2024-04-26T00:16:21.429 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34130.log 2024-04-26T00:16:21.430 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29767.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29767.log.gz 2024-04-26T00:16:21.430 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29554.log 2024-04-26T00:16:21.431 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34130.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34130.log.gz 2024-04-26T00:16:21.431 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28265.log 2024-04-26T00:16:21.432 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29554.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.29554.log.gz 2024-04-26T00:16:21.433 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27480.log 2024-04-26T00:16:21.434 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28265.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28265.log.gz 2024-04-26T00:16:21.434 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.bar.34868.log 2024-04-26T00:16:21.435 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27480.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27480.log.gz 2024-04-26T00:16:21.435 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33496.log 2024-04-26T00:16:21.436 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bar.34868.log: 87.6% -- replaced with /var/log/ceph/ceph-client.bar.34868.log.gz 2024-04-26T00:16:21.437 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27350.log 2024-04-26T00:16:21.437 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27082.log 2024-04-26T00:16:21.438 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35413.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35413.log.gz 2024-04-26T00:16:21.439 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33496.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33496.log.gz 2024-04-26T00:16:21.439 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29626.log 2024-04-26T00:16:21.439 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27350.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27350.log.gz 2024-04-26T00:16:21.439 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28073.log 2024-04-26T00:16:21.440 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29626.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29626.log.gz 2024-04-26T00:16:21.441 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33424.log 2024-04-26T00:16:21.441 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28073.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28073.log.gz 2024-04-26T00:16:21.442 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33301.log 2024-04-26T00:16:21.443 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33424.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.33424.log.gz 2024-04-26T00:16:21.443 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29410.log 2024-04-26T00:16:21.444 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33301.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.33301.log.gz 2024-04-26T00:16:21.444 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35160.log 2024-04-26T00:16:21.445 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29410.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29410.log.gz 2024-04-26T00:16:21.446 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2024-04-26T00:16:21.446 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.35160.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35160.log.gz 2024-04-26T00:16:21.447 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30753.log 2024-04-26T00:16:21.448 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34106.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gz 2024-04-26T00:16:21.448 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34210.log 2024-04-26T00:16:21.449 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30753.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30753.log.gz 2024-04-26T00:16:21.449 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33722.log 2024-04-26T00:16:21.450 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34210.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34210.log.gz 2024-04-26T00:16:21.451 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27588.log 2024-04-26T00:16:21.452 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33722.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33722.log.gz 2024-04-26T00:16:21.452 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29792.log 2024-04-26T00:16:21.453 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27588.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27588.log.gz 2024-04-26T00:16:21.453 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T00:16:21.454 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29792.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29792.log.gz 2024-04-26T00:16:21.455 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34258.log 2024-04-26T00:16:21.456 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30964.log 2024-04-26T00:16:21.457 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27082.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27082.log.gz 2024-04-26T00:16:21.468 INFO:teuthology.orchestra.run.smithi106.stderr: 90.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-26T00:16:21.471 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33398.log 2024-04-26T00:16:21.472 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34258.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.34258.log.gz 2024-04-26T00:16:21.472 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30279.log 2024-04-26T00:16:21.474 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30964.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30964.log.gz 2024-04-26T00:16:21.474 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34175.log 2024-04-26T00:16:21.475 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30279.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30279.log.gz 2024-04-26T00:16:21.475 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27241.log 2024-04-26T00:16:21.476 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34175.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34175.log.gz 2024-04-26T00:16:21.477 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32976.log 2024-04-26T00:16:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27241.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.27241.log.gz 2024-04-26T00:16:21.478 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33575.log 2024-04-26T00:16:21.479 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32976.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32976.log.gz 2024-04-26T00:16:21.480 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27523.log 2024-04-26T00:16:21.480 INFO:teuthology.orchestra.run.smithi171.stderr: 96.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T00:16:21.480 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28415.log 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33398.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33398.log.gz 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30899.log 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28415.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28415.log.gz 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28290.log 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33575.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33575.log.gz 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34418.log 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27523.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27523.log.gz 2024-04-26T00:16:21.483 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31224.log 2024-04-26T00:16:21.485 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30899.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30899.log.gz 2024-04-26T00:16:21.485 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32868.log 2024-04-26T00:16:21.485 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28290.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28290.log.gz 2024-04-26T00:16:21.485 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30297.log 2024-04-26T00:16:21.486 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34418.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34418.log.gz 2024-04-26T00:16:21.486 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29510.log 2024-04-26T00:16:21.486 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31224.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31224.log.gz 2024-04-26T00:16:21.486 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36130.log 2024-04-26T00:16:21.487 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29510.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.29510.log.gz 2024-04-26T00:16:21.488 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30462.log 2024-04-26T00:16:21.488 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36130.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36130.log.gz 2024-04-26T00:16:21.489 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34756.log 2024-04-26T00:16:21.489 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32868.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32868.log.gz 2024-04-26T00:16:21.490 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34082.log 2024-04-26T00:16:21.490 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30297.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30297.log.gz 2024-04-26T00:16:21.490 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27302.log 2024-04-26T00:16:21.490 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34082.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.34082.log.gz 2024-04-26T00:16:21.490 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33037.log 2024-04-26T00:16:21.490 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27302.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27302.log.gz 2024-04-26T00:16:21.490 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32531.log 2024-04-26T00:16:21.492 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33037.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33037.log.gz 2024-04-26T00:16:21.492 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33890.log 2024-04-26T00:16:21.492 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32531.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32531.log.gz 2024-04-26T00:16:21.492 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32014.log 2024-04-26T00:16:21.493 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30462.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30462.log.gz 2024-04-26T00:16:21.493 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34808.log 2024-04-26T00:16:21.493 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34756.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34756.log.gz 2024-04-26T00:16:21.493 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29745.log 2024-04-26T00:16:21.494 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34808.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.34808.log.gz 2024-04-26T00:16:21.494 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29823.log 2024-04-26T00:16:21.494 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29745.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29745.log.gz 2024-04-26T00:16:21.496 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28842.log 2024-04-26T00:16:21.496 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29823.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29823.log.gz 2024-04-26T00:16:21.496 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35283.log 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33890.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.33890.log.gz 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32796.log 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32014.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32014.log.gz 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29288.log 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32796.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32796.log.gz 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28784.log 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29288.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29288.log.gz 2024-04-26T00:16:21.497 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29458.log 2024-04-26T00:16:21.500 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28784.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28784.log.gz 2024-04-26T00:16:21.500 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29718.log 2024-04-26T00:16:21.500 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29458.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29458.log.gz 2024-04-26T00:16:21.500 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-04-26T00:16:21.501 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28842.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28842.log.gz 2024-04-26T00:16:21.501 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35881.log 2024-04-26T00:16:21.501 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35283.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35283.log.gz 2024-04-26T00:16:21.501 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31406.log 2024-04-26T00:16:21.501 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35881.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35881.log.gz 2024-04-26T00:16:21.501 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-26T00:16:21.502 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31406.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31406.log.gz 2024-04-26T00:16:21.502 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33889.log 2024-04-26T00:16:21.503 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29718.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29718.log.gz 2024-04-26T00:16:21.503 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34776.log 2024-04-26T00:16:21.503 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33698.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gz 2024-04-26T00:16:21.503 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30225.log 2024-04-26T00:16:21.503 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34776.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34776.log.gz 2024-04-26T00:16:21.504 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30681.log 2024-04-26T00:16:21.504 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30225.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30225.log.gz 2024-04-26T00:16:21.505 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30875.log 2024-04-26T00:16:21.506 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30681.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30681.log.gz 2024-04-26T00:16:21.506 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30201.log 2024-04-26T00:16:21.507 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30875.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30875.log.gz 2024-04-26T00:16:21.508 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28902.log 2024-04-26T00:16:21.509 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30201.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30201.log.gz 2024-04-26T00:16:21.509 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32652.log 2024-04-26T00:16:21.510 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28902.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28902.log.gz 2024-04-26T00:16:21.510 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32113.log 2024-04-26T00:16:21.511 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32652.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32652.log.gz 2024-04-26T00:16:21.512 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31623.log 2024-04-26T00:16:21.513 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32113.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32113.log.gz 2024-04-26T00:16:21.513 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33673.log 2024-04-26T00:16:21.514 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31623.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31623.log.gz 2024-04-26T00:16:21.515 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35136.log 2024-04-26T00:16:21.516 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33673.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33673.log.gz 2024-04-26T00:16:21.516 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27923.log 2024-04-26T00:16:21.517 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31562.log 2024-04-26T00:16:21.517 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.35136.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35136.log.gz 2024-04-26T00:16:21.517 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28536.log 2024-04-26T00:16:21.518 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33889.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.33889.log.gz 2024-04-26T00:16:21.519 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27923.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27923.log.gz 2024-04-26T00:16:21.519 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30580.log 2024-04-26T00:16:21.520 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28536.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28536.log.gz 2024-04-26T00:16:21.520 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30055.log 2024-04-26T00:16:21.521 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30580.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30580.log.gz 2024-04-26T00:16:21.521 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28464.log 2024-04-26T00:16:21.522 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30055.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30055.log.gz 2024-04-26T00:16:21.523 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24167.log 2024-04-26T00:16:21.524 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28464.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28464.log.gz 2024-04-26T00:16:21.524 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28049.log 2024-04-26T00:16:21.525 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.24167.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.24167.log.gz 2024-04-26T00:16:21.526 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33593.log 2024-04-26T00:16:21.527 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28049.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28049.log.gz 2024-04-26T00:16:21.527 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33253.log 2024-04-26T00:16:21.528 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33593.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33593.log.gz 2024-04-26T00:16:21.529 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34782.log 2024-04-26T00:16:21.529 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27052.log 2024-04-26T00:16:21.530 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31562.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31562.log.gz 2024-04-26T00:16:21.531 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33253.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33253.log.gz 2024-04-26T00:16:21.531 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27165.log 2024-04-26T00:16:21.531 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27052.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27052.log.gz 2024-04-26T00:16:21.531 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32748.log 2024-04-26T00:16:21.532 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27165.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27165.log.gz 2024-04-26T00:16:21.533 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33229.log 2024-04-26T00:16:21.533 INFO:teuthology.orchestra.run.smithi106.stderr: 96.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26916.log 2024-04-26T00:16:21.535 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32748.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32748.log.gz 2024-04-26T00:16:21.535 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30323.log 2024-04-26T00:16:21.535 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34782.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34782.log.gz 2024-04-26T00:16:21.535 INFO:teuthology.orchestra.run.smithi106.stderr: -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-26T00:16:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34149.log 2024-04-26T00:16:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26916.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.26916.log.gz 2024-04-26T00:16:21.536 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35491.log 2024-04-26T00:16:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34149.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34149.log.gz 2024-04-26T00:16:21.537 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27445.log 2024-04-26T00:16:21.539 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33229.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33229.log.gz 2024-04-26T00:16:21.539 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30947.log 2024-04-26T00:16:21.539 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30323.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30323.log.gz 2024-04-26T00:16:21.539 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-26T00:16:21.539 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30947.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.30947.log.gz 2024-04-26T00:16:21.539 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32844.log 2024-04-26T00:16:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35491.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35491.log.gz 2024-04-26T00:16:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35673.log 2024-04-26T00:16:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27445.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27445.log.gz 2024-04-26T00:16:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30488.log 2024-04-26T00:16:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35673.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35673.log.gz 2024-04-26T00:16:21.541 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30175.log 2024-04-26T00:16:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30488.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30488.log.gz 2024-04-26T00:16:21.542 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34019.log 2024-04-26T00:16:21.543 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30175.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30175.log.gz 2024-04-26T00:16:21.544 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28868.log 2024-04-26T00:16:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34019.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34019.log.gz 2024-04-26T00:16:21.545 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30097.log 2024-04-26T00:16:21.546 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27003.log 2024-04-26T00:16:21.547 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28868.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28868.log.gz 2024-04-26T00:16:21.547 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28816.log 2024-04-26T00:16:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30097.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30097.log.gz 2024-04-26T00:16:21.548 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32438.log 2024-04-26T00:16:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28816.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28816.log.gz 2024-04-26T00:16:21.549 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33106.log 2024-04-26T00:16:21.550 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32438.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32438.log.gz 2024-04-26T00:16:21.551 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31484.log 2024-04-26T00:16:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33106.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33106.log.gz 2024-04-26T00:16:21.552 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26770.log 2024-04-26T00:16:21.553 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31484.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31484.log.gz 2024-04-26T00:16:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36104.log 2024-04-26T00:16:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26770.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.26770.log.gz 2024-04-26T00:16:21.555 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30019.log 2024-04-26T00:16:21.556 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32844.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31255.log 2024-04-26T00:16:21.556 INFO:teuthology.orchestra.run.smithi171.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32844.log.gz 2024-04-26T00:16:21.556 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27003.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.27003.log.gz 2024-04-26T00:16:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36104.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36104.log.gz 2024-04-26T00:16:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29458.log 2024-04-26T00:16:21.557 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30019.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30019.log.gz 2024-04-26T00:16:21.558 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28426.log 2024-04-26T00:16:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29458.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29458.log.gz 2024-04-26T00:16:21.559 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27081.log 2024-04-26T00:16:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28426.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28426.log.gz 2024-04-26T00:16:21.560 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33941.log 2024-04-26T00:16:21.561 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27081.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27081.log.gz 2024-04-26T00:16:21.562 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36546.log 2024-04-26T00:16:21.563 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33941.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33941.log.gz 2024-04-26T00:16:21.563 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30618.log 2024-04-26T00:16:21.564 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36546.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36546.log.gz 2024-04-26T00:16:21.564 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24181.log 2024-04-26T00:16:21.565 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30618.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30618.log.gz 2024-04-26T00:16:21.566 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33523.log 2024-04-26T00:16:21.567 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.24181.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.24181.log.gz 2024-04-26T00:16:21.567 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35829.log 2024-04-26T00:16:21.568 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33523.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33523.log.gz 2024-04-26T00:16:21.569 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27269.log 2024-04-26T00:16:21.569 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31233.log 2024-04-26T00:16:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35829.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35829.log.gz 2024-04-26T00:16:21.570 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30201.log 2024-04-26T00:16:21.571 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31255.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31255.log.gz 2024-04-26T00:16:21.571 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32676.log 2024-04-26T00:16:21.572 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31233.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31233.log.gz 2024-04-26T00:16:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27269.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27269.log.gz 2024-04-26T00:16:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35777.log 2024-04-26T00:16:21.572 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30201.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30201.log.gz 2024-04-26T00:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31943.log 2024-04-26T00:16:21.573 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35777.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35777.log.gz 2024-04-26T00:16:21.574 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31250.log 2024-04-26T00:16:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31943.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31943.log.gz 2024-04-26T00:16:21.575 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32638.log 2024-04-26T00:16:21.576 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31250.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31250.log.gz 2024-04-26T00:16:21.577 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32898.log 2024-04-26T00:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32638.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32638.log.gz 2024-04-26T00:16:21.578 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35043.log 2024-04-26T00:16:21.579 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32898.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32898.log.gz 2024-04-26T00:16:21.580 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34045.log 2024-04-26T00:16:21.580 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35043.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35043.log.gz 2024-04-26T00:16:21.581 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33967.log 2024-04-26T00:16:21.582 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34045.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34045.log.gz 2024-04-26T00:16:21.582 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36468.log 2024-04-26T00:16:21.583 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33967.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33967.log.gz 2024-04-26T00:16:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30886.log 2024-04-26T00:16:21.584 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36468.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36468.log.gz 2024-04-26T00:16:21.585 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35595.log 2024-04-26T00:16:21.585 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27121.log 2024-04-26T00:16:21.586 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32676.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32676.log.gz 2024-04-26T00:16:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30886.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30886.log.gz 2024-04-26T00:16:21.587 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31827.log 2024-04-26T00:16:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35595.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35595.log.gz 2024-04-26T00:16:21.588 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27072.log 2024-04-26T00:16:21.589 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.bar.34800.log 2024-04-26T00:16:21.589 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27121.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27121.log.gz 2024-04-26T00:16:21.589 INFO:teuthology.orchestra.run.smithi171.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-26T00:16:21.589 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27077.log 2024-04-26T00:16:21.591 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.bar.34800.log: 87.4% -- replaced with /var/log/ceph/ceph-client.bar.34800.log.gz 2024-04-26T00:16:21.591 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28391.log 2024-04-26T00:16:21.591 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27077.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27077.log.gz 2024-04-26T00:16:21.591 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28856.log 2024-04-26T00:16:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31827.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31827.log.gz 2024-04-26T00:16:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26742.log 2024-04-26T00:16:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27072.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27072.log.gz 2024-04-26T00:16:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33705.log 2024-04-26T00:16:21.592 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26742.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.26742.log.gz 2024-04-26T00:16:21.593 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33352.log 2024-04-26T00:16:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33705.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33705.log.gz 2024-04-26T00:16:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-26T00:16:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33352.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33352.log.gz 2024-04-26T00:16:21.595 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32690.log 2024-04-26T00:16:21.596 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28391.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28391.log.gz 2024-04-26T00:16:21.596 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28808.log 2024-04-26T00:16:21.596 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28856.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28856.log.gz 2024-04-26T00:16:21.596 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27610.log 2024-04-26T00:16:21.597 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28808.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28808.log.gz 2024-04-26T00:16:21.597 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33350.log 2024-04-26T00:16:21.597 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27610.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.27610.log.gz 2024-04-26T00:16:21.597 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24191.log 2024-04-26T00:16:21.598 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33350.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33350.log.gz 2024-04-26T00:16:21.598 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30419.log 2024-04-26T00:16:21.598 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.24191.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.24191.log.gz 2024-04-26T00:16:21.599 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27536.log 2024-04-26T00:16:21.601 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.30419.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30419.log.gz 2024-04-26T00:16:21.602 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34739.log 2024-04-26T00:16:21.602 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27536.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27536.log.gz 2024-04-26T00:16:21.602 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32065.log 2024-04-26T00:16:21.602 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.34739.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34739.log.gz 2024-04-26T00:16:21.603 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27675.log 2024-04-26T00:16:21.604 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32065.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32065.log.gz 2024-04-26T00:16:21.604 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27028.log 2024-04-26T00:16:21.605 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27675.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.27675.log.gz 2024-04-26T00:16:21.605 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32580.log 2024-04-26T00:16:21.606 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.27028.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.27028.log.gz 2024-04-26T00:16:21.607 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28586.log 2024-04-26T00:16:21.608 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32580.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32580.log.gz 2024-04-26T00:16:21.608 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29354.log 2024-04-26T00:16:21.609 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31743.log 2024-04-26T00:16:21.610 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32690.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32690.log.gz 2024-04-26T00:16:21.610 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.28586.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28586.log.gz 2024-04-26T00:16:21.610 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33938.log 2024-04-26T00:16:21.611 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31743.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31743.log.gz 2024-04-26T00:16:21.611 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33085.log 2024-04-26T00:16:21.612 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33938.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33938.log.gz 2024-04-26T00:16:21.612 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31211.log 2024-04-26T00:16:21.613 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33085.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.33085.log.gz 2024-04-26T00:16:21.614 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31479.log 2024-04-26T00:16:21.614 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31211.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31211.log.gz 2024-04-26T00:16:21.615 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.24143.log 2024-04-26T00:16:21.616 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31479.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31479.log.gz 2024-04-26T00:16:21.616 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33109.log 2024-04-26T00:16:21.617 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.24143.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.24143.log.gz 2024-04-26T00:16:21.617 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31163.log 2024-04-26T00:16:21.618 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.33109.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.33109.log.gz 2024-04-26T00:16:21.619 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32089.log 2024-04-26T00:16:21.620 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.31163.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31163.log.gz 2024-04-26T00:16:21.620 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29362.log 2024-04-26T00:16:21.621 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.32089.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32089.log.gz 2024-04-26T00:16:21.622 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.29362.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29362.log.gz 2024-04-26T00:16:21.628 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33211.log 2024-04-26T00:16:21.629 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29354.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29354.log.gz 2024-04-26T00:16:21.636 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36704.log 2024-04-26T00:16:21.637 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33211.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33211.log.gz 2024-04-26T00:16:21.644 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28920.log 2024-04-26T00:16:21.645 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36704.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.36704.log.gz 2024-04-26T00:16:21.652 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34470.log 2024-04-26T00:16:21.653 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28920.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28920.log.gz 2024-04-26T00:16:21.660 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33601.log 2024-04-26T00:16:21.661 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34470.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34470.log.gz 2024-04-26T00:16:21.668 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26917.log 2024-04-26T00:16:21.669 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33601.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.33601.log.gz 2024-04-26T00:16:21.676 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34279.log 2024-04-26T00:16:21.677 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.26917.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.26917.log.gz 2024-04-26T00:16:21.687 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29250.log 2024-04-26T00:16:21.687 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34279.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34279.log.gz 2024-04-26T00:16:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29797.log 2024-04-26T00:16:21.705 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29250.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29250.log.gz 2024-04-26T00:16:21.724 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35751.log 2024-04-26T00:16:21.725 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29797.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.29797.log.gz 2024-04-26T00:16:21.732 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33679.log 2024-04-26T00:16:21.733 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35751.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35751.log.gz 2024-04-26T00:16:21.740 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33185.log 2024-04-26T00:16:21.741 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33679.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33679.log.gz 2024-04-26T00:16:21.748 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35517.log 2024-04-26T00:16:21.749 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33185.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33185.log.gz 2024-04-26T00:16:21.756 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36312.log 2024-04-26T00:16:21.757 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35517.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.35517.log.gz 2024-04-26T00:16:21.764 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30644.log 2024-04-26T00:16:21.765 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36312.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36312.log.gz 2024-04-26T00:16:21.772 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33759.log 2024-04-26T00:16:21.773 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30644.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30644.log.gz 2024-04-26T00:16:21.780 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28634.log 2024-04-26T00:16:21.781 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.33759.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33759.log.gz 2024-04-26T00:16:21.788 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31639.log 2024-04-26T00:16:21.789 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28634.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28634.log.gz 2024-04-26T00:16:21.796 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27965.log 2024-04-26T00:16:21.797 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31639.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31639.log.gz 2024-04-26T00:16:21.804 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29484.log 2024-04-26T00:16:21.805 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27965.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.27965.log.gz 2024-04-26T00:16:21.812 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36338.log 2024-04-26T00:16:21.813 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29484.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29484.log.gz 2024-04-26T00:16:21.820 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30071.log 2024-04-26T00:16:21.821 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.36338.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36338.log.gz 2024-04-26T00:16:21.828 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35387.log 2024-04-26T00:16:21.829 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30071.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30071.log.gz 2024-04-26T00:16:21.836 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32468.log 2024-04-26T00:16:21.837 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35387.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.35387.log.gz 2024-04-26T00:16:21.844 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28738.log 2024-04-26T00:16:21.845 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.32468.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.32468.log.gz 2024-04-26T00:16:21.853 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27861.log 2024-04-26T00:16:21.853 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28738.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.28738.log.gz 2024-04-26T00:16:21.860 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35803.log 2024-04-26T00:16:21.861 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27861.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.27861.log.gz 2024-04-26T00:16:21.868 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27471.log 2024-04-26T00:16:21.869 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.35803.log: 90.8% -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2024-04-26T00:16:21.869 INFO:teuthology.orchestra.run.smithi106.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35803.log.gz 2024-04-26T00:16:21.872 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34678.log 2024-04-26T00:16:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27471.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27471.log.gz 2024-04-26T00:16:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29120.log 2024-04-26T00:16:21.874 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34678.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34678.log.gz 2024-04-26T00:16:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27575.log 2024-04-26T00:16:21.875 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.29120.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29120.log.gz 2024-04-26T00:16:21.876 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28530.log 2024-04-26T00:16:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.27575.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27575.log.gz 2024-04-26T00:16:21.877 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34548.log 2024-04-26T00:16:21.878 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28530.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28530.log.gz 2024-04-26T00:16:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31735.log 2024-04-26T00:16:21.879 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.34548.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34548.log.gz 2024-04-26T00:16:21.880 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30782.log 2024-04-26T00:16:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.31735.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31735.log.gz 2024-04-26T00:16:21.881 INFO:teuthology.orchestra.run.smithi106.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28894.log 2024-04-26T00:16:21.882 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.30782.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30782.log.gz 2024-04-26T00:16:21.883 INFO:teuthology.orchestra.run.smithi106.stderr:/var/log/ceph/ceph-client.admin.28894.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28894.log.gz 2024-04-26T00:16:21.948 INFO:teuthology.orchestra.run.smithi171.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2024-04-26T00:16:22.071 INFO:teuthology.orchestra.run.smithi171.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2024-04-26T00:16:22.097 INFO:teuthology.orchestra.run.smithi171.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2024-04-26T00:16:22.099 INFO:teuthology.orchestra.run.smithi106.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-26T00:16:22.159 INFO:teuthology.orchestra.run.smithi106.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2024-04-26T00:16:22.235 INFO:teuthology.orchestra.run.smithi171.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2024-04-26T00:16:22.326 INFO:teuthology.orchestra.run.smithi106.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-26T00:16:22.467 INFO:teuthology.orchestra.run.smithi171.stderr: 92.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-26T00:16:22.504 INFO:teuthology.orchestra.run.smithi106.stderr: 92.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-26T00:16:22.525 INFO:teuthology.orchestra.run.smithi106.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-26T00:16:22.644 INFO:teuthology.orchestra.run.smithi171.stderr: 92.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-26T00:16:22.930 INFO:teuthology.orchestra.run.smithi171.stderr: 93.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-26T00:16:22.932 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-04-26T00:16:22.932 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m1.775s 2024-04-26T00:16:22.932 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m7.952s 2024-04-26T00:16:22.932 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m0.353s 2024-04-26T00:16:23.060 INFO:teuthology.orchestra.run.smithi106.stderr: 93.1% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-26T00:16:23.497 INFO:teuthology.orchestra.run.smithi106.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-26T00:16:23.498 INFO:teuthology.orchestra.run.smithi106.stderr: 2024-04-26T00:16:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:real 0m2.378s 2024-04-26T00:16:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:user 0m10.103s 2024-04-26T00:16:23.498 INFO:teuthology.orchestra.run.smithi106.stderr:sys 0m0.406s 2024-04-26T00:16:23.499 INFO:tasks.ceph:Archiving logs... 2024-04-26T00:16:23.499 DEBUG:teuthology.misc:Transferring archived files from smithi106:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/remote/smithi106/log 2024-04-26T00:16:23.500 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T00:16:24.913 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/remote/smithi171/log 2024-04-26T00:16:24.914 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-26T00:16:26.091 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-26T00:16:26.101 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-26T00:16:26.101 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T00:16:26.104 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-26T00:16:26.172 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-26T00:16:26.185 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-26T00:16:26.185 DEBUG:teuthology.orchestra.run.smithi106:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T00:16:26.188 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-26T00:16:26.197 INFO:teuthology.orchestra.run.smithi106.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T00:16:26.197 INFO:teuthology.orchestra.run.smithi106.stdout:============================================================================== 2024-04-26T00:16:26.197 INFO:teuthology.orchestra.run.smithi106.stdout:*hv01.front.sepi 67.205.162.81 3 u 59 64 377 0.069 -6.241 1.362 2024-04-26T00:16:26.197 INFO:teuthology.orchestra.run.smithi106.stdout:+hv02.front.sepi 63.231.80.2 3 u 65 64 377 0.100 -5.092 0.892 2024-04-26T00:16:26.197 INFO:teuthology.orchestra.run.smithi106.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.097 -5.830 0.713 2024-04-26T00:16:26.197 INFO:teuthology.orchestra.run.smithi106.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-26T00:16:26.198 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2024-04-26T00:16:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2024-04-26T00:16:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:+hv01.front.sepi 67.205.162.81 3 u 60 64 377 0.078 -5.706 0.299 2024-04-26T00:16:26.198 INFO:teuthology.orchestra.run.smithi171.stdout:+hv02.front.sepi 63.231.80.2 3 u 58 64 377 0.092 -3.938 0.321 2024-04-26T00:16:26.199 INFO:teuthology.orchestra.run.smithi171.stdout:*hv03.front.sepi 74.6.168.72 3 u 56 64 377 0.086 -4.396 0.350 2024-04-26T00:16:26.199 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-26T00:16:26.199 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-26T00:16:26.209 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-26T00:16:26.209 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-26T00:16:26.240 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-26T00:16:26.278 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-26T00:16:26.317 INFO:teuthology.task.internal:Duration was 1876.433166 seconds 2024-04-26T00:16:26.317 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-26T00:16:26.346 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-26T00:16:26.346 DEBUG:teuthology.orchestra.run.smithi106:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T00:16:26.349 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-26T00:16:26.410 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-26T00:16:26.411 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi106.front.sepia.ceph.com 2024-04-26T00:16:26.411 DEBUG:teuthology.orchestra.run.smithi106:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T00:16:26.421 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-04-26T00:16:26.421 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-26T00:16:26.442 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-26T00:16:26.443 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T00:16:26.465 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-26T00:16:26.510 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-26T00:16:26.510 DEBUG:teuthology.orchestra.run.smithi106:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T00:16:26.537 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-26T00:16:26.628 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-26T00:16:26.644 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-26T00:16:26.645 DEBUG:teuthology.orchestra.run.smithi106:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T00:16:26.657 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-26T00:16:26.670 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-26T00:16:26.710 DEBUG:teuthology.orchestra.run.smithi106:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:16:26.712 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:16:26.722 INFO:teuthology.orchestra.run.smithi106.stdout:kernel.core_pattern = core 2024-04-26T00:16:26.723 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-04-26T00:16:26.744 DEBUG:teuthology.orchestra.run.smithi106:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:16:26.792 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:16:26.792 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-26T00:16:26.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-26T00:16:26.797 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-26T00:16:26.809 INFO:teuthology.task.internal:Transferring archived files... 2024-04-26T00:16:26.810 DEBUG:teuthology.misc:Transferring archived files from smithi106:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/remote/smithi106 2024-04-26T00:16:26.810 DEBUG:teuthology.orchestra.run.smithi106:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T00:16:26.857 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-25_21:00:03-rados-squid-distro-default-smithi/7673841/remote/smithi171 2024-04-26T00:16:26.857 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-26T00:16:26.877 INFO:teuthology.task.internal:Removing archive directory... 2024-04-26T00:16:26.878 DEBUG:teuthology.orchestra.run.smithi106:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T00:16:26.898 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-26T00:16:26.923 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-26T00:16:26.934 INFO:teuthology.task.internal:Not uploading archives. 2024-04-26T00:16:26.935 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-26T00:16:26.961 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-26T00:16:26.961 DEBUG:teuthology.orchestra.run.smithi106:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T00:16:26.963 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-26T00:16:26.967 INFO:teuthology.orchestra.run.smithi106.stdout: 658638 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 00:16 /home/ubuntu/cephtest 2024-04-26T00:16:26.970 INFO:teuthology.orchestra.run.smithi171.stdout: 658463 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 26 00:16 /home/ubuntu/cephtest 2024-04-26T00:16:26.972 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-26T00:16:27.008 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-26T00:16:27.123 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_workunits} duration: 1876.4331662654877 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-26T00:16:27.123 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-26T00:16:27.201 INFO:teuthology.run:pass